Data Download Problem

Question

Data Download Problem

tjuwyh opened this issue 4 years ago · 29 comments

Hi, thank you for your interesting work!
I have a problem when trying to download the provided dataset annotations and features since the one drive link provided cannot be visited in China without a VPN. So it's difficult for me to prepare the data on my ubuntu machine.
Do you have any generous advice for me to solve this problem? Or would you please provide another download link that can be easily connected in China for MSCOCO data?
Thank you!

Answer 1 · 2020-11-21T04:00:55.000Z

@tjuwyh Could you point me to the OneDrive files you want to download (the links)? I will upload those files to Baidu Pan for you if they are under the size limit.

Answer 2 · 2020-12-06T06:22:28.000Z

你可以分享flickr30k到百度网盘吗？我用了vpn,onedrive一直下载不成功，

https://onedrive.live.com/download?cid=E5364FD183A1F5BB&resid=E5364FD183A1F5BB%212015&authkey=AFZ2iehPM8HREeA

非常感谢！

Answer 3 · 2020-12-08T02:51:21.000Z

Please upload this link file to the Baidu Pan, Thanks

"https://onedrive.live.com/download?cid=E5364FD183A1F5BB&resid=E5364FD183A1F5BB%212015&authkey=AFZ2iehPM8HREeA"

Answer 4 · 2020-12-08T07:20:47.000Z

The links in the projects have become invalid. Please upload this link file to the Baidu Pan, Thanks, "https://onedrive.live.com/?id=root&cid=9D5EEB4DA610D7AC"

Answer 5 · 2020-12-08T07:27:36.000Z

Hi all, I am now uploading the files you requested. However, uploading feature files to Baidu Pan is extremely slow from my end. I will announce here once all the uploads are completed at location https://pan.baidu.com/s/1JSgQmBYJWkuH910Y1xN7EQ 提取码: wkpe

I will split the zipped file into multiple files due to the size limit in Baidu Pan. You can join them with this tool once they are ready: https://pinetools.com/join-files

Answer 6 · 2020-12-08T07:30:10.000Z

The links in the projects have become invalid. Please upload this link file to the Baidu Pan, Thanks, "https://onedrive.live.com/?id=root&cid=9D5EEB4DA610D7AC"

@TangDonnie I do not see this link in the repo. Where did you get it? Can you confirm that it is from VLP?

Answer 7 · 2020-12-08T07:33:46.000Z

Sorry, I have given the wrong link. I have successfully downloaded the flickr30k dataset with given command two weeks ago. But it does not work today when I was trying to download coco caption dataset with given commands.

Answer 8 · 2020-12-08T07:38:43.000Z

Hi Luowei, Thanks for you efforts, I know it’s very slow to upload large files to baidu pan from states, is it convenient for you to upload in google drive? I think I found a way download from Onedrive, but seems links no longer available, please check all data onedrive links. Thanks Zency

…

On Dec 8, 2020, at 15:27, Luowei Zhou ***@***.***> wrote: Hi all, I am now uploading the files you requested. However, uploading feature files to Baidu Pan is extremely slow from my end. I will announce here once all the uploads are completed at location https://pan.baidu.com/s/1JSgQmBYJWkuH910Y1xN7EQ <https://pan.baidu.com/s/1JSgQmBYJWkuH910Y1xN7EQ> 提取码: wkpe I will split the zipped file into multiple files due to the size limit in Baidu Pan. You can join them with this tool once they are ready: https://pinetools.com/join-files <https://pinetools.com/join-files> — You are receiving this because you commented. Reply to this email directly, view it on GitHub <#33 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/ACLX7ZBVXS67KXFXE6PYKV3STXIPNANCNFSM4TS64QMQ>.

Answer 9 · 2020-12-08T07:40:51.000Z

@zencyyoung @LuoweiZhou It seems that we are confronted with same problems.

Answer 10 · 2020-12-08T07:46:30.000Z

@TangDonnie is it convenient for you share the flickr30k dataset？

Answer 11 · 2020-12-08T07:51:25.000Z

@zencyyoung Sorry, it is not quite convenient for me to share for some private reasons. We shall hope that the author @LuoweiZhou will fix this problems as soon. Thanks.

Answer 12 · 2020-12-08T08:03:08.000Z

Many thanks!

…

------------------ 原始邮件 ------------------ 发件人: "Luowei Zhou"<notifications@github.com>; 发送时间: 2020年12月8日(星期二) 下午3:27 收件人: "LuoweiZhou/VLP"<VLP@noreply.github.com>; 抄送: "Gin"<xixiareone@foxmail.com>; "Comment"<comment@noreply.github.com>; 主题: Re: [LuoweiZhou/VLP] Data Download Problem (#33) Hi all, I am now uploading the files you requested. However, uploading feature files to Baidu Pan is extremely slow from my end. I will announce here once all the uploads are completed at location https://pan.baidu.com/s/1JSgQmBYJWkuH910Y1xN7EQ 提取码: wkpe I will split the zipped file into multiple files due to the size limit in Baidu Pan. You can join them with this tool once they are ready: https://pinetools.com/join-files — You are receiving this because you commented. Reply to this email directly, view it on GitHub, or unsubscribe.

Answer 13 · 2020-12-08T17:29:53.000Z

The download error occurs occasionally (I believe it's an OneDrive thing). Please try a few more times with either wget or direct download to your local.

Answer 14 · 2020-12-09T16:31:03.000Z

Hi all, I am now uploading the files you requested. However, uploading feature files to Baidu Pan is extremely slow from my end. I will announce here once all the uploads are completed at location https://pan.baidu.com/s/1JSgQmBYJWkuH910Y1xN7EQ 提取码: wkpe

I will split the zipped file into multiple files due to the size limit in Baidu Pan. You can join them with this tool once they are ready: https://pinetools.com/join-files

The upload is now completed. Please let me know if you encounter any issues.

Answer 15 · 2020-12-10T03:23:20.000Z

@LuoweiZhou The download link of coco captions is still not valid now, I have tried over seven times, but it is not work properly.

Answer 16 · 2020-12-11T03:41:29.000Z

@LuoweiZhou It works as I tried several times todays, thanks

Answer 17 · 2020-12-12T02:04:51.000Z

@LuoweiZhou @xixiareone Could you share MSCOCO to baidu pan? I haven't been able to download successfully, thanks

Answer 18 · 2020-12-12T18:09:20.000Z

@jasscia18 I am uploading them now. I Will keep you posted once it finishes (likely early next week given the current uploading speed).

Answer 19 · 2020-12-15T07:35:22.000Z

Hi @LuoweiZhou , I've uploaded the COCO part of your data to my Baidu disk, would you mind me share it here?

The data is in BaiduDisk (code: ljz3)

Answer 20 · 2020-12-15T16:59:54.000Z

@bearcatt Sure, go for it. Thanks!

Answer 21 · 2020-12-18T07:47:07.000Z

Could you please also help upload the config and checkpoint of Detectron feature extractor to Baidu Pan?
Their onedrive links can neither be reached ..

`# Detectron config/model
wget -O e2e_faster_rcnn_X-101-64x4d-FPN_2x-vlp.yaml "https://onedrive.live.com/download?cid=E5364FD183A1F5BB&resid=E5364FD183A1F5BB%212013&authkey=AHIvnE1FcggwiLU"

wget -O e2e_faster_rcnn_X-101-64x4d-FPN_2x-vlp.pkl "https://onedrive.live.com/download?cid=E5364FD183A1F5BB&resid=E5364FD183A1F5BB%212014&authkey=AAHgqN3Y-LXcBvU"`

Answer 22 · 2020-12-18T17:12:05.000Z

The download error occurs occasionally (I believe it's an OneDrive thing). Please try a few more times with either wget or direct download to your local.

@ChenYutongTHU

Answer 23 · 2020-12-20T01:37:43.000Z

The download error occurs occasionally (I believe it's an OneDrive thing). Please try a few more times with either wget or direct download to your local.

@ChenYutongTHU
Great thanks! A VPN is needed here to download OneDrive Stuff :)

Answer 24 · 2020-12-21T12:16:51.000Z

Hi @LuoweiZhou , I've uploaded the COCO part of your data to my Baidu disk, would you mind me share it here?

The data is in BaiduDisk (code: ljz3)

Does this document contain regional features？

Answer 25 · 2020-12-21T12:46:33.000Z

Does this document contain regional features？

yes

Answer 26 · 2020-12-21T12:47:15.000Z

Hi Luowei, Thanks for you efforts, I know it’s very slow to upload large files to baidu pan from states, is it convenient for you to upload in google drive? I think I found a way download from Onedrive, but seems links no longer available, please check all data onedrive links. Thanks Zency
…
On Dec 8, 2020, at 15:27, Luowei Zhou @.***> wrote: Hi all, I am now uploading the files you requested. However, uploading feature files to Baidu Pan is extremely slow from my end. I will announce here once all the uploads are completed at location https://pan.baidu.com/s/1JSgQmBYJWkuH910Y1xN7EQ https://pan.baidu.com/s/1JSgQmBYJWkuH910Y1xN7EQ 提取码: wkpe I will split the zipped file into multiple files due to the size limit in Baidu Pan. You can join them with this tool once they are ready: https://pinetools.com/join-files https://pinetools.com/join-files — You are receiving this because you commented. Reply to this email directly, view it on GitHub <#33 (comment)>, or unsubscribe https://github.com/notifications/unsubscribe-auth/ACLX7ZBVXS67KXFXE6PYKV3STXIPNANCNFSM4TS64QMQ.

Could you share your way of downloading such large data from Onedrive please? Thanks

Answer 27 · 2020-12-21T12:48:23.000Z

Does this document contain regional features？

yes

But I can only found one h5 document which seems to be the boundbox file.

Answer 28 · 2020-12-21T15:15:49.000Z

But I can only found one h5 document which seems to be the boundbox file.

They are in the folder COCO/region_feat_gvd_wo_bgd/feat_cls_1000/

Answer 29 · 2020-12-21T22:27:24.000Z

Hi all, I am now uploading the files you requested. However, uploading feature files to Baidu Pan is extremely slow from my end. I will announce here once all the uploads are completed at location https://pan.baidu.com/s/1JSgQmBYJWkuH910Y1xN7EQ 提取码: wkpe
I will split the zipped file into multiple files due to the size limit in Baidu Pan. You can join them with this tool once they are ready: https://pinetools.com/join-files

The upload is now completed. Please let me know if you encounter any issues.

@bearcatt Thanks for the help! My version on COCO with 48 file splits is also ready at https://pan.baidu.com/s/1JSgQmBYJWkuH910Y1xN7EQ 提取码: wkpe