How should we deal with URL expiration
JaniceLC opened this issue · 1 comments
JaniceLC commented
Hi,
Thanks for providing this wonderful benchmark. I am trying to download the datasets. however some URL expired like below,
https://live.staticflickr.com/3350/3328832525_53137b4dc8_c.jpg 43 | HTTP Error 404: Not Found
https://live.staticflickr.com/65535/51711998126_44424b26e4_c.jpg 89 | HTTP Error 410: Gone
https://live.staticflickr.com/2948/15328105477_2179fc52df_c.jpg 29 | HTTP Error 404: Not Found
https://live.staticflickr.com/8346/8197016789_13861519b4_c.jpg 46 | HTTP Error 404: Not Found
https://live.staticflickr.com/65535/50817719423_91aa5b9eee_c.jpg 44 | HTTP Error 404: Not Found
https://live.staticflickr.com/677/20659591775_566ba4c359_c.jpg 14 | HTTP Error 410: Gone
https://live.staticflickr.com/930/42159145080_8dbfe0cd4d_c.jpg 112 | HTTP Error 404: Not Found
https://live.staticflickr.com/65535/51274576030_bf0d80f6cd_c.jpg 31 | HTTP Error 410: Gone
https://live.staticflickr.com/3/5988371_0298fa95f1_c.jpg 83 | HTTP Error 410: Gone
https://live.staticflickr.com/4715/40072461222_89996e7368_c.jpg 90 | HTTP Error 404: Not Found
https://live.staticflickr.com/3790/14077299849_e40c525317_c.jpg 78 | HTTP Error 404: Not Found
https://live.staticflickr.com/3564/3328797301_8dfd3aeb6c_c.jpg 43 | HTTP Error 404: Not Found
https://live.staticflickr.com/8344/8198106188_e5da145e85_c.jpg 46 | HTTP Error 404: Not Found
https://live.staticflickr.com/1292/777343748_53a9ee15e5_c.jpg 32 | HTTP Error 410: Gone
https://live.staticflickr.com/30/65749667_7e1d6d3ff3_c.jpg 98 | HTTP Error 404: Not Found
https://live.staticflickr.com/4202/34190970073_1ff540d6e7_c.jpg 112 | HTTP Error 404: Not Found
How should we deal with the missing data?
Thank you!
ZhangYuanhan-AI commented
Hi, Janice.
You can give me the complete list of expired URLs (as follow), and I can upload them to my google drive.
REALM_NAME
https://live.staticflickr.com/3350/3328832525_53137b4dc8_c.jpg 43 | HTTP Error 404: Not Found
https://live.staticflickr.com/65535/51711998126_44424b26e4_c.jpg 89 | HTTP Error 410: Gone
XXX