Download a geography returns a 500 error (a few times)
Closed this issue · 8 comments
I've tried to download a Geography and the process hanged and I get this exception:
It has been at 95% around 3 minutes without downloading any data (I checked the file size)
cc: @cmongut @oleurud
@josemazo did you find this issue during QA or did you forget to test download feature?
Sometimes the progress bar brokes (not able to find a pattern but it happens to me often 80%):
Could be that progress bar doesn't work when storage API is used?
I've run the download like 10 times and I've not been able to reproduce again the download fail, but the progress bar issue is always there.
Could be that progress bar doesn't work when storage API is used?
They were not returning the total_rows with BQ Storage API, this is the reason why the progress bar always looks full but it counts the rows downloaded.
About the error, I have not seen it before
As an improvement we could take the number of rows of the dataset from the catalog at summary_json
@josemazo did you find this issue during QA or did you forget to test download feature?
I didn't get any 500 errors, but I encountered the fallback to the regular download from the Storage API.
As an improvement we could take the number of rows of the dataset from the catalog at summary_json
If that summary is always updated it's the best idea, if not, some metadata can be accessed from the regular BQ API.
Solved by using DO API