Improve download status for Mitads

Question

Improve download status for Mitads

Closed this issue 4 years ago · 6 comments

This is what happens with parlareitaliano:

...17066%, 0 MB, 58052 KB/s, 0 seconds passedDownloading in ./parsing/parlareitaliano/b01f001f.hsw
...12047%, 0 MB, 45343 KB/s, 0 seconds passedDownloading in ./parsing/parlareitaliano/b01f003f.hsw
...24824%, 0 MB, 59074 KB/s, 0 seconds passedDownloading in ./parsing/parlareitaliano/b01f005f.hsw

We need to test all the importers for their status bar because sometimes don't works flawlessy.

Answer 1 · 2020-10-01T15:06:53.000Z

in all the scripts?

Answer 2 · 2020-10-01T16:30:22.000Z

Yes, we have an internal library but doesn't works often

Answer 3 · 2020-10-03T20:21:33.000Z

I don't think that problem is due to the progress bar itself. I tried with a different progress bar implementation and I get the same result: for corpus_api.py the progress starts at 100% and the seconds count do not start. This problem happens only with corpus_api.py and not with the other scrapers

Answer 4 · 2020-10-05T13:50:13.000Z

So it is a bug just of that corpus.
This #103 fix the issue?

Answer 5 · 2020-10-05T14:01:50.000Z

No, it doesn't. Now the % won't go over 100% and I added a line break

Answer 6 · 2020-10-05T14:05:54.000Z

Well anyway is a bugfix :-D