ostrolucky/Bulk-Bing-Image-downloader

Different performance on different computers

sym44 opened this issue · 4 comments

sym44 commented

Hi, I've met a problem that on my mac, bbid can download over 500 images at a time. While on remote ubuntu node, it can only download less than 100 images, with same query and parameters. Could someone explain this a bit?

Thanks in advance!

Performance is dependent on CPU parallel processing power and bandwidth. These tend to be lower on VPS.

sym44 commented

@gadelat Sorry for the misleading title. The issue here is the total amount of images downloaded. (So that is only around 20 or so images could be downloaded on VPS for query like 'earth') Later, I found it may have something to do with the 'break' statement in line 80. For some reason, on VPS, this break will break the entire while True loop. While on my mac, the program will keep running for many iterations.

That break is supposed to break whole loop. It looks like bing returns different results on both machines. Print out response from line 76 on both machines and do a comparison.

Closing, as this doesn't look like a valid issue