philbot9/youtube-comment-scraper

Cannot rip from videos with many comments

Closed this issue · 1 comments

http://youtu.be/jCyEX6u-Yhs

Terminator: Dark Fate - Official Teaser Trailer (2019) - Paramount Pictures

Almost 58,000 comment as of this ticket.

I'm using http://ytcomments.klostermann.ca/ and the scrape attempt never completes.

I get the impression that there is a problem when scraping a huge number of comments. Perhaps this is a timeout or issue at the YouTube end, and the scraper has to be throttled. Perhaps partial and resumed scrapes has to be implemented as a workaround.

I don't have the actual commandline program running to give more detailed logs, and perhaps this is only an issue with the website.

After several tries, I came back the next day to try twice more. It did end up completing and giving a download link.

Perhaps the problem is at the website / server end, and it was a server load issue.

I'm going to close this.