Scrape Comments for Entire Channel?
Opened this issue · 2 comments
Is there a way to pass multiple URLs, or better yet, the channel name to this? I'm not a programmer, but I'd really like something like that. It's not feasible for me to enter in hundreds of video URLs.
Hi,
Unfortunately, scraping multiple URLs is not currently supported. I'm toying with some ideas for version 2 of the Youtube Comment Scraper and scraping a batch of URLs is one of those ideas. Scraping all videos from a channel is also a good idea, but that would be added later, once the batch scraping is working.
Obviously scraping comments from many videos may take a long time, so I'm thinking a solution that allows you to "come back later" for the results will work best here, but that requires some more thought.
There's also the issue of server load, so the system would likely have to scrape the videos sequentially one at a time per user.
I'm glad for any suggestions for version 2 if you have any thoughts.
I wonder if instead you could scrape the comments page from the YouTube dashboard, so it would give the most recent comments, rather than all comments for all time. (I'd personally be looking for something like the last 30 days).