TannerGilbert/Tutorials

Scraping comments for each post together

Vibhuarvind opened this issue · 2 comments

Vibhuarvind commented

what if I want to scrape posts along with the comment on each post into csv? How do i do it?

TannerGilbert commented

This depends on if the website is static or dynamic. If it's static, you can scrape it with BeautifulSoup and save the results into a CSV. If the website is dynamic, you'll need a tool that allows you to render the browser like Selenium. For more information, check out 'Python Web Scraping - Dynamic Websites'.

  • 👀1
github-actions commented

This issue is stale because it has been open 30 days with no activity. Remove stale label or comment or this will be closed in 5 days