/infinite-twitter-crawler

python crawler used for twitter infinite scrolling page

Primary LanguagePythonMIT LicenseMIT

infinite-twitter-crawler

Description

This python crawler script is meant to download tweet message from a twitter infinite scrolling page. The message and its time stamp will be saved as a csv file.

Dependencies

  • Python 3.7
  • BeautifulSoup 4.6.3
  • Selenium 3.141.0

Execution

  1. Download this project.
  2. Run the script as below.
python crawler.py
  1. Set file name, or default will be used. Set path to chrome driver or default will be used.