/Twitter-Crawler

Primary LanguagePython

Crawl's the entire Twitter timeline of any user with a public profile and stores it in a folder identical to the users Twitter-Handle (@Username).

Prequesites

  1. Probably ffmpeg installed (not sure).
  2. Python 3.8.
  3. Pip

Setup

  1. Clone or download this repository.
  2. Create and activate a virtual environment within your local copy's directory.
  3. Run pip install -r requirements.txt
  4. Run python crawler.py -user user_name -destination-directory directory

Knwon issues

Twint may be out of date whithin pip repositories; if you run into any issues, try installing Twint from Github directly. To do so, run

pip install --upgrade -e git+https://github.com/twintproject/twint.git@origin/master#egg=twint

within your virtual environment