This project is a simple Twitter scraper built with FastAPI and Selenium. It allows you to scrape tweets from a specified Twitter user.
- Scrape tweets from a Twitter user.
- Retrieve the profile title and posts.
- Asynchronous processing with FastAPI.
- JSON response with scraped data.
- Python 3.8+
- Selenium
- FastAPI
- Uvicorn
- WebDriver (e.g., ChromeDriver)
git clone https://github.com/osmandlsmn/python-101.git
cd twitter-scrape
python -m venv venv
source venv/bin/activate # On Windows use `venv\Scripts\activate`
pip install -r requirements.txt
make run
uvicorn src.main:app --host 0.0.0.0 --port 3000 --reload
twitter-scrape/
├── src/
│ ├── main.py
│ └── utils/
│ └── selectors.py
├── requirements.txt
├── Makefile
└── README.md