The main goal of this project was to try out a docker-compose pipeline combined with an ETL process.
The pipeline|ETL process works as followed:
- Collecting tweets via tweepy
- Loading tweets into MongoDB
- Extracting data from MongoDB and running a sentiment analysis with vaderSentiment
- Loading data into postgresdb
- Writing a flask app to show my dataframe outputs as html