A twitter scrapper using nodejs + puppeteer. Coupled with sentiment analysis
- NodeJS - Express JS to load the scrapper in browser link
- Puppeteer - start a headless instance of chrome to scrape twitter
- socket.io - to send the scrapped twitter data to browser
- wink-sentiment - perform sentiment analysis on data
- D3 - used in browser to render bubble chart.
- install all dependencies with
npm install
- run
npm start
to start server using nodemon - Load the browser link
- Put the hashtag and days (both are needed to activate the button)
- Level 1 - use this to search just the hashtag
- Level 2 - use this to search all the handles who tweeted the searched hashtag for the entered number of days
- show tweets
- allow user to save tweets
- show scrapping progress in browser
- stemming