Denmark-Mentions
A simple social media scraper for Denmark
Files Description
-
yt_channels_list.json: This file contains a list of youtube channels scraped from Social Bakers in JSON format.
-
fb_pages_list.json: This file contains a list of facebook pages scraped from Social Bakers in JSON format.
-
app /
- facebook_script.py: This script uses facebook graph api to fetch posts and comments from the pages listed in
fb_pages_list.json
file. This script also saves the results as django models into postgres database. - youtube_script.py: This script uses youtube data api to fetch comments from all the videos from all the channels listed in
yt_channels_list.json
. This script also saves the results as django models into postgres database. - yt_channels_list.py: This script works if
yt_channels_list.json
is unavailable, in that case, the script fetches the survey from social bakers website and restores youtube channels list into the same json file. - fb_pages_list.py: This script works if
fb_pages_list.json
is unavailable, in that case, the script fetches the survey from social bakers website and restores the facebook pages list into the same json file. - forms.py: This file contains django forms for displaying on homepage.
- models.py: This file contains django models for storing results after fetching data about pages and channels from facebook and youtube respectively.
- views.py: This file contains view function about updating the entire database.
- facebook_script.py: This script uses facebook graph api to fetch posts and comments from the pages listed in
-
dkmentions /
- prod_settings.py: This file contains database settings for production environment.
- settings.py: This file contains database settings for local development environment.
- urls.py: This file contains url patterns for the website.
- views.py: This file contains all the views for the application except update view.