News aggregator is a Django project to scrape a news website using Beautiful soup and request module and hence combination of web crawlers and web applications. Both of these technologies have their implementation in Python.
The news aggregator works in 3 steps:
1.It scrapes the news website for the articles.In this Django project, we are scraping a website 'www.theonion.com'
(The news articles have been scraped from 'latest' section of 'www.theonion.com' for demonstration)
2.Then it stores the article’s images, links, and title.
3.The stored objects in the database are served to the client. The client gets information in a nice template by clicking the 'Load news' button and select the different options available to you.The options are: Latest, Entertainment, Sports, Politics, Opinion,Breaking-News
----------------------------------------------------------------------------------------
Python3
Install the dependencies by running:
pip install bs4
pip install requests
pip install django-social-shareNavigate to the News-Aggregator folder which has manage.py file then run the following command on cmd
python manage.py runserverBackend : Python3,Beautiful soup
Framework : Django
Database : Sqlite3
Frontend : Html,CSS,Bootstrap