/Ares

Web Scraping, mongoDB

Primary LanguageJupyter Notebook

Ares

A single HTML page was created to display various info. related to Mars. Such info. was lively retrieved simply by clicking the Scrape New Data button on HTML, which sent instructions to scraping app (scrape_mars.py) through connecting with "scrape()" router of Flask server. Data were scraped from various websites, being Latest Mars News from NASA Mars News, Featured Mars Image from Jet Propulsion Laboratory, Mars Weather from Mars Weather on Twitter, Mars Facts from Space Fact, and Mars Hemispheres from USGS Astrogeology. Scraped data were stored in mongoDB. The latest data record was then retrieved from database by "index()" router of Flask app and passed to HTML for display.

screenshot