/Project3-Census

Primary LanguageJupyter Notebook

Project3-Census

Topic

Dataset

API Call 3: Income data by county (corresponding to 2 years in API call 1)

API Call 4: Death rate by county (corresponding to 2 years in API call 1)

Geo-coding of state-county

Explore to gather data in geo-json format. If not convert api data to geo json

Inspiration

Visuals

Proposal

  • param_config_file

    • Capture the mongodb db name
    • endpoints
    • flask site port
  • Geo coding data for (State,county)

  • INSU_DATA / API Call 1 ("Insured","Un-insured","State","County" "Year", "lat","lon")

  • POP_DATA / API Call 2 ("Population_Count","State","County","Year","lat","lon")

  • INCO_DATA / API Call 3 ("Income","State","County","Year","lat","lon")

  • DEATH_DATA / API Call 4 ("Death_count","State","County","Year","lat","lon")

  • Database (MongoDB) (for each dataset) (refer to module 12-1)

  • ETL routines to clean up and merge data for rendering into starter database

  • Initialize database with api calls to feed the starter database

  • Build a Python flask service layer to initialize the map rendering with dataset from mongoDB (refer to module 10-3 flask)

  • Incorporate leaflets / plotly to enable user interaction with the data visualization

  • Read data via api using python and imported it into MongoDB

  • Imported data from flat files into json

  • created indexes on mongo db for quicker access by state and county fips

  • used python scripts to merge datasets about counties

  • mongodb cannot accept numbers as key

  • if you are using plotly the scripts go at the end so the javascript engine can see the DOM elements

  • Just when you thought there is not enough charting engines.. there is MongoDB charts - https://www.mongodb.com/products/charts