Lighthouse Labs Data Science Midterm Project
Slide Deck https://slides.com/gailbishop/midterm-project
- db_connection - this notebook creates the Postgres db connection and is imported into other workbooks that require the connection
- Flights Dataframe - this workbook has exploratory data analysis of the Flights data
- Flights Dataframe 2 - this workbook has exploratory data analysis of the Flights data and related Fuel Consumption and Passengers data
- Feature Creation Methods - this workbook contains all methods to create the new features and stores the dataframe as a compressed csv
- Reference Dataframes - this workbook contains methods to create summary reference tables of data for creating aggregate features
- WeatherData - this workbook determines a list of 52 representative cities that were used to query the Weather API, and queries the Weather API for 12 months of aggregate weather data
- Regression Model Evaluation - this workbook run 3 regression models and shows evaluation methods for each
- Run Final Model - this workbook read the Test Data from a csv, runs the saved XGB model and exports the predictions to a csv
- submission_xgb.csv - the prediction file for the first week of January 2020
This contains Pickle files of dataframes created by the Reference Dataframe workbook. These pickle files were then imported into the Feature Creation Methods workbook.