/XX-Intro-to-Data-Science

Intro to data science for BWSI-Remote Sensing

Primary LanguageJupyter NotebookMIT LicenseMIT

05-Intro-to-Data-Science

Intro to data science for BWSI-Remote Sensing

Exercise

Students will download a .csv with 450,000+ rows with the following columns. Using Python, student will be asked to analyze the data and produce statistics and an a GIS analysis of their choosing. Unlike previous exercises, students will need to create their own Colab / Jupyter Notebooks.

Data descriptions

Column Description
FILENAME Full file path of image
LAT_deg Latitude in degrees
LON_deg Longitude in degrees
ELEVATION_m_agl Elevation above ground level in meters
YEAR Calendar year photo was taken
MONTH Calendar month photo was taken
DAY Calendar day photo was taken
HOUR Hour that photo was taken
MINUTE Minute that photo was taken
SECOND Second that photo was taken
STATEFP US Census state code
COUNTYFP US Census county code
COUNTYNS US Census county code
GEOID US Census geoid
KOPPEN Köppen-Geiger climate classification (Legend)

Load data into Google Colab from local file

This code snippet will prompt the user to upload a file in Google Colab.

from google.colab import files
uploaded = files.upload()

Store data in a in a Pandas Dataframe

This code snippet can be used to load the upload file as a Pandas dataframe.

import io
import pandas
data = pandas.read_csv(io.BytesIO(uploaded['FILENAME.csv']))

Supplemental MIT OCW Lectures

MIT OpenCourseWare (OCW) is a web-based publication of virtually all MIT course content. OCW is open and available to the world and is a permanent MIT activity. Here is a list of OCW video lectures related to this course content.

ESD.051J: 10-Step Design Process and Dieter Ram

OCW.051J

6.0002: Clustering

OCW6.0002

6.041: Counting

OCW6.041

References

MIT OCW

Eric Grimson, John Guttag, and Ana Bell. 6.0002 Introduction to Computational Thinking and Data Science. Fall 2016. Massachusetts Institute of Technology: MIT OpenCourseWare, https://ocw.mit.edu. License: Creative Commons BY-NC-SA.

Blade Kotelly, and Joel Schindall. ESD.051J Engineering Innovation and Design. Fall 2012. Massachusetts Institute of Technology: MIT OpenCourseWare, https://ocw.mit.edu. License: Creative Commons BY-NC-SA.

Andrew Sutherland. Combinatorics: The Fine Art of Counting. Summer 2007. Massachusetts Institute of Technology: MIT OpenCourseWare, https://ocw.mit.edu. License: Creative Commons BY-NC-SA.

John Tsitsiklis. 6.041 Probabilistic Systems Analysis and Applied Probability. Fall 2010. Massachusetts Institute of Technology: MIT OpenCourseWare, https://ocw.mit.edu. License: Creative Commons BY-NC-SA.

Data

Rubel, F., and M. Kottek, 2010: Observed and projected climate shifts 1901-2100 depicted by world maps of the Köppen-Geiger climate classification. Meteorol. Z., 19, 135-141. DOI: 10.1127/0941-2948/2010/0430.

TIGER/Line Shapefile, 2018, nation, U.S., Current County and Equivalent National Shapefile

Distribution Statement

DISTRIBUTION STATEMENT A. Approved for public release. Distribution is unlimited.

(C) 2019 Massachusetts Institute of Technology.

Delivered to the U.S. Government with Unlimited Rights, as defined in DFARS Part 252.227-7013 or 7014 (Feb 2014). Notwithstanding any copyright notice, U.S. Government rights in this work are defined by DFARS 252.227-7013 or DFARS 252.227-7014 as detailed above. Use of this work other than as specifically authorized by the U.S. Government may violate any copyrights that exist in this work.