Click here for AGU 2019 Agenda
This repository tutorial materials for half-day workshops that showcase Pangeo JupyterHub deployments. The notebooks directory has Jupyter notebooks that illustrate key python libraries including geopandas, xarray, dask, and intake. You can run these notebooks interactively on BinderHub services like MyBinder.org. Note that these are emphermal computing environments on Public infrastructure, so you may lose work, and don't store passwords!
| Basic content |
|---|
 |
Notebooks in subfolders amazon-web-services and google-cloud combine all these Python libraries and use cluster configurations and datasets stored on Google Cloud (GCP) or Amazon Cloud (AWS). The following binder links launch a predefined computational environment in different Cloud data centers, allowing us to upload our computation rather than download data:
| AWS-specific content | GCP-specific content |
|---|---|
 |
 |
- About Pangeo: Pangeo is a community effort for big data in the geosciences using Python. A key component of the Pangeo effort is the improved integration of Xarray and Dask to enable analysis of very large datasets.
- About Jupyter: Project Jupyter exists to develop open-source software, open-standards, and services for interactive computing across dozens of programming languages. The Jupyter Notebook is an open-source web application that allows you to create and share documents that contain live code, equations, visualizations and narrative text. Uses include: data cleaning and transformation, numerical simulation, statistical modeling, data visualization, machine learning, and much more.
- About Xarray: Xarray is an open source project and Python package that aims to bring the labeled data power of pandas to the physical sciences, by providing N-dimensional variants of the core pandas data structures.
- About Dask: Dask is a flexible parallel computing library for analytic computing.
- About Geopandas: Geopandas is a library to facilitate analysis of geospatial vector data
- About Intake: Intake is a cataloging system designed to "Take the pain out of data access and distribution"
- 2018 AGU workshop: Scalable Geoscience Tools in Python — Xarray, Dask, and Jupyter.
- 2019 AGU workshop: Pangeo: Hands on with JupyterHub and Open-source Python Tools for Scalable Analysis of Big Data in the Geosciences
At its core, Pangeo is a community effort built around open-source software. As such, the credit for the developments of the software described here belongs with the community that created it.
Elements of this tutorial were taken from the xarray, Dask, Cartopy, Holoviews, and Geoviews documentation. Some pieces of text in the xarray portion of the tutorial were adapted from Hoyer and Hamman (2016).
Pangeo is supported by the National Science Foundation (NSF) via the EarthCube Program and the National Aeronautics and Space Administration via the ACCESS Program. NCAR is separately supported by the National Science Foundation (NSF).
Google provided compute credits on Google Compute Engine. Amazon provided compute credits on AWS
This work is licensed under a Creative Commons Attribution 4.0 International License.
