angelchen7/Awesome-Earth-Artificial-Intelligence

A curated list of Earth Science's Artificial Intelligence (AI) tutorials, notebooks, software, datasets, courses, books, video lectures and papers. Contributions most welcome.

Awesome-Earth-Artificial-Intelligence

A curated list of tutorials, notebooks, software, datasets, courses, books, video lectures and papers specifically for Artificial Intelligence (AI) use cases in Earth Science.

Maintained by ESIP Machine Learning Cluster. Free and open to inspire AI for Good.

Contributions are most welcome. Please refer to our contributing guidelines, what is awesome?, and Code of Conduct.

Contents

Courses	Books	Tools	Tutorials	Training Datasets
Code	Videos	Papers	Reports	Thoughts
Competitions	Communities	RelatedAwesome

ML-enthusiastic Earth Scientific Questions

Earth Spheres	Scientific Problems
Geosphere	How to identify hidden signals of earthquakes? How to learn the spatio-temporal relationships amonog earthquakes and make predictions based on the relationship? How to capture complex relationships of volcano-seismic data and classify explosion quakes in volcanos? How to predict landslides How to estimate the damage?
Atmosphere	How to trace and predict climate change using machine learning? How to predict hurricane? How to monitor and predict meteorological drought? How to detect wildfire early? How to monitor and predict air quality? How to predict dust storm? How to accelerate the model simulation and lower the computing costs?
Hydrosphere	How to do high spatio-temporal resoluton waterbody mapping? How to get insights of water quality from remote sensing? How to monitor, and predict snow melt as a water resource?
Biosphere	How to do high spatio-temporal resoluton forest mapping? How to do high spatio-temporal resoluton crop mapping? How to do high spatio-temporal resoluton animal mapping?
Cryosphere	How to do high spatio-temporal resoluton mapping and classification of sea ice? How to monitor and predict glacier/ice sheet mass loss?

▲ Top

Courses

• ML Seminar: Physics-informed Machine learning for weather and climate science (57:35) by Dr. Karthik Kashinath from Lawrence Berkeley National Lab, Mar 19, 2021

• ML Seminar: Scalable Geospatial Analysis (53:23) by Tom Augspurger from Microsoft AI for Earth, May 20, 2021

• Fundamentals of ML and DL in Python - A series of Jupyter notebooks that walk you through the fundamentals of Machine Learning and Deep Learning in python using Scikit-Learn and TensorFlow.

• Trustworthy Artificial Intelligence for Environmental Science (TAI4ES) Summer School will be virtually the week of July 26-30, 2021.

• Artificial Intelligence for Earth System Science (AI4ESS) Summer School repo readinglist

• American Meterological Survey AI Webinar Series

• USGS Artificial Intelligence/Machine Learning Workshop

• Stanford CS 229 ML Cheatsheets

• RadiantEarth ML4EO Bootcamp 2021

• Summer School on High-Performance and Disruptive Computing in Remote Sensing - Scaling Machine Learning for Remote Sensing using Cloud Computing

▲ Top

Books

• How to achieve AI maturity and why it matters? (PDF)

• 70-Years-of-Machine-Learning-in-Geoscience-in-Review

▲ Top

Tools

• eo-learn: Earth observation processing framework for machine learning in Python,

• EarthML website: Tools for working with machine learning in earth science,

• ML visualization tool - A Visualization tool for neural network, deep learning and machine learning models, support ONNX (.onnx, .pb, .pbtxt), Keras (.h5, .keras), Core ML (.mlmodel), Caffe (.caffemodel, .prototxt), Caffe2 (predict_net.pb), Darknet (.cfg), MXNet (.model, -symbol.json), Barracuda (.nn), ncnn (.param), Tengine (.tmfile), TNN (.tnnproto), UFF (.uff) and TensorFlow Lite (.tflite).

• Dopamine is a research framework for fast prototyping of reinforcement learning algorithms,

• mlflow - MLflow: A Machine Learning Lifecycle Platform,

• Snips NLU Snips NLU (Natural Language Understanding) is a Python library that allows to extract structured information from sentences written in natural language.

• MindsDB - MindsDB is an Explainable AutoML framework for developers built on top of Pytorch. It enables you to build, train and test state of the art ML models in as simple as one line of code.

• TensorFlow Hub TensorFlow Hub is a repository of reusable assets for machine learning with TensorFlow. In particular, it provides pre-trained SavedModels that can be reused to solve new tasks with less training time and less training data.

• Polyaxon - Polyaxon, a platform for building, training, and monitoring large scale deep learning applications. A Machine Learning Platform for Kubernetes.

• SynapseML - SynapseML (previously MMLSpark) is an open source library to simplify the creation of scalable machine learning pipelines. Microsoft Machine Learning for Apache Spark,

• TransmogrifAI - TransmogrifAI (pronounced trăns-mŏgˈrə-fī) is an AutoML library written in Scala that runs on top of Apache Spark. It was developed with a focus on accelerating machine learning developer productivity through machine learning automation, and an API that enforces compile-time type-safety, modularity, and reuse.

• Microsoft AI for Earth API Platform - Microsoft AI for Earth API Platform is a distributed infrastructure designed to provide a secure, scalable, and customizable API hosting, designed to handle the needs of long-running/asynchronous machine learning model inference. It is based on Azure and Kubernetes.

• OneFlow - OneFlow is a performance-centered and open-source deep learning framework.

• ml.js - ml.js - Machine learning tools in JavaScript.

• BentoML - BentoML is an open-source framework for high-performance ML model serving.

• flashflight: - flashflight: A C++ standalone library for machine learning.

• Xarray-Beam - Python library for building Apache Beam pipelines with Xarray datasets.

▲ Top

Tutorials

• Pixel-level land cover classification

• EO-learn-workshop - EO-learn-workshop: Bridging Earth Observation data and Machine Learning in Python,

• Machine Learning for Development Machine Learning for Development: A method to Learn and Identify Earth Features from Satellite Images,

• ELSI-DL-Bootcamp - Intro to Machine Learning and Deep Learning for Earth-Life Sciences,

• UW WaterhackerWeek - Introduction to Machine Learning on Landslide Data and Scikit-learn from UW WaterhackerWeek,

• Planet Snow Mapping - Introduction to using Planet imagery to map snow cover

• Machine Learning Pipeline for Climate Science - an end-to-end pipeline for the creation, intercomparison and evaluation of machine learning methods in climate science

• AI Cheatsheets - Essential Cheat Sheets for deep learning and machine learning engineers. It contains a lot of useful tutorials to learn awesome tricks on AI engineering

▲ Top

Training Data

• Kaggle Earth Science Training Dataset

• Radiant MLHub - an open library for geospatial training data

• Google Earth Engine Data Catalog

• University of California Irvine Machine Learning Repository

• EuroSAT Dataset - EuroSAT Dataset: Land Use and Land Cover Classification with Sentinel-2,

• Awesome Satellite Imagery Datasets - Awesome Satellite Imagery Datasets: A curated list of deep learning training datasets,

• STanford EArthquake Dataset (STEAD) - A Global Data Set of Seismic Signals for AI

▲ Top

Code

• 👓Earth System Emulator (ESEm) - A tool for emulating geophysical datasets including (but not limited to) Earth System Models

• 👓EmissionAI - Microsoft AI for Earth Project: AI Monitoring Coal-fired Power Plant Emission from Space

• BassNet,paper-preprint - Deep Learning for Land-cover Classification in Hyperspectral Images,

• MTLCC - Multitemporal Land Cover Classification Network (ConvLSTM, ConvGRU),

• Landsat Time Series Analysis for Multi-Temporal Land Cover Classification

• EarthEngine-Deep-Learning - Deep Learning on Google Earth Engine,

• Continuous Change Detection and Classification - Continuous Change Detection and Classification (CCDC) of land cover using all available Landsat data,

• Object-based Classification on Earth Engine - Object-based land cover classification with Feature Extraction and Feature Selection for Google Earth Engine (GEE),

• Earth Lens - Earth Lens, a Microsoft Garage project is an iOS iPad application that helps people and organizations quickly identify and classify objects in aerial imagery through the power of machine learning.

• Image Classification Neural Network Ranking with source code - paperswithcode has put together a list of cutting-edge papers and ranked them with the claimed accuracy.

• EQTransformer - An AI-Based Earthquake Signal Detector and Phase Picker.

• Tropical Cyclone Windspeed Estimator - Winning solutions for Tropical Cyclone Wind Speed Prediction Competition

▲ Top

Videos

• Tutorial on Microsoft Azure Machine Learning Studio (AutoML-Regression), created by Microsoft AI for Earth Project: AI Monitoring Coal-fired Power Plant Emission from Space.

▲ Top

Papers

• 👓CIRA Guide To Custom Loss Functions For Neural Networks In Environmental Sciences - Version 1

• 👓Zero-Shot Learning of Aerosol Optical Properties with Graph NeuralNetworks

• 👓 NeuralHydrology - a collection of papers on using neural networks in hydrology

• Ten Ways to Apply Machine Learning in Earth and Space Sciences

• Advancing AI for Earth Science: A Data Systems Perspective

• Google Earth Engine: Planetary-scale geospatial analysis for everyone

▲ Top

Reports

• Workshop Report: Advancing Application of Machine Learning Tools for NASA’s Earth Observation Data

▲ Top

Thoughts

• Why 90% of machine learning models never hit the market

• 'Farewell Convolutions' – ML Community Applauds Anonymous ICLR 2021 Paper That Uses Transformers for Image Recognition at Scale

• 37 reasons why your neural network is not working

▲ Top

Competitions

• 👓GPU Hackthons - designed to help scientists, researchers and developers to accelerate and optimize their applications on GPUs.

• LANL Earthquake Prediction

• HackerEarth

▲ Top

Communities

• ESIP Machine Learning Cluster

• ESIP Agriculture and Climate Cluster

▲ Top

RelatedAwesome

• Awesome-Open-Geoscience – A list is curated from repositories that make our lives as geoscientists, hackers and data wranglers easier or just more awesome. In accordance with the awesome manifesto, we add awesome repositories.
• Awesome-Spatial – Awesome list for geospatial, not specific to geoscience but significant overlap
• Awesome Open Climate Science – Awesome list for atmospheric, ocean, climate, and hydrologic science
• Awesome Coastal – Awesome list for coastal engineers and scientists
• Awesome Satellite Imagery Datasets - List of aerial and satellite imagery datasets with annotations for computer vision and deep learning
• Awesome Workflow Engines - A curated list of awesome open source workflow engines
• Awesome Pipeline - A curated list of awesome pipeline toolkits inspired by Awesome Sysadmin
• Awesome Machine Learning - A curated list of awesome Machine Learning frameworks, libraries and software

▲ Top