geospatial-data-catalogs
Introduction
Some of the popular cloud-computing platforms (e.g., AWS, Google Earth Engine, Microsoft Planetary Computer) host a lot of publicly available geospatial datasets. This repo compiles the list of all geospatial datasets on these platforms as a CSV file and as a JSON file, making it easier to find and use them programmatically. The list is updated daily.
Usage
This repo provides the list of geospatial datasets in two formats:
Tab separated values (TSV) format
- AWS Open Data: aws_open_datasets.tsv
- AWS Open Geospatial Data: aws_geo_datasets.tsv
- AWS Open Geospatial Data with STAC endpoint: aws_stac_catalogs.tsv
- STAC Index Catalogs: stac_catalogs.tsv
- Earth Engine Catalog: gee_catalog.tsv
- Planetary Computer Catalog: pc_catalog.tsv
JSON format
- AWS Open Data: aws_open_datasets.json
- AWS Open Geospatial Data: aws_geo_datasets.json
- AWS Open Geospatial Data with STAC endpoint: aws_stac_catalogs.json
- STAC Index Catalogs: stac_catalogs.json
- Earth Engine Catalog: gee_catalog.json
- Planetary Computer Catalog: pc_catalog.json
Examples
The TSV file can be easily read into a Pandas DataFrame using the following code:
import pandas as pd
url = 'https://github.com/giswqs/geospatial-data-catalogs/raw/master/aws_geo_datasets.tsv'
df = pd.read_csv(url, sep='\t')
df.head()Related Projects
- A list of open datasets on AWS: aws-open-data
- A list of open geospatial datasets on AWS: aws-open-data-geo
- A list of open geospatial datasets on AWS with a STAC endpoint: aws-open-data-stac
- A list of STAC endpoints from stacindex.org: stac-index-catalogs
- A list of geospatial datasets on Microsoft Planetary Computer: Planetary-Computer-Catalog
- A list of geospatial datasets on Google Earth Engine: Earth-Engine-Catalog
- A list of geospatial data catalogs: geospatial-data-catalogs