catalyst-cooperative/pudl-archiver

Archive NREL ATB data

Closed this issue · 0 comments

zaneselvans commented

NREL's Annual Technology Baseline (ATB) for electricity is available in a public S3 bucket either as CSV or Paruqet, and is updated annually. The URLs take the form of:

s3://oedi-data-lake/ATB/electricity/FORMAT/YYYY/ATBe.FORMAT

Where:

  • FORMAT is either parquet or csv
  • YYYY is the 4-digit year (2019-2023)

The Parquet files are much smaller and have richer data types, and so seem like the better option.