/covid19-eu-data

Automated Data Collection: COVID-19/SARS-COV-2 Cases in EU by Country, State/Province/Local Authorities, and Date

Primary LanguageHTML

covid19-eu-data

covid19-eu-data is a dataset repository for COVID-19/SARS-CoV-2 cases in Europe. We pull data from official government websites regularly using the open-source scripts inside the repository.

If you would like to help or track the progress of this project, checkout our roadmap.

Update Status

Commit Status:

Workflow status by countries:

Country Status Data Source
AT CI Download AT Data
BE CI Download BE PDF
CZ CI Download CZ Data
DE CI Download DE SARS-COV-2 Cases from RKI
ES CI Download ES PDF Files
FR CI Download FR Data
IT CI Download IT Data
NL CI Download NL SARS-COV-2 Cases from volksgezondheidenzorg
NO CI Download NO Data
PL CI Download PL Data
SE CI Download SE
UK CI Download England Data CI Download Scotland Data
EU(ECDC) CI Download All EU from ECDC

Dataset

Tabular Data

The tabular data files are located in dataset folder. The folder dataset/daily holds the daily updates in each country.

The metadata for the tabular data is found in .dataherb/metadata.yml.

Other Data

Some of the countries publish more than simple tabular data. We cache the files in documents folder.

Scrapers

The scripts that are being used to update the data are located in scripts folder. Most of the scripts require the utils.py module to run. Create a new environment and run pip install -r requirements.txt to install the requirements.

Workflows

The workflows that update the dataset are defined in .github/workflows. The python scripts are scheduled to run on GitHub Actions.

Notes

AT

Caveats:

  1. We started tracking the recovered population and the deaths on 2020-03-13.

BE

  1. Only PDF files of the records are downloaded.

NL

Caveats:

  1. NL doesn't publish the time of the data release. We use 00:00 of the day to denote the release time though it doesn't indicate the actual update time.

UK

England

  1. In the first few days of reporting (before 2020-03-11), data of England is not always a number. To solve this problem, we added two columns, cases_lower and cases_upper, to reflect the range of the number of cases.
  2. England switched to ArcGIS later. We are downloading the CSV file directly.

Wales

  1. Wales stopped publishing detailed data on 2020-03-17.

Northern Ireland

Northern Ireland does not publish detailed data.

IT

  1. The data source also provides the whole time-series data. Set the -f flag to true for scripts/download_it.py to redownload all dates.

Community

Bugs and requests: PRs are welcome.

Issues

Telegram Channel (in Chinese): 新冠肺炎欧洲中文臺

Chat