dsfsi/covid19za

[DATA] dsfsi covid data NICD scraper broken

vukosim opened this issue · 2 comments

@krokkie We are having a scraper issue again. Got this from Hugh Murrell

NICD web-scraper is broken.

A few days ago, The NICD changed the presentation format on its
COVID dashboard and as a result faulty data is getting scraped for
your South African provincial Covid count dataset on github.

Quite a few web apps make use of your dataset. Please can you
ask someone to take a look at the problem

The break occurs between 22-11-2021 and 23-11-2021 in this dataset

https://raw.githubusercontent.com/dsfsi/covid19za/master/data/covid19za_provincial_cumulative_timeline_confirmed.csv

and that is when the NICD format changed.

@krokkie can we close this now?