The idea for this scrapper comes from the following repo holding data from more than 8 years ago.
By running the scrapper, you will scrap every data (sorted per date) from the NUFORC website.
ReportRepresentation.Data scrapped is stored inside data.csv
file inside the project directory. If you don't want to run the scrapper, you can download the dataset.csv
file which may be (and surely is) out of date.
ReportRepresentation.Data inside the CSV file has the same structure as any report webpage (for instance, this one). That is to say :
Date / Time | City | State | Country | Shape | Duration | Summary | Posted | Images |
---|
You will need the following requirements
- Java
- Scala build tool (sbt)
Open a terminal, clone the repository and run sbt
cd <project folder>
sbt run
You should now have a data.csv
file inside <project folder>
.
Currently, latitude and longitude of the reports are missing. They need to be extrapolated from the city of the report.