/rls-data

Reef Life Survey data processing

Primary LanguagePythonMIT LicenseMIT

Reef Life Survey data processor

Processing functionality to produce JSONs and other data files for Reef Life Survey tools.

Setup

Develop locally:

$ poetry install
$ poetry run pre-commit install

Or in a VirtualBox:

$ vagrant up

Command line interface

Run rls-data for available commands:

$ poetry run rls-data --help

See .github/workflows/update-data.yml for the update flow example.

Images can be downloaded to data/img/ by changing the scrapy call to include --set ITEM_PIPELINES='{"scrapy.pipelines.images.ImagesPipeline": 1}' --set IMAGES_STORE=data/img.