/wilds-project

Primary LanguageJupyter NotebookMIT LicenseMIT

Wilds-project

Description

WILDs is a benchmark of in-the-wild distribution shifts spanning diverse data modalities and applications, from tumor identification to wildlife monitoring to poverty mapping.

This repo contains my infrastructure to maintain experiments on the dataset.

How to run an interactive terminal in my environment

First, download docker.

Second, run for an interactive terminal

make run

How to run an experiment

make run -- python src/train.py
    --experiment-id 'test_model'

How to make an experiment

  1. See example test experiment at src/experiments/test_model.py
  2. Inside of src/experiments/experiments.py import the new experiment
  3. Run make run -- python src/train.py --experiment-id '<experiment_name>'

Linting

make lint

Tests

make test

Citation

@article{wilds-project,
  title={Wilds project},
  author={Adrian Orenstein},
  journal={GitHub. Note: https://github.com/AdrianOrenstein/wilds-project},
  year={2021}
}

push to public

git push public public:master