/wandb_examples_ci

Minimal notebook CI

Primary LanguageJupyter Notebook

Automating the testing of wandb/examples/colabs

This repo gives a minimal implementation of testing 1 example of the examples repo.

  • The dockerfile has a sort-of minimal pytorch image

Build with: docker build . -t "minimal"

Running the test

docker run -it --rm --gpus all -v $PWD:/wandb minimal

inside the docker container, you should log to wandb:

wandb login

this should be automated in a resonable way preserving credentials

then, you can run the execution of the testing with the nb_helpers.run_nbs

nb_helpers.run_nbs --path  /wandb/Intro_to_Weights_\&_Biases.ipynb

after executing this command, you should find a run.csv file with basic reporting of the execution.

TODO

  • Find a better way to log to wandb, and override project name to something like examples_testing
  • Orchestrate different images with different notebooks types (tensorflow, pytorch, sklearn, etc...)
  • Automate this testing on a machine triggered from a github action