/template-pytorch-lightning-hydra-wandb-docker

Primary LanguagePython

Template Pytorch-Lightning Hydra Wandb Docker

The code in this repository is based on pytorch/examples.

Template Design

An overview of this template

Configurations written in yaml are in configs directory. You can easily overwrite these configurations through command line arguments.

Instllation

1. sh scripts/docker/build.sh

Run Training

# single run with default settings
poetry run python main.py
# single run
poetry run python main.py gpus=[0,1,2,3] batch_size=128 trainer.accelerator=ddp trainer.precision=16 optimizer=sgd scheduler.step_size=1
# multi runs
poetry run python main.py -m optimizer=adam,rmsprop,sgd trainer.precision=16,32 scheduler.step_size=1

Start Mlflow Server

mlflow ui
# access http://127.0.0.1:5000

Run Formatter

pysen run format