This is the source code for the Databricks article on how to scale PyTorch lightning.
It covers:
- Usage of Petastorm
- Usage of Horovod
Scaling from single to multi-gpu.
The order to review the notebooks are:
- Exploring the flowers dataset
- Building the PyTorch Lightning Modules
- Main Execution Notebook
Associated blog article is :