/Gaudi-tutorials

Tutorials for running models on First-gen Gaudi and Gaudi2 for Training and Inference. The source files for the tutorials on https://developer.habana.ai/

Primary LanguageJupyter Notebook

Gaudi Tutorials

These are the source files for the tutorials on https://developer.habana.ai/.

The tutorials provide step-by-step instructions for PyTorch and PyTorch Lightning on Intel Gaudi AI Processor. From beginner level to advanced users.

The tutorials will cover the following domains and tasks:

Advanced

  • Fine Tuning with LORA and Inference on Hugging Face Llama 2 70B model
  • Full RAG application with TGI-gaudi
  • RAG application with Local GPT modified to run on Intel Gaudi
  • How to setup and use DeepSpeed for Training Large Language Models

Intermediate

  • GPU migration Tool
  • Debug for Dynamic Shapes
  • Running Simple Inference examples with HPU Graph
  • How to use the Gaudi Tensorboard Plug-in for Profiling
  • Running DeepSpeed on PyTorch Lightning with GPT2
  • BERT Fine Tuning use PyTorch Lightning

Getting Started

  • Quick Start Overall review of Model-References, Hugging Face and DeepSpeed
  • Mixed Precision Show how to use Autocast
  • Training a Classifier Basic PyTorch Tutorial
  • Quickstart_tutorial, Basic PyTorch Tutorial
  • Introduction to Lightning Running simple PyTorch Lightning model, using Gaudi plug-in