/Model-References

TensorFlow and PyTorch Reference models for Gaudi(R)

Primary LanguagePython

Habana Deep Learning Examples for Training and Inference

Model List and Performance Data

Please visit this page for performance information.

This repository is a collection of models that have been ported to run on Habana Gaudi AI accelerator. They are intended as examples, and will be reasonably optimized for performance while still being easy to read.

Computer Vision

Models Framework Validated on Gaudi Validated on Gaudi2
ResNet50, ResNeXt101 PyTorch ✔ ✔
ResNet152 PyTorch ✔
MobileNetV2 PyTorch ✔
UNet 2D, Unet 3D PyTorch ✔ ✔
SSD PyTorch ✔ ✔
GoogLeNet PyTorch ✔
Vision Transformer PyTorch ✔
DINO PyTorch ✔
YOLOX PyTorch ✔
YOLOV3 PyTorch ✔
ResNet50 Keras TensorFlow ✔ ✔
ResNeXt101 TensorFlow ✔ ✔
SSD TensorFlow ✔ ✔
Mask R-CNN TensorFlow ✔ ✔
UNet 2D TensorFlow ✔ ✔
UNet 3D TensorFlow ✔ ✔
UNet Industrial TensorFlow ✔
DenseNet TensorFlow ✔
EfficientDet TensorFlow ✔
SegNet TensorFlow ✔
Vision Transformer TensorFlow ✔

Natural Language Processing

Models Framework Validated on Gaudi Validated on Gaudi2
BERT Pretraining PyTorch ✔ ✔
BERT Finetuning PyTorch ✔ ✔
DeepSpeed BERT-1.5B, BERT-5B PyTorch ✔
Transformer PyTorch ✔ ✔
BART PyTorch ✔
HuggingFace BLOOM PyTorch ✔ ✔
Megatron-DeepSpeed BLOOM 13B PyTorch ✔
BERT TensorFlow ✔ ✔
DistilBERT TensorFlow ✔
Transformer TensorFlow ✔ ✔
Electra TensorFlow ✔

Recommender Systems

Models Framework Validated on Gaudi Validated on Gaudi2
Wide & Deep TensorFlow ✔

Audio

Models Framework Validated on Gaudi Validated on Gaudi2
Wav2vec 2.0 PyTorch ✔ ✔
Wav2Vec2ForCTC PyTorch ✔ ✔

Generative Models

Models Framework Validated on Gaudi Validated on Gaudi2
V-Diffusion PyTorch ✔
Stable Diffusion PyTorch ✔ ✔
Stable Diffusion Training PyTorch ✔
Stable Diffusion v1.5 PyTorch ✔ ✔
Stable Diffusion v2.1 PyTorch ✔
CycleGAN TensorFlow ✔

MLPerf™ 2.1

Models Framework Validated on Gaudi Validated on Gaudi2
ResNet50 Keras PyTorch ✔
BERT PyTorch ✔
ResNet50 Keras TensorFlow ✔
BERT TensorFlow ✔

MLPerf™ is a trademark and service mark of MLCommons Association in the United States and other countries. All rights reserved. Unauthorized use is strictly prohibited.

Reporting Bugs/Feature Requests

We welcome you to use the GitHub issue tracker to report bugs or suggest features.

When filing an issue, please check existing open, or recently closed, issues to make sure somebody else hasn't already reported the issue. Please try to include as much information as you can. Details like these are incredibly useful:

  • A reproducible test case or series of steps
  • The version of our code being used
  • Any modifications you've made relevant to the bug
  • Anything unusual about your environment or deployment

Community

Hugging Face