/Model-References

TensorFlow and PyTorch Reference models for Gaudi(R)

Primary LanguagePython

Habana Deep Learning Examples for Training and Inference

Model List and Performance Data

Please visit this page for performance information.

This repository is a collection of models that have been ported to run on Habana Gaudi AI accelerator. They are intended as examples, and will be reasonably optimized for performance while still being easy to read.

Computer Vision

Models Framework Validated on Gaudi Validated on Gaudi2
ResNet50, ResNeXt101 PyTorch Training Training, Inference
ResNet152 PyTorch Training -
MobileNetV2 PyTorch Training -
UNet 2D, Unet3D PyTorch Training, Inference Training, Inference
SSD PyTorch Training Training
GoogLeNet PyTorch Training -
Vision Transformer PyTorch Training -
DINO PyTorch Training -
YOLOX PyTorch Training -
YOLOV3 PyTorch Training -
ResNet50 Keras TensorFlow Training Training
ResNeXt101 TensorFlow Training Training
SSD TensorFlow Training Training
Mask R-CNN TensorFlow Training Training
UNet 2D TensorFlow Training Training
UNet 3D TensorFlow Training Training
DenseNet TensorFlow Training -
EfficientDet TensorFlow Training -
Vision Transformer TensorFlow Training -

Natural Language Processing

Models Framework Validated on Gaudi Validated on Gaudi2
BERT Pretraining and Finetuning PyTorch Training, Inference Training, Inference
DeepSpeed BERT-1.5B, BERT-5B PyTorch Training -
Transformer PyTorch Training Training
BART PyTorch Training -
HuggingFace BLOOM PyTorch Inference Inference
Megatron-DeepSpeed BLOOM 13B PyTorch - Training
BERT TensorFlow Training Training
DistilBERT TensorFlow Training -
Transformer TensorFlow Training Training

Recommender Systems

Models Framework Validated on Gaudi Validated on Gaudi2
Wide & Deep TensorFlow Training -

Audio

Models Framework Validated on Gaudi Validated on Gaudi2
Wav2Vec2ForCTC PyTorch Inference Inference
Hubert PyTorch - Training

Generative Models

Models Framework Validated on Gaudi Validated on Gaudi2
V-Diffusion PyTorch Inference -
Stable Diffusion PyTorch Training, Inference Training, Inference
Stable Diffusion v1.5 PyTorch Inference Inference
Stable Diffusion v2.1 PyTorch Inference -
CycleGAN TensorFlow Training -

MLPerf™ 2.1

Models Framework Validated on Gaudi Validated on Gaudi2
ResNet50 Keras PyTorch - Training
BERT PyTorch - Training
ResNet50 Keras TensorFlow - Training
BERT TensorFlow - Training

MLPerf™ is a trademark and service mark of MLCommons Association in the United States and other countries. All rights reserved. Unauthorized use is strictly prohibited.

Reporting Bugs/Feature Requests

We welcome you to use the GitHub issue tracker to report bugs or suggest features.

When filing an issue, please check existing open, or recently closed, issues to make sure somebody else hasn't already reported the issue. Please try to include as much information as you can. Details like these are incredibly useful:

  • A reproducible test case or series of steps
  • The version of our code being used
  • Any modifications you've made relevant to the bug
  • Anything unusual about your environment or deployment

Community

Hugging Face

Fairseq