/huggingface_candle_transformer

Step by step Transformer implementation using huggingface candle

Primary LanguageRustGNU General Public License v3.0GPL-3.0

Step by step Transformer implementation using huggingface candle

This is a step by step implementation of the transformer from paper "Attention Is All You Need" using the rust programming language and the huggingface candle library.

Dot Product Attention

"Image Dot Product Attention

Multi Head Attention

"Image Multi Head Attention

Transformer

"Image Transformer