rzarno/create-transformer

This repository shows how to create transformer from scratch.

Creating GPT from scratch

based on https://www.youtube.com/watch?v=kCc8FmEb1nY&t=1172s

Using PyTorch to create transformers in order to generate text in style of novel that was used for training transformer.