/gpt-transformer

A simple implementation of a GPT-style Transformer architecture and inference.

Primary LanguagePythonMIT LicenseMIT

GPT Transformer

A simple implementation of a GPT-style Transformer architecture. Includes inference code, but no training code.

For more information, check out the accompanying blog post.

Running instructions

  • Install conda if you don't have it already.
  • Install and activate the conda environment by executing the following commands:
conda env create -f environment.yml
conda activate gpt-transformer
  • Within VS Code, press Ctrl+Shift+P to open the Command Palette, type "Python: Select Interpreter," and select the "gpt-transformer" interpreter.
  • Run the main.py file by pressing F5 within Visual Studio.