The most exciting phrase to hear in science, the one that heralds new discoveries, is not 'Eureka!' but 'That's funny...' - Isaac Asimov
This project is inspired by the exercises proposed in Karpathy's GPT video. The main idea is to create a GPT model that functions as a calculator. The project is evidently not useful in a practical sense and has as its sole purpose learning and understanding the GPT architecture in more depth.
Main files
- data.py: Contains the get_batch function that provides x and y data for training.
- model.py: Contains all the components of the final architecture, almost identical to the one in Karpathy's video.
- train.py: Main file, imports get_batch and the model, and performs the learning.
Current state: Right now the model only supports addition on positive numbers, more operations are coming soon...
Trying the model: Start by creating and activating a virtual environment, then run:
pip install -r requirements.txtAnd that's it! Change the hyperparameters as you wish in the Config class, and use the generate function to see the model calculate!