Inspired by Andrej Karpathy's minGPT, I am building midiGPT as a learning-in-public project. The goal is to build a from-scratch PyTorch implementation of a decoder-only transformer model (similar to GPT) that generates music as MIDI data.
The projects directory contains simple example applications of midiGPT, which are being used for development.
- projects/bach-chorales
- example generation with temperature = 0.5:
bach-and-his-laptop.mp4
- projects/tiny-shakespeare
- example generation:
KING JOHNNY:
To be, or not to be: that is the question.
Gentlemen, give me the clothes to wail,
And what I am to receive: to resist this war
To bear himself of God, my worship forth;
Have caught up my state, which have we stood
To take enforce the stones?