/train-gpt

Train a word-level GPT on text data from scratch

Primary LanguagePython

Training a word-level GPT (work in progress)

I tried the prompt "I looked above the dark" on a minimal gpt architecture trained on Lovecraft Novels, output from gpt shown below ⬇️

I looked above the dark, without the means of striking a light, crashing against the table, overturning a chair, and finally groping my way to the place where the blackness screamed with shocking music. To save myself and the outer hellish thing had seized me, and I knew I must have gained the roof, or at least some kind of floor. In the darkness I raised my free hand and tested the barrier, finding it stone and immovable. Then came a deadly circuit of the tower, clinging