Source code of "sc2req"
Here is a demo of GPT-NEO with colab: https://colab.research.google.com/github/EleutherAI/GPTNeo/blob/master/GPTNeo_example_notebook.ipynb
The checkpoint file pf sc2req can be access via this link: https://storage.googleapis.com/gpt3_demo/GPT3_XL/model.ckpt-364000.data-00001-of-00002 and https://storage.googleapis.com/gpt3_demo/GPT3_XL/model.ckpt-364000.data-00000-of-00002
Please follow the instruction in the GPT-NEO demo.
In preparation of future work, the code is currently being refactored and will be updated.