/Parallelformers_Demo

Primary LanguagePythonGNU Affero General Public License v3.0AGPL-3.0

Parallelformers_Demo

This code is a demo of the repo here which allows one to split large Transformer models onto multiple GPUs.

It goes along with the video the can be seen here