JannikWolff/FlexGen
Running large language models like ChatGPT/GPT-3/OPT-175B on a single GPU. Up to 100x faster than other offloading systems.
PythonApache-2.0
Watchers
No one’s watching this repository yet.
Running large language models like ChatGPT/GPT-3/OPT-175B on a single GPU. Up to 100x faster than other offloading systems.
PythonApache-2.0
No one’s watching this repository yet.