tohtana/DeepSpeed-MII
MII makes low-latency and high-throughput inference possible, powered by DeepSpeed.
PythonApache-2.0
Stargazers
No one’s star this repository yet.
MII makes low-latency and high-throughput inference possible, powered by DeepSpeed.
PythonApache-2.0
No one’s star this repository yet.