REEF is a GPU-accelerated DNN inference serving system that enables instant kernel preemption and biased concurrent execution in GPU scheduling.
Primary LanguageCudaApache License 2.0Apache-2.0
No one’s watching this repository yet.