There are 2 repositories under deep-learning-serving topic.
Dynamic Batching for Deep Learning Serving