lix19937/triton

make triton as infer framework

triton

make triton(https://github.com/triton-inference-server https://github.com/triton-inference-server/core) as infer framework

• 处理请求
• 后端管理
• 模型调度