DeployAI

Pinned Repositories

• Awesome-LLM-Inference

  💻A small Collection for Awesome LLM Inference [Papers|Blogs|Docs] with codes, contains TensorRT-LLM, streaming-llm, SmoothQuant, WINT8/4, Continuous Batching, FlashAttention, PagedAttention etc.

  1000

• nndeploy

  nndeploy是一款模型端到端部署框架。以多端推理以及基于有向无环图模型部署为内核，致力为用户提供跨平台、简单易用、高性能的模型部署体验。

  Language:C++459171071

• onnx-simplifier

  Simplify your onnx model

  Language:Python1000

DeployAI's Repositories