ChenShisen's Stars
bloodeagle40234/dp-trtllm
Dummy Plug for TensorRT-LLM used by transformers pipeline
TRT2022/trtllm-llama
☢️ TensorRT 2023复赛——基于TensorRT-LLM的Llama模型推断加速优化
Franc-Z/QWen1.5_TensorRT-LLM
Optimize QWen1.5 models with TensorRT-LLM
onnx/onnx-tensorrt
ONNX-TensorRT: TensorRT backend for ONNX
zhangkaifang/model_deployment
本仓库提供了模型部署与量化等相关学习资料和参考资料、丰富的代码范例。主要涉及ONNX/TensorRT/PPQ/Triton等。
itsliupeng/torchnvjpeg
Decode JPEG image on GPU using PyTorch
CVCUDA/CV-CUDA
CV-CUDA™ is an open-source, GPU accelerated library for cloud-scale image processing and computer vision.
HqWu-HITCS/Awesome-Chinese-LLM
整理开源的中文大语言模型,以规模较小、可私有化部署、训练成本较低的模型为主,包括底座模型,垂直领域微调及应用,数据集与教程等。
jackaduma/awesome_LLMs_interview_notes
LLMs interview notes and answers:该仓库主要记录大模型(LLMs)算法工程师相关的面试题和参考答案
NVIDIA/TensorRT-LLM
TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT-LLM also contains components to create Python and C++ runtimes that execute those TensorRT engines.
hpcaitech/ColossalAI
Making large AI models cheaper, faster and more accessible
Stability-AI/stablediffusion
High-Resolution Image Synthesis with Latent Diffusion Models
ChaoWANG0511/CycleGAN-VC3
jackaduma/CycleGAN-VC3
Voice Conversion by CycleGAN (语音克隆/语音转换):CycleGAN-VC3
jackaduma/CycleGAN-VC2
Voice Conversion by CycleGAN (语音克隆/语音转换): CycleGAN-VC2
iperov/DeepFaceLab
DeepFaceLab is the leading software for creating deepfakes.
ypwhs/CreativeChatGLM
👋 欢迎来到 ChatGLM 创意世界!你可以使用修订和续写的功能来生成创意内容!
YanBC/mlops-toolkit
A set of helper scripts for ML Ops
kshitizgupta21/triton-trt-oss
Example showing Triton hosting of TensorRT HuggingFace T5 and BART models
xx529/CUDA
layerism/TensorRT-Inference-Server-Tutorial
服务侧深度学习部署案例
DingXiaoH/ResRep
ResRep: Lossless CNN Pruning via Decoupling Remembering and Forgetting (ICCV 2021)
huggingface/pytorch-image-models
The largest collection of PyTorch image encoders / backbones. Including train, eval, inference, export scripts, and pretrained weights -- ResNet, ResNeXT, EfficientNet, NFNet, Vision Transformer (ViT), MobileNetV4, MobileNet-V3 & V2, RegNet, DPN, CSPNet, Swin Transformer, MaxViT, CoAtNet, ConvNeXt, and more
thb1314/tensorrt-layernorm-plugin
VainF/Torch-Pruning
[CVPR 2023] Towards Any Structural Pruning; LLMs / SAM / Diffusion / Transformers / YOLOv8 / CNNs
Visual-Computing/TF2TRT
A Tensorflow to TensorRT converter written in pure Python
wcirq/trt-samples-for-hackathon-cn
microsoft/Swin-Transformer
This is an official implementation for "Swin Transformer: Hierarchical Vision Transformer using Shifted Windows".
szagoruyko/pytorchviz
A small package to create visualizations of PyTorch execution graphs
alibaba/BladeDISC
BladeDISC is an end-to-end DynamIc Shape Compiler project for machine learning workloads.