Pinned Repositories
model_optimizer_tf
Model optimizer used in Adlik.
model_zoo
smoothquantplus
[ICML 2023] SmoothQuant: Accurate and Efficient Post-Training Quantization for Large Language Models
vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
Atom
[MLSys'24] Atom: Low-bit Quantization for Efficient and Accurate LLM Serving
LLM-QAT
Code repo for the paper "LLM-QAT Data-Free Quantization Aware Training for Large Language Models"
pytorch
Tensors and Dynamic neural networks in Python with strong GPU acceleration
priscilla-pan's Repositories
priscilla-pan/pytorch
Tensors and Dynamic neural networks in Python with strong GPU acceleration