Pinned Repositories
Atom
Codebase for Atom
AutoGPTQ
An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.
exl2-for-all
EXL2 quantization generalized to other models.
exllamav2
A fast inference library for running LLMs locally on modern consumer-class GPUs
gpt-fast
Simple and efficient pytorch-native transformer text generation in <1000 LOC of python.
llama-cpp-torch
llama.cpp to PyTorch Converter
QuIP-for-all
QuIP quantization
vllm-gptq
A high-throughput and memory-efficient inference and serving engine for LLMs
chu-tianxiang's Repositories
chu-tianxiang/vllm-gptq
A high-throughput and memory-efficient inference and serving engine for LLMs
chu-tianxiang/QuIP-for-all
QuIP quantization
chu-tianxiang/llama-cpp-torch
llama.cpp to PyTorch Converter
chu-tianxiang/exl2-for-all
EXL2 quantization generalized to other models.
chu-tianxiang/gpt-fast
Simple and efficient pytorch-native transformer text generation in <1000 LOC of python.
chu-tianxiang/AutoGPTQ
An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.
chu-tianxiang/exllamav2
A fast inference library for running LLMs locally on modern consumer-class GPUs
chu-tianxiang/Atom
Codebase for Atom
chu-tianxiang/mt-dnn
Multi-Task Deep Neural Networks for Natural Language Understanding
chu-tianxiang/tf-tutorials
a tutorials for deep learning course.
chu-tianxiang/DSA
Free Premium Books For Learning Data Structure and Algorithm