Quang-elec44

Pinned Repositories

mergekit
Tools for merging pretrained large language models.
Language:Python4.6k 50 301406
outlines
Structured Text Generation
Language:Python8.4k 47 574425
optimum-nvidia
Language:Python885 36 6486
SqueezeLLM-gradients
Language:Python14 2 47
AITOMATIC-Test
Language:Python00
Quang-elec44
Config files for my GitHub profile.
00
sglang
SGLang is a fast serving framework for large language models and vision language models.
Language:Python5.4k 55 539388
QUICK
QUICK: Quantization-aware Interleaving and Conflict-free Kernel for efficient LLM inference
Language:Python107 1 66
GLiNER
Generalist and Lightweight Model for Named Entity Recognition (Extract any entity types from texts) @ NAACL 2024
Language:Python1.3k 14 122109
vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
Language:Python27.6k 225 4.6k4.1k

Quang-elec44's Repositories

Quang-elec44/AITOMATIC-Test
Language:Python00
Quang-elec44/Quang-elec44
Config files for my GitHub profile.
00