mxjmtxrm

Pinned Repositories

• transformers

  🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

  Language:Python127k25.3k

• lm-evaluation-harness

  A framework for few-shot evaluation of language models.

  Language:Python5.5k1.4k

• AutoGPTQ

  An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.

  Language:Python4k405

• swift

  ms-swift: Use PEFT or Full-parameter to finetune 250+ LLMs or 35+ MLLMs. (Qwen2, GLM4, Internlm2, Yi, Llama3, Llava, Deepseek, Baichuan2...)

  Language:Python1.9k183

• fsdp_qlora

  Training LLMs with QLoRA + FSDP

  Language:Jupyter Notebook1.3k174

• functionary

  Chat language model that can use tools and interpret the results

  Language:Python1.2k85

• OmniQuant

  [ICLR2024 spotlight] OmniQuant is a simple and powerful quantization technique for LLMs.

  Language:Python60448

• hqq

  Official implementation of Half-Quadratic Quantization (HQQ)

  Language:Python53450

• QuaRot

  Code for QuaRot, an end-to-end 4-bit inference of large language models.

  Language:Python16610

• EETQ

  Easy and Efficient Quantization for Transformers

  Language:C++15112

mxjmtxrm's Repositories