intellinjun

intellinjun's Stars

• intel/neural-compressor

  SOTA low-bit LLM quantization (INT8/FP8/INT4/FP4/NF4) & sparsity; leading model compression techniques on TensorFlow, PyTorch, and ONNX Runtime

  Language:Python2.3k33211259

• intel/intel-extension-for-transformers

  ⚡ Build your chatbot within minutes on your favorite device; offer SOTA compression techniques for LLMs; run LLMs efficiently on Intel Platforms⚡

  Language:Python2.1k28166210

• intel/neural-speed

  An innovative library for efficient LLM inference via low-bit quantization

  Language:C++35284738