kevinintel

kevinintel's Stars

• intel/neural-compressor

  SOTA low-bit LLM quantization (INT8/FP8/INT4/FP4/NF4) & sparsity; leading model compression techniques on TensorFlow, PyTorch, and ONNX Runtime

  Language:Python2.2k34206256

• intel/intel-extension-for-transformers

  ⚡ Build your chatbot within minutes on your favorite device; offer SOTA compression techniques for LLMs; run LLMs efficiently on Intel Platforms⚡

  Language:Python2.1k28166211

• intel/neural-speed

  An innovative library for efficient LLM inference via low-bit quantization

  Language:C++34884737

• opea-project/GenAIExamples

  Generative AI Examples is a collection of GenAI examples such as ChatQnA, Copilot, which illustrate the pipeline capabilities of the Open Platform for Enterprise AI (OPEA) project.

  Language:Shell27324291191

• intel/auto-round

  Advanced Quantization Algorithm for LLMs. This is official implementation of "Optimize Weight Rounding via Signed Gradient Descent for the Quantization of LLMs"

  Language:Python247115420