fp4

There are 3 repositories under fp4 topic.

intel/neural-compressor
SOTA low-bit LLM quantization (INT8/FP8/INT4/FP4/NF4) & sparsity; leading model compression techniques on TensorFlow, PyTorch, and ONNX Runtime
Language:Python2.2k 34 206256
intel/neural-speed
An innovative library for efficient LLM inference via low-bit quantization
Language:C++348 8 4737
gm-stuffs/fairphone_fp4_dump
Language:Shell0 0