int8
There are 33 repositories under int8 topic.
intel/neural-compressor
SOTA low-bit LLM quantization (INT8/FP8/INT4/FP4/NF4) & sparsity; leading model compression techniques on TensorFlow, PyTorch, and ONNX Runtime
intel/neural-speed
An innovative library for efficient LLM inference via low-bit quantization
clancylian/retinaface
Reimplement RetinaFace use C++ and TensorRT
Wulingtian/yolov5_tensorrt_int8_tools
tensorrt int8 量化yolov5 onnx模型
Wulingtian/yolov5_tensorrt_int8
TensorRT int8 量化部署 yolov5s 模型，实测3.3ms一帧！
Wulingtian/RepVGG_TensorRT_int8
RepVGG TensorRT int8 量化，实测推理不到1ms一帧！
xuanandsix/Tensorrt-int8-quantization-pipline
a simple pipline of int8 quantization based on tensorrt.
the0807/YOLOv8-ONNX-TensorRT
👀 Apply YOLOv8 exported with ONNX or TensorRT(FP16, INT8) to the Real-time camera
Wulingtian/nanodet_tensorrt_int8
nanodet int8 量化，实测推理2ms一帧！
ppogg/ncnn-yolov4-int8
NCNN+Int8+YOLOv4 quantitative modeling and real-time inference
whitelok/tensorrt-int8-python-sample
TensorRT Int8 Python version sample. TensorRT Int8 Python 实现例子。TensorRT Int8 Pythonの例です
aahouzi/llama2-chatbot-cpu
A LLaMA2-7b chatbot with memory running on CPU, and optimized using smooth quantization, 4-bit quantization or Intel® Extension For PyTorch with bfloat16.
Egorundel/int8_calibrator_cpp
INT8 calibrator for ONNX model with dynamic batch_size at the input and NMS module at the output. C++ Implementation.
cbalint13/rvv-kernels
RISCV Vector Kernel C/LLVM-IR generator
dasdristanta13/LLM-Lora-PEFT_accumulate
LLM-Lora-PEFT_accumulate explores optimizations for Large Language Models (LLMs) using PEFT, LORA, and QLORA. Contribute experiments and implementations to enhance LLM efficiency. Join discussions and push the boundaries of LLM optimization. Let's make LLMs more efficient together!
egbertYeah/mt-yolov6_tensorrt
MT-Yolov6 TensorRT Inference with Python.
yester31/Quantization_EX
quantization example for pqt & qat
JohnClaw/chatllm.vb
VB.NET api wrapper for llm-inference chatllm.cpp
JohnClaw/chatllm.cs
C# api wrapper for llm-inference chatllm.cpp
stdlib-js/array-int8
Int8Array.
stdlib-js/constants-int8
8-bit signed integer mathematical constants.
stdlib-js/constants-int8-min
Minimum signed 8-bit integer.
stdlib-js/assert-is-int8array
Test if a value is an Int8Array.
stdlib-js/constants-int8-max
Maximum signed 8-bit integer.
stdlib-js/constants-int8-num-bytes
Size (in bytes) of an 8-bit signed integer.
stdlib-js/napi-argv-int8array
Convert a Node-API value to a signed 8-bit integer array.
stdlib-js/napi-argv-strided-int8array
Convert a Node-API value representing a strided array to a signed 8-bit integer array.
stdlib-js/napi-argv-strided-int8array2d
Convert a Node-API value representing a two-dimensional strided array to a signed 8-bit integer array.
douzsh/mxnet-quantized
mxnet GluonCV quantization binary ternary models
MrFMach/Practice-C-types
Practicing C data types using the sizeof function
yester31/Quantization_Framework
development quantization framework