knowledge-distillation
There are 473 repositories under knowledge-distillation topic.
PaddlePaddle/PaddleClas
A treasure chest for visual classification and recognition powered by PaddlePaddle
dkozlov/awesome-knowledge-distillation
Awesome Knowledge Distillation
huawei-noah/Pretrained-Language-Model
Pretrained language model and its related optimization techniques developed by Huawei Noah's Ark Lab.
intel/neural-compressor
SOTA low-bit LLM quantization (INT8/FP8/INT4/FP4/NF4) & sparsity; leading model compression techniques on TensorFlow, PyTorch, and ONNX Runtime
IDEA-Research/DWPose
"Effective Whole-body Pose Estimation with Two-stages Distillation" (ICCV 2023, CV4Metaverse Workshop)
alibaba/EasyNLP
EasyNLP: A Comprehensive and Easy-to-use NLP Toolkit
jingyi0000/VLM_survey
Collection of AWESOME vision-language models for vision tasks
haitongli/knowledge-distillation-pytorch
A PyTorch implementation for exploring deep and shallow knowledge distillation (KD) experiments with flexibility
microsoft/Cream
This is a collection of our NAS and Vision Transformer work.
AberHu/Knowledge-Distillation-Zoo
Pytorch implementation of various Knowledge Distillation (KD) methods.
microsoft/NeuronBlocks
NLP DNN Toolkit - Building Your NLP DNN Models Like Playing Lego
szagoruyko/attention-transfer
Improving Convolutional Networks via Attention Transfer (ICLR 2017)
open-mmlab/mmrazor
OpenMMLab Model Compression Toolbox and Benchmark.
lxztju/pytorch_classification
利用pytorch实现图像分类的一个完整的代码，训练，预测，TTA，模型融合，模型部署，cnn提取特征，svm或者随机森林等进行分类，模型蒸馏，一个完整的代码
yoshitomo-matsubara/torchdistill
A coding-free framework built on PyTorch for reproducible deep learning studies. 🏆25 knowledge distillation methods presented at CVPR, ICLR, ECCV, NeurIPS, ICCV, etc are implemented so far. 🎁 Trained models, training logs and configurations are available for ensuring the reproducibiliy and benchmark.
huawei-noah/Efficient-Computing
Efficient computing methods developed by Huawei Noah's Ark Lab
MingSun-Tse/Efficient-Deep-Learning
Collection of recent methods on (deep) neural network compression and acceleration.
horseee/Awesome-Efficient-LLM
A curated list for Efficient Large Language Models
alibaba/EasyTransfer
EasyTransfer is designed to make the development of transfer learning in NLP applications easier.
megvii-research/mdistiller
The official implementation of [CVPR2022] Decoupled Knowledge Distillation https://arxiv.org/abs/2203.08679 and [ICCV2023] DOT: A Distillation-Oriented Trainer https://openaccess.thecvf.com/content/ICCV2023/papers/Zhao_DOT_A_Distillation-Oriented_Trainer_ICCV_2023_paper.pdf
lhyfst/knowledge-distillation-papers
knowledge distillation papers
SforAiDl/KD_Lib
A Pytorch Knowledge Distillation library for benchmarking and extending works in the domains of Knowledge Distillation, Pruning, and Quantization.
yuanli2333/Teacher-free-Knowledge-Distillation
Knowledge Distillation: CVPR2020 Oral, Revisiting Knowledge Distillation via Label Smoothing Regularization
segmind/distill-sd
Segmind Distilled diffusion
chaitjo/efficient-gnns
Code and resources on scalable and efficient Graph Neural Networks
aimagelab/mammoth
An Extendible (General) Continual Learning Framework based on Pytorch - official codebase of Dark Experience for General Continual Learning
clovaai/overhaul-distillation
Official PyTorch implementation of "A Comprehensive Overhaul of Feature Distillation" (ICCV 2019)
ilovepose/fast-human-pose-estimation.pytorch
Official pytorch Code for CVPR2019 paper "Fast Human Pose Estimation" https://arxiv.org/abs/1811.05419
Picsart-AI-Research/MI-GAN
[ICCV 2023] MI-GAN: A Simple Baseline for Image Inpainting on Mobile Devices
yanx27/2DPASS
2DPASS: 2D Priors Assisted Semantic Segmentation on LiDAR Point Clouds (ECCV 2022) :fire:
lenscloth/RKD
Official pytorch Implementation of Relational Knowledge Distillation, CVPR 2019
yzhao062/SUOD
(MLSys' 21) An Acceleration System for Large-scare Unsupervised Heterogeneous Outlier Detection (Anomaly Detection)
1duo/awesome-ai-infrastructures
Infrastructures™ for Machine Learning Training/Inference in Production.
HikariTJU/LD
Localization Distillation for Object Detection (CVPR 2022, TPAMI 2023)
yzd-v/FGD
Focal and Global Knowledge Distillation for Detectors (CVPR 2022)
yuanyuanli85/Fast_Human_Pose_Estimation_Pytorch
Pytorch Code for CVPR2019 paper "Fast Human Pose Estimation" https://arxiv.org/abs/1811.05419