sausage-333
2015.02 ~ 2020. 02 Bachelor's at KAIST 2020.03 ~ Integrated Ph. D at KAIST Interested in - Efficient Transformers - Knowledge distillation - Speech SSL
KAISTDaejeon
Pinned Repositories
av_hubert
A self-supervised learning framework for audio-visual speech
FitHuBERT
FitHuBERT: Going Thinner and Deeper for Knowledge Distillation of Speech Self-Supervised Learning (INTERSPEECH 2022)
BEST-RQ
Implementation of the paper "Self-supervised Learning with Random-projection Quantizer for Speech Recognition" in Pytorch.
best-rq-pytorch
Implementation of BEST-RQ - a model for self-supervised learning of speech signals using a random projection quantizer, in Pytorch.
s3prl
Self-Supervised Speech Pre-training and Representation Learning Toolkit
fairseq
Facebook AI Research Sequence-to-Sequence Toolkit written in Python.
university_footprints
ARMHuBERT
(Interspeech 2023 & ICASSP 2024) Official repository for ARMHuBERT and STaRHuBERT
PETL_AST
This is the official repository of the papers "Parameter-Efficient Transfer Learning of Audio Spectrogram Transformers" and "Efficient Fine-tuning of Audio Spectrogram Transformers via Soft Mixture of Adapters".
sausage-333's Repositories
sausage-333/fairseq
Facebook AI Research Sequence-to-Sequence Toolkit written in Python.
sausage-333/university_footprints