0nutation

0nutation's Stars

• Vaibhavs10/insanely-fast-whisper

  Language:Jupyter Notebook8.3k69201594

• kyutai-labs/moshi

  Moshi is a speech-text foundation model and full-duplex spoken dialogue framework. It uses Mimi, a state-of-the-art streaming neural audio codec.

  Language:Python8k91115657

• pyannote/pyannote-audio

  Neural building blocks for speaker diarization: speech activity detection, speaker change detection, overlapped speech detection, speaker embedding

  Language:Jupyter Notebook7.2k781k862

• OpenRLHF/OpenRLHF

  An Easy-to-use, Scalable and High-performance RLHF Framework (70B+ PPO Full Tuning & Iterative DPO & LoRA & RingAttention & RFT)

  Language:Python6.1k35579602

• linkedin/Liger-Kernel

  Efficient Triton Kernels for LLM Training

  Language:Python4.8k46185297

• Rikorose/DeepFilterNet

  Noise supression using deep filtering

  Language:Python3k34301271

• ictnlp/LLaMA-Omni

  LLaMA-Omni is a low-latency and high-quality end-to-end speech interaction model built upon Llama-3.1-8B-Instruct, aiming to achieve speech capabilities at the GPT-4o level.

  Language:Python2.9k3158194

• ufal/whisper_streaming

  Whisper realtime streaming for long speech-to-text transcription and translation

  Language:Python2.7k40127328

• linto-ai/whisper-timestamped

  Multilingual Automatic Speech Recognition with word-level timestamps and confidence

  Language:Python2.3k34161179

• baaivision/Emu3

  Next-Token Prediction is All You Need

  Language:Python2.1k316479

• kan-bayashi/ParallelWaveGAN

  Unofficial Parallel WaveGAN (+ MelGAN & Multi-band MelGAN & HiFi-GAN & StyleMelGAN) with Pytorch

  Language:Jupyter Notebook1.6k47256345

• microsoft/DNS-Challenge

  This repo contains the scripts, models, and required files for the Deep Noise Suppression (DNS) Challenge.

  Language:Python1.2k47151421

• haoheliu/voicefixer

  General Speech Restoration

  Language:Python1.1k1759133

• wenet-e2e/wespeaker

  Research and Production Oriented Speaker Verification, Recognition and Diarization Toolkit

  Language:Python86318146133

• lifeiteng/OmniSenseVoice

  Omni SenseVoice: High-Speed Speech Recognition with words timestamps 🗣️🎯

  Language:Python830101433

• JusperLee/Speech-Separation-Paper-Tutorial

  A must-read paper for speech separation based on neural networks

  773252137

• facebookresearch/libri-light

  dataset for lightly supervised training using the librivox audio book recordings. https://librivox.org/.

  Language:Python492181679

• showlab/videollm-online

  VideoLLM-online: Online Video Large Language Model for Streaming Video (CVPR 2024)

  Language:Python42685241

• davidmartinrius/speech-dataset-generator

  🔊 Create labeled datasets, enhance audio quality, identify speakers, support diverse dataset types. 🎧👥📊 Advanced audio processing.

  Language:Python243161423

• yangdongchao/RSTnet

  Real-time Speech-Text Foundation Model Toolkit (wip)

  Language:Python22015519

• aoifemcdonagh/audioset-processing

  Toolkit for downloading and processing Google's AudioSet dataset.

  Language:Jupyter Notebook1683642

• shinjiwlab/versa

  Versatile Evaluation of Speech and Audio

  Language:Python1649414

• Aria-K-Alethia/BigCodec

  Official implementation of the paper "BigCodec: Pushing the Limits of Low-Bitrate Neural Speech Codec"

  Language:Python1515169

• SpeechColab/GigaSpeech2

  An evolving, large-scale and multi-domain ASR corpus for low-resource languages with automated crawling, transcription and refinement

  Language:Python1516126

• YuanGongND/vocalsound

  Dataset and baseline code for the VocalSound dataset (ICASSP2022).

  Language:Jupyter Notebook1332710

• hhguo/SoCodec

  Ultra-low-bitrate Speech Codec for Speech Language Modeling Applications

  Language:Python79885

• AbrahamSanders/codec-bpe

  Implementation of Acoustic BPE (Shen et al., 2024), extended for RVQ-based Neural Audio Codecs

  Language:Python54427

• slp-rl/salmon

  The official code for the SALMon🍣 benchmark (ICASSP 2025 - Oral)

  Language:Python45100

• tincans-ai/gazelle-inference

  proof of concept conversation orchestrator with a speech-language model

  Language:Go19201

• hedeshy/CNVVE

  Dataset and Benchmark for Classifying Non-verbal Voice Expressions

  Language:Python9300