HIN0209

HIN0209's Stars

• lllyasviel/Fooocus

  Focus on prompting and generating

  Language:Python40.5k3131.5k5.7k

• shap/shap

  A game theoretic approach to explain the output of any machine learning model.

  Language:Jupyter Notebook22.6k2412.5k3.3k

• modelscope/FunASR

  A Fundamental End-to-End Speech Recognition Toolkit and Open Source SOTA Pretrained Models, Supporting Speech Recognition, Voice Activity Detection, Text Post-processing etc.

  Language:Python6.2k581.1k658

• xorbitsai/inference

  Replace OpenAI GPT with another LLM in your app by changing a single line of code. Xinference gives you the freedom to use any LLM you need. With Xinference, you're empowered to run inference with any open-source language models, speech recognition models, and multimodal models, whether in the cloud, on-premises, or even on your laptop.

  Language:Python5k431.3k396

• FunAudioLLM/SenseVoice

  Multilingual Voice Understanding Model

  Language:Python2.8k37121267

• pytorch/audio

  Data manipulation and transformation for audio signal processing, powered by PyTorch

  Language:Python2.5k72933644

• bytedance/SALMONN

  SALMONN: Speech Audio Language Music Open Neural Network

  Language:Python996264778

• X-LANCE/SLAM-LLM

  Speech, Language, Audio, Music Processing with Large Language Model

  Language:Python513183643

• mpc001/Visual_Speech_Recognition_for_Multiple_Languages

  Visual Speech Recognition for Multiple Languages

  Language:Python328132655

• facebookresearch/SONAR

  SONAR, a new multilingual and multimodal fixed-size sentence embedding space, with a full suite of speech and text encoders and decoders.

  Language:Python326141934

• Srijith-rkr/Whispering-LLaMA

  EMNLP 23 - Integrating Whisper Encoder to LLaMA Decoder for Generative ASR Error Correction

  Language:Jupyter Notebook22751115

• mpc001/auto_avsr

  Auto-AVSR: Lip-Reading Sentences Project

  Language:Python16953539

• YUCHEN005/RobustGER

  Code for paper "Large Language Models are Efficient Learners of Noise-Robust Speech Recognition"

  Language:Python120643

• cwx-worst-one/EAT

  [IJCAI 2024] EAT: Self-Supervised Pre-Training with Efficient Audio Transformer

  Language:Python100483

• roudimit/whisper-flamingo

  [Interspeech 2024] Whisper-Flamingo: Integrating Visual Features into Whisper for Audio-Visual Speech Recognition and Translation

  Language:Jupyter Notebook70213

• ms-dot-k/Lip-to-Speech-Synthesis-in-the-Wild

  PyTorch implementation of "Lip to Speech Synthesis in the Wild with Multi-task Learning" (ICASSP2023)

  Language:Python61477

• ahaliassos/raven

  Official implementation of RAVEn (ICLR 2023) and BRAVEn (ICASSP 2024)

  Language:Python53973

• mmorise/rohan4600

  モーラバランス型日本語コーパス

  Language:HTML53323

• PierreElias/IntroECG

  Resource library for getting started with deep learning work using electrocardiograms

  Language:Jupyter Notebook521213

• skit-ai/SpeechLLM

  This repository contains the training, inference, evaluation code for SpeechLLM models and details about the model releases on huggingface.

  Language:Python46412

• IIP-Sogang/olkavs-avspeech

  The Introduction of the OLKAVS Dataset

  Language:Python30122

• gongouveia/Whisper-Synthetic-ASR-Dataset-Generator

  This UI serves as a Synthetic ASR Dataset Generator powered by/for OpenAI Whisper, enabling users to capture audio, transcribing it, on the fly and manage the generated dataset 🤗. Fine tune Whisper or enhanced and custom datasets

  Language:Python20430

• StelaBou/voxceleb_preprocessing

  Download and preprocess voxceleb datasets.

  Language:Python19104

• topel/audioset-convnext-inf

  Adapting a ConvNeXt model to audio classification on AudioSet

  Language:Python17212

• Sreyan88/LipGER

  Code for InterSpeech 2024 Paper: LipGER: Visually-Conditioned Generative Error Correction for Robust Automatic Speech Recognition

  Language:Python11201

• MuSAELab/Multimodal-dataset-catalog

  This repository lists publicly available datasets for visual-audio, speech and audio, and biomedical signal related tasks.

  4101

• payalmohapatra/Multimodal-Speech-Disfluency

  Multimodal Disfluency Detection (Interspeech 2024)

  Language:Python3200

• srinath-dittakavi/lip-reading

  LRS3-based lip reading algorithm using Inception3D features & self-attention. Handles 4 segments of 16 frames for word prediction.

  Language:Jupyter Notebook2

• zulfiqarAlibalti/audio-visual-Transcription

  Real-Time Audio-visual Speech Recongition

  Language:Python2100

• sindhujagopu/LIP-READING-AI

  LIP READING-AI is an AI system that interprets lip movements from video to text in real-time, enhancing communication for the hearing-impaired and deaf, and improving security and interaction in noisy or masked situations. Utilizing advanced deep learning models, it offers pre-trained solutions and customizable tools for various applications.

  Language:Jupyter Notebook1