catherine-qian

catherine-qian's Stars

• langchain-ai/langchain

  🦜🔗 Build context-aware reasoning applications

  Language:Jupyter Notebook91.9k6797.5k14.6k

• CorentinJ/Real-Time-Voice-Cloning

  Clone a voice in 5 seconds to generate arbitrary speech in real-time

  Language:Python52k9371.1k8.7k

• coqui-ai/TTS

  🐸💬 - a deep learning toolkit for Text-to-Speech, battle-tested in research and production

  Language:Python33.2k2791.1k4k

• facebookresearch/audiocraft

  Audiocraft is a library for audio processing and generation with deep learning. It features the state-of-the-art EnCodec audio compressor / tokenizer, along with MusicGen, a simple and controllable music generation LM with textual and melodic conditioning.

  Language:Python20.6k2013722.1k

• facebookresearch/ImageBind

  ImageBind One Embedding Space to Bind Them All

  Language:Python8.2k9989751

• Plachtaa/VALL-E-X

  An open source implementation of Microsoft's VALL-E X zero-shot TTS model. Demo is available in https://plachtaa.github.io

  Language:Python7.5k81151750

• jaywalnut310/vits

  VITS: Conditional Variational Autoencoder with Adversarial Learning for End-to-End Text-to-Speech

  Language:Python6.6k542051.2k

• open-mmlab/Amphion

  Amphion (/æmˈfaɪən/) is a toolkit for Audio, Music, and Speech Generation. Its purpose is to support reproducible research and help junior researchers and engineers get started in the field of audio, music, and speech generation research and development.

  Language:Python4.4k58151376

• facebookresearch/encodec

  State-of-the-art deep learning based audio codec supporting both mono 24 kHz audio and stereo 48 kHz audio.

  Language:Python3.4k5870304

• esbatmop/MNBVC

  MNBVC(Massive Never-ending BT Vast Chinese corpus)超大规模中文语料集。对标chatGPT训练的40T数据。MNBVC数据集不但包括主流文化，也包括各个小众文化甚至火星文的数据。MNBVC数据集包括新闻、作文、小说、书籍、杂志、论文、台词、帖子、wiki、古诗、歌词、商品介绍、笑话、糗事、聊天记录等一切形式的纯文本中文数据。

  3.4k6353231

• NExT-GPT/NExT-GPT

  Code and models for NExT-GPT: Any-to-Any Multimodal Large Language Model

  Language:Python3.2k5892318

• FreedomIntelligence/LLMZoo

  ⚡LLM Zoo is a project that provides data, models, and evaluation benchmark for large language models.⚡

  Language:Python2.9k5149198

• s3prl/s3prl

  Self-Supervised Speech Pre-training and Representation Learning Toolkit

  Language:Python2.2k44395479

• lifeiteng/vall-e

  PyTorch implementation of VALL-E(Zero-Shot Text-To-Speech), Reproduced Demo https://lifeiteng.github.io/valle/index.html

  Language:Python2k49126320

• QwenLM/Qwen-Audio

  The official repo of Qwen-Audio (通义千问-Audio) chat & pretrained large audio language model proposed by Alibaba Cloud.

  Language:Python1.4k256499

• bytedance/SALMONN

  SALMONN: Speech Audio Language Music Open Neural Network

  Language:Python969254474

• LinkSoul-AI/LLaSM

  第一个支持中英文双语语音-文本多模态对话的开源可商用对话模型。便捷的语音输入将大幅改善以文本为输入的大模型的使用体验，同时避免了基于 ASR 解决方案的繁琐流程以及可能引入的错误。

  Language:Python51113853

• Sxjdwang/TalkLip

  Language:Python390174733

• facebookresearch/muavic

  MuAViC: A Multilingual Audio-Visual Corpus for Robust Speech Recognition and Robust Speech-to-Text Translation

  Language:Python351132130

• CheyneyComputerScience/CREMA-D

  Crowd Sourced Emotional Multimodal Actors Dataset (CREMA-D)

  Language:R335107119

• XinhaoMei/WavCaps

  This reporsitory contains metadata of WavCaps dataset and codes for downstream tasks.

  Language:Python19452611

• glory20h/VoiceLDM

  VoiceLDM: Text-to-Speech with Environmental Context

  Language:Python156748

• zinengtang/TVLT

  PyTorch code for “TVLT: Textless Vision-Language Transformer” (NeurIPS 2022 Oral)

  Language:Jupyter Notebook12031613

• sunpeng981712364/ACMR_demo

  Language:Python925028

• ChenDelong1999/VirtualConductor

  🎶 Music-Driven Conducting Motion Generation (IEEE ICME'21 Best Demo)

  Language:Python873611

• zeroQiaoba/GCNet

  GCNet, official pytorch implementation of our paper "GCNet: Graph Completion Network for Incomplete Multimodal Learning in Conversation"

  Language:Python59536

• IFICL/stereocrw

  Code for the Paper: [ECCV2022] Sound Localization by Self-Supervised Time-Delay Estimation

  Language:Python18205

• l3das/L3DAS23

  Official repository supporting the L3DAS23 IEEE ICASSP Grand Challenge

  Language:Python16123

• ISmallFish/Libri-adhoc40

  A dataset collected from synchronized ad-hoc microphone arrays

  15222

• kad99kev/FGTD

  Face Generation from Textual Description using GANs.

  Language:Python13214