gg22mm

gg22mm's Stars

• Rudrabha/Wav2Lip

  This repository contains the codes of "A Lip Sync Expert Is All You Need for Speech to Lip Generation In the Wild", published at ACM Multimedia 2020. For HD commercial model, please try out Sync Labs

  Language:Python10.9k2.3k

• anothermartz/Easy-Wav2Lip

  Colab for making Wav2Lip high quality and easy to use

  Language:Jupyter Notebook686113

• OpenTalker/video-retalking

  [SIGGRAPH Asia 2022] VideoReTalking: Audio-based Lip Synchronization for Talking Head Video Editing In the Wild

  Language:Python6.7k982

• wan-h/awesome-digital-human-live2d

  Awesome Digital Human

  Language:TypeScript95899

• Henry-23/VideoChat

  实时语音交互数字人，支持端到端语音方案（GLM-4-Voice - THG）和级联方案（ASR-LLM-TTS-THG）。可自定义形象与音色，无须训练，支持音色克隆，首包延迟低至3s。Real-time voice interactive digital human, supporting end-to-end voice solutions (GLM-4-Voice - THG) and cascaded solutions (ASR-LLM-TTS-THG). Customizable appearance and voice, supporting voice cloning, with initial package delay as low as 3s.

  Language:Python46160

• rany2/edge-tts

  Use Microsoft Edge's online text-to-speech service from Python WITHOUT needing Microsoft Edge or Windows or an API key

  Language:Python6.4k633

• 2noise/ChatTTS

  A generative speech model for daily dialogue.

  Language:Python32.6k3.5k

• RVC-Boss/GPT-SoVITS

  1 min voice data can also be used to train a good TTS model! (few shot voice cloning)

  Language:Python36.2k4.1k

• CyberAgentAILab/TANGO

  Official implementation of the paper "TANGO: Co-Speech Gesture Video Reenactment with Hierarchical Audio-Motion Embedding and Diffusion Interpolation"

  Language:Python35077

• open-mmlab/mmcv

  OpenMMLab Computer Vision Foundation

  Language:Python5.9k1.7k

• Ikaros-521/AI-Vtuber

  AI Vtuber是一个由 【ChatterBot/ChatGPT/claude/langchain/chatglm/text-gen-webui/闻达/千问/kimi/ollama】 驱动的虚拟主播【Live2D/UE/xuniren】，可以在 【Bilibili/抖音/快手/微信视频号/拼多多/斗鱼/YouTube/twitch/TikTok】 直播中与观众实时互动 或 直接在本地进行聊天。它使用TTS技术【edge-tts/VITS/elevenlabs/bark/bert-vits2/睿声】生成回答并可以选择【so-vits-svc/DDSP-SVC】变声；指令协同SD画图。

  Language:Python3.2k482

• aigc-apps/EasyAnimate

  📺 An End-to-End Solution for High-Resolution and Long Video Generation Based on Transformer Diffusion

  Language:Python1.5k109

• Doubiiu/ToonCrafter

  [SIGGRAPH Asia 2024, Journal Track] ToonCrafter: Generative Cartoon Interpolation

  Language:Python5.4k451

• TMElyralab/MusePose

  MusePose: a Pose-Driven Image-to-Video Framework for Virtual Human Generation

  Language:Python2.3k167

• KwaiVGI/LivePortrait

  Bring portraits to life!

  Language:Python13.1k1.4k

• jdh-algo/JoyHallo

  JoyHallo: Digital human model for Mandarin

  Language:Python36135

• lipku/LiveTalking

  Real time interactive streaming digital human

  Language:Python4k576

• wangsrGit119/suke-webrtc-ext

  python等客户端和web端通过WebRTC交互

  Language:Python216

• pushkarprasad007/llm-aiortc

  Language:Python21

• aiortc/aiortc

  WebRTC and ORTC implementation for Python using asyncio

  Language:Python4.3k767

• AUTOMATIC1111/stable-diffusion-webui

  Stable Diffusion web UI

  Language:Python144k27k

• gradio-app/gradio

  Build and share delightful machine learning apps, all in Python. 🌟 Star to support our work!

  Language:Python34.2k2.6k

• Kedreamix/Linly-Talker

  Digital Avatar Conversational System - Linly-Talker. 😄✨ Linly-Talker is an intelligent AI system that combines large language models (LLMs) with visual models to create a novel human-AI interaction method. 🤝🤖 It integrates various technologies like Whisper, Linly, Microsoft Speech Services, and SadTalker talking head generation system. 🌟🔬

  Language:Python2.1k339

• OpenTalker/SadTalker

  [CVPR 2023] SadTalker：Learning Realistic 3D Motion Coefficients for Stylized Audio-Driven Single Image Talking Face Animation

  Language:Python12k2.2k

• ZiqiaoPeng/SyncTalk

  [CVPR 2024] This is the official source for our paper "SyncTalk: The Devil is in the Synchronization for Talking Head Synthesis"

  Language:Python1.3k161

• facebookresearch/sam2

  The repository provides code for running inference with the Meta Segment Anything Model 2 (SAM 2), links for downloading the trained model checkpoints, and example notebooks that show how to use the model.

  Language:Jupyter Notebook12.7k1.2k

• zllrunning/face-parsing.PyTorch

  Using modified BiSeNet for face parsing in PyTorch

  Language:Python2.3k457

• z-x-yang/Segment-and-Track-Anything

  An open-source project dedicated to tracking and segmenting any objects in videos, either automatically or interactively. The primary algorithms utilized include the Segment Anything Model (SAM) for key-frame segmentation and Associating Objects with Transformers (AOT) for efficient tracking and propagation purposes.

  Language:Jupyter Notebook2.9k343

• Fictionarry/TalkingGaussian

  [ECCV'24] TalkingGaussian: Structure-Persistent 3D Talking Head Synthesis via Gaussian Splatting

  Language:Python27033

• Fictionarry/ER-NeRF

  [ICCV'23] Efficient Region-Aware Neural Radiance Fields for High-Fidelity Talking Portrait Synthesis

  Language:Python1.1k137