chaiyujin
Ph.D in Computer Science graduated from Zhejiang University, China. Speech-driven facial animation. 3D facial reconstruction (3DMM).
Zhejiang UniversityHangzhou, Zhejiang, China
Pinned Repositories
dctts-pytorch
The pytorch implementation of DC-TTS
ffmpeg-rvl
RVL lossless depth image compression plugin for ffmpeg
glow-pytorch
pytorch implementation of openai paper "Glow: Generative Flow with Invertible 1×1 Convolutions"
media_ffmpeg
psfa-2022
PyTorch Implementation of our paper "Personalized Audio-Driven 3D Facial Animation via Style-Content Disentanglement" published in IEEE TVCG.
sdfa-2019
PyTorch Implementation of our paper "Speech-Driven Facial Animation with Spectral Gathering and Temporal Attention" published in Springer FCS.
snow_legacy
A c++ toolbox for easier life.
VAE-GMVAE
This repository contains the implementation of the VAE and Gaussian Mixture VAE using TensorFlow and several network architectures
videoio-python
chaiyujin's Repositories
chaiyujin/sdfa-2019
PyTorch Implementation of our paper "Speech-Driven Facial Animation with Spectral Gathering and Temporal Attention" published in Springer FCS.
chaiyujin/imgui-njs
Immediate Mode GUI for browser and electron environments.
chaiyujin/NeuralVoicePuppetry
This github contains the network architectures of NeuralVoicePuppetry.
chaiyujin/videoio-python
chaiyujin/psfa-2022
PyTorch Implementation of our paper "Personalized Audio-Driven 3D Facial Animation via Style-Content Disentanglement" published in IEEE TVCG.
chaiyujin/Audio-driven-TalkingFace-HeadPose
Code for "Audio-driven Talking Face Video Generation with Learning-based Personalized Head Pose"
chaiyujin/AudioDVP
AudioDVP:Photorealistic Audio-driven Video Portraits
chaiyujin/blender-render-flame
chaiyujin/chaiyujin.github.io
chaiyujin/confr
Configuration system geared towards Python ML projects
chaiyujin/DECA
DECA: Detailed Expression Capture and Animation
chaiyujin/flame-blender-animation
chaiyujin/glfw
A multi-platform library for OpenGL, OpenGL ES, Vulkan, window and input
chaiyujin/imgui-nanobind
chaiyujin/lightning-hydra-template
PyTorch Lightning + Hydra. A very general, feature-rich template for rapid and scalable ML experimentation with best practices. ⚡🔥⚡
chaiyujin/LunarVim
A Neovim config made with sane defaults
chaiyujin/ml-neuman
Official repository of NeuMan: Neural Human Radiance Field from a Single Video (ECCV 2022)
chaiyujin/multi_thread_web_server-rsbook
Final project of Rust Book: Building a Multithreaded Web Server
chaiyujin/nanovg
Antialiased 2D vector drawing library on top of OpenGL for UI and visualizations.
chaiyujin/nvdiffrast
Nvdiffrast - Modular Primitives for High-Performance Differentiable Rendering
chaiyujin/nvim-config
chaiyujin/nvim-tree.lua
A file explorer tree for neovim written in lua
chaiyujin/ray
An open source framework that provides a simple, universal API for building distributed applications. Ray is packaged with RLlib, a scalable reinforcement learning library, and Tune, a scalable hyperparameter tuning library.
chaiyujin/splocs
Sparse Localized Deformation Components
chaiyujin/stream-player
chaiyujin/TemplateFitting
Template fitting for non-rigid mesh registration of a 3D face scan
chaiyujin/vim-colors-xcode
Xcode 11’s dark and light colourschemes for Vim
chaiyujin/vits
VITS: Conditional Variational Autoencoder with Adversarial Learning for End-to-End Text-to-Speech
chaiyujin/voca
This codebase demonstrates how to synthesize realistic 3D character animations given an arbitrary speech signal and a static character mesh.
chaiyujin/wgpu-native
Native WebGPU implementation based on wgpu-core