laxmaniron/3D-Animation

2D to 3D motion capture

Animepose: Multi-person 3D Pose Estimation and Animation

This repo contains application implementation of paper Animepose: Multi-person 3D Pose Estimation and Animation. Basically using this code you transfers of movement of a person from a 2d video to 3d environment in unity

Requirements

1. python 3.6
2. Tensorflow 1.12
3. Pytorch 0.4
4. Cuda toolkit 9.0
5. Cudnn

Instructions to run the code

1. Download Alpha pose and set it up from the link below Alpha Pose
2. Run the output of the first step through deep sort in the link below Deep Sort
3. Segregate poses of different person using jupyter notebook code in mycode folder
4. Uplift the poses from 2d to 3d from the below link 3D Pose estimation Baseline
5. Place output of the step 4 in unity assets folder and run it to watch the animation

Medium Link

https://medium.com/@sravanvinakota/dc48cf1227f2

Results

Single Person

Demo link: https://www.youtube.com/watch?v=zhTshx-Vg_U&t=69s

Multi Person

Demo link: https://www.youtube.com/watch?v=f9cXyo3saAI