This repository is a fork of https://github.com/Daniil-Osokin/lightweight-human-pose-estimation-3d-demo.pytorch.git, and contains the extra necessary code for 3D human pose extraction in .npy files and exporting videos of new 3D poses. Please check the setup instructions from https://github.com/Daniil-Osokin/lightweight-human-pose-estimation-3d-demo.pytorch/blob/master/README.md
- pose_extract.py
- plot_generated.py
- join_sound.py
The skeleton joints extracted from this respository look like the following:
Poses extracted from each frame are of the shape (18,3) where each joint 'n' has the 3D coordinate (n,3).
python pose_extract.py --model human-pose-estimation-3d.pth --video video_path
Extracted poses will be saved in the folder './POSES'
--duration: duration of song to crop (in seconds)
python plot_generated.py --joints joints.npy --music music.mp3 --duration 10
python join_sound.py output_name
Output: output_name.mp4
python plot_generated.py --joints joints.npy
Output: rendered.mp4