This project explores the opportunities of deep learning and artificial intelligence for character animation and control as part of my Ph.D. research at the University of Edinburgh in the School of Informatics, supervised by Taku Komura and in collaboration with He Zhang and Jun Saito. The development is done using Unity3D / Tensorflow, and the implementations are made available during my Ph.D. progress.
Animating characters can be a pain, especially those four-legged monsters!
This year, we will be presenting our recent research on quadruped animation and character control at the SIGGRAPH 2018 in Vancouver.
The system can produce natural animations from real motion data using a novel neural network architecture, called Mode-Adaptive Neural Networks.
Instead of optimising a fixed group of weights, the system learns to dynamically blend a group of weights into a further neural network, based on the current
state of the character. That said, the system does not require labels for the phase or locomotion gaits, but can learn from unstructured motion capture data in an
end-to-end fashion.
-
Video
-
Paper
-
Windows Demo
-
Linux Demo
-
Mac Demo
-
MoCap Data
-
ReadMe
-
This work continues the recent work on PFNN (Phase-Functioned Neural Networks) for character control.
A demo in Unity3D using the original weights for terrain-adaptive locomotion is contained in the Assets/Demo/SIGGRAPH_2017/Original folder.
Another demo on flat ground using the Adam character is contained in the Assets/Demo/SIGGRAPH_2017/Adam folder.
In order to run them, you need to download the neural network weights from the link provided in the Link.txt file, extract them into the /NN folder,
and store the parameters via the custom inspector button.
-
Video
-
Paper
-
Windows Demo
-
Linux Demo
-
Mac Demo
-
In progress. More information will be added soon.
This code implementation is only for research or education purposes, and (especially the learned data) not freely available for commercial use or redistribution. The intellectual property and code implementation belongs to the University of Edinburgh. Licensing is possible if you want to apply this research for commercial use. For scientific use, please reference this repository together with the relevant publications below. In any case, I would ask you to contact me if you intend to seriously use, redistribute or publish anything related to this code or repository.
