/recipes

Move AI logo

Move AI Recipes

This repo provides examples, guides and tools for using the Move API to access models developed by Move AI. To run these models, you will need a Move AI API key which you can request here.

The models generate spatial motion data related to humans (e.g. human motion and camera positions in different file formats) from 2D video input by using physics and AI based estimation techniques.

Most of the code examples are written in Python, although the concepts can be applied in any language.

Some examples live in their own repos and are included here as submodules.

So if you want to get all the examples, make sure to clone the repo recursively (GitHub .zip download will not include the submodules):

git clone --recurse-submodules --remote-submodules git@github.com:move-ai/recipes.git

User examples

Move AI logo MGMT music video
Video game development by Electronic Arts Music video for MGMT's “Mother Nature” by Eye Garden

Models

Overview

Model Description Inference time
singlecam Generates spatial motion data using a single video as input, optimised for quality. 25-30s for 10s, 60fps, HD
singlecam-turbo
(coming soon)		 Generates spatial motion data using a single video as input, optimised for speed and quality. 10s for 10s, 60fps, HD
multicam
(coming soon)		 Generates spatial motion data using multiple videos as input, optimised for quality. 2.5mins for 10s, 60fps, HD, 4 cameras
multicam-rt
(available now, request access here)		 Generates spatial motion data using multiple videos as input, optimised for real-time speed. <120ms latency

singlecam

  • Full body tracking

  • Hand and finger tracking

  • FBX, USD and Blend 3D output formats

  • Track up to 3 people (coming soon)

  • Supports any video but best results are obtained when the camera is known

    This model powers the Move One iPhone app

Code examples

Link Language Description
Move_API_single_person_single_video_unknown_camera.ipynb Python Generate 3D animation data of a single person from a single video from an unknown camera
Move_API_JavaScript_demo JavaScript Generate 3D animation data of a single person from a single video from an unknown camera
Move_API_and_retargeting_Blender_addon Blender Python API Move.ai API integrated into Blender via an add-on. Additional features: retargeting, scene import, rendering
Move_API_JSON_motion_data_sample_overview.ipynb Python Explore and analyse the .JSON motion data output
MoveSingleAPISwift Swift Swift SDK