AmyangXYZ/MiKaPo

Real-time MMD motion capture on Web

MiKaPo: AI Pose Picker for MikuMikuDance

MiKaPo is a Web-based tool that poses MMD models from video input in real-time. Welcome feature requests and PRs!

Tech Stack

• 3D key points detection: Mediapipe
• 3D scene: Babylon.js
• MMD model viewer: babylon-mmd
• Web framework: Vite+React
• Models are from aplaybox.

Features

• Pose detection
• Face detection
• Hand detection (experimental)
• Rust-WASM based pose-to-quaternion solver
• 360-degree background selection
• Video, image upload
• Webcam input
• Model selection
• Ollama support (electron version)
• VMD import/export (to export a valid VMD file, you must record at least one motion)
• MMD editor: bone, material, mesh edit

Hint

• Let your browser use dedicated GPU for better performance.

Project Setup

npm install

Compile and Hot-Reload for Development

npm run dev

Type-Check, Compile and Minify for Production

npm run build

Lint with ESLint

npm run lint