This project aims to explore the capabilities of real-time motion capture using computer vision algorithms via web cameras, leveraging pose estimation models to detect skeletal structures and body movement. The captured motion data will be processed through machine learning algorithms for accurate pose detection and tracking. For synchronization, the Colyseus multiplayer server will be utilized to ensure low-latency and efficient state management. This allows multiple users to join and have their body movements accurately reflected in real-time within a collaborative virtual environment.
graph LR
A1[User 1: Web Camera] -->|Captures Video Input| B1[Computer Vision Algorithm]
A2[User 2: Web Camera] -->|Captures Video Input| B2[Computer Vision Algorithm]
B1 -->|Pose Estimation| D[Colyseus Multiplayer Server]
B2 -->|Pose Estimation| D[Colyseus Multiplayer Server]
D -->|Synchronizes Movement| E1[User 1: Virtual Environment]
D -->|Synchronizes Movement| E2[User 2: Virtual Environment]
E1 -->|Collaborative Movement| F[Shared Virtual Space]
E2 -->|Collaborative Movement| F[Shared Virtual Space]
moveplayground is fair-code distributed under Apache 2.0 with Commons Clause license.