/HandTrackingProject

Hand tracking with Mediapipe

Primary LanguagePython

Hand Tracking App with Mediapipe and CMake

demo fingers

How to Run the CMake Project

mkdir build
cd build
cmake ..
make
./main

For a detailed setup and description of the project, please explore the detailed approach post.

Repository Overview

  • Integration of Mediapipe (based on Bazel) into a CMake project
  • Hand Tracking demo
  • Dear ImGUI interface for basic visualization controls

Challenges Faced

  • Mediapipe and Bazel: Integrating Mediapipe, which primarily uses the Bazel build system, into a CMake project required extensive tinkering to bridge the gap.
  • Python API Limitations: CPU-only inference in Python and the interpreter's general slowness posed challenges.
  • Transition to C++: Initial implementation in Python using Mediapipe Python API, transitioning to C++ for improved performance.
  • Using Mediapipe as a Library: Setup of Mediapipe's Hand Tracking as a library, requiring source code modifications and integration with CMake for effective usage.

Repository Structure

Acknowledgments

  • Mediapipe: Core framework for hand tracking
  • LibMP: Inspirational project for setup