/AirDrawing_with_Mediapipe_Android

Primary LanguageKotlinGNU General Public License v3.0GPL-3.0

Air Drawing with MediaPipe Hands in Android

Using hand landmark recognition to draw on the screen.

The app uses MediaPipe's Hand Landmark Detection to detect specific landmarks on the user's hand and uses them to draw strokes on the screen.

The app's UI is written with Jetpack Compose and uses CameraX for displaying the camera preview. app_demo-min

Build the demo using Android Studio

Prerequisites

  • The Android Studio IDE. This sample has been tested on Android Studio Dolphin.

  • A physical Android device with a minimum OS version of SDK 24 (Android 7.0 - Nougat) with developer mode enabled. The process of enabling developer mode may vary by device.

Watch the video on YouTube *The demo is recorded on an Android 12 device with a 32-bit Samsung Exynos 850 processor (4GB RAM)

Building

  • Clone the repository on your system with,
git clone --depth=1 https://github.com/shubham0204/AirDrawing_with_Mediapipe_Android

  • Open the resulting folder in Android Studio. You may be asked if you trust the project. Select Trust.

  • If it asks you to do a Gradle Sync, click OK.

  • With your Android device connected to your computer and developer mode enabled, click on the green Run arrow in Android Studio.

Models used

Downloading, extraction, and placing the models into the assets folder is managed automatically by the app/download_tasks.gradle file.