/mrHandy

Repository for mouse control using hand recognition

Primary LanguagePython

This is a script for hand recognition using webcam

Installation:

  1. git clone
  2. cd into folder
  3. run pip install requirements.txt

Running script:

  1. this script will ask for access to monitor, mouse control and camera, feel free to give it, it is absolutely safe
  2. run python face.py
  3. you could run face.py --help if you want to use arguments
  4. to exit cam press "q" (make sure you use english keyboard)

How to use?

By default this script has two modes: recognition and master mode. In recognition mode the programm will wait until it sees a gesture to switch to master mode (by default it is open palm) for 20 frames. To switch back to recognition mode you should point your index finger up for 20 frames.

By default switching between modes has a sound notification (could be turned off using --muffle flag)

After you enter master mode the programm will automatically monitor the following parts of the palm:

  1. tip of each finger
  2. coordinate for every knuckle
  3. centroid of your knuckles

In master mode your mouse cursor follows the basis of your palm in relative coordinates (beta). Currently this program only supports one monitor (two monitors support will be added later).

To click with mouse close index finger and thumb. To release simply get those fingers apart. By doing so you can drag and drop applications or select text or do various stuff. To double click close middle finger and thumb.

Whats new?

  1. Added double click option
  2. Added various image enhancement parameters
  3. Added linear coordinates correction

For compliance or collaboration feel free to contact me at i.mikhailov@omnigene.tech