Cengo is a program that allows users to play any pc video game using their hand signs and movements instead of using mouse and keyboard. It uses OpenCV python script to access the user’s webcam, Mediapipe from Google to recognise hands, color detection for mouse movements and PyDirectInput library of python to emulate keypresses. The combination of these allows users to play games using hand signs.
videoplayback.mp4
Clone the respository into your pc on any folder. Run CengoMain and open any game to play it in.
Instructions of use- The left hand index finger is used as to press release the W key. Raising it will press W and putting it down will release W. Red marker is used to move the mouse. The left hand thumb is used to emulate mouse left button press. Opening the thumb will click the mouse and closing it will release the mouse button.
Credits - Followed his tutorials for hand gesture recognition - https://www.youtube.com/c/MurtazasWorkshopRoboticsandAI