/KobukiControlledByHand

Primary LanguagePythonBSD 3-Clause "New" or "Revised" LicenseBSD-3-Clause

BotControlledByHand

Description

This project proposes a way to control a robot in the simulator V-REP using Hand Gestures. All the gestures were obtained in the 1 Million Hand Dataset and used the CNN Topology proposed by the Inception V1, which the implementation were inspired by the repository TF-Deephand. The gestures used in this project are:

  • : The bot moves foward
  • : The bot moves very fast forward
  • : The bot moves backwards
  • : Stop the bot
  • : The bot starts to rotate anti-clockwise
  • : The bot starts to rotate clockwise
  • : Freezes the command interpreter
    • If freezed, it will only restart interpret the gestures if you unfreeze
  • : Unfreezes the command interpreter

It's possible execute the gestures with both hands. The script starts FREEZED, so it's necessary unfreeze it!

Requirements

  • V-REP: 3.6.1
  • Python: 3.7.2
    • Tensorflow: 1.13.1
    • Numpy: 1.16.2
    • OpenCV: 4.0.0

Run

  • Starts the V-REP and open the file scene.ttt
  • Starts the simulation
  • Run the script run.py and enjoy it

Video

IMAGE ALT TEXT HERE

License

BSD 3-Clause License

Copyright (c) 2019, Bruno Georgevich Ferreira All rights reserved.