A python application to capture the onscreen health data of a game to process onscreen health and send it to hardware device through serial communication.
Python Application Feature :
- Saving different games health bar location / processing information
- Interactive screenshot to get the healthbar / health value co-ordinates
- Customizable serial communication (ports / badu rate selection)
- In built image editor
- Performs OCR on Health value
- Determines Health value based on Health bar
Arduino Application Feautre:
- ESP-NOW integrated
- Reads data from serial
- Drive different addressable RGB leds
- Open CV
- Pillow
- numpy
- pyserial
- pytesseract
- pyautogui
Navigate to the main.py file location and run the command in cmd/power shell.
Python main.py
Home page - Here select the com port where the device is connected and set the badu rate.
Interactive Screenshot - select the part of the screen where the health bar or health value is located. (Make sure the image/game is full screen when you do this)
Selection of health bar
Selection of health value
Editor Window - Here the images are processed to get the health value by using sliders (threshold, brightness and blur).
Editing for health bar
Editing for health value
Open the Arduino IDE and follow the below steps:
Sketch -> include library -> ManageLibrary -> *Search for the above libraries*
Or follow the instructions on respective library repository.
Video explanation for hardware/circuit: Youtube link
This is the first version so there are way to many bugs for now, let me know what issues you find. The latency of processing the health value varies dpending on the specs of the PC.
LICENSE.md file for details