gui-automation
There are 59 repositories under gui-automation topic.
camel-ai/crab
🦀️ CRAB: Cross-environment Agent Benchmark for Multimodal Language Model Agents. https://crab.camel-ai.org/
TransformerOptimus/AutoNode
AutoNode: A Neuro-Graphic Self-Learnable Engine for Cognitive GUI Automation
LLmHub-dev/open-computer-use
The Open Framework for autonomous virtual computer agents at scale, fully open-source, safe, auditable, and production-ready.
Integration-Automation/AutomationIDE
AutomationIDE , Python IDE creare by Python, Include [WEB, API, GUI, Load & Stress] automation.
Integration-Automation/AutoControlGUI
A framework for GUI automation
imbus/robotframework-robosapiens
Fully localized Robot Framework library for automating the SAP GUI using text locators
juancarlospaco/nim-xdo
Nim GUI Automation Linux, simulate user interaction, mouse and keyboard.
nolantait/deskbot
Desktop automation library for Ruby
Dentosal/autogui-rs
GUI automation toolkit for Rust
abdur75648/V-Zen
V-Zen: Efficient GUI Understanding and Precise Grounding With A Novel Multimodal LLM Resources
arsho/t_rex_bot
Google Chrome offline game (T Rex) bot using Python.
michalkasiarz/selenium-webdriver-java
Selenium WebDriver with Java from LetsKodeIt
sagerpascal/computer-control-agents
Official Repo of "AI Agents for Computer Use: A Review of Instruction-based Computer Control, GUI Automation, and Operator Assistants"
ClimenteA/pyrobogui
Wrapper around pyautogui - plus some new functions. Ideal for doing robotic process automation.
JustoSenka/MouseRobot
Mouse Robot C#
lambsteak/auto-pixel-canvas
Automatically supply intelligent clicks to targeted kinds of pixel blocks in a dynamic canvas element.
varunbpatil/OTP_scanner
Scan one-time-password generated on your mobile phone via webcam for use on your computer.
crispyzingy/gui-automation
💻⌨🖱 Programmatically control the mouse & keyboard
jithurjacob/Clash-Of-Clans---TrophyDropBot
A simple Automation bot for dropping trophies in Clash of Clans
Mordekai66/design2apps
This project automates the conversion of Figma designs into Python code, supporting frameworks like Tkinter, Kivy, and PyQt5. It streamlines UI development by transforming design files into fully functional, customizable Python code while preserving the original layout, colors, fonts, and components.
EddieTGH/tftBot
A Python-programmed bot using GUI Automation (PyAutoGUI library) and image recognition (OpenCV) that completely automated the process of queuing into and playing the video game Teamfight Tactics in order to earn tokens for rewards while I was not actively using my computer (ie. during the night).
pmqtt/IntelliType
Automate the typing process
veilair/UI-testing-development
An ongoing curated list of frameworks, books, articles, talks, screencasts, recordings, libraries, learning tutorials and resources about UI Testing & Best Practices Development
Vibhu-Agarwal/Automated-Draw-In-MS-Paint
It asks for names. Using GUI Automation, opens MS-paint in Windows 10 and draws the names using brushes or pencils.
f01c33/robotgo-macro-recorder
records keypresses and mouse clicks and exports as a Go program that does the same actions
lksrz/mcp-desktop-pro
Advanced MCP server for AI agents, computer use automation, and desktop operator control: Intelligent Window Management 🪟, Multi-Action Chaining ⛓️, AI-Optimized Screenshots 🖼️, macOS and Retina Display Support 🍎. Ideal for testing apps, games, and running desktop tasks locally with AI agents through Model Context Protocol.
rafbradey/miscrit-auto-farm-bot-py
A simple bot for Miscrits that helps you grind EXP by auto-attacking and capturing rare Miscrits using image recognition.
Rafiere/click-helper
A simple GUI automation tool that uses a declarative YAML-based language. Instead of writing complex code, you can define your automation flows with clear and readable commands. It makes it easy to automate desktop tasks, from simple clicks and movements to opening applications, all within a single configuration file.
venomnert/Cell
Cell the trading bot
batuafk/PYAutmation
Code executor in python (send key in background, locate image, keyboard, mouse, discord, tor proxy, growtopia)
chiragx16/SAP-LOGON-GUI-Automation
Automates SAP Logon GUI tasks using Python + PyWinAuto — useful for repetitive workflows, report generation, and task scheduling.
DineshNeupane/GUI-Automation-Tool-GAT
Python based GUI automation tool to do tedious repetitive tasks automatically, uses Tkinter and pyautogui.
EddieTGH/Python-GUI-Bot
This is Edmond 2.0, a Python-programmed bot using GUI Automation (PyAutoGUI library) and image recognition (OpenCV) that completely automated the entire “trading” process in my favorite video game, Realm of the Mad God.; facilitated game objectives including publishing trade offers, communicating with both sellers and buyers, selecting the items to trade, and confirming that the trade was legit. Recorded videos to continuously catch and fix bugs and improve the bot’s communication methods.
FilipRokita/pyClicker
pyClicker is a Python program that automates mouse clicks. It utilizes the PyAutoGUI library to perform the clicking action and the keyboard library to start and stop the clicking process. Users can customize the start and stop buttons according to their preferences. With pyClicker, repetitive clicking tasks can be completed with ease.
kumarmuthu/PythonGUIAutomation
PythonGUIAutomation
melchiorhering/GUI-OS-AI-Agent-Benchmarking
A modular framework for benchmarking multimodal AI agents in a reproducible, full-OS environment. Using and adaption of the Smolagents's CodeAgent, Docker containers to run the VM in, VM's created using Qemu.