DroidBot + ChatGPT for easier GUI automation
Closed this issue · 0 comments
yuanchun-li commented
I'd like to introduce an interesting feature that we just started developing.
We are trying to support GUI automation with a simple text prompt.
For example, given a task prompt "create a contact named Yuanchun“, DroidBot automatically figures out how to complete the task in an app.
To achieve this, we use the superpower of ChatGPT-style models. The idea is simple - describing the task, current state, and available actions with natural language, and let ChatGPT make a choice of actions.
If you feel interested, please take a look: https://github.com/GAIR-team/DroidBot-GPT