/MobileAgent

Mobile-Agent: The Powerful Mobile Device Operation Assistant Family

Primary LanguagePythonMIT LicenseMIT

Mobile-Agent: The Powerful Mobile Device Operation Assistant Family

Open in Spaces Demo ModelScope

MobileAgent | Trendshift

English | 简体中文 | 日本語

📺Demo

Mobile-Agent-v3 (Note: The video is not accelerated)

YouTube

YouTube

Bilibili

Bilibili

PC-Agent

Chrome and DingTalk

Search.NBA.FMVP.and.send.to.friend.mp4

Word

Write.an.introduction.of.Alibaba.in.Word.mp4

Mobile-Agent-v2

Mobile-Agent-v2.mp4

Mobile-Agent

Mobile-Agent.mp4

📢News

  • 🔥🔥[9.26] Mobile-Agent-v2 has been accepted by The Thirty-eighth Annual Conference on Neural Information Processing Systems (NeurIPS 2024).
  • 🔥[8.23] We proposed PC-Agent, a PC operation assistant supporting both Mac and Windows platforms.
  • 🔥[7.29] Mobile-Agent won the best demo award at the The 23rd China National Conference on Computational Linguistics (CCL 2024). On the CCL 2024, we displayed the upcoming Mobile-Agent-v3. It has smaller memory overhead (8 GB), faster reasoning speed (10s-15s per operation), and all uses open source models. Video demo, please see the last section 📺Demo.
  • [6.27] We proposed Demo that can upload mobile phone screenshots to experience Mobile-Agent-V2 in Hugging Face and ModelScope. You don’t need to configure models and devices, and you can experience it immediately.
  • [6. 4] Modelscope-Agent has supported Mobile-Agent-V2, based on Android Adb Env, please check in the application.
  • [6. 4] We proposed Mobile-Agent-v2, a mobile device operation assistant with effective navigation via multi-agent collaboration.
  • [3.10] Mobile-Agent has been accepted by the ICLR 2024 Workshop on Large Language Model (LLM) Agents.

📱Version

⭐Star History

Star History Chart

📑Citation

If you find Mobile-Agent useful for your research and applications, please cite using this BibTeX:

@article{wang2024mobile2,
  title={Mobile-Agent-v2: Mobile Device Operation Assistant with Effective Navigation via Multi-Agent Collaboration},
  author={Wang, Junyang and Xu, Haiyang and Jia, Haitao and Zhang, Xi and Yan, Ming and Shen, Weizhou and Zhang, Ji and Huang, Fei and Sang, Jitao},
  journal={arXiv preprint arXiv:2406.01014},
  year={2024}
}

@article{wang2024mobile,
  title={Mobile-Agent: Autonomous Multi-Modal Mobile Device Agent with Visual Perception},
  author={Wang, Junyang and Xu, Haiyang and Ye, Jiabo and Yan, Ming and Shen, Weizhou and Zhang, Ji and Huang, Fei and Sang, Jitao},
  journal={arXiv preprint arXiv:2401.16158},
  year={2024}
}

📦Related Projects