OSU-NLP-Group/SeeAct
[ICML'24] SeeAct is a system for generalist web agents that autonomously carry out tasks on any given website, with a focus on large multimodal models (LMMs) such as GPT-4V(ision).
PythonNOASSERTION
Issues
- 4
SeaAct cannot find screenshot of the page
#36 opened by vbxx0 - 1
- 5
- 2
keep state between runs
#51 opened by herval - 0
Suggestion: Add terminal operator capability
#50 opened by James4Ever0 - 0
Instruction on offline code.
#47 opened by lihaoliu-cambridge - 0
SOM bounding boxes crash on certain websites
#46 opened by mlin12321 - 1
- 0
- 1
- 1
- 2
som branch has duplicate overlays
#39 opened by mlin12321 - 2
<div> as an interactive element
#38 opened by MeLoveCarbs - 0
- 0
Model Predictions and Oracle Grounding
#12 opened by oriyor - 1
Statement has no effect
#30 opened by manuel-delverme - 1
- 1
Mistake or workaround?
#34 opened by manuel-delverme - 0
- 0
openai.error.APIError: HTTP code 413 from API
#26 opened by leoozy - 0
- 0
Why is there an extra unmatched quote?
#29 opened by manuel-delverme - 0
typo :)
#31 opened by manuel-delverme - 1
Deadcode?
#28 opened by manuel-delverme - 3
Config not loaded?
#27 opened by manuel-delverme - 2
pip package
#17 opened by yimothysu - 1
Is the demo still working?
#19 opened by agonza1 - 1
- 0
Can an online assessment yield a score, or can the process of an offline assessment be visualized?
#22 opened by Tangent-90C - 0
What is the Accuracy for Ungrounded Experiments?
#21 opened by Arvulus - 0
possibly dumb action space ideas
#18 opened by keeganpoppen - 0
Model trajectories release
#16 opened by taogoddd - 1
No browser event when set experiment_split="element_attribute" in generate_prompt in seeact.py
#14 opened by cc13qq - 1
- 1
No such file or directory: '../data/formal_manual_selection/task_id_dicts/30_selected.pkl'
#10 opened by cc13qq - 1
No such file or directory: '../data/formal_manual_selection/task_id_dicts/30_selected.pkl'
#9 opened by ningyu1991 - 1
How to get total raw data from globus
#8 opened by HarryZhou-618 - 2
Full code release date
#7 opened by shanjiaming - 2
Looking to test this against my website
#2 opened by Shoshin23 - 1
Setup and experiment guide on readme file
#4 opened by asuzukosi - 1
Look forward to full code release
#5 opened by zfchenUnique