web-arena-x/visualwebarena

Issues

• Classifieds is impossible to evaluate for vision-based CC agents

  #70 opened a month ago by liaopeiyuan
  2

• How to run Llama3-70B-Instruct on VWA?

  #65 opened a month ago by yxchng
  1

• Wrong evaluation

  #71 opened a month ago by yeonjooooni
  1

• Error('It looks like you are using Playwright Sync API inside the asyncio loop.\nPlease use the Async API instead.')]

  #69 opened a month ago by binkybarnes
  0

• net::ERR_ABORTED

  #68 opened a month ago by binkybarnes
  1

• clear action related test failed

  #66 opened 2 months ago by shuyanzhou
  0

• Reproducing open-source model results

  #27 opened 7 months ago by anithselva
  2

• Access to Dockerfile and compose.yaml files

  #64 opened 2 months ago by Philmod
  2

• How to set up multiple docker for the same website to conduct the parallel evalution.

  #61 opened 3 months ago by leoozy
  1

• action space of som can not solve the select element

  #54 opened 3 months ago by leoozy
  3

• The very important element: "sort" can not be found in accessibility_tree_with_captioner.

  #59 opened 3 months ago by leoozy
  3

• Need for resetting in run som scripts

  #60 opened 4 months ago by sanjari-orb
  2

• Pytest code is not working

  #56 opened 4 months ago by pokerme7777
  1

• Release log of success/failures for GPT4+SOM trajectories

  #58 opened 4 months ago by sanjari-orb
  2

• MySQL error with Classifieds website

  #31 opened 7 months ago by vardaan123
  5

• Trouble with Checkboxes

  #18 opened 4 months ago by gurugecl
  4

• Multiple unreachable image ulrs

  #50 opened 4 months ago by Saraabdali
  1

• Issue with URL links in classifieds tasks

  #55 opened 5 months ago by Saraabdali
  1

• How to open trace files without display server?

  #53 opened 5 months ago by piperwolters
  1

• Archive.org Download Links Not Working

  #42 opened 5 months ago by jdy18
  1

• It seems that the search text for city does not work for the classifieds?

  #47 opened 5 months ago by leoozy
  1

• Why you have to remove the dupulicated content.

  #46 opened 5 months ago by leoozy
  1

• Configurations Setup for all Model Types

  #30 opened 5 months ago by anithselva
  12

• Some examples will report an error when running run.py

  #17 opened 7 months ago by XinrunXu
  4

• [Question] How to view the generated .trace files for a trace?

  #52 opened 5 months ago by ReeceResearch
  1

• May I know any solution for using apptainer instead of docker for starting up website?

  #51 opened 5 months ago by pokerme7777
  0

• Elasticsearch / Opensearch issues on Shopping Website

  #37 opened 7 months ago by mlin12321
  6

• AssertionError: Cookie ./.auth/reddit_state.json expired.

  #49 opened 6 months ago by leoozy
  2

• ImportError: cannot import name 'GITLAB' from 'browser_env.env_config'

  #43 opened 6 months ago by leoozy
  3

• Errors in annotation

  #41 opened 6 months ago by leoozy
  12

• How to navigate to www.homepage.com?

  #34 opened 6 months ago by leoozy
  3

• Shopping Website Issues with setup:store-config:set

  #35 opened 6 months ago by mlin12321
  1

• Assertion error in LLM based fuzzy match

  #40 opened 6 months ago by vardaan123
  1

• Evaluation always skips last task for any website

  #39 opened 7 months ago by vardaan123
  1

• How to manually reset the shopping/reddit website?

  #32 opened 7 months ago by leoozy
  1

• Could you please release the code about how to run the CogVLM?

  #33 opened 7 months ago by leoozy
  1

• How do you evaluate CogVLM when there are multiple images as input.

  #36 opened 7 months ago by leoozy
  1

• AttributeError("'Page' object has no attribute 'client'")

  #38 opened 7 months ago by vardaan123
  3

• Osclass Error

  #26 opened 7 months ago by DEM1TASSE
  3

• Website Files Missing

  #29 opened 7 months ago by mlin12321
  5

• PyTest fail on test_click_open_new_tab

  #28 opened 7 months ago by anithselva
  0

• Possibility of altering evaluation sites

  #20 opened 7 months ago by devinat1
  1

• Blank screenshot when running GPT-4V + SOM

  #19 opened 8 months ago by ltzheng
  1

• Search in Classifieds is too bad to be used as meaningful tests

  #11 opened 8 months ago by mondaychen
  1

• Questions about pytest -x

  #16 opened 8 months ago by XinrunXu
  3

• What are the multi-site tasks mentioned in the paper?

  #14 opened 8 months ago by XinrunXu
  2

• docker compose takes too much time, always fails here.

  #8 opened 9 months ago by youbaowangsheng
  4

• 'devicePixelRatio is not 1.0' when running run_demo.py

  #6 opened 9 months ago by EvgenyKos
  3

• about CogVLM

  #7 opened 9 months ago by jun0wanan
  6

• Release for multi-modal agents on arbitrary website

  #1 opened 10 months ago by froggy-hub
  2