OSU-NLP-Group/SeeAct

SeaAct cannot find screenshot of the page

Closed this issue · 4 comments

vbxx0 commented

Hello guys!
I have a problem launching example script on my website.
FileNotFoundError: [Errno 2] No such file or directory: 'seeact_agent_files/20240608_162057/screenshots/screen_1.png'

async def run_agent():
    agent = SeeActAgent(model="gpt-4-turbo",
                        default_task=TASK,
                        default_website=WEBSITE,
                        # save_file_dir="/tmp/test"
                        )
    await agent.start()
    while not agent.complete_flag:
        prediction_dict = await agent.predict()
        await agent.execute(prediction_dict)
    await agent.stop()


if __name__ == "__main__":
    asyncio.run(run_agent())

I didn't find any screenshots in the given folder, but found logs (website name was replaced)
image

As for google.com this works fine

boyugou commented

because you are opening "example.com", which is not an actual web page?

vbxx0 commented

@boyugou I replaced for the issue but its https://app.usebraintrust.com/jobs/12636

boyugou commented

Interestingly, I also failed to take screenshots of this webpage for the first time (succeeded the second time). Will try to figure out the reason.

vbxx0 commented

Interestingly, I also failed to take screenshots of this webpage for the first time (succeeded the second time). Will try to figure out the reason.

I believe it's a playwright issue. I think it will be useful to make ability to provide my own playwright instance (for example if I need playwright-stealth)

  • 👍1