TypeError after successful action

Question

TypeError after successful action

SmartALB opened this issue 9 months ago · 5 comments

Hello!
We are very excited about this project.
During my test runs, I notice that it is not yet completely stable.

While this action is performed without any problems:

await ai("Click on a day", { page: appointmentManagerPage, test })

This error is thrown after successfully(!) performing this action:

await ai("Click on a time slot", { page: appointmentManagerPage, test })

TypeError: undefined is not iterable (cannot read property Symbol(Symbol.iterator)) at Object.getContentQuads (r:\Sources\...\Playwright\node_modules\@zerostep\playwright\src\cdp.ts:208:7) at Object.clickCDPElement (r:\Sources\...\Playwright\node_modules\@zerostep\playwright\src\playwright.ts:11:32) at executeCommand (r:\Sources\...\Playwright\node_modules\@zerostep\playwright\src\index.ts:210:14) at r:\Sources\...\Playwright\node_modules\@zerostep\playwright\src\index.ts:147:30

Answer 1 · 2023-12-14T21:29:11.000Z

Thank you for reporting @SmartALB - we will take a look and report back on what we find!

Answer 2 · 2023-12-18T14:44:35.000Z

Hi @SmartALB,

Thank you for bringing this to our attention. I am one of the developers at ZeroStep and I am investigating what the issue is here. It would be very helpful if I could reproduce the issue myself - would that be possible? If this appointment manager site is publicly accessible, would you mind sharing the full Playwright test where you saw this problem occurring?

Answer 3 · 2023-12-18T14:58:47.000Z

Hi @SmartALB,

Thank you for bringing this to our attention. I am one of the developers at ZeroStep and I am investigating what the issue is here. It would be very helpful if I could reproduce the issue myself - would that be possible? If this appointment manager site is publicly accessible, would you mind sharing the full Playwright test where you saw this problem occurring?

Hi! Sure. I can send you the url of an calendar off this channel (discord?)

Answer 4 · 2023-12-18T15:41:31.000Z

I received your DM on discord. I will take a look and let you know what I find. Thanks!

Answer 5 · 2023-12-18T17:23:49.000Z

Hey @SmartALB

At the moment, this is a shortcoming of our AI. The issue is that the page changes in a way that isn't expected and so while we successfully execute the action as described, we try (and fail) to execute another action. Until improvements to our AI are shipped that address this, you can reword the prompt so that it doesn't fail. We've found that "Click on the first time slot" works, and is more a predictable action anyway.

Thanks for bringing this to our attention, and hope this helps!