dgtlmoon/changedetection.io

[feature] more "fetch method"

Closed this issue · 0 comments

Version and OS
latest 2ddd3fe1b0c8 on docker

Is your feature request related to a problem? Please describe.
Fetching from Leboncoin using WEBDRIVER_URL: http://browser-chrome:4444/wd/hub works and stops working as soon as I add PLAYWRIGHT_DRIVER_URL: ws://sockpuppetbrowser:3000 as playwright gets blocked by an anti-robot solution.

Describe the solution you'd like
Let me add a playwright_driver_url to use playwright when possible, to preview, or to help me filter the page and so on, but allow me to force a group of checks and a check itself to use the webdriver url and not the playwright url ?

Describe the use-case and give concrete real-world examples
Try fetching https://www.leboncoin.fr/recherche?text=humidificateur&shippable=1&owner_type=all&sort=time
You should see that you get blocked with playwright but can parse the results with only the webdriver_url set and a working chrome container.

Additional context
I'm new here so maybe I'm using the tool wrong, it's always a possibility ;-)