pavlovtech/WebReaper

SetCookies feature is not working as expected

Opened this issue · 0 comments

Describe the bug
When I pass the login cookies via .SetCookies in ScraperEngineBuilder as example mentioned, the login was not set properly.

To Reproduce
Steps to reproduce the behavior:

  1. Extract login cookies from the selenium chrome browser
  2. Inject the cookiecollection into puppeteer via .SetCookies with ScraperEngineBuilder as in example
  3. Run it with headless mode to see the login status. (Make sure set parallelsimDegree to 1)
  4. target page will load for three times and throw the error.

Expected behavior
The target page shall be loaded with login set.

Desktop (please complete the following information):

  • OS: Windows11
  • Browser Chrome
  • Version 119.0.6045.200

Additional context
Please have a look in PuppeteerPageLoader.cs: line 63 .
I think url must be loaded prior setting the cookie.