webrecorder/browsertrix

[Bug]: crawl waiting for resources indefinitely

Closed this issue · 0 comments

Browsertrix Version

v1.10.2-dc9069d

What did you expect to happen? What happened instead?

I expected the crawler to start crawling. Instead, crawler is waiting for resources indefinitely (let it wait for 13 days :) ). Even while there are no limits applied to the organisation or any other place.

Reproduction instructions

Go to you organisation. Start a new seeded crawl. Fill in the details and choose 'pages on this domain'. Unlimited depth. Include any linked page. No exclusions, no additional urls. Default browser profile No max pages. Crawler instances X3. Auto scroll behavior on.
Run on save > Save.

  • Crawl starting...
  • After 2 minutes: red error message right bottom of the screen saying Sorry, couldn't retrieve Workflow at this time.
  • the whole instance becomes inresponsive / white screen on reload.
  • a few minutes later the UI works again. The crawls status is now: Waiting (At Capacity).

This issue may be related to #1923.

Screenshots / Video

No response

Environment

Proxmos / Ubuntu server 22.04 / MicroK8S / Helm3

Additional details

No response