alephdata/memorious

Make memorious run a crawler based on a yaml file

sunu opened this issue · 1 comments

sunu commented

Introduce a mode where memorious can:

  • run a crawler based on a yaml file
  • run in single threaded mode and use fakeredis as queue

We aim to use this in Argo workflows.

sunu commented

Fixed in #161