Update documentation
Closed this issue · 0 comments
dismantl commented
The README documentation needs to be update to reflect the following changes:
- The spider component is now run in a Docker container using AWS Elastic Container Service (ECS). The description and diagrams in the README should be updated to reflect this.
- Both the spider and scraper components are run automatically at multiple intervals using cron-like scheduled tasks.