Powerful and modular Java RSS/ATOM feeds aggregator and indexer.
Allows fetching one or multiple feeds in multithreaded way and store it to chosen/custom backend.
The aggregator is based on Java Batch Processing (JSR 352) framework and ships base logic for:
- Reading RSS/ATOM feed
- Storing to backend e.g. mongo
- Common logic for logging, skip invalid posts etc.
- Parsing multiple feeds and triggering appropriate feed reader jobs
Thanks to the framework it's possible to declaratively define the overall workflow.
Maven multi-module layout offers picking exactly what is needed to produce microservice rather than combining all combinations together.
The project ships also ready to go distributions which can be used as well as for creating own combinations.
- feeds2mongo - indexer with mongo backend.
- api-mongo - REST API backed by mongo DB.