/news-feed-scraper

Configurable and schedulable web scrapping tool. Used to extract raw article content and metadata for aggregated news feeds.

Primary LanguageJava

News-Feed-Scraper

This is a web crawler, scraper, and extractor used internally at SessionApi for extracting financial news articles which are subsequently aggregated on some of our web products. See

Configure what crawl and what to extract

Execute on Schedule

To schedule the crawler to run automatically. Define a cron expression in your application.yml.