hm-seclab/YAFRA

Add Webscraper for websites without rss feed

p2h5 opened this issue · 0 comments

p2h5 commented

Is your feature request related to a problem? Please describe.
Various websites are not having rss feeds to scrape. For those websites, another way has to be found to get the data from.

Describe the solution you'd like

  • Download html from gven sources
  • Extract links from the downloaded data.
  • Scrape for IOCs within the reports, the link points to.