/FunCrawler

A F# fun project to crawl pull out information from domains.

Primary LanguageF#MIT LicenseMIT

WebCrawler for fun of F#

Some crazy features that could be there:

Usage:

  • Test out from the command line
  • Spread out to serverless infrastructure and create API
  • persist data to somewhere

Trigger:

Bonus stage:

  • What else is running on the same machine
  • CEF (Embedded chrome) to actual see what javascript does