/scrapex

⛏ Fast and robust web crawling/scraping tool in Elixir

Primary LanguageElixir

Scrapex

Fast and robust web crawling/scraping tool in Elixir. Powered by job processing library - Exq

Features

  • Minimal and easy to use DSL - examples.
  • PhantomJS rendering via Hound.
  • Queue, concurrent processing, retries, fault-tolerance - all thanks to Exq and Elixir/OTP.

Installation

def deps do
  [
    {:scrapex, "~> 0.1.0"}
  ]
end