sathish316/scrapify

Support for Basic Authentication

Opened this issue · 2 comments

Some pages require basic authentication.

Add support for username, password before crawling pages

class Library
  html "http://mylibrary.com"
  username "foo"
  password "bar"
end

Basic auth can be supported by changing the html like below

class Library
  html "http://foo:bar@mylibrary.com"
end

should it be captured separately?

Not sure how Nokogiri handles this. Waiting to test this before closing.