lorey/mlscraper

Include fetching in scrapers

lorey opened this issue · 1 comments

lorey commented

Scrapers should be able to deal with urls, HTML, and parsed DOMs (even requests response objects?) to enable for flexible library usage.

  • scrapers input HTML, DOM, and responses, e.g. via scrape_soup, scrape_html, scrape_url
  • examples can be created via static methods, e.g. via SingleItemPageSample.from_soup, etc.
lorey commented

Currently omitted to avoid requests dependency. Could be relevant if asked for frequently.