everypolitician/scraped

Issues

• Investigate scope of #99

  #100 opened 7 years ago by tmtmtmtm
  7

• "invalid byte sequence in UTF-8" from CleanURLs decorator

  #99 opened 7 years ago by tmtmtmtm
  4

• Decorators don't know what content type they're dealing with

  #61 opened 8 years ago by chrismytton
  0

• add a CONTRIBUTING.md statement

  #96 opened 7 years ago by davewhiteland
  1

• AbsoluteUrls should have been deprecated, not simply removed

  #87 opened 7 years ago by tmtmtmtm
  1

• `.to_h` should always only return a plain data structure

  #98 opened 7 years ago by ondenman
  0

• AbsoluteUrls: print warning when URL can't be parsed

  #53 opened 8 years ago by chrismytton
  0

• latest Rubcop expects %i literals to use square brackets (violation in Rakefile)

  #93 opened 7 years ago by davewhiteland
  1

• Come up with better elevator pitch

  #45 opened 8 years ago by chrismytton
  0

• Correct out of date reference to AbsoluteUrls in Changelog

  #88 opened 8 years ago by tmtmtmtm
  0

• Handle JSON documents

  #81 opened 8 years ago by ondenman
  1

• [AbsoluteUrls] Handle URI::InvalidComponentError error

  #65 opened 8 years ago by chrismytton
  0

• Rubocop failing on master

  #78 opened 8 years ago by chrismytton
  1

• Allow passing request headers to strategies

  #75 opened 8 years ago by chrismytton
  0

• [AbsoluteUrls] Rename class

  #73 opened 8 years ago by ondenman
  0

• AbsoluteURLs decorate -- URI.unescape is obsolete

  #62 opened 8 years ago by ondenman
  2

• [AbsoluteURLs] Decorator adds new line characters

  #72 opened 8 years ago by ondenman
  0

• AbsoluteUrls decorator should ensure urls are encoded correctly

  #52 opened 8 years ago by chrismytton
  3

• Make the logger configurable

  #9 opened 8 years ago by chrismytton
  2

• Improve documentation for Scraped::Request

  #27 opened 8 years ago by chrismytton
  0

• Handle incorrect key ordering in fragment method

  #63 opened 8 years ago by chrismytton
  0

• Add a shortcut for dealing with fragment

  #43 opened 8 years ago by chrismytton
  2

• Add 'fragments' method for multiple calls to 'fragment' in a loop

  #49 opened 8 years ago by tmtmtmtm
  0

• Add a shortcut for scraping a url with a class

  #50 opened 8 years ago by chrismytton
  3

• Check that responses have correct status

  #51 opened 8 years ago by chrismytton
  0

• Add docs for String#tidy method

  #56 opened 8 years ago by chrismytton
  0

• Find a nicer way to configure strategies and decorators

  #28 opened 8 years ago by chrismytton
  0

• Allow decorators to be removed

  #35 opened 8 years ago by chrismytton
  0

• non-breaking spaces + AbsoluteURL decorator

  #57 opened 8 years ago by tmtmtmtm
  0

• AbsoluteUrls decorator: Handle <base> HTML tag

  #58 opened 8 years ago by chrismytton
  0

• Add String#tidy method

  #8 opened 8 years ago by chrismytton
  0

• AbsoluteUrls fails with javascript: urls

  #40 opened 8 years ago by tmtmtmtm
  1

• Built-in decorators to make links and images absolute

  #38 opened 8 years ago by chrismytton
  1

• Docs about request strategies are wrong

  #36 opened 8 years ago by chrismytton
  0

• Bump field_serializer dependency to 0.3.0

  #33 opened 8 years ago by chrismytton
  0

• Remove dependency on scraped_page_archive

  #22 opened 8 years ago by chrismytton
  0

• Add a ScrapedPage::Scope class

  #4 opened 8 years ago by chrismytton
  0

• open-uri-cached strategy

  #11 opened 8 years ago by chrismytton
  0

• Move HTML specific bits into a ScrapedPage::HTML class

  #17 opened 8 years ago by chrismytton
  0

• Provide a mechanism for pre-processing html

  #10 opened 8 years ago by chrismytton
  1

• Add a class to represent requests and their responses

  #15 opened 8 years ago by chrismytton
  0

• ScrapedPage subclasses should only deal with responses

  #16 opened 8 years ago by chrismytton
  0

• Rename this library "Scraped"

  #24 opened 8 years ago by chrismytton
  1

• Add a header to archive responses to indicate the actual url for the response

  #26 opened 8 years ago by chrismytton
  0

• No way of getting the url for a response

  #18 opened 8 years ago by chrismytton
  0

• Add method for accessing url query string params

  #13 opened 8 years ago by chrismytton
  1

• add an open-uri-cached strategy

  #14 opened 8 years ago by tmtmtmtm
  1

• Add to_csv method or equivalent to ScrapedPage

  #5 opened 8 years ago by chrismytton
  0

• It's not clear what the 'noko' method does

  #2 opened 8 years ago by chrismytton
  0