iipc/jwarc

Issues

• ClueWeb09 WARC files faile to parse

  #26 opened 6 months ago by sebastian-nagel
  2

• ParsingException when reading ClueWeb09 files

  #86 opened 6 months ago by gijshendriksen
  3

• UncheckedIOException, invalid WARC record error

  #84 opened 9 months ago by gleporeNARA
  3

• UncheckedIOException, unexpected end of gzip

  #85 opened 10 months ago by gleporeNARA
  1

• IllegalArgumentException on ARC Parsing

  #83 opened a year ago by gleporeNARA
  1

• ARC variants with different interpretations of version-block length

  #82 opened a year ago by tballison
  7

• Custom records awkward to register due to package private constructors in the default records

  #81 opened a year ago by vlofgren
  1

• jwarc failing to read Http body at the second pass of a file

  #80 opened a year ago by vlofgren
  3

• Multithreading issue on GzipChannel write header

  #79 opened a year ago by creyer
  1

• CDX indexer fails to parse (webrecorder) WARC file and terminates.

  #78 opened a year ago by thomasegense
  2

• invalid HTTP message at byte position 6: HTTP/2<-- HERE --> 200

  #70 opened a year ago by nice-redbull
  1

• CDX indexer: support revisit records

  #71 opened a year ago by ato
  0

• CDX indexer: Keep calculated digest from WARC header

  #73 opened 2 years ago by thomasegense
  1

• CDX indexer: CDXJ output support

  #72 opened 2 years ago by ato
  0

• disable serviceworker in replay proxy mode

  #69 opened 2 years ago by sberequek
  3

• WarcRevisit Builder with String targetURI

  #67 opened 2 years ago by robertvanloenhout
  1

• Build WarcRevisit with refersTo String targetURI

  #65 opened 2 years ago by robertvanloenhout
  1

• Raw header access

  #42 opened 3 years ago by ato
  1

• Request/Response Builder with String targetURI

  #63 opened 3 years ago by robertvanloenhout
  2

• ARC parser infinite loop reading body

  #62 opened 3 years ago by sebastian-nagel
  1

• Native OSX / Linux binaries do not work

  #61 opened 3 years ago by ikreymer
  3

• wget quirk: Content-Length off by one

  #29 opened 3 years ago by ato
  1

• RecordBuilder: Date/Timestamp truncated if .date(..) is called before .version(WARC_1_1)

  #58 opened 3 years ago by lambdaupb
  1

• replay proxy doesn't start because of sw.js file not found

  #57 opened 4 years ago by mbreevoort
  1

• Recording proxy with browser javax.net.ssl.SSLHandshakeException

  #56 opened 4 years ago by sberequek
  4

• GunzipChannel fails on payload with uncompressed size exceeding int_max

  #54 opened 4 years ago by sebastian-nagel
  0

• Gzip compression

  #53 opened 4 years ago by alex73
  1

• How to parse not standard http header? avoid not throw exception?

  #50 opened 5 years ago by ysykzheng
  3

• Utility methods to read payload body

  #48 opened 5 years ago by sebastian-nagel
  1

• GzipChannel write() returns compressed length rather than buffer consumption

  #44 opened 5 years ago by ato
  1

• ByteBuffer inflate and deflate support

  #45 opened 5 years ago by ato
  0

• Avoid unchecked exceptions caused by malformed HTTP captures

  #39 opened 5 years ago by sebastian-nagel
  1

• Optional space after chunk-size in chunked transfer-encoding

  #33 opened 5 years ago by sebastian-nagel
  0

• Don't throw on duplicate keys in media type parameters

  #40 opened 5 years ago by ato
  0

• Add lenient HttpParser

  #25 opened 5 years ago by sebastian-nagel
  2

• Payload body has size 0 if HTTP Content-Length header is missing

  #36 opened 5 years ago by sebastian-nagel
  0

• Chunked body parser may read over end of chunk if destination buffer has higher capacity

  #34 opened 5 years ago by sebastian-nagel
  0

• GunzipChannel input position is off by 2 if gzip extra field is present

  #31 opened 5 years ago by sebastian-nagel
  0

• WARC 1.0 quirk: angle brackets around WARC-Target-URI

  #30 opened 5 years ago by ato
  0

• Chunked transfer-encoding causes exceptions at end of WARC record

  #24 opened 5 years ago by sebastian-nagel
  4

• WarcReader/GunzipChannel to check ByteBuffer in constructor

  #21 opened 5 years ago by sebastian-nagel
  3

• WarcReader may hang up on clipped gzipped WARC file

  #17 opened 5 years ago by sebastian-nagel
  0

• Leverage gzip extra field "sl" to skip over compressed WARC records

  #16 opened 5 years ago by sebastian-nagel
  0

• IoException reading gzip extra

  #14 opened 5 years ago by sebastian-nagel
  0

• Should we include a Dockerfile?

  #10 opened 6 years ago by ibnesayeed
  4

• Support multiple captures of the same URL in WarcServer index

  #12 opened 6 years ago by ato
  0

• Add build instructions

  #13 opened 6 years ago by machawk1
  1

• Rudimentary Memento support on replay

  #11 opened 6 years ago by machawk1
  3

• Typo in url_byte in http and warc grammars

  #9 opened 6 years ago by ato
  0

• Run an external command on each record

  #8 opened 6 years ago by ato
  0