nla/chronicrawl

Issues

• Add index to speed up crawl log

  #16 opened 4 years ago by ato
  1

• Extended browser page watching times

  #18 opened 4 years ago by ato
  0

• Enqueue implicit favicons

  #17 opened 4 years ago by ato
  0

• Images should default to a slower revisit cycle

  #13 opened 4 years ago by ato
  0

• Don't write revisits for small content lengths

  #15 opened 4 years ago by ato
  0

• WARC compression support

  #14 opened 4 years ago by ato
  0

• CSS link extraction

  #12 opened 4 years ago by ato
  0

• Follow redirects

  #7 opened 4 years ago by ato
  0

• Throttle revisits via browser of hard error urls

  #11 opened 4 years ago by ato
  0

• Use cache-control for next visit

  #10 opened 4 years ago by ato
  0

• UI Screenshots

  #5 opened 4 years ago by ato
  0

• Fuzzier identical criteria for revisit scheduling

  #9 opened 4 years ago by ato
  0

• Localise dates in UI

  #8 opened 4 years ago by ato
  0

• Resource size limit

  #6 opened 4 years ago by ato
  0

• Configurable revisit schedules

  #2 opened 4 years ago by ato
  0

• Link extraction

  #3 opened 4 years ago by ato
  0

• Improve HTTP client

  #1 opened 4 years ago by ato
  0