internetarchive/heritrix3

Issues

• Improve the HTML Parser for alternative resolution images

  #604 opened 3 months ago by saraaubry
  0

• Provided seed files are updated (the more the job is repited, the more they are modified)

  #558 opened 2 years ago by cgr71ii
  0

• How to change auth type?

  #556 opened 6 months ago by Moogamouth
  0

• Heritrix 3.4.0-SNAPSHOT-2022-03-08T19:15:59Z keeps pausing..

  #569 opened 6 months ago by cslr
  1

• Support for silent option when running a job

  #563 opened a year ago by melker
  0

• Maven build fails due to HTTP only upstream servers

  #481 opened 6 months ago by Jauchi
  5

• Question about memory usage

  #462 opened 3 years ago by naveen17797
  3

• Text versions of DNS should be recorded as WARC-Type resource instead of response

  #568 opened a year ago by ato
  0

• Redirect field in seeds-report.txt is only populated for status 301 and 302

  #564 opened a year ago by ato
  0

• archive web crawler - crawl speed

  #562 opened a year ago by solaceten
  7

• Error when more than 125 jobs are instantiated

  #559 opened 2 years ago by cgr71ii
  4

• WARNING: politessDelay unset, returning default 5000

  #553 opened 2 years ago by cgr71ii
  0

• Compatibility problems with Sonatype release process

  #494 opened 2 years ago by anjackson
  0

• Error: Could not find or load main class org.archive.crawler.Heritrix Caused by: java.lang.ClassNotFoundException: org.archive.crawler.Heritrix

  #546 opened 2 years ago by Moogamouth
  2

• Question about the size of the 'state' directory

  #498 opened 2 years ago by cgr71ii
  3

• RateLimitGuard.authenticate() authentication failure

  #474 opened 3 years ago by troloff
  2

• SurtPrefixedDecideRule doesnt seem to work as expected

  #436 opened 3 years ago by naveen17797
  3

• Exclude PDF-Files

  #453 opened 3 years ago by oschihin
  8

• Question: how to create a new log/report for a single class

  #501 opened 2 years ago by cgr71ii
  0

• Question re: cloudfront.net

  #487 opened 2 years ago by carj
  1

• Question

  #485 opened 2 years ago by zhaobm
  0

• How to scale Heritrix with Kubernetes?

  #466 opened 2 years ago by naveen17797
  0

• How to cite?

  #463 opened 2 years ago by Querela
  2

• Impact of log4j CVE-2021-44228 on heritrix3?

  #451 opened 2 years ago by bnewbold
  1

• Authentication on servers using Oauth2

  #446 opened 2 years ago by AndreSchmutz
  4

• cannot resolve these dependencies

  #443 opened 2 years ago by oldRabbitForz
  10

• [Question] Where should i set the content obtained from http request ?

  #438 opened 2 years ago by naveen17797
  1

• Resume a crawl for later

  #500 opened 2 years ago by JenPho
  0

• Questions about TransclusionDecideRule

  #496 opened 2 years ago by cgr71ii
  6

• Implicit max. value of URI cost and precedence (?) should raise warning if exceeded

  #502 opened 2 years ago by cgr71ii
  1

• Time is not stopped when Disk Space Monitor is triggered and report files are removed

  #499 opened 2 years ago by cgr71ii
  5

• Bean reference missing inherited properties

  #497 opened 2 years ago by ato
  0

• ${launchId} is not being replaced (sometimes)

  #495 opened 2 years ago by cgr71ii
  1

• Apple Silicon docker images

  #471 opened 3 years ago by ziodave
  1

• Job build fails with NoClassDefFoundError: org/slf4j/LoggerFactory

  #482 opened 3 years ago by zhaobm
  2

• ExtractorHTML matches srcset attribute case-sensitively

  #477 opened 3 years ago by ato
  0

• Heritrix not ignoring robots.txt

  #479 opened 3 years ago by Elletra
  2

• JDK18: ExtractorMultipleRegexTest fails due to Groovy asm incompatiblity

  #473 opened 3 years ago by ato
  0

• HTTP/2 protocol

  #472 opened 3 years ago by kauka-1
  1

• Overcrawling due to sitemap links acting like transclusions

  #469 opened 3 years ago by ato
  0

• "java.lang.NoClassDefFoundError: Could not initialize class org.archive.util.CLibrary" on Apple Silicon

  #467 opened 3 years ago by ziodave
  1

• Setting of maxLogFileSize in the BDBModule is ineffective

  #464 opened 3 years ago by ClemensRobbenhaar
  0

• Heritrix crasching on malformed Content-Length header

  #449 opened 3 years ago by krakan
  0

• Commas in srcset-URLs are not handled correctly

  #458 opened 3 years ago by grob
  1

• Crawl job stats and reports misleading when excluding PDF-Files (follow up to issue #453)

  #455 opened 3 years ago by oschihin
  3

• Build failing via maven-assembly-plugin: group id is too big

  #447 opened 3 years ago by ldko
  1

• Allow plain HTTP console access (as a non-default option)

  #440 opened 3 years ago by anjackson
  1

• Java version check throws StringIndexOutOfBoundsException on exact major versions

  #439 opened 3 years ago by ato
  0

• [Question] SEVERE Configuration problem: Unable to locate Spring NamespaceHandler for XML schema namespace

  #437 opened 3 years ago by naveen17797
  4

• force HTTP11 true - breaking warc records

  #432 opened 3 years ago by Feribv
  2