ArchiveTeam/wpull

Issues

• Corrupted gzipped sitemap causes OSError crash

  #484 opened 3 months ago by JustAnotherArchivist
  0

• Stop adding `data:` and `mailto:` URIs to the database

  #483 opened 4 months ago by JustAnotherArchivist
  0

• Abandoned?

  #482 opened 5 months ago by Alseenrodelap
  1

• Error in python 3.9

  #481 opened 6 months ago by Dazmed707
  1

• "Repeat redirects" (307 or 308) to a different host lead to an incorrect Host header

  #425 opened 5 years ago by JustAnotherArchivist
  2

• IDNA crashes due to uncaught UnicodeErrors

  #435 opened 5 years ago by JustAnotherArchivist
  2

• Remove Tornado dependency

  #479 opened 9 months ago by JustAnotherArchivist
  1

• url containing & character getting split

  #478 opened 9 months ago by kashortiexda
  3

• AttributeError: module 'collections' has no attribute 'Mapping'

  #475 opened a year ago by allanlaal
  6

• ValueError: IPv6 addresses are 16 bytes long

  #477 opened a year ago by Sanqui
  6

• Migrate test suite to Drone

  #467 opened a year ago by JustAnotherArchivist
  1

• FTP processor may start retrieval before logging the `Fetching` message

  #473 opened 2 years ago by JustAnotherArchivist
  0

• 'ValueError: write to closed file' when using --output-document with redirects

  #453 opened 4 years ago by JustAnotherArchivist
  1

• Always send the `Host` header first

  #468 opened 3 years ago by JustAnotherArchivist
  1

• Equivalent but differently encoded URLs break no-parent recursion

  #469 opened 2 years ago by JustAnotherArchivist
  0

• Support for server-side image maps

  #466 opened 3 years ago by JustAnotherArchivist
  0

• Handle `Refresh` header as a redirect

  #465 opened 3 years ago by JustAnotherArchivist
  0

• FTP login information in URLs is lost

  #464 opened 3 years ago by JustAnotherArchivist
  0

• SQLAlchemy 1.4 incompatibility: `sqlalchemy.orm.evaluator.UnevaluatableError: Cannot evaluate Select`

  #463 opened 3 years ago by JustAnotherArchivist
  0

• OSError when the cookie jar gets cleared

  #462 opened 3 years ago by JustAnotherArchivist
  0

• resolve_dns hook lacks information on IPv4/IPv6 preference and can't return more than one result

  #461 opened 3 years ago by JustAnotherArchivist
  0

• HTML in JavaScript leads to undecoded character references in URLs

  #460 opened 3 years ago by JustAnotherArchivist
  0

• NUL byte in <link> href confuses libxml2-lxml parser

  #459 opened 3 years ago by JustAnotherArchivist
  0

• LinkInfo/LinkContext's linked and inline fields for HTML-extracted URLs are not always bools

  #458 opened 3 years ago by JustAnotherArchivist
  0

• Writing output to stdout (--output-document -) crashes with a TypeError

  #457 opened 3 years ago by JustAnotherArchivist
  0

• Should wpull deduplicate redirect targets?

  #431 opened 5 years ago by JustAnotherArchivist
  2

• Abort downloads when reaching the --monitor-disk limit

  #456 opened 4 years ago by JustAnotherArchivist
  0

• ValueError: Field missing colon.

  #455 opened 4 years ago by JustAnotherArchivist
  0

• Providing an empty string to `--post-data` makes wpull send GET instead of POST requests

  #454 opened 4 years ago by jodizzle
  0

• Website directory as folder with index.html file within

  #452 opened 4 years ago by jaredxx1
  1

• Dependency namedlist incompatible with Python 3.8

  #451 opened 4 years ago by jayvdb
  1

• Multipart response whose connection gets killed is still written to WARC

  #450 opened 4 years ago by JustAnotherArchivist
  0

• [Errno 1] Operation not permitted

  #449 opened 4 years ago by makew0rld
  1

• Store cookies in database instead of in memory

  #448 opened 4 years ago by JustAnotherArchivist
  0

• Unexpected recursion due to parsing HTML on an expected script

  #447 opened 4 years ago by JustAnotherArchivist
  0

• Spaces in URL parameters get encoded as + instead of %20

  #445 opened 4 years ago by JustAnotherArchivist
  1

• Fails to recurse on some sites when the homepage is a 404

  #444 opened 4 years ago by JustAnotherArchivist
  0

• Unable to resolve onion hostnames when using http proxy

  #443 opened 5 years ago by codsane
  3

• Handle URL parsing errors

  #442 opened 5 years ago by JustAnotherArchivist
  0

• Replace buggy urllib.parse

  #441 opened 5 years ago by JustAnotherArchivist
  0

• Remove PhantomJS support

  #432 opened 5 years ago by JustAnotherArchivist
  2

• Tildes in links in Shift-JIS pages are interpreted as %E2%80%BE when html-parser is set to libxml2-lxml

  #440 opened 5 years ago by DoomTay
  0

• Travis-CI badge in README is for a different repository

  #438 opened 5 years ago by machawk1
  1

• Invalid Syntax Error when doing anything

  #436 opened 5 years ago by Czechball
  1

• pip installs wrong version of tornado and html5lib

  #434 opened 5 years ago by kelson42
  4

• The DNS operation timed out

  #433 opened 5 years ago by nihelmasell
  2

• Incorrect recursion after domain-changing redirects

  #430 opened 5 years ago by JustAnotherArchivist
  0

• wpull seems to ignore the <base> tag for images

  #429 opened 5 years ago by JustAnotherArchivist
  0

• URL table performance woes

  #427 opened 5 years ago by JustAnotherArchivist
  1

• Plugin deactivate method not called

  #428 opened 5 years ago by JustAnotherArchivist
  0