adbar/courlan

Issues

• Define `__all__` in `__init__.py`

  #110 opened 6 months ago by adbar
  0

• UrlStore: add blocking convenience function around get_download_urls()

  #109 opened 6 months ago by adbar
  0

• Bug: clean_url fails on apostrophe in urls

  #106 opened 7 months ago by mikewolfd
  1

• Deprecate Python 3.6 & 3.7

  #73 opened 8 months ago by adbar
  0

• Convert Readme file to markdown format

  #98 opened 10 months ago by adbar
  0

• Replace language and country codes in `langinfo.py` by `pycountry`

  #74 opened 10 months ago by adbar
  1

• Check if `langcodes` can be replaced by `babel`

  #70 opened 10 months ago by adbar
  0

• UrlStore: keep track of last response code and adjust backoff strategy

  #85 opened a year ago by adbar
  0

• Change license to Apache 2.0

  #80 opened a year ago by adbar
  1

• Persistance for `UrlStore` (file I/O)

  #71 opened a year ago by adbar
  0

• Add functioning courlan image or link to Pypi readme file

  #68 opened a year ago by adbar
  0

• Add support for username in netloc?

  #76 opened a year ago by adbar
  1

• Add `is_homepage()` heuristic

  #75 opened a year ago by adbar
  0

• Navigation: add heuristic based on site depth

  #72 opened a year ago by adbar
  0

• Add a function to check robots.txt rules and page type

  #69 opened a year ago by adbar
  0

• Provide function `is_valid_url()`

  #62 opened a year ago by adbar
  0

• Define option to focus on given extension types

  #61 opened a year ago by adbar
  0

• Offer IRI to URI conversion

  #57 opened a year ago by adbar
  0

• process_response does not properly resolve urls

  #45 opened 2 years ago by Ristellise
  13

• Make use of signal optional

  #17 opened 2 years ago by adbar
  0

• Courlan does not load `/page/` links

  #16 opened 2 years ago by sbusso
  3

• Domain/subdomain confusion in link extraction

  #14 opened 2 years ago by adbar
  0

• Investigate sampling issue

  #7 opened 3 years ago by adbar
  0

• Test and fix URL sampling to support Python 3.11

  #6 opened 3 years ago by adbar
  0

• Remove tox test settings

  #5 opened 3 years ago by adbar
  0

• Drop support for Python 3.5

  #4 opened 3 years ago by adbar
  0

• Replace tldextract with tld?

  #1 opened 4 years ago by adbar
  1

• Send head request with urllib3

  #2 opened 4 years ago by adbar
  1