ArchiveTeam/tumblr-grab

Issues

• vtt.tumblr.com is not specific

  #94 opened 6 years ago
  0

• Dead S3 links can pause really ancient blogs

  #93 opened 6 years ago
  0

• amp URLs still grabbed

  #78 opened 6 years ago
  2

• /audio_player_iframe/ URLs

  #72 opened 6 years ago
  2

• (not tumblr) website problem

  #63 opened 6 years ago
  2

• Unable to install gnutls-dev

  #62 opened 6 years ago
  2

• lua.h is in /usr/include/lua5.1 on Debian 9, not /usr/include/lua-5.1

  #48 opened 6 years ago
  3

• "Project code is out of date"

  #47 opened 6 years ago
  3

• Game over - IP ban error 403 message

  #46 opened 6 years ago
  1

• A lot of urls resulting in 404

  #43 opened 6 years ago
  2

• Googlebot UA makes our requests low-priority

  #42 opened 6 years ago
  4

• Splitting up jobs

  #39 opened 6 years ago
  2

• missing photoset_iframe

  #38 opened 6 years ago
  1

• templated URL's are in crawl :id :year :month :page

  #37 opened 6 years ago
  1

• Support download of videos

  #36 opened 6 years ago
  0

• Improve deduplication

  #35 opened 6 years ago
  1

• Erroneous URI's in output

  #22 opened 6 years ago
  5

• log files are flushed on restart

  #20 opened 6 years ago
  0

• Repeat crawl of same link

  #19 opened 6 years ago
  3

• Infinite URL crawl loop from 404

  #16 opened 6 years ago
  2

• PR/Patches have no support for test environment

  #15 opened 6 years ago
  4

• Custom domains

  #13 opened 6 years ago
  0

• crawls can fill up drive and then be abandoned

  #12 opened 6 years ago
  3

• % and tags (problem regarding detection occurences of /)

  #11 opened 6 years ago
  5

• /notes can dominate crawl

  #10 opened 6 years ago
  8

• Extraneous Reblog links

  #9 opened 6 years ago
  4

• Avatars 16px still in crawl

  #8 opened 6 years ago
  0

• get-wget-lua should bail out earlier if dependencies aren't available

  #4 opened 6 years ago
  5

• URLs for embed currently in crawl

  #3 opened 6 years ago
  7

• Login-required blogs

  #2 opened 6 years ago
  6