tijme/not-your-average-web-crawler

Issues

• requirements.txt has some problems

  #8 opened 6 years ago by Bosco-Lam
  3

• Error message with a job finished

  #7 opened 6 years ago by Hax0rG1rl
  3

• How can I blacklist or whitelist certain URL extensions?

  #2 opened 7 years ago by CaiJiJi
  5

• CrawlerActions.DO_SKIP_TO_NEXT not working

  #4 opened 7 years ago by mutepigz
  2

• KeyError in Queue.py when crawling unicode URLs

  #5 opened 7 years ago by mutepigz
  2

• Where is the data dumped?

  #3 opened 7 years ago by ceased-ebc
  4