pythonhacker/harvestman-crawler

Issues

• import errors for module hashlib

  #33 opened 10 years ago by GoogleCodeExporter
  3

• Depth of any url

  #34 opened 10 years ago by GoogleCodeExporter
  0

• Running configuration sample results in Exception

  #35 opened 10 years ago by GoogleCodeExporter
  1

• Deprecation Warnings on Ubuntu 10.10, python 2.6.6

  #36 opened 10 years ago by GoogleCodeExporter
  0

• Patch for /trunk/HarvestMan-lite/harvestman/apps/samples/blogger.py

  #37 opened 10 years ago by GoogleCodeExporter
  0

• No _logger attribute

  #31 opened 10 years ago by GoogleCodeExporter
  0

• Implement -nd option of wget

  #32 opened 10 years ago by GoogleCodeExporter
  0

• Docs: How to increase limit of connections to single server.

  #29 opened 10 years ago by GoogleCodeExporter
  1

• ImportError: No module named _bsddb

  #30 opened 10 years ago by GoogleCodeExporter
  0

• Am getting errors after fresh install with default config file

  #28 opened 10 years ago by GoogleCodeExporter
  2

• harvestman --genconfig fails to work with web.py-0.31

  #27 opened 10 years ago by GoogleCodeExporter
  3

• Permaloop?

  #25 opened 10 years ago by GoogleCodeExporter
  10

• Use all functionality of setup.py

  #26 opened 10 years ago by GoogleCodeExporter
  0

• Adding Flash-related file extension support

  #23 opened 10 years ago by GoogleCodeExporter
  8

• URL construction error for base URLs containing ? in path

  #24 opened 10 years ago by GoogleCodeExporter
  1

• Install error in x86_64

  #22 opened 10 years ago by GoogleCodeExporter
  4

• Error crawling url's containing non latin-1 characters: reported containing fatal errors

  #21 opened 10 years ago by GoogleCodeExporter
  4

• Error crawling sites containing characters with encoding standards different than Latin-1

  #20 opened 10 years ago by GoogleCodeExporter
  19

• Scale crawler to a client/server design aiming for full distributed system support

  #18 opened 10 years ago by GoogleCodeExporter
  7

• Error: "I/O operation on closed file" when running the crawler on the same site twice.

  #19 opened 10 years ago by GoogleCodeExporter
  1

• Design the crawler to run non-stop

  #16 opened 10 years ago by GoogleCodeExporter
  1

• Design the crawler to run non-stop

  #17 opened 10 years ago by GoogleCodeExporter
  2

• HTML code reconstruction library to be added optionally - beautifullsoup for example

  #15 opened 10 years ago by GoogleCodeExporter
  5

• Memory consumption optimization

  #13 opened 10 years ago by GoogleCodeExporter
  12

• Parallel crawl of projects

  #14 opened 10 years ago by GoogleCodeExporter
  1

• Modify logging to confirm to standards

  #12 opened 10 years ago by GoogleCodeExporter
  4

• RSS Integration

  #10 opened 10 years ago by GoogleCodeExporter
  4

• Killing harvestman with "ctrl+C"

  #11 opened 10 years ago by GoogleCodeExporter
  2

• Scheduling options in command-line

  #9 opened 10 years ago by GoogleCodeExporter
  5

• Combine filters and enhance filter implementation

  #7 opened 10 years ago by GoogleCodeExporter
  11

• Implement a basic but comprehensive GUI

  #8 opened 10 years ago by GoogleCodeExporter
  3

• Data flushing for connector file objects

  #6 opened 10 years ago by GoogleCodeExporter
  2

• Add a "maxbyte" param as a control variable

  #5 opened 10 years ago by GoogleCodeExporter
  5

• Crawler strategy classes

  #4 opened 10 years ago by GoogleCodeExporter
  3

• URLs file not saved in project folder

  #3 opened 10 years ago by GoogleCodeExporter
  1

• virtualenv setup error

  #2 opened 10 years ago by GoogleCodeExporter
  13

• Implement download throttling to constraint download speeds

  #1 opened 10 years ago by GoogleCodeExporter
  5