scrapy/scrapyd

Issues

• Announcement: Scrapyd 1.5.0b1 prerelease

  #531 opened a month ago by jpmckinney
  0

• chinese log encoding is error

  #532 opened 3 months ago by mouday
  3

• Linux service documentation

  #530 opened 4 months ago by jpmckinney
  0

• pkg_resources migration

  #528 opened 4 months ago by jpmckinney
  0

• Allow launcher to tracker processes across restarts

  #521 opened 4 months ago by jpmckinney
  2

• listjobs.json: `args` in running jobs and finished jobs

  #529 opened 4 months ago by jpmckinney
  0

• SQLite queue is using all CPU on high frequency poller (<1s)

  #475 opened 6 months ago by pspsdev
  13

• Reload configuration file without restart (i.e. via SIGHUP)

  #519 opened 4 months ago by jpmckinney
  1

• Test improvements

  #527 opened 4 months ago by jpmckinney
  0

• Webservice test improvements

  #524 opened 4 months ago by jpmckinney
  0

• [settings] support

  #525 opened 4 months ago by jpmckinney
  0

• Make the config a component of the app

  #526 opened 4 months ago by jpmckinney
  1

• Check valid and existing versions in webservices

  #517 opened 4 months ago by jpmckinney
  3

• Check project names in egg storage

  #516 opened 4 months ago by jpmckinney
  1

• Review old security audit

  #518 opened 4 months ago by jpmckinney
  0

• Is there a way to limit of how many spiders of a certain project would run on Scrapyd?

  #505 opened 5 months ago by aaronm137
  2

• Consider deprecated versions of Python3

  #508 opened 4 months ago by vorenhoutgithub
  2

• Add `--bind-address` and `--http-port` options (instead of configuration file)

  #487 opened 4 months ago by fuqiang-code
  2

• Show timestamp for log files

  #509 opened 4 months ago by vorenhoutgithub
  0

• Adjust doc: add way to listen on IPv6 addresses

  #507 opened 4 months ago by vorenhoutgithub
  0

• Specify settings for spider that share root directories between projects

  #506 opened 5 months ago by Aaron2516
  1

• How to specify the naming convention of log files?

  #504 opened 5 months ago by aaronm137
  1

• Are Scrapyd log files created with delays?

  #503 opened 5 months ago by aaronm137
  1

• Adding custom endpoints

  #484 opened 6 months ago by vazkir
  4

• The work of scrapyd with the virtual environments of projects

  #492 opened 6 months ago by WhatIsLowe
  1

• Enable configuration of bind_address, http_port, username and password via env vars

  #498 opened 6 months ago by fkromer
  1

• When I am in Scrapyd deploy，always report an error

  #501 opened 10 months ago by joykerl
  1

• Transparent list of projects

  #493 opened a year ago by bsekiewicz
  7

• Azure Feed exporter not working

  #497 opened a year ago by MathiasIconB
  2

• Bad installation steps for "python setup.py install"

  #496 opened a year ago by HyperUpscale
  2

• Add support for environment variables

  #478 opened a year ago by Shleif91
  7

• Error on windows when trying to deploy - [WinError 32]

  #494 opened a year ago by amartins2imp
  17

• May I ask is there any way use scrpyd to run python script with CrawlerProcess

  #489 opened a year ago by xinatcg
  2

• Cannot access environment variables in the spider running under ScrapyD

  #490 opened a year ago by iamumairayub
  2

• How to pause and resume crawling with scrapyd?

  #483 opened 2 years ago by Akise
  3

• Use wheel files for deployment

  #488 opened a year ago by majid-vaghari
  1

• xxx.log can't be found

  #479 opened 2 years ago by hyliush
  3

• Add reverse proxy support for web interface

  #480 opened 2 years ago by TecIntelli
  1

• [Feature Request] S3 Storage

  #477 opened 2 years ago by mgrist
  3

• ReadTheDocs build

  #472 opened 2 years ago by jpmckinney
  2

• crawl: error: Invalid -s value, use -s NAME=VALUE

  #473 opened 2 years ago by saavedra29
  9

• scrapyd writing logs to console instead of log files in docker container

  #470 opened 2 years ago by blacksteel1288
  9

• encoding errors when running a spider via scrapyd

  #462 opened 2 years ago by dedepene
  2

• API - add items and logs url to listjobs.json

  #464 opened 2 years ago by mxdev88
  3

• High frequency scheduling

  #466 opened 2 years ago by pspsdev
  1

• facing unexpected builtins.TypeError error when running >Scrapyd command .

  #456 opened 2 years ago by usmanabbasi360
  6

• How to correctly configure CONCURRENT_REQUESTS in a project with multiple spiders

  #463 opened 2 years ago by jxlil
  1

• add FEEDS support like "curl http://localhost:6800/schedule.json ... -d setting=FEEDS=output.csv"

  #465 opened 2 years ago by armonbc
  0

• Why not use __main__?

  #454 opened 2 years ago by dhvcc
  3

• Persistent scheduling based on CRON

  #453 opened 2 years ago by kanchansapkota27
  4