Gerapy/Gerapy

Gerapy任务管理选择多台主机,调度2台,剩下2台未调度

Qingenmm opened this issue · 0 comments

问题描述
任务管理中配置4台主机,gerapy调度时有输出客户端的调度日志,但scrapyd的web页面有两台未启动,gerapy元数据表(django_apscheduler_djangojobexecution)的状态是两条数据为Executed,两条数据为Started execution。【重启gerapy后可正常调度】

日志
INFO - 2022-12-06 10:23:00,022 - process: 26463 - scheduler.py - gerapy.server.core.scheduler - 34 - scheduler - execute job of client crawler02_6805, project project_name, spider spider_name
INFO - 2022-12-06 10:23:00,055 - process: 26463 - scheduler.py - gerapy.server.core.scheduler - 34 - scheduler - execute job of client crawler03_6806, project project_name, spider spider_name
INFO - 2022-12-06 10:23:00,067 - process: 26463 - scheduler.py - gerapy.server.core.scheduler - 34 - scheduler - execute job of client crawler03_6807, project project_name, spider spider_name
INFO - 2022-12-06 10:23:00,088 - process: 26463 - scheduler.py - gerapy.server.core.scheduler - 34 - scheduler - execute job of client crawler03_6808, project project_name, spider spider_name

django_apscheduler_djangojobexecution表数据
16 Started execution 2022-12-06 02:23:00.000000 crawler02_6805-project_name-spider_name
17 Started execution 2022-12-06 02:23:00.000000 crawler03_6806-project_name-spider_name
18 Executed 2022-12-06 02:23:00.000000 2.00 1670293382.00 crawler03_6807-project_name-spider_name
19 Executed 2022-12-06 02:23:00.000000 1.98 1670293381.98 crawler03_6808-project_name-spider_name

环境
OS: ubuntu 20.04
Browser: Chrome 104(64位)
Python: 3.9.15
Gerapy: 0.9.11
Scrapyd: 1.3.0