actiontech/dtle-docs-cn

Unable to get incremental data

Closed this issue · 1 comments

pyb0815 commented

dtle is run by the latest docker
source is rds 8.0
des is rds 5.7
can get the full data,but can't get the incremential data

Here is the job_stage info
curl -XGET "127.0.0.1:4646/v1/job/dtle-sync-test-hq-quote-bz/allocations" | jq '.' | grep job_stage
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 6154 0 6154 0 0 5745k 0 --:--:-- --:--:-- --:--:-- 6009k
"DisplayMessage": "job_stage_full",
"DriverMessage": "job_stage_full",
"DisplayMessage": "job_stage_incr",
"DriverMessage": "job_stage_incr",

the dtle docker log
2021-12-09T03:35:39.301Z [INFO] client.gc: garbage collecting allocation: alloc_id=a13a55c8-0995-5ec8-9de2-02a3c000a635 reason="forced collection"
2021-12-09T03:35:39.301Z [INFO] client.gc: garbage collecting allocation: alloc_id=968b1f0b-b4a7-49de-c05c-09d3d6914e80 reason="forced collection"
2021-12-09T03:35:39.301Z [INFO] client.gc: garbage collecting allocation: alloc_id=aa7ddcd8-4b13-2e8b-54bb-284f6033ea82 reason="forced collection"
2021-12-09T03:35:39.301Z [INFO] client.gc: garbage collecting allocation: alloc_id=4a424ffa-2cf7-fb8b-949e-21abf1557c75 reason="forced collection"
2021-12-10T03:04:54.090Z [ERROR] client.driver_mgr.dtle: unexpected error on publish: driver=dtle @module=dtle.extractor err="nats: timeout" job=dtle-sync-test-hq-quote-bz timestamp=2021-12-10T03:04:54.089Z
2021-12-10T03:04:54.090Z [ERROR] client.driver_mgr.dtle: onError: driver=dtle @module=dtle.extractor err="nats: timeout" job=dtle-sync-test-hq-quote-bz timestamp=2021-12-10T03:04:54.090Z
2021-12-10T03:04:54.090Z [INFO] client.driver_mgr.dtle: extractor shutdown: driver=dtle @module=dtle.extractor job=dtle-sync-test-hq-quote-bz timestamp=2021-12-10T03:04:54.090Z
2021-12-10T03:04:54.092Z [INFO] client.driver_mgr.dtle: DestroyTask: driver=dtle @module=dtle id=954956ca-b823-a73f-df78-4c160b4ed0e4/src/13fc2e71 timestamp=2021-12-10T03:04:54.092Z