redis/riot

Redis failed to synchronize data

Opened this issue · 1 comments

huangyukang-L commented

The following is an error message in debug mode for executing synchronization：/services/riot-3.1.5/bin/riot -d -n 8 -h xxxx -p 6379 replicate -h xxxx -p 6379 -a xxxx --threads 2 -n 8 --type=ds
09:11:13.555 FINE org.springframework.batch.core.step.tasklet.TaskletStep : Applying contribution: [StepContribution: read=50, written=0, filtered=0, readSkips=0, writeSkips=0, processSkips=0, exitStatus=EXECUTING]
09:11:13.556 FINE org.springframework.batch.core.step.tasklet.TaskletStep : Rollback for RuntimeException: java.lang.NumberFormatException: For input string: "inf"
09:11:13.556 FINE org.springframework.transaction.support.TransactionTemplate : Initiating transaction rollback on application exception
java.lang.NumberFormatException: For input string: "inf"
at java.base/jdk.internal.math.FloatingDecimal.readJavaFormatString(FloatingDecimal.java:2054)
at java.base/jdk.internal.math.FloatingDecimal.parseDouble(FloatingDecimal.java:110)
at java.base/java.lang.Double.parseDouble(Double.java:543)
at com.redis.spring.batch.reader.StructProcessor.toDouble(StructProcessor.java:68)
at com.redis.spring.batch.reader.StructProcessor.zset(StructProcessor.java:86)
at com.redis.spring.batch.reader.StructProcessor.process(StructProcessor.java:40)
at com.redis.spring.batch.reader.StructProcessor.process(StructProcessor.java:21)
at com.redis.spring.batch.common.ListItemProcessor.process(ListItemProcessor.java:20)
at com.redis.spring.batch.common.ListItemProcessor.process(ListItemProcessor.java:8)
at com.redis.spring.batch.common.CompositeItemStreamProcessor.process(CompositeItemStreamProcessor.java:58)
at com.redis.spring.batch.common.CompositeItemStreamProcessor.process(CompositeItemStreamProcessor.java:58)
at com.redis.spring.batch.common.ProcessingItemWriter.write(ProcessingItemWriter.java:56)
at org.springframework.batch.core.step.item.SimpleChunkProcessor.writeItems(SimpleChunkProcessor.java:193)
at org.springframework.batch.core.step.item.SimpleChunkProcessor.doWrite(SimpleChunkProcessor.java:159)
at org.springframework.batch.core.step.item.SimpleChunkProcessor.write(SimpleChunkProcessor.java:294)
at org.springframework.batch.core.step.item.SimpleChunkProcessor.process(SimpleChunkProcessor.java:217)
at org.springframework.batch.core.step.item.ChunkOrientedTasklet.execute(ChunkOrientedTasklet.java:77)
at org.springframework.batch.core.step.tasklet.TaskletStep$ChunkTransactionCallback.doInTransaction(TaskletStep.java:407)
at org.springframework.batch.core.step.tasklet.TaskletStep$ChunkTransactionCallback.doInTransaction(TaskletStep.java:331)
at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:140)
at org.springframework.batch.core.step.tasklet.TaskletStep$2.doInChunkContext(TaskletStep.java:273)
at org.springframework.batch.core.scope.context.StepContextRepeatCallback.doInIteration(StepContextRepeatCallback.java:82)
at org.springframework.batch.repeat.support.RepeatTemplate.getNextResult(RepeatTemplate.java:375)
at org.springframework.batch.repeat.support.RepeatTemplate.executeInternal(RepeatTemplate.java:215)
at org.springframework.batch.repeat.support.RepeatTemplate.iterate(RepeatTemplate.java:145)
at org.springframework.batch.core.step.tasklet.TaskletStep.doExecute(TaskletStep.java:258)
at org.springframework.batch.core.step.AbstractStep.execute(AbstractStep.java:208)
at org.springframework.batch.core.job.SimpleStepHandler.handleStep(SimpleStepHandler.java:152)
at org.springframework.batch.core.job.AbstractJob.handleStep(AbstractJob.java:413)
at org.springframework.batch.core.job.SimpleJob.doExecute(SimpleJob.java:136)
at org.springframework.batch.core.job.AbstractJob.execute(AbstractJob.java:320)
at org.springframework.batch.core.launch.support.SimpleJobLauncher$1.run(SimpleJobLauncher.java:149)
at java.base/java.lang.Thread.run(Thread.java:829)

09:11:13.556 FINE org.springframework.batch.support.transaction.ResourcelessTransactionManager : Initiating transaction rollback
09:11:13.556 FINE org.springframework.batch.support.transaction.ResourcelessTransactionManager : Rolling back resourceless transaction on [org.springframework.batch.support.transaction.ResourcelessTransactionManager$ResourcelessTransaction@3ba541d2]
09:11:13.556 FINE org.springframework.batch.repeat.support.RepeatTemplate : Handling exception: java.lang.NumberFormatException, caused by: java.lang.NumberFormatException: For input string: "inf"
09:11:13.556 FINE org.springframework.batch.repeat.support.RepeatTemplate : Handling fatal exception explicitly (rethrowing first of 1): java.lang.NumberFormatException: For input string: "inf"
09:11:13.556 SEVERE org.springframework.batch.core.step.AbstractStep : Encountered an error executing step scan-reader in job scan-reader
java.lang.NumberFormatException: For input string: "inf"
at java.base/jdk.internal.math.FloatingDecimal.readJavaFormatString(FloatingDecimal.java:2054)
at java.base/jdk.internal.math.FloatingDecimal.parseDouble(FloatingDecimal.java:110)
at java.base/java.lang.Double.parseDouble(Double.java:543)
at com.redis.spring.batch.reader.StructProcessor.toDouble(StructProcessor.java:68)
at com.redis.spring.batch.reader.StructProcessor.zset(StructProcessor.java:86)
at com.redis.spring.batch.reader.StructProcessor.process(StructProcessor.java:40)
at com.redis.spring.batch.reader.StructProcessor.process(StructProcessor.java:21)
at com.redis.spring.batch.common.ListItemProcessor.process(ListItemProcessor.java:20)
at com.redis.spring.batch.common.ListItemProcessor.process(ListItemProcessor.java:8)
at com.redis.spring.batch.common.CompositeItemStreamProcessor.process(CompositeItemStreamProcessor.java:58)
at com.redis.spring.batch.common.CompositeItemStreamProcessor.process(CompositeItemStreamProcessor.java:58)
at com.redis.spring.batch.common.ProcessingItemWriter.write(ProcessingItemWriter.java:56)
at org.springframework.batch.core.step.item.SimpleChunkProcessor.writeItems(SimpleChunkProcessor.java:193)
at org.springframework.batch.core.step.item.SimpleChunkProcessor.doWrite(SimpleChunkProcessor.java:159)
at org.springframework.batch.core.step.item.SimpleChunkProcessor.write(SimpleChunkProcessor.java:294)
at org.springframework.batch.core.step.item.SimpleChunkProcessor.process(SimpleChunkProcessor.java:217)
at org.springframework.batch.core.step.item.ChunkOrientedTasklet.execute(ChunkOrientedTasklet.java:77)
at org.springframework.batch.core.step.tasklet.TaskletStep$ChunkTransactionCallback.doInTransaction(TaskletStep.java:407)
at org.springframework.batch.core.step.tasklet.TaskletStep$ChunkTransactionCallback.doInTransaction(TaskletStep.java:331)
at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:140)
at org.springframework.batch.core.step.tasklet.TaskletStep$2.doInChunkContext(TaskletStep.java:273)
at org.springframework.batch.core.scope.context.StepContextRepeatCallback.doInIteration(StepContextRepeatCallback.java:82)
at org.springframework.batch.repeat.support.RepeatTemplate.getNextResult(RepeatTemplate.java:375)
at org.springframework.batch.repeat.support.RepeatTemplate.executeInternal(RepeatTemplate.java:215)
at org.springframework.batch.repeat.support.RepeatTemplate.iterate(RepeatTemplate.java:145)
at org.springframework.batch.core.step.tasklet.TaskletStep.doExecute(TaskletStep.java:258)
at org.springframework.batch.core.step.AbstractStep.execute(AbstractStep.java:208)
at org.springframework.batch.core.job.SimpleStepHandler.handleStep(SimpleStepHandler.java:152)
at org.springframework.batch.core.job.AbstractJob.handleStep(AbstractJob.java:413)
at org.springframework.batch.core.job.SimpleJob.doExecute(SimpleJob.java:136)
at org.springframework.batch.core.job.AbstractJob.execute(AbstractJob.java:320)
at org.springframework.batch.core.launch.support.SimpleJobLauncher$1.run(SimpleJobLauncher.java:149)
at java.base/java.lang.Thread.run(Thread.java:829)

09:11:13.558 FINE org.springframework.batch.support.transaction.ResourcelessTransactionManager : Creating new transaction with name [org.springframework.batch.core.repository.support.SimpleJobRepository.updateExecutionContext]: PROPAGATION_REQUIRED,ISOLATION_DEFAULT
09:11:13.558 FINE org.springframework.batch.support.transaction.ResourcelessTransactionManager : Initiating transaction commit
09:11:13.558 FINE org.springframework.batch.support.transaction.ResourcelessTransactionManager : Committing resourceless transaction on [org.springframework.batch.support.transaction.ResourcelessTransactionManager$ResourcelessTransaction@ec0094]
09:11:13.558 INFO org.springframework.batch.core.step.AbstractStep : Step: [scan-reader] executed in 8s128ms
09:11:13.558 FINE org.springframework.batch.support.transaction.ResourcelessTransactionManager : Creating new transaction with name [org.springframework.batch.core.repository.support.SimpleJobRepository.update]: PROPAGATION_REQUIRED,ISOLATION_DEFAULT
09:11:13.559 FINE org.springframework.batch.support.transaction.ResourcelessTransactionManager : Initiating transaction commit
09:11:13.559 FINE org.springframework.batch.support.transaction.ResourcelessTransactionManager : Committing resourceless transaction on [org.springframework.batch.support.transaction.ResourcelessTransactionManager$ResourcelessTransaction@24c38393]
09:11:13.561 FINE org.springframework.batch.core.step.AbstractStep : Step execution complete: StepExecution: id=2, version=201, name=scan-reader, status=FAILED, exitStatus=FAILED, readCount=10000, filterCount=0, writeCount=9950 readSkipCount=0, writeSkipCount=0, processSkipCount=0, commitCount=199, rollbackCount=1
09:11:13.561 FINE org.springframework.batch.support.transaction.ResourcelessTransactionManager : Creating new transaction with name [org.springframework.batch.core.repository.support.SimpleJobRepository.updateExecutionContext]: PROPAGATION_REQUIRED,ISOLATION_DEFAULT
09:11:13.562 FINE org.springframework.batch.support.transaction.ResourcelessTransactionManager : Initiating transaction commit
09:11:13.562 FINE org.springframework.batch.support.transaction.ResourcelessTransactionManager : Committing resourceless transaction on [org.springframework.batch.support.transaction.ResourcelessTransactionManager$ResourcelessTransaction@537c9c8]
09:11:13.562 FINE org.springframework.batch.core.job.AbstractJob : Upgrading JobExecution status: StepExecution: id=2, version=201, name=scan-reader, status=FAILED, exitStatus=FAILED, readCount=10000, filterCount=0, writeCount=9950 readSkipCount=0, writeSkipCount=0, processSkipCount=0, commitCount=199, rollbackCount=1, exitDescription=java.lang.NumberFormatException: For input string: "inf"
at java.base/jdk.internal.math.FloatingDecimal.readJavaFormatString(FloatingDecimal.java:2054)
at java.base/jdk.internal.math.FloatingDecimal.parseDouble(FloatingDecimal.java:110)
at java.base/java.lang.Double.parseDouble(Double.java:543)
at com.redis.spring.batch.reader.StructProcessor.toDouble(StructProcessor.java:68)
at com.redis.spring.batch.reader.StructProcessor.zset(StructProcessor.java:86)
at com.redis.spring.batch.reader.StructProcessor.process(StructProcessor.java:40)
at com.redis.spring.batch.reader.StructProcessor.process(StructProcessor.java:21)
at com.redis.spring.batch.common.ListItemProcessor.process(ListItemProcessor.java:20)
at com.redis.spring.batch.common.ListItemProcessor.process(ListItemProcessor.java:8)
at com.redis.spring.batch.common.CompositeItemStreamProcessor.process(CompositeItemStreamProcessor.java:58)
at com.redis.spring.batch.common.CompositeItemStreamProcessor.process(CompositeItemStreamProcessor.java:58)
at com.redis.spring.batch.common.ProcessingItemWriter.write(ProcessingItemWriter.java:56)
at org.springframework.batch.core.step.item.SimpleChunkProcessor.writeItems(SimpleChunkProcessor.java:193)
at org.springframework.batch.core.step.item.SimpleChunkProcessor.doWrite(SimpleChunkProcessor.java:159)
at org.springframework.batch.core.step.item.SimpleChunkProcessor.write(SimpleChunkProcessor.java:294)
at org.springframework.batch.core.step.item.SimpleChunkProcessor.process(SimpleChunkProcessor.java:217)
at org.springframework.batch.core.step.item.ChunkOrientedTasklet.execute(ChunkOrientedTasklet.java:77)
at org.springframework.batch.core.step.tasklet.TaskletStep$ChunkTransactionCallback.doInTransaction(TaskletStep.java:407)
at org.springframework.batch.core.step.tasklet.TaskletStep$ChunkTransactionCallback.doInTransaction(TaskletStep.java:331)
at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:140)
at org.springframework.batch.core.step.tasklet.TaskletStep$2.doInChunkContext(TaskletStep.java:273)
at org.springframework.batch.core.scope.context.StepContextRepeatCallback.doInIteration(StepContextRepeatCallback.java:82)
at org.springframework.batch.repeat.support.RepeatTemplate.getNextResult(RepeatTemplate.java:375)
at org.springframework.batch.repeat.support.RepeatTemplate.executeInternal(RepeatTemplate.java:215)
at org.springframework.batch.repeat.support.RepeatTemplate.iterate(RepeatTemplate.java:145)
at org.springframework.batch.core.step.tasklet.TaskletStep.doExecute(TaskletStep.java:258)
at org.springframework.batch.core.step.AbstractStep.execute(AbstractStep.java:208)
at org.springframework.batch.core.job.SimpleStepHandler.handleStep(SimpleStepHandler.java:152)
at org.springframework.batch.core.job.AbstractJob.handleStep(AbstractJob.java:413)
at org.springframework.batch.core.job.SimpleJob.doExecute(SimpleJob.java:136)
at org.springframework.batch.core.job.AbstractJob.execute(AbstractJob.java:320)
at org.springframework.batch.core.launch.support.SimpleJobLauncher$1.run(SimpleJobLauncher.java:149)
at java.base/java.lang.Thread.run(Thread.java:829)

09:11:13.565 FINE org.springframework.batch.core.job.AbstractJob : Job execution complete: JobExecution: id=1, version=1, startTime=Fri Jul 05 09:11:05 UTC 2024, endTime=null, lastUpdated=Fri Jul 05 09:11:05 UTC 2024, status=FAILED, exitStatus=exitCode=FAILED;exitDescription=java.lang.NumberFormatException: For input string: "inf"
at java.base/jdk.internal.math.FloatingDecimal.readJavaFormatString(FloatingDecimal.java:2054)
at java.base/jdk.internal.math.FloatingDecimal.parseDouble(FloatingDecimal.java:110)
at java.base/java.lang.Double.parseDouble(Double.java:543)
at com.redis.spring.batch.reader.StructProcessor.toDouble(StructProcessor.java:68)
at com.redis.spring.batch.reader.StructProcessor.zset(StructProcessor.java:86)
at com.redis.spring.batch.reader.StructProcessor.process(StructProcessor.java:40)
at com.redis.spring.batch.reader.StructProcessor.process(StructProcessor.java:21)
at com.redis.spring.batch.common.ListItemProcessor.process(ListItemProcessor.java:20)
at com.redis.spring.batch.common.ListItemProcessor.process(ListItemProcessor.java:8)
at com.redis.spring.batch.common.CompositeItemStreamProcessor.process(CompositeItemStreamProcessor.java:58)
at com.redis.spring.batch.common.CompositeItemStreamProcessor.process(CompositeItemStreamProcessor.java:58)
at com.redis.spring.batch.common.ProcessingItemWriter.write(ProcessingItemWriter.java:56)
at org.springframework.batch.core.step.item.SimpleChunkProcessor.writeItems(SimpleChunkProcessor.java:193)
at org.springframework.batch.core.step.item.SimpleChunkProcessor.doWrite(SimpleChunkProcessor.java:159)
at org.springframework.batch.core.step.item.SimpleChunkProcessor.write(SimpleChunkProcessor.java:294)
at org.springframework.batch.core.step.item.SimpleChunkProcessor.process(SimpleChunkProcessor.java:217)
at org.springframework.batch.core.step.item.ChunkOrientedTasklet.execute(ChunkOrientedTasklet.java:77)
at org.springframework.batch.core.step.tasklet.TaskletStep$ChunkTransactionCallback.doInTransaction(TaskletStep.java:407)
at org.springframework.batch.core.step.tasklet.TaskletStep$ChunkTransactionCallback.doInTransaction(TaskletStep.java:331)
at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:140)
at org.springframework.batch.core.step.tasklet.TaskletStep$2.doInChunkContext(TaskletStep.java:273)
at org.springframework.batch.core.scope.context.StepContextRepeatCallback.doInIteration(StepContextRepeatCallback.java:82)
at org.springframework.batch.repeat.support.RepeatTemplate.getNextResult(RepeatTemplate.java:375)
at org.springframework.batch.repeat.support.RepeatTemplate.executeInternal(RepeatTemplate.java:215)
at org.springframework.batch.repeat.support.RepeatTemplate.iterate(RepeatTemplate.java:145)
at org.springframework.batch.core.step.tasklet.TaskletStep.doExecute(TaskletStep.java:258)
at org.springframework.batch.core.step.AbstractStep.execute(AbstractStep.java:208)
at org.springframework.batch.core.job.SimpleStepHandler.handleStep(SimpleStepHandler.java:152)
at org.springframework.batch.core.job.AbstractJob.handleStep(AbstractJob.java:413)
at org.springframework.batch.core.job.SimpleJob.doExecute(SimpleJob.java:136)
at org.springframework.batch.core.job.AbstractJob.execute(AbstractJob.java:320)
at org.springframework.batch.core.launch.support.SimpleJobLauncher$1.run(SimpleJobLauncher.java:149)
at java.base/java.lang.Thread.run(Thread.java:829)
, job=[JobInstance: id=1, version=0, Job=[scan-reader]], jobParameters=[{}]
09:11:13.566 FINE org.springframework.batch.support.transaction.ResourcelessTransactionManager : Creating new transaction with name [org.springframework.batch.core.repository.support.SimpleJobRepository.update]: PROPAGATION_REQUIRED,ISOLATION_DEFAULT
09:11:13.568 FINE org.springframework.batch.support.transaction.ResourcelessTransactionManager : Initiating transaction commit
09:11:13.576 FINE org.springframework.batch.support.transaction.ResourcelessTransactionManager : Committing resourceless transaction on [org.springframework.batch.support.transaction.ResourcelessTransactionManager$ResourcelessTransaction@1d7b488c]
09:11:13.577 INFO org.springframework.batch.core.launch.support.SimpleJobLauncher : Job: [SimpleJob: [name=scan-reader]] completed with the following parameters: [{}] and the following status: [FAILED] in 8s158ms
09:11:13.629 FINE org.springframework.batch.core.step.item.FaultTolerantChunkProvider : Reader job failed : org.springframework.batch.item.ItemStreamException
09:11:13.629 FINE org.springframework.batch.repeat.support.RepeatTemplate : Handling exception: org.springframework.batch.core.step.skip.NonSkippableReadException, caused by: org.springframework.batch.core.step.skip.NonSkippableReadException: Non-skippable exception during read
09:11:13.629 FINE org.springframework.batch.repeat.support.RepeatTemplate : Handling fatal exception explicitly (rethrowing first of 1): org.springframework.batch.core.step.skip.NonSkippableReadException: Non-skippable exception during read
09:11:13.630 FINE org.springframework.batch.core.step.tasklet.TaskletStep : Applying contribution: [StepContribution: read=50, written=0, filtered=0, readSkips=0, writeSkips=0, processSkips=0, exitStatus=EXECUTING]
09:11:13.630 FINE org.springframework.batch.core.step.tasklet.TaskletStep : Rollback for RuntimeException: org.springframework.batch.core.step.skip.NonSkippableReadException: Non-skippable exception during read
09:11:13.630 FINE org.springframework.transaction.support.TransactionTemplate : Initiating transaction rollback on application exception
org.springframework.batch.core.step.skip.NonSkippableReadException: Non-skippable exception during read
at org.springframework.batch.core.step.item.FaultTolerantChunkProvider.read(FaultTolerantChunkProvider.java:105)
at org.springframework.batch.core.step.item.SimpleChunkProvider$1.doInIteration(SimpleChunkProvider.java:126)
at org.springframework.batch.repeat.support.RepeatTemplate.getNextResult(RepeatTemplate.java:375)
at org.springframework.batch.repeat.support.RepeatTemplate.executeInternal(RepeatTemplate.java:215)
at org.springframework.batch.repeat.support.RepeatTemplate.iterate(RepeatTemplate.java:145)
at org.springframework.batch.core.step.item.SimpleChunkProvider.provide(SimpleChunkProvider.java:118)
at org.springframework.batch.core.step.item.ChunkOrientedTasklet.execute(ChunkOrientedTasklet.java:71)
at org.springframework.batch.core.step.tasklet.TaskletStep$ChunkTransactionCallback.doInTransaction(TaskletStep.java:407)
at org.springframework.batch.core.step.tasklet.TaskletStep$ChunkTransactionCallback.doInTransaction(TaskletStep.java:331)
at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:140)
at org.springframework.batch.core.step.tasklet.TaskletStep$2.doInChunkContext(TaskletStep.java:273)
at org.springframework.batch.core.scope.context.StepContextRepeatCallback.doInIteration(StepContextRepeatCallback.java:82)
at org.springframework.batch.repeat.support.RepeatTemplate.getNextResult(RepeatTemplate.java:375)
at org.springframework.batch.repeat.support.RepeatTemplate.executeInternal(RepeatTemplate.java:215)
at org.springframework.batch.repeat.support.RepeatTemplate.iterate(RepeatTemplate.java:145)
at org.springframework.batch.core.step.tasklet.TaskletStep.doExecute(TaskletStep.java:258)
at org.springframework.batch.core.step.AbstractStep.execute(AbstractStep.java:208)
at org.springframework.batch.core.job.SimpleStepHandler.handleStep(SimpleStepHandler.java:152)
at org.springframework.batch.core.job.AbstractJob.handleStep(AbstractJob.java:413)
at org.springframework.batch.core.job.SimpleJob.doExecute(SimpleJob.java:136)
at org.springframework.batch.core.job.AbstractJob.execute(AbstractJob.java:320)
at org.springframework.batch.core.launch.support.SimpleJobLauncher$1.run(SimpleJobLauncher.java:149)
at org.springframework.core.task.SyncTaskExecutor.execute(SyncTaskExecutor.java:50)
at org.springframework.batch.core.launch.support.SimpleJobLauncher.run(SimpleJobLauncher.java:140)
at com.redis.riot.cli.common.AbstractCommand.call(AbstractCommand.java:128)
at com.redis.riot.cli.common.AbstractCommand.call(AbstractCommand.java:37)
at picocli.CommandLine.executeUserObject(CommandLine.java:2041)
at picocli.CommandLine.access$1500(CommandLine.java:148)
at picocli.CommandLine$RunLast.executeUserObjectOfLastSubcommandWithSameParent(CommandLine.java:2461)
at picocli.CommandLine$RunLast.handle(CommandLine.java:2453)
at picocli.CommandLine$RunLast.handle(CommandLine.java:2415)
at picocli.CommandLine$AbstractParseResultHandler.execute(CommandLine.java:2273)
at picocli.CommandLine$RunLast.execute(CommandLine.java:2417)
at com.redis.riot.cli.common.RiotExecutionStrategy.execute(RiotExecutionStrategy.java:42)
at picocli.CommandLine.execute(CommandLine.java:2170)
at com.redis.riot.cli.Main.execute(Main.java:59)
at com.redis.riot.cli.Main.main(Main.java:47)
Caused by: org.springframework.batch.item.ItemStreamException: Reader job failed
at com.redis.spring.batch.reader.AbstractRedisItemReader.read(AbstractRedisItemReader.java:241)
at com.redis.spring.batch.reader.AbstractRedisItemReader.read(AbstractRedisItemReader.java:42)
at org.springframework.batch.core.step.item.SimpleChunkProvider.doRead(SimpleChunkProvider.java:99)
at org.springframework.batch.core.step.item.FaultTolerantChunkProvider.read(FaultTolerantChunkProvider.java:87)
... 36 more

09:11:13.630 FINE org.springframework.batch.support.transaction.ResourcelessTransactionManager : Initiating transaction rollback
09:11:13.630 FINE org.springframework.batch.support.transaction.ResourcelessTransactionManager : Rolling back resourceless transaction on [org.springframework.batch.support.transaction.ResourcelessTransactionManager$ResourcelessTransaction@2aafd790]
09:11:13.630 FINE org.springframework.batch.repeat.support.RepeatTemplate : Handling exception: org.springframework.batch.core.step.skip.NonSkippableReadException, caused by: org.springframework.batch.core.step.skip.NonSkippableReadException: Non-skippable exception during read
09:11:13.630 FINE org.springframework.batch.core.step.item.SimpleRetryExceptionHandler : Handled fatal exception
09:11:13.630 FINE org.springframework.batch.repeat.support.RepeatTemplate : Handling fatal exception explicitly (rethrowing first of 1): org.springframework.batch.core.step.skip.NonSkippableReadException: Non-skippable exception during read
09:11:13.630 SEVERE org.springframework.batch.core.step.AbstractStep : Encountered an error executing step scan in job replicate
org.springframework.batch.core.step.skip.NonSkippableReadException: Non-skippable exception during read
at org.springframework.batch.core.step.item.FaultTolerantChunkProvider.read(FaultTolerantChunkProvider.java:105)
at org.springframework.batch.core.step.item.SimpleChunkProvider$1.doInIteration(SimpleChunkProvider.java:126)
at org.springframework.batch.repeat.support.RepeatTemplate.getNextResult(RepeatTemplate.java:375)
at org.springframework.batch.repeat.support.RepeatTemplate.executeInternal(RepeatTemplate.java:215)
at org.springframework.batch.repeat.support.RepeatTemplate.iterate(RepeatTemplate.java:145)
at org.springframework.batch.core.step.item.SimpleChunkProvider.provide(SimpleChunkProvider.java:118)
at org.springframework.batch.core.step.item.ChunkOrientedTasklet.execute(ChunkOrientedTasklet.java:71)
at org.springframework.batch.core.step.tasklet.TaskletStep$ChunkTransactionCallback.doInTransaction(TaskletStep.java:407)
at org.springframework.batch.core.step.tasklet.TaskletStep$ChunkTransactionCallback.doInTransaction(TaskletStep.java:331)
at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:140)
at org.springframework.batch.core.step.tasklet.TaskletStep$2.doInChunkContext(TaskletStep.java:273)
at org.springframework.batch.core.scope.context.StepContextRepeatCallback.doInIteration(StepContextRepeatCallback.java:82)
at org.springframework.batch.repeat.support.RepeatTemplate.getNextResult(RepeatTemplate.java:375)
at org.springframework.batch.repeat.support.RepeatTemplate.executeInternal(RepeatTemplate.java:215)
at org.springframework.batch.repeat.support.RepeatTemplate.iterate(RepeatTemplate.java:145)
at org.springframework.batch.core.step.tasklet.TaskletStep.doExecute(TaskletStep.java:258)
at org.springframework.batch.core.step.AbstractStep.execute(AbstractStep.java:208)
at org.springframework.batch.core.job.SimpleStepHandler.handleStep(SimpleStepHandler.java:152)
at org.springframework.batch.core.job.AbstractJob.handleStep(AbstractJob.java:413)
at org.springframework.batch.core.job.SimpleJob.doExecute(SimpleJob.java:136)
at org.springframework.batch.core.job.AbstractJob.execute(AbstractJob.java:320)
at org.springframework.batch.core.launch.support.SimpleJobLauncher$1.run(SimpleJobLauncher.java:149)
at org.springframework.core.task.SyncTaskExecutor.execute(SyncTaskExecutor.java:50)
at org.springframework.batch.core.launch.support.SimpleJobLauncher.run(SimpleJobLauncher.java:140)
at com.redis.riot.cli.common.AbstractCommand.call(AbstractCommand.java:128)
at com.redis.riot.cli.common.AbstractCommand.call(AbstractCommand.java:37)
at picocli.CommandLine.executeUserObject(CommandLine.java:2041)
at picocli.CommandLine.access$1500(CommandLine.java:148)
at picocli.CommandLine$RunLast.executeUserObjectOfLastSubcommandWithSameParent(CommandLine.java:2461)
at picocli.CommandLine$RunLast.handle(CommandLine.java:2453)
at picocli.CommandLine$RunLast.handle(CommandLine.java:2415)
at picocli.CommandLine$AbstractParseResultHandler.execute(CommandLine.java:2273)
at picocli.CommandLine$RunLast.execute(CommandLine.java:2417)
at com.redis.riot.cli.common.RiotExecutionStrategy.execute(RiotExecutionStrategy.java:42)
at picocli.CommandLine.execute(CommandLine.java:2170)
at com.redis.riot.cli.Main.execute(Main.java:59)
at com.redis.riot.cli.Main.main(Main.java:47)
Caused by: org.springframework.batch.item.ItemStreamException: Reader job failed
at com.redis.spring.batch.reader.AbstractRedisItemReader.read(AbstractRedisItemReader.java:241)
at com.redis.spring.batch.reader.AbstractRedisItemReader.read(AbstractRedisItemReader.java:42)
at org.springframework.batch.core.step.item.SimpleChunkProvider.doRead(SimpleChunkProvider.java:99)
at org.springframework.batch.core.step.item.FaultTolerantChunkProvider.read(FaultTolerantChunkProvider.java:87)
... 36 more
Scanning 100% [==============================================================================================================================================================================] 12937/12937 (0:00:08 / 0:00:00) 1617.1/s
09:11:13.643 FINE org.jline : Removing shutdown-hook: Thread[JLine Shutdown Hook,5,main]
09:11:13.654 FINE org.springframework.batch.support.transaction.ResourcelessTransactionManager : Creating new transaction with name [org.springframework.batch.core.repository.support.SimpleJobRepository.updateExecutionContext]: PROPAGATION_REQUIRED,ISOLATION_DEFAULT
09:11:13.654 FINE org.springframework.batch.support.transaction.ResourcelessTransactionManager : Initiating transaction commit
09:11:13.655 FINE org.springframework.batch.support.transaction.ResourcelessTransactionManager : Committing resourceless transaction on [org.springframework.batch.support.transaction.ResourcelessTransactionManager$ResourcelessTransaction@226346d4]
09:11:13.655 INFO org.springframework.batch.core.step.AbstractStep : Step: [scan] executed in 8s588ms
09:11:13.655 FINE org.springframework.batch.support.transaction.ResourcelessTransactionManager : Creating new transaction with name [org.springframework.batch.core.repository.support.SimpleJobRepository.update]: PROPAGATION_REQUIRED,ISOLATION_DEFAULT
09:11:13.655 FINE org.springframework.batch.support.transaction.ResourcelessTransactionManager : Initiating transaction commit
09:11:13.655 FINE org.springframework.batch.support.transaction.ResourcelessTransactionManager : Committing resourceless transaction on [org.springframework.batch.support.transaction.ResourcelessTransactionManager$ResourcelessTransaction@66d0d5ee]
09:11:13.655 FINE org.springframework.batch.core.step.AbstractStep : Step execution complete: StepExecution: id=1, version=101, name=scan, status=FAILED, exitStatus=FAILED, readCount=9950, filterCount=0, writeCount=9900 readSkipCount=0, writeSkipCount=0, processSkipCount=0, commitCount=99, rollbackCount=1
09:11:13.655 FINE org.springframework.batch.support.transaction.ResourcelessTransactionManager : Creating new transaction with name [org.springframework.batch.core.repository.support.SimpleJobRepository.updateExecutionContext]: PROPAGATION_REQUIRED,ISOLATION_DEFAULT
09:11:13.656 FINE org.springframework.batch.support.transaction.ResourcelessTransactionManager : Initiating transaction commit
09:11:13.656 FINE org.springframework.batch.support.transaction.ResourcelessTransactionManager : Committing resourceless transaction on [org.springframework.batch.support.transaction.ResourcelessTransactionManager$ResourcelessTransaction@738a1324]
09:11:13.656 FINE org.springframework.batch.core.job.AbstractJob : Upgrading JobExecution status: StepExecution: id=1, version=101, name=scan, status=FAILED, exitStatus=FAILED, readCount=9950, filterCount=0, writeCount=9900 readSkipCount=0, writeSkipCount=0, processSkipCount=0, commitCount=99, rollbackCount=1, exitDescription=org.springframework.batch.core.step.skip.NonSkippableReadException: Non-skippable exception during read
at org.springframework.batch.core.step.item.FaultTolerantChunkProvider.read(FaultTolerantChunkProvider.java:105)
at org.springframework.batch.core.step.item.SimpleChunkProvider$1.doInIteration(SimpleChunkProvider.java:126)
at org.springframework.batch.repeat.support.RepeatTemplate.getNextResult(RepeatTemplate.java:375)
at org.springframework.batch.repeat.support.RepeatTemplate.executeInternal(RepeatTemplate.java:215)
at org.springframework.batch.repeat.support.RepeatTemplate.iterate(RepeatTemplate.java:145)
at org.springframework.batch.core.step.item.SimpleChunkProvider.provide(SimpleChunkProvider.java:118)
at org.springframework.batch.core.step.item.ChunkOrientedTasklet.execute(ChunkOrientedTasklet.java:71)
at org.springframework.batch.core.step.tasklet.TaskletStep$ChunkTransactionCallback.doInTransaction(TaskletStep.java:407)
at org.springframework.batch.core.step.tasklet.TaskletStep$ChunkTransactionCallback.doInTransaction(TaskletStep.java:331)
at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:140)
at org.springframework.batch.core.step.tasklet.TaskletStep$2.doInChunkContext(TaskletStep.java:273)
at org.springframework.batch.core.scope.context.StepContextRepeatCallback.doInIteration(StepContextRepeatCallback.java:82)
at org.springframework.batch.repeat.support.RepeatTemplate.getNextResult(RepeatTemplate.java:375)
at org.springframework.batch.repeat.support.RepeatTemplate.executeInternal(RepeatTemplate.java:215)
at org.springframework.batch.repeat.support.RepeatTemplate.iterate(RepeatTemplate.java:145)
at org.springframework.batch.core.step.tasklet.TaskletStep.doExecute(TaskletStep.java:258)
at org.springframework.batch.core.step.AbstractStep.execute(AbstractStep.java:208)
at org.springframework.batch.core.job.SimpleStepHandler.handleStep(SimpleStepHandler.java:152)
at org.springframework.batch.core.job.AbstractJob.handleStep(AbstractJob.java:413)
at org.springframework.batch.core.job.SimpleJob.doExecute(SimpleJob.java:136)
at org.springframework.batch.core.job.AbstractJob.execute(AbstractJob.java:320)
at org.springframework.batch.core.launch.support.SimpleJobLauncher$1.run(SimpleJobLauncher.java:149)
at org.springframework.core.task.SyncTaskExecutor.execute(SyncTaskExecutor.java:50)
at org.springframework.batch.core.launch.support.SimpleJobLauncher.run(SimpleJobLauncher.java:140)
at com.redis.riot.cli.common.AbstractCommand.call(AbstractCommand.java:128)
at com.redis.riot.cli.common.AbstractCommand.call(AbstractCommand.java:37)
at picocli.CommandLine.executeUserObject(CommandLine.java:2041)
at picocli.CommandLine.access$1500(CommandLine.java:148)
at picocli.CommandLine$RunLast.executeUserObjectOfLastSubcommandWithSameParent(CommandLine.java:2461)
at picocli.CommandLine$RunLast.handle(CommandLine.java:2453)
at picocli.CommandLine$RunLast.handle(CommandLine.java:2415)
at picocli.CommandLine$AbstractParseResultHandler.execute(CommandLine.java:2273)
at picocli.CommandLine$RunLast.execute(CommandLine.java:2417)
at com.redis.riot.cli.common.RiotExecutionStrategy.execute(RiotExecutionStrategy.java:42)
at picocli.CommandLine.execute(CommandLine.java:2170)
at com.redis.riot.cli.Main.execute(Main.java:59)
at com.redis.riot.cli.Main.main(Main.java:47)
Caused by: org.springframework.batch.item.ItemStreamException: Reader job failed
at com.redis.spring.batch.reader.AbstractRedisItemReader.read(AbstractRedisItemReader.java:241)
at com.redis.spring.batch.reader.AbstractRedisItemReader.read(AbstractRedisItemReader.java:42)
at org.springframework.batch.core.step.item.SimpleChunkProvider.doRead(SimpleChunkProvider.java:99)
at org.springframework.batch.core.step.item.FaultTolerantChunkProvider.read(FaultTolerantChunkProvider.java:87)
... 36 more

09:11:13.656 FINE org.springframework.batch.core.job.AbstractJob : Job execution complete: JobExecution: id=0, version=1, startTime=Fri Jul 05 09:11:05 UTC 2024, endTime=null, lastUpdated=Fri Jul 05 09:11:05 UTC 2024, status=FAILED, exitStatus=exitCode=FAILED;exitDescription=org.springframework.batch.core.step.skip.NonSkippableReadException: Non-skippable exception during read
at org.springframework.batch.core.step.item.FaultTolerantChunkProvider.read(FaultTolerantChunkProvider.java:105)
at org.springframework.batch.core.step.item.SimpleChunkProvider$1.doInIteration(SimpleChunkProvider.java:126)
at org.springframework.batch.repeat.support.RepeatTemplate.getNextResult(RepeatTemplate.java:375)
at org.springframework.batch.repeat.support.RepeatTemplate.executeInternal(RepeatTemplate.java:215)
at org.springframework.batch.repeat.support.RepeatTemplate.iterate(RepeatTemplate.java:145)
at org.springframework.batch.core.step.item.SimpleChunkProvider.provide(SimpleChunkProvider.java:118)
at org.springframework.batch.core.step.item.ChunkOrientedTasklet.execute(ChunkOrientedTasklet.java:71)
at org.springframework.batch.core.step.tasklet.TaskletStep$ChunkTransactionCallback.doInTransaction(TaskletStep.java:407)
at org.springframework.batch.core.step.tasklet.TaskletStep$ChunkTransactionCallback.doInTransaction(TaskletStep.java:331)
at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:140)
at org.springframework.batch.core.step.tasklet.TaskletStep$2.doInChunkContext(TaskletStep.java:273)
at org.springframework.batch.core.scope.context.StepContextRepeatCallback.doInIteration(StepContextRepeatCallback.java:82)
at org.springframework.batch.repeat.support.RepeatTemplate.getNextResult(RepeatTemplate.java:375)
at org.springframework.batch.repeat.support.RepeatTemplate.executeInternal(RepeatTemplate.java:215)
at org.springframework.batch.repeat.support.RepeatTemplate.iterate(RepeatTemplate.java:145)
at org.springframework.batch.core.step.tasklet.TaskletStep.doExecute(TaskletStep.java:258)
at org.springframework.batch.core.step.AbstractStep.execute(AbstractStep.java:208)
at org.springframework.batch.core.job.SimpleStepHandler.handleStep(SimpleStepHandler.java:152)
at org.springframework.batch.core.job.AbstractJob.handleStep(AbstractJob.java:413)
at org.springframework.batch.core.job.SimpleJob.doExecute(SimpleJob.java:136)
at org.springframework.batch.core.job.AbstractJob.execute(AbstractJob.java:320)
at org.springframework.batch.core.launch.support.SimpleJobLauncher$1.run(SimpleJobLauncher.java:149)
at org.springframework.core.task.SyncTaskExecutor.execute(SyncTaskExecutor.java:50)
at org.springframework.batch.core.launch.support.SimpleJobLauncher.run(SimpleJobLauncher.java:140)
at com.redis.riot.cli.common.AbstractCommand.call(AbstractCommand.java:128)
at com.redis.riot.cli.common.AbstractCommand.call(AbstractCommand.java:37)
at picocli.CommandLine.executeUserObject(CommandLine.java:2041)
at picocli.CommandLine.access$1500(CommandLine.java:148)
at picocli.CommandLine$RunLast.executeUserObjectOfLastSubcommandWithSameParent(CommandLine.java:2461)
at picocli.CommandLine$RunLast.handle(CommandLine.java:2453)
at picocli.CommandLine$RunLast.handle(CommandLine.java:2415)
at picocli.CommandLine$AbstractParseResultHandler.execute(CommandLine.java:2273)
at picocli.CommandLine$RunLast.execute(CommandLine.java:2417)
at com.redis.riot.cli.common.RiotExecutionStrategy.execute(RiotExecutionStrategy.java:42)
at picocli.CommandLine.execute(CommandLine.java:2170)
at com.redis.riot.cli.Main.execute(Main.java:59)
at com.redis.riot.cli.Main.main(Main.java:47)
Caused by: org.springframework.batch.item.ItemStreamException: Reader job failed
at com.redis.spring.batch.reader.AbstractRedisItemReader.read(AbstractRedisItemReader.java:241)
at com.redis.spring.batch.reader.AbstractRedisItemReader.read(AbstractRedisItemReader.java:42)
at org.springframework.batch.core.step.item.SimpleChunkProvider.doRead(SimpleChunkProvider.java:99)
at org.springframework.batch.core.step.item.FaultTolerantChunkProvider.read(FaultTolerantChunkProvider.java:87)
... 36 more
, job=[JobInstance: id=0, version=0, Job=[replicate]], jobParameters=[{}]
09:11:13.662 FINE org.springframework.batch.support.transaction.ResourcelessTransactionManager : Creating new transaction with name [org.springframework.batch.core.repository.support.SimpleJobRepository.update]: PROPAGATION_REQUIRED,ISOLATION_DEFAULT
09:11:13.663 FINE org.springframework.batch.support.transaction.ResourcelessTransactionManager : Initiating transaction commit
09:11:13.663 FINE org.springframework.batch.support.transaction.ResourcelessTransactionManager : Committing resourceless transaction on [org.springframework.batch.support.transaction.ResourcelessTransactionManager$ResourcelessTransaction@59df8444]
09:11:13.663 INFO org.springframework.batch.core.launch.support.SimpleJobLauncher : Job: [SimpleJob: [name=replicate]] completed with the following parameters: [{}] and the following status: [FAILED] in 8s632ms

jruaux commented

Can you try with latest RIOT release?