redis-field-engineering/redis-kafka-connect

Could not open reader

ogelacinyc opened this issue · 0 comments

ogelacinyc commented

STREAM reader type works normally, but it does not work when changed to KEYS type.
Settings and error log are as follows

{
  "name": "RedisSourceConnectorConnector_0",
  "config": {
    "name": "RedisSourceConnectorConnector_0",
    "connector.class": "com.redis.kafka.connect.RedisSourceConnector",
    "tasks.max": "6",
    "errors.log.enable": "true",
    "errors.log.include.messages": "true",
    "redis.cluster": "false",
    "redis.host": "172.21.0.3:6379",
    "redis.uri": "172.21.0.3:6379",
    "redis.tls": "false",
    "redis.insecure": "false",
    "topic": "redis",
    "redis.reader": "KEYS",
    "redis.keys.patterns": "*",
    "redis.stream.name": ""
  }
}

connect  | [2023-01-17 07:26:03,002] INFO [Worker clientId=connect-1, groupId=compose-connect-group] Starting connectors and tasks using config offset 190 (org.apache.kafka.connect.runtime.distributed.DistributedHerder)
connect  | [2023-01-17 07:26:03,002] INFO [Worker clientId=connect-1, groupId=compose-connect-group] Finished starting connectors and tasks (org.apache.kafka.connect.runtime.distributed.DistributedHerder)
connect  | [2023-01-17 07:26:03,014] ERROR WorkerSourceTask{id=RedisSourceConnectorConnector_0-0} Task threw an uncaught and unrecoverable exception. Task is being killed and will not recover until manually restarted (org.apache.kafka.connect.runtime.WorkerTask)
connect  | org.apache.kafka.connect.errors.RetriableException: Could not open reader
connect  | 	at com.redis.kafka.connect.source.RedisSourceTask.start(RedisSourceTask.java:50)
connect  | 	at org.apache.kafka.connect.runtime.AbstractWorkerSourceTask.initializeAndStart(AbstractWorkerSourceTask.java:273)
connect  | 	at org.apache.kafka.connect.runtime.WorkerTask.doRun(WorkerTask.java:199)
connect  | 	at org.apache.kafka.connect.runtime.WorkerTask.run(WorkerTask.java:256)
connect  | 	at org.apache.kafka.connect.runtime.AbstractWorkerSourceTask.run(AbstractWorkerSourceTask.java:75)
connect  | 	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
connect  | 	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
connect  | 	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
connect  | 	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
connect  | 	at java.base/java.lang.Thread.run(Thread.java:829)
connect  | Caused by: java.lang.NullPointerException
connect  | 	at java.base/java.util.Objects.requireNonNull(Objects.java:221)
connect  | 	at java.base/java.util.Optional.<init>(Optional.java:107)
connect  | 	at java.base/java.util.Optional.of(Optional.java:120)
connect  | 	at com.redis.spring.batch.step.FlushingOptions$Builder.timeout(FlushingOptions.java:55)
connect  | 	at com.redis.kafka.connect.source.KeySourceRecordReader.open(KeySourceRecordReader.java:63)
connect  | 	at com.redis.kafka.connect.source.RedisSourceTask.start(RedisSourceTask.java:48)
connect  | 	... 9 more
connect  | [2023-01-17 07:26:03,031] INFO [Producer clientId=connector-producer-RedisSourceConnectorConnector_0-0] Closing the Kafka producer with timeoutMillis = 30000 ms. (org.apache.kafka.clients.producer.KafkaProducer)
connect  | [2023-01-17 07:26:03,039] INFO Metrics scheduler closed (org.apache.kafka.common.metrics.Metrics)
connect  | [2023-01-17 07:26:03,039] INFO Closing reporter org.apache.kafka.common.metrics.JmxReporter (org.apache.kafka.common.metrics.Metrics)
connect  | [2023-01-17 07:26:03,039] INFO Metrics reporters closed (org.apache.kafka.common.metrics.Metrics)
connect  | [2023-01-17 07:26:03,040] INFO App info kafka.producer for connector-producer-RedisSourceConnectorConnector_0-0 unregistered (org.apache.kafka.common.utils.AppInfoParser)