awslabs/amazon-kinesis-client

KCL v2 consumer does not backoff on ProvisionedThroughputExceededException

vtlkvl opened this issue · 2 comments

vtlkvl commented

In KCL v1 com.amazonaws.services.kinesis.clientlibrary.lib.worker.ProcessTask used to fetch records and yield a short message on ProvisionedThroughputExceededException using ThrottlingReporter and then backoff. In KCL v2 records are fetched upstream by PrefetchRecordsPublisher and then passed to software.amazon.kinesis.lifecycle.ProcessTask. PrefetchRecordsPublisher handles ProvisionedThroughputExceededException as a common SDK error, specifically it logs a stack trace and does not force a backoff. Is it an intended change or a regression?

royyeah commented

Any updates on this issue? I see pull request #716, but this has not been merged.

  • 👍3
LuShuai commented

any updates?

  • 👍1