arXiv/arxiv-base

Use boto3 Kinesis WaiterConfig instead of Python retry when waiting for stream

erickpeirson opened this issue · 1 comments

retry_call(waiter.wait, fkwargs=fkwargs,
tries=tries, delay=delay, max_delay=max_delay,
backoff=backoff, jitter=jitter)

Using retry introduces an extra layer of complexity, since boto3's waiter already implements some retry logic. Using WaiterConfig like this is much simpler:

                WaiterConfig=dict(
                    Delay=delay,
                    MaxAttempts=tries,
                    ExclusiveStartShardId=self.shard_id
                )
bdc34 commented

No longer using kinesis.