Question: is is possible to programmatically consume several ratelimit usage?

[gautierrog]

Hello,

I would like to be able to tell the limiter to consume all its available volume in bulk, I could loop on the ratelimiter like this:

        while True:
            try:
                with self._ratelimiter.ratelimit(identity, delay=False):
                    pass
            except BucketFullException as e:
                break

but that is sub optimal and really time consumming when I use a redis backend.

Would we have another way to achieve that?

[vutran1710]

How about you write a helper function like that and reuse it everywhere?

def consume_batch(limiter, batch):
    for identity in batch:
        while True:
            try:
                with self._ratelimiter.ratelimit(identity, delay=False):
                    pass
            except BucketFullException as e:
                break

Now you can easily import/export it and reuse across your app

[gautierrog]

I tried this helper function but it's really slow with a redis backend. I was looking for a more optimized solution.

[vutran1710]

I understand your point. I'll look at it soon.

[vutran1710]

The next major release will be packed with heavy performance boost (roughly ~1500 items/sec for usage with redis), therefore this probably wont be an issue any longer.