confluentinc/kafkacat-images

Include pv in container

Opened this issue · 0 comments

I've been using this container in kubernetes to create test loads, works a treat.

Overridden the entrypoint and executing a script inside the container - again works well.

I'd love to have some control over the throughput of the producers.

Script in question:

cat /dev/urandom | base64 | kafkacat -P -t test-topic -b "${BOOTSTRAP_HOST}" -l -X linger.ms=1000

I'd propose to be able to use pv:

cat /dev/urandom | base64 | pv --line-mode --rate-limit 100K | kafkacat -P -t test-topic -b "${BOOTSTRAP_HOST}" -l -X linger.ms=1000

Likewise you could consume and pipe it through pv to emulate a slow writing/processing consumer.

I appreciate this could be out of scope but I figured it's worth asking.

Thanks again.