Esque apply is incredible slow.
Closed this issue · 1 comments
hfjn commented
Recently esque apply doesn't seem to work properly anymore. It takes several minutes for the initial diff to load.
We are running Kafka 2.4.0. with not too many topics but quite a few partitions.
In Kafka Logs I see a few of these:
WARN Attempting to send response via channel for which there is no open connection, connection id
I assume that some metadata request is just timing out or taking forever and esque is swallowing that error or actually waiting for something here. What are we waiting for here?
hfjn commented
After a bit of debugging I'm quite sure our amount of partitions is the problem and we are stuck here:
https://github.com/real-digital/esque/blob/master/esque/controller/topic_controller.py#L125
I think it shouldn't be necessary to get all partition data for the apply, should it?