Lots of open files

[danielhopkins]

I'm running on the HEAD commit (3646d87) and there seem to be lots of open socket connections between kafka and the persistence application.

On os x at least I run this periodically:

pgrep -f kafka-server | xargs lsof -i 4 -P -p | grep 9092 | wc -l

During load testing I'm running into to "too many open files" which I think might be related.

Could there be a connection leak in there?

[krasserm]

Thanks for reporting, there actually were connection leaks in the code which should now be fixed with d923837. Can you please verify?

Also, too many topics in Kafka (= too many persistent actors) can also cause a too many open files (see also this question on Quora and this discussion on akka-user).

[danielhopkins]

looks good to me, under heavy load it's only using a couple of connections now

[danielhopkins]

feel free to close this and thanks for the fix

[krasserm]

You're welcome, thank you for your valuable feedback.