pivotal/credhub-release

Setting number of file handles for credhub jvm

gaigaslab-operations opened this issue · 2 comments

What version of the credhub server you are using?
2.1.1 and 2.5.6

What version of the credhub cli you are using?
2.4.0

If you were attempting to accomplish a task, what was it you were attempting to do?
-none- Normal operation

What did you expect to happen?
No errors

What was the actual behavior?
credhub instance was running out of file handles. nofile set to 4096:4096 as deployed from bosh release. CPU is high and load average at 40+

Tried adding ulimit to credhub instance, but jvm still has 4096:4096 for nofile. Temporarily overriding using prlimit, but that is not a long-term solution.

Please confirm where necessary:

  • I have included a log output
  • My log includes an error message
  • I have included steps for reproduction

If you are a PCF customer with an Operation Manager (PCF Ops Manager) please direct your questions to support (https://support.pivotal.io/)

We have created an issue in Pivotal Tracker to manage this:

https://www.pivotaltracker.com/story/show/169472119

The labels on this github issue will be updated when the story is started.

@gaigaslab-operations - thank you for opening this. Do you know what those file handles were pointing to, by chance? Surely we have a file handle leak somewhere, but it would be helpful to know what exactly the server is hanging onto.