neo4j-partners/amazon-cloud-formation-neo4j

Improve Java Memory Allocation

Closed this issue · 4 comments

benofben commented

I'm getting OOM on the t3.medium with a small data set, specifically this: https://github.com/neo4j-partners/neo4j-sagemaker/blob/main/form13/embedding.ipynb

It works in Aura with a similar config. I'm strongly suspicious something needs to be done in the installers to allocate heap better. This code should go in the installer, not the template. I wonder if there's code in Aura that ought to move over to the template.

benofben commented

Ed checking with product team. Likely fix pulling memory allocation into the core product.

benofben commented

Looks like we may have hit similar but less dramatic performance issues related to our SageMaker PR. I'm highly suspicious that the lack of JVM tuning is causing us wider pain than we're aware of.

Note that I'm an not suggesting that go as a one off in cloud init, rather it should be part of the installer so that it is available on all platforms.

edrandall-dev commented

Resolved.