google/autofdo

Huge memory consumption

zamazan4ik opened this issue · 0 comments

create_llvm_prof uses more than 30 Gib RAM on my ~1.8 Gib perf profile. Since I have only 32 Gib RAM it's OOM-killed and I cannot continue the converting process.

Since AutoFDO has no built-in options to reduce memory usage, I've needed to collect much smaller perf profiles. Smth like 800-900 Mib profiles consume 20+ Gib but at least fit on my machine.

Are there other options to reduce memory consumption? Any ongoing work on it or "hidden" command-line options? Would be awesome to get this problem somehow documented.