PEPPER-Margin-DeepVariant takes more cores than limit
Opened this issue · 1 comments
martabaragli commented
Hi,
I am running PEPPER-Margin-DeepVariant via singularity, however I noticed that even when setting a 10 threads limit (-t 10), it takes up to 200 cores. At first I thought it was an issue with singularity, but setting a thread limit on singularity exec doesn't help either (in fact, the default for --vm-cpu string is 1).
Do you have any idea why this may happen?
Thank you
Marta
minaminii commented
Hi, you issue may be caused by PyTorch CPU limit hasn't been configured, making it use all of the available cores.
Try setting environment variable OMP_NUM_THREADS=10 or use torch.set_num_threads()
More information https://discuss.pytorch.org/t/cpu-usage-extremely-high/52172