memory allocation failed

Question

memory allocation failed

Ne0tea opened this issue a year ago · 5 comments

Hi！
I was tring to polish a genome with 1.3g at a node with 2T memory, but constantly got the error of "memory allocation of xxx bytes failed". According to your previous recommendation, I decraesed -t to 1, and it failed. Then, I split my genome and bam file, while it turns out the same error.
Could you please your comments?

Answer 1 · 2023-08-03T09:47:33.000Z

Can you download the latest version and try again? If still have this error? Can you paste the full error message here?

Answer 2 · 2023-08-03T15:11:40.000Z

Thanks for your comment!
The error message is
Starting Wed Aug 2 21:37:35 CST 2023 node21 memory allocation of 835916608 bytes failed /opt/gridview//pbs/dispatcher/mom_priv/jobs/42661.tc6000.SC: line 19: 371102 Aborted (core dumped) ~/software/next_polish2/target/release/next_polish2 -t 20 -r $bam $asm ${yak1} $yak2 > ${asm%.*}_gfa_chr_np2.fa Finished
Starting Wed Aug 2 13:49:00 CST 2023 node21 memory allocation of 835916608 bytes failed /opt/gridview//pbs/dispatcher/mom_priv/jobs/42634.tc6000.SC: line 19: 373261 Aborted (core dumped) ~/software/next_polish2/target/release/next_polish2 -t 1 -r $bam $asm ${yak1} $yak2 > ${asm%.*}_gfa_chr_np2.fa Finished
and nextpolish2 version is

Answer 3 · 2023-08-07T00:59:02.000Z

Did you run the test data successfully?

Answer 4 · 2023-08-07T08:37:50.000Z

yeah, it is successful with test data.

Answer 5 · 2024-03-29T10:14:34.000Z

Thanks for your comment! The error message is Starting Wed Aug 2 21:37:35 CST 2023 node21 memory allocation of 835916608 bytes failed /opt/gridview//pbs/dispatcher/mom_priv/jobs/42661.tc6000.SC: line 19: 371102 Aborted (core dumped) ~/software/next_polish2/target/release/next_polish2 -t 20 -r $bam $asm ${yak1} $yak2 > ${asm%.*}_gfa_chr_np2.fa Finished Starting Wed Aug 2 13:49:00 CST 2023 node21 memory allocation of 835916608 bytes failed /opt/gridview//pbs/dispatcher/mom_priv/jobs/42634.tc6000.SC: line 19: 373261 Aborted (core dumped) ~/software/next_polish2/target/release/next_polish2 -t 1 -r $bam $asm ${yak1} $yak2 > ${asm%.*}_gfa_chr_np2.fa Finished and nextpolish2 version is

this tools may has a high resource consumption, I met the same problem as you, so I separate the Chr into different file and run them again in a separate way, it worked well