error executing process > 'pipeline:process_bams:extract_barcodes (74) '
reedmakGCB opened this issue · 7 comments
Operating System
macOS
Other Linux
No response
Workflow Version
Workflow Execution
Command line
EPI2ME Version
v3.0
CLI command run
nextflow run epi2me-labs/wf-single-cell --fastq /reedm/singleCell/fastq --kit_name 3prime --kit_version v3 --expected_cells 20000 --ref_genome_dir /10x/refdata-gex-GRCh38-2020-A --plot_umaps --merge_bam --max_threads 8 --resources_mm2_max_threads 32 -profile singularity -c nextflow_env.config
Workflow Execution - CLI Execution Profile
singularity
What happened?
![Screenshot 2024-02-10 at 10 03 55 AM](https://private-user-images.githubusercontent.com/143645398/303845055-1fb4a9a7-7a2e-4081-a949-e251d84107ce.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MjQ3MjI2NDcsIm5iZiI6MTcyNDcyMjM0NywicGF0aCI6Ii8xNDM2NDUzOTgvMzAzODQ1MDU1LTFmYjRhOWE3LTdhMmUtNDA4MS1hOTQ5LWUyNTFkODQxMDdjZS5wbmc_WC1BbXotQWxnb3JpdGhtPUFXUzQtSE1BQy1TSEEyNTYmWC1BbXotQ3JlZGVudGlhbD1BS0lBVkNPRFlMU0E1M1BRSzRaQSUyRjIwMjQwODI3JTJGdXMtZWFzdC0xJTJGczMlMkZhd3M0X3JlcXVlc3QmWC1BbXotRGF0ZT0yMDI0MDgyN1QwMTMyMjdaJlgtQW16LUV4cGlyZXM9MzAwJlgtQW16LVNpZ25hdHVyZT1hYTc0ODJkYjMzZDVlODdlMzM4YWQ5YzkxNGFhODdhNTE2MjgzM2FiNWIxMmE5NTEzYmRmZjQzMzM3ODEwNDZlJlgtQW16LVNpZ25lZEhlYWRlcnM9aG9zdCZhY3Rvcl9pZD0wJmtleV9pZD0wJnJlcG9faWQ9MCJ9.9iRcesbWj4tNXdFtdcVFkMffDZ7igFmrYYnrNucV8Ak)
![Screenshot 2024-02-10 at 10 11 14 AM](https://private-user-images.githubusercontent.com/143645398/303845056-cf7b8d3a-001e-44ff-8ffb-cd8004643008.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MjQ3MjI2NDcsIm5iZiI6MTcyNDcyMjM0NywicGF0aCI6Ii8xNDM2NDUzOTgvMzAzODQ1MDU2LWNmN2I4ZDNhLTAwMWUtNDRmZi04ZmZiLWNkODAwNDY0MzAwOC5wbmc_WC1BbXotQWxnb3JpdGhtPUFXUzQtSE1BQy1TSEEyNTYmWC1BbXotQ3JlZGVudGlhbD1BS0lBVkNPRFlMU0E1M1BRSzRaQSUyRjIwMjQwODI3JTJGdXMtZWFzdC0xJTJGczMlMkZhd3M0X3JlcXVlc3QmWC1BbXotRGF0ZT0yMDI0MDgyN1QwMTMyMjdaJlgtQW16LUV4cGlyZXM9MzAwJlgtQW16LVNpZ25hdHVyZT1lZjE2OWRlNTQ3NGM5NGJlYjM3MzIyYzkyMzU0ZDZhN2FmZGNiMjc3MmQ3MDcyNDlmNzRmN2EwMzhlMjZkOTM4JlgtQW16LVNpZ25lZEhlYWRlcnM9aG9zdCZhY3Rvcl9pZD0wJmtleV9pZD0wJnJlcG9faWQ9MCJ9.wsdOD81QRFSrby3T88I-AfkxurPsShLNd7ntQWr2z38)
![Screenshot 2024-02-10 at 10 13 23 AM](https://private-user-images.githubusercontent.com/143645398/303845057-0506c2cc-0ce0-4289-8c6b-bb6311ccab58.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MjQ3MjI2NDcsIm5iZiI6MTcyNDcyMjM0NywicGF0aCI6Ii8xNDM2NDUzOTgvMzAzODQ1MDU3LTA1MDZjMmNjLTBjZTAtNDI4OS04YzZiLWJiNjMxMWNjYWI1OC5wbmc_WC1BbXotQWxnb3JpdGhtPUFXUzQtSE1BQy1TSEEyNTYmWC1BbXotQ3JlZGVudGlhbD1BS0lBVkNPRFlMU0E1M1BRSzRaQSUyRjIwMjQwODI3JTJGdXMtZWFzdC0xJTJGczMlMkZhd3M0X3JlcXVlc3QmWC1BbXotRGF0ZT0yMDI0MDgyN1QwMTMyMjdaJlgtQW16LUV4cGlyZXM9MzAwJlgtQW16LVNpZ25hdHVyZT05ZTVkZjZhNzExM2M3MjM5N2U4YTcxZGU1YjhiMjE5NmRkNmY4YTU3YjMzMjUwMTNkNmJkYWY3ZDlkYTk1ZmUxJlgtQW16LVNpZ25lZEhlYWRlcnM9aG9zdCZhY3Rvcl9pZD0wJmtleV9pZD0wJnJlcG9faWQ9MCJ9._rddLYcu1jSu6qvwt58HJbpP2wKv4zFwiLfKQ7ESKXQ)
Relevant log output
shown in screenshots above
Application activity log entry
No response
Were you able to successfully run the latest version of the workflow with the demo data?
yes
Other demo data information
Hi @reedmakGCB I'm sorry you are having issues with the workflow. Could you post the files .nextflow.log
please?
Hello!
I tried adding
profiles {
singularity {
singularity {
enabled = true
autoMounts = true
runOptions = '--writable-tmpfs'
}
}
}
and resuming the process from where this error left off however I was then meet with a different error after the pipeline ran some more.
my log file is too big but here is the last few pages of it:
nextflowLog (dragged).pdf
If you can add the log as a text file and not a pdf it will be much smaller and you shoul dbe able to include it all
I went in a added more time and memory for this step to run but it still gives me this error
Hi @reedmakGCB
Sorry for the delay. From your log it appears the you have these resources available.
CPUs: 2 - Mem: 10 GB
OI would recommend giving the workflow at least 30Gb and raising the number of CPUs substantially.
Hi @reedmakGCB,
Version 2.0.0 released today has reworked a lot of the workflows resource requirements. Please give it a try.