aws/amazon-genomics-cli

Getting ` Cannot find latest version of nf-validation plugin` when running NextFlow pipelines

Opened this issue · 1 comments

When running RNASeq, Sarek, or FetchNGS pipelines as per the AWS tutorial Analyzing Genomic Data using Amazon Genomics CLI and Amazon SageMaker the AWS Batch run job is failing on the head node with Cannot find latest version of nf-validation plugin

Portion of log from Batch job:

N E X T F L O W ~ version 22.04.3
Pulling nf-core/sarek ...
downloaded from https://github.com/nf-core/sarek.git
WARN: It appears you have never run this project before -- Option -resume is ignored
Launching 'https://github.com/nf-core/sarek' [fabulous_volhard] DSL2 - revision: 6aeac929c9 [master]
Cannot find latest version of nf-validation plugin
Cannot find latest version of nf-validation plugin
=== Nextflow Log ===
=== Running Cleanup ===

Using:

  • NextFlow 22.04.4
  • AGC 1.6.0
  • Running on Mac M1 with Sonoma 14.2 / also running from AWS SageMaker
  • Node v20.1.0
  • zsh version 5.9

Following along with above linked tutorial - AGC activate and context deploy fine
Pipeline fails at the validation - suggestions are to enter the validation module version manually to the nextflow.config - using AGC doesn't seem to allow this

Expect pipeline to complete as it does when built on an EC2 launcher using AWS Batch following the NextFlow tutorial as per NextFlow on AWS - I have this running successfully - was trying out AGC as a potential solution for an easily deployable contained module.

Operating System:
AGC Version: 1.6.0
Was AGC setup with a custom bucket: yes
Was AGC setup with a custom VPC: no

I have resolved this issue by pushing version numbers back due to AGC not being up to date with the latest version of NextFlow.

Is AGC no longer current? We were looking at this as a valid solution but not if it is not being maintained.