/arcs

🌈Scaffold genome sequence assemblies using linked or long read sequencing data

Primary LanguageC++GNU General Public License v3.0GPL-3.0

Release Downloads Conda Issues

Logo

ARCS

Scaffolding genome sequence assemblies using linked or long read sequencing data

Contents

  1. Description
  2. Run modes - cheat sheet
  3. Install
  4. Dependencies
  5. Installation
  6. ARCS+LINKS pipeline
  7. Running ARCS with linked reads
  8. Running ARCS with long reads
  9. Running alignment-free ARKS with linked reads
  10. Running alignment-free ARKS with long reads
  11. Simulating pseudo-linked reads from long reads
  12. Demo
  13. Using stLFR linked reads
  14. About ARCS/ARKS
  15. Citing ARCS/ARKS/LINKS
  16. License

Description

ARCS and ARKS are genome sequence assembly scaffolders using linked and long read sequencing data

Run modes - cheat sheet

ARCS can be run in 4 modes:

  • ARCS (default) uses alignments of linked reads to the input contigs
  • ARCS-long (arcs-long) uses alignments of long reads to the input contigs
  • ARKS (--arks) uses exact k-mer mapping to associate linked reads to input contigs
  • ARKS-long (arks-long) uses exact k-mer mapping to associate long reads to input contigs

Because ARKS is not dependent on read alignments, it is generally much faster than ARCS. However, ARCS is recommended for use with very fragmented assemblies and/or large genomes.

Dependencies

  • Boost (tested on 1.61)
  • GCC (6+)
  • Autotools (if cloning directly from repository)
  • LINKS (tested on 1.8)
  • Google SparseHash
  • ABySS (if using long reads)
  • btllib (1.4.3+)

Installation

If cloning directly from the repository run:

./autogen.sh

To compile ARCS run:

./configure && make

To install ARCS in a specified directory:

./configure --prefix=/ARCS/PATH && make install

If your boost library headers are not in your PATH you can specify their location:

./configure –-with-boost=/boost/path --prefix=/ARCS/PATH && make install

If you compiled btllib from source (as opposed to installation using conda), you can specify the location of the btllib library files:

export CXXFLAGS+=" -I /path/to/btllib/include"
export LDFLAGS+=" -L /path/to/btllib/install/lib"
./configure && make

If using the arcs-make Makefile, ensure that the directory where the arcs binary is located is on your PATH.

ARCS+LINKS pipeline

The ARCS+LINKS pipeline requires two input files:

  • Draft assembly fasta file
  • Reads file in fastq format *.fq.gz (or fasta format *.fa.gz if using long reads)
    • For linked reads, ARCS expects an interleaved linked reads file (Barcode sequence expected in the BX tag of the read header or in the form "@readname_barcode" ; Run Long Ranger basic on raw chromium reads to produce this interleaved file)

The Makefile located here: bin/arcs-make will run the full ARCS pipeline. It will also optionally run the misassembly corrector Tigmint prior to scaffolding with ARCS. If you are running Tigmint in your pipeline, please ensure that all input files are in your current working directory.

There are three steps to the pipeline:

  1. Run ARCS to generate a Graphviz Dot file (.gv). Nodes in the graph are the sequences to scaffold, and edges show that there is evidence to suggest nodes are linked based on the data obtained from the GemCode/Chromium reads.

  2. Run the python script bin/makeTSVfile.py to generate a file named XXX.tigpair_checkpoint file from the ARCS graph file. The XXX.tigpair_checkpoint file will be provided to LINKS in step 3.

  3. Run LINKS with the XXX.tigpair_checkpoint file as input. To do this, the base name (-b) must be set to the same name as XXX.

When using the -D/--dist_est ARCS option to estimate gap sizes, the user is recommended to use LINKS v1.8.6 or later.

Running ARCS with linked reads (default mode)

The default mode uses alignments of linked reads to contigs to scaffold the input contigs.

To run the pipeline in default mode, run bin/arcs-make arcs. For example, to scaffold the assembly my_scaffolds.fa with the interleaved, longranger processed reads my_reads.fq.gz, specifying a minimum contig length of 1000bp:

arcs-make arcs draft=my_scaffolds reads=my_reads z=1000

For more info check bin/arcs-make help.

To run the arcs executable in default mode, run arcs <alignments>. For descriptions of all arguments, run arcs --help.

Running ARCS with long reads ('--arcs-long' mode)

The arcs-long mode first segments and assigns barcodes to the long reads, yielding pseudo-linked reads. Alignments of the pseudo-linked reads are then used to scaffold the input contigs.

To run the pipeline in arcs-long mode, run bin/arcs-make arks-long. For example, to scaffold the assembly my_scaffolds.fa with long reads my_reads.fa.gz or my_reads.fq.gz, specifying a minimum contig length of 1000bp:

arcs-make arcs-long draft=my_scaffolds reads=my_reads z=1000

The input long reads can be gzipped or uncompressed. For more info check bin/arcs-make help.

Parameters: To account for the higher error rates in long reads vs linked reads, we suggest starting with the following values:

  • m=8-10000
  • s=70
  • c=4
  • l=4
  • a=0.3

Note that lowering c, l and increasing a may increase contiguity, but will likely increase the number of misassemblies as well.

Running alignment-free ARKS with linked reads ('--arks' mode)

To run the pipeline in ARKS mode, run bin/arcs-make arcs. For example, to scaffold the assembly my_scaffolds.fa with the interleaved, longranger processed reads my_reads.fq.gz, specifying a kmer size of 60:

arcs-make arks draft=my_scaffolds reads=my_reads k=60

For more info check bin/arcs-make help.

To run the arcs executable in ARKS mode, run arcs --arks. For descriptions of all arguments, run arcs --help.

Running alignment-free ARKS with long reads ('--arks-long' mode)

The arks-long mode first segments and assigns barcodes to the long reads, yielding pseudo-linked reads. Scaffolding is performed based on exact k-mer mapping of pseudo-linked reads to the input contigs.

To run the pipeline in arks-long mode, run bin/arcs-make arks-long. For example, to scaffold the assembly my_scaffolds.fa with long reads my_reads.fa.gz or my_reads.fq.gz, specifying a kmer size of 20 and j of 0.05:

arcs-make arks-long draft=my_scaffolds reads=my_reads k=20 j=0.05

Parameters: To account for the higher error rates in long reads vs linked reads, we suggest starting with the following values:

  • m=8-10000
  • j=0.05
  • k=20
  • c=4
  • l=4
  • a=0.3

The input long reads can be gzipped or uncompressed.

Simulating pseudo-linked reads from long reads for --arks-long and --arcs-long modes

Pseudo-linked read simulation

Demo

You can test your installation by running one of our supplied demos:

  • ARCS: Examples/arcs_test-demo
  • ARCS-long: Examples/arcs-long_test-demo
  • ARKS: Examples/arks_test-demo
  • ARKS-long: Examples/arks-long_test-demo

You can compare your output to the files provided in the output folders within the above directories.

Using stLFR linked reads

To use stLFR linked reads with ARCS, you will need to re-format the reads to have the barcode in a BX:Z: tag in the read header. For example, this format

@V100002302L1C001R017000000#0_0_0/1 0	1
TGTCTTCCTGGACAGCTGACATCCCTTTTGTTTTTCTGTTTGCTCAGATGCTGTCTCTTATACACATCTTAGGAAGACAAGCACTGACGACATGATCACC
+
FFFFFFFGFGFFGFDFGFFFFFFFFFFFGFFF@FFFFFFFFFFFF@FFFFFFFFFGGFFEFEFFFF?FFFFGFFFGFFFFFFFGFFEFGFGGFGFFFGFF

should be changed to:

@V100002302L1C001R017000000 BX:Z:0_0_0
TGTCTTCCTGGACAGCTGACATCCCTTTTGTTTTTCTGTTTGCTCAGATGCTGTCTCTTATACACATCTTAGGAAGACAAGCACTGACGACATGATCACC
+
FFFFFFFGFGFFGFDFGFFFFFFFFFFFGFFF@FFFFFFFFFFFF@FFFFFFFFFGGFFEFEFFFF?FFFFGFFFGFFFFFFFGFFEFGFGGFGFFFGFF

About ARCS/ARKS

Thank you for your Stars and for using, developing and promoting this free software!

Citing ARCS/ARKS/LINKS

If you use ARCS/ARKS/LINKS in your research, please cite:

Citing ARKS

ARKS: chromosome-scale scaffolding of human genome drafts with linked read kmers.
Coombe L, Zhang J, Vandervalk BP, Chu J, Jackman SD, Birol I, Warren RL.
BMC Bioinformatics. 2018 Jun 20;19(1):234. doi: 10.1186/s12859-018-2243-x.

link

Citing ARCS

ARCS: scaffolding genome drafts with linked reads.
Yeo S, Coombe L, Warren RL, Chu J, Birol I.
Bioinformatics. 2018 Mar 1;34(5):725-731. doi: 10.1093/bioinformatics/btx675.

link

NOTE: The supplementary data and scripts have been moved to http://www.bcgsc.ca/downloads/supplementary/ARCS/

Citing LINKS

LINKS: Scalable, alignment-free scaffolding of draft genomes with long reads.
Warren RL, Yang C, Vandervalk BP, Behsaz B, Lagman A, Jones SJ, Birol I.
Gigascience. 2015 Aug 4;4:35. doi: 10.1186/s13742-015-0076-3. eCollection 2015.

link link

License

ARCS Copyright (c) 2016-present British Columbia Cancer Agency Branch. All rights reserved.

ARCS is released under the GNU General Public License v3

This program is free software: you can redistribute it and/or modify it under the terms of the GNU General Public License as published by the Free Software Foundation, version 3.

This program is distributed in the hope that it will be useful, but WITHOUT ANY WARRANTY; without even the implied warranty of MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU General Public License for more details.

You should have received a copy of the GNU General Public License along with this program. If not, see http://www.gnu.org/licenses/.

For commercial licensing options, please contact Patrick Rebstein prebstein@bccancer.bc.ca