Introduction of the project

IMPaCT-Data is the IMPaCT program that aims to support the development of a common, interoperable and integrated system for the collection and analysis of clinical and molecular data by providing the knowledge and resources available in the Spanish Science and Technology System. This development will make it possible to answer research questions based on the different clinical and molecular information systems available. Fundamentally, it aims to provide researchers with a population perspective based on individual data.

The IMPaCT-Data project is divided into different work packages (WP). In the context of IMPaCT-Data WP3 (Genomics), a working group of experts worked on the generation of a specific quality control (QC) workflow for germline exome samples.

To achieve this, a set of metrics related to human genomic data was decided upon, and the toolset or software to extract these metrics was implemented in an existing variant calling workflow called Sarek, part of the nf-core community. The final outcome is a Nextflow subworkflow, called IMPaCT-QC implemented in the Sarek pipeline.

Below you can find the explanation of this workflow (raw pipeline), the link to the documentation of the IMPaCT QC subworkflow and a linked documentation associated to the QC metrics added in the mentioned workflow.

• IMPaCT-data subworkflow documentation

• Metrics documentation

<img alt="nf-core/sarek" src="docs/images/nf-core-sarek_logo_light.png">

Introduction

nf-core/sarek is a workflow designed to detect variants on whole genome or targeted sequencing data. Initially designed for Human, and Mouse, it can work on any species with a reference genome. Sarek can also handle tumour / normal pairs and could include additional relapses.

The pipeline is built using Nextflow, a workflow tool to run tasks across multiple compute infrastructures in a very portable manner. It uses Docker/Singularity containers making installation trivial and results highly reproducible. The Nextflow DSL2 implementation of this pipeline uses one container per process which makes it much easier to maintain and update software dependencies. Where possible, these processes have been submitted to and installed from nf-core/modules in order to make them available to all nf-core pipelines, and to everyone within the Nextflow community!

On release, automated continuous integration tests run the pipeline on a full-sized dataset on the AWS cloud infrastructure. This ensures that the pipeline runs on AWS, has sensible resource allocation defaults set to run on real-world datasets, and permits the persistent storage of results to benchmark between pipeline releases and other analysis sources. The results obtained from the full-sized test can be viewed on the nf-core website.

It's listed on Elixir - Tools and Data Services Registry and Dockstore.

Pipeline summary

Depending on the options and samples provided, the pipeline can currently perform the following:

• Form consensus reads from UMI sequences (fgbio)
• Sequencing quality control and trimming (enabled by --trim_fastq) (FastQC, fastp)
• Map Reads to Reference (BWA-mem, BWA-mem2, dragmap or Sentieon BWA-mem)
• Process BAM file (GATK MarkDuplicates, GATK BaseRecalibrator and GATK ApplyBQSR or Sentieon LocusCollector and Sentieon Dedup)
• Summarise alignment statistics (samtools stats, mosdepth)
• Variant calling (enabled by --tools, see compatibility):
  • ASCAT
  • CNVkit
  • Control-FREEC
  • DeepVariant
  • freebayes
  • GATK HaplotypeCaller
  • Manta
  • mpileup
  • MSIsensor-pro
  • Mutect2
  • Sentieon Haplotyper
  • Strelka2
  • TIDDIT
• Variant filtering and annotation (SnpEff, Ensembl VEP, BCFtools annotate)
• Summarise and represent QC (MultiQC)

Usage

[!NOTE] If you are new to Nextflow and nf-core, please refer to this page on how to set-up Nextflow. Make sure to test your setup with -profile test before running the workflow on actual data.

First, prepare a samplesheet with your input data that looks as follows:

samplesheet.csv:

patient,sample,lane,fastq_1,fastq_2
ID1,S1,L002,ID1_S1_L002_R1_001.fastq.gz,ID1_S1_L002_R2_001.fastq.gz

Each row represents a pair of fastq files (paired end).

Now, you can run the pipeline using:

nextflow run nf-core/sarek \
   -profile  \
   --input samplesheet.csv \
   --outdir 

[!WARNING] Please provide pipeline parameters via the CLI or Nextflow -params-file option. Custom config files including those provided by the -c Nextflow option can be used to provide any configuration except for parameters; see docs.

For more details and further functionality, please refer to the usage documentation and the parameter documentation.

Pipeline output

To see the results of an example test run with a full size dataset refer to the results tab on the nf-core website pipeline page. For more details about the output files and reports, please refer to the output documentation.

Benchmarking

On each release, the pipeline is run on 3 full size tests:

• test_full runs tumor-normal data for one patient from the SEQ2C consortium
• test_full_germline runs a WGS 30X Genome-in-a-Bottle(NA12878) dataset
• test_full_germline_ncbench_agilent runs two WES samples with 75M and 200M reads (data available here). The results are uploaded to Zenodo, evaluated against a truth dataset, and results are made available via the NCBench dashboard.

Credits

Sarek was originally written by Maxime U Garcia and Szilveszter Juhos at the National Genomics Infastructure and National Bioinformatics Infastructure Sweden which are both platforms at SciLifeLab, with the support of The Swedish Childhood Tumor Biobank (Barntumörbanken). Friederike Hanssen and Gisela Gabernet at QBiC later joined and helped with further development.

The Nextflow DSL2 conversion of the pipeline was lead by Friederike Hanssen and Maxime U Garcia.

Maintenance is now lead by Friederike Hanssen and Maxime U Garcia (now at Seqera Labs)

Main developers:

• Maxime U Garcia
• Friederike Hanssen

We thank the following people for their extensive assistance in the development of this pipeline:

• Abhinav Sharma
• Adam Talbot
• Adrian Lärkeryd
• Alexander Peltzer
• Alison Meynert
• Anders Sune Pedersen
• arontommi
• BarryDigby
• Bekir Ergüner
• bjornnystedt
• cgpu
• Chela James
• David Mas-Ponte
• Edmund Miller
• Francesco Lescai
• Gavin Mackenzie
• Gisela Gabernet
• Grant Neilson
• gulfshores
• Harshil Patel
• James A. Fellows Yates
• Jesper Eisfeldt
• Johannes Alneberg
• José Fernández Navarro
• Júlia Mir Pedrol
• Ken Brewer
• Lasse Westergaard Folkersen
• Lucia Conde
• Malin Larsson
• Marcel Martin
• Nick Smith
• Nicolas Schcolnicov
• Nilesh Tawari
• Nils Homer
• Olga Botvinnik
• Oskar Wacker
• pallolason
• Paul Cantalupo
• Phil Ewels
• Sabrina Krakau
• Sam Minot
• Sebastian-D
• Silvia Morini
• Simon Pearce
• Solenne Correard
• Susanne Jodoin
• Szilveszter Juhos
• Tobias Koch
• Winni Kretzschmar

Acknowledgements

Contributions & Support

If you would like to contribute to this pipeline, please see the contributing guidelines.

For further information or help, don't hesitate to get in touch on the Slack #sarek channel (you can join with this invite), or contact us: Maxime U Garcia, Friederike Hanssen

Citations

If you use nf-core/sarek for your analysis, please cite the Sarek article as follows:

Friederike Hanssen, Maxime U Garcia, Lasse Folkersen, Anders Sune Pedersen, Francesco Lescai, Susanne Jodoin, Edmund Miller, Oskar Wacker, Nicholas Smith, nf-core community, Gisela Gabernet, Sven Nahnsen Scalable and efficient DNA sequencing analysis on different compute infrastructures aiding variant discovery NAR Genomics and Bioinformatics Volume 6, Issue 2, June 2024, lqae031, doi: 10.1093/nargab/lqae031.

Garcia M, Juhos S, Larsson M et al. Sarek: A portable workflow for whole-genome sequencing analysis of germline and somatic variants [version 2; peer review: 2 approved] F1000Research 2020, 9:63 doi: 10.12688/f1000research.16665.2.

You can cite the sarek zenodo record for a specific version using the following doi: 10.5281/zenodo.3476425

An extensive list of references for the tools used by the pipeline can be found in the CITATIONS.md file.

You can cite the nf-core publication as follows:

The nf-core framework for community-curated bioinformatics pipelines.

Philip Ewels, Alexander Peltzer, Sven Fillinger, Harshil Patel, Johannes Alneberg, Andreas Wilm, Maxime Ulysse Garcia, Paolo Di Tommaso & Sven Nahnsen.

Nat Biotechnol. 2020 Feb 13. doi: 10.1038/s41587-020-0439-x.

CHANGELOG

• CHANGELOG