This BioExcel best practice guide outlines the development process for writing a workflow using the Common Workflow Language (CWL), from creating and selecting tools like BioBB, through early experimentation, reuse and testing, to optimization and ensuring reproducibility before publication in workflow repositories.

Presented at Swedish eResearch Centre meeting, 13 may 2022

Keynote Presented at the ICTeSSH 2021 Conference to Social Science and Humanities. ICTeSSH 2021, 30th June 2021

https://ictessh.uns.ac.rs/ In data intensive science multi-step tool-chains are widely used to help scientists manage, analyze, and share increasing volumes of complex data. The use of computational workflows to manage these multi-step computational processes has accelerated in the past few years driven by the need for scalable data processing, the exchange of processing know-how, and ...

Keynote JOBIM 2021 (French Bioinformatics Conference)

FAIR Computational Workflows https://jobim2021.sciencesconf.org/ 8 July 2021

Computational workflows capture precise descriptions of the steps and data dependencies needed to carry out computational data pipelines, analysis and simulations in many areas of Science, including the Life Sciences. The use of computational workflows to manage these multi-step computational processes has accelerated in the past few years driven by the need for ...

Keynote at German Conference on Bioinformatics 2021 https://gcb2021.de/ FAIR Computational Workflows Computational workflows capture precise descriptions of the steps and data dependencies needed to carry out computational data pipelines, analysis and simulations in many areas of Science, including the Life Sciences. The use of computational workflows to manage these multi-step computational processes has accelerated in the past few years driven by the need for scalable data processing, the ...

Description

The Settlement Delineation and Analysis (SDA) workflows generates a settlement network from geospatial settlement data. It can process geotiff and shapefile inputs and was originally designed to operate on the World Settlement Footprint dataset. Through multiple workflow stages, a settlement network is constructed, contracted (i.e. clustered) and ultimately analysed with centrality measures. The output shapefile stores the ...

plant2human workflow

...

Workflow for gene set enrichment analsysis (GSEA) and co-expression analysis (WGCNA) on transcriptomics data to analyze pathways affected in Porto-Sinusoidal Vascular Disease.

Workflow for Creating a large disease network from various datasets and databases for IBM, and applying the active subnetwork identification method MOGAMUN.

A CWL-based pipeline for calling small germline variants, namely SNPs and small INDELs, by processing data from Whole-genome Sequencing (WGS) or Targeted Sequencing (e.g., Whole-exome sequencing; WES) experiments.

On the respective GitHub folder are available:

• The CWL wrappers and subworkflows for the workflow
• A pre-configured YAML template, based on validation analysis of publicly available HTS data

Briefly, the workflow performs the following steps:

1. Quality control of Illumina reads ...

A CWL-based pipeline for calling small germline variants, namely SNPs and small INDELs, by processing data from Whole-genome Sequencing (WGS) or Targeted Sequencing (e.g., Whole-exome sequencing; WES) experiments.

On the respective GitHub folder are available:

• The CWL wrappers and subworkflows for the workflow
• A pre-configured YAML template, based on validation analysis of publicly available HTS data

Briefly, the workflow performs the following steps:

1. Quality control of Illumina reads ...

A CWL-based pipeline for processing ChIP-Seq data (FASTQ format) and performing:

• Peak calling
• Consensus peak count table generation
• Detection of super-enhancer regions
• Differential binding analysis

On the respective GitHub folder are available:

• The CWL wrappers for the workflow
• A pre-configured YAML template, based on validation analysis of publicly available HTS data
• Tables of metadata (EZH2_metadata_CLL.csv and H3K27me3_metadata_CLL.csv), based on the same validation ...

A CWL-based pipeline for processing RNA-Seq data (FASTQ format) and performing differential gene/transcript expression analysis.

On the respective GitHub folder are available:

• The CWL wrappers for the workflow
• A pre-configured YAML template, based on validation analysis of publicly available HTS data
• A table of metadata (mrna_cll_subsets_phenotypes.csv), based on the same validation analysis, to serve as an input example for the design of comparisons during differential expression ...

MGnify (http://www.ebi.ac.uk/metagenomics) provides a free to use platform for the assembly, analysis and archiving of microbiome data derived from sequencing microbial populations that are present in particular environments. Over the past 2 years, MGnify (formerly EBI Metagenomics) has more than doubled the number of publicly available analysed datasets held within the resource. Recently, an updated approach to data analysis has been unveiled (version 5.0), replacing the previous single pipeline ...

MGnify (http://www.ebi.ac.uk/metagenomics) provides a free to use platform for the assembly, analysis and archiving of microbiome data derived from sequencing microbial populations that are present in particular environments. Over the past 2 years, MGnify (formerly EBI Metagenomics) has more than doubled the number of publicly available analysed datasets held within the resource. Recently, an updated approach to data analysis has been unveiled (version 5.0), replacing the previous single pipeline ...

MGnify (http://www.ebi.ac.uk/metagenomics) provides a free to use platform for the assembly, analysis and archiving of microbiome data derived from sequencing microbial populations that are present in particular environments. Over the past 2 years, MGnify (formerly EBI Metagenomics) has more than doubled the number of publicly available analysed datasets held within the resource. Recently, an updated approach to data analysis has been unveiled (version 5.0), replacing the previous single pipeline ...

Workflow for LongRead Quality Control and Filtering

• NanoPlot (read quality control) before and after filtering
• Filtlong (read trimming)
• Kraken2 taxonomic read classification before and after filtering
• Minimap2 read filtering based on given references

Other UNLOCK workflows on WorkflowHub: https://workflowhub.eu/projects/16/workflows?view=default

All tool CWL files and other workflows can be found here: https://gitlab.com/m-unlock/cwl/workflows

**How to setup and use an UNLOCK ...

Workflow for quality assessment of paired reads and classification using NGTax 2.0 and functional annotation using picrust2. In addition files are exported to their respective subfolders for easier data management in a later stage. Steps:

• FastQC (read quality control)
• NGTax 2.0
• Picrust 2
• Export module for ngtax

Rare disease researchers workflow is that they submit their raw data (fastq), run the mapping and variant calling RD-Connect pipeline and obtain unannotated gvcf files to further submit to the RD-Connect GPAP or analyse on their own.

This demonstrator focuses on the variant calling pipeline. The raw genomic data is processed using the RD-Connect pipeline (Laurie et al., 2016) running on the standards (GA4GH) compliant, interoperable container ...

Analysis of variation within individual COVID-19 samples using bowtie2, bwa, fastp, multiqc , picard ,samtools, snpEff Workflow, tools and data are available on https://github.com/fjrmoreews/cwl-workflow-SARS-CoV-2/tree/master/Variation This worklow was ported into CWL from a Galaxy Workflow ( https://github.com/galaxyproject/SARS-CoV-2/tree/master/genomics/4-Variation migrated to CWL).

Author: AMBARISH KUMAR [email protected]; [email protected]

This is a proposed standard operating procedure for genomic variant detection using SAMTools.

It is hoped to be effective and useful for getting SARS-CoV-2 genome variants.

It uses Illumina RNASEQ reads and genome sequence.

Author: AMBARISH KUMAR [email protected] & [email protected]

This is a proposed standard operating procedure for genomic variant detection using GATK4.

It is hoped to be effective and useful for getting SARS-CoV-2 genome variants.

It uses Illumina RNASEQ reads and genome sequence.

Author: AMBARISH KUMAR [email protected]; [email protected]

This is a proposed standard operating procedure for genomic variant detection using VARSCAN.

It is hoped to be effective and useful for getting SARS-CoV-2 genome variants.

It uses Illumina RNASEQ reads and genome sequence.

Author: AMBARISH KUMAR [email protected] & [email protected]

This is a proposed standard operating procedure for genomic variant detection using GATK4.

It is hoped to be effective and useful for getting SARS-CoV-2 genome variants.

It uses Illumina RNASEQ reads and genome sequence.

This BioExcel best practice guide discusses the workflow engines available for the Common Workflow Language (CWL).