Summary
This pipeline contains the following functions: (1) Data processing to handle the tansformations needed to obtain the original pathway scores of the samples according to single sample analysis GSEA (2) Model training based on the disease and healthy sample pathway scores, to classify them (3) Scoring matrix weights optimization according to a gold standard list of drugs (those that went on clinical trials or are approved for the disease).It tests the weights in a range of 0 to 30 (you may change as you want). The evaluation function tests and try to maximize the number of approved drugs whose modified pathway scores for disease samples is changed from disease to healthy sample classification, according to the trained model. (4) Computation of the calibrated disease samples pathwa scores according to the interaction among drug and targets found in the sample pathways & Drug ranking based on the disease samples whose calibrated matrix were responsible to change the trained model decision from disease to healthy state. (5) Drug combination ranking evaluated the same way as in option (4) but adding the effects of multiple drugs in each sample while calculating the calibrated scoring matrix
Input configuration file:
- The pipeline only needs a configuration file and the step number you want to run.
-
Configuration file keys (see also the example in config.json):
- identifier: project identifier to be used in the result files
- type_normalization: normalization type (possible values: tpm, fpkm, tmm, cpm or fpkm_uq)
- genome_assembly: the supported assemblies are the 37 and 38 (values may be: g37 or g38)
- pathway_geneset: pathway-based gene sets, choose one identifier from the list in genesets_available.txt
- folder: working directory
- expression_file: compressed gene expression file for the desired icgc project, it must be separated by tabulation. The following columns are mandatory: submitted_file_id (sample names), raw_read_count (the read counts without normalization) and gene_id (genes in ensembl or hgnc symbol). File expected to be in {folder}.
- labels_file (optional for function 1): file with two columns, one named 'sample' corresponding to the unique values of submitted_sample_id; the second named 'label' corresponding to a disease (or confirmed tumour) (1) or a healthy (0) case. File expected to be in {folder}.
- trained_model (optional for function 1): file with the trained model to separate healthy and disease cases. Full path is expected.
- means_table_file (optional for function 1): file with the means table calculated when the model is trained by the function 3. Full path is expected.
- samples_pathway_scores (optional for function 1): file with the original model calculated pathway scores by function 1, in order to check the number of features expected by the original model. Full path is expected.
- optimized_weights_file: tab separated table file with two columns representing the weights (w1, w2, w3) and their respective values.
- drug_list_file (only mandatory for function 3): file with the gold standard drug list (one drugbank id per line), this file is expected to be in the in the experiment item folder results ({folder}/{identifier})
- drug_combination_file (only mandatory for function 5): file with the drug combination candidates list (drugbank ids concatenated with comma in each line). Full path is expected.
-
Observation:
- The "labels_file" parameter is mandatory for the weights optimization, scoring matrix calculation, model traning and drug (or drug combination) ranking
- In case of transfer learning, "labels_file" may be ignored only if both "trained_model", "means_table_file" and "samples_pathway_scores" are present. This is only possible for the functions 2, 4 and 5. For weights optimization, only labels file is accepted.
- If type_normalization and/or genome_assembly are missing or empty, it will switch to the default fpkm_uq
- If pathway_geneset is missing or empty, it will switch to the default KEGG_2021_HUMAN
- If optimized_weights_file is missing or empty, it will switch to the default values (w1: 20, w2: 5, w3: 10)
Usage Instructions
Preparation:
git clone https://github.com/YasCoMa/caliscoma_pipeline.git
cd caliscoma_pipeline
- Create conda environment to handle dependencies:
conda env create -f drugresponse_env.yml
conda activate drugresponse_env
- Setup an environment variable named "path_workflow" with the full path to this workflow folder
Getting data for the running example in the LICA-FR and LIRI-JP projects from ICGC
- Download the expression file for LICA-FR and put it in data_icgc folder
- Download the expression file for LIRI-JP and put it in data_icgc folder
- For the liri-jp project, the labels file is already processed, to given an example of a project that run all steps proposed by this workflow
Run analysis
-
Run all steps:
python3 main.py -rt 0 -cf config.json
-
Run all steps:
python3 main.py -rt 0 -cf config_transfer_options.json
-
Run only data processing:
python3 main.py -rt 1 -cf config.json
-
Run only data processing:
python3 main.py -rt 1 -cf config_transfer_options.json
-
Run only model training & modified pathway score matrix:
python3 main.py -rt 2 -cf config.json
-
Run only model training & modified pathway score matrix:
python3 main.py -rt 2 -cf config_transfer_options.json
-
Run only weights optimization:
python3 main.py -rt 3 -cf config.json
-
Run only drug ranking:
python3 main.py -rt 4 -cf config.json
-
Run only drug ranking:
python3 main.py -rt 4 -cf config_transfer_options.json
-
Run only drug combination evaluation:
python3 main.py -rt 5 -cf config.json
-
Run only drug combination evaluation:
python3 main.py -rt 5 -cf config_transfer_options.json
Reference
Martins, Y. C. (2023). Multi-task analysis of gene expression data on cancer public datasets. medRxiv, 2023-09.
Bug Report
Please, use the Issues tab to report any bug.
Version History
master @ 775adb8 (earliest) Created 22nd Oct 2023 at 01:11 by Yasmmin Martins
meta
Frozen
master
775adb8
Creator
Submitter
Views: 1847 Downloads: 291
Created: 22nd Oct 2023 at 01:11
None