Source-linked AI summary

Deep Learning in Pharmacogenomics: From Gene Regulation to Patient Stratification

Alexandr A. Kalinin, Gerald A. Higgins, Narathip Reamaroon, S. M. Reza Soroushmehr, Ari Allyn-Feuer, Ivo D. Dinov, Kayvan Najarian, Brian D. Athey

arXiv:1801.08570v2q-bio.QMcs.LGstat.ML

TL;DR

Pharmaceutical and biotechnology companies have been slow to adopt pharmacogenomics, although testing to optimize medication selection has shown promise for clinical utility in psychiatry. This Perspective considers deep learning applications and anticipates better-informed predictions from combining experiments, alongside a shift toward actionable recommendations.

  • Problem

    Pharmaceutical and biotechnology companies have been slow to adopt pharmacogenomics.

    Source: §1 · p. 3
  • Method

    The Perspective considers deep-learning applications for generating hypotheses about potential pharmacogenomic markers and drugs.

    Source: §2.2 · p. 8, §4.4 · p. 30
  • Results

    The conclusion anticipates that combining information from different experiments will provide better-informed predictions.

    Source: §4.4 · p. 30
  • Takeaways & Limitations

    Intelligence-based systems are expected to shift from prediction to prescription, providing recommendations for further action.

    Source: §4.4 · p. 30

    Practical use of deep-learning models faces several challenges.

    Source: §2.2 · p. 8

Abstract

from arXiv · show

This Perspective provides examples of current and future applications of deep learning in pharmacogenomics, including: (1) identification of novel regulatory variants located in noncoding domains and their function as applied to pharmacoepigenomics; (2) patient stratification from medical records; and (3) prediction of drugs, targets, and their interactions. Deep learning encapsulates a family of machine learning algorithms that over the last decade has transformed many important subfields of artificial intelligence (AI) and has demonstrated breakthrough performance improvements on a wide range of tasks in biomedicine. We anticipate that in the future deep learning will be widely used to predict personalized drug response and optimize medication selection and dosing, using knowledge extracted from large and complex molecular, epidemiological, clinical, and demographic datasets.

1 Introduction

Pharmacogenomics offers clinical applications, but adoption has been slow as variant discovery and treatment-response prediction face expanding data and validation challenges. This Perspective surveys deep learning’s current and potential roles in pharmacogenomics and pharmacoepigenomics while aiming to stimulate discussion of these applications.

1 Introduction

  • Deep learning methods can analyze raw data, learn useful features, and make predictions without first forming a hypothesis.The field has shown promising advances over prior state-of-the-art methods in several biomedical tasks.Source: §1 · p. 3
  • Pharmacogenomics studies genetic variants correlated with drug effects and has potential applications in medication optimization, companion diagnostics, and drug discovery.Its clinical impact has been greatest in oncology, psychiatry, neurology, and cardiology.Source: §1 · p. 3
  • Despite FDA recommendations, pharmacogenomic adoption has been slow, although testing to optimize psychiatric medication selection has shown promise for clinical utility.Source: §1 · p. 3
  • The noncoding regulatory genome is a source of potential pharmacogenomic variants, and pharmacoepigenomics studies how the epigenome relates to drug response.Source: §1 · p. 4
  • Novel variant discovery and drug development can require lengthy trials to assess clinical efficacy, toxicity, and safety, while growing data complicate response prediction.Source: §1 · p. 4
  • The Perspective presents selected current and potential deep-learning applications to raise awareness and stimulate dialogue, not to provide a rigorous technical evaluation.It also cautions that these methods can err without computational, statistical, and experimental expertise, and that proper controls and performance metrics are critical.Source: §1 · p. 5

2 Opportunities and challenges for deep learning applications

This section outlines opportunities for deep learning to learn task-relevant representations from complex raw data in pharmacogenomics, alongside challenges including data needs, model complexity, interpretability, and overfitting risk. It also emphasizes careful evaluation and methods for interpreting models and their predictions.

2.1 Methodological advantages of deep learning

  • Deep learning can learn hierarchical, task-relevant representations from raw data, whereas conventional methods often require extensive guidance, feature handcrafting, and preprocessing.Conventional methods can struggle when useful information is buried among many extracted features; deep networks can learn representations from raw and noisy inputs.Source: §2.1 · p. 6

2.2.1 Data requirements

  • Deep learning has often relied on large labeled datasets, while biological and clinical datasets have historically had fewer labeled samples than data-rich fields.Multimodal, multi-task, transfer, and semi-supervised learning can partly alleviate data limitations; pharmacogenomics models can also benefit from prior knowledge such as gene networks or pathways.Source: §2.2.1 · p. 9

2.2.2 Overfitting in deep learning

  • Deep models can overfit by memorizing training data, particularly when model features or parameters are large relative to sample size or training examples are scarce.Careful architecture and hyperparameter choices are needed, and trained models should demonstrate robust performance.Source: §2.2.2 · pp. 9–10
  • Preventing overfitting requires carefully designed evaluation, including cross-validation and subject normalization, with metrics chosen for the problem and test sets that assess generalization.Metric interpretation can be error-prone: ROC plots are less informative when classes are imbalanced, a common pharmacogenomics situation. The text recommends testing on varying sets that represent the same problem.Source: §2.2.2 · p. 10

2.2.3 Interpretability of deep learning models

  • Interpretation methods include perturbation and back-propagation; DeepSEA and DeepBind probe virtual mutations, while Basset inserts known motifs into input sequences [47, 48, 41].These approaches assess how sequence changes affect model outputs, including predicted chromatin effects and sequence accessibility.Source: §2.2.3 · pp. 11–12
  • Although deep neural networks are harder to interpret than most Bayesian models, recent developments enable interpretation of models and decisions, including SVMs and ensemble methods [46].Users may need an explanation for a particular prediction rather than a full account of a complex model.Source: §2.2.3 · pp. 11–12
  • DeepLIFT scores feature importance using differences from reference inputs and outputs, while activation maximization and attention have been applied to genomic sequences [51, 52].Attention can reveal which input portions contribute to different outputs.Source: §2.2.3 · p. 12

3.1 Inference of pharmacoepigenomic variants: the biology and machine learning

This section examines how deep-learning models use sequence and epigenomic data to infer regulatory states and variant effects in noncoding regions. It considers how these predictions can help investigate pharmacogenomic variation relevant to medication efficacy, dose requirements, drug response, and adverse events.

  • Over 90% of pharmacogenomic GWAS SNPs lie in enhancer, promoter, or intronic regions, and noncoding variation may contribute to drug-response and adverse-event variation.Source: §3.1 · pp. 12, 14
  • DeepSEA predicts transcription-factor binding, DNase I sensitivity, and histone marks across cell types, then uses these profiles to prioritize sequence variants at single-nucleotide sensitivity.Source: §3.1 · pp. 17–18
  • Deepnet-RBP predicts transcription-factor and RNA-binding-protein sites and outperforms 26 tested algorithms; iDeep and iDeepS use multimodal features to predict interpretable RNA-binding motifs.Source: §3.1 · p. 17
  • Basset predicts DNA accessibility by learning sequence motifs and their regulatory logic; predicted accessibility changes are greater for likely causal GWAS SNPs than nearby linkage-disequilibrium SNPs.Source: §3.1 · p. 17
  • 97.6% of targets: DanQ, using the same features and data as DeepSEA, outperformed DeepSEA.Source: §3.1 · pp. 17–18
  • Predicted Hi-C contacts at 1-kb resolution from sequence and DNase I inputs show expected trends against histone, replication-timing, and functional-element data.Source: §3.1 · p. 17
  • Basenji predicts cell-specific epigenetic and transcriptional profiles from DNA sequence alone, with variant-effect predictions aligning with causal eQTL variants; DeepATAC [74] predicts binding locations from DNA sequence and ATAC-seq accessibility, outperforming DeepSEA.Source: §3.1 · pp. 17–18

3.1 Inference of pharmacoepigenomic variants: the biology and machine learning

  • DeepBind used a convolutional neural network to assess sequence binding to transcription factors and RNA-binding proteins and the effects of single-point mutations.The model was applied to binding properties in various diseases.Source: §3.1 · p. 18
  • Basset discriminated causal from non-causal autoimmune GWAS SNPs in high linkage disequilibrium.It learned protein-DNA binding motifs and regulatory knowledge underlying cell-specific DNA accessibility.Source: §3.1 · p. 18
  • DeepSEA and Basset learn features adaptively from raw sequence rather than using handcrafted features, and their expressive power enables them to outperform traditional machine-learning models.More accurate prediction and functional annotation of noncoding variants may improve understanding of pharmacoepigenomic variation and prediction of drug response and adverse events.Source: §3.1 · p. 18
  • Tests of DeepVariant found that a general deep-learning framework exceeded traditional methods' accuracy for SNP and indel calling.DeepVariant was described as a universal SNP and small-indel caller and received the “highest performance” award in a variant-calling challenge.Source: §3.1 · p. 19
  • Deep neural networks also outperformed conventional machine-learning techniques in SNP–SNP interaction prediction [88].Source: §3.1 · p. 19

3.2 The application of artificial intelligence for patient stratification

The section describes how pharmacogenomics and electronic health records can support patient stratification and treatment-response prediction, while noting substantial challenges in extracting useful phenotypes from EHR data.

3.2 The application of artificial intelligence for patient stratification

  • Integrating genomic information and EHRs can extend population or cohort ethnicity stratification toward patient-level stratification and potentially more precise risk assessment.The section also describes EHR-derived disease phenotypes used in GWAS and PheWAS analyses.Source: §3.2 · pp. 19–20
  • Pharmacogenomic and sociometric data from EHR-linked DNA biorepositories can support predictive dosage modeling and reduce dosing error.Clinically available characteristics such as age, gender, and education can also inform treatment options and patient-response assessment.Source: §3.2 · p. 20
  • EHR data’s high dimensionality, noise, heterogeneity, sparseness, incompleteness, random error, and systematic biases can make phenotype extraction require extensive feature engineering and computational models beyond traditional machine learning.Deep learning is described as having potential to overcome these challenges and learn patient data representations useful for treatment response.Source: §3.2 · p. 20
  • Deep EHR models can learn from heterogeneous records, capture temporal patterns, impute missing data, and predict clinical outcomes and treatment strategies, outperforming conventional machine-learning methods [91].Generative models can derive patient representations and surrogate phenotypes, while emerging GAN applications report improved disease- and treatment-related risk prediction [97] [98].Source: §3.2 · pp. 20–21

3.3 Deep learning for temporal patient data

Deep learning can model longitudinal patient records and temporal clinical outcomes, with reported advantages over snapshot-based methods. The section also points to wearable and mobile sensor data as sources for patient phenotyping and describes open-source tools in the field.

3.3 Deep learning for temporal patient data

  • RNNs and LSTMs can extract temporal patterns from patient records, while deep-learning approaches combined with reinforcement learning have been shown efficient for predicting optimal treatment strategies [91].A heparin-dosing policy was learned from sample dosing trials.Source: §3.3 · p. 21
  • The passages describe trajectories with temporal clinical-outcome predictions outperforming conventional machine-learning methods, which typically require a single “snapshot” in time and are less robust for longitudinal modeling.Source: §3.3 · p. 21
  • The authors envision mobile-device and wearable-sensor data measuring phenotypic markers and stratifying patients, with continuous collection enabling large-scale human deep phenotyping and better real-time prognosis assessment.Source: §3.3 · p. 21

[REF] SOURCE CODE

  • Table 3 collects examples of published research and open-source deep-learning software for patient stratification and care coordination.The section identifies wearable data as robust and usable with deep-learning methods, although it is not yet considered part of the EHR [105].Source: §3.3 · p. 22, Table 3 · p. 23

3.4 Pharmacological applications for drug and target discovery, repurposing, and interaction

The section connects pharmacogenomic regulation to drug-target discovery, emphasizing the epigenome’s regulatory complexity and the promise of deep learning for candidate identification. It also notes that validating candidate compounds remains costly and time-consuming.

3.4 Pharmacological applications for drug and target discovery, repurposing, and interaction

  • The epigenome’s spatial and temporal regulatory mechanisms include enhancer-promoter relationships, transcription-factor circuits, and regulatory marks, and the druggable epigenome has yielded thousands of targets.The section identifies pharmacoepigenomics as relevant to drug discovery involving ADME-gene regulation.Source: §3.4 · p. 24
  • Deep learning is described as a valuable approach for identifying prospective druggable targets in the human epigenome.The section places this approach within broader applications that include virtual screening, ADME/Tox prediction, drug-target interaction prediction, and de novo molecule design.Source: §3.4 · p. 25
  • Testing compound–drug-target pairs remains constrained by prolonged preclinical animal screening and the cost and time of brute-force screening thousands of compounds.The section presents simulation in virtual humans as a possible direction for representing human molecular physiology.Source: §3.4 · p. 25

3.5 Deep Learning and toxicology

Deep-learning approaches performed strongly in toxicology benchmarks and can also expose toxicity-related structural features. Tox21 and DeepAOT illustrate benchmark performance and model interpretation, respectively.

3.5 Deep Learning and toxicology

  • The Tox21 challenge assessed 12,000 environmental chemicals and drugs across 12 toxic effects using specifically designed assays.Deep-learning models in the challenge used molecular graph encoding and convolutional neural networks for regression, multiclassification, and multitask learning.Source: §3.5 · pp. 25–26
  • DeepTox achieved the Tox21 challenge’s highest performance, winning the grand challenge, nuclear receptor panel, stress response panel, and six single assays.Its multi-task network outperformed its single-task counterpart in 10 of 12 assays.Source: §3.5 · p. 25
  • DeepAOT models could infer acute oral toxicity-related fragments from molecular shape and atomic-bond information.Internal deep fingerprints were highly correlated with topological structure-based fingerprints, and highlighted fragments were compared with structural alerts and ToxAlerts compounds.Source: §3.5 · p. 26

[REF] SOURCE CODE

  • The cited source-code resources include DeepChem, DeepDTIs_DBN, and DeepSynergy.The section also identifies a table of open-source software applications for pharmacological applications.Source: [REF] SOURCE CODE · p. 27, Table 4 · p. 27

3.6 Other pharmacogenomic applications

The section surveys deep-learning applications across molecular, clinical, and safety-related pharmacogenomic tasks, reporting state-of-the-art performance in several examples.

3.6 Other pharmacogenomic applications

  • Applications include predicting cell phenotypes from transcriptomics, cancer drug response, preclinical drug side effects, patient survival from multi-omic data, drug-induced liver injury, and adverse drug reactions from genomic variants.The cited examples report state-of-the-art performance for these applications.Source: §3.6 · p. 28

4 Future perspectives

The future perspectives describe deep learning’s potential for multimodal pharmacogenomic research, patient stratification, and drug discovery, while emphasizing validation, data access, and sharing constraints. The authors anticipate improved prediction as datasets grow and envision systems eventually moving from prediction toward recommendations.

4.1 Impact on basic research in biology and pharmacology

  • Joint learning from heterogeneous, multimodal data could predict variants and their functions, adverse-event risk, treatment and dosage recommendations, and other pharmacological outputs.Combining patient-specific records, environmental data, demographics, pharmacogenomic targets, and knowledge bases is proposed for stratification at population, cohort, and individual levels.Source: §4.1 · p. 28
  • Deep-learning applications require careful control selection, training sets, validation schemes, metrics, and domain expertise.The authors anticipate increasing predictive power as larger and more heterogeneous pharmacogenomic datasets become available.Source: §4.1 · p. 28

4.2 Industrial perspectives

  • The authors describe pharmaceutical companies as awaiting pragmatic evidence of clinical-trial success and more realistic demonstrations before major investments in deep learning.U.S. security concerns have limited partnerships among healthcare data owners, while companies have organized internal datasets and pursued external data partnerships.Source: §4.2 · p. 29
  • The industry is described as poised to embrace omics-driven and phenotype-driven discovery and clinical-trial stratification once convincing validation emerges.The passage also notes that proprietary and intellectual-property protections often prevent industry researchers from sharing code, data, and results.Source: §4.2 · p. 29, §4.3 · p. 29

4.3 Open science considerations

  • Sharing datasets, preprocessing code, software, and trained models is presented as a way to catalyze research and accelerate progress.Pretrained networks can be fine-tuned for transfer learning, and joint training on proprietary data from multiple sources is contemplated.Source: §4.3 · pp. 29–30
  • Open-science opportunities are constrained by industry sharing restrictions and by privacy concerns around translational studies.The passage contrasts open-source resources for regulatory interactions and variant annotation with less publicly available patient-stratification and pharmacological applications.Source: §4.3 · p. 29

4.4 Conclusions

  • The authors anticipate joint representations of multiple omics data types and generative models that may suggest testable pharmacogenomic markers and drug targets.They also describe a possible future shift from prediction to prescription, with systems recommending further action, and anticipate greater predictive power as datasets grow.Source: §4.4 · p. 30
  • The conclusions frame deep learning as an emerging pharmacogenomics approach for noncoding regulatory variants, medical-record phenotype extraction, patient stratification, and medication optimization.The authors note that applications remain in their infancy and that models often require large training sets, architecture design, and careful validation to prevent overfitting.Source: §4.4 · pp. 31–32
Loading 1801.08570v2…