Source-linked AI summary

Quantification of the effect of mutations using a global probability model of natural sequence variation

Thomas A. Hopf, John B. Ingraham, Frank J. Poelwijk, Michael Springer, Chris Sander, Debora S. Marks

arXiv:1510.04612v1q-bio.BM

TL;DR

The paper addresses the challenge of predicting genetic-variation effects when systematic mutation assays leave much protein sequence space unexplored. It models correlated amino-acid variation in protein families with a statistical energy that includes residue interactions, and finds reasonably accurate predictions for several protein mutational datasets. The approach is particularly informative when experimental selection resembles the evolutionary pressure represented in the sequences.

  • Problem

    Systematic functional assays provide useful mutation data, but they cover only a small fraction of potential mutational space, motivating use of natural sequence variation.

    Source: Introduction · p. 2
  • Method

    The paper uses sequence-only probabilistic models of protein families, including residue interactions, to quantify mutation effects through statistical-energy differences.

    Source: Introduction · p. 2
  • Results

    The models reasonably accurately predict experimentally determined effects across several proteins, including higher-order mutations and influenza nucleoprotein and hemagglutinin variants.

    Source: Introduction · pp. 3–4
  • Takeaways & Limitations

    Natural sequence variation can support quantitative prediction of mutation effects and analysis of residue interactions in protein function.

    Source: Introduction · pp. 2–3, Discussion · p. 12

    Inferring a model with all pairwise residue interactions presents a limitation, and correlations decrease when a large fraction of mutants becomes non-viable.

    Source: Discussion · p. 11, Extended Data Figure Legends · p. 25

Abstract

from arXiv · show

Modern biomedicine is challenged to predict the effects of genetic variation. Systematic functional assays of point mutants of proteins have provided valuable empirical information, but vast regions of sequence space remain unexplored. Fortunately, the mutation-selection process of natural evolution has recorded rich information in the diversity of natural protein sequences. Here, building on probabilistic models for correlated amino-acid substitutions that have been successfully applied to determine the three-dimensional structures of proteins, we present a statistical approach for quantifying the contribution of residues and their interactions to protein function, using a statistical energy, the evolutionary Hamiltonian. We find that these probability models predict the experimental effects of mutations with reasonable accuracy for a number of proteins, especially where the selective pressure is similar to the evolutionary pressure on the protein, such as antibiotics.

Introduction

The paper develops a sequence-only statistical approach for predicting mutation effects by modeling residue interactions in protein families. It addresses limited experimental coverage and reports reasonably accurate predictions across several protein mutational datasets.

Motivation

  • Systematic mutation assays cover only a small fraction of potential mutational space and depend strongly on the assayed functional property.Natural evolutionary variation provides a broader record of sequences that retained sufficient function.Source: Introduction · p. 2

Approach

  • The authors present a general approach that uses only sequence variation among evolutionarily related protein families to predict mutation effects through residue interactions.The model builds on statistical models of epistatic constraints previously used for protein-structure prediction.Source: Introduction · pp. 2–3

Limitations of prior approaches

  • Previous computational approaches often assume independent positions and do not systematically model transitive inter-residue dependencies or context-dependent mutation effects.These limitations persist despite evidence that mutation effects depend on context throughout protein evolution.Source: Introduction · p. 3

Evaluation

  • The analysis compares model-derived statistical energies with experimental assays from systematic mutation scans across 13 protein families.The tests examine fitness effects, thermostability, and higher-order mutations, including influenza proteins.Source: Introduction · p. 3

Approach

  • The model estimates statistical energies for protein sequences and uses energy differences between wild-type and mutant sequences to quantify mutation effects.The evolutionary sequence model includes site-specific biases and pairwise epistatic constraints.Source: Introduction · p. 3, Figure 1 · p. 4

Results

  • The approach reasonably accurately predicts experimentally determined higher-order mutation effects and effects of thousands of influenza nucleoprotein and hemagglutinin variants.The results also indicate that across-species variation can inform understanding of human influenza protein evolution.Source: Introduction · pp. 3–4

Probability model for sequences in a protein family

The EVH models protein-family sequence probability distributions using position-specific amino-acid preferences and pairwise residue interactions. Statistical energy differences between mutant and wild-type sequences quantify mutation effects while incorporating sequence context and epistasis.

Predictions of effects of mutations

EVH predictions correlate with experimentally measured effects across several proteins and assay types. The model also evaluates unobserved combinations of mutations and evolutionary paths through sequence space.

Especially good model predictions for particular selection experiments

Prediction accuracy depends on how closely experimental selection pressure matches the evolutionary pressure encoded by sequence variation. Correlations strengthen under relevant antibiotic selection but can decline when effects saturate.

Interactions in epistatic models essential for good predictions

Epistatic EVH models generally outperform independent models because pairwise interactions encode context-dependent sequence constraints. The advantage is especially pronounced for binding, active-site, specificity, and stability-related mutations.

Discussion

The model uses natural sequence variation to predict mutation effects and investigate protein-function constraints, but its accuracy is bounded by data sparsity, model complexity, and experimental noise.

Discussion

  • Sequence scarcity creates a tradeoff between model complexity and fit, motivating additional sequence data and improved regularization.The authors highlight overfitting as a concern and recommend interpreting prediction accuracy alongside experimental noise.Source: Discussion · pp. 11–12
  • Experimental replicate correlations of ~r = 0.7 constrain the accuracy expected from computational mutation-effect predictions.The discussion explicitly links this replicate correlation to the interpretation of prediction accuracy.Source: Discussion · p. 12
  • The approach can study specific variants and combinations across numerous protein families using only sequence variation.The authors propose global probability models as a way to turn evolutionary sequence records into quantitative resources for connecting genotype to phenotype.Source: Discussion · p. 12
  • Future analyses may benefit from global sequence-family models that explicitly incorporate interactions between positions.The proposed scope extends beyond proteins as genomic sequencing becomes more accessible.Source: Discussion · p. 12
  • Mutation datasets were assembled through a literature search of quantitative high-throughput mutagenesis experiments, excluding proteins with insufficient sequence diversity.The compilation also included low-throughput measurements for SH3 and trypsin.Source: Mutation effect datasets · p. 13

Inference of epistatic statistical model of sequences

The paper infers a global probability model of protein sequences with site-specific fields and pairwise couplings, then converts sequence probabilities into mutation-effect predictions and context-dependence measures.

Inference of epistatic statistical model of sequences

  • The model is a maximum-entropy distribution constrained by empirical single-site and pairwise amino-acid frequencies.It is described as a Markov random field, or 20-state Potts model.Source: Inference of epistatic statistical… · p. 14
  • The sequence probability uses site parameters hi(σi), pair parameters Jij(σi,σj), and a partition function Z over all sequences.The distribution assigns probabilities across sequence space for a protein family.Source: Inference of epistatic statistical… · p. 14
  • Parameters are estimated by pseudolikelihood maximization because full likelihood inference is intractable over the 20^N sequence space.L2 regularization is added to improve generalization in the under-sampled regime.Source: Inference of epistatic statistical… · p. 14
  • Evolutionary couplings summarize pairwise constraints using Frobenius norms, average-product correction, and a significance cutoff.These couplings are compared with structural contacts using residue-distance thresholds.Source: Calculation of evolutionary couplings · p. 15
  • The model’s statistical energy differences are not directly comparable between proteins, so effects are rescaled using the mean of the 5% most deleterious predicted single mutants.This rescaling reduces the influence of single outliers.Source: Context-dependent prediction of… · p. 16
  • An independent model uses only site-specific amino-acid preferences, allowing comparison with the pairwise epistatic model.The difference between the two predicted effects quantifies context dependence between sites.Source: Inference of independent maximum… · pp. 16–17
  • Experimental mutation effects are classified with two-component Gaussian mixture models assigning mutants to the component with higher posterior probability.The input effects are sequencing-read enrichment ratios before and after functional selection, transformed into log-space where applicable.Source: Classification of experimental… · p. 17

Extended Data Tables

The extended data tables catalog the mutagenesis experiments and report correlations between model predictions and experimental results.

  • Extended Data Table 1 lists the set of mutagenesis experiments.Source: Table 1
  • Extended Data Table 2 reports correlations between prediction and experiment.Source: Table 2
  • Extended Data Table 3 reports correlations between prediction and experiment for an additional category or analysis.The table caption is truncated in the supplied passage.Source: Table 3

Extended Data Figure Legends

The extended data figures compare evolutionary-model predictions with mutational experiments, examine context-dependent effects and residue interactions, and relate model behavior to structural and selective features.

  • Scatter plots display the quantitative relationship between evolutionary predictions and experimental results.Source: Extended Data Figure Legends · p. 24, Figure 1
  • The epistatic model predicts all tested single-mutation effects using context-dependent evolutionary information.Displayed positions were covered by the sequence alignments used to infer the statistical models.Source: Extended Data Figure Legends · p. 24, Figure 2
  • The model predicts compensatory mutational paths in which G177E, G177D, or L202Q enable otherwise deleterious mutations at other sites.A179M and D136R are tolerated in the backgrounds of L202Q and G177E, respectively, and may require the enabling mutation first.Source: Extended Data Figure Legends · p. 25
  • Correspondence between predicted and experimental effects for bacterial aminoglycoside kinase depends on antibiotic selection pressure.Some mutations become detectable as deleterious in vivo only when selective pressure increases, whereas overall correlations decrease when many mutants are non-viable.Source: Extended Data Figure Legends · p. 25
  • Predicted epistatic residue pairs largely correspond to structurally proximate residues and define a global interaction network.Source: Extended Data Figure Legends · p. 25
  • Epistatic predictions generally agree better with experimental data than independent predictions because they account for context-dependent mutation effects.Epistatic effects also differ more strongly from independent effects for high-effect mutations and specificity-determining residues.Source: Extended Data Figure Legends · pp. 25–26
Loading 1510.04612v1…