Source-linked AI summary

SPICE, A Dataset of Drug-like Molecules and Peptides for Training Machine Learning Potentials

Peter Eastman, Pavan Kumar Behara, David L. Dotson, Raimondas Galvelis, John E. Herr, Josh T. Horton, Yuezhi Mao, John D. Chodera, Benjamin P. Pritchard, Yuanqing Wang, Gianni De Fabritiis, Thomas E. Markland

arXiv:2209.10702v2physics.chem-phcs.LGq-bio.BM

TL;DR

The paper targets accurate, general-purpose potentials for simulating drug-like molecules interacting with proteins. It constructs SPICE from complementary subsets and trains proof-of-concept models, achieving low energy errors across the dataset while remaining scoped to conformational changes.

Abstract

from arXiv · show

Machine learning potentials are an important tool for molecular simulation, but their development is held back by a shortage of high quality datasets to train them on. We describe the SPICE dataset, a new quantum chemistry dataset for training potentials relevant to simulating drug-like small molecules interacting with proteins. It contains over 1.1 million conformations for a diverse set of small molecules, dimers, dipeptides, and solvated amino acids. It includes 15 elements, charged and uncharged molecules, and a wide range of covalent and non-covalent interactions. It provides both forces and energies calculated at the ωB97M-D3(BJ)/def2-TZVPPD level of theory, along with other useful quantities such as multipole moments and bond orders. We train a set of machine learning potentials on it and demonstrate that they can achieve chemical accuracy across a broad region of chemical space. It can serve as a valuable resource for the creation of transferable, ready to use potential functions for use in molecular simulations.

Dataset Requirements

SPICE is designed as a general-purpose potential-training dataset covering chemically relevant elements, charges, interactions, and conformations. Its requirements emphasize forces, accurate quantum chemistry, useful auxiliary properties, and continued versioned growth.

  • SPICE targets general-purpose potentials for drug-like molecules interacting with proteins, rather than models specialized to one system.Source: Dataset Requirements · p. 2
  • The dataset must cover diverse elements, chemical groups, charged and polar molecules, and both covalent and non-covalent interactions.Source: Dataset Requirements · p. 2
  • It must sample higher-energy as well as low-energy conformations because molecular dynamics and conformational searches explore more than energy-minimized structures.Source: Dataset Requirements · pp. 2–3
  • The initial scope excludes very high-energy conformations involving covalent-bond formation or breaking, focusing instead on conformational changes.Source: Dataset Requirements · p. 3
  • Forces provide 3N components for an N-atom molecule, compared with one energy, substantially increasing the information available for training.Source: Dataset Requirements · p. 3
  • Training data should use the most accurate practical theory and include inexpensive auxiliary quantities such as multipole moments and partial charges.Source: Dataset Requirements · p. 3
  • Existing datasets commonly lack forces, charged molecules, broad elemental coverage, non-equilibrium conformations, or complete intramolecular interactions.Source: Dataset Requirements · pp. 4–5

Methods

SPICE combines complementary subsets covering covalent and non-covalent chemistry, diverse drug-like molecules, peptides, solvated amino acids, ions, and conformational variation. Energies and forces are computed at a practical high-accuracy DFT level, alongside multiple molecular properties.

Content of the SPICE Dataset

Quantum Chemistry Calculations

Data Records

SPICE is distributed as a single HDF5 data file organized by molecule or cluster, with fields describing the available properties.

  • The dataset is deposited in Zenodo as SPICE-1.1.2.hdf5 and organized into one top-level group per molecule or cluster.Source: Data Records · p. 8
  • Each molecule or cluster group contains data fields for the different available types of information, with detailed descriptions in the Zenodo record.Source: Data Records · p. 8

Technical Validation

The proof-of-concept models use an equivariant transformer ensemble trained on filtered SPICE data with energy and force losses. Training converges, generalizes closely from training to test conformations, and achieves mostly chemically accurate energy predictions, while errors remain associated with charges, molecular size, and unusual chemistries.

Model and training setup

  • Five Equivariant Transformer models with identical hyperparameters differ only by random seed and receive minimal hyperparameter tuning.Each model uses six layers, eight attention heads, embedding width 128, a 1 nm cutoff, and 64 radial basis functions.Source: Training a Potential Energy Model · p. 9
  • The model represents each unique element–formal-charge combination as one of 28 atom types, whose frequencies range from over 12 million neutral carbons to 750 positively charged phosphorus atoms.Formal-charge-based atom types provide the model's charge representation, but remain valid only when bonding patterns do not change.Source: Training a Potential Energy Model · p. 9, Table 2 · p. 9

Data preparation

  • Approximately 2% of highly strained conformations are discarded, leaving 1,109,212 samples, with 55,461 randomly selected for testing.Samples are filtered when any force component exceeds 1 hartree/bohr.Source: Filtering of strained molecules · p. 10

Training behavior

  • All five models largely plateau during training, suggesting convergence and limited benefit from further training.The loss combines weighted L2 energy and force errors, with weights of 1 (kJ/mol)^-2 and 1 (kJ/mol/Å)^-2, respectively.Source: Optimization of model parameters · p. 10, Figure 2 · p. 10

Validation results

Error analysis

  • The best model has dataset-wide energy MAE 4.663 kJ/mol and median absolute error 2.912 kJ/mol, while errors tend to increase roughly linearly with molecular size.The lower median indicates that a small fraction of large-error samples raises the mean; unusual chemistries, including phosphinic acids, are also prominent among high-error molecules.Source: Analysis of the trained models · pp. 11–12, Molecules with large errors · p. 13

Competing interests

The authors disclose advisory-board memberships, equity interests, and extensive funding relationships involving scientific, pharmaceutical, and technology organizations.

  • JDC serves on the Scientific Advisory Boards of four companies and holds equity interests in two of them.Source: Competing interests · p. 16
Loading 2209.10702v2…