betaFeedback

WorksPhysics and Astronomy

A Universal Graph Deep Learning Interatomic Potential for the Periodic Table

Abstract

Interatomic potentials (IAPs), which describe the potential energy surface of atoms, are a fundamental input for atomistic simulations. However, existing IAPs are either fitted to narrow chemistries or too inaccurate for general applications. Here, we report a universal IAP for materials based on graph neural networks with three-body interactions (M3GNet). The M3GNet IAP was trained on the massive database of structural relaxations performed by the Materials Project over the past 10 years and has broad applications in structural relaxation, dynamic simulations and property prediction of materials across diverse chemical spaces. About 1.8 million materials were identified from a screening of 31 million hypothetical crystal structures to be potentially stable against existing Materials Project crystals based on M3GNet energies. Of the top 2000 materials with the lowest energies above hull, 1578 were verified to be stable using DFT calculations. These results demonstrate a machine learning-accelerated pathway to the discovery of synthesizable materials with exceptional properties.

Atomistic simulations are the bedrock of in silico materials design. The first step in most computational studies of materials is obtaining an equilibrium structure, which involves navigating the potential energy surface (PES) across all independent lattice and atomic degrees of freedom in search of a minimum. Atomistic simulations are also used to probe the dynamical evolution of materials systems and to obtain thermodynamic averages and kinetic properties (e.g., diffusion constants). While electronic structure methods such as density functional theory (DFT) provide the most accurate description of the PES, they are computationally expensive and scale poorly with system size.

For large-scale materials studies, efficient, linear-scaling interatomic potentials (IAPs) that describe the PES in terms of many-body interactions between atoms are often necessary. However, most IAPs today are custom-fitted for a very narrow range of chemistries, often for a single element or up to no more than 4-5 elements. The most popular “general purpose” IAPs are the AMBER family of force fields [1, 2] and the Universal Force Field (UFF). [3] However, both were formulated primarily for molecular/organic systems and have limited support and accuracy in modeling crystal structures. More recently, machine learning (ML) of the PES has emerged as a particularly promising approach to IAP development. [4, 5, 6, 7, 8] These so-called ML-IAPs typically express the PES as a function of local environment descriptors such as the interatomic distances and angles, or atomic densities, and have been demonstrated to significantly outperform classical IAPs across a broad range of chemistries. [9] Message-passing and graph deep learning models [10, 11, 12] have also been shown to yield highly accurate predictions of energies and/or forces of molecules as well as a limited number of crystals, such as Li7P3S11\mathrm{Li}_{7}\mathrm{P}_{3}\mathrm{S}_{11} [13] and LixSiy\mathrm{Li}_{x}\mathrm{Si}_{y} [14] for lithium-ion batteries. Nevertheless, no work has demonstrated a universally applicable IAP across the periodic table and for all crystal types.

In the past decade, the advent of efficient and reliable electronic structure codes [15] with high-throughput automation frameworks [16, 18, 19] [17] have led to the development of large federated databases of computed materials data, such as the Materials Project, [20] AFLOW, [21] Open Quantum Mechanical Database (OQMD), [22] NOMAD, [23] etc. Most of the focus has been on the utilization of the final outputs from the electronic structure computations carried out by these database efforts, namely, the equilibrium structures, energies, band structures and other derivative material properties, for the purposes of materials screening and design. Less attention has been paid to the huge quantities of PES data, i.e., intermediate structures and their corresponding energies, forces, stresses, that have been amassed in the process of performing structural relaxations.

In this work, we develop the formalism for a graph-based deep learning IAP by combining many-body features of traditional IAPs with those of flexible graph material representations. Utilizing the largely untapped dataset of more than 187,000 energies, 16,000,000 forces and 1,600,000 stresses from structural relaxations performed by the Materials Project since its inception in 2011, we trained a universal material graph with three-body interactions neural network (M3GNet) IAP for 89 elements of the periodic table with low energy, force, and stress errors. We demonstrate the applications of M3GNet in the calculations of phonon and elasticity, structural relaxations, etc. We further relaxed ∼\sim30 millions of hypothetical structures for new materials discovery.

Materials Graphs with Many-Body Interactions

Mathematical graphs are a natural representation for crystals and molecules, with nodes and edges representing the atoms and the bonds between them, respectively. In traditional graph neural network (GNN) models for materials, information flows between the node, edge, and, optionally, state vector attributes via successive application of graph convolutional or update operations.[24, 26] [25, 27] Typically, the input bond attribute is based on an interatomic pair distance measure, such as a Gaussian basis expansion. While such graph deep learning models have proven to be exceptionally effective for general materials property predictions,[24, 26] [25, 27] they are not suitable as IAPs due to the lack of physical constraints such as continuity of energies and forces with changes with the length and number of bonds.

Here, we develop a new materials graph architecture that explicitly incorporates many-body interactions (Figure 1). The materials graph is represented as G=(V,E,X,[M,u])\mathcal{G}=(\mathcal{V},\mathcal{E},\mathcal{X},[M,\mathbf{u}]), where vi∈V\mathbf{v}_i \in\mathcal{V} is atom information for ii, eij∈Ee_{ij} \in\mathcal{E} is the bond information for bond connected by atom ii and jj, and u\mathbf{u} is the optional global state information, as temperature, pressure etc. A key difference with prior materials graph implementations is the addition of xi∈X\mathbf{x}_i \in\mathcal{X}, the coordinates for atom ii, and MM, the optional 3×33 \times3 lattice matrix in crystals, which are necessary for obtaining tensorial quantities such as forces and stresses via auto-differentiation.

Figure 1. Schematic of the many-body graph potential and the major computational blocks. The model architecture starts from a position-included graph, and then goes through a featurization process, followed by main blocks, and the readout module with energy, force and stress outputs. The featurization process consists of the graph featurizer and the many-body computation module. In the graph featurizer, the atomic number of elements were embedded into a learnable continuous feature space, and the pair bond distances were expanded onto a basis set with values and derivatives up to second order going to zero at boundary. The many-body computation module calculates the three-body and many-body interaction atom indices and the associated angles. The main block consists of two main steps, namely the many-body to bond module and standard graph convolution. The many-body to bond step calculates the new bond information eije_{ij} by considering the full bonding environment Ni\mathcal{N}_i of atom ii via many-body angles such as θjik\theta_{jik}, τkijl\tau_{kijl}, etc., and the bond length rikr_{ik}, rijr_{ij}, rilr_{il}, etc. The standard graph convolution updates bond, atom, and the optional state information iteratively. During the readout stage, atom information in the graph was passed to a gated MLP for obtaining atomic energy, which sums to the total energy. The derivatives of the total energy give force and stress outputs.

The neighborhood of atom ii is denoted as Ni\mathcal{N}_i. Taking inspiration from traditional IAPs such as the Tersoff bond order potential,28 we consider all other bonds emanating from atom ii when calculating the bond interaction of eije_{ij}. To incorporate nn-body interactions, each eije_{ij} is updated using all distinct combinations of n−2n-2 neighbors in the neighborhood of atom ii excluding atom jj, i.e., Ni/j\mathcal{N}_{i/j}, denoted generally as follows:

e~ij=∑k1,k2,…,kn−2∈Ni/jk1≠k2≠…kn−2ϕn(eij,rij,vj,rik1,rik2,…,rikn−2,vk1,vk2,…,vkn−2)(1)\tilde{e}_{ij}=\sum_{\substack{k_1,k_2,\ldots,k_{n-2}\in\mathcal{N}_{i/j}\\ k_1\ne k_2\ne\ldots k_{n-2}}}\phi_n(e_{ij},\boldsymbol{r}_{ij},\boldsymbol{v}_j,\boldsymbol{r}_{ik_1},\boldsymbol{r}_{ik_2},\ldots,\boldsymbol{r}_{ik_{n-2}},\boldsymbol{v}_{k_1},\boldsymbol{v}_{k_2},\ldots,\boldsymbol{v}_{k_{n-2}}) \tag*{(1)}

where ϕn\phi_n is the update function and rik\boldsymbol{r}_{ik} is the vector pointing from atom ii to atom kk. In practice, this nn-body information exchange involves the calculation of distances, angles, dihedral angles, improper angles, etc., which escalates combinatorially with the order nn as (Mi−1)!/(Mi−n+1)!(M_i-1)!/(M_i-n+1)! where MiM_i is the number of neighbors in Ni\mathcal{N}_i. For brevity, we will denote this materials graph with nn-body interactions neural network as MnGNet. In this work, we will focus on the incorporation of three-body interactions only, i.e., M3GNet.

Let θjik\theta_{jik} denote the angle between bonds eije_{ij} and eike_{ik}. Here, we expand the three-body angular interactions using an efficient complete and orthogonal spherical Bessel function and spherical harmonics basis set, as proposed by Klicpera et al. [11] The bond update equation can then be rewritten as:

e~ij=∑kjl(zlnrikrc)Yl0(θjik)⊙σ(Wvvk+bv)fc(rij)fc(rik)(2)\tilde{e}_{ij}=\sum_k j_l\left(z_{ln}\frac{r_{ik}}{r_c}\right)Y_l^0(\theta_{jik})\odot\sigma(\mathbf{W}_v\mathbf{v}_k+\mathbf{b}_v)f_c(r_{ij})f_c(r_{ik}) \tag*{(2)}
eij′=eij+g(W~2e~ij+b~2)⊙σ(W~1e~ij+b~1)(3)e'_{ij}=e_{ij}+g(\widetilde{\mathbf{W}}_2\tilde{e}_{ij}+\tilde{\mathbf{b}}_2)\odot\sigma(\widetilde{\mathbf{W}}_1\tilde{e}_{ij}+\tilde{\mathbf{b}}_1) \tag*{(3)}

where W\mathbf{W} and b\mathbf{b} are learnable weights from the network, jlj_l is the spherical Bessel function with the roots at zlnz_{ln}, rcr_c is the cutoff radius, Yl0Y_l^0 is the spherical harmonics function with m=0m=0, ⊙\odot is the element-wise product, σ\sigma is the sigmoid activation function, fc(r)=1−6(r/rc)5+15(r/rc)4−10(r/rc)3f_c(r)=1-6(r/r_c)^5+15(r/r_c)^4-10(r/r_c)^3 is the cutoff function ensuring the functions vanishes smoothly at the neighbor boundary,29 and g(x)=xσ(x)g(x)=x\sigma(x) is the nonlinear activation function.30 e~ij\tilde{e}_{ij} is a vector of length nmax⁡lmax⁡n_{\max}l_{\max} expanded by indices l=0,1,…,lmax⁡−1l=0,1,\ldots,l_{\max}-1 and n=0,1,…,nmax⁡−1n=0,1,\ldots,n_{\max}-1.

Following the nn-body interaction update, several graph convolution steps are carried out sequentially to update the bond, atom and, optionally, state information, as follows:

eij′=eij+ϕe(vi⊕vj⊕eij⊕u)We0eij0(4)e'_{ij}=e_{ij}+\phi_e(v_i\oplus v_j\oplus e_{ij}\oplus u)\mathbf{W}_e^0e_{ij}^0 \tag*{(4)}
vi′=vi+∑jϕe′(vi⊕vj⊕eij′⊕u)We0′eij0(5)v'_i=v_i+\sum_j\phi'_e(v_i\oplus v_j\oplus e'_{ij}\oplus u)\mathbf{W}_e^{0'}e_{ij}^0 \tag*{(5)}
u′=g(W2ug(W1u(1Nv∑iNvvi⊕u)+b1u)+b2u)(6)u'=g\left(\mathbf{W}_2^u g\left(\mathbf{W}_1^u\left(\frac{1}{N_v}\sum_i^{N_v}v_i\oplus u\right)+b_1^u\right)+b_2^u\right) \tag*{(6)}

where ϕe(x)\phi_e(x) and ϕe′(x)\phi'_e(x) are gated multi-layer perceptrons as in (9), ⊕\oplus is the concatenation operator, NvN_v is the number of atoms, and eij0e_{ij}^0 are the distance-expanded basis functions with values, first and second derivatives smoothly go to zero at the cutoff boundary (see Methods). Such a design ensures that the target values and their derivatives up to second order change smoothly with changes in the number of bonds. uu inputs and updates are optional to the models since not all structures or models have state attributes.

Each block of multi-step updates (nn-body, bond, atom, state) can be repeated to construct models of arbitrary complexity, similar to previous materials graph network architectures. 25

M3GNet Interatomic Potential

To develop an IAP using the M3GNet architecture, crystal structures with corresponding energies (EE), forces (ff) and stresses (σ\sigma) as targets were used as training data. The model generate trainable targets via auto-differentiation with f=−∂E/∂xf=-\partial E/\partial x and σ=V−1∂E/∂ϵ\sigma=V^{-1}\partial E/\partial\epsilon, where xx are the atomic coordinates, VV is the volume, and ϵ\epsilon is the strain.

Benchmark on IAP datasets

As an initial benchmark, we selected a diverse DFT dataset of elemental energies and forces previously generated by Zuo et al. 9 for fcc Ni, fcc Cu, bcc Li, bcc Mo, diamond Si and diamond Ge. From Table 1, the M3GNet IAPs significantly outperform classical many-body potentials such as the embedded atom method (EAM) and modified EAM (MEAM)

ElementM3GNetM3GNet-allEAMMEAMNNPMTP
Energy (10−310^{-3} eV atom−1^{-1})
Ni0.91.98.523.02.30.8
Cu1.82.37.510.51.70.5
Li2.54.7368.6-1.00.7
Mo6.36.868.036.45.73.9
Si9.66.8-111.79.93.0
Ge9.45.9--11.03.7
Force (10−310^{-3} eV Å−1^{-1})
Ni37.437.011033067.326.9
Cu17.016.912024063.013.5
Li22.124.5140-63.413.2
Mo193.7271.4520220198.7148.1
Si102.8126.2-400174.288.1
Ge76.478.4--124.370.3

Table 1. M3GNet models errors compared to the existing models EAM, MEAM, NNP, and MTP on the single-element dataset from Zuo et al. [9] In each cell, the errors are reported in root mean squared error (RMSE) by averaging results from three independent model training. The M3GNet-all model trains all six elements in one model.

and performs comparably to local environment-based ML-IAPs such as the Behler-Parinello neural network potential (NNP) [4] and moment tensor potential (MTP). [7] It should be noted that while ML-IAPs can achieve slightly lower energy and force errors than M3GNet IAPs, it comes at a substantial loss in flexibility in handling multi-element chemistries. Incorporating multiple elements in ML-IAPs results in a combinatorial explosion in number of regression coefficients and corresponding data requirements. For instance, the MTP requires O(nele2)O(n_{\mathrm{ele}}^{2}) regression coefficients alone to describe the element interactions, where nelen_{\mathrm{ele}} is the number of elements. In contrast, the M3GNet architecture represents the elemental information for each atom (node) as a learnable embedding vector. Such a framework is readily extendable to multi-component chemistries. For instance, the M3GNet-all IAP trained on all six elements perform similarly to the M3GNet IAPs trained on individual elements. The M3GNet framework, like other GNNs, is able to capture long-range interactions without the need to increase the cutoff radius for bond construction (Figure S1). At the same time, unlike the previous GNN models, the M3GNet architecture still retains a continuous variation of energy, force and stress with changes of the number of bonds (Figure S2), a crucial requirement for IAPs.

M3GNet compared to MTP in long-range MgO dataset in equation-of-state and locality studies

Figure S1. M3GNet compared to MTP in long-range MgO dataset in (a) equation-of-state study and (b) locality tests.

Continuity of M3GNet models with strain applied on a Ni super cell

Figure S2. Continuity of M3GNet models with strain applied on a Ni super cell with atom displacements on the first atom. a, the number of bonds change, b, the energy per atom change, c, the force on the first atom change and d, the hydrostatic stress change. All bonds are broken at strain close to 150%, at which point the energy, force and stress changes continuously.

Universal Interatomic Potential for the Periodic Table

To develop an IAP for the entire periodic table, we leveraged on one of the largest open databases of DFT crystal structure relaxations in the world - the Materials Project. [20] The Materials Project performs a sequence of two relaxation calculations [19] with the Perdew-Burke Ernzerhof (PBE) 31 generalized gradient approximation (GGA) functional or the GGA+U method 32 for every unique input crystal, typically obtained from an experimental database such as the Inorganic Crystal Structure Database (ICSD). 33 Our initial dataset comprises a sampling of the energies, forces and stresses from the first and middle ionic steps of the first relaxation and the last step of the second relaxation for calculations in the Materials Project database that contains “GGA Structure Optimization” or “GGA+U Structure Optimization” timization” task types as of Feb 8, 2021. The snapshots that have a final energy per atom greater than 50 eV atom−1^{-1} or atom distance less than 0.5 Å were excluded, since those tend to be the result of errors in the initial input structure. In total, this “MPF.2021.2.8” dataset contains 187,687 ionic steps of 62,783 compounds, with 187,687 energies, 16,875,138 force components, and 1,689,183 stress components. The dataset covers an energy, force and stress range of [-28.731, 49.575] eV atom−1^{-1}, [-2570.567, 2552.991] eV Å−1^{-1} and [-5474.488, 1397.567] GPa, respectively (Figure 2a,Figure 2b). The majority of structures have formation energies between -5 and 3 eV atom−1^{-1}, as shown in Figure S3. While the distribution of forces is relatively symmetric, the stress data contains a slightly higher proportion of negative (compressive) stresses than positive stresses due to the well-known tendency of the PBE functional to underbind. The radial distribution function g(r)g(r) (Figure 2c) shows that the dataset also spans a broad range of interatomic distances, including small distances of less than 0.6 Å that are essential for the M3GNet model to learn the repulsive forces at close distances. The dataset

Figure 2. The distribution of the MPF.2021.2.8 dataset. Structural energy per atom versus force components (a) and stress components (b) distributions. c, The radial distribution function g(r)g(r) and pair atom distance distribution density. The short distance (<1.1<1.1 Å) density is made of mostly hydrogen bonded with O, C and N, illustrated in the inset. d, Element counts for all atoms in the dataset, covering 89 elements across the periodic table.

Formation energy distribution of the MPF.2021.2.8 dataset

Figure S3. Formation energy distribution of the MPF.2021.2.8 dataset

encompasses 89 elements of the periodic table. More information about the MPF.2021.2.8 data distribution is provided in Table S1. This dataset is then split into the training, validation and test data in the ratio of 90%, 5% and 5%, respectively, according to materials not data points. Three independent data splits were performed.

TargetMeanStdMinMax[0.25, 0.5, 0.75] Quantile
EE (eV atom−1^{-1})-5.9751.860-28.73149.575[-7.081, -6.191, -4.938]
ff (eV Å−1^{-1})0.03.395-2570.5672552.991[-0.033, 0.0, 0.033]
σ\sigma (GPa)-0.83325.13-5474.4881397.567[-0.049, 0, 0.006]

Table S1. The mean, standard deviation, min, max and quantiles of the MPF.2021.2.8 dataset.

In principle, an IAP can be trained on only energies, or a combination of energies and forces. In practice, the M3GNet IAP trained only on energies (M3GNet-EE) was unable to achieve reasonable accuracies for predicting either forces or stresses, with mean absolute errors (MAEs) great than even the mean absolute deviation of the data (Table S2). This is the result of the amplification of errors when calculating the derivatives when only energy data is used. The M3GNet models trained with energies + forces (M3GNet-EFEF) and energies + forces + stresses (M3GNet-EFSEFS) achieved relatively similar energy and force MAEs, but the MAE in stresses of the M3GNet-EFSEFS was about half that of the M3GNet-EFEF model. Accurate stress predictions are necessary for applications that involve lattice changes, such as structural relaxations or NpTNpT molecular dynamics (MD) simulations. Our results suggest that it is critical to include all three properties (energy, force, and stress) in the model training to obtain a practical IAP. The final M3GNet-EFSEFS IAP (henceforth, referred to simple as the M3GNet model for brevity) achieved an average of 0.035 eV atom−1^{-1}, 0.072 eV Å−1^{-1}, and 0.41 GPa for energy, force, and stress test MAE, respectively.

ModelEnergy (meV atom−1^{-1})Force (meV Å−1^{-1})Stress (GPa)
MAD1345.6270.32.068
M3GNet-EE41.7±2.141.7 \pm2.1379.4±48.7379.4 \pm48.715.05±2.6315.05 \pm2.63
M3GNet-EFEF34.0±2.934.0 \pm2.970.2±1.770.2 \pm1.70.80±0.120.80 \pm0.12
M3GNet-EFSEFS34.7±3.134.7 \pm3.171.7±1.171.7 \pm1.10.41±0.010.41 \pm0.01

Table S2. Mean absolute errors (MAEs) of M3GNet models trained on energy, energy and force, and energy, force, and stress of the MPF.2021.2.8 data. Three models were trained, using energy-only (M3GNet-EE), energy and force (M3GNet-EFEF), and energy, force and stress (M3GNet-EFSEFS). Each error metric is calculated from the mean of three independent model trainings.

We further investigated the test error distributions of one final M3GNet model. Generally, the model predictions and the DFT ground truth match well as revealed by the high linearity and the R2R^2 values for the linear fitting between DFT and model predictions (Figure 3a-Figure 3c) The cumulative distribution of the model errors indicate that 50% of the data has energy, force, and stress errors lower than 0.01 eV atom−1^{-1}, 0.033 eV Å−1^{-1} and 0.042 GPa, respectively (Figure 3d-Figure 3f). Even more stringent tests were carried out using phonon and elasticity calculations, which were not part of the original training data. The M3GNet model can reproduce accurate phonon dispersion curves and density of states (DOS) of β\beta-cristobalite, stishovite, and α\alpha-quartz SiO2_2 (Figure S4) to quantitative agreements with expensive DFT computa丁香五月

Figure 3. The model predictions on the test dataset compared to DFT calculations. a-c, The parity plots for energy, force and stress, respectively. The model predicted results are E^\hat{E}, f^\hat{f}, and σ^\hat{\sigma}. The dashed lines are y=xy=x as guides for the eye. d-e, The cumulative distribution of errors for energy, force and stress, respectively. The horizontal dashed lines indicate the model errors, from bottom to top, at 50%, 80% and 95%. g, The comparison between model calculated 1,521 phonon density of state (DOS) center data (ω^\hat{\omega}) and the PBEsol DFT calculations (ωˉ\bar{\omega}) from Petretto et al. 34 and h, the 11,848 Debye temperatures (excluding negative moduli) calculated from M3GNet model (T^Debye\hat{T}_{\mathrm{Debye}}) and PBE DFT elastic tensors from de Jong et al. 35

M3GNet-calculated phonon band structure examples for SiO₂ polymorphs

Figure S4. M3GNet-calculated phonon band structure examples for SiO2SiO_2 polymorphs. (a) The band structures for the β\beta-cristobalite, stishovite, and α\alpha-quartz structures, and their corresponding density of states (DOS) calculated from M3GNet using 2×2×22 \times2 \times2 supercells. (b) The same calculations by DFT using the PBEsol functional from Petretto et al.[7] The M3GNet results show quantitative agreements with DFT. Panel (b) is reprinted under the terms of Creative Commons Attribution 4.0 International License. Copyright 2018,

tions.34 The M3GNet phonon DOS centers ωˉ\bar{\omega} from phonon calculations using predicted forces and the frozen phonon approach are also in good agreement with DFT computed values with a MAE of 44.2 cm−1^{-1} (Figure 3g).34 The systematic underestimation by the M3GNet model relative to DFT is likely due to the different choices of pseudopotentials; the DFT phonon calculations were performed using the PBEsol36 functional while the M3GNet training data comprised of PBE/PBE+U calculations.37,38 This systematic underestimation can be corrected with a constant shift of 31.6 cm−1^{-1} and the MAE reduces to 28.8 cm−1^{-1}. Such errors are even lower than a state-of-the-art phonon DOS peak position prediction model which reported MAE of 36.9 cm−1^{-1}.39 We note that the DOS peak prediction model does not exhibit a systematic shift as it was directly fitted on the data by minimizing a mean-squared error. Similar to DFT, the relationship ωˉ∝1/(mˉ)2\bar{\omega} \propto1/(\bar{m})^{2}, where mˉ\bar{m} is the average atomic mass, is obtained (Figure S5). The M3GNet-calculated Debye temperatures are less accurate (Figure 3h), which can be attributed to relative poor M3GNet predictions of the shear moduli (R2=0.134R^2 = 0.134) (Figure S6), though the the bulk moduli predictions (R2=0.757R^2 = 0.757) are reasonable.

Predicted phonon DOS center as a function of the average atomic mass

Figure S5. The predicted phonon DOS center as a function of the average atomic mass mˉ=(1n∑kMk)2\bar{m} = \left(\frac{1}{n}\sum_k \sqrt{M_k}\right)^2, colored by the ratio between the minimal atomic mass mmin⁡m_{\min} and mˉ\bar{m}. The fitted line follows the trend ω∝1/(mˉ)2\omega\propto1/(\bar{m})^2. The results are in quantitative agreement with the work by Petretto et al. [7].

Scatter plots comparing bulk and shear moduli calculated by M3GNet and DFT

Figure S6. The bulk and shear moduli calculated by the M3GNet compared to DFT. The agreement in bulk moduli (a) is better than shear moduli (b).

The M3GNet model was then applied in a simulated materials discovery workflow where the final DFT structures are not known a priori. M3GNet relaxations were carried out on the initial structures from the test dataset of 3,140 materials. M3GNet relaxation yields crystals that have volumes much closer to the DFT reference volumes (Figure 4a). While 50% and 5% of the initial input structures have volumes that differ from the final DFT relaxed crystals by more than 2.4% and 22.2%, respectively, these errors are reduced to 0.6% and 6.6% via M3GNet relaxation. Correspondingly, the errors in the predicted energies E^\hat{E} are also much smaller (Figure 4b). Using the initial structures for direct model predictions, the energy differences distribute broadly, with considerable amount of structures having errors larger than 0.1 eV atom−1^{-1}. All errors here were calculated relative to the DFT energies of the final DFT-relaxed structures for each material. The overall MAE is 0.169 eV atom−1^{-1} with ∼20%\sim20\% of the structures having errors greater than 0.071 eV atom−1^{-1} (Figure 4b). These errors are far too large for reliable estimations of materials stability, given that 90% of all inorganic crystals in the ICSD has an energy above the convex hull of less than 0.067 eV atom−1^{-1}. 40 In contrast, energy calculations on the M3GNet-relaxed structures yield a MAE of 0.035 eV atom−1^{-1} and 80% of the materials have errors less than 0.028 eV atom−1^{-1}. The error distributions using M3GNet relaxed structures are close to the case where we know the DFT final structures, as shown in Figure 4b, suggesting that M3GNet potential can be accurate in helping getting the correct structures. In general, relaxations with M3GNet converges rapidly, as shown in Figure S7. An example of M3GNet relaxation is shown in Figure S8 for K57_{57}Se34_{34} (mp-685089), a material with one of the largest energy change during relaxation. Convergence is achieved after about 100 steps when the forces falls under 0.1 eV Å−1^{-1}. The X-ray diffraction (XRD) pattern of the M3GNet-relaxed structure also resembles the counterpart from DFT relaxation (Figure S8). This relaxation can be performed on a laptop in about 22 seconds on a single CPU core of Intel(R) Xeon(R) CPU E5-2620 v4 @ 2.10GHz, while the corresponding DFT relaxation took 15 hours on 32 cores in the original Materials Project calculations.

Figure 4. Relaxation of crystal structures with M3GNet. a, Distribution of the absolute percentage error in volumes of M3GNet-relaxed structures relative to DFT-relaxed structures. b, The differences between M3GNet-predicted energies E^\hat{E} and ground state (gs) energies EgsE_{\mathrm{gs}} using the initial, M3GNet-relaxed and DFT-relaxed structures. EgsE_{\mathrm{gs}} is defined as the DFT energy of the DFT-relaxed crystal. The horizontal lines mark the 50th, 80th, and 95th percentiles of the distributions and the corresponding xx axis values are annotated.

Relaxation convergence plot of MAE versus Step

Figure S7. Relaxation convergence. The MAE between model calculated energies during relaxation and the final DFT energies as a function of M3GNet relaxation steps.

A structural relaxation example using the model compared to DFT

Figure S8. A structural relaxation example using the model compared to DFT. a-c, The energy, force, and stress evolution during the model optimization, compared to the DFT relaxation for mp-685089 K57Se34K_{57}Se_{34}. d-e. The lattice constant and angle changes during relaxation compared to the final DFT structure (dashed lines). f. The average atom distances to their final positions. g. The X-ray diffraction pattern of the initial structure, and the ones for the DFT relaxed final structure and model relaxed final structure.

New Materials Discovery

The ability of M3GNet to accurately and rapidly relax arbitrary crystal structures and predict their energies makes it ideal for large-scale materials discovery. To generate hypothetical materials, combinatorial isovalent ionic substitutions based on the common oxidation states of non-noble-gas element were performed on 5,283 binary, ternary and quaternary structural prototypes in the 2019 version of the ICSD33 database. Only prototypes with less than 51 atoms were selected for computational speed considerations. Further filtering was performed to exclude structures with non-integer or zero-charged atoms. A total of 31,664,858 hypothetical materials candidates were generated, more than 200 times the total number of unique crystals in the Materials Project today. All structures were relaxed using the M3GNet model and their signed energy distance to the Materials Project convex hull were calculated using the M3GNet IAP-predicted energy (Ehull−mE_{\mathrm{hull-m}}). We acknowledge that some of the generated structures may compete with each other for stability. However, to avoid introducing additional uncertainties into the Ehull−mE_{\mathrm{hull-m}} predictions, we have elected to compute Ehull−mE_{\mathrm{hull-m}} relative to ground-truth DFT energies in the Materials Project as opposed to the higher uncertainty M3GNet-computed energies. A zero or negative EhullE_{\mathrm{hull}} means that the material is predicted to be potentially stable compared to known materials in MP. The more negative the EhullE_{\mathrm{hull}}, the greater the probability that a material is likely to be stable after accounting for uncertainties in the M3GNet-predicted energies. In total, 1,849,096 materials have Ehull−mE_{\mathrm{hull-m}} less than 0.001 eV atom−1^{-1}. We then excluded materials that have non-metal ions in multiple valence states, e.g., materials containing Br+\mathrm{Br}^{+} and Br−\mathrm{Br}^{-} at the same time, etc. It is well-known that PBE overbinds single-element molecules such as O2\mathrm{O}_2, S8\mathrm{S}_8, Cl2\mathrm{Cl}_2, etc. and negative anion energy corrections are applied to ionic compounds in Materials Project to offset such errors. 41 However the corrections are based mostly on composition, which may artificially over-stabilize materials with multi-valence non-metal ions. We have developed a searchable database for the generated hypothetical structures and their corresponding M3GNet-predicted properties at http://matterverse.ai.

A formation energy model based on the Matbench39 Materials Project data was developed using the same architecture as the M3GNet IAP model (see Table S3). Materials with a difference in the signed energy distance to the Materials Project convex hull from this model (Ehull−fE_{\mathrm{hull-f}}) and Ehull−mE_{\mathrm{hull-m}} greater than 0.2 eV atom−1^{-1} were then discarded in the subsequent DFT analysis. This additional step removes materials with higher energy prediction uncertainties, which account for 13.1% (243,820) of the predicted materials. It should be noted that this step can also be omitted to simplify the discovery workflow, though potentially with impact on the hit rate of stable materials discovery. The top-1000 lowest Ehull−mE_{\mathrm{hull-m}} materials from any chemistry as well as the top-1000 metal oxides with elements from the first five rows (excluding Tc due to radioactivity and Rb due to high dominance) were then selected for validation via DFT relaxation and energy calculations. Only the most stable polymorphs were selected for each composition. It was found that the distribution in the DFT calculated Ehull−dftE_{\mathrm{hull-dft}} matches well with the distributions of Ehull−mE_{\mathrm{hull-m}} (Figure 5a). For most computational materials discovery efforts, a positive threshold, typically around 0.05-0.1 eV atom−1^{-1}, is applied to identify synthesizable materials. This positive threshold accounts for both errors in DFT calculated energies as well as the fact that some thermodynamically meta-stable materials can be realized experimentally. Of the top-1000 materials from any chemistry, 999 were found to have a Ehull−dft<0.001E_{\mathrm{hull-dft}} < 0.001 eV atom−1^{-1} (Figure 5b) and none of them were in the Materials Project database. For the top-1000 oxides, 579, 826, and 935 were found to be synthesizable based on Ehull−dftE_{\mathrm{hull-dft}} thresholds of 0.001, 0.05 and 0.1 eV atom−1^{-1}, respectively (Figure 5b). Out of the 579 DFT-stable oxides, only five, namely Mg4Nb2O9\mathrm{Mg}_{4}\mathrm{Nb}_{2}\mathrm{O}_{9}, Sr3V2O8\mathrm{Sr}_{3}\mathrm{V}_{2}\mathrm{O}_{8}, K2SnO2\mathrm{K}_{2}\mathrm{SnO}_{2}, Cd(RhO2)2\mathrm{Cd}(\mathrm{RhO}_{2})_{2}, CoMnO4\mathrm{CoMnO}_{4}, were previously known and matched with the Materials Project structures. The effectiveness of the M3GNet IAP relaxations can be seen in Figure S9, which show that the energy changes during subsequent DFT relaxations (of the MEG3Net-relaxed structures) are at least one order of magnitude smaller than the energy changes during M3GNet relaxation. The final M3GNet-relaxed energies are in excellent agreement with the final DFT-relaxed energies, with MAEs of 0.112 and 0.045 eV atom−1^{-1} for the top 1000 materials in any chemistry and the oxide chemistry, respectively (Figure 5c-Figure 5d). Using the M3GNet IAP, we have also assessed the dynamic stability of the 1578 materials with Ehull−dft<0.001E_{\mathrm{hull-dft}} < 0.001 eV atom−1^{-1} using phonon calculations. A total of 328 materials do not exhibit imaginary frequencies in their M3GNet phonon dispersion curves. Four phonon dispersion curves are shown in Figure 6. The others are provided in Data Availability.

Figure 5. Discovery of stable materials using M3GNet. a, The signed EhullE_{\mathrm{hull}} distribution for the top-1000 lowest Ehull−mE_{\mathrm{hull-m}} materials from any chemistry (All) and oxides only (Oxides). b, Fraction of materials below Ehull−dftE_{\mathrm{hull-dft}} among top-1000 materials in the All and Oxides categories. c, d, Plot of the final M3GNet predicted energy against final DFT energy for the (c) All and (d) Oxides categories.

M3GNet-calculated phonon dispersion curves of four new materials

Figure 6. M3GNet-calculated phonon dispersion curves of four new materials predicted to be thermodynamically and dynamically stable. a, Sr6Sc2Al4O15\mathrm{Sr}_{6}\mathrm{Sc}_{2}\mathrm{Al}_{4}\mathrm{O}_{15}; b, K2Li3AlO4\mathrm{K}_{2}\mathrm{Li}_{3}\mathrm{AlO}_{4}; c, KMn4V2O12\mathrm{KMn}_{4}\mathrm{V}_{2}\mathrm{O}_{12}; d, MnCd(GaO2)4\mathrm{MnCd}(\mathrm{GaO}_{2})_{4}

Distribution of energy changes during M3GNet and DFT relaxations

Figure S9. Distribution of energy changes during M3GNet and DFT relaxations. a, M3GNet energy changes during M3GNet relaxation for materials in All category. b, DFT energy changes in subsequent DFT relaxations for materials in All category. c-d, same plots as a-b but on the Oxide category.

Target, Data SizeM3GNetMOD-Net[16]AtomSets-V1V_{1}17MEG-Net[14, 18]AutoMat-miner[14]
Regression Tasks
EexfoliationE_{\mathrm{exfoliation}} (meV atom−1^{-1}), 636b^{b}50.1±\pm11.934.540±\pm555.938.6
PhonDOS Peak (cm−1^{-1}), 1265c^{c}34.1±\pm4.538.7554±\pm936.950.8
nn, 4764e^{e}0.312±\pm0.0630.2970.46±\pm0.030.4780.299
log⁡(KVRH)\log(K_{VRH}) (GPa), 10987f^{f}0.058±\pm0.0030.05480.07±\pm0.000.07120.0679
log⁡(GVRH)\log(G_{VRH}) (GPa), 10987g^{g}0.086±\pm0.0020.07310.09±\pm0.000.09140.0849
Perovskite EfE_f (meV atom−1^{-1}), 18928h^{h}6.6±\pm0.2-12±\pm08.338.8
MP EgE_g (eV), 106113i^{i}0.183±\pm0.005-0.25±\pm0.010.2350.282
MP EfE_f (meV atom−1^{-1}), 132752j^{j}19.5±\pm0.2-44±\pm133.2173
Classification Tasks
MP Metallicity, 106113m^{m}0.958±\pm0.001-0.96±\pm0.000.9770.909

Table S3. Performance of M3GNet models on crystal property predictions compared to other state-of-the-art models using the same test sets as the AutoMatminer work.[14] Mean absolute error (MAE) for regression tasks and area-under-curve (AUC) of receiver operating characteristic curve for classification tasks are used as the model metrics. The lowest errors are highlighted with bold fonts.

As an additional evaluation of the performance of M3GNet for materials discovery, we computed the discovery rate, i.e., the fraction of DFT-stable materials (Ehull−dft≤0E_{\mathrm{hull-dft}} \le0) for 1000 structures uniformly sampled from the ∼1.8\sim1.8 million materials with Ehull−m<0.001E_{\mathrm{hull-m}} < 0.001 eV atom−1^{-1}. The discovery rate remains close to 1.0 up to a Ehull−mE_{\mathrm{hull-m}} threshold of around 0.5 eV atom−1^{-1} and remains at a reasonably high value of 0.31 at the strictest threshold of 0.001 eV atom−1^{-1}, as shown in Figure S10. For this material set, we also compared the DFT relaxation time cost with and without M3GNet pre-relaxation. The results show that without M3GNet pre-relaxation, the DFT relaxation time cost is about three times of that with the M3GNet relaxation, as shown in Figure S11.

Stable ratio as a function of $E_{\mathrm{hull-m}}$ threshold

Figure S10. DFT stable ratio as a function of Ehull−mE_{\mathrm{hull-m}} threshold for a uniform sample of 1000 structures.

Histogram of DFT acceleration with M3GNet pre-relaxation

Figure S11. DFT acceleration with M3GNet pre-relaxation.

Discussion

A universal IAP such as M3GNet has applications beyond crystal structure relaxation and stability predictions. For instance, a common application of IAPs is in molecular dynamics (MD) simulations to obtain transport properties such as diffusivity and ionic conductivity. The Arrhenius plot from MD simulations at multiple temperatures of the recently discovered Li3_3YCl6_6 superionic conductor is shown in Figure S12. The results agree well with the ionic conductivity and activation barriers from previous ab initio MD simulations.42 Training an IAP for a complex multi-component systems such as Li3_3YCl6_6 is typically a highly-involved process,43 while the M3GNet IAP can be universally applied to any material without further retraining. As shown in Figure S13, M3GNet MD calculations can potentially be applied to a wide range of Li-containing compounds to identify potential lithium superionic conductors.

M3GNet MD results on Li3YCl6

Figure S12. M3GNet MD results on Li3_3YCl6_6. a-c the mean-squared displacements (MSDs) for Li, Y and Cl, respectively, at temperatures ranging from 250 K to 1200 K at 50 K intervals. The material was found to melt at temperatures between 950 K and 1000 K, as shown by the sudden increase of MSD for framework ions Y and Cl. d The Arrhenius plot of the Li conductivity using M3GNet vs AIMD simulations from Wang et al. [9]. The M3GNet activation energy of 0.22 eV and extrapolated room temperature conductivity of 14.3 mS cm−1^{-1} compare well with the AIMD values of 0.19 eV and 14 mS cm−1^{-1}.

Mean squared displacements of short-time M3GNet molecular dynamics simulations

Figure S13. Mean squared displacements (MSDs) of short-time M3GNet molecular dynamics simulations. a, The distributions of 800 K and 1200 K MSDs for all Li-containing compounds passing the filtering criteria, supplemented by manual entries. The dashed line has a slope of 7, and materials below this line have desired Li diffusion energy barrier lower than 0.4 eV. b, the MSDs at 800 K projected onto the anion types. c, the MSDs at 800 K projected onto the anion groups.

Furthermore, the M3GNet IAP can also serve as a surrogate model in lieu of DFT with other structural exploration techniques such as evolutionary algorithms like USPEX44 and CALYPSO45 or generative models such as CDVAE46 to generate more diverse and unconstrained candidates.

It should be noted that the current M3GNet IAP reported in this work is merely the best that can be done at present with available data. Further improvements in accuracy can be achieved through several efforts. First, the training data for the M3GNet IAP comes from DFT relaxation calculations in the Materials Project, which were performed with less stringent convergence criteria such as a lower energy cutoff and sparser kk-point grids. For IAP development, a best practice is to obtain accurate energies, forces and stresses via single-point, well-converged DFT calculations for training data. Building such a database is an extensive effort that is planned for future developments in the Materials Project. Second, active learning strategies, for instance, by using the DFT relaxation data from the M3GNet-predicted stable crystals in a feedback loop, can be used to systematically improve the M3GNet IAP, especially in under-explored chemical spaces with the greatest potential for novel materials discoveries. Nevertheless, about 1.8 million of the 31 million candidates were predicted to be potentially stable or meta-stable by M3GNet against materials in the Materials Project, which already expands the potential exploration pool by an order of magnitude over the ∼\sim140,000 crystals in the Materials Project database today. We shall note that the potentially stable materials will need to be further verified with DFT calculations and experimental synthesis.

The model uncertainty will also play a role in further decreasing the number of true discoveries. The candidate space contains 294,643 chemical systems, while the Materials Project has only about 47,000 chemical systems. Hence, we likely see many extrapolations in the predictions. For example, some of the most uncertain predictions are from chemical systems such as F-Fe-Se-W, F-Fe-S-W, F-Fe-Te-W, F-Ni-S-W, and Co-F-S-W, which are not represented in the Materials Project training data.

Finally, the M3GNet framework is not limited to crystalline IAPs or even IAPs in general. The M3GNet formalism without lattice inputs and stress outputs is naturally suited for molecular force fields. When benchmarked on MD17 and MD17-CCSD(T) molecular force field data (Table S4 and Table S5), 47–49 the M3GNet models were found to be more accurate than the embedded atom neural network (EANN) force field50 and perform similarly to the state-of-the-art message-passing networks and equivariant neural network models. Moreover, by changing the readout section from summed atomic energy as in Figure 1 to intensive property readout, the M3GNet framework can be used to develop surrogate models for property prediction. We trained M3GNet models on the Matbench materials data covering nine general crystal materials properties (Table S3). 39 In all cases, the M3GNet models achieved excellent accuracies.

MoleculeM3GNetEANN22^{22}sGDML21^{21}DimeNet23^{23}NequIP24^{24}PaiNN25^{25}
Aspirin7.8, 18.814.1, 43.08.4, 29.48.8, 21.6-, 15.17.2, 14.7
Benzene[19]3.5, 8.1-3.1, 8.83.4, 8.1-, 8.1-
Benzene[21]4.0, 1.9-4.2, 2.4--, 2.3-
Ethanol2.4, 5.34.4, 20.33.1, 14.52.8, 10.0-, 9.02.8, 9.7
Malonaldehyde3.4, 9.55.9, 26.94.3, 18.04.5, 16.6-, 14.64.3, 14.9
Naphthalene5.1, 5.46.1, 22.35.0, 4.95.3, 9.3-, 10.35.0, 3.3
Salicylic acid5.1, 10.16.1, 22.35.0, 12.25.8, 16.2-, 4.25.0, 8.5
Toluene4.0, 4.74.8, 16.64.2, 6.24.4, 9.4-, 4.44.1, 4.1
Uracil4.5, 7.04.8, 15.34.7, 10.55.0, 13.1-, 7.54.6, 6.0

Table S4. Performance of M3GNet models compared to the existing models on the MD17 datasets. In each cell, the errors are reported in mean absolute error (MAE) and are written in energy (meV), force (meV Å−1^{-1}) pairs. The M3GNet results were obtained by average of three independent model fitting using different random seeds for data splitting. The lowest errors are highlighted by bold fonts.

MoleculeM3GNetsGDML [21]PhysNet [26]NequIP [24]
Aspirin6.0, 19.76.8, 33.0--, 14.7
Azobenzene7.5, 12.24.0, 17.78.5, 20.1-
Benzene0.15, 1.060.13, 1.8--, 0.8
Ethanol0.92, 5.512.2, 15.0--, 9.4
Malonaldehyde1.3, 8.21.6, 10.7--, 16.0
Paracetamol6.6, 14.56.6, 21.37.9, 22.5-
Toluene1.0, 5.51.3, 8.9--, 4.4

Table S5. Performance of M3GNet models compared to the existing models on the MD17 CCSD/CCSD(T) datasets. [19, 21] In each cell, the errors are reported in mean absolute error (MAE) and are written in energy (meV), force (meV A˚−1\mathrm{\AA}^{-1}) pairs. The M3GNet results were obtained by average of three independent model fitting using different random seeds for data splitting. The lowest errors are highlighted by bold fonts.

Correspondence Correspondence and requests for materials should be addressed to C.C. (email: [email protected]) or S.P.O. (email: [email protected]).

Acknowledgement

This work was primarily supported by the Materials Project, funded by the U.S. Department of Energy, Office of Science, Office of Basic Energy Sciences, Materials Sciences and Engineering Division under contract no. DE-AC02-05-CH11231: Materials Project program KC23MP. The lithium superionic conductor analysis portion of the work was funded by the LG Energy Solution through the Frontier Research Laboratory (FRL) Program. This work used the Extreme Science and Engineering Discovery Environment (XSEDE), which is supported by National Science Foundation grant number ACI-1548562.

Author contributions

C.C. and S.P.O. conceived the idea and designed the work. C.C. implemented the models and performed the analysis. C.C. and S.P.O. wrote the manuscript and contributed to the discussion and revision.

Ethics Declaration

Competing Interests

The authors declare that they have no competing financial interests.

Methods

Model construction

Neural network definition

If we denote one layer of the perceptron model as

Lgk:x↦g(Wkx+bk)(7)\mathcal{L}_{g}^{k}: x \mapsto g(\mathbf{W}_{k}x+\mathbf{b}_{k}) \tag*{(7)}

then the KK-layer multi-layer perceptron (MLP) can be expressed as

ξK(x)=(LgK∘LgK−1∘…Lg1)(x)(8)\xi_{K}(x)=\left(\mathcal{L}_{g}^{K}\circ\mathcal{L}_{g}^{K-1}\circ\ldots\mathcal{L}_{g}^{1}\right)(x) \tag*{(8)}

The KK-layer gated MLP becomes

ϕK(x)=((LgK∘LgK−1∘…Lg1)(x))⊙((LσK∘LgK−1∘…Lg1)(x))(9)\phi_{K}(x)=\left(\left(\mathcal{L}_{g}^{K}\circ\mathcal{L}_{g}^{K-1}\circ\ldots\mathcal{L}_{g}^{1}\right)(x)\right)\odot\left(\left(\mathcal{L}_{\sigma}^{K}\circ\mathcal{L}_{g}^{K-1}\circ\ldots\mathcal{L}_{g}^{1}\right)(x)\right) \tag*{(9)}

where LσK(x)\mathcal{L}_{\sigma}^{K}(x) replaces the activation function g(x)g(x) of LgK(x)\mathcal{L}_{g}^{K}(x) to sigmoid function σ(x)\sigma(x) and ⊙\odot denotes element-wise product. The gated MLP consists of the normal MLP before ⊙\odot and the gate network after ⊙\odot.

Model architecture

Materials graphs were constructed using a radial cutoff of 5 Å. For computational efficiency considerations, the three-body interactions were limited to within a cutoff of 4 Å. The graph featurizer converts the atomic number into embeddings of dimension 64. The bond distances were expanded using the continuous and smooth basis function proposed by Kocer et al., 51 which ensures that the first and second derivatives vanish at the cutoff radius.

hm(r)=1dm[fm(r)+emdm−1hm−1(r)](10)h_m(r) = \frac{1}{\sqrt{d_m}}\left[f_m(r) + \sqrt{\frac{e_m}{d_{m-1}}}h_{m-1}(r)\right] \tag*{(10)}

where

dm=1−emdm−1(11)d_m = 1 - \frac{e_m}{d_{m-1}} \tag*{(11)}
em=m2(m+2)24(m+1)4+1(12)e_m = \frac{m^2(m+2)^2}{4(m+1)^4+1} \tag*{(12)}
fm(r)=(−1)m2πrc3/2(m+1)(m+2)(m+1)2+(m+2)2(sinc⁡(r(m+1)πrc)+sinc⁡(r(m+2)πrc))(13)f_m(r) = (-1)^m\frac{\sqrt{2}\pi}{r_c^{3/2}}\frac{(m+1)(m+2)}{\sqrt{(m+1)^2+(m+2)^2}}\left(\operatorname{sinc}\left(r\frac{(m+1)\pi}{r_c}\right)+\operatorname{sinc}\left(r\frac{(m+2)\pi}{r_c}\right)\right) \tag*{(13)}
sinc⁡(x)=sin⁡xx(14)\operatorname{sinc}(x) = \frac{\sin x}{x} \tag*{(14)}

eij0e_{ij}^{0} is a vector formed by mm basis functions of h(r)h(r).

eij0(rij)=[h1(rij),h2(rij),…,hm(rij)](15)e_{ij}^{0}(r_{ij}) = [h_1(r_{ij}), h_2(r_{ij}), \ldots, h_m(r_{ij})] \tag*{(15)}

In this work, we used three basis functions for the pair distance expansion. The main blocks consist of three three-body information exchange and graph convolutions (N=3N = 3 in Figure 1). By default, the W\mathbf{W}’s and b\mathbf{b}’s in the perceptron model gives output dimensions of 64. Each gated MLP (ϕe(x)\phi_e(x) and ϕe′(x)\phi'_e(x) in Equations (4) and (5)) have two layers with 64 neurons in each layer.

For the prediction of extensive properties such as total energies, a three-layer gated MLP (Equation (9)) was used on the atom attributes after the graph convolution and sum the outputs as the final prediction, i.e.,

pext=∑iϕ3(vi)(16)p_{\mathrm{ext}} = \sum_i \phi_3(\mathbf{v}_i) \tag*{(16)}

The gated MLP ϕ3(x)\phi_3(x) has a layer neuron configuration of [64, 64, 1] and no activation in the last layer of the normal MLP part.

For the prediction of intensive properties, the readout step was performed as follows after the main blocks.

pint=ξ3(∑iwiξ~2(vi)⊕u)(17)p_{\mathrm{int}} = \xi_3\left(\sum_i w_i\widetilde{\xi}_2(\mathbf{v}_i) \oplus\mathbf{u}\right) \tag*{(17)}

with weights wiw_i summing to 1 and defined as

wi=ξ3′(vi)∑iξ3′(vi)(18)w_i = \frac{\xi'_3(\mathbf{v}_i)}{\sum_i \xi'_3(\mathbf{v}_i)} \tag*{(18)}

ξ3\xi_3 and ξ3′\xi'_3 have neuron configurations of [64, 64, 1] to ensure the output is scalar. For regression targets, there is no activation in the final layer of MLP, while for classification targets, the last layer activation is chosen as the sigmoid function.

In the training of MPF.2021.2.8 data, the M3GNet model contains three main blocks with 227,549 learnable weights.

Model training

The Adam optimizer52 was used with initial learning rate of 0.001, with a cosine decay to 1% of the original value in 100 epochs. During the optimization, the validation metric values were used to monitor the model convergence, and training was stopped if the validation metric did not improve for 200 epochs. For the elemental IAP training, the loss function was the mean squared error (MSE). For other properties, the Huber loss function53 with δ\delta set to 0.01 was used. For the universal IAP training, the total loss function includes the loss for energy, forces, and, in inorganic compounds, also the stresses. Batch size of 32 was used in model training.

L=ℓ(e,eD)+wfℓ(f,fD)+wσℓ(σ,σD)(19)L = \ell(e,e_D) + w_f\ell(\mathbf{f},\mathbf{f}_D) + w_\sigma\ell(\boldsymbol{\sigma},\boldsymbol{\sigma}_D) \tag*{(19)}

where ℓ\ell is the Huber loss function, ee is energy per atom, f\mathbf{f} is the force vector, σ\boldsymbol{\sigma} is the stress, and ww’s are the scalar weights. The subscript DD indicates data from DFT.

Before M3GNet IAP fitting, we fit the elemental reference energies using linear regression of the total energies. We first featurize a composition into a vector c=[c1,c2,c3,…,c89]\mathbf{c} = [c_1,c_2,c_3,\ldots,c_{89}] where cic_i is the number of atoms in the composition that has the atomic number ii. The composition feature vector c\mathbf{c} is mapped to the total energy of the material EE via E=∑iciEiE = \sum_i c_i E_i, where EiE_i is the reference energy for element with atomic number ii that can be obtained by linear regression of the training data. Then, the elemental reference energies were subtracted from the total energies to improve M3GNet model training stability. We set wf=1w_f = 1 and wσ=0.1w_\sigma= 0.1 during training the MPF.2021.2.8 data.

Software implementation

The M3GNet framework was implemented using the Tensorflow54 package. All crystal and molecular structure processing were performed using the Python Materials Genomics (pymatgen)[16] package. The structural optimization was performed using the FIRE55 algorithm implemented in the atomic simulation environment (ASE).56 The MD simulations were performed in the NVTNVT ensemble using ASE.56 Phonon calculations were performed using the Phonopy package.57

Data Availability

The training data for the universal IAP is available at http://doi.org/10.6084/m9.figshare.19470599. The phonon dispersion curves of 328 dynamically stable materials are available at http://doi.org/10.6084/m9.figshare.20217212. All generated hypothetical compounds and their corresponding M3GNet predictions are provided at http://matterverse.ai.

Code Availability

The source code for M3GNet is available at https://github.com/materialsvirtuallab/m3gnet.

Supplementary Information

Characteristics of M3GNet models

Long-range interactions

Different from the MLIAPs, M3GNet can simulate long-range interaction by stacking graph convolution layers without increasing the cutoff radius. To compare the long-range behavior, we used a model system MgO. The ion interactions in the test MgO system are described by the Buckingham potential with long-range electrostatics.

Vij=Aijexp⁡(−rij/ρij)−Cijrij6+Kqiqjεrij(20)V_{ij}=A_{ij}\exp\left(-r_{ij}/\rho_{ij}\right)-\frac{C_{ij}}{r_{ij}^{6}}+\frac{Kq_iq_j}{\varepsilon r_{ij}} \tag*{(20)}

where AijA_{ij}, ρij\rho_{ij} and CijC_{ij} are the Buckingham potential parameters, qiq_i is the charge for atom ii, KK is the energy-conversion constant and ε\varepsilon is the dielectric constant.

We used the MgO Buckingham potential to simulate the material and generate the long-range force field data. The parameters were take from the work by Shukla et al. [1]

We took the MgO (mp-1265) structure from the Materials Project [2] as the initial structure. Then we applied -0.1, 0.1, and 0.2 isotropic strains to the structures, producing a total of four structures. For each structure, we randomly displace the atoms up to 0.5 A˚0.5\,\text{\AA} in each direction for 100 times, producing a total of 400 structures for the MgO data set. The data is split into 80%-20% train-test data. Energies and forces are calculated using the potential described in the previous section using LAMMPS[3] by setting the short-range interaction cutoff as 10 A˚10\,\text{\AA} and carrying out long-range calculations using the Ewald summation. [4]

M3GNet and MTP models with cutoffs of 5 A˚5\,\text{\AA} were trained on the train data and evaluated on the test data. We calculated the equation of state (EOS) for MgO using different computational methods, as shown in Figure S1. The M3GNet in this work outperforms the MTP in extrapolation outside of the training data regimes in general.

The probe the interaction reach, we adopted the locality tests following the ideas proposed by Bartók et al. [5] and reiterated by Deringer and Csányi[6]. For the MgO cubic conventional cell, we produced a 6×6×66 \times6 \times6 super cell, with dimensions 25.54 A˚×25.54 A˚×25.54 A˚25.54\,\text{\AA} \times25.54\,\text{\AA} \times25.54\,\text{\AA}. Then for the Mg atom at the center, we fix the its neighbor atoms within a radius of rlocalr_{local} and introduce random displacements (max 0.2 Å) to the atoms out of rlocalr_{local}. We recorded the forces on the center atom and compute its standard deviation σ(f)\sigma(\mathbf{f}). If σ(f)=0\sigma(\mathbf{f}) = 0 at certain rlocalr_{local}. The interaction described by the computational method is localized within rlocalr_{local}.

fig:S1b shows the σ(f)\sigma(\mathbf{f}) as a function of rlocalr_{local} for Buckingham with Coulombic forces, MTP, and M3GNet in this work. As expected, the Buckingham potential with long-range force is highly non-local, with large σ(f)\sigma(\mathbf{f}) even at rlocal=10r_{local} = 10 Å. The M3GNet in this work shows similar long range behavior and has non-zero σ(f)\sigma(\mathbf{f}) at rlocal=10r_{local} = 10 Å. On the contrary, the interaction of MTP is localized, with σ(f)\sigma(\mathbf{f}) vanishing at 2rc=102r_c = 10 Å. It should be noted that while the MTP interactions in terms of energy is limited to rcr_c, the force impact goes to 2rc2r_c because the forces are calculated as follows:

fi=−Eri=−∑jEjri(21)\mathbf{f}_i = -\frac{E}{r_i} = -\sum_j \frac{E_j}{r_i} \tag*{(21)}

Although all jj in Equation 2 is within rcr_c of atom ii, for an atom jj at the boundary close to rcr_c, the atom kk that is 2rc2r_c away from ii can also contribute to EjE_j. Hence the force fi\mathbf{f}_i will be affected by atom kk that is 2rc2r_c away. Nevertheless, the force locality for MTP beyond rcr_c is relatively minimal and vanishes completely at 2rc2r_c.

In conclusion, the M3GNet model proposed in this work is able to capture long-range interactions well beyond the set cutoff radius.

Potential smoothness

A critical requirement of an interatomic potential is its prediction smoothness across changes in structures. Figure S2 shows that by applying strains to a Ni cell, the energy, forces, and stresses all change smoothly despite non-smooth changes of the number of bonds defined within a cutoff of 5 A˚5\,\text{\AA}.

MPF.2021.2.8 distribution and M3GNet fitting using different targets

The MPF.2021.2.8 data distribution is shown in Table S1.

M3GNet dynamic properties calculations

The phonon dispersion curves and density of state (DOS) calculations for SiO2_2 polymorphs are shown in Figure S4, where the M3GNet calculated results in Figure S4 are in good agreements with the DFT calculations in Figure S4, yet the M3GNet calculations took only seconds to run, which are at least four orders of magnitude faster than the DFT calculations.

The model calculations used a frozen phonon approach while the original calculations used DFPT. The frozen phonon approach requires larger supercells to produce long wavelength behavior. The supercell size difference also explains the differences in the number of bands. The DOS center versus average atomic mass results in Figure S5 are also in agreement with DFT results.

The bulk moduli and shear moduli calculated from M3GNet in comparison with DFT are shown in Figure S6. The bulk moduli matched well with DFT calculations, but the shear moduli were more challenging to match.

M3GNet relaxation for materials discovery

The MAEs as a function of M3GNet relaxation steps are shown in Figure S7, where the MAE dropped to 0.047 eV atom−1^{-1} after about 10 relaxation steps.

An example of M3GNet relaxation is shown in Figure S8. The energy, force, and stress all converged within less than 200 steps. At the same time, the lattice constants, angles and the mean atom distances all converged closed to the equilibrium structures from DFT. The XRD pattern of model-relaxed structures also match with that from DFT-relaxation.

Figure S9 shows the M3GNet energy changes during M3GNet relaxation (ΔEM3GNet−relax\Delta E_{\mathrm{M3GNet-relax}}), and DFT energy changes during DFT relaxation (ΔEDFT−relax\Delta E_{\mathrm{DFT-relax}}). In both all chemistry category (Figure S9-Figure S9) and oxide category (Figure S9-Figure S9), the DFT energy changes are at least one order of magnitude smaller than the M3GNet energy changes, suggesting that M3GNet effectively relaxes the structures close to their equilibrium.

Figure S10 shows the DFT stable ratio for 1000 structures taken uniformly from the total discovery pool of ∼1.8\sim1.8 million structures based on their Ehull−mE_{\mathrm{hull-m}} values. The stable ratio (DFT stable structures / structures below Ehull−mE_{\mathrm{hull-m}} threshold) decreases monotonically with the Ehull−mE_{\mathrm{hull-m}} threshold, and reaches 0.31 at threshold 0.001 eV atom−1^{-1}.

For materials in Figure S10, we compared the DFT relaxation CPU cost with and without M3GNet pre-relaxation, as shown in Figure S11. On average the DFT relaxation CPU cost without M3GNet pre-relaxation is 2.971 times the one with M3GNet pre-relaxation. In other

words, the M3GNet relaxation can accelerate DFT relaxation if one aims to obtain all DFT results.

M3GNet for molecular dynamics simulations

The M3GNet model trained on MPF.2021.2.8 can also be used for molecular dynamics simulations. We chose Li3YCl6\mathrm{Li}_3\mathrm{Y}\mathrm{Cl}_6 as an initial study case from our recent work. [8] The M3GNet calculated mean squared displacements (MSDs) for Li, Y, and Cl show reasonable temperature dependencies, as shown in Figure S12. Interestingly, the M3GNet calculated conductivities matched well with AIMD simulations from Wang et al. [9] The extrapolated room-temperature Li conductivity and the activation energy fitted from the Arrhenius equation also showed excellent agreements.

To demonstrate M3GNet’s utility in screening for unexplored lithium superionic conductors, we performed NVT MD simulations on Li-containing compounds in Materials Project that satisfying the following criteria: 1) energy above hull less than 50 meV atom−1^{-1} and band gap greater than 2 eV, 2) no transition metals other than Sc, Y, Zr and Nb, and 3) alkaline element fraction greater than 10% in the formula. We also manually added a few entries with known conductivities, such as Li3_3Y(PS4_4)2_2, Li5_5P(S2_2Cl)2_2, LiZnPS4_4, LiAl(PS3_3)2_2, studied by Zhu et al., 10 the tetragonal (t)- and cubic (c)-Li$_7$La$_3$Zr$_2$O$_{12}$, Na$_2$B$_2$H$_{12}$, etc. The filtering and additions gave us 837 potential lithium superionic conductors for MD simulations using the short molecular dynamics approach proposed by {citet}Zhu et al., [10] where 25 ps of molecular dynamics are performed on the materials at 800 K and 1200 K temperatures and the MSDs of the diffusive species are recorded.

Figure S13 maps all the Li-containing compounds in our materials pool. The materials on the upper right are desired materials with both high MSDs and low diffusion energy barriers (∝log⁡((MSD−1200K)/(MSD−800K))\propto\log((\mathrm{MSD} - 1200\mathrm{K})/(\mathrm{MSD} - 800\mathrm{K}))). The M3GNet model correctly “re-discovered” known Li superionic conductors such as LiBH4_4, Li7_7P3_3S11_{11}, Li10_{10}M(PS6_6)2_2 (M=Ge, Si, Sn), Li3_3PS4_4, Li3_3Y(PS4_4)2_2, Li5_5P(S2_2Cl)2_2, Li4_4GeS4_4, to have high MSDs at both temperatures. The halides such as Li3_3InCl6_6, Li3_3InBr6_6, Li3_3YCl6_6, Li3_3ErCl6_6 are also good conductors but have slightly smaller MSDs than the first batch of superionic conductors. The M3GNet model also predicts that the c-Li7_7La3_3Zr2_2O12_{12} has similar MSD with t-Li7_7La3_3Zr2_2O12_{12} at 1200 K but much larger MSD at 800 K, suggesting the the cubic phase is a better ionic conductor at low temperature. Oxides such as Li4_4GeO4_4, Li4_4SiO4_4, Li2_2Ge7_7O15_{15}, Li3_3ClO and Li3_3BrO show very small MSDs and hence minimal Li conductivity. However, in experiments, Li3_3ClO was known to be a highly Li conductive material. We postulate that defects are the main driving force for high Li conductivity in this material, while in simulation there are no defects. Indeed, high quality deposited thin films with few defects show very small Li conductivity in Li3_3ClO.{sup}11 AIMD simulations by {citet}Zhang et al. {sup}12` also found that pristine Li3_3ClO and Li3_3BrO are poor conductors, with no Li diffusion up to 1500 K. AIMD that showed Li diffusion was done with explicit Li vacancies.1

Many materials distribute on the top left (low low-temperature MSDs and high Li diffusion energy barriers) and the bottom left (low MSDs at both temperatures). Very few materials distribute on the upper right and below the dashed line with diffusion energy barriers less than 0.4 eV. The results also suggest the difficulties in finding new superionic conductors.

We further group the materials according to their anion group (Figure S13) and the polyanions (Figure S13). For carbon group elements (C, Si, and Ge), the Li diffusivities decrease monotonically with the atomic number. For pnictogens, the trend forms a convex shape where arsenide compounds have the lowest overall Li conductivity and antimonides have the highest conductivity. For the chalcogen anions, sulfur stands out in facilitating Li diffusion, followed by selenium. Oxides and tellurides are usually poor Li conductors. The halogens have relatively simple monotonic trends where the iodides are usually the best Li conductors. Comparing the elements in the second row of the periodic table, boron and nitrogen form better lithium conductors than oxygen and fluorine. The projections onto the polyanion groups shown in Figure S13 also suggest that oxides are relatively poor conductors, with the exception of CO3\mathrm{CO}_{3}, SO4\mathrm{SO}_{4}, PO4\mathrm{PO}_{4} that have several conductive compounds. Not surprisingly, PS6\mathrm{PS}_{6} and PS4\mathrm{PS}_{4} polyanions facilitate fast Li conduction. Lastly, the BH4\mathrm{BH}_{4} polyanion group, which are all LiBH4\mathrm{LiBH}_{4} polymorphs, show remarkable Li diffusivity. The trends of anions and polyanions match with experimental findings and distill chemical knowledge for guiding new Li superionic conductor design.

Applications of M3GNet to benchmark materials datasets

MatBench materials data

We took the nine structural MatBench datasets by Dunn et al. [14] as the material property benchmark. The datasets cover a wide range of materials properties with varying data sizes, including crystal energy, phonon spectrum, optical properties, mechanical properties, etc. We trained the M3GNet models on those properties using the same model architectures as the potential model. The M3GNet results compared to other state-of-the-art models are shown in Table S3. The MODNet [15, 16] model shows lower or comparable errors in the small to medium data size regimes. However, for larger data such as the whole formation energy dataset of MP, the original authors acknowledge that the graph models such as MEGNet outperform MODNet by a factor of 2. [16] The M3GNet model, on the other hand, is able to achieve consistently high accuracy across all the datasets, and is more accurate than the previous MEGNet models in all nine tasks. In particular, for the large (∼15,000\sim15{,}000) to very large datasets (>100,000>100{,}000), the M3GNet models achieve much higher accuracy than the rest; the accuracy improvements compared to the previous best graph model are 20.5% for the perovskite formation energy data, 22.1% for the MP band gap, and even 41.3% for the MP formation energy data.

M3GNet as molecular force fields

The MD17 datasets[19, 20, 21] were used as the first test case as M3GNet models as force fields.

The MD17 datasets contain several small molecules and their molecular dynamics trajectories with energies and forces computed by density functional theory. The comparisons between M3GNet and other models are shown in Table S4, where for each molecule, only 1000 snapshots were used for training and validation and the rest were used as test for metric reporting. Each error metric in M3GNet is the mean error from three different random sampling and model training.

The M3GNet models achieved consistently lower errors than the less complex EANN[22] models. For sGDML[21] and the deep learning-based models, such as message-passing based DimeNet,[23] and the Equivalent neural networks NequIP[24] and PaiNN,25 the errors are all low and are comparable to the M3GNet models. No model is able to outperform the rest in all molecules.

MD17 CCSD/CCSD(T) benchmark

The quantum-accurate CCSD/CCSD(T) [19, 21] calculations of the molecules in the MD17 datasets are used for further molecular force field benchmark. The M3GNet model results are compared to the available sGDML, [21] PhysNet[26] and NequIP, [24], as shown in Table S5. In this dataset, the M3GNet model achieves excellent accuracies across all the the molecules, and has state-of-the-art accuracy in Ethanol, Malonaldehyde and Paracetamol. M3GNet also shows state-of-the-art accuracies in energies of Aspirin and Toluene, and forces of Azobenzene and Benzene.

References

  1. [1]Shukla, P.; Watanabe, T.; Nino, J. C.; Tulenko, J. S.; Phillpot, S. R. Thermal Transport Properties of MgO and Nd2Zr2O7 Pyrochlore by Molecular Dynamics Simulation. Journal of Nuclear Materials 2008, 380, 1–7.DOI
  2. [2]Jain, A.; Ong, S. P.; Hautier, G.; Chen, W.; Richards, W. D.; Dacek, S.; Cholia, S.; Gunter, D.; Skinner, D.; Ceder, G.; Persson, K. A. Commentary: The Materials Project: A Materials Genome Approach to Accelerating Materials Innovation. APL Materials 2013, 1, 011002.DOI
  3. [3]Plimpton, S. Fast Parallel Algorithms for Short-Range Molecular Dynamics. Journal of Computational Physics 1995, 117, 1–19.
  4. [4]Ewald, P. P. Die Berechnung Optischer Und Elektrostatischer Gitterpotentiale. 1921,DOI
  5. [5]Bartók, A. P.; Payne, M. C.; Kondor, R.; Csányi, G. Gaussian Approximation Potentials: The Accuracy of Quantum Mechanics, without the Electrons. Physical Review Letters 2010, 104, 136403.pubmed.ncbi.nlm.nih.gov/20481899
  6. [6]Deringer, V. L.; Csányi, G. Machine Learning Based Interatomic Potential for Amorphous Carbon. Physical Review B 2017, 95, 094203.DOI
  7. [7]Petretto, G.; Dwaraknath, S.; P. C. Miranda, H.; Winston, D.; Giantomassi, M.; van Setten, M. J.; Gonze, X.; Persson, K. A.; Hautier, G.; Rignanese, G.-M. High-Throughput Density-Functional Perturbation Theory Phonons for Inorganic Materials. Scientific Data 2018, 5, 180065.DOI
  8. [8]Qi, J.; Banerjee, S.; Zuo, Y.; Chen, C.; Zhu, Z.; Holekevi Chandrappa, M. L.; Li, X.; Ong, S. P. Bridging the Gap between Simulated and Experimental Ionic Conductivities in Lithium Superionic Conductors. Materials Today Physics 2021, 21, 100463.arxiv.org/abs/2102.08413
  9. [9]Wang, S.; Bai, Q.; Nolan, A. M.; Liu, Y.; Gong, S.; Sun, Q.; Mo, Y. Lithium Chlorides and Bromides as Promising Solid-State Chemistries for Fast Ion Conductors with Good Electrochemical Stability. Angewandte Chemie International Edition 2019, 58, 8039–8043.
  10. [10]Zhu, Z.; Chu, I.-H.; Ong, S. P. Li1Y(PS4)2 and Li5PS4Cl2: New Lithium Superionic Conductors Predicted from Silver Thiophosphates Using Efficiently Tiered Ab Initio Molecular Dynamics Simulations. Chemistry of Materials 2017, 29, 2474–2484.
  11. [11]Lü, X.; Wu, G.; Howard, J. W.; Chen, A.; Zhao, Y.; Daemen, L. L.; Jia, Q. Li-Rich Anti-Perovskite Li3OCl Films with Enhanced Ionic Conductivity. Chemical Communications 2014, 50, 11520–11522.DOI
  12. [12]Zhang, Y.; Zhao, Y.; Chen, C. Ab Initio Study of the Stabilities of and Mechanism of Superionic Transport in Lithium-Rich Antiperovskites. Physical Review B 2013, 87, 134303.DOI
  13. [13]Deng, Z.; Radhakrishnan, B.; Ong, S. P. Rational Composition Optimization of the Lithium-Rich Li3OCl1−xBrx Anti-Perovskite Superionic Conductors. Chemistry of Materials 2015, 27, 3749–3755.DOI
  14. [14]Dunn, A.; Wang, Q.; Ganose, A.; Dopp, D.; Jain, A. Benchmarking Materials Property Prediction Methods: The Matbench Test Set and Automatminer Reference Algorithm. npj Computational Materials 2020, 6, 1–10.DOI
  15. [15]De Breuck, P.-P.; Hautier, G.; Rignanese, G.-M. Materials Property Prediction for Limited Datasets Enabled by Feature Selection and Joint Learning with MODNet. npj Computational Materials 2021, 7, 1–8.DOI
  16. [16]Breuck, P.-P. D.; Evans, M. L.; Rignanese, G.-M. Robust Model Benchmarking and Bias-Imbalance in Data-Driven Materials Science: A Case Study on MODNet. Journal Chen, C.; Ong, S. P. AtomSets – A Hierarchical Transfer Learning Framework for Small and Large Materials Datasets. arXiv:2102.02401 [cond-mat] 2021,
  17. [18]Chen, C.; Ye, W.; Zuo, Y.; Zheng, C.; Ong, S. P. Graph Networks as a Universal Machine Learning Framework for Molecules and Crystals. Chemistry of Materials 2019, 31, 3564–3572.DOI
  18. [19]Chmiela, S.; Tkatchenko, A.; Sauceda, H. E.; Poltavsky, I.; Schütt, K. T.; Müller, K.-R. Machine Learning of Accurate Energy-Conserving Molecular Force Fields. Science Advances 2017, 3, e1603015.DOI
  19. [20]Schütt, K. T.; Arbabzadah, F.; Chmiela, S.; Müller, K. R.; Tkatchenko, A. Quantum-Chemical Insights from Deep Tensor Neural Networks. Nature Communications 2017, 8, 13890.
  20. [21]Chmiela, S.; Sauceda, H. E.; Müller, K.-R.; Tkatchenko, A. Towards Exact Molecular Dynamics Simulations with Machine-Learned Force Fields. Nature Communications 2018, 9, 3887.
  21. [22]Zhang, Y.; Hu, C.; Jiang, B. Embedded Atom Neural Network Potentials: Efficient and Accurate Machine Learning with a Physically Inspired Representation. The Journal of Physical Chemistry Letters 2019, 10, 4962–4967.DOI
  22. [23]Klipera, J.; Groß, J.; Günnemann, S. Directional Message Passing for Molecular Graphs. arXiv:2003.03123 [physics, stat] 2020,
  23. [24]Batzner, S.; Musaelian, A.; Sun, L.; Geiger, M.; Mailoa, J. P.; Kornbluth, M.; Molinari, N.; Smidt, T. E.; Kozinsky, B. SE(3)-Equivariant Graph Neural Networks for Data-Efficient and Accurate Interatomic Potentials. arXiv:2101.03164 [cond-mat, physics:physics] 2021, Schütt, K. T.; Unke, O. T.; Gastegger, M. Equivariant Message Passing for the Prediction of Tensorial Properties and Molecular Spectra. arXiv:2102.03150 [physics] 2021,
  24. [26]Unke, O. T.; Meuwly, M. PhysNet: A Neural Network for Predicting Energies, Forces, Dipole Moments, and Partial Charges. Journal of Chemical Theory and Computation 2019, 15, 3678–3693.

Paper details

vlnc:W_y3e3frvv
Version
v1 · latest
Published
Fresh — added to the Hub within the last 30 days
Added
License
CC BY 4.0
Usage

views · 0

downloads · 0

A view counts once per browser per day, a download each time the PDF is requested.

  • Physics and Astronomy

Not recorded for this paper

View statement
Looking for related papers…
Contents