WorksPhysics and Astronomy
Universal Machine Learning Interatomic Potentials are Ready for Phonons
Abstract
There has been an ongoing race for the past several years to develop the best universal machinelearning interatomic potential. This progress has led to increasingly accurate models for predictingenergy, forces, and stresses, combining innovative architectures with big data. Here, we benchmarkthese models on their ability to predict harmonic phonon properties, which are critical for under-standing the vibrational and thermal behavior of materials. Using around 10 000 ab initio phononcalculations, we evaluate model performance across various phonon-related parameters to test theuniversal applicability of these models. The results reveal that some models achieve high accuracyin predicting harmonic phonon properties. However, others still exhibit substantial inaccuracies,even if they excel in the prediction of the energy and the forces for materials close to dynamicalequilibrium. These findings highlight the importance of considering phonon-related properties inthe development of universal machine learning interatomic potentials.
Introduction
One of the most impactful applications of artificial intelligence methods to the field of materials science has been the introduction of machine learning interatomic potentials (MLIPs) [4] [1, 2, 3]. These are by now capable of delivering energies and forces at the level of density functional theory (DFT), or beyond, at a computational cost that is often several orders of magnitude lower. As such, they are now accelerating or even replacing the expensive DFT calculations, truly enabling the in-silico design and development of complex materials.
Various representation methods for crystal structures (embedding techniques) have been proposed in the past years [5, 6, 7, 8, 9]. These methods encode crystal structure information into learnable features, thereby improving data efficiency for the models. Furthermore, new machine learning models and strategies were also developed and improved. These advancements gained significant momentum with the introduction of message passing neural network frameworks [10], which were later enhanced by incorporating continuous-filter convolutions for message passing [11]. Message passing addressed the issue of exponentially expanding descriptor sizes in earlier machine learning models, enabling the prediction of much larger and more complex systems.
The training of MLIPs has also been facilitated by the continuous accumulation of DFT calculations over the decades, and by the creation of comprehensive databases, such as the Materials Project [12], the Open Quantum Materials Database [13], Aflowlib [14], Alexandria [15], NOMAD [16], etc. These databases contain materials with almost all chemical elements and in all types of crystal structures. They also provide a variety of computed properties, including total energies, forces, stresses, etc. not only for compounds at dynamical equilibrium, but
also for geometry optimization or molecular dynamics paths.
Until recently, MLIPs were typically trained for specific chemical systems and were often limited to a narrow range of geometries and atomic arrangements. This paradigm shifted in 2019 with the introduction of the Materials Graph Network (MEGNet) [17], a framework designed for universal machine learning in materials science. Universal MLIPs (uMLIPs) are foundational models capable of handling all chemistries and crystal structures. MEGNet already demonstrated relatively low prediction errors across a wide array of properties in both molecules and crystals. Its performance was significantly enhanced by incorporating atomic coordinates, lattice vectors in crystals, and 3-body interactions [18], enabling uMLIPs to predict ground-state geometries with a mean absolute error of 0.035 eV/atom in the energy, when compared to DFT. Further advancements, such as the use of higher-order body messages, have resulted in models that are accurate, fast, and highly parallelizable [19]. Since then, there has been a surge of developments, with new and improved models being published at an almost monthly rate [20, 21, 22, 23, 24].
In spite of the rapid progress of uMLIPs, there are still challenges remaining. Since these models are mostly trained and evaluated on existing datasets [12, 15, 23], containing mainly equilibrium or near-equilibrium geometries, they struggle to reproduce meta-stable or highly distorted structures [25]. To resolve this problem, further information on the off-equilibrium structures from molecular dynamic results can be used [26]. Alternatively, by gradually distorting the optimized geometries, one can step away from the minima of the potential energy surface [27]. Models trained on such augmented datasets show superior performance at predicting equilibrium structures and energies [27]. Moreover, compared to those trained without off-equilibrium data, models trained with augmented datasets perform better on predicting the first derivatives of the energy [27]. While multiple evaluations of uMLIPs can be found in the literature [28, 29, 30], direct phonon prediction capabilities have not been comprehensively characterized.
Here we benchmark seven uMLIP models, specifically M3GNet, CHGNet, MACE-MP-0, SevenNet-0, MatterSim-v1, ORB, and eqV2-M, for the calculation of phonon properties. These properties are obtained from the second derivatives (i.e., the curvature) of the potential energy surface, and therefore sample a small neighbourhood around the dynamically stable minima. Phonons are extremely important in materials science, as they are fundamental in determining the free energy (and therefore thermodynamic stability), dynamical stability, thermal properties, etc. We note that all seven models are also featured in the Matbench Discovery leaderboard [17, 19, 20, 21, 23, 25, 27, 31] (ranked 12th, 11th, 10th, 8th, 3rd, 2nd, and 1st, respectively, at the time of writing).
M3GNet [17] is one of the pioneering uMLIPs and still remains a key model in the field. It employs three-body interactions and incorporates atomic positions, enabling the calculation of forces through the automatic differentiation of the neural network. CHGNet [23] is another of the earlier models, but it still demonstrates excellent performance while having one of the smallest architectures with just over 400 thousand parameters. MACE-MP-0 [19] utilizes the atomic cluster expansion [32] as a local descriptor, reducing the number of necessary message-passing steps while maintaining efficiency. SevenNet-0 [21], built upon NequIP [8], focuses on parallelizing the message-passing process. This approach preserves NequIP’s data efficiency, accuracy, and equivariant character. MatterSim-v1 [31] builds upon M3GNet, leveraging active learning and efficient sampling across the chemical space. Its goal is to enhance the accuracy of energy and force predictions over a broader range of scenarios while maintaining a straightforward architecture that is easy to fine-tune. The ORB model [20] combines the smooth overlap of atomic positions [6] with a graph network simulator [33]. Finally, eqV2-M [27] is using the model developed by Ref. 22 utilizing equivariant transformers to achieve higher-order equivariant representations. An important detail to note is that the ORB and eqV2-M models predict forces as a separate output rather than deriving them as energy gradients as the other five models.
Results
Dataset and Its Properties
To benchmark phonon properties we use the dataset developed in the MDR database [34]. This dataset includes around 10 000 non-magnetic semiconductors, covering a wide range of elements across the periodic table. Moreover, the phonon calculations were performed with VASP, ensuring a high degree of compatibility with the training sets used in the construction of the uM-
LIPs. Unfortunately, this phonon dataset was originally constructed with the Perdew-Burke-Ernzerhof (PBE) for solids (PBEsol) approximation to the exchange-correlation functional [35]. This is certainly a very reasonable choice, as the PBEsol functional exhibits superior structural [36, 37] and phonon [38] properties when compared to the standard PBE [39]. However, as all uMLIPs were trained on PBE data, a direct comparison to PBEsol phonons can be ambiguous. To mitigate this problem, we recalculated the entire phonon dataset from Ref. 34 with the PBE functional (see Section IV). In the following, we not only present comparisons of uMLIP calculations with PBE data, but we also include the difference between PBE and PBEsol. This gives us an estimate of the variability of the results as a function of the approximation to the exchange-correlation function, that we use as an absolute scale to assess the quality of the uMLIPs.
As illustrated in Figure 1a, the dataset contains mostly ternary and quaternary compounds. Additionally, we observe that the majority of the compounds belong to the monoclinic and orthorhombic crystal systems, followed by approximately equal proportions of trigonal and tetragonal systems. Cubic systems are less common, with hexagonal systems representing the smallest proportion. Ultimately, these characteristics are inherited from the Materials Project database [12] and the Inorganic Crystal Structure Database (ICSD) [40]. Finally, triclinic systems are absent from the MDR database, likely because of the extra computational cost that arises from the reduced symmetry.

Figure 1. Distribution of (a) number of different chemical elements per unit cell, (b) crystal systems, and (c) band gaps calculated with the PBE functional for all the materials in the dataset.
In Figure 2 we plot the frequency of the chemical elements in the dataset. We can see that almost all the periodic table is well represented (with a few exceptions like Tc that is radioactive or Eu and Gd for which vasp has convergence problems). We also observe a significant abundance of structures containing oxygen. However, certain compounds, such as those containing Mo and W, as well as the magnetic elements (from V to Ni) are underrepresented. These biases in the MDR database [34] are also to some extent inherited from the Materials Project database [12], but should not be relevant for the benchmark we present here. Although the dataset is predominated by oxides, the band gaps of the whole set still covers a large range, as illustrated in Figure 1c.
Figure 2. Periodic tables showing the frequency of the chemical elements in the structures from the dataset. Elements in gray are absent from the dataset.
Relative Performances of uMLIPs
We start by discussing the errors in the geometry relaxations, as shown in Table I and Figure 3. The “Failed” column in Table I indicates for how many systems a model failed to converge the forces to below eV/. We can see that CHGNet and MatterSim-v1 models appears to be the most reliable, with respectively 0.09% and 0.10% unconverged structures. The M3GNet, SevenNet-0 and MACE-MP-0 models have a similar number of unconverged structures, while the ORB and eqV2-M models
| Model | Failed (%) | MAE() | MAE() |
| M3GNet | 0.12 | 33 | 0.516 |
| CHGNet | 0.09 | 334 | 0.518 |
| MACE-MP-0 | 0.14 | 31 | 0.392 |
| SevenNet-0 | 0.15 | 31 | 0.283 |
| MatterSim-v1 | 0.10 | 29 | 0.244 |
| ORB | 0.82 | 31 | 0.082 |
| eqV2-M | 0.85 | 33 | 0.084 |
| PBEsol | – | – | 1.283 |
Table I. Summary of the errors for energy (, in meV/atom) and volume (, in /atom) of the converged relaxation compared to PBE results. We list mean absolute errors (MAE) as well as the percentage of failed (F) to converge.
Figure 3. Violin plot of the errors in the volume of the unit cell per atoms, relatively to the PBE reference data.
exhibit a much larger failure rate. The most unreliable model for this dataset is eqV2-M, for which 0.85% structural calculations were unable to converge. In general, there are two main reasons behind the failures, specifically either the geometry optimization path explored regions of the potential energy surface for which the uMLIP yielded unphysical forces, or there were high frequency errors in the forces that prevented the relaxation algorithm to converge to the required precision. This latter reason is behind the very large failure rate for the two models where the forces are not the exact derivatives of the energy. CHGNet shows notably higher error in energy predictions, which is expected given that we did not apply the energy correction procedure typically used during CHGNet’s training.
Looking at Figure 3 we see that, as expected, PBEsol leads to a contraction of the unit cell, correcting the underbinding that is typical of the PBE approximation. The large majority of the systems show a difference between the PBE and PBEsol volume per atom between 0 and −2 /atom. All uMLIPs exhibit a MAE() that is smaller than the mean absolute difference between PBE and PBEsol. Among them, the eqV2-M model emerges as the most accurate, closely followed by ORB. Indeed, these two uMLIPs show a remarkable performance for the vast majority of the compounds in the dataset, with errors that are quite small in both absolute and relative terms. MatterSim-v1 and SevenNet-0 show a very solid performance, although with mean errors four times larger than the two best models. Finally, M3GNet, MACE-MP-0, and CHGNet have a wider error distribution, with a MAE in the range of 0.4–0.5 /atom. These results confirm that both eqV2-M and ORB are the best models for geometry optimization, and that they can already be used to essentially replace DFT calculations for this task.
We now turn our attention to phonon related properties. We chose to look at the maximum phonon frequency (reported in Kelvin, with 1 K = 0.695 cm), the phonon density of state (DOS), the average of the sound velocity on the 3 acoustic branches, the vibrational entropy, the Helmholtz free energy, and the heat capacity at constant volume, the last three calculated at the temperature of 300 K. The maximum phonon frequency allows us to detect systematic errors in the prediction of the concavity of the potential energy surface, especially important as it is well known that some uMLIPs have the tendency to yield too soft phonons. The phonon DOS provides information regarding the general prediction of phonon modes with respect to frequency, while the sound velocity help identify errors in the acoustic branches in the vicinity of . It should be noted that for the phonon DOS we remove
values below 0.1 states/THz. The vibrational entropy and the Helmholtz free energy are important properties as they are essential to determine thermodynamic stability and phase diagrams as a function of temperature. Finally, the heat capacity is an important thermal property that can be directly measured experimentally.
We note that maximum phonon frequency was calculated from the values at the -points commensurate to the supercell matrix, whereas the DOS and thermodynamic properties were obtained on a denser -grid by applying Fourier interpolation (see Section IV). However, as the -grids are consistent across DFT and uMLIPs calculations, the interpolation error should be systematic and should not affect the benchmark.
We aggregated the errors for all models in Table II and in Figure 4. We first notice that the deviation between the PBE and PBEsol results is small but not negligible. This observation reinforces the necessity of using a consistent functional between the training and benchmarking stages. The difference between PBE and PBEsol exhibits a rather narrow distribution in all 6 properties, especially when compared to the MAE of most of the uMLIPs. There are also systematic differences: for example, the maximum phonon frequencies in PBEsol are higher than with PBE, which can be understood by the contraction of the cell and subsequent hardening of the force constants. PBEsol also leads to larger values of the free energy (on average of the order of 10 kJ/mol), and to smaller values of the entropy and the heat capacity.

Figure 4. Violin plots of the errors in (a) the maximum phonon frequency, (b) the vibrational entropy, (c) the Helmholtz free energy, (d) the heat capacity, (e) the density of states and (f) the average of the sound velocity on the 3 accoustic branches, relatively to the PBE reference data.
Based on the errors we can roughly classify the seven models into three categories. The first contains ORB and eqV2-M, which have very large errors in phonon-related properties (see Figure 4). In fact, phonon frequencies are grossly underestimated, and are often even imaginary as we will see in the following.
In the second category we have, in increasing ororder of accuracy, M3GNet, CHGNet, MACE-MP-0 and SevenNet-0 (see Figure 4). The errors of these models are on average considerably larger than the difference between PBE and PBEsol. Moreover they all exhibit systematic errors, underestimating the phonon frequencies and the free energy, and overestimating the entropy and the heat capacity. From the four models, the most accurate is clearly SevenNet-0, while the older M3GNet and CHGNet show the larger errors. In spite of the difference in topologies, these four models are all trained in the same dataset, so it is not surprising that their results are somewhat similar. This again demonstrates that training data is at least as important as the representation of the crystal structure or the topology of the model to develop a uMLIP.
Finally, MatterSim-v1 stands out as the most accurate uMLIP for the calculation of phonons. Not only does it not exhibit any strong systematic error, with all distributions essentially centered at zero, but also the dispersion of the errors is extremely small, leading to values of MAE considerably smaller than the difference between PBE and PBEsol. This indicates that MatterSim-v1 can be used to calculate phonon properties of semiconductors with an accuracy comparable to DFT codes, although at a very small fraction of the computational cost. It is very interesting to note that although MatterSim-v1 is based upon the simple M3GNet, its performance exceeds much more complicated models such as SevenNet-0 or eqV2-M that are based on equivariant networks. The key in this case is the scalability of M3GNet, which allows for an increase in the number of parameters and the efficient use of larger amounts of training data.
| Model | |||
| M3GNet | 98 | 150 | 56 |
| CHGNet | 89 | 114 | 45 |
| MACE-MP-0 | 61 | 60 | 24 |
| SevenNet-0 | 40 | 48 | 19 |
| MatterSim-v1 | 17 | 15 | 5 |
| ORB | 291 | 421 | 175 |
| eqV2-M | 780 | 403 | 241 |
| PBEsol | 33 | 25 | 10 |
| Model | |||
| M3GNet | 22 | 5.5 | 617 |
| CHGNet | 21 | 4.8 | 649 |
| MACE-MP-0 | 13 | 4.2 | 523 |
| SevenNet-0 | 9 | 4.2 | 510 |
| MatterSim-v1 | 3 | 3.3 | 401 |
| ORB | 57 | 9.1 | 1198 |
| eqV2-M | 100 | 10.7 | 1240 |
| PBEsol | 5 | 2.9 | 305 |
Table 2. Summary of the mean absolute errors (MAE) for the maximum phonon frequency (, in Kelvin where 1 K≈0.695 cm), the vibrational entropy (, in J/K/mol), the Helmholtz free energy (, in kJ/mol), the heat capacity at constant volume (, in J/K/mol), the phonon density of state (), and the average of sound velocities ().
To have a better understanding of the general behavior of the uMLIPs, we plot in Figure 5 the distribution of the maximum frequency predicted. Most compounds have maximum frequencies in the range of 500–2000 K, with a few containing very light elements going up to 5500 K. The softening of the phonon frequencies by M3GNet, CHGNet, MACE-MP-0 and SevenNet-0 is evident, in particular for the first two. ORB and eqV2-M, on the other hand, exhibit completely distorted distributions peaking at zero, showing that the force constants obtained with these models are unphysical.

Figure 5. Highest frequencies predicted for each structure for all models and from the original PBEsol MDR database.
Another important performance metric is dynamical stability, a crucial stability descriptor utilized by many high-throughput searches of inorganic materials [41, 42, 43, 44]. A compound is dynamically stable when it is in a true minimum of the potential energy surface and not in a maximum or a saddle point. In practice, it is assured by the absence of imaginary phonon frequencies in the spectrum. Unfortunately, it is well known that numerical inaccuracies often lead to small imaginary frequencies close to the -point. To avoid this problem, we consider a structure to be dynamically stable if frequencies are all real across the Brillouin zone except at where we allow the three acoustic modes to have small imaginary frequencies (with a threshold of K). This criterion was applied to all -points commensurate to the supercell matrix (but not to the interpolated -points).
The elements of the confusion matrix, when compared to the PBE, are listed in Table III. Most compounds that are stable in the PBE are also stable in PBEsol and vice-versa, with the differences coming mostly from the difficulty associated to small imaginary frequencies as mentioned above. MatterSim-v1 and MACE-MP-0 are the most reliable with a percentage of true positives of 95%. M3GNet, SevenNet-0 and CHGNet are somewhat less accurate, especially in what concerns the percentage of true positives. Finally, the eqV2-M and ORB models perform very poorly, with more than 80% of the unstable systems being false negatives.
| Model | TS | FU | TU | FS |
| M3GNet | 87 | 13 | 73 | 27 |
| CHGNet | 77 | 23 | 73 | 27 |
| MACE-MP-0 | 95 | 5 | 73 | 27 |
| SevenNet-0 | 81 | 19 | 80 | 20 |
| MatterSim-v1 | 95 | 5 | 75 | 25 |
| ORB | 15 | 85 | 92 | 8 |
| eqV2-M | 7 | 93 | 94 | 6 |
| PBESol | 97 | 3 | 76 | 24 |
Table III. Normalized confusion matrix with true stable (TS, in %), false unstable (FU, in %), true unstable (TU, in %), false stable (FS, in %) of predicted dynamical stability for models using PBE data as reference. For information, the number of stable compounds in the PBE is 8189 and unstable is 1769.
Discussion
We created a dataset that includes phonon properties of almost 10 000 semiconductors obtained with DFT. These calculations were performed with the PBE approximation, the same approximation employed in the datasets used for the training of uMLIPs. This allows us to benchmark, without ambiguities, phonon properties calculated with uMLIPs.
In what concerns the equilibrium geometry, ORB and eqV2-M are extremely accurate and convincingly outperform all other models. This can be understood from the fact that the models output both the energy and the forces, and are trained in a very large dataset, leading to very small errors at equilibrium. Regarding phonons, however, the situation is completely different. ORB and eqV2-M yield very low quality phonons, often imaginary. We believe that the reason for this problem is that these models are non-conservative. In fact, contrary to all other models, in ORB and eqV2-M the forces are not calculated by performing the derivative of the energy with respect to the atomic positions, but they are output directly by the network. This avoids the costly computational step of evaluating the derivatives though backpropagation and the extra freedom allows for a more accurate prediction of energy and forces. Unfortunately, it also leads to inevitable errors especially for the small displacements required for the calculation of phonons. This problematic behavior has also been reported and analyzed in [45]. The problem can be alleviated, but far from resolved, by using larger displacements in the frozen-phonon workflow. Of course, this can lead to further problems, such as the overestimation of the anharmonic contributions.
Phonon properties calculated with MatterSim-v1, and to a lesser extent SevenNet-0, are of very high quality. Other models fare somewhere in between, exhibiting both a larger dispersion of the errors, and systematic deviations with respect to the reference PBE values.
We should note that not only the performance of the models, but also their computational efficiency, should be taken into account when choosing a uMLIP for a specific application. From the models tested here, M3GNet is by far the fastest, running in a single CPU core more efficiently than any of the other models in a full GPU. On the extreme we have eqV2-M and MACE-MP-0, convincingly the slowest of the pack, while the rest of the models fall in between.
Our benchmark highlights the importance of considering specific optimization goals for individual metrics and understanding the trade-offs involved. Furthermore, it shows that uMLIPs are ready to be used not only for the calculation of geometries and energies, but also of response properties, that are essential for a variety of material applications. We hope our critical assessment of phonon properties will guide future training efforts and encourage the use of our dataset to further develop uMLIPs.
Methods
Ab initio Dataset
To recalculate the MDR dataset [34] with PBE [39] exchange-correlation functional, we used the code VASP [46, 47]. We used all parameters consistent with the MDR dataset, with the exception of the approximation to the exchange-correlation functional that was changed from PBEsol to PBE. We followed the same workflow as MDR, but before the stringent geometry relaxation we applied a pre-relaxation step with energy and force convergence criteria of eV/cell and eV/Å, respectively. For the stringent relaxation step, in accordance to the MDR calculations, we used a higher energy and force convergence criteria of eV/cell and eV/Å, respectively. Next, the force constants were obtained by applying the finite displacement method as implemented in the PHONOPY python package [48, 49].
uMLIP evaluation
For all the uMLIP models, we perform the geometry relaxation and force set calculations starting from the PBE geometry using the Atomic Simulation Environment (ASE) [50]. To keep the space group symmetry of the PBE structure, we employ the ASE symmetrizer FretchCellFilter. The structure optimization is done using the fast inertial relaxation engine (FIRE) [51], with force convergence criteria set to 0.005 eV/Å for all models.
To calculate the thermodynamic properties, i.e. the vibrational entropy, the Helmholtz free energy, and the heat capacity, the phonon density of states is obtained by Fourier interpolation from the coarse calculated -grid into a denser grid as in the MDR database. We set a temperature of 300 K to compute the thermodynamic properties.
The phonon density of states has been calculated using the same grid as that employed for the thermal properties. Values that are below 0.1 states/THz from PBE and model prediction were removed. The sound velocity is calculated using group velocities near the Γ point, that are calculated using small -vectors oriented along each axis (x, y, and z). For each phonon branch, we extract the directional component of the group velocity corresponding to the axis along which the -vector was oriented, specifically the xx, yy, and zz components. We then calculate the average of these directional components across all acoustic branches to obtain the average sound velocity.
All models considered in this paper are open source. In Table IV we list their training set sizes, data sources, and the number of parameters.
| Model | Source | ||
| M3GNet | 188 k | MPF | 228 k |
| MACE-MP-0 | 1.58 M | MPtrj | 4.69 M |
| CHGNet | 1.58 M | MPtrj | 413 k |
| MatterSim-v1 | 6 M | MatterSim | 4.5 M |
| SevenNet-0 | 1.58 M | MPtrj | 842 k |
| ORB | 1.58 M | MPtrj | 25.2 M |
| eqV2-M | 110 M | MPtrj, Alexandria, OMat | 86 M |
Table IV. List of models with number of training data (), data source, and number of parameters of the models ().
Data Availability
The phonon dataset is available in ALEXANDRIA which can be accessed and/or downloaded from https://alexandria.icams.rub.de/ under the terms of the Creative Commons Attribution 4.0 License.
Code Availability
All code developed in this work is freely available at https://github.com/hyllios/utils/tree/main/.
Acknowledgements
A.L. and M.A.L.M. acknowledge funding from the Horizon Europe MSCA Doctoral network grant n.101073486, EUSpecLab, funded by the European Union. S.B. and D.S. acknowledge financial support from the Deutsche Forschungsgemeinschaft (DFG, German Research Foundation) through the project BO4280/11-1. H.C.W and M.A.L.M would like to thank the NHR Centre PC2 for providing computing time on the Noctua 2 supercomputers.
Author Contributions
A.L. and M.A.L.M developed the high-throughput workflow; A.L. , D.S., and M.A.L.M performed the response calculations; A.L. and M.A.L.M. performed the machine learning validations; H.-C. W., S.B., and M.A.L.M directed the research. All authors participated equally in the interpretation of the results and in the writing of the manuscript.
Competing Interests
S.B. declares to be an Associate Editor for npj Computational Materials. This role has not influenced the peer review or editorial process for this manuscript, which has been handled independently according to the journal’s standard procedures for manuscripts with editorial board member authorship.
References
- [4]O. T. Unke, S. Chmiela, H. E. Sauceda, M. Gastegger, I. Poltavsky, K. T. Schütt, A. Tkatchenko, and K.-R. Müller, Machine learning force fields, Chem. Rev. 121, 10142–10186 (2021).
- [5]J. Behler and M. Parrinello, Generalized neural-network representation of high-dimensional potential-energy surfaces, Phys. Rev. Lett. 98, 146401 (2007).
- [6]A. P. Bartók, R. Kondor, and G. Csányi, On representing chemical environments, Phys. Rev. B 87, 184115 (2013).DOI
- [7]J. Gasteiger, J. Groß, and S. Günnemann, Directional message passing for molecular graphs, in International Conference on Learning Representations (2020).arxiv.org/abs/2003.03123
- [8]S. Batzner, A. Musaelian, L. Sun, M. Geiger, J. P. Mailoa, M. Kornbluth, N. Molinari, T. E. Smidt, and B. Kozinsky, E(3)-equivariant graph neural networks for data-efficient and accurate interatomic potentials, Nat. Commun. 13, 2453 (2022).DOI
- [9]M. Gastegger, K. T. Schütt, and K.-R. Müller, Machine learning of solvent effects on molecular spectra and reactions, Chem. Sci. 12, 11473–11483 (2021).
- [10]J. Gilmer, S. S. Schoenholz, P. F. Riley, O. Vinyals, and G. E. Dahl, Neural message passing for quantum chemistry, in Proceedings of the 34th International Conference on Machine Learning, Proceedings of Machine Learning Research, Vol. 70, edited by D. Precup and Y. W. Teh (PMLR, 2017) pp. 1263–1272.arxiv.org/abs/1704.01212
- [11]K. Schütt, P.-J. Kindermans, H. E. Sauceda Felix, S. Chmiela, A. Tkatchenko, and K.-R. Müller, SchNet: A continuous-filter convolutional neural network for modeling quantum interactions, in Advances in Neural Information Processing Systems, Vol. 30, edited by I. Guyon, U. V. Luxburg, S. Bengio, H. Wallach, R. Fergus, S. Vishwanathan, and R. Garnett (Curran Associates, Inc., 2017).
- [12]A. Jain, S. P. Ong, G. Hautier, W. Chen, W. D. Richards, S. Dacek, S. Cholia, D. Gunter, G. Ceder, and K. A. Persson, Commentary: The Materials Project: A materials genome approach to accelerating materials innovation, Appl. Mater. 1, 011002 (2013).DOI
- [13]S. Kirklin, J. E. Saal, B. Meredig, A. Thompson, J. W. Doak, M. Aykol, S. Rühl, and C. Wolverton, The open quantum materials database (OQMD): assessing the accuracy of DFT formation energies, npj Comput. Mater. 1, 15010 (2015).DOI
- [14]S. Curtarolo, W. Setyawan, S. Wang, J. Xue, K. Yang, R. H. Taylor, L. J. Nelson, G. L. Hart, S. Sanvito, M. Buongiorno-Nardelli, N. Mingo, and O. Levy, AFLOWLIB.ORG: A distributed materials properties repository from high-throughput ab initio calculations, Comput. Mater. Sci. 58, 227–235 (2012).
- [15]J. Schmidt, T. F. Cerqueira, A. H. Romero, A. Loew, F. Jäger, H.-C. Wang, S. Botti, and M. A. Marques, Improving machine-learning models in materials science through large datasets, Mater. Today Phys. 48, 101560 (2024).
- [16]M. Scheidgen, L. Himanen, A. N. Ladines, D. Sikter, M. Nakhaee, A. Fekete, T. Chang, A. Golparvar, J. A. Márquez, S. Brockhauser, S. Brückner, L. M. Ghiringhelli, F. Dietrich, D. Lehmberg, T. Denell, A. Albino, H. Näström, S. Shabih, F. Dobener, M. Kühbach, R. Mozumder, J. F. Rudzinski, N. Daelman, J. M. Pizarro, M. Kuban, C. Salazar, P. Ondráčka, H.-J. Bungartz, and C. Draxl, NOMAD: A distributed web-based platform for managing materials science research data, J. Open Source Softw. 8, 5388 (2023).DOI
- [17]C. Chen, W. Ye, Y. Zuo, C. Zheng, and S. P. Ong, Graph networks as a universal machine learning framework for molecules and crystals, Chem. Mater. 31, 3564–3572 (2019).DOI
- [18]C. Chen and S. P. Ong, A universal graph deep learning interatomic potential for the periodic table, Nat. Comput. Sci. 2, 718–728 (2022).DOI
- [19]I. Batatia, D. P. Kovacs, G. Simm, C. Ortner, and G. Csányi, MACE: Higher order equivariant message passing neural networks for fast and accurate force fields, in Advances in Neural Information Processing Systems, Vol. 35, edited by S. Koyejо, S. Mohamed, A. Agarwal, D. Belgrave, K. Cho, and A. Oh (Curran Associates, Inc., 2022) pp. 11423–11436.
- [20]M. Neumann, J. Gin, B. Rhodes, S. Bennett, Z. Li, H. Choubisa, A. Hussey, and J. Godwin, Orb: A fast, scalable neural network potential, arXiv , 2410.22570 (2024).arxiv.org/abs/2410.22570
- [21]Y. Park, J. Kim, S. Hwang, and S. Han, Scalable parallel algorithm for graph neural network interatomic potentials in molecular dynamics simulations, J. Chem. Theory Comput. 20, 4857–4868 (2024).DOI
- [22]Y.-L. Liao, B. M. Wood, A. Das, and T. Smidt, EquiformerV2: Improved equivariant transformer for scaling to higher-degree representations, in The Twelfth International Conference on Learning Representations (2024).arxiv.org/abs/2306.12059
- [23]B. Deng, P. Zhong, K. Jun, J. Riebesell, K. Han, C. J. Bartel, and G. Ceder, CHGNet as a pretrained universal neural network potential for charge-informed atomistic modelling, Nat. Mach. Intell. 5, 1031–1041 (2023).DOI
- [24]K. Choudhary and B. DeCost, Atomistic line graph neural network for improved materials property predictions, npj Comput. Mater. 7, 185 (2021).DOI
- [25]J. Riebesell, R. E. A. Goodall, P. Benner, Y. Chiang, B. Deng, A. A. Lee, A. Jain, and K. A. Persson, Matbench discovery – a framework to evaluate machine learning crystal stability predictions, arXiv , 2308.14920 (2023).arxiv.org/abs/2308.14920
- [26]Y.-L. Liao, T. Smidt, M. Shuaibi, and A. Das, Generalizing denoising to non-equilibrium structures improves equivariant force fields, arXiv , 2403.0954 (2024).arxiv.org/abs/2403.09549
- [27]L. Barroso-Luque, M. Shuaibi, X. Fu, B. M. Wood, M. Dzamba, M. Gao, A. Rizvi, C. L. Zitnick, and Z. W. Ulissi, Open materials 2024 (OMat24) inorganic materials dataset and models, arXiv , 2410.12771 (2024).
- [28]B. Focassio, L. P. M. Freitas, and G. R. Schleder, Performance assessment of universal machine learning interatomic potentials: Challenges and directions for materials’ surfaces, ACS Appl. Mater. Interfaces (2024).
- [29]B. Póta, P. Ahlawat, G. Csányi, and M. Simoncelli, Thermal conductivity predictions with foundation atomistic models, arXiv , 2408.00755 (2024).arxiv.org/abs/2408.00755
- [30]H. Yu, M. Giantomassi, G. Materzanini, J. Wang, and G.-M. Rignanese, Systematic assessment of various universal machine-learning interatomic potentials, Mater. Genome Eng. Adv. 2, e58 (2024).arxiv.org/abs/2403.05729
- [31]H.-M. Hu, C. Hu, Y. Zhou, X. Liu, Y. Shi, J. Li, G. Li, Z. Chen, S. Chen, C. Zeni, M. Horton, R. Pinsler, A. Fowler, D. Zügner, T. Xie, J. Smith, L. Sun, Q. Wang, L. Kong, C. Liu, H. Hao, and Z. Lu, Mattersim: A deep learning atomistic model across elements, temperatures and pressures, arXiv , 2405.04967 (2024).
- [32]R. Drautz, Atomic cluster expansion for accurate and transferable interatomic potentials, Phys. Rev. B 99, 014104 (2019).DOI
- [33]A. Sanchez-Gonzalez, J. Godwin, T. Pfaff, R. Ying, J. Leskovec, and P. W. Battaglia, Learning to simulate complex physics with graph networks, arXiv , 2002.09405 (2020).
- [34]National Institute for Materials Science Japan, MDR phonon calculation database, https://mdr.nims.go.jp/collections/8g84ms862?locale=en, Accessed: November 04, 2024.DOI
- [35]J. P. Perdew, A. Ruzsinszky, G. I. Csonka, O. A. Vydrov, G. E. Scuseria, L. A. Constantin, X. Zhou, and K. Burke, Restoring the density-gradient expansion for exchange in solids and surfaces, Phys. Rev. Lett. 100, 136406 (2008).pubmed.ncbi.nlm.nih.gov/18517979
- [36]G. I. Csonka, J. P. Perdew, A. Ruzsinszky, P. H. T. Philipsen, S. Lebègue, J. Paier, O. A. Vydrov, and J. G. Ángyán, Assessing the performance of recent density functionals for bulk solids, Phys. Rev. B 79, 155107 (2009).DOI
- [37]R. Hussein, J. Schmidt, T. Barros, M. A. L. Marques, and S. Botti, Machine-learning correction to density-functional crystal structure optimization, MRS Bull. 47, 765–771 (2022).
- [38]L. He, F. Liu, G. Hautier, M. J. T. Oliveira, M. A. L. Marques, F. D. Vila, J. J. Rehr, G.-M. Rignanese, and A. Zhou, Accuracy of generalized gradient approximation functionals for density-functional perturbation theory calculations, Phys. Rev. B 89, 064305 (2014).DOI
- [39]J. P. Perdew, K. Burke, and M. Ernzerhof, Generalized gradient approximation made simple, Phys. Rev. Lett. 77, 3865 (1996).pubmed.ncbi.nlm.nih.gov/10062328
- [40]G. Bergerhoff, R. Hundt, R. Sievers, and I. D. Brown, The inorganic crystal structure data base, J. Chem. Inf. Model. 23, 66–69 (1983).DOI
- [41]S. Haastrup, M. Strange, M. Pandey, T. Deilmann, P. S. Schmidt, N. F. Hinsche, M. N. Gjerding, D. Torelli, P. M. Larsen, A. C. Riis-Jensen, J. Gath, K. W. Jacobsen, J. Jørgen Mortensen, T. Olsen, and K. S. Thygesen, The computational 2D materials database: high-throughput modeling and discovery of atomically thin crystals, 2D Mater. 5, 042002 (2018).DOI
- [42]Z. Zhu, J. Park, H. Sahasrabuddhe, A. M. Ganose, R. Chang, J. W. Lawson, and A. Jain, A high-throughput framework for lattice dynamics, npj Comput. Mater. 10, 258 (2024).DOI
- [43]K. Choudhary, K. F. Garrity, V. Sharma, A. J. Biacchi, A. R. Hight Walker, and F. Tavazza, High-throughput density functional perturbation theory and machine learning predictions of infrared, piezoelectric, and dielectric responses, npj Comput. Mater. 6, 64 (2020).DOI
- [44]T. F. T. Cerqueira, A. Sanna, and M. A. L. Marques, Sampling the materials space for conventional superconducting compounds, Adv. Mater. 36, 2307085 (2023).DOI
- [45]F. Bigi, M. Langer, and M. Cer iotti, The dark side of the forces: assessing non-conservative force models for atomistic machine learning, arXiv , 2408.00755 (2024).arxiv.org/abs/2412.11569
- [46]G. Kresse and J. Furthmüller, Efficiency of ab-initio total energy calculations for metals and semiconductors using a plane-wave basis set, Comput. Mater. Sci. 6, 15–50 (1996).DOI
- [47]G. Kresse and J. Furthmüller, Efficient iterative schemes for ab initio total-energy calculations using a plane-wave basis set, Phys. Rev. B 54, 11169 (1996).pubmed.ncbi.nlm.nih.gov/9984901
- [48]A. Togo, First-principles phonon calculations with Phonopy and Phono3py, J. Phys. Soc. Jpn. 92, 012001 (2023).DOI
- [49]A. Togo, L. Chaput, and I. Tanaka, Distributions of phonon lifetimes in Brillouin zones, Phys. Rev. B 91, 094306 (2015).DOI
- [50]A. Hjorth Larsen, J. Jørgen Mortensen, J. Blomqvist, I. E. Castelli, R. Christensen, M. Dułak, J. Friis, M. N. Groves, B. Hammer, C. Hargus, E. D. Hermes, P. C. Jennings, P. Bjerre Jensen, J. Kermode, J. R. Kitchin, E. Leonhard Kolsbjerg, J. Kubal, K. Kaasbjer g, S. Lysgaard, J. Bergmann Maronsson, T. Maxson, T. Olsen, L. Pastewka, A. Peterson, C. Rostgaard, J. Schiøtz, O. Schütt, M. Strange, K. S. Thygesen, T. Vegge, L. Vilhelmsen, M. Walter, Z. Zeng, and K. W. Jacobsen, The atomic simulation environment—a Python library for working with atoms, J. Phys.:Condens. Matter 29, 273002 (2017).DOI
- [51]E. Bitzek, P. Koskinen, F. Gä hler, M. Moseler, and P. Gumbsch, Structural relaxation made simple, Phys. Rev. Lett. 97, 170201 (2006).pubmed.ncbi.nlm.nih.gov/17155444

