In this note, we establish some connections between standard (data-driven) neural network-based solvers for PDE and eigenvalue problems developed on one side in the applied mathematics and engineering communities (e.g. Deep-Ritz and Physics Informed Neural Networks (PINN)), and on the other side in quantum chemistry (e.g. Variational Monte Carlo algorithms, Ferminet or Paulinet following the pioneer work of Carleo et. al. In particular, we re-formulate a PINN algorithm as a fitting problem with data corresponding to the solution to a standard Diffusion Monte Carlo algorithm initialized thanks to neural network-based Variational Monte Carlo. Connections at the level of the optimization algorithms are also established.
Introduction
In less than 10 years (since 2017), Physics Informed Neural Networks (PINN) has emerged as a major player in the field of computational methods for solving direct and inverse problems involving (high-dimensional) parameterized partial differential equations (PDEs) [23, 26, 19, 1]. The principle is to seek solutions to PDEs in the form of data-driven neural networks, optimized by minimizing PDE residuals. These techniques, along with others such as polynomial regression, Gaussian process, reduced order modeling, or Deep Ritz [25], have become highly popular in several engineering fields (e.g. mechanical engineering, fluid dynamics) as they allow to a certain extent, the tackling of problems that are inaccessible with traditional PDE solvers.
There is a tremendous effort within the mathematics and computer science communities to address several open questions related to convergence, approximability, efficient high-dimensional optimizers, etc., in Scientific Machine Learning, including PINN-like techniques. Independently of the development of PINN-like methods by the mathematics, engineering, computer science, and statistics communities, significant practical progress has been achieved in quantum chemistry and quantum physics in the development of neural network-based Variational Monte Carlo (VMC) and Diffusion Monte Carlo (DMC) methods. This has enabled the calculation of the electronic structure of molecules larger than those usually considered with traditional computational methods. This approach corresponds mathematically to the approximation of the lowest eigenvalues (energies) of high-dimensional Schrödinger operators. Following the construction of Neural Quantum States (NQS) [7, 8], several corresponding libraries have been developed, such as Ferminet by DeepMind/Google [9, 22] or Paulinet [15].
To our knowledge, the two above formalisms have never been unified or even rigorously connected, despite their strong similarities. In this manuscript, we establish some connections potentially relevant for the development of a mathematical formalism unifying these modern techniques. More specifically, we will reformulate the so-called Neural-Variation Diffusion Monte Carlo (N-VDMC), corresponding roughly to a standard DMC method where the trial wavefunction is computed through a VMC method (corresponding to a Deep-Ritz algorithm [25]) as proposed for instance in Ferminet. Let us also mention [14], where a neural network based variational solving for many-body Schroedinger Hamiltonian is proposed. We will also show that at the level of the optimization algorithm (gradient descent-like algorithm) a N-VDMC is indeed “similar” to a PINN method applied to a diffusion equation (PINN-DE) derived from the time-dependent Schrödinger equation.
In the first part of the manuscript, we will propose a short presentation of PINN, VMC, and DMC and N-VDMC algorithms. We then show that we can reformulate the PINN algorithm as a fitting problem with data, corresponding to the solution to a N-VDMC algorithm. We will then show that at the level of the optimization algorithm, a modified version of N-VDMC leads to the same gradient descent algorithm as PINN.
In this manuscript, we do not discuss the (very complex) structure of the neural networks usually used in quantum chemistry which follows standard strategies based on one-electron orbitals and Slater’s determinants [24], and refer to [22, 7, 8] for details. However, the properties and connections presented in this manuscript are largely independent of the structure of the neural networks; the latter will be treated here as a parameterized functions.
Mathematical set-up
We denote by H the exact N-particle Schrödinger Hamiltonian of domain D(H)=H2(R3N;C) and by R=(r1,…,rN)∈R3N with ri the 3-dimensional coordinates of the ith particle, see [10, 24]. We denote by ϕG(R) the groundstate of H
HϕG(R)=EGϕG(R),
where H reads
H=−21∇R2+Vp(R)−ET,
and where ET is a so-called off-set energy and Vp the potential energy of the considered molecule/atom. In this work, we consider a relatively general framework, as we will “only” establish high-level connections between PINN-like algorithms and neural network-based VMC and DMC algorithms.
Basics on neural networks
Let us here recall the basics of fully connected neural networks. The latter are parameterized functions constructed as the composition of i) discrete convoluted linear functions, and ii) nonlinear functions. In a d-dimension the space, we introduce l∈N, ni∈N for i=0,1,…,l, with n0=d. We denote by θ∈Θ:=∏i=1lRni×(ni−1+1) the neural network parameters such that: θ={θi}i with θi=(wi,bi)∈Rni×ni−1×Rni and i=1,…,l. A network f in Rd is a function from ∏i=1lRni×(ni−1+1)×Rd to Rnl such that
f(θ;τ)=wlσ(wl−1(σ(w2σ(w1τ+b1)+b2)⋯)+bl−1)+bl,(1)
where σ is a so-called activation function. We refer to [16, 2] for details on neural networks. The use of neural network-based algorithms for PDE and eigenvalue problems largely rely on approximability theorems such as the celebrated Cybenko’s Universal Approximation theorem [11] and more recently [12, 13]. Let us repeat that here, we do not discuss the very elaborated structure of neural networks used for approximating wavefunctions in high-dimensional electronic structure problems, but refer to [22, 7, 8].
Deep-Ritz / Ferminet
Following the celebrated works of Carleo et al. [7, 8] on neural quantum states, Ferminet [9, 22] has become a standard electronic structure calculation library, which is based on the minimization of the Rayleigh quotient
EG=ϕmin⟨ϕ,ϕ⟩⟨Hϕ,ϕ⟩,
thanks to a Variational Monte-Carlo using a neural network ϕ(ϑ;R) as ansatz; and where we have used the notation ⟨Hϕ,ϕ⟩ where ⟨⋅,⋅⟩ denotes the L2-inner product. The groundstate ϕG is approximated by an optimized neural network ψT:R∈R3N↦ϕ(ϑ∗;R), such that
ϑ∗=ϑargmin⟨ϕ(ϑ;⋅),ϕ(ϑ;⋅)⟩⟨Hϕ(ϑ;⋅),ϕ(ϑ;⋅)⟩.
Practically, the Rayleigh quotient is minimized thanks to automatic differentiation and using Monte-Carlo integration with learning nodes {Rα}α in R3N
hence defining an approximate groundstate. This approach can be seen as a Deep-Ritz algorithm [25]; corresponding to a class of variational neural network-based solvers for PDE and eigenvalue problems. In the following, the use of neural network as ansatz for minimizing the Rayleigh quotient will be referred as Neural-Variational Monte Carlo (N-VMC).
Diffusion Monte Carlo and Neural Diffusion Monte Carlo
Let us shortly recall the principle of the DMC method [20, 18, 6, 17, 27]. The latter relies on the computation over, say Q:=R3N×R+, of the following function
f(R,t)=ψT(R)ϕ(R,t),
where ψT is a given trial function approximating ϕG for a N-particle Schrödinger operator. The function f satisfies the following equation on Q, and we will refer to the Diffusion Equation (DE)
leading to EG=⟨HϕG,ψT⟩/⟨ϕG,ψT⟩, as long as ψT has an overlap with ϕG. From a practical point of view the above approach is discretized using a sequence of time-dependent random walks {Rα(t)}α from t to R3N, and allowing for the construction of a function f~ approximating f in the form (see [27])
A sequence of discrete times t0=0<t1<⋯<ti<ti+1<⋯ and dt=ti+1−ti for any i∈N is introduced. For {R0α,t0}α given, we define f~iα=f~(Riα,ti), such that
Ri+1α=Riα+dtV0(Riα)+dtηi,
f~i+1α=f~iαexp(dt(S0(Ri+1α)+S0(Riα))/2).
with ηi=η(ti) where η is a 3N-dimensional Gaussian random vector with null mean E[η]=0 (in space and time) and variance equal to dt. Moreover E[η2]=3N, where η2 denotes η⋅η. Acceptance/rejection process is based on Metropolis’ probability [17] and we set for any i
f~i(R)=f~(R,ti)=∑αf~iα∑αf~iαδ(R−Riα).
Finally, for i large enough and denoting by ⟨⋅⟩α the average over the walkers, we get the mixed estimator at any time ti, Emixi=⟨E~i−1(Riα)f~iα⟩α/⟨f~iα⟩α.
Initialization. In the N-VDMC algorithm, the trial function ψT is computed from a neural-network VMC/Deep-Ritz method referred above as a N-VMC method [7, 8, 9, 15, 25]. In this goal, we introduce a neural-network ϕ^T(ϑ;R) with parameters ϑ. Deep-Ritz/Ferminet consists in minimizing
We denote f0(R)=ϕ^T2(ϑ∗;R) which is taken as the initial data to (2) for both N-VDMC and PINN. In practice, for a fixed set of initial positions {R0α}α, we define
f~0(R)=∑αf0(R0α)∑αf0(R0α)δ(R−R0α).
For the sake of notation simplicity, hereafter we will denote fi the DMC-solution (in place of f~i) at time ti, while f^i will refer to the PINN-solution.
Basics on PINN
Physics Informed Neural Networks (PINN) [23, 26, 19, 1] has become a standard methodology in engineering and applied mathematics for the data-driven computation of partial differential equations. A PINN-like solution to a differential system (S) is a (smooth and usually data-driven) neural network optimized thanks to the minimization of the norm of the PDE residual of (S) evaluated at some (randomly chosen) learning nodes. This approach has recently gained a huge interest in scientific machine learning thanks to their simplicity, their nice mathematical and computational properties coming in particular from automatic differentiation and efficient stochastic gradient descent methods [5].
We now discuss the principle of PINN algorithms for solving (2). In order to avoid a null solution (which can occur for large times), it is preferable to decompose the time-domain as follows: R+=⋃i=1∞[ti−1,ti), with t0=0<t1<⋯<ti<ti+1<⋯ and we denote dt=ti+1−ti and Qi=R3N×[ti−1,ti). In general dt does not represent a time-step (and the time-derivative is not approximated) and can often be taken much larger than usual time steps in standard computational solvers such as DMC. It is also possible to solve (2) by considering it as a boundary value problem, hence without approximating the time derivative. In this paper, as the objective is to propose links to N-VDMC algorithms, within PINN we propose a first order discretization of ∂t, so that dt actually represents the same time-step as the one used in DMC.
On Q0 and for f0=ψT2 given, we search for a neural network f:(θ;R)∈Θ×R3N→R which i) optimized by minimizing the commonly called loss (objective) function
The approximate solution to (2) at ti is then denoted by fi(R)=f(θi∗;R), where
θi∗=θargminLi(θ).
In high-dimension, the L2-norm are computed using Monte-Carlo integrations; this allows to connect PINN and DMC. Hence for i large enough we get an approximation to f(R,ti) from which we get can obtain an approximate ground state and approximate ground state energy. More specifically, denoting {Rα}α a set of M randomly chosen learning nodes over R3N approximating (6) by the commonly called training lossLi(PINN) defined as follows.
By abuse of notation, in the following we will keep the notation Li(PINN)(θ) to represent the training loss.
Hereafter, we will use the L2-inner product (⟨⋅,⋅⟩L2(R3N)) and norm (∥⋅∥L2(R3N)) to define the loss functions. However when the searched solution has more regularity (say Hs for s≥1, corresponding to the L2-functions with derivatives (up to the sth ones) in L2, using the Hs-norm can potentially improve the minimization process and/or provide a more precise approximate solution as recently proven in recent several papers, where PINN algorithms are applied for instance to Navier-Stokes equations, geophysical models or nonlinear Schrödinger equations [12, 13]. Further investigations will be conducted in the framework of quantum chemistry.
Inclusion of data
One of the key interests of neural networks is the use of data allowing to drive/supervise the learning of the searched eigenstate(s). It basically consists in adding to the loss function, a data-fitting contribution allowing for a more accurate neural network optimization. As an example of supervised learning, let us consider a Schrödinger operator with parameter-dependent potentials V(R,p) with p∈Π and Π a bounded subset of Rπ with π∈N∖{0}. Then we search for a neural network ϕ^:(θ;R,p)∈Θ×R3N×Π↦ϕ^(θ;R,p)∈R approximating a p-dependent groundstate ϕG:(R,p)∈R3N×Π↦ϕG(R,p)∈R. Assuming that the groundstate was computed for q parameters p1,⋯,pq, we add to the loss function the following contribution/constraint.
L(θ)←L(θ)+k=1∑qα∑ϕ^(θ;Rα,pk)−ϕG(Rα,pk)2.
As data inclusion is similarly performed within N-VDMC, Deep-Ritz/ferminet and PINN algorithms, in this paper we do not focus on this aspect.
Organization
The rest of the manuscript is organized as follows. In Section 2, we show that the standard PINN-DE algorithm can be reformulated as a fitting problem for the N-VDMC solution. Section 3 is devoted to the comparison at the optimization level, of a modified N-VDMC algorithm with the standard PINN-DE algorithm. We conclude in Section 4.
Standard N-VDMC vs PINN-DE
In this section, we establish connections between N-VDMC (trial wavefunction estimated by N-VMC) and PINN-DE algorithms. We show that a PINN-DE can be reformulated as a fitting problem for data corresponding to the DMC solution where the nodes used in the Monte Carlo integration are the DMC random walks.
In the following fi will refer to the DMC-solution at time ti, while f^i will refer to the PINN-solution.
Preliminary remark
In order to connect the PINN-DE and DMC methods we will rewrite those methods in a weak form. At iteration i≥1, let us recall that the PINN loss function reads
In the following subsection, we will use (10) to reformulate (8).
PINN as a fitting algorithm for DMC
The objective is here then to rewrite Li(PINN) using {fi}i, the N-VDMC solution. At iteration i−1, we assume given f^i−1(R) the approximate solution to PINN-DE at time ti. We construct the smooth function Φ, as follows
In order to connect the PINN and N-VDMC algorithms, in PINN’s loss function, we select the learning nodes {Rα}α over Qi=[ti,ti+1]×R3N, as the electron positions from DMC; that is: {Rα}α={Riα}α. For the sake of readiness, we use hereafter the following notation
We next introduce the following sequence {ϵi−1α}α and {δi−1α}α
ϵi−1α=fi−1α−f^i−1α,δi−1α=f0;i−1α−f^i−1α,
corresponding to the difference between i) the N-VDMC and PINN-DE solutions and ii) the trial function and the PINN-DE solution, at time ti−1 and at {Ri−1α}α. Hence using fiα=fi−1α(1+dtSi−1α)+O(ηi−1dt3/2)+O(dt2) (see (9)), we get
We next use that η is a Gaussian random process, such that
M1α∑ηi−1=O(M1),M1α∑ηi−12=3N+O(M1).
This allows to simplify the expression of the loss function and getting rid of the ηi−1 terms, the PINN-DE loss function can be rewritten as a fitting problem.
We can actually refine this result. For i=1, as the initial data in PINN and DMC are taken identical then ε0α and δ0α are null, so that S0α=S0;0α, V0α=V0;0α and as a consequence ε0α(θ)=O(dt2). Hence, assuming that the loss can be as small as wanted (which is however in general, a very strong assumption), we can deduce by induction that εiα(θ)=O(dt2). Thus, PINN can be seen as a data-fitting algorithm N-VDMC from data {fiα}α up to a (small) correction εi−1α. More specifically, we can state the following proposition.
Proposition 2.1. Let us denote by {fiα}α the N-VDMC solution at time iteration i≥1. Assume that the PINN training loss function can be as small as possible up to iteration i−1. Then, at iteration i, the PINN training loss can be reformulated as a fitting problem on {fiα}α:
where εiα(θ)=O(dt2) and M is the number of learning nodes.
Optimization algorithm for Modified N-VDMC and PINN-DE
In this section we show that both the N-VDMC and PINN-DE algorithms lead at first order, to comparable optimization algorithms; hence lead to comparable optimized neural networks approximating the groundstate to the Schrödinger operator. More specifically, we show that the PINN method i) applied to the Imaginary Time Method (ITM) referred here as PINN-ITM, and ii) applied to the diffusion equation (2) PINN-DE, lead to a gradient descent algorithm similar to the one of a modified N-VDMC method. In the previous section, the N-VDMC algorithm (1.4) is initialized once for all at t=t0 thanks to a N-VMC algorithm (Ferminet/Deep-Ritz). Hereafter, on each time interval [ti,ti+1], the so-called modified N-VDMC is reinitialized (at t=ti) from a N-VMC algorithm, as long as ϕi−1 is smooth and strictly positive; we refer to § 2. Moreover within the PINN algorithms, the learning nodes are taken as the electron positions from DMC. For simplicity, in the following we also set ET=0.
On Qi and setting f(θ;ti)=fi−1=ϕi−12 and f(θ;⋅)=ψ(θ;⋅)ϕi−1, we rewrite
In this subsection, we derive the optimization algorithm for the 3 different approaches: PINN-ITM, PINN-DE and N-VDMC. We here assume that on each Qi the same learning nodes/randoms walks {Riα}α={Riα}α are used in the 3 different algorithms.
Neural network optimization for PINN-ITM. Let us first recall that the imaginary time method can be reformulated as a minimizing the energy associated to the Hamiltonian H.
Minimizing R the Rayleigh quotient, is equivalent under technical conditions to the imaginary time method. From for any t and assuming given a normalized function ϕ0 in R3N, we search for ψ in Q=R3N×R+ solution to the time-dependent Schrödinger equation in imaginary time, such that
for negative potentials (see [4, 3]), then limt→∞ψ(⋅,t)=ϕG. In other words under technical assumptions, solving (14) is equivalent to solving (15).
In practice, in order to solve (15) the imaginary time method requires a time-discretization t0=0<t1<⋯<ti<ti+1<⋯. Then, assumed given a normalized function ϕi−1 in R3N, we search for ϕi in R3N such that on Qi=R3N×[ti−1,ti]
Solving (17) with PINN is equivalent to searching for a neural network using PINN ψ(ϑi;R) such that ϑi=argminϑMi(ϑ), where (at the continuous level)
Proposition 3.1.The gradient descent algorithm applied to the training loss approximating the continuous PINN-ITM loss Mi(PINN), using learning nodes {Riα}α on R3N, reads as follows
Neural network optimization for PINN-DE. We here reformulate the DE presented in Subsection 1.4 from (16) on Qi by multiplying the PDE by ϕi−1. We define f:=ϕi−1ψ which satisfies on Qi
Then assuming fi−1 given, a PINN method consists in searching for a neural network f(θi∗;⋅) with θi∗=argminθLi(PINN)(θ), where (at the continuous level)
Proposition 3.2. The gradient descent algorithm applied to the training loss approximating the continuous PINN-DE loss Li(PINN), using learning nodes {Riα}α on R3N, reads as follows
Neural network optimization for N-VDMC. The N-VDMC method is a combination of N-VCM and DMC methods. More specifically, unlike the “standard” N-VDMC presented in the previous section where N-VMC was only applied once at t=t0, we here assume that VMC is applied at each ti with i≥1. In other words, on Qi, we initialize the wavefunction with a N-VMC algorithm (Ferminet), as long as the initial states ϕi−1 are smooth and positive. Then we apply a DMC algorithm from ti−1 to ti. More specifically, we minimize Ri(ψ(ϑ)) where
Ri(ψ(ϑ))=⟨ψ(ϑ;⋅),ψ(ϑ;⋅)⟩⟨Hψ(ϑ;⋅),ψ(ϑ;⋅)⟩,
and where the corresponding gradient descent method is initialized with the solution to the DMC solution at time ti−1 (which differs from ϕi−1). The converged solution is then denoted by ϕi−1. Let us consider VMC/DMC on Qi assuming that ψ (from DMC) is such that
Proposition 3.3. The gradient descent algorithm applied to N-VDMC where the continuous loss function Ri is approximated thanks to the learning nodes {Riα}α on R3N, reads as follows
The above discussion allows to deduce that up to a O(dt2), the PINN-DE and N-VDMC algorithms lead to the same optimization algorithms (20) and (21). In addition, by choosing ⟨⋅,⋅⟩ϕ^i−1 as the inner product (at iteration i), still up to a O(dt2) the PINN-ITM algorithm also leads to the same optimization algorithm, see (18).
Recall that the “direct” N-VDMC as described in § 1.4 (see [27]) and unlike the modified version used above, does not require to the use of VMC at each time iteration ti and as a consequence is much less computationally complex. Notice that PINN-like algorithms do not necessarily require the discretization of the time-derivative. Instead we can search for a neural network on QT=R3N×[0,T] (for T large enough) with f0=ψT2 given, for a neural network f^:(θ;R,t)∈Θ×Q→R (and designed such that f^:(θ;R,0)=f0(R)) by minimizing
In principle, the computation is performed once for all over Q, hence avoiding the use of N-VMC at intermediate times ti. In practice, it may still however be necessary to decompose the time-domain [0,T] in several subdomains ([Ti,Ti+1] of length larger than dt) used in DMC to avoid the computation of a null network.
Conclusion
NQS, Ferminet and PINN, Deep-Ritz have become very popular libraries and algorithms which were developed independently to each other in different fields of research. In this manuscript we have established non-trivial bridges between these different methodologies. We think that these connections may be beneficial for future developments in the different involved scientific communities. Naturally, PINN algorithms for solving (2) are more computationally complex than DMC-like algorithms, as they approximate PDE solutions, unlike DMC algorithms which only evaluate “trajectories”. In future works, we plan to develop efficient PINN-like algorithms for eigenvalue problems in the spirit of DMC algorithms. Data-driven PINN algorithms will be explored for high-dimensional quantum chemistry evolution problems (for instance in the spirit of [21]), such as laser-molecule interactions.
References
[1]T. Alt, K. Schrader, M. Augustin, P. Peter, and J. Weickert. Connections between numerical algorithms for PDE and neural networks. Journal of Mathematical Imaging and Vision, 65(1):185–208, 2023.arxiv.org/abs/2107.14742
[2]M. Anthony and P. L. Bartlett. Neural network learning: theoretical foundations. Cambridge University Press, Cambridge, 1999.
[3]W. Bao and Y. Cai. Mathematical theory and numerical methods for Bose-Einstein condensation. Kinetic and Related Models, 6(1):1–135, 2013.DOI
[4]W. Bao and Q. Du. Computing the ground state solution of Bose-Einstein condensates by a normalized gradient flow. SIAM Journal on Scientific Computing, 25(5):1674–1697, 2004.arxiv.org/abs/cond-mat/0303241
[5]L. Bottou, F. E. Curtis, and J. Nocedal. Optimization methods for large-scale machine learning. SIAM Rev., 60(2):223–311, 2018.arxiv.org/abs/1606.04838
[6]M. Caffarel, P. Del Moral, and L. de Montella. On the mathematical foundations of diffusion Monte Carlo, 2024.arxiv.org/abs/2402.04642
[7]G Carlo, I. Cirac, K. Cranmer, L. Daudet, M. Schuld, N. Tishby, L. Vogt-Maranto, and L. Zdeborová. Machine learning and the physical sciences. Rev. Mod. Phys., 91:045002, Dec 2019.DOI
[8]G. Carleo and M. Troyer. Solving the quantum many-body problem with artificial neural networks. Science, 355(6325):602–606, 2017.DOI
[9]K. Choo, A. Mezzacapo, and G. Carleo. Fermionic neural-network states for ab-initio electronic struc ture. Nature Communications, 11(1), 2020.DOI
[10]C. Cohen-Tannoudji, J. Dupont-Roc, and G. Grynberg. Atom-photon interactions. Wiley Interscience, N.Y., 1992.
[11]G. Cybenko. Approximation by superpositions of a sigmoidal function. Math. Control. Signals Syst., 2(4):303–314, 1989.
[12]T. De Ryck, A. D. Jagtap, and S. Mishra. Error estimates for physics-informed neural networks approximating the navier–stokes equations. IMA Journal of Numerical Analysis, 44(1):83–119, 2024.
[13]T. De Ryck, S. Lanthaler, and S. Mishra. On the approximation of functions by tanh neural networks. Neural Networks, 143:732–750, 2021.DOI
[14]Jiequn H., Linfeng Z., and Weinan E. Solving many-electron schrödinger equation using deep neural networks. J. of Comput. Phys., 399:108929, 2019.DOI
[15]J. Hermann, Z. Schätzle, and F. Noé. Deep-neural-network solution of the electronic Schroedinger equation. Nature Chemistry, 12(10):891 – 897, 2020.
[16]J. J. Hopfield. Neural networks and physical systems with emergent collective computational abilities. Proc. Nat. Acad. Sci. U.S.A., 79(8):2554–2558, 1982.
[17]M. H. Kalos. Monte Carlo calculations of the ground state of three- and four-body nuclei. Phys. Rev., 128:1791–1795, Nov 1962.
[18]I. Kosztin, B. Faber, and K. Schulten. Introduction to the diffusion Monte Carlo method. American Journal of Physics, 64(5):633–644, May 1996.DOI
[19]I.E. Lagaris, A. Likas, and D.I. Fotiadis. Artificial neural networks for solving ordinary and partial differential equations. IEEE Transactions on Neural Networks, 9(5):987–1000, 1998.DOI
[20]N. Metropolis and S. Ulam. The Monte Carlo method. Journal of the American Statistical Association, 44(247):335–341, 1949.
[21]Jannes Nys, Zakari Denis, and Giuseppe Carleo. Real-time quantum dynamics of thermal states with neural thermofields, 2024.arxiv.org/abs/2309.07063
[22]D. Pfau, J. S. Spencer, A. G. D. G. Matthews, and W. M. C. Foulkes. Ab initio solution of the many-electron Schroedinger equation with deep neural networks. Physical Review Research, 2(3), September 2020.
[23]M. Raissi, P. Perdikaris, and G.E. Karniadakis. Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations. Journal of Computational Physics, 378:686–707, 2019.DOI
[24]A. Szabo and N.S. Ostlund. Modern Quantum Chemistry: Introduction to Advanced Electronic Structure Theory. Dover Books on Chemistry Series. Dover Publications, 1996.
[25]E. Weinan and Bing Yu. The deep Ritz method: A deep learning-based numerical algorithm for solving variational problems. Communications in Mathematics and Statistics, 6(1):1 – 12, 2018.
[26]L. Yang, D. Zhang, and G. E. Karniadakis. Physics-informed generative adversarial networks for stochastic differential equations. SIAM J. Sci. Comput., 42(1):A292–A317, 2020.arxiv.org/abs/1811.02033
[27]A. Zen, S. Sorella, M. J. Gillan, A. Michaelides, and D. Alfè. Boosting the accuracy and speed of quantum Monte Carlo: Size consistency and time step. Physical Review B, 93(24), jun 2016.DOI