betaFeedback

WorksPhysics and Astronomy

Regularized Neural Quantum States for Heisenberg Magnets

Abstract

We introduce an approach to solving locally ordered quantum spin systems using neural network quantum states. First, our approach rests on choosing a spin basis constructed from the magnetic texture of a classical or quantum reference state. Second, the method improves convergence and suppresses parameter-space drift through a regularized Riemannian gradient descent adapted to the quantum state geometry of the variational state manifold. Combining these techniques enables stable ground-state calculations for two- and three-dimensional chiral spin systems with Dzyaloshinskii-Moriya interactions. The resulting variational ground-state energies are competitive with those of high-fidelity density matrix renormalization group calculations and, for periodic and layered geometries, provide significantly tighter upper bounds on the ground-state energy.

Introduction

Finding ground states of interacting quantum systems remains a challenging task because of the exponential complexity of generic many-body wavefunctions. In recent years, Neural Quantum States (NQS) have emerged as a powerful variational ansatz, leveraging the expressivity of artificial neural networks to represent complex wavefunctions [1, 2, 3, 4, 5]. While standard network optimization methods treat variational parameters as coordinates on a flat space [6], quantum variational states naturally reside on a curved manifold, where distances are dictated by the quantum metric [7, 8]. This observation underlies Riemannian-gradient methods, such as Stochastic Reconfiguration (SR) [1, 9, 10], which improve the optimization by following the geometry of the variational manifold [see Fig. 1(a)]. However, small eigenvalues of the quantum metric, arising from redundant or weakly resolved parameter directions and finite-sampling noise, can lead to unstable optimization, particularly for large and deep networks [11, 12, 13, 14]. Diagonal regularization of the metric is therefore commonly introduced. Beyond improving numerical conditioning, the diagonal shift acts as a statistical filter on finite-sample SR updates [15]. Restricting optimization to low-dimensional parameter subspaces has also been shown to improve NQS training stability [16]. Nevertheless, regularizing the metric does not directly constrain parameter drift along redundant directions. In particular, parameters can drift along nearly flat directions of the energy landscape without producing a corresponding change in the physical quantum state. They can thereby grow until they exceed numerical precision [17].

In this work, we introduce a Regularized Riemannian Gradient Descent (RRGD) scheme that controls this parameter-space drift while retaining the quantum geometry of the variational manifold. We derive the update from a Lagrangian with simultaneous constraints on the quantum distance of the update and the parameter norm at its endpoint. The resulting soft constraint suppresses drift along redundant parameter directions while preserving the Riemannian structure of the variational update.

Furthermore, basis rotations provide a complementary route to improving NQS optimization. Previous studies have demonstrated that global basis choices can modify the variational representation and the parameter-space distance between the initial and target states [18, 19, 20, 21]. Additionally, local orbital rotations have been jointly optimized with NQS parameters to improve the variational accuracy and the optimization landscape [22]. Here, we do not treat the basis transformation as an additional set of variational parameters. Instead, we use a physically informed, fixed local basis for ordered Heisenberg spin-1/2 magnets, which avoids introducing further redundant variational degrees of freedom. This provides a complementary approach to the optimization problem: the local frames improve the starting point, and RRGD regularizes the subsequent evolution through parameter space. We demonstrate that their combination enables stable and fast optimization of shallow NQS architectures in single precision for various atomistic spin-1/2 chiral models known to host skyrmion textures [23, 24, 25, 26]. Our simulations are implemented in a custom JAX-based code, leveraging composable automatic differentiation and just-in-time compilation [27]. We refer to the Supplemental Material [28] and [29] for additional details on the network and the training method.

Network Layout and Initialization

Throughout this work, we represent the many-body wavefunction using an NQS, which assigns a complex amplitude ψθ(σ)=⟨σ∣ψθ⟩\psi_{\boldsymbol{\theta}}(\boldsymbol{\sigma}) = \langle\boldsymbol{\sigma}|\psi_{\boldsymbol{\theta}}\rangle to each configuration σ=(σ1,…,σN)\boldsymbol{\sigma} = (\sigma_1,\ldots,\sigma_N) in a chosen computational basis {∣σ⟩}\{|\boldsymbol{\sigma}\rangle\} [1, 30]. We parameterize its logarithmic amplitude ρ\rho and phase φ\varphi using separate shallow feed-forward neural networks (FFNNs),

ln⁡ψθ(σ)=ρθρ(σ)+iφθφ(σ),(1)\ln\psi_{\boldsymbol{\theta}}(\boldsymbol{\sigma}) = \rho_{\boldsymbol{\theta}_{\rho}}(\boldsymbol{\sigma}) + i\varphi_{\boldsymbol{\theta}_{\varphi}}(\boldsymbol{\sigma}), \tag*{(1)}

where θ={θρ,θφ}∈Rnp\boldsymbol{\theta} = \{\boldsymbol{\theta}_{\rho},\boldsymbol{\theta}_{\varphi}\} \in\mathbb{R}^{n_p} represents the variational parameters. Both subsets are optimized simultaneously, as in recent phase-resolved NQS studies of frustrated and chiral magnets [31, 32, 33]. For the chosen parameterization, the quantum metric is block diagonal in (θρ,θφ)(\boldsymbol{\theta}_{\rho},\boldsymbol{\theta}_{\varphi}). Each network consists of hh parallel input transformations (heads) [28]. This architecture increases expressivity without deeply stacked network structures [see Fig. 1(b)], thereby sidestepping the optimization difficulties associated with deep architectures in the sign-sensitive regime [12, 13, 34]. Because variational parameters generally lack a direct physical interpretation, constructing a physically informed initialization requires understanding the state represented at a particular point in the parameter space {citep}[2, 5]`. For the architecture used here, the network output is configuration-independent at vanishing parameters, ψθ=0(σ)=Z≠0\psi_{\theta=0}(\sigma)=Z\ne0. Consequently, in the canonical zz-basis, the zero-parameter state is the equal-amplitude superposition

Figure 1. Geometric interpretation of gradient descent and the NQS architecture. (a) Schematic illustration of gradient flows on the sphere S2S^2 (top view), directed toward the minima of the objective function f(θ,φ)=sin⁡2θsin⁡φf(\theta,\varphi)=\sin^2\theta\sin\varphi. Euclidean gradient descent (EGD) defines steepest descent with respect to the identity metric in the angular coordinates (g=1g=1), whereas Riemannian gradient descent (RGD) uses the induced spherical metric (g=diag⁡(1,sin⁡2θ)g=\operatorname{diag}(1,\sin^2\theta)). Consequently, EGD is not intrinsically adapted to the spherical geometry and may exhibit coordinate-dependent behavior near the poles (black dot), whereas RGD accounts for the curvature of the sphere when determining the update direction and size. (b) Wavefunction ansatz architecture. The input configuration σ\sigma is processed by hh parallel heads in separate amplitude and phase branches. Their outputs are aggregated to obtain the real-valued log-amplitude Fρ(σ)F_\rho(\sigma) and phase Fφ(σ)F_\varphi(\sigma), which define the output ln⁡ψθ(σ)=Fρ(σ)+iFφ(σ)\ln\psi_\theta(\sigma)=F_\rho(\sigma)+iF_\varphi(\sigma).

∣ψθ=0⟩=Z∑σ∣σ⟩=Z⨂i=1N∑mi=−ss∣s,mi⟩z(2)\lvert\psi_{\theta=0}\rangle=Z\sum_{\sigma}\lvert\sigma\rangle=Z\bigotimes_{i=1}^{N}\sum_{m_i=-s}^{s}\lvert s,m_i\rangle_z \tag*{(2)}

which, for spin-1/2 systems, coincides with the x^\hat{x}-polarized spin-coherent state up to normalization. Thus, the origin of the parameter space has a direct physical interpretation, and displacements from θ=0\theta=0 explore the surrounding variational manifold. However, these displacements need not correspond one-to-one to physically distinct states. Redundant parameterizations and gauge degrees of freedom can give rise to directions along which the physical state remains unchanged, a feature shared with overparameterized NQS and transformer wavefunctions [35, 36, 37]. These redundancies are treated and partially alleviated by the RRGD algorithm.

Canonical Local Frames

For the systems considered here, we use the atomistic spin-1/2 Hamiltonian

H^=∑⟨i,j⟩∑α,βJijαβS^iαS^jβ+∑iBS^iz,(3)\hat{H}=\sum_{\langle i,j\rangle}\sum_{\alpha,\beta}\mathcal{J}_{ij}^{\alpha\beta}\hat{S}_{i}^{\alpha}\hat{S}_{j}^{\beta}+\sum_i B\hat{S}_i^z, \tag*{(3)}

where S^i=σ^i/2\hat{S}_i=\hat{\sigma}_i/2 denotes the spin operator at site ii and σ^\hat{\sigma} the vector of Pauli matrices. The first sum runs over unique nearest-neighbor pairs. The coupling matrix Jijαβ=Jδαβ+ϵDijαβ\mathcal{J}_{ij}^{\alpha\beta}=J\delta^{\alpha\beta}+\epsilon D_{ij}^{\alpha\beta} contains the isotropic Heisenberg exchange JJ and the Dzyaloshinskii–Moriya interaction (DMI) DijD_{ij}, while BB is a uniform external magnetic field. Depending on its orientation relative to the normalized bond vector r^ij\hat{r}_{ij}, the DMI vector takes one of two forms: Dij=Dr^ijD_{ij}=D\hat{r}_{ij} for Bloch-type DMI or Dij=Dz^×r^ijD_{ij}=D\hat{z}\times\hat{r}_{ij} for Néel-type DMI. We denote these two types by DBD_{\mathrm{B}} and DND_{\mathrm{N}}, respectively. To provide a physically informed starting point, we rewrite the Hamiltonian H^\hat{H} in a site-dependent frame aligned with a reference spin texture. The reference texture is obtained either from a classical spin configuration or from an intermediate Matrix Product State (MPS) variationally optimized by the Density Matrix Renormalization Group (DMRG) [38, 39, 40]. The corresponding transformation U^=∏iU^i(Θi,Φi)\hat{U}=\prod_i\hat{U}_i(\Theta_i,\Phi_i) defines the unitarily equivalent Hamiltonian H^′=U^†H^U^\hat{H}'=\hat{U}^{\dagger}\hat{H}\hat{U}, on which the NQS is optimized [19, 20]. The local angles (Θi,Φi)(\Theta_i,\Phi_i) are determined by the reference spin at site ii. We choose the rotation convention such that the reference spins are mapped onto the +x^+\hat{x} axis; consequently, the zero-parameter NQS represents the reference texture [28]. Furthermore, the local rotation matrices are kept fixed as nontrainable hyperparameters. Since their orientations are already determined by the reference configuration, optimizing the frame angles would enlarge the parameter space and may introduce redundant or poorly conditioned directions, without necessarily providing additional physically motivated variational freedom [34, 36]. In practice, we initialize the weights with Gaussian noise of standard deviation 10−710^{-7}.

Regularized Riemannian Gradient Descent

For normalized variational quantum states, the local state-space distance is determined by the quantum metric [7]

gij=Re⁡⟨∂ψθ∂θi|(1−∣ψ⟩⟨ψ∣)|∂ψθ∂θj⟩.(4)g_{ij}=\operatorname{Re}\left\langle\frac{\partial\psi_\theta}{\partial\theta_i}\middle|\left(1-\lvert\psi\rangle\langle\psi\rvert\right)\middle|\frac{\partial\psi_\theta}{\partial\theta_j}\right\rangle. \tag*{(4)}

Minimizing the locally linearized energy at fixed quantum distance ds2=δθTgδθds^2=\delta\theta^{\mathsf{T}}g\delta\theta gives

gδθ=−η∇θE(θ),(5)g\delta\theta=-\eta\nabla_\theta E(\theta), \tag*{(5)}

which corresponds to Riemannian gradient descent [8]. In practice, the quantities entering Eq. (5) are estimated using Markov-chain Monte Carlo sampling and the resulting method is known as stochastic reconfiguration [1, 9]. The metric is in general positive semidefinite and can become ill-conditioned due to exact null directions arising from redundant parameterizations, as well as to weakly resolved directions in its stochastic estimate. The conventional replacement g→g+ϵ1g \to g+\epsilon\mathbf{1} provides a Tikhonov-type regularization [41, 42, 43, 44, 45]. However, it bounds only the update δθ\delta\theta and does not prevent θ\theta from drifting along nearly flat directions, where the drift produces little or no change in the represented quantum state. Such drift can drive parameter magnitudes to scales that compromise finite-precision computations, even when each individual update remains bounded [17]. We instead constrain both the quantum distance of the update and the norm of its endpoint. To this end, we minimize the Lagrangian

LRRGD(δθ)=∂θE(θ)⋅δθ+λ2(δθTgδθ−η2)+ν2(∣θ+δθ∣2−μ2).(6)\begin{aligned} \mathcal{L}_{\mathrm{RRGD}}(\delta\theta)=\partial_{\theta}E(\theta)\cdot\delta\theta+\frac{\lambda}{2}\left(\delta\theta^{T}g\delta\theta-\eta^{2}\right) \\ &+\frac{\nu}{2}\left(\lvert\theta+\delta\theta\rvert^{2}-\mu^{2}\right). \tag*{(6)} \end{aligned}

Stationarity with respect to δθ\delta\theta, together with the definitions η=1/λ\eta=1/\lambda and μ=ν/λ\mu=\nu/\lambda, gives

(g+μ1)δθ=−η∂θE(θ)−μθ,(7)(g+\mu\mathbf{1})\delta\theta=-\eta\partial_{\theta}E(\theta)-\mu\theta, \tag*{(7)}

where the shift +μ1+\mu\mathbf{1} stabilizes the metric inversion, while the accompanying term −μθ-\mu\theta anchors the parameters to the physically motivated zero-parameter state and suppresses the aforementioned drifts. We refer to Eq. (7) as the Regularized Riemannian Gradient Descent (RRGD) update. In practice, we solve Eq. (7) iteratively using the conjugate gradient (CG) solver provided by JAX [27], initialized with the solution from the previous iteration. We use a relative residual tolerance of 10−510^{-5} and impose a maximum of 128 iterations.

Although the parameter-norm penalty is isotropic, its effect is filtered by the quantum metric. In an eigenmode of gg with eigenvalue γa\gamma_a, the restoring contribution is weighted by μ/(γa+μ)\mu/(\gamma_a+\mu). RRGD therefore mainly anchors weakly resolved directions with γa≲μ\gamma_a\lesssim\mu, while recovering SR up to corrections of order μ/γa\mu/\gamma_a for γa≫μ\gamma_a\gg\mu. A finite μ\mu nevertheless introduces a controllable regularization bias, whose spectral interpretation is discussed in the Supplemental Material [28].

Ferromagnetic Chiral Magnet.– To benchmark the NQS approach, we first consider the well-studied case of a two-dimensional skyrmion lattice [23, 24] in a square-lattice chiral magnet. We simulate an 11×1111\times11 system with periodic boundary conditions (PBC), using J=−1J=-1, DB=−1D_B=-1, and B=−0.3B=-0.3, which corresponds to a skyrmion-lattice ground state. We use DMRG simulations to obtain an accurate estimate of the state and its quantum characteristics, and we take its energy and the distribution of the magnetic-moment length as references (see Figure 2). With RRGD optimization, the single-layer NQS achieves a variational energy per site of ENQSh=2/N=−0.659671(1)E_{\mathrm{NQS}}^{h=2}/N=-0.659671(1), in proximity of but surpassing the DMRG result EMPSχ=128/N=−0.6596602E_{\mathrm{MPS}}^{\chi=128}/N=-0.6596602. At the same time, it approaches a lower energy variance per site compared to MPS, i.e. σMPS2/N=1.69×10−4\sigma_{\mathrm{MPS}}^{2}/N=1.69\times10^{-4} vs. σNQS2/N=1.08×10−4\sigma_{\mathrm{NQS}}^{2}/N=1.08\times10^{-4}. An infinite-χ\chi extrapolation of the DMRG data yields E∞/N=−0.6597198E_{\infty}/N=-0.6597198. The h=6h=6 NQS energy per site lies only 4.9×10−54.9\times10^{-5} above this value, compared with 6.0×10−56.0\times10^{-5} for the χ=128\chi=128 MPS. The NQS reaches this accuracy with about twenty times fewer variational parameters than the MPS (2χ2N2\chi^{2}N vs. 2h(N+1)N2h(N+1)N).

Figure 2. Energy convergence and symmetry properties of the skyrmion states. (a,b) Bond-dimension scaling of the relative energy per site and the residual C4C_4 anisotropy of variational MPS, compared with results obtained by training hh-headed networks (dashed lines). The black dashed line in panel (a) indicates the infinite-head extrapolation of the energy. (c) The 1D “zigzag” ordering of lattice sites used for the MPS. (d) Converged local spin textures for MPS with χ=128\chi=128, χ=16\chi=16 and for an NQS with h=2h=2. Unlike the other textures, the MPS with χ=16\chi=16 exhibits visible vertical artifacts that break C4C_4 symmetry in the local magnetization norm ∣m∣|\mathbf{m}|. Throughout the paper, spin textures are color-coded using the standard scheme [46]: the hue is given by atan2⁡(my,mx)\operatorname{atan2}(m_y,m_x), while the saturation SS and value VV are determined by the mzm_z component of the magnetization.

Although DMRG accurately describes this weakly entangled phase at sufficiently large bond dimensions, its MPS representation requires a one-dimensional mapping of the lattice [we chose the ordering sketched in Figure 2(c)]. This 1D-chain ordering is not unique and can introduce artifacts that manifest themselves as apparent lattice symmetry breaking. In particular, this is evident in the distribution of local spin-magnitude variations ∣mi∣:=∣⟨S^i⟩∣\lvert\mathbf{m}_i\rvert:= \lvert\langle\hat{\mathbf{S}}_i\rangle\rvert, which can provide a convenient proxy for the local entanglement entropy [26, 47]. Although these observables should respect the C4C_4 rotational symmetry of the square lattice, they generally exhibit residual anisotropy in the MPS representation for insufficiently large bond dimensions. We quantify the resulting anisotropy through

α2=1Ns2∑i=1N(∣mi∣−∣mi∗∣)2,(8)\alpha^2 = \frac{1}{N s^2}\sum_{i=1}^{N}\left(\lvert\mathbf{m}_i\rvert-\lvert\mathbf{m}_{i^*}\rvert\right)^2, \tag*{(8)}

where i∗i^* denotes the symmetry partner of site ii under a π/2\pi/2 rotation about the center of the lattice. As shown in Figure 2(b,Figure 2d), low-χ\chi MPS states develop anisotropic spin-norm fluctuations aligned with the 1D path, while increasing χ\chi progressively reduces the residual C4C_4 anisotropy. The locally rotated NQS exhibits a much smaller C4C_4 anisotropy than MPS representations, even at large bond dimensions (see Figure 2), which demonstrates the dimensionality-agnostic nature of the FFNN ansatz.

Antiferromagnetic Chiral Magnet.– We next consider a quantum three-sublattice antiferromagnetic chiral magnet on a 12×1212 \times12 triangular lattice, which supports a skyrmion-lattice phase [25]. This phase is stabilized at J=1J = 1, DN=0.8D_{\mathrm{N}} = 0.8, and B=−1.76B = -1.76 and, strictly speaking, requires PBC. These, however, are challenging for conventional DMRG because of the entanglement growth in two and higher dimensions [48]. Although the DMRG algorithm has not reached a clear convergence plateau at the bond dimensions considered, the resulting state reproduces the three-sublattice skyrmion texture, with small finite-size distortions (see Figure 3). Here, however, the strongly nonconvex energy landscape makes NQS optimization sensitive to the choice of local reference frames. A classical initialization can trap the optimization in a metastable minimum, where the NQS captures local quantum fluctuations but may fail to reach variational states of lower energy. Such transitions may require big parameter changes, whereas Monte Carlo sampling based on local spin flips predominantly probes configurations in proximity of the current state and therefore provides little gradient information toward distant minima. We overcome this topological trapping by a hybrid bootstrapping strategy based on a moderately converged finite-bond-dimension DMRG calculation. The local frames are initialized from the spin orientations extracted from this intermediate-χ\chi DMRG state, which incorporates essential nonlocal quantum correlations while remaining sufficiently close to the variational manifold explored by the NQS. Starting from this quantum-informed reference frame, the hh-headed NQS converges smoothly to a lower variational energy than the MPS reference simulation (see Figure 3).

Figure 3. Comparison of MPS and NQS results obtained for the triangular-lattice antiferromagnetic phase. (a,b) MPS bond-dimension scaling compared with NQS parallel-head scaling for the relative energy and the variance per site. (c) Ordering of sublattices within the triangular lattice. (d) Local magnetization exhibiting skyrmion-like structures on the individual sublattices I, II, and III and in the composite full spin texture.

Bilayer Monoaxial Magnet.– To demonstrate the applicability of the NQS approach beyond strictly 2D geometries, we next consider a magnetic bilayer as an intermediate step toward systems with three-dimensional connectivity. Specifically, we study a 10×10×210 \times10 \times2 bilayer of stacked 2D monoaxial chiral magnets introduced in Ref. [49]. The mutually orthogonal DMI in the two layers produces a strongly frustrated magnetic texture containing localized anti-aligned (AA) points, which may be viewed as analogs of Bloch points [50]. As a result, one can expect a strong localization of quantum fluctuations near these points [51]. We investigate the model at J=−1J=-1, B=0B=0, and DB=1D_{\mathrm{B}}=1, with fully isotropic nearest-neighbor exchange and monoaxial intralayer DMI given by the vectors:

Dijtop=DB(0,yi−yj),Dijbottom=DB(xj−xi,0),(9)\mathbf{D}_{ij}^{\mathrm{top}} = D_{\mathrm{B}}(0,y_i-y_j), \qquad\mathbf{D}_{ij}^{\mathrm{bottom}} = D_{\mathrm{B}}(x_j-x_i,0), \tag*{(9)}

where we set the lattice constant to a=1a=1. Both DMRG and NQS resolve the localized signatures of the AA points, as shown in Figure 4. The periodic in-plane geometry and the interlayer couplings make the model challenging for an MPS representation and impair DMRG convergence. In contrast, the NQS reaches a much lower variational energy for the computational resources considered here [see Figure 4(b)]. This result demonstrates that the approach is independent of the system’s interaction graph, making it directly applicable to the study of long-ranged or 3D quantum systems.

Figure 4. Magnetic texture and energy convergence of the coupled chiral-magnet bilayer. (a) Magnetic “checkerboard” state stabilized in a bilayer system coupled via the Heisenberg interaction. The anisotropic intralayer DMI makes the spiral propagation directions in the two layers mutually orthogonal. (b) Bond-dimension scaling of the energy density compared with NQS parallel-head scaling. (c) Spin textures of the bilayer, showing localized AA points at the center and corners, where the spins in the two layers exhibit the strongest local anti-alignment within the obtained texture. This anti-alignment is reflected in the opposite saturation extremes of the arrow color-coding in the two layers.

Conclusion.— We have presented an approach to NQS optimization that combines physically informed local frames with a regularized version of Riemannian gradient descent. The two methods address complementary aspects of the optimization problem: the reference-aligned basis provides a physically motivated starting state at minimal parameter norm, while RRGD suppresses the parameter-space drift that accumulates along redundant directions. This construction stabilizes the optimization even with single-precision variational parameters, thereby enabling large-scale simulations on commodity hardware. All results reported here were obtained on a single RTX 5090 GPU in less than two GPU weeks.

We demonstrated the approach on a variety of chiral spin systems, including 2D and layered geometries.

For the square-lattice ferromagnet, we showed that a modestly-sized network can capture the 2D symmetry of local spin-magnitude fluctuations with high fidelity. The triangular-lattice antiferromagnet highlighted the importance of reference selection: when a classical texture led to metastable optimization, local frames extracted from an intermediate DMRG calculation provided a more effective starting point. This hybrid strategy uses only the reference spin directions and does not require the NQS to start from the exact MPS wavefunction. In the bilayer, the NQS resolved the localized signatures of anti-aligned points, extending the demonstration beyond strictly planar geometries. Across all benchmarks, the NQS consistently achieves variational energies competitive with or lower than those obtained by DMRG.

These results identify reference selection and parameter control as practical tools for improving NQS calculations of noncollinear quantum magnets. Their effectiveness nevertheless depends on the reference texture and the regularization strength. Finite anchoring can bias the optimized state, and the method does not remove the possibility of converging to metastable excitations.

The present bilayer calculations motivate extensions to a larger number of stacked layers and to fully 3D spin systems. More broadly, encoding the classical texture in local reference frames and controlling the parameter norm through the regularized metric shift the burden from network depth toward physical insight. This brings quantum fluctuations around large and complex spin textures within reach of shallow networks on a single GPU.

Acknowledgments.— The authors acknowledge financial support from the Luxembourg National Research Fund under Grants C22/MS/17415246/DeQuSky and AFR/23/17951349. V.M.K. acknowledges financial support from the European Union’s Horizon Europe research and innovation programme under the Marie Skłodowska-Curie Grant 101203692 (QUANTHOPF).

References

ref-1 | article-journal | Carleo, G.; Troyer, M. | 2017 | Solving the quantum many-body problem with artificial neural networks | Science | 355 | | 602 | | | raw: [1] G. Carleo and M. Troyer, Solving the quantum many-body problem with artificial neural networks, Science 355, 602 (2017). ref-2 | article-journal | Deng, D.-L.; Li, X.; Das Sarma, S. | 2017 | Quantum entanglement in neural network states | Phys. Rev. X | 7 | | 021021 | | | raw: [2] D.-L. Deng, X. Li, and S. Das Sarma, Quantum entanglement in neural network states, Phys. Rev. X 7, 021021 (2017). ref-3 | article-journal | Choo, K.; Carleo, G.; Regnault, N.; Neupert, T. | 2018 | Symmetries and many-body excitations with neural-network quantum states | Phys. Rev. Lett. | 121 | | 167204 | | | raw: [3] K. Choo, G. Carleo, N. Regnault, and T. Neupert, Symmetries and many-body excitations with neural-network quantum states, Phys. Rev. Lett. 121, 167204 (2018). ref-4 | article-journal | Lange, H.; Van de Walle, A.; Abedinnia, A.; Bohrdt, A. | 2024 | From architectures to applications: a review of neural quantum states | Quantum Science and Technology | 9 | | 040501 | | | raw: [4] H. Lange, A. Van de Walle, A. Abedinnia, and A. Bohrdt, From architectures to applications: a review of neural quantum states, Quantum Science and Technology 9, 040501 (2024). ref-5* | article-journal | Medvidović, M.; Robledo Moreno, J. | | Neural-network | | | | | | | raw: [5] M. Medvidović and J. Robledo Moreno, Neural-network

Neural Network architecture

The amplitude and phase networks are both implemented as shallow feed-forward architectures with a sum-of-heads structure, i.e., each one consists of hh parallel branches dubbed “heads”. Specifically, for input dimension (system size) din=Nd_{\mathrm{in}}=N, and output width doutd_{\mathrm{out}}, each network has hh heads with weight matrices W(i)∈Rdout×dinW^{(i)}\in\mathbb{R}^{d_{\mathrm{out}}\times d_{\mathrm{in}}} and bias vectors b(i)∈Rdout\mathbf{b}^{(i)}\in\mathbb{R}^{d_{\mathrm{out}}}, i=1,…,hi=1,\ldots,h. The first head is purely affine, with no internal activation function, and its output is therefore unconstrained:

z(1)(σ)=W(1)σ+b(1),(10)\mathbf{z}^{(1)}(\boldsymbol{\sigma})=W^{(1)}\boldsymbol{\sigma}+\mathbf{b}^{(1)}, \tag*{(10)}

while the remaining h−1h-1 heads each consist of a linear map followed by a sigmoid activation fσ(x)=1/(1+e−x)f_{\sigma}(x)=1/(1+e^{-x}) applied component-wise, and a final rescaling Rdout→(−1,1)dout\mathbb{R}^{d_{\mathrm{out}}}\to(-1,1)^{d_{\mathrm{out}}}:

z(i)(σ)=2fσ(W(i)σ+b(i))−1,i=2,…,h.(11)\mathbf{z}^{(i)}(\boldsymbol{\sigma})=2f_{\sigma}\left(W^{(i)}\boldsymbol{\sigma}+\mathbf{b}^{(i)}\right)-1,\quad i=2,\ldots,h. \tag*{(11)}

The heads are summed, ζ(σ)=∑i=1hz(i)(σ)\boldsymbol{\zeta}(\boldsymbol{\sigma})=\sum_{i=1}^{h}\mathbf{z}^{(i)}(\boldsymbol{\sigma}), and a global activation function fout:Rdout→Rdoutf_{\mathrm{out}}:\mathbb{R}^{d_{\mathrm{out}}}\to\mathbb{R}^{d_{\mathrm{out}}} is applied. Consequently, the final output is obtained by summing over the doutd_{\mathrm{out}} components of the activated vector, giving:

F(σ)=∑k=1dout[fout(ζ(σ))]k,(12)F(\boldsymbol{\sigma})=\sum_{k=1}^{d_{\mathrm{out}}}\left[f_{\mathrm{out}}\left(\boldsymbol{\zeta}(\boldsymbol{\sigma})\right)\right]_{k}, \tag*{(12)}

with fout=log⁡_softmaxf_{\mathrm{out}}=\log\_\mathrm{softmax} for the amplitude ρ\rho, and fout=softplusf_{\mathrm{out}}=\mathrm{softplus} for the phase φ\varphi. This yields the outputs

Fρ(σ)=∑k=1doutζk(σ)−doutln⁡∑k=1douteζk(σ),(13)F_{\rho}(\boldsymbol{\sigma})=\sum_{k=1}^{d_{\mathrm{out}}}\zeta_{k}(\boldsymbol{\sigma})-d_{\mathrm{out}}\ln\sum_{k=1}^{d_{\mathrm{out}}}e^{\zeta_{k}(\boldsymbol{\sigma})}, \tag*{(13)}
Fφ(σ)=∑k=1doutln⁡(1+eζk(σ)).(14)F_{\varphi}(\boldsymbol{\sigma})=\sum_{k=1}^{d_{\mathrm{out}}}\ln\left(1+e^{\zeta_{k}(\boldsymbol{\sigma})}\right). \tag*{(14)}

With this form the zero-parameter state is configuration independent. In other words, when all weights and biases are zero, we have Fρ=−doutln⁡doutF_{\rho}=-d_{\mathrm{out}}\ln d_{\mathrm{out}} and Fφ=doutln⁡2F_{\varphi}=d_{\mathrm{out}}\ln2. Each head contributes dindout+doutd_{\mathrm{in}}d_{\mathrm{out}}+d_{\mathrm{out}} parameters, giving each network a total of h(din+1)douth(d_{\mathrm{in}}+1)d_{\mathrm{out}} trainable parameters. For simplicity we choose the amplitude and phase networks to have symmetric architectures. The full complex wavefunction therefore has

np=2h(din+1)dout(15)n_{\mathrm{p}}=2h(d_{\mathrm{in}}+1)d_{\mathrm{out}} \tag*{(15)}

trainable parameters. We consider dout=dind_{\mathrm{out}}=d_{\mathrm{in}}, making the parameter count scale quadratically with the system size, np=O(N2)n_{\mathrm{p}}=O(N^{2}).

The purpose of retaining one purely affine head is to preserve a direct linear pathway from the input to the head outputs, which we found to improve convergence in the small-hh regime. This is motivated by the fact that sigmoid activations have bounded derivatives and can attenuate gradients for large-magnitude preactivations, potentially slowing optimization when the number of heads is small. We also tested a fully symmetric variant in which all heads include an internal sigmoid activation. For small hh (e.g. h=1h=1), the fully activated variant converges slower within a fixed iteration budget, while for larger hh (e.g. h=6h=6) it shows slightly improved convergence as opposed to the asymmetric one. In both cases, however, the qualitative behavior of the optimizer and the physical conclusions remain unchanged. All results presented in the main text use the architecture with one affine head.

We estimate the energy trend with increasing network size using unweighted linear least-squares fits of the variational energy per site to E(h)=Eh→∞+a/hE(h)=E_{h\to\infty}+a/h, where hh is the number of heads and Eh→∞E_{h\to\infty} is the fitted intercept at 1/h=01/h=0. At fixed system size, the parameter count npn_{\mathrm{p}} is proportional to hh, so this procedure is equivalent to a linear fit in 1/np1/n_{\mathrm{p}}. Given the limited number of network sizes considered, this procedure does not establish an asymptotic 1/h1/h scaling law. The extrapolated values should therefore be understood as indicative estimates rather than controlled infinite-network-size limits. Our benchmark comparisons are instead based on the converged finite-hh variational energies.

Initialization

For a general spin-ss degree of freedom, the equal-amplitude superposition of the canonical zz-basis states does not, in general, correspond to a state polarized along x^\hat{x}. However, since having a easily interpretable reference state is convenient for the optimization, we may still choose to initialize the network to represent a fully polarized state along +x^+\hat{x}. This can be done by introducing a configuration-dependent reference amplitude ψref(σ)\psi_{\mathrm{ref}}(\boldsymbol{\sigma}), such that the network represents the wavefunction

ψθ(σ)=ψref(σ)exp⁡(ρθρ(σ)+iφθϕ(σ)),(16)\psi_{\theta}(\boldsymbol{\sigma})=\psi_{\mathrm{ref}}(\boldsymbol{\sigma})\exp\left(\rho_{\theta\rho}(\boldsymbol{\sigma})+i\varphi_{\theta\phi}(\boldsymbol{\sigma})\right), \tag*{(16)}

where ψref(σ)>0\psi_{\mathrm{ref}}(\boldsymbol{\sigma})>0 is a real, parameter-free function of the configuration σ\boldsymbol{\sigma}. As it is untrainable, this amplitude modulation does not change the expressivity of the network nor the optimization landscape, but allows us to initialize the zero-parameter state to a desired reference state.

We look for the amplitude ψref(σ)\psi_{\mathrm{ref}}(\boldsymbol{\sigma}) by rotating the canonical zz-basis ∣s,s⟩z\lvert s,s\rangle_z to obtain a local state maximally polarized along +x^+\hat{x}:

∣s,s⟩x=e−iπ2S^y∣s,s⟩z=eπ4(S^−−S^+)∣s,s⟩z=etan⁡(π4)S^−e2ln⁡(cos⁡π4)S^ze−tan⁡(π4)S^+∣s,s⟩z=2−seS^−∣s,s⟩z.(17)\begin{aligned} \lvert s,s\rangle_x&=e^{-i\frac{\pi}{2}\hat{S}^{y}}\lvert s,s\rangle_z\\ &=e^{\frac{\pi}{4}(\hat{S}^{-}-\hat{S}^{+})}\lvert s,s\rangle_z\\ &=e^{\tan(\frac{\pi}{4})\hat{S}^{-}}e^{2\ln(\cos\frac{\pi}{4})\hat{S}^{z}}e^{-\tan(\frac{\pi}{4})\hat{S}^{+}}\lvert s,s\rangle_z\\ &=2^{-s}e^{\hat{S}^{-}}\lvert s,s\rangle_z. \tag*{(17)} \end{aligned}

Expanding this state in the canonical zz-basis gives

∣s,s⟩x=∑m=−ss⟨s,m∣2−seS^−∣s,s⟩z∣s,m⟩=∑m=−ss2−s∑n=02s1n!⟨s,m∣(S^−)n∣s,s⟩z∣s,m⟩=∑m=−ss2−s∑n=02s((2s)!(2s−n)!n!)12δm,s−n∣s,m⟩=∑m=−ss2−s((2ss+m))12∣s,m⟩,(18)\begin{aligned} \lvert s,s\rangle_x&=\sum_{m=-s}^{s}\langle s,m\lvert2^{-s}e^{\hat{S}^{-}}\lvert s,s\rangle_z\lvert s,m\rangle\\ &=\sum_{m=-s}^{s}2^{-s}\sum_{n=0}^{2s}\frac{1}{n!}\langle s,m\lvert(\hat{S}^{-})^{n}\lvert s,s\rangle_z\lvert s,m\rangle\\ &=\sum_{m=-s}^{s}2^{-s}\sum_{n=0}^{2s}\left(\frac{(2s)!}{(2s-n)!n!}\right)^{\frac{1}{2}}\delta_{m,s-n}\lvert s,m\rangle\\ &=\sum_{m=-s}^{s}2^{-s}\left(\binom{2s}{s+m}\right)^{\frac{1}{2}}\lvert s,m\rangle, \tag*{(18)} \end{aligned}

up to convention-dependent phase factors. Thus, for a product reference state, the configuration-dependent reference amplitude is

ψref(σ)=∏i=1N2−s(2ss+mi),(19)\psi_{\mathrm{ref}}(\boldsymbol{\sigma})=\prod_{i=1}^{N}2^{-s}\sqrt{\binom{2s}{s+m_i}}, \tag*{(19)}

where σ=(m1,…,mN)\boldsymbol{\sigma}=(m_1,\ldots,m_N). For spin-1/2, the two binomial coefficients are identical and ψref\psi_{\mathrm{ref}} reduces to a configuration-independent constant, recovering the equal-amplitude initialization used in the present work. For higher spins, the nonuniform amplitudes are therefore not an additional variational assumption, but follow directly from requiring the zero-parameter state to be fully polarized along +x^+\hat{x}.

Local Frames and Variational Monte Carlo Estimators

Canonical local-frame transformation

Let the reference spin direction at site ii be specified by the unit vector

ni=(sin⁡Θicos⁡Φi,sin⁡Θisin⁡Φi,cos⁡Θi),(20)\boldsymbol{n}_i=(\sin\Theta_i\cos\Phi_i,\sin\Theta_i\sin\Phi_i,\cos\Theta_i), \tag*{(20)}

where Θi\Theta_i and Φi\Phi_i are the polar and azimuthal angles in the canonical zz-basis. We introduce a site-dependent unitary transformation U^=∏iU^i\hat{U}=\prod_i\hat{U}_i, where

U^i=exp⁡[−iΦiS^iz]exp⁡[−i(Θi−π/2)S^iy].(21)\hat{U}_i=\exp[-i\Phi_i\hat{S}^{z}_i]\exp[-i(\Theta_i-\pi/2)\hat{S}^{y}_i]. \tag*{(21)}

The induced transformation of the spin-1/21/2 operators is represented by the active-rotation matrix Ri=Rz(Φi)Ry(Θi−π/2)∈SO(3)R_i = R^z(\Phi_i)R^y(\Theta_i-\pi/2) \in\mathrm{SO}(3), with the convention

U^i†S^iαU^i=∑μRiαμS^iμ.(22)\hat{U}_i^\dagger\hat{S}_i^\alpha\hat{U}_i = \sum_\mu R_i^{\alpha\mu}\hat{S}_i^\mu. \tag*{(22)}

For the rotation matrix elements, it holds that Riαβ=12Tr⁡[σ^βU^i†σ^αU^i]R_i^{\alpha\beta} = \frac{1}{2}\operatorname{Tr}\left[\hat{\sigma}^\beta\hat{U}_i^\dagger\hat{\sigma}^\alpha\hat{U}_i\right]. Additionally, the shift by π/2\pi/2 ensures that Rix^=niR_i\hat{x} = n_i. Consequently, a local-frame state polarized along +x^+\hat{x} is mapped by U^\hat{U} onto the reference spin texture, and the zero-parameter NQS thus represents the reference state.

The laboratory-frame Hamiltonian is written as

H^=∑⟨i,j⟩JijαβS^iαS^jβ+∑iBiαS^iα,(23)\hat{H} = \sum_{\langle i,j\rangle} \mathcal{J}_{ij}^{\alpha\beta}\hat{S}_i^\alpha\hat{S}_j^\beta+ \sum_i B_i^\alpha\hat{S}_i^\alpha, \tag*{(23)}

where the coupling tensor Jijαβ=Jδαβ+ϵαβγDijγ\mathcal{J}_{ij}^{\alpha\beta} = J\delta^{\alpha\beta} + \epsilon^{\alpha\beta\gamma}D_{ij}^\gamma accounts for the Heisenberg exchange JJ, and the Dzyaloshinskii-Moriya interaction (DMI) DijD_{ij}. Depending on the type of DMI, the DMI vector is either parallel (Bloch-type) or perpendicular (Néel-type) to the displacement vector rij=rj−rir_{ij} = r_j-r_i between the two spins. We write Dij=Drij/∣rij∣D_{ij} = D r_{ij}/\lvert r_{ij}\rvert for Bloch-type DMI and Dij=Dz^×rij/∣rij∣D_{ij} = D\hat{z}\times r_{ij}/\lvert r_{ij}\rvert for Néel-type DMI, where DD is the interaction strength and z^\hat{z} is the unit vector perpendicular to the plane of the spins.

The Hamiltonian in the local frame is

H^′=U^†H^U^=∑⟨i,j⟩J~ijμνS^iμS^jν+∑iB~iμS^iμ,(24)\hat{H}' = \hat{U}^\dagger\hat{H}\hat{U} = \sum_{\langle i,j\rangle}\widetilde{\mathcal{J}}_{ij}^{\mu\nu}\hat{S}_i^\mu\hat{S}_j^\nu+ \sum_i \widetilde{B}_i^\mu\hat{S}_i^\mu, \tag*{(24)}

where

J~ijμν=∑α,βRiαμJijαβRjβν,(25)\widetilde{\mathcal{J}}_{ij}^{\mu\nu} = \sum_{\alpha,\beta} R_i^{\alpha\mu}\mathcal{J}_{ij}^{\alpha\beta}R_j^{\beta\nu}, \tag*{(25)}
B~iμ=∑αBiαRiαμ.(26)\widetilde{B}_i^\mu= \sum_\alpha B_i^\alpha R_i^{\alpha\mu}. \tag*{(26)}

The site-dependent transformation generally produces a fully anisotropic coupling tensor in the local frame. The matrix elements derived below apply to this general tensor without modification.

Let ∣ψ′⟩\lvert\psi'\rangle denote the network-represented state optimized for H^′\hat{H}'. The corresponding state in the original laboratory frame is

∣ψ⟩=U^∣ψ′⟩.(27)\lvert\psi\rangle= \hat{U}\lvert\psi'\rangle. \tag*{(27)}

An observable O^\hat{O} defined in the laboratory frame must therefore be evaluated in the local frame using

O^′=U^†O^U^,⟨ψ∣O^∣ψ⟩⟨ψ∣ψ⟩=⟨ψ′∣O^′∣ψ′⟩⟨ψ′∣ψ′⟩.(28)\hat{O}' = \hat{U}^\dagger\hat{O}\hat{U}, \qquad\frac{\langle\psi\lvert\hat{O}\rvert\psi\rangle}{\langle\psi\vert\psi\rangle} = \frac{\langle\psi'\lvert\hat{O}'\rvert\psi'\rangle}{\langle\psi'\vert\psi'\rangle}. \tag*{(28)}

In particular, the laboratory-frame local magnetization and two-point correlations are recovered as

⟨S^iα⟩lab=∑μRiαμ⟨S^iμ⟩loc,(29)\left\langle\hat{S}_i^\alpha\right\rangle_{\mathrm{lab}} = \sum_\mu R_i^{\alpha\mu}\left\langle\hat{S}_i^\mu\right\rangle_{\mathrm{loc}}, \tag*{(29)}
⟨S^iαS^jβ⟩lab=∑μ,νRiαμRjβν⟨S^iμS^jν⟩loc.(30)\left\langle\hat{S}_i^\alpha\hat{S}_j^\beta\right\rangle_{\mathrm{lab}} = \sum_{\mu,\nu} R_i^{\alpha\mu}R_j^{\beta\nu}\left\langle\hat{S}_i^\mu\hat{S}_j^\nu\right\rangle_{\mathrm{loc}}. \tag*{(30)}

Variational Monte-Carlo Estimators

Having defined the local-frame Hamiltonian and the corresponding transformation of physical observables, we next derive the variational Monte Carlo estimators used to optimize ∣ψ′⟩\lvert\psi'\rangle. For notational simplicity, in the following we write H^\hat{H} and ∣ψ⟩\lvert\psi\rangle for the Hamiltonian and state represented in the basis in which the Monte Carlo sampling is performed. In the canonical local frames, these quantities are understood as H^′\hat{H}' and ∣ψ′⟩\lvert\psi'\rangle, respectively.

Consider a quantum state expressed in a complete basis {∣σ⟩}\{\lvert\sigma\rangle\}, i.e., ∣ψ⟩=∑σ∣σ⟩⟨σ∣ψ⟩=∑σψ(σ)∣σ⟩\lvert\psi\rangle= \sum_{\sigma} \lvert\sigma\rangle\langle\sigma\lvert\psi\rangle= \sum_{\sigma} \psi(\sigma) \lvert\sigma\rangle with a wavefunction ψ(σ)=⟨σ∣ψ⟩\psi(\sigma) = \langle\sigma\lvert\psi\rangle. The expectation value of an observable A^\hat{A} in the basis of configurations σ\sigma is given by

⟨A^⟩=⟨ψ∣A^∣ψ⟩⟨ψ∣ψ⟩=∑σ,σ′⟨σ∣A^∣σ′⟩ψ∗(σ)ψ(σ′)⟨ψ∣ψ⟩=∑σ∣ψ(σ)∣2⟨ψ∣ψ⟩∑σ′⟨σ∣A^∣σ′⟩ψ(σ′)ψ(σ)=∑σp(σ)Aloc(σ),(31)\begin{aligned} \langle\hat{A}\rangle= \frac{\langle\psi\lvert\hat{A}\rvert\psi\rangle}{\langle\psi\vert\psi\rangle} = \sum_{\sigma,\sigma'} \langle\sigma\lvert\hat{A}\rvert\sigma'\rangle\frac{\psi^{*}(\sigma)\psi(\sigma')}{\langle\psi\vert\psi\rangle} \\ &= \sum_{\sigma} \frac{\lvert\psi(\sigma)\rvert^{2}}{\langle\psi\vert\psi\rangle} \sum_{\sigma'} \langle\sigma\lvert\hat{A}\rvert\sigma'\rangle\frac{\psi(\sigma')}{\psi(\sigma)} \\ &= \sum_{\sigma} p(\sigma) A_{\mathrm{loc}}(\sigma), \tag*{(31)} \end{aligned}

where in the second line we insert ψ(σ)/ψ(σ)\psi(\sigma)/\psi(\sigma), and in the last line we define the sampling probability p(σ)=∣ψ(σ)∣2/⟨ψ∣ψ⟩p(\sigma) = \lvert\psi(\sigma)\rvert^{2}/\langle\psi\vert\psi\rangle. In addition, we defined the local estimator associated with the observable,

Aloc(σ)=∑σ′⟨σ∣A^∣σ′⟩ψ(σ′)ψ(σ).(32)A_{\mathrm{loc}}(\sigma) = \sum_{\sigma'} \langle\sigma\lvert\hat{A}\rvert\sigma'\rangle\frac{\psi(\sigma')}{\psi(\sigma)}. \tag*{(32)}

Using configuration samples {σi}i=1ns\{\sigma_i\}_{i=1}^{n_s} appropriately drawn from the probability distribution p(σ)p(\sigma), we can approximate the sum in Eq. (31) according to

⟨A^⟩≈1ns∑i=1nsAloc(σi)=⟨ ⁣⟨Aloc⟩ ⁣⟩,(33)\langle\hat{A}\rangle\approx\frac{1}{n_s}\sum_{i=1}^{n_s} A_{\mathrm{loc}}(\sigma_i) = \langle\!\langle A_{\mathrm{loc}}\rangle\!\rangle, \tag*{(33)}

where we introduced the notation for the sample average of a general function

⟨ ⁣⟨f⟩ ⁣⟩:=1ns∑i=1nsf(σi).(34)\langle\!\langle f\rangle\!\rangle:= \frac{1}{n_s}\sum_{i=1}^{n_s} f(\sigma_i). \tag*{(34)}

Pair and single-spin interactions

To evaluate the local estimators relevant for the evaluation of the energy and its gradient, we require the configuration-basis matrix elements of the single- and two-spin operators entering the Hamiltonian. We derive these expressions below for a general coupling tensor, so they apply directly to the transformed coefficients J~ijαβ\widetilde{J}^{\alpha\beta}_{ij} and B~iα\widetilde{B}^{\alpha}_{i}.

The local spin operators are proportional to the Pauli matrices, i.e., S^α=12σ^α\hat{S}^{\alpha} = \frac{1}{2}\hat{\sigma}^{\alpha} with α=x,y,z\alpha= x,y,z. Their action on the canonical spin-1/2 basis is given by:

S^ix∣σ⟩=12∣σ(i)⟩,(35)\hat{S}^{x}_{i}\lvert\sigma\rangle= \frac{1}{2}\lvert\sigma^{(i)}\rangle, \tag*{(35)}
S^iy∣σ⟩=12σi∣σ(i)⟩,(36)\hat{S}^{y}_{i}\lvert\sigma\rangle= \frac{1}{2}\sigma_i\lvert\sigma^{(i)}\rangle, \tag*{(36)}
S^iz∣σ⟩=12σi∣σ⟩,(37)\hat{S}^{z}_{i}\lvert\sigma\rangle= \frac{1}{2}\sigma_i\lvert\sigma\rangle, \tag*{(37)}

where σi=±1\sigma_i = \pm1 for the ii-th spin of configuration σ\boldsymbol{\sigma} being up/down, respectively, and ∣σ(i)⟩\lvert\sigma^{(i)}\rangle represents σ\sigma with the ii-th spin flipped.

Using the action of the spin operators on the basis states, we can simplify the spin-observable local estimators as given below. The diagonal spin-component estimators are given by

∑σ′⟨σ∣S^ixS^jx∣σ′⟩ψ(σ′)ψ(σ)=14ψ(σ(i,j))ψ(σ),(38)\sum_{\sigma'} \langle\sigma\lvert\hat{S}^{x}_{i}\hat{S}^{x}_{j}\rvert\sigma'\rangle\frac{\psi(\sigma')}{\psi(\sigma)} = \frac{1}{4}\frac{\psi(\sigma^{(i,j)})}{\psi(\sigma)}, \tag*{(38)}
∑σ′⟨σ∣S^iyS^jy∣σ′⟩ψ(σ′)ψ(σ)=−14σiσjψ(σ(i,j))ψ(σ),(39)\sum_{\sigma'} \langle\sigma\lvert\hat{S}^{y}_{i}\hat{S}^{y}_{j}\rvert\sigma'\rangle\frac{\psi(\sigma')}{\psi(\sigma)} = -\frac{1}{4}\sigma_i\sigma_j\frac{\psi(\sigma^{(i,j)})}{\psi(\sigma)}, \tag*{(39)}
∑σ′⟨σ∣S^izS^jz∣σ′⟩ψ(σ′)ψ(σ)=14σiσj,(40)\sum_{\sigma'} \langle\sigma\lvert\hat{S}^{z}_{i}\hat{S}^{z}_{j}\rvert\sigma'\rangle\frac{\psi(\sigma')}{\psi(\sigma)} = \frac{1}{4}\sigma_i\sigma_j, \tag*{(40)}

where we used the fact that only the configuration with flipped spins at both sites ii and jj (i.e., σ′=σ(i,j)\sigma' = \sigma^{(i,j)}) can contribute to the sums in the first two equations, while σ′=σ\sigma' = \sigma is the only contributing configuration for the last equation.

The off-diagonal contributions read

∑σ′⟨σ∣S^ixS^jy∣σ′⟩ψ(σ′)ψ(σ)=−i4σjψ(σ(i,j))ψ(σ)(41)\sum_{\sigma'} \langle\sigma|\hat{S}^{x}_{i}\hat{S}^{y}_{j}|\sigma'\rangle\frac{\psi(\sigma')}{\psi(\sigma)}=-\frac{\mathrm{i}}{4}\sigma_{j}\frac{\psi(\sigma^{(i,j)})}{\psi(\sigma)} \tag*{(41)}
∑σ′⟨σ∣S^ixS^jz∣σ′⟩ψ(σ′)ψ(σ)=14σjψ(σ(i))ψ(σ)(42)\sum_{\sigma'} \langle\sigma|\hat{S}^{x}_{i}\hat{S}^{z}_{j}|\sigma'\rangle\frac{\psi(\sigma')}{\psi(\sigma)}=\frac{1}{4}\sigma_{j}\frac{\psi(\sigma^{(i)})}{\psi(\sigma)} \tag*{(42)}
∑σ′⟨σ∣S^iyS^jz∣σ′⟩ψ(σ′)ψ(σ)=−i4σiσjψ(σ(i))ψ(σ)(43)\sum_{\sigma'} \langle\sigma|\hat{S}^{y}_{i}\hat{S}^{z}_{j}|\sigma'\rangle\frac{\psi(\sigma')}{\psi(\sigma)}=-\frac{\mathrm{i}}{4}\sigma_{i}\sigma_{j}\frac{\psi(\sigma^{(i)})}{\psi(\sigma)} \tag*{(43)}

The remaining contributions can be obtained by exchanging the spin indices ii and jj in the above equations. Contributions involving single-spin operators are evaluated as

∑σ′⟨σ∣S^ix∣σ′⟩ψ(σ′)ψ(σ)=12ψ(σ(i))ψ(σ)(44)\sum_{\sigma'} \langle\sigma|\hat{S}^{x}_{i}|\sigma'\rangle\frac{\psi(\sigma')}{\psi(\sigma)}=\frac{1}{2}\frac{\psi(\sigma^{(i)})}{\psi(\sigma)} \tag*{(44)}
∑σ′⟨σ∣S^iy∣σ′⟩ψ(σ′)ψ(σ)=−i2σiψ(σ(i))ψ(σ)(45)\sum_{\sigma'} \langle\sigma|\hat{S}^{y}_{i}|\sigma'\rangle\frac{\psi(\sigma')}{\psi(\sigma)}=-\frac{\mathrm{i}}{2}\sigma_{i}\frac{\psi(\sigma^{(i)})}{\psi(\sigma)} \tag*{(45)}
∑σ′⟨σ∣S^iz∣σ′⟩ψ(σ′)ψ(σ)=12σi(46)\sum_{\sigma'} \langle\sigma|\hat{S}^{z}_{i}|\sigma'\rangle\frac{\psi(\sigma')}{\psi(\sigma)}=\frac{1}{2}\sigma_{i} \tag*{(46)}

These expressions provide local estimators for single-spin operators and can therefore be used to evaluate both local-energy contributions from Zeeman terms and observables such as local magnetization miα=⟨S^iα⟩m^{\alpha}_{i}=\langle\hat{S}^{\alpha}_{i}\rangle. For calculations in canonical local frames, Zeeman contributions are evaluated using transformed field coefficients B~iα\tilde{B}^{\alpha}_{i}. The physical magnetizations in the laboratory frame are subsequently reconstructed using Eq. (29).

Energy Gradient

Let us further assume the wavefunction is parametrized by a set of variational parameters θ∈Rnp\boldsymbol{\theta}\in\mathbb{R}^{n_{p}}. In the search for a variational ground state, the parameters are optimized by minimizing the energy expectation value. The corresponding energy gradient is therefore a central ingredient of optimization and, as the energy itself, can be estimated from configurations sampled according to pθ(σ)p_{\theta}(\boldsymbol{\sigma}). The energy gradient with respect to the parameters θ\boldsymbol{\theta} can be computed as

∂θE(θ)=∂θ⟨ψθ∣H^∣ψθ⟩⟨ψθ∣ψθ⟩=2Re⁡(⟨∂θψθ∣H^∣ψθ⟩⟨ψθ∣ψθ⟩−⟨ψθ∣H^∣ψθ⟩⟨ψθ∣ψθ⟩⟨∂θψθ∣ψθ⟩⟨ψθ∣ψθ⟩)≈2Re⁡(⟨ElocO∗⟩−⟨Eloc⟩⟨O∗⟩)=2Re⁡(⟨Eloc∗O⟩−⟨Eloc∗⟩⟨O⟩)(47)\begin{aligned} \partial_{\theta}E(\theta)&=\partial_{\theta}\frac{\langle\psi_{\theta}|\hat{H}|\psi_{\theta}\rangle}{\langle\psi_{\theta}|\psi_{\theta}\rangle}\\ &=2\operatorname{Re}\left(\frac{\langle\partial_{\theta}\psi_{\theta}|\hat{H}|\psi_{\theta}\rangle}{\langle\psi_{\theta}|\psi_{\theta}\rangle}-\frac{\langle\psi_{\theta}|\hat{H}|\psi_{\theta}\rangle}{\langle\psi_{\theta}|\psi_{\theta}\rangle}\frac{\langle\partial_{\theta}\psi_{\theta}|\psi_{\theta}\rangle}{\langle\psi_{\theta}|\psi_{\theta}\rangle}\right)\\ &\approx2\operatorname{Re}\left(\langle E_{\mathrm{loc}}O^{*}\rangle-\langle E_{\mathrm{loc}}\rangle\langle O^{*}\rangle\right)\\ &=2\operatorname{Re}\left(\langle E_{\mathrm{loc}}^{*}O\rangle-\langle E_{\mathrm{loc}}^{*}\rangle\langle O\rangle\right) \tag*{(47)} \end{aligned}

where we used the intermediary steps

⟨∂θψθ∣H^∣ψθ⟩⟨ψθ∣ψθ⟩=∑σ,σ′⟨σ∣H^∣σ′⟩⟨ψθ∣ψθ⟩⟨∂θψθ∣σ⟩⟨σ′∣ψθ⟩=∑σ,σ′⟨σ∣H^∣σ′⟩⟨ψθ∣ψθ⟩ψθ(σ′)(∂θψθ(σ))∗=∑σ,σ′⟨σ∣H^∣σ′⟩⟨ψθ∣ψθ⟩ψθ(σ′)ψθ∗(σ)(∂θln⁡ψθ(σ))∗=∑σ,σ′∣ψθ(σ)∣2⟨ψθ∣ψθ⟩⟨σ∣H^∣σ′⟩ψθ(σ′)ψθ(σ)O∗(σ)=∑σpθ(σ)Eloc(σ)O∗(σ)≈⟨ElocO∗⟩(48)\begin{aligned} \frac{\langle\partial_{\theta}\psi_{\theta}|\hat{H}|\psi_{\theta}\rangle}{\langle\psi_{\theta}|\psi_{\theta}\rangle} &=\sum_{\sigma,\sigma'}\frac{\langle\sigma|\hat{H}|\sigma'\rangle}{\langle\psi_{\theta}|\psi_{\theta}\rangle}\langle\partial_{\theta}\psi_{\theta}|\sigma\rangle\langle\sigma'|\psi_{\theta}\rangle\\ &=\sum_{\sigma,\sigma'}\frac{\langle\sigma|\hat{H}|\sigma'\rangle}{\langle\psi_{\theta}|\psi_{\theta}\rangle}\psi_{\theta}(\sigma')(\partial_{\theta}\psi_{\theta}(\sigma))^{*}\\ &=\sum_{\sigma,\sigma'}\frac{\langle\sigma|\hat{H}|\sigma'\rangle}{\langle\psi_{\theta}|\psi_{\theta}\rangle}\psi_{\theta}(\sigma')\psi_{\theta}^{*}(\sigma)(\partial_{\theta}\ln\psi_{\theta}(\sigma))^{*}\\ &=\sum_{\sigma,\sigma'}\frac{|\psi_{\theta}(\sigma)|^{2}}{\langle\psi_{\theta}|\psi_{\theta}\rangle}\langle\sigma|\hat{H}|\sigma'\rangle\frac{\psi_{\theta}(\sigma')}{\psi_{\theta}(\sigma)}O^{*}(\sigma)\\ &=\sum_{\sigma}p_{\theta}(\sigma)E_{\mathrm{loc}}(\sigma)O^{*}(\sigma)\\ &\approx\langle E_{\mathrm{loc}}O^{*}\rangle \tag*{(48)} \end{aligned}

used the sample average defined in Eq. (34) and defined the logarithmic wavefunction derivative O(σ)∈Cnp\mathbf{O}(\boldsymbol{\sigma}) \in\mathbb{C}^{n_p}. Component-wise, the logarithmic derivative reads Oi(σ)=∂θiln⁡ψθ(σ)=∂θiψθ(σ)/ψθ(σ)O_i(\boldsymbol{\sigma}) = \partial_{\theta_i} \ln\psi_\theta(\boldsymbol{\sigma}) = \partial_{\theta_i} \psi_\theta(\boldsymbol{\sigma})/\psi_\theta(\boldsymbol{\sigma}).

Sampling

Markov-chain Monte Carlo

Expectation values are estimated by sampling configurations σ\boldsymbol{\sigma} from the variational probability distribution pθ(σ)=∣ψθ(σ)∣2/⟨ψθ∣ψθ⟩p_\theta(\boldsymbol{\sigma}) = |\psi_\theta(\boldsymbol{\sigma})|^2/\langle\psi_\theta|\psi_\theta\rangle. The Hilbert space grows exponentially with system size, making direct summation over all configurations intractable. We therefore employ Markov-chain Monte Carlo (MCMC) to generate samples distributed according to pθ(σ)p_\theta(\boldsymbol{\sigma}). We construct a Markov chain with transition probability t(σ→σ′)t(\boldsymbol{\sigma} \to\boldsymbol{\sigma}') that satisfies a detailed balance pθ(σ)t(σ→σ′)=pθ(σ′)t(σ′→σ)p_\theta(\boldsymbol{\sigma})t(\boldsymbol{\sigma} \to\boldsymbol{\sigma}') = p_\theta(\boldsymbol{\sigma}')t(\boldsymbol{\sigma}' \to\boldsymbol{\sigma}) such that the stationary distribution of the chain is pθ(σ)p_\theta(\boldsymbol{\sigma}).

We employ the Metropolis algorithm with symmetric proposals. Given a current configuration σ\boldsymbol{\sigma}, a trial configuration σ′\boldsymbol{\sigma}' is proposed and accepted with probability

A(σ→σ′)=min⁡[1,pθ(σ′)pθ(σ)]=min⁡[1,∣ψθ(σ′)∣2∣ψθ(σ)∣2].(49)A(\boldsymbol{\sigma} \to\boldsymbol{\sigma}') = \min\left[1, \frac{p_\theta(\boldsymbol{\sigma}')}{p_\theta(\boldsymbol{\sigma})}\right] = \min\left[1, \frac{|\psi_\theta(\boldsymbol{\sigma}')|^2}{|\psi_\theta(\boldsymbol{\sigma})|^2}\right]. \tag*{(49)}

For numerical stability, we evaluate the probability ratio using the logarithm of the wavefunction ln⁡ψθ(σ)\ln\psi_\theta(\boldsymbol{\sigma}),

∣ψθ(σ′)∣2∣ψθ(σ)∣2=exp⁡[2Re⁡(ln⁡ψθ(σ′)−ln⁡ψθ(σ))].(50)\frac{|\psi_\theta(\boldsymbol{\sigma}')|^2}{|\psi_\theta(\boldsymbol{\sigma})|^2} = \exp\left[2\operatorname{Re}\left(\ln\psi_\theta(\boldsymbol{\sigma}') - \ln\psi_\theta(\boldsymbol{\sigma})\right)\right]. \tag*{(50)}

Proposal move and sampling protocol

We use local single-spin-flip proposals. For a configuration σ∈{±1}N\boldsymbol{\sigma} \in\{ \pm1\}^{N}, a site i∈{1,…,N}i \in\{1,\ldots,N\} is selected uniformly at random, and the trial configuration σ′\boldsymbol{\sigma}' is obtained by flipping σi→−σi\sigma_i \to-\sigma_i. Thus, the proposal probability q(σ′∣σ)q(\boldsymbol{\sigma}'|\boldsymbol{\sigma}), defined as the probability of proposing σ′\boldsymbol{\sigma}' given the current configuration σ\boldsymbol{\sigma}, is 1/N1/N for configurations σ′\boldsymbol{\sigma}' that differ from σ\boldsymbol{\sigma} by a single spin flip and zero otherwise. Since the spin flip is reversible, the proposal distribution is symmetric q(σ′∣σ)=q(σ∣σ′)q(\boldsymbol{\sigma}'|\boldsymbol{\sigma}) = q(\boldsymbol{\sigma}|\boldsymbol{\sigma}'), and therefore the acceptance probability is given by Eq. (49).

At the beginning of optimization, the nbatchn_{\mathrm{batch}} chains are initialized from random spin configurations, with each spin chosen independently and uniformly from {−1,1}\{-1,1\}. Sampling proceeds immediately, without a burn-in period (i.e., a waiting period to allow the chains to equilibrate towards the stationary distribution of the target distribution). The Markov chains are then evolved independently and persistently across optimization steps, with the target distribution pθ(σ)p_\theta(\boldsymbol{\sigma}) updated at each step. Between successive optimization steps, each chain evolves for nresn_{\mathrm{res}} Metropolis updates. Subsequently, the final configuration is retained from each chain, giving ns=nbatchn_s = n_{\mathrm{batch}} samples per iteration. The resulting configurations are then used to evaluate local estimators as given in section SIII A.

For the simulations reported in the manuscript, we choose nres=Nn_{\mathrm{res}} = N, which corresponds to one attempted spin update per site on average between successive optimization steps. All chains and Metropolis updates are evaluated in parallel over the batch dimension and the batch size is chosen as nbatch=219n_{\mathrm{batch}} = 2^{19}.

Stochastic Reconfiguration (SR)

Let us assume that the states are parameterized by a set of real parameters θ\boldsymbol{\theta}. Stochastic reconfiguration can be interpreted as a natural-gradient update on the variational manifold of quantum states ∣ψθ⟩|\psi_\theta\rangle. The projective Hilbert space is a Kähler manifold endowed with the Fubini-Study metric and a compatible symplectic form. The variational family is a real submanifold that inherits a Riemannian metric gg and a two-form ω\omega from this structure, given by g=Re⁡Qg = \operatorname{Re}Q and ω=−2Im⁡Q\omega= -2\operatorname{Im}Q, where QQ is the quantum geometric tensor pulled back to the variational submanifold. The submanifold is generally not itself Kähler, since it need not inherit the compatible complex structure. We induce the metric gg from the Fubini-Study quantum distance

dFS2=−ln⁡(∣⟨ψθ∣ψθ′⟩∣2⟨ψθ∣ψθ⟩⟨ψθ′∣ψθ′⟩).(51)d_{\mathrm{FS}}^2 = -\ln\left(\frac{|\langle\psi_\theta|\psi_{\theta'}\rangle|^2}{\langle\psi_\theta|\psi_\theta\rangle\langle\psi_{\theta'}|\psi_{\theta'}\rangle}\right). \tag*{(51)}

Assuming θ′=θ+δθ\theta' = \theta+ \delta\theta, the argument can be Taylor expanded up to second order in δθ\delta\theta as

∣⟨ψθ∣ψθ′⟩∣2⟨ψθ∣ψθ⟩⟨ψθ′∣ψθ′⟩≈(1+aiδθi+(bij−Re⁡Qij)δθiδθj)(1−aiδθi+(aiaj−bij)δθiδθj)≈1−Re⁡Qijδθiδθj,(52)\frac{\left|\langle\psi_\theta|\psi_{\theta'}\rangle\right|^2}{\langle\psi_\theta|\psi_\theta\rangle\langle\psi_{\theta'}|\psi_{\theta'}\rangle} \approx\left(1+a_i\delta\theta_i+\left(b_{ij}-\operatorname{Re}Q_{ij}\right)\delta\theta_i\delta\theta_j\right) \left(1-a_i\delta\theta_i+\left(a_i a_j-b_{ij}\right)\delta\theta_i\delta\theta_j\right) \approx1-\operatorname{Re}Q_{ij}\delta\theta_i\delta\theta_j, \tag*{(52)}

where the summation convention is assumed. The above drifting-norm terms ai=∂iln⁡⟨ψθ∣ψθ⟩a_i=\partial_i\ln\langle\psi_\theta|\psi_\theta\rangle and bij=12⟨ψθ∣ψθ⟩∂i∂j⟨ψθ∣ψθ⟩b_{ij}=\frac{1}{2\langle\psi_\theta|\psi_\theta\rangle}\partial_i\partial_j\langle\psi_\theta|\psi_\theta\rangle out, resulting in the infinitesimal Fubini-Study distance

dFS2≈−ln⁡(1−Re⁡Qijδθiδθj)≈Re⁡Qijδθiδθj,(53)d_{\mathrm{FS}}^2\approx-\ln\left(1-\operatorname{Re}Q_{ij}\delta\theta_i\delta\theta_j\right) \approx\operatorname{Re}Q_{ij}\delta\theta_i\delta\theta_j, \tag*{(53)}

where QijQ_{ij} represent the elements of the quantum geometric tensor

Qij=1⟨ψθ∣ψθ⟩⟨∂ψθ∂θi|(1−P^)|∂ψθ∂θj⟩,(54)Q_{ij}=\frac{1}{\langle\psi_\theta|\psi_\theta\rangle}\left\langle\frac{\partial\psi_\theta}{\partial\theta_i}\middle|(1-\hat{P})\middle|\frac{\partial\psi_\theta}{\partial\theta_j}\right\rangle, \tag*{(54)}

and P^\hat{P} is the state projector;

P^=∣ψθ⟩⟨ψθ∣⟨ψθ∣ψθ⟩.(55)\hat{P}=\frac{|\psi_\theta\rangle\langle\psi_\theta|}{\langle\psi_\theta|\psi_\theta\rangle}. \tag*{(55)}

It follows that for infinitesimally close states, the Fubini-Study distance induces a Riemannian metric on the parameter space given as gij=Re⁡Qijg_{ij}=\operatorname{Re}Q_{ij}.

We further define the (complex) Berry connection

A=i⟨ψθ∣∂θψθ⟩⟨ψθ∣ψθ⟩.(56)\mathcal{A}=i\frac{\langle\psi_\theta|\partial_\theta\psi_\theta\rangle}{\langle\psi_\theta|\psi_\theta\rangle}. \tag*{(56)}

By straightforward evaluation, we find Qij=Qji−i(∂iAj−∂jAi)Q_{ij}=Q_{ji}-i\left(\partial_iA_j-\partial_jA_i\right), from which we deduce that the Berry curvature wij=(∂iAj−∂jAi)w_{ij}=\left(\partial_iA_j-\partial_jA_i\right) is the anti-symmetric two-form. The Berry connection motivates us to define the gauge-covariant derivative ∇:=∂θ+iA\nabla:=\partial_\theta+i\mathcal{A}, whose commutator is the curvature wij=−i[∇i,∇j]w_{ij}=-i[\nabla_i,\nabla_j]. Under the transformation ∣ψθ⟩→eiφ(θ)∣ψθ⟩|\psi_\theta\rangle\to e^{i\varphi(\theta)}|\psi_\theta\rangle, we find

Ai=i⟨ψθ∣∂i∣ψθ⟩⟨ψθ∣ψθ⟩→i⟨ψθ∣e−iφ(θ)∂ieiφ(θ)∣ψθ⟩⟨ψθ∣ψθ⟩=Ai−∂iφ(θ),(57)A_i=i\frac{\langle\psi_\theta|\partial_i|\psi_\theta\rangle}{\langle\psi_\theta|\psi_\theta\rangle}\to i\frac{\langle\psi_\theta|e^{-i\varphi(\theta)}\partial_i e^{i\varphi(\theta)}|\psi_\theta\rangle}{\langle\psi_\theta|\psi_\theta\rangle} =A_i-\partial_i\varphi(\theta), \tag*{(57)}

and further

∇∣ψθ⟩→(∂θ+iA−i∂θφ(θ))eiφ(θ)∣ψθ⟩=eiφ(θ)∇∣ψθ⟩(58)\nabla|\psi_\theta\rangle\to(\partial_\theta+i\mathcal{A}-i\partial_\theta\varphi(\theta))e^{i\varphi(\theta)}|\psi_\theta\rangle =e^{i\varphi(\theta)}\nabla|\psi_\theta\rangle \tag*{(58)}

Therefore, the covariant derivative transforms covariantly under gauge transformations, and we find

⟨ψθ∣∇∣ψθ⟩⟨ψθ∣ψθ⟩=⟨ψθ∣∂θ∣ψθ⟩⟨ψθ∣ψθ⟩+iA=0.(59)\frac{\langle\psi_\theta|\nabla|\psi_\theta\rangle}{\langle\psi_\theta|\psi_\theta\rangle} =\frac{\langle\psi_\theta|\partial_\theta|\psi_\theta\rangle}{\langle\psi_\theta|\psi_\theta\rangle}+i\mathcal{A}=0. \tag*{(59)}

The quantum geometric tensor can be compactly expressed in terms of the covariant derivative as

Qij=⟨∇iψθ∣∇jψθ⟩⟨ψθ∣ψθ⟩,(60)Q_{ij}=\frac{\langle\nabla_i\psi_\theta|\nabla_j\psi_\theta\rangle}{\langle\psi_\theta|\psi_\theta\rangle}, \tag*{(60)}

which highlights its gauge independence due to Eq. (58). Finally, we can equip every point of the manifold with a tangent space TθM=span⁡{∣∇ψθ⟩}T_\theta M=\operatorname{span}\{|\nabla\psi_\theta\rangle\}, endowed with the inner product ⟨u∣v⟩TθM:=⟨u∣v⟩/⟨ψθ∣ψθ⟩\langle u|v\rangle_{T_\theta M}:=\langle u|v\rangle/\langle\psi_\theta|\psi_\theta\rangle.

In order to evolve an initial state with finite ground state overlap closer towards the ground state, we apply imaginary time-evolution, i.e.

∣ϕθ⟩=e−2ηH^∣ψθ⟩.(61)|\phi_\theta\rangle= e^{-2\eta\hat{H}}|\psi_\theta\rangle. \tag*{(61)}

To find the optimal tangential vector, we extremize the (in this case gauge-invariant) vector distance

dvec2=∥∣tθ⟩−∣ϕθ⟩∥2⟨ψθ∣ψθ⟩(62)d_{\mathrm{vec}}^2 = \frac{\left\| |t_\theta\rangle- |\phi_\theta\rangle\right\|^2}{\langle\psi_\theta|\psi_\theta\rangle} \tag*{(62)}

with respect to the coordinates ckc_k of the tangent state ∣tθ⟩=ci∇i∣ψθ⟩|t_\theta\rangle= c_i\nabla_i|\psi_\theta\rangle. We restrict the coefficients to be real c∈R\mathbf{c} \in\mathbb{R}, as appropriate for a variational family with real parameters θ\boldsymbol{\theta}. With the tangent-space inner product, we have ⟨tθ∣tθ⟩TθM=cicjgij\langle t_\theta|t_\theta\rangle_{T_\theta M} = c_i c_j g_{ij}. Requiring ∂ckdvec2=0\partial_{c_k}d_{\mathrm{vec}}^2 = 0 leads us to

gkjcj=Re⁡⟨ψθ∣e−2ηH^∇k∣ψθ⟩⟨ψθ∣ψθ⟩.(63)g_{kj}c_j = \frac{\operatorname{Re}\langle\psi_\theta|e^{-2\eta\hat{H}}\nabla_k|\psi_\theta\rangle}{\langle\psi_\theta|\psi_\theta\rangle}. \tag*{(63)}

For sufficiently small η>0\eta> 0 we can approximate e−2ηH^≈1−2ηH^e^{-2\eta\hat{H}} \approx1 - 2\eta\hat{H}. Since ∇i∣ψθ⟩\nabla_i|\psi_\theta\rangle is orthogonal to ∣ψθ⟩|\psi_\theta\rangle in the ambient Hilbert space (see Eq. (59)), the leading-order term vanishes and we find

gkjcj≈−2ηRe⁡⟨ψθ∣H^∇k∣ψθ⟩⟨ψθ∣ψθ⟩=−η2Re⁡(⟨ψθ∣H^∣∂kψθ⟩⟨ψθ∣ψθ⟩−⟨ψθ∣H^∣ψθ⟩⟨ψθ∣ψθ⟩⟨ψθ∣∂kψθ⟩⟨ψθ∣ψθ⟩)=−η∂kE.(64)\begin{aligned} g_{kj}c_j &\approx-2\eta\frac{\operatorname{Re}\langle\psi_\theta|\hat{H}\nabla_k|\psi_\theta\rangle}{\langle\psi_\theta|\psi_\theta\rangle} \\ &= -\eta2\operatorname{Re}\left(\frac{\langle\psi_\theta|\hat{H}|\partial_k\psi_\theta\rangle}{\langle\psi_\theta|\psi_\theta\rangle} - \frac{\langle\psi_\theta|\hat{H}|\psi_\theta\rangle}{\langle\psi_\theta|\psi_\theta\rangle}\frac{\langle\psi_\theta|\partial_k\psi_\theta\rangle}{\langle\psi_\theta|\psi_\theta\rangle}\right) \\ &= -\eta\partial_k E. \tag*{(64)} \end{aligned}

If we now require that the entire right-hand side ηgjk−1∂kE\eta g^{-1}_{jk}\partial_k E be small enough to approximate ∣ψθ+δθ⟩≈∣ψθ⟩+δθ⋅∇∣ψθ⟩|\psi_{\theta+\delta\theta}\rangle\approx|\psi_\theta\rangle+ \delta\boldsymbol{\theta}\cdot\nabla|\psi_\theta\rangle, we can identify cj=δθjc_j = \delta\theta_j and arrive at

gijδθj=−η∂iE,(65)g_{ij}\delta\theta_j = -\eta\partial_i E, \tag*{(65)}

which in the Monte Carlo community is the defining equation of stochastic reconfiguration (SR). We can now see that Eq. (65) takes the form of a Riemannian gradient descent, taking into account the metric distance in the manifold of variational states.

SV Regularized Riemannian Gradient Descent

A Derivation of constrained gradient descent

For real parameters θ∈Rnp\boldsymbol{\theta} \in\mathbb{R}^{n_p}, consider the minimization of the locally linearized energy subject to a fixed Euclidean step,

LGD(δθ)=∂θE⋅δθ+λ2(∣δθ∣2−η′2).(66)\mathcal{L}_{\mathrm{GD}}(\delta\boldsymbol{\theta}) = \partial_{\theta}E \cdot\delta\boldsymbol{\theta} + \frac{\lambda}{2}\left(|\delta\boldsymbol{\theta}|^2 - \eta^{\prime2}\right). \tag*{(66)}

Stationarity and the norm constraint give

δθ=−η′∂θE∣∂θE∣.(67)\delta\boldsymbol{\theta} = -\eta^\prime\frac{\partial_{\theta}E}{|\partial_{\theta}E|}. \tag*{(67)}

Hence, gradient descent is locally the direction that minimizes the energy at fixed Euclidean distance. For variational quantum states, replacing the Euclidean norm by the quantum line element gives

LRGD(δθ)=∂θE⋅δθ+λ2(δθTgδθ−η′2).(68)\mathcal{L}_{\mathrm{RGD}}(\delta\boldsymbol{\theta}) = \partial_{\theta}E \cdot\delta\boldsymbol{\theta} + \frac{\lambda}{2}\left(\delta\boldsymbol{\theta}^{T}g\delta\boldsymbol{\theta} - \eta^{\prime2}\right). \tag*{(68)}

Assuming that gg is invertible in the relevant tangent subspace, this yields

gδθ=−1λ∂θE,λ=(∂θE)⋅(g−1∂θE)η′.(69)g\delta\boldsymbol{\theta} = -\frac{1}{\lambda}\partial_{\theta}E,\qquad\lambda= \frac{\sqrt{(\partial_{\theta}E)\cdot(g^{-1}\partial_{\theta}E)}}{\eta^\prime}. \tag*{(69)}

Instead of a fixed η′\eta', it is more convenient to absorb the gradient norm into the learning rate, i.e. η=η′/∂θE(θ)⋅(g−1∂θE(θ))\eta= \eta'/\sqrt{\partial_\theta E(\theta)\cdot(g^{-1}\partial_\theta E(\theta))}, such that the update step simplifies to the SR equation Eq. (65). This has the benefits that (i) a constant η\eta dynamically adapts the update step’s quantum distance (equal to η′\eta') and (ii) we do not need to invert the large dense matrix representation of the quantum metric gg but may rely on matrix-free conjugate gradient methods to find a non-trivial solution to Eq. (65).

To additionally bound the endpoint in parameter space, consider

∣θ+δθ∣2≤μ′2.(70)\lvert\theta+\delta\theta\rvert^2\leq\mu'^2. \tag*{(70)}

The associated Karush-Kuhn-Tucker Lagrangian is

LRRGD(δθ)=LRGD(δθ)+ν2(∣θ+δθ∣2−μ′2),(71)\mathcal{L}_{\mathrm{RRGD}}(\delta\theta)=\mathcal{L}_{\mathrm{RGD}}(\delta\theta)+\frac{\nu}{2}\left(\lvert\theta+\delta\theta\rvert^2-\mu'^2\right), \tag*{(71)}

with ν≥0\nu\geq0 and complementary slackness condition ν(∣θ+δθ∣2−μ′2)=0\nu\left(\lvert\theta+\delta\theta\rvert^2-\mu'^2\right)=0. The inequality constraint is enforced only when the updated parameters reach the boundary of the allowed region, in which case ν\nu may be nonzero. If the constraint is inactive, i.e., the updated parameters lie strictly within the allowed region, complementary slackness requires (ν=0)(\nu=0). An exactly constrained update would require solving a nonlinear system of equations for the multipliers at each iteration. Instead, we relax the hard constraint and treat η=1/λ\eta=1/\lambda and μ=ν/λ\mu=\nu/\lambda as hyperparameters, obtaining

(g+μ1)δθ=−η ∂θE−μθ.(72)(g+\mu\mathbf{1})\delta\theta=-\eta\,\partial_\theta E-\mu\theta. \tag*{(72)}

This defines the RRGD equation. The resulting RRGD update softly penalizes the endpoint norm rather than enforcing a prescribed value of μ′\mu'.

Spectral properties and regularization bias

We analyze the action of RRGD in the eigenbasis of the quantum metric. Let

gva=γava,γa≥0,(73)g v_a=\gamma_a v_a,\qquad\gamma_a\geq0, \tag*{(73)}

and define θa=vaTθ\theta_a=v_a^T\theta and ∂aE=vaT∂θE\partial_aE=v_a^T\partial_\theta E. Projecting Eq. (72) onto vav_a gives

δθa=−η ∂aE+μθaγa+μ=−ηγa+μ∂aE−μγa+μθa.(74)\delta\theta_a=-\frac{\eta\,\partial_aE+\mu\theta_a}{\gamma_a+\mu}=-\frac{\eta}{\gamma_a+\mu}\partial_aE-\frac{\mu}{\gamma_a+\mu}\theta_a. \tag*{(74)}

Although the Euclidean penalty is isotropic before preconditioning, its effect on the update is therefore filtered by the quantum metric. For γa≫μ\gamma_a\gg\mu, the energy-driven term approaches the SR update,

δθa=−ηγa∂aE+O(μγa),(75)\delta\theta_a=-\frac{\eta}{\gamma_a}\partial_aE+O\left(\frac{\mu}{\gamma_a}\right), \tag*{(75)}

and the restoring contribution is suppressed by μ/γa\mu/\gamma_a. In contrast, the directions with γa≲μ\gamma_a\lesssim\mu are both regularized and driven toward the reference parameters.

This selectivity is physically motivated by the relation between the metric and the energy gradient. For an unnormalized state,

∂aE=2⟨ψ∣ψ⟩Re⁡⟨∂aψ∣(H^−E)∣ψ⟩.(76)\partial_aE=\frac{2}{\langle\psi\vert\psi\rangle}\operatorname{Re}\langle\partial_a\psi\vert(\hat{H}-E)\vert\psi\rangle. \tag*{(76)}

Since ⟨ψ∣(H^−E)∣ψ⟩=0\langle\psi\vert(\hat{H}-E)\vert\psi\rangle=0, it equivalently holds that

∂aE=2⟨ψ∣ψ⟩Re⁡⟨∂aψ∣(1−P^)(H^−E)∣ψ⟩.(77)\partial_aE=\frac{2}{\langle\psi\vert\psi\rangle}\operatorname{Re}\langle\partial_a\psi\vert(1-\hat{P})(\hat{H}-E)\vert\psi\rangle. \tag*{(77)}

where P^\hat{P} is the projector from Eq. (55). The Cauchy–Schwarz inequality gives

∣∂aE∣≤2(va)i(va)jQijσ2=2vaTgvaσ2=2γaσ2.(78)\begin{aligned} \lvert\partial_aE\rvert&\leq2\sqrt{(v_a)_i(v_a)_jQ_{ij}}\sqrt{\sigma^2}\\ &=2\sqrt{v_a^Tgv_a}\sqrt{\sigma^2}\\ &=2\sqrt{\gamma_a}\sqrt{\sigma^2}. \tag*{(78)} \end{aligned}

where we identified the quantum geometric tensor QQ from Eq. (54) and the variance of energy σ2=⟨ψ∣(H^−E)2∣ψ⟩/⟨ψ∣ψ⟩\sigma^2 = \langle\psi\mid(\hat{H} - E)^2 \mid\psi\rangle/ \langle\psi\mid\psi\rangle. Thus, an exact null direction of the metric cannot carry an exact energy gradient. For small but finite γa\gamma_a, the directional energy derivative is correspondingly bounded, while the SR update divides this derivative by γa\gamma_a. Inverting the metric can therefore produce large parameter displacements and amplify sampling errors along directions to which the state is only weakly sensitive. RRGD limits this amplification by replacing γa−1\gamma_a^{-1} with (γa+μ)−1(\gamma_a+\mu)^{-1} and simultaneously anchors the corresponding parameter component.

The parameter anchoring can be viewed as a soft gauge fixing. Redundant parameterizations may represent the same normalized state at different points in parameter space; the quantum metric alone does not select among such equivalent representations. The restoring term favors the small-norm representative centered on the chosen reference point. More generally, anchoring around θref\boldsymbol{\theta}_{\mathrm{ref}} gives

(g+μ1)δθ=−η∂θE−μ(θ−θref).(79)(g+\mu\mathbb{1})\delta\boldsymbol{\theta}=-\eta\partial_{\boldsymbol{\theta}}E-\mu(\boldsymbol{\theta}-\boldsymbol{\theta}_{\mathrm{ref}}). \tag*{(79)}

In the canonical local frames used here, θref=0\boldsymbol{\theta}_{\mathrm{ref}}=0 represents the physically motivated reference texture, reducing Eq. (79) to Eq. (72).

A finite anchoring strength can also bias the optimized state. Defining ν=μ/η\nu=\mu/\eta, the update can be written as

(g+ην1)δθ=−η∂θ[E(θ)+ν2∣θ∣2].(80)(g+\eta\nu\mathbb{1})\delta\boldsymbol{\theta}=-\eta\partial_{\boldsymbol{\theta}}\left[E(\boldsymbol{\theta})+\frac{\nu}{2}\lvert\boldsymbol{\theta}\rvert^2\right]. \tag*{(80)}

Consequently, for fixed η\eta and μ\mu, an RRGD fixed point generally satisfies

∂θE=−μηθ,(81)\partial_{\boldsymbol{\theta}}E=-\frac{\mu}{\eta}\boldsymbol{\theta}, \tag*{(81)}

rather than ∂θE=0\partial_{\boldsymbol{\theta}}E=0. The ratio μ/η\mu/\eta therefore controls the strength of the parameter-norm penalty in the optimization objective. For a fixed learning rate η\eta, ordinary SR is formally recovered as μ/η→0\mu/\eta\to0, whereas keeping μ=ην\mu=\eta\nu finite corresponds to optimizing with a fixed L2L_2 penalty of strength ν\nu.

Note that regularization modifies the optimization objective, but not the Hamiltonian expectation value E(θ)E(\boldsymbol{\theta}) evaluated at a given state. Its effect on the physical energy is indirect: the penalty favors small-norm parameters and, therefore, changes the state selected by optimization. Consequently, the penalty value ν∣θ∣2/2\nu\lvert\boldsymbol{\theta}\rvert^2/2, with ν=μ/η\nu=\mu/\eta, is not the difference between the regularized and unregularized minimum energies. Subtracting it from the measured energy, therefore, does not, in general, recover the unregularized variational minimum. To reduce this bias, the anchoring strength ν\nu can gradually be decreased, allowing the state to reoptimize. This procedure approaches unregularized optimization but does not eliminate errors by itself due to incomplete convergence, local minima, or limited variational expressivity.

Convergence and numerical stability

To compare the SR and RRGD methods, we employ the antiferromagnetic triangular monolayer introduced in the main text. We train a two-headed network with the Hamiltonian (S14) with J=1J=1, B=−1.76B=-1.76, Néel-type DMI with strength DN=0.8D_{\mathrm{N}}=0.8 and periodic boundaries. The training methods are compared for both the bare Hamiltonian HH and the rotated Hamiltonian H′H', considering different initial regularization strengths μ0\mu_0. The results are shown in Figure S1. As discussed above, it follows from Eq. (80) that a finite regularization strength μ\mu introduces a bias in the energy landscape. We therefore employ a scheduled decay of μ\mu using the sequence

Figure S1. Comparison of SR and RRGD for the bare Hamiltonian (left column) and the rotated Hamiltonian (right column). (a,c) Energy difference per spin relative to the reference energy; the infinite-head extrapolation Eh→∞E_{h\to\infty}. (b,d) Euclidean norm of the variational parameters. Colors indicate the initial regularization strength μ0\mu_0; dotted, dashed, and solid lines denote SR with constant shift, SR with scheduled decay, and RRGD with scheduled decay, respectively. Circles and diamonds mark the final recorded iterations of SR runs that terminate because of NaN energy estimates. A rollback procedure restores an earlier checkpoint and increases the diagonal regularization according to Eq. (85), whenever the update fails the prescribed stability criteria. No rollback is triggered in the rotated-frame runs.

μn+1=max⁡(μnn+1n+2,10−7),(82)\mu_{n+1}=\max\left(\mu_n\frac{n+1}{n+2},10^{-7}\right), \tag*{(82)}

where nn denotes the training step (epoch). This decay is applied after each accepted update.

To prevent premature under-regularization and mitigate numerical instabilities, we additionally implement a rollback procedure based on the size and finiteness of the parameter update. Let δθn\delta\boldsymbol{\theta}_n denote the change in the parameter vector during an optimization epoch nn. During the first nw=20n_{\mathrm{w}}=20 “warm-up” epochs, a step is accepted provided that ∣δθn∣\lvert\delta\boldsymbol{\theta}_n\rvert is finite. Thereafter, we also require the relative update norm to satisfy

∣δθn∣∣θn−1∣+ϵ0<R,(83)\frac{\lvert\delta\boldsymbol{\theta}_n\rvert}{\lvert\boldsymbol{\theta}_{n-1}\rvert+\epsilon_0}<R, \tag*{(83)}

where R=5R=5 and ϵ0=10−12\epsilon_0=10^{-12}. Once at least ten accepted update norms are available, we impose the additional condition

∣δθn∣<10Δ‾n,Δ‾n=110∑j=110∣δθnj∣,(84)\lvert\delta\theta_n\rvert< 10\overline{\Delta}_n,\qquad\overline{\Delta}_n=\frac{1}{10}\sum_{j=1}^{10}\lvert\delta\theta_{n_j}\rvert, \tag*{(84)}

where the average is taken over the ten most recent accepted updates, which need not correspond to consecutive epochs.

If a step fails any of these criteria, the parameter vector is restored to the oldest checkpoint in a buffer containing up to 20 accepted parameter vectors, and the regularization strength is increased according to

μn→min⁡(100μn,μ0).(85)\mu_n\to\min(100\mu_n,\mu_0). \tag*{(85)}

The update history is retained, and the regularization schedule resumes after the next accepted step according to Eq. (82). Independently, training terminates if the energy estimate becomes NaN.

We observe that for the rotated Hamiltonian, SR and RRGD reach comparable energies over the given iteration budget [Fig. S1(c)]. Their parameter norms, however, evolve differently: SR with scheduled decay exhibits a substantially stronger growth than RRGD, without a corresponding improvement in energy [Fig. S1(d)]. A constant diagonal shift suppresses this growth, although the larger shift also slows energy convergence. All runs in the rotated frame remain numerically stable, and none trigger the rollback procedure described above.

For the bare unrotated Hamiltonian, all SR runs displayed eventually terminate because of NaN energy estimates, as indicated by their endpoint markers [Fig. S1(a,b)]. Their parameter norms exhibit pronounced growth or irregular variations before termination. Repeated rollback attempts do not restore sustained convergence in these runs, and they ultimately fail. Thus, among the configurations here, only RRGD combined with rollback sustains stability throughout the displayed interval.

These observations are consistent with the stabilizing role of the explicit restoring term −μθ-\mu\theta. RRGD maintains comparatively controlled parameter norms while reaching energies comparable to SR in the rotated frame and sustaining energy reduction in the bare frame over the displayed training interval. The results therefore demonstrate improved numerical robustness for the tested configurations, although they do not establish convergence to a stationary point or show that RRGD is unconditionally stable. The effectiveness of the method remains dependent on the regularization strength and the rollback procedure.

SVI Linear solvers

Analogously to Eq. (47), using the sample average defined in Eq. (34), we can express the quantum metric in terms of the logarithmic wavefunction derivatives as

gij=Re⁡(⟨∂iψθ∣∂jψθ⟩⟨ψθ∣ψθ⟩−⟨∂iψθ∣ψθ⟩⟨ψθ∣ψθ⟩⟨ψθ∣∂jψθ⟩⟨ψθ∣ψθ⟩)=Re⁡(⟨ ⁣⟨Oi∗Oj⟩ ⁣⟩−⟨ ⁣⟨Oi∗⟩ ⁣⟩⟨ ⁣⟨Oj⟩ ⁣⟩),(86)g_{ij} = \operatorname{Re}\left(\frac{\langle\partial_i\psi_\theta|\partial_j\psi_\theta\rangle}{\langle\psi_\theta|\psi_\theta\rangle}-\frac{\langle\partial_i\psi_\theta|\psi_\theta\rangle}{\langle\psi_\theta|\psi_\theta\rangle}\frac{\langle\psi_\theta|\partial_j\psi_\theta\rangle}{\langle\psi_\theta|\psi_\theta\rangle}\right) = \operatorname{Re}\left(\langle\!\langle O_i^*O_j\rangle\!\rangle-\langle\!\langle O_i^*\rangle\!\rangle\langle\!\langle O_j\rangle\!\rangle\right), \tag*{(86)}

where we used that

⟨∂iψθ∣∂jψθ⟩⟨ψθ∣ψθ⟩=∑σ1⟨ψθ∣ψθ⟩⟨∂iψθ∣σ⟩⟨σ∣∂jψθ⟩=∑σ1⟨ψθ∣ψθ⟩(∂iψθ(σ))∗∂jψθ(σ)=∑σ∣ψθ(σ)∣2⟨ψθ∣ψθ⟩(∂iln⁡ψθ(σ))∗∂jln⁡ψθ(σ)=∑σpθ(σ)Oi∗(σ)Oj(σ)≈⟨ ⁣⟨Oi∗Oj⟩ ⁣⟩.(87)\begin{aligned} \frac{\langle\partial_i\psi_\theta|\partial_j\psi_\theta\rangle}{\langle\psi_\theta|\psi_\theta\rangle} &= \sum_\sigma\frac{1}{\langle\psi_\theta|\psi_\theta\rangle}\langle\partial_i\psi_\theta|\sigma\rangle\langle\sigma|\partial_j\psi_\theta\rangle\\ &= \sum_\sigma\frac{1}{\langle\psi_\theta|\psi_\theta\rangle}\left(\partial_i\psi_\theta(\sigma)\right)^*\partial_j\psi_\theta(\sigma) \\ &= \sum_\sigma\frac{|\psi_\theta(\sigma)|^2}{\langle\psi_\theta|\psi_\theta\rangle}\left(\partial_i\ln\psi_\theta(\sigma)\right)^*\partial_j\ln\psi_\theta(\sigma) \\ &= \sum_\sigma p_\theta(\sigma)O_i^*(\sigma)O_j(\sigma) \\ &\approx\langle\!\langle O_i^*O_j\rangle\!\rangle. \tag*{(87)} \end{aligned}

To avoid forming full matrices, we instead compute Jacobian-vector (JVP) and vector-Jacobian (VJP) products on the fly, which avoids the explicit construction of the ns×npn_s \times n_p Jacobian or the np×npn_p \times n_p metric and therefore keeps the memory at that of a forward and backward pass over the batch [29]. The JVP and VJP exploit the forward- and reverse-mode autodiff primitives of the JAX library [27], respectively. They are defined as the contraction of a (co)vector vv with the Jacobian ∂fi(x)/∂θj\partial f_i(x)/\partial\theta_j of the multivariate function ff with components fi(x)f_i(x), i.e.:

JVP⁡f(v)=∂fi(x)∂θjvj.(88)\operatorname{JVP}_f(v) = \frac{\partial f_i(x)}{\partial\theta_j}v_j. \tag*{(88)}
VJP⁡f(v)=vi∂fi(x)∂θj.(89)\operatorname{VJP}_f(v) = v_i\frac{\partial f_i(x)}{\partial\theta_j}. \tag*{(89)}

Recast in terms of these operations, the contraction of the quantum metric with a vector δθ\delta\theta can be expressed as

gδθ=Re⁡(1nsVJP⁡ln⁡ψ∗(JVP⁡ln⁡ψ(δθ)))−Re⁡(VJP⁡⟨ ⁣⟨ln⁡ψ⟩ ⁣⟩∗(JVP⁡⟨ ⁣⟨ln⁡ψ⟩ ⁣⟩(δθ))),(90)g\delta\theta= \operatorname{Re}\left(\frac{1}{n_s}\operatorname{VJP}_{\ln\psi}^*\left(\operatorname{JVP}_{\ln\psi}(\delta\theta)\right)\right)-\operatorname{Re}\left(\operatorname{VJP}_{\langle\!\langle\ln\psi\rangle\!\rangle}^*\left(\operatorname{JVP}_{\langle\!\langle\ln\psi\rangle\!\rangle}(\delta\theta)\right)\right), \tag*{(90)}

and the energy gradient (S39) reads

∂θE(θ)=2Re⁡(1nsVJP⁡ln⁡ψ(Eloc∗))−2Re⁡(VJP⁡⟨ ⁣⟨ln⁡ψ⟩ ⁣⟩∗(⟨ ⁣⟨Eloc∗⟩ ⁣⟩)),(91)\partial_\theta E(\theta) = 2\operatorname{Re}\left(\frac{1}{n_s}\operatorname{VJP}_{\ln\psi}(E_{\mathrm{loc}}^*)\right)-2\operatorname{Re}\left(\operatorname{VJP}_{\langle\!\langle\ln\psi\rangle\!\rangle}^*\left(\langle\!\langle E_{\mathrm{loc}}^*\rangle\!\rangle\right)\right), \tag*{(91)}

where ln⁡ψ\ln\psi and ElocE_{\mathrm{loc}} are vectors with components ln⁡ψi=ln⁡ψ(σi)\ln\psi_i=\ln\psi(\sigma_i) and Eloc,i=Eloc(σi)E_{\mathrm{loc},i}=E_{\mathrm{loc}}(\sigma_i), respectively. This matrix-free implementation requires only action on trial vectors, which is suitable for iterative linear solvers. In this work, we use the conjugate gradient method implemented in the JAX library [27] as jax.scipy.sparse.linalg.cg.

References

  1. [1]G. Carleo and M. Troyer, Solving the quantum many-body problem with artificial neural networks, Science 355, 602 (2017).DOI
  2. [2]D.-L. Deng, X. Li, and S. Das Sarma, Quantum entanglement in neural network states, Phys. Rev. X 7, 021021 (2017).DOI
  3. [3]K. Choo, G. Carleo, N. Regnault, and T. Neupert, Symmetries and many-body excitations with neural-network quantum states, Phys. Rev. Lett. 121, 167204 (2018).
  4. [4]H. Lange, A. Van de Walle, A. Abedinnia, and A. Bohrdt, From architectures to applications: a review of neural quantum states, Quantum Science and Technology 9, 040501 (2024).
  5. [5]M. Medvidović and J. Robledo Moreno, Neural-network quantum states for many-body physics, European Physical Journal Plus 139, 631 (2024).
  6. [6]D. P. Kingma and J. Ba, Adam: A method for stochastic optimization (2017), arXiv:1412.6980 [cs.LG].arxiv.org/abs/1412.6980
  7. [7]J. P. Provost and G. Vallee, Renormalization structure on manifolds of quantum states, Communications in Mathematical Physics 76, 289 (1980).DOI
  8. [8]S.-i. Amari, Natural gradient works efficiently in learning, Neural Computation 10, 251 (1998).
  9. [9]S. Sorella, Green function monte carlo with stochastic reconfiguration, Phys. Rev. Lett. 80, 4558 (1998).
  10. [10]M. Pervez, A. Haqq, N. McMahon, and C. Arenz, Riemannian gradient descent-based quantum algorithms for ground state preparation with guarantees (2025), arXiv:2512.13401 [quant-ph].arxiv.org/abs/2512.13401
  11. [11]R. Rende, L. L. Viteritti, L. Bardone, F. Becca, and S. Goldt, A simple linear algebra identity to optimize large-scale neural network quantum states, Communications Physics 7 (2024).DOI
  12. [12]A. Chen and M. Heyl, Empowering deep neural quantum states through efficient optimization, Nature Physics 20, 1476 (2024).DOI
  13. [13]A. Guzmán-Cordero, F. Dangel, G. Goldshlager, and M. Zeinhofer, Improving energy natural gradient descent through woodbury, momentum, and randomization (2025), arXiv:2505.12149 [cs.LG].
  14. [14]W. Liu and W. Dou, Publicly restarted lanczos enables chemically accurate shallow neural quantum states, Precision Chemistry 4, 1395 (2026).
  15. [15]T. Hur, Stochastic reconfiguration as statistical filtering for overparameterized neural quantum states (2026), arXiv:2609.23334 [quant-ph].arxiv.org/abs/2609.23334
  16. [16]L. Wei, Y. Wang, C. Cao, and H. Ling, Apparent compression, real stability: The intrinsic dimension of learning a quantum wavefunction (2026), arXiv:2609.33193 [cs.LG].arxiv.org/abs/2609.33193
  17. [17]M. Solinas, A. Valenti, N. Bou-Rabee, and R. Wiersema, Neural quantum states in mixed precision (2026), arXiv:2601.20782 [quant-ph].arxiv.org/abs/2601.20782
  18. [18]M. Y. Pei and S. R. Clark, Neural-network quantum states for spin-1 systems: Spin-basis and parameterization effects on compactness of representations, Entropy 23 (2021).DOI
  19. [19]S. B. Kožić, V. Zlatić, F. Franchini, and S. M. Giampaolo, Exploring the effect of basis rotation on nqs performance (2026), arXiv:2512.17893 [quant-ph].arxiv.org/abs/2512.17893
  20. [20]R. S. Cortes Santamaria, A. S. Shankar, M. Dalmonte, R. Verdel, and N. Niggemann, Basis dependence of neural quantum states for the transverse field ising model, SciPost Phys. Core 9, 027 (2026).
  21. [21]N. Paul, K. Chen, J. K. Jiang, H. Zhao, and D. Luo, Walshness: an intrinsic neural-network representability metric for quantum states (2026), arXiv:2610.00505 [quant-ph].arxiv.org/abs/2610.00505
  22. [22]J. R. Moreno, J. Cohn, D. Sels, and M. Motta, Enhancing the expressivity of variational neural, and hardware-efficient quantum states through orbital rotations (2023), arXiv:2302.11588 [quant-ph].arxiv.org/abs/2302.11588
  23. [23]A. Haller, S. Groeneindijk, A. Habibi, A. Michels, and T. L. Schmidt, Quantum skyrmion lattices in heisenberg ferromagnets, Phys. Rev. Res. 4, 043113 (2022).DOI
  24. [24]A. Joshi, R. Peters, and T. Posske, Ground state properties of quantum skyrmions described by neural network quantum states, Phys. Rev. B 108, 094410 (2023).DOI
  25. [25]J. Corte, F. Holik, L. Rebón, and F. A. G. Albarracín, Quantum skyrmions in the antiferromagnetic triangular lattice (2026), arXiv:2601.18737 [cond-mat.str-el].arxiv.org/abs/2601.18737
  26. [26]Š. Ličkář, A. Haller, A. Michels, T. L. Schmidt, and V. M. Kuchkin, Skyrmionic Schrödinger cat states in monoaxial chiral magnets, Phys. Rev. B 113, 174403 (2026).
  27. [27]J. Bradbury, R. Frostig, P. Hawkins, M. J. Johnson, C. Leary, D. Maclaurin, G. Necula, A. Paszke, J. VanderPlas, S. Wanderman-Milne, and Q. Zhang, JAX: composable transformations of Python+NumPy programs (2018).
  28. [28]See Supplemental Material at [URL] for details on the derivation of the Regularized Riemannian Gradient Descent algorithm, the implementation and training of the neural network quantum states, and additional numerical results.
  29. [29]R. Novak, J. Sohl-Dickstein, and S. S. Schoenholz, Fast finite width neural tangent kernel (2022), arXiv:2206.08720 [cs.LG].arxiv.org/abs/2206.08720
  30. [30]O. Sharir, A. Shashua, and G. Carleo, Neural tensor contractions and the expressive power of deep neural quantum states, Phys. Rev. B 106, 205136 (2022).DOI
  31. [31]T. Westerhout, N. Astrakhantsev, K. S. Tikhonov, M. Katsnelson, and A. A. Bagrov, Generalization properties of neural network approximations to frustrated magnet ground states, Nature Communications 11, 1593 (2020).DOI
  32. [32]C. Roth, A. Szabó, and A. H. MacDonald, High-accuracy variational monte carlo for frustrated magnets with deep neural networks, Phys. Rev. B 108, 054410 (2023).DOI
  33. [33]A. Joshi, R. Peters, and T. Posske, Quantum skyrmion dynamics studied by neural network quantum states, Physical Review B 110, 104411 (2024).arxiv.org/abs/2403.08184
  34. [34]R. P. Nutakki, A. Shokry, and F. Vicentini, Design principles of deep translationally-symmetric neural quantum states for frustrated magnets, Physical Review Research 7, 043099 (2025).DOI
  35. [35]R. Rende, L. L. Viteritti, F. Becca, A. Scardicchio, A. Laio, and G. Carleo, Foundation neural-networks quantum states as a unified ansatz for multiple hamiltonians, Nature Communications 16 (2025).DOI
  36. [36]R. Rende and L. Loris Viteritti, Are queries and keys always relevant? A case study on transformer wave functions, Machine Learning: Science and Technology 6, 010501 (2025).DOI
  37. [37]R. Rende, F. Gerace, A. Laio, and S. Goldt, A distributional simplicity bias in the learning dynamics of transformers (2025), arXiv:2410.19637 [cs.CL].arxiv.org/abs/2410.19637
  38. [38]S. R. White, Density matrix formulation for quantum renormalization groups, Phys. Rev. Lett. 69, 2863 (1992).pubmed.ncbi.nlm.nih.gov/10046608
  39. [39]U. Schollwöck, The density-matrix renormalization group, Rev. Mod. Phys. 77, 259 (2005).DOI
  40. [40]U. Schollwöck, The density-matrix renormalization group in the age of matrix product states, Annals of Physics 326, 96 (2011).DOI
  41. [41]A. N. Tikhonov, Solution of incorrectly formulated problems and the regularization method, Soviet Mathematics Doklady 4, 1035 (1963).
  42. [42]A. N. Tikhonov and V. Y. Arsenin, Solutions of Ill-Posed Problems (Winston, Washington, D.C., 1977).DOI
  43. [43]K. Levenberg, A method for the solution of certain non-linear problems in least squares, Quarterly of Applied Mathematics 2, 164 (1944).DOI
  44. [44]D. W. Marquardt, An algorithm for least-squares estima- tion of nonlinear parameters, Journal of the Society for Industrial and Applied Mathematics 11, 431 (1963).
  45. [45]H. W. Engl, M. Hanke, and A. Neubauer, Regularization of Inverse Problems, Mathematics and Its Applications, Vol. 375 (Kluwer Academic Publishers, Dordrecht, 1996).
  46. [46]A. S. Savchenko, V. M. Kuchkin, F. N. Rybakov, S. Blügel, and N. S. Kiselev, Chiral standing spin waves in skyrmion lattice, APL Materials 10, 071111 (2022).DOI
  47. [47]A. Haller, S. A. Díaz, W. Belzig, and T. L. Schmidt, Quantum magnetic skyrmion operator, Phys. Rev. Lett. 133, 216702 (2024).arxiv.org/abs/2403.10347
  48. [48]F. Verstraete, D. Porras, and J. I. Cirac, Density matrix renormalization group and periodic boundary conditions: A quantum information perspective, Phys. Rev. Lett. 93, 227205 (2004).pubmed.ncbi.nlm.nih.gov/15601115
  49. [49]S. Ghosh, H. Katsumoto, G. Bihlmayer, M. Sallermann, V. M. Kuchkin, F. N. Rybakov, O. Eriksson, S. Blügel, and N. S. Kiselev, Linked skyrmions in shifted magnetic bilayer, Communications Physics 9, 104 (2026).
  50. [50]W. Döring, Point singularities in micromagnetism, Jour- nal of Applied Physics 39, 1006 (1968).
  51. [51]V. M. Kuchkin, A. Haller, S. Liscak, M. P. Adams, V. Rai, E. P. Sinaga, A. Michels, and T. L. Schmidt, Quantum and classical magnetic Bloch points, Physical Review Research 7, 013195 (2025).DOI

Paper details

vlnc:W_5a6sxusk
Version
v1 · latest
Published
Fresh — added to the Hub within the last 30 days
Added
License
CC BY 4.0
Usage

views · 0

downloads · 0

A view counts once per browser per day, a download each time the PDF is requested.

  • Physics and Astronomy

Not recorded for this paper

View statement
Looking for related papers…
Contents