betaFeedback

WorksPhysics and Astronomy

Quantum natural gradient without monotonicity

Abstract

Natural gradient (NG) is an information-geometric optimization method that plays a crucial role, especially in the estimation of parameters for machine learning models like neural networks. To apply NG to quantum systems, the quantum natural gradient (QNG) was introduced and utilized for noisy intermediate-scale devices. Additionally, a mathematically equivalent approach to QNG, known as the stochastic reconfiguration method, has been implemented to enhance the performance of quantum Monte Carlo methods. It is worth noting that these methods are based on the symmetric logarithmic derivative (SLD) metric, which is one of the monotone metrics. So far, monotonicity has been believed to be a guiding principle to construct a geometry in physics. In this paper, we propose generalized QNG by removing the condition of monotonicity. Initially, we demonstrate that monotonicity is a crucial condition for conventional QNG to be optimal. Subsequently, we provide analytical and numerical evidence showing that non-monotone QNG outperforms conventional QNG based on the SLD metric in terms of convergence speed.

Introduction

Continuous optimization is prevalent in scientific and industrial problem-solving, with a plethora of methods proposed [1]. Natural gradient (NG) stands out as a novel continuous optimization method rooted in information geometry (IG) [2, 3, 4]. The field of machine learning has gained significant attention recently, with neural networks (NNs) holding paramount importance [5, 6, 7]. NG is frequently employed in the optimization of NNs, demonstrating numerical effectiveness [8].

In the realm of physics, the era of quantum computing has dawned, prompting investigations into the hidden potential of noisy intermediate-scale quantum (NISQ) devices [9]. For NISQ devices, the parameter estimation of quantum circuits is imperative [10, 11, 12]. In addition to quantum circuit learning, estimating parameters of quantum states is essential in various contexts, including the variational Monte Carlo method [13], and tensor networks [14]. Quantum natural gradient (QNG), introduced as the quantum counterpart of NG, has recently garnered attention for its promising performance in applications [15, 16]. A mathematically equivalent method to QNG, known in condensed matter physics as the stochastic reconfiguration (SR) method [17, 18, 19, 20, 21]. Furthermore, quantum metrics find applications in classical machine learning contexts [22, 23, 24, 25]. It is noteworthy that both conventional QNG and the SR method are grounded in the symmetric logarithmic derivative (SLD) metric, which is one of the monotone quantum Fisher metrics and a fundamental concept in quantum information geometry (QIG).

In this paper, we present a generalization of QNG based on QIG. Monotonicity implies that information is not gained via completely positive and trace-preserving (CPTP) maps; so it has been believed to be a guiding principle for constructing a geometry in physics. However, from the viewpoint of optimization, it has not been clear whether it is necessary. Initially, we establish that monotonicity is a prerequisite for the SLD metric to optimize the speed of QNG. Subsequently, we theoretically demonstrate that QNG utilizing non-monotone quantum Fisher metrics exhibits faster performance than its SLD-based counterpart. Furthermore, in practical numerical simulations for both classical and quantum cases, the diagonal approximation of the Fisher metric is often employed to mitigate the computational costs associated with inverting the Fisher metric. We show that even under this approximation, the aforementioned findings remain valid. Lastly, we provide numerical simulations to illustrate that non-monotone quantum Fisher metrics outperform the SLD metric in terms of speed.

Natural gradient

In the derivation of NG, the Fisher metric and Kullback-Leibler (KL) divergence play an essential role. Then, we first explain the Fisher metric. Assume that we have ρθ(⋅)\rho_\theta(\cdot), which is a probability distribution parameterized by θ∈Rn\theta\in\mathbb{R}^n. We define tangent vectors as X:=∑i=1nXi∂iX := \sum_{i=1}^{n}X^i\partial_i, where ∂i:=∂∂θi\partial_i := \frac{\partial}{\partial\theta^i} for i=1,2,…,ni=1,2,\ldots,n. Then, the Fisher metric between XX and YY is defined as

gρθ(⋅)(X,Y):=∑x=1NXρθ(⋅)m(x)Yρθ(⋅)e(x).(1)g_{\rho_\theta(\cdot)}(X,Y) := \sum_{x=1}^{N}X_{\rho_\theta(\cdot)}^{\mathrm{m}}(x)Y_{\rho_\theta(\cdot)}^{\mathrm{e}}(x). \tag*{(1)}

where the e- and the m-representations of XX at ρθ(⋅)\rho_\theta(\cdot) are given, respectively, by

Xρθ(⋅)m:=Xρθ(⋅),(2)X_{\rho_\theta(\cdot)}^{\mathrm{m}} := X\rho_\theta(\cdot), \tag*{(2)}
Xρθ(⋅)e:=Xln⁡ρθ(⋅).(3)X_{\rho_\theta(\cdot)}^{\mathrm{e}} := X\ln\rho_\theta(\cdot). \tag*{(3)}

Next, we turn our attention to classical rescaled Rényi divergence [26]. When we explain NG only, KL divergence is sufficient; but, the purpose of this paper is to discuss QNG. Then, we explain classical rescaled Rényi divergence, which is a generalized version of KL divergence. Classical rescaled Rényi divergence is given by

Dα(pθˉ(⋅)∥pθ(⋅)):=1α(α−1)ln⁡∑x=1Npθˉα(x)pθ1−α(x).(4)D_{\alpha}(p_{\bar{\theta}}(\cdot)\mathbin{\|}p_{\theta}(\cdot)) := \frac{1}{\alpha(\alpha-1)}\ln\sum_{x=1}^{N}p_{\bar{\theta}}^{\alpha}(x)p_{\theta}^{1-\alpha}(x). \tag*{(4)}

Note that “rescaled” means the additional factor 1/α1/\alpha in Eq. (4). Furthermore the rescaled Rényi divergence, Eq. (4), in the limit $\alpha \to 1$ corresponds to the KL divergence [26]`:

lim⁡α→1Dα(pθˉ(⋅)∥pθ(⋅))=DKL(pθˉ(⋅)∥pθ(⋅)).(5)\lim_{\alpha\to1}D_{\alpha}(p_{\bar{\theta}}(\cdot)\mathbin{\|}p_{\theta}(\cdot))=D_{\mathrm{KL}}(p_{\bar{\theta}}(\cdot)\mathbin{\|}p_{\theta}(\cdot)). \tag*{(5)}

Notably, Eqs. (1) and (4) satisfy the following relationship:

gpθ(⋅)(X,Y)=lim⁡θˉ→θXˉYˉDα(pθˉ(⋅)∥pθ(⋅)),(6)g_{p_{\theta}(\cdot)}(X,Y)=\lim_{\bar{\theta}\to\theta}\bar{X}\bar{Y}D_{\alpha}(p_{\bar{\theta}}(\cdot)\mathbin{\|}p_{\theta}(\cdot)), \tag*{(6)}

where Xˉ,Yˉ\bar{X},\bar{Y} are the tangent vectors acting on pθˉ(⋅)p_{\bar{\theta}}(\cdot). The key observation is that the right-hand side of Eq. (6) do not depend on α\alpha. As we will see later, the quantum counterpart of Eq. (4) yields different metric contrarily to the classical limit, and this fact will play an important role in QNG.

We here review NG, which is one of the optimization methods for continuous variables motivated by IG [4]. Let us consider the minimization problem of L(θ)L(\theta). Then, the dynamics of NG is given by

θτ+1=θτ+Δθ(ϵ),(7)\theta_{\tau+1}=\theta_{\tau}+\Delta\theta(\epsilon), \tag*{(7)}
Δθ(ϵ)=arg⁡min⁡Δθ:Dα(pθτ+Δθ(⋅)∥pθτ(⋅))≤ϵL(θτ+Δθ),(8)\Delta\theta(\epsilon)=\underset{\Delta\theta:D_{\alpha}(p_{\theta_{\tau}+\Delta\theta}(\cdot)\mathbin{\|}p_{\theta_{\tau}}(\cdot))\leq\epsilon}{\arg\min}L(\theta_{\tau}+\Delta\theta), \tag*{(8)}

where ϵ\epsilon is a positive number. The key point of Eq. (6) is the constraint in Eq. (6b) since this term does not exist in conventional optimization methods such as the steepest decent method and Newton’s method. Note that in this paper, we focus on Eq. (4), but we do not need to limit ourselves to Eq. (3). First, we transform Eq. (6b) by using the lowest-order approximation:

Δθ(ϵ)≈arg⁡min⁡Δθ:12ΔθTGα(θτ)Δθ≤ϵ ∇θL(θτ)TΔθ,(9)\Delta\theta(\epsilon)\approx\underset{\Delta\theta:\frac{1}{2}\Delta\theta^{\mathsf{T}}G_{\alpha}(\theta_{\tau})\Delta\theta\leq\epsilon}{\arg\min}\ \nabla_{\theta}L(\theta_{\tau})^{\mathsf{T}}\Delta\theta, \tag*{(9)}

where

∇θL(θ):=[∂1L(θ),∂2L(θ),…,∂nL(θ)]T,\nabla_{\theta}L(\theta):=[\partial_{1}L(\theta),\partial_{2}L(\theta),\ldots,\partial_{n}L(\theta)]^{\mathsf{T}},
∇θL(θτ):=∇θL(θ)∣θ=θτ,\nabla_{\theta}L(\theta_{\tau}):=\left.\nabla_{\theta}L(\theta)\right|_{\theta=\theta_{\tau}},

and Gα(θτ)G_{\alpha}(\theta_{\tau}) is the matrix representation of the Fisher metric gpθτ(⋅)(∂i,∂j)g_{p_{\theta_{\tau}}(\cdot)}(\partial_i,\partial_j) induced by Dα(pθτ+Δθ(⋅)∥pθτ(⋅))D_{\alpha}(p_{\theta_{\tau}+\Delta\theta}(\cdot)\mathbin{\|}p_{\theta_{\tau}}(\cdot)). To solve Eq. (9), we use the method of Lagrange’s multiplier [27]. Then the solution of Eq. (9) is rewritten as

Δθ(ϵ)=−2ϵ∇θL(θτ)TGα−1(θτ)∇θL(θτ)Gα−1(θτ)∇θL(θτ).(10)\Delta\theta(\epsilon)=-\sqrt{\frac{2\epsilon}{\nabla_{\theta}L(\theta_{\tau})^{\mathsf{T}}G_{\alpha}^{-1}(\theta_{\tau})\nabla_{\theta}L(\theta_{\tau})}}G_{\alpha}^{-1}(\theta_{\tau})\nabla_{\theta}L(\theta_{\tau}). \tag*{(10)}

Note that we have added a negative sign to decrease the value of L(θ)L(\theta) by this update. In a practical usage of NG, we may use the following update rule instead of Eq. (10):

Δθ(ϵ)=−ηGα−1(θτ)∇θL(θτ),(11)\Delta\theta(\epsilon)=-\eta G_{\alpha}^{-1}(\theta_{\tau})\nabla_{\theta}L(\theta_{\tau}), \tag*{(11)}

where η\eta is a positive number.

Quantum natural gradient

To discuss QNG, we explain their quantum counterparts of the Fisher metric, the rescaled Rényi divergence, respectively. Assume that we have ρ^θ\hat{\rho}_{\theta}, which is a quantum state parameterized by θ\theta, and its spectral decomposition is given by ρ^θ:=∑i=1Npi∣ψi⟩⟨ψi∣\hat{\rho}_{\theta}:=\sum_{i=1}^{N}p_i\lvert\psi_i\rangle\langle\psi_i\rvert. We first introduce the quantum extension of the Fisher metric, Eq. (1) [28, 29, 30, 31]. To this end, we define the following linear operator Δρ^θA^:=ρ^θA^ρ^θ−1\Delta_{\hat{\rho}_{\theta}}\hat{A}:=\hat{\rho}_{\theta}\hat{A}\hat{\rho}_{\theta}^{-1}. And we also introduce the nonlinear transformation of Δρ^θA^\Delta_{\hat{\rho}_{\theta}}\hat{A}:

f−1(Δρ^θ)A^:=∑i,j=1N⟨ψi∣A^∣ψj⟩f(pi/pj)∣ψi⟩⟨ψj∣.(12)f^{-1}(\Delta_{\hat{\rho}_{\theta}})\hat{A}:=\sum_{i,j=1}^{N}\frac{\langle\psi_i\lvert\hat{A}\rvert\psi_j\rangle}{f(p_i/p_j)}\lvert\psi_i\rangle\langle\psi_j\rvert. \tag*{(12)}

Using Eq. (12), the quantum counterparts of Eq. (2) at ρ^θ\hat{\rho}_{\theta} are defined as follows:

X^ρ^θm:=Xρ^θ,(13)\hat{X}_{\hat{\rho}_{\theta}}^{\mathrm{m}}:=X\hat{\rho}_{\theta}, \tag*{(13)}
X^ρ^θ,f(⋅)m:=f−1(Δρ^θ)(Xρ^θρ^θ−1),(14)\hat{X}_{\hat{\rho}_{\theta},f(\cdot)}^{\mathrm{m}}:=f^{-1}(\Delta_{\hat{\rho}_{\theta}})\left(X\hat{\rho}_{\theta}\hat{\rho}_{\theta}^{-1}\right), \tag*{(14)}

where f(⋅):R>0→R>0f(\cdot):\mathbb{R}_{>0}\to\mathbb{R}_{>0} is an operator-monotone function such that

f(1)=1,(15)f(1)=1, \tag*{(15)}
f(t)=tf(t−1).(16)f(t)=tf(t^{-1}). \tag*{(16)}

Note that f(⋅)f(\cdot) in Eq. (11b) is called the Petz function. Then the quantum Fisher metric is given by

gρ^θ,f(⋅)(X,Y):=Tr⁡[X^ρ^θmY^ρ^θ,f(⋅)m].(17)g_{\hat{\rho}_{\theta},f(\cdot)}(X,Y):=\operatorname{Tr}[\hat{X}_{\hat{\rho}_{\theta}}^{\mathrm{m}}\hat{Y}_{\hat{\rho}_{\theta},f(\cdot)}^{\mathrm{m}}]. \tag*{(17)}

The key point of the quantum Fisher metric, Eq. (17), is its dependence on the operator-monotone function f(⋅)f(\cdot). Equation (12a) implies the classical limit of the quantum Fisher metric goes to the classical Fisher metric without depending on the choice of f(⋅)f(\cdot) and Eq. (12b) guarantee for the quantum Fisher metric to be real.

We then consider a quantum extension of Eq. (4). Quantum rescaled sandwiched Rényi divergence is defined as follows [32]:

Dα(ρ^∥σ^):=1α(α−1)ln⁡Tr⁡[(ρ^1−α2ασ^ρ^1−α2α)α].(18)D_{\alpha}(\hat{\rho}\mathbin{\|}\hat{\sigma}):=\frac{1}{\alpha(\alpha-1)}\ln\operatorname{Tr}\left[\left(\hat{\rho}^{\frac{1-\alpha}{2\alpha}}\hat{\sigma}\hat{\rho}^{\frac{1-\alpha}{2\alpha}}\right)^{\alpha}\right]. \tag*{(18)}

Note that “sandwiched” means ρ^θ\hat{\rho}_{\theta} is sandwiched by ρ^θ\hat{\rho}_{\theta}. In Ref. [2], quantum α\alpha-divergence, in which ρ^θ\hat{\rho}_{\theta} is not sandwiched by ρ^θ\hat{\rho}_{\theta}, is investigated. Rescaled sandwiched Rényi divergence, Eq. (18), becomes quantum KL divergence [33] in the limit α→1\alpha\to1: lim⁡α→1Dα(ρ^θˉ∥ρ^θ)=DqKL(ρ^θˉ∥ρ^θ)\lim_{\alpha\to1} D_{\alpha}(\hat{\rho}_{\bar{\theta}}\|\hat{\rho}_{\theta}) = D_{\mathrm{qKL}}(\hat{\rho}_{\bar{\theta}}\|\hat{\rho}_{\theta}). Introducing the Petz function given by

fα(t):=(1−α)1−t1/α1−t1−1/α,(19)f_{\alpha}(t) := (1-\alpha)\frac{1-t^{1/\alpha}}{1-t^{1-1/\alpha}}, \tag*{(19)}

Eq. (17) and Eq. (18) satisfy the following relation:

gρ^θ,fα(⋅)(X,Y)=lim⁡θˉ→θXˉYˉDα(ρ^θˉ∥ρ^θ),(20)g_{\hat{\rho}_{\theta},f_{\alpha}(\cdot)}(X,Y) = \lim_{\bar{\theta}\to\theta}\bar{X}\bar{Y}D_{\alpha}(\hat{\rho}_{\bar{\theta}}\|\hat{\rho}_{\theta}), \tag*{(20)}

where Xˉ:=∑i=1nXi∂ˉi\bar{X}:=\sum_{i=1}^{n}X^{i}\bar{\partial}_{i}, Yˉ:=∑i=1nYi∂ˉi\bar{Y}:=\sum_{i=1}^{n}Y^{i}\bar{\partial}_{i}.

As the quantum counterpart of Eq. (6), let us consider the minimization problem of L(θ)L(\theta):

θτ+1=θτ+Δθ(ϵ),(21)\theta_{\tau+1}=\theta_{\tau}+\Delta\theta(\epsilon), \tag*{(21)}
Δθ(ϵ)=arg⁡min⁡Δθ:Dα(ρ^θτ+Δθ∥ρ^θτ)≤ϵ L(θτ+Δθ).(22)\Delta\theta(\epsilon)=\underset{\Delta\theta:D_{\alpha}(\hat{\rho}_{\theta_{\tau}+\Delta\theta}\|\hat{\rho}_{\theta_{\tau}})\leq\epsilon}{\arg\min}\ L(\theta_{\tau}+\Delta\theta). \tag*{(22)}

In Eq. (17b), ρ^θ\hat{\rho}_{\theta} appears in the constraint instead of pθ(⋅)p_{\theta}(\cdot). By using the lowest-order approximation, Eq. (17b) can be transformed into

Δθ(ϵ)≈arg⁡min⁡Δθ:12ΔθTGα(θτ)Δθ≤ϵ ∇θL(θτ)TΔθ,(23)\Delta\theta(\epsilon)\approx\underset{\Delta\theta:\frac{1}{2}\Delta\theta^{\mathsf{T}}G_{\alpha}(\theta_{\tau})\Delta\theta\leq\epsilon}{\arg\min}\ \nabla_{\theta}L(\theta_{\tau})^{\mathsf{T}}\Delta\theta, \tag*{(23)}

where Gα(θτ)G_{\alpha}(\theta_{\tau}) is the quantum Fisher metric induced by Dα(ρ^θτ+Δθ∥ρ^θτ)D_{\alpha}(\hat{\rho}_{\theta_{\tau}+\Delta\theta}\|\hat{\rho}_{\theta_{\tau}}); that is, it can be rewritten as [Gα(θτ)]i,j=gρ^θ,fα(⋅)(∂i,∂j)[G_{\alpha}(\theta_{\tau})]_{i,j}=g_{\hat{\rho}_{\theta},f_{\alpha}(\cdot)}(\partial_{i},\partial_{j}) because of Eq. (20). To solve Eq. (17), we employ almost the same technique to that used to derive NG. Then, we reach the same equation in the classical case, Eqs. (10) and (11), but Gα−1(θτ)G_{\alpha}^{-1}(\theta_{\tau}) is computed from Eq. (20). Note that we do not need to limit ourselves to Eq. (18) though in this paper we focus on Eq. (18).

Monotonicity

Characterizing metrics and divergences, monotonicity is an essential concept [28, 34, 35]. For example, the monotonicity of quantum KL divergence is considered to be quite natural since it implies that information is not gained via CPTP maps.

We review some important properties of operator functions [34, 35, 36, 37]. We first state the definition of the monotonicity of a function: that is, f(⋅)f(\cdot) is called monotone if and only if

A^⪰B^⇒f(A^)⪰f(B^),(24)\hat{A}\succeq\hat{B}\Rightarrow f(\hat{A})\succeq f(\hat{B}), \tag*{(24)}

where A^⪰B^:⇔∀∣ψ⟩∈H,⟨ψ∣(A^−B^)∣ψ⟩≥0\hat{A}\succeq\hat{B}:\Leftrightarrow\forall|\psi\rangle\in\mathcal{H},\langle\psi|(\hat{A}-\hat{B})|\psi\rangle\geq0. Metric gρ^(X,Y)g_{\hat{\rho}}(X,Y) is called a monotone metric if and only if it satisfies the following relation for arbitrary CPTP map γ(⋅)\gamma(\cdot): gρ^(X,X)≥gγ(ρ^)(γ∗(X),γ∗(X))g_{\hat{\rho}}(X,X)\geq g_{\gamma(\hat{\rho})}(\gamma_{*}(X),\gamma_{*}(X)) where γ∗(⋅)\gamma_{*}(\cdot) is the pushforward associated with γ(⋅)\gamma(\cdot). Note that Eq. (19) is operator-monotone if and only if α∈(−∞,−1]∪[1/2,∞)\alpha\in(-\infty,-1]\cup[1/2,\infty) and Eq. (20) is a monotone metric [32].

We define the following partial order on f(⋅):R≥0→R≥0f(\cdot):\mathbb{R}_{\geq0}\to\mathbb{R}_{\geq0}:

f(⋅)⪯f~(⋅):⇔∀t∈R≥0, f(t)≤f~(t).(25)f(\cdot)\preceq\tilde{f}(\cdot):\Leftrightarrow\forall t\in\mathbb{R}_{\geq0},\ f(t)\leq\tilde{f}(t). \tag*{(25)}

For monotone functions, the following theorem holds [28]:

Theorem 1. fSLD(⋅)f_{\mathrm{SLD}}(\cdot) and frRLD(⋅)f_{\mathrm{rRLD}}(\cdot) are the maximum and the minimum elements with respect to Eq. (25) under the condition of monotonicity, Eq. (24), f(1)=1f(1)=1, and f(t)=tf(t−1)f(t)=tf(t^{-1}). That is, we have the following relation for any f(t)f(t) such that the condition of monotonicity, Eq. (24), f(1)=1f(1)=1, and f(t)=tf(t−1)f(t)=tf(t^{-1}):

frRLD(⋅)⪯f(⋅)⪯fSLD(⋅),(26)f_{\mathrm{rRLD}}(\cdot)\preceq f(\cdot)\preceq f_{\mathrm{SLD}}(\cdot), \tag*{(26)}

where fSLD(⋅)f_{\mathrm{SLD}}(\cdot) and frRLD(⋅)f_{\mathrm{rRLD}}(\cdot) are the Petz functions for the SLD and rRLD metrics defined, respectively, as fSLD(t):=1+t2f_{\mathrm{SLD}}(t):=\frac{1+t}{2}, frRLD(t):=2tt+1f_{\mathrm{rRLD}}(t):=\frac{2t}{t+1}.

We review some important properties of Eq. (19). For simplicity, we substitute α=1β\alpha=\frac{1}{\beta} into Eq. (19):

f1/β(t)=(1−1β)1−tβ1−tβ−1.(27)f_{1/\beta}(t)=\left(1-\frac{1}{\beta}\right)\frac{1-t^{\beta}}{1-t^{\beta-1}}. \tag*{(27)}

Two important theorems on Eq. (27) are shown in Ref. [32]. The first one is as follows [32]:

Theorem 2. Eq. (27) monotonically increases when β\beta increased.

Thm. 2 implies that fα(⋅)f_{\alpha}(\cdot), Eq. (19), is monotonically decreasing with α\alpha increasing, but α=0\alpha=0 is singular. Thus, fα(⋅)f_{\alpha}(\cdot), Eq. (19), monotonically increases toward α→0+\alpha\to0+.

The second one is as follows [32]:

Theorem 3. Eq. (27) is operator monotone if and only if β∈[−1,2]\beta\in[-1,2].

Thm. 3 means that fα(⋅)f_{\alpha}(\cdot), Eq. (19), is operator monotone for α∈(∞,−1]∪[1/2,∞)\alpha\in(\infty,-1]\cup[1/2,\infty).

In Figure 1, we show fα(t)f_{\alpha}(t), Eq. (19), for several different α\alpha and highlight the regime of the monotone Petz functions by light cyan. Note that fα(t)f_{\alpha}(t), Eq. (19), with α=1/2,−1\alpha=1/2,-1 are the Petz functions for the SLD and rRLD metrics, respectively. Furthermore, we also have lim⁡α→±∞fα(t)=tln⁡tt−1\lim_{\alpha\to\pm\infty}f_{\alpha}(t)=\frac{t\ln t}{t-1} [32].

Figure 1. fα(t)f_\alpha(t), Eq. (19), with α=0.1,0.3,0.5,100.0,−100.0,−1.0,−0.3,−0.1\alpha= 0.1, 0.3, 0.5, 100.0, -100.0, -1.0, -0.3, -0.1. Note that α=0.5\alpha= 0.5 and α=−1.0\alpha= -1.0 yield the SLD and rRLD metrics, respectively. The regime of the monotone Petz functions is highlighted by light cyan.

Fisher metrics and speed of QNG

We here explain the relation between the quantum Fisher metrics and the speed of QNG. In general, the following theorem holds:

Theorem 4. Let us assume that f(⋅)f(\cdot) and gρ^θ,f(⋅)(⋅,⋅)g_{\hat{\rho}_{\theta},f(\cdot)}(\cdot,\cdot) are related via Eq. (17). Then, we have

f(⋅)⪯f~(⋅)⇔gρ^θ,f(⋅)(⋅,⋅)⪰gρ^θ,f~(⋅)(⋅,⋅),(28)f(\cdot)\preceq\tilde{f}(\cdot)\Leftrightarrow g_{\hat{\rho}_{\theta},f(\cdot)}(\cdot,\cdot)\succeq g_{\hat{\rho}_{\theta},\tilde{f}(\cdot)}(\cdot,\cdot), \tag*{(28)}

where g(⋅,⋅)⪰g(⋅,⋅):⇔∀X, g(X,X)≥g(X,X)g(\cdot,\cdot)\succeq g(\cdot,\cdot):\Leftrightarrow\forall X,\ g(X,X)\geq g(X,X).

The proof of Thm. 4 is shown in Sec. A in Appendix A. We define the following diagonal metric:

gˉρ^θ,f(⋅)(∂i,∂j):={gρ^θ,f(⋅)(∂i,∂j)(i=j),0(i≠j).(29)\bar{g}_{\hat{\rho}_{\theta},f(\cdot)}(\partial_i,\partial_j) := \begin{cases} g_{\hat{\rho}_{\theta},f(\cdot)}(\partial_i,\partial_j) & (i=j), \\ 0 & (i\ne j). \end{cases} \tag*{(29)}

In partial usages, Eq. (29) is of great importance and often used instead of Eq. (17) because the computation of the inverse matrix of Eq. (17) is numerically costly. Similarly to Thm. 4, the following theorem holds:

Theorem 5. The following relation holds for Eq. (29):

f(t)⪯f~(⋅)⟺gˉρ^θ,f(⋅)(⋅,⋅)⪰gˉρ^θ,f~(⋅)(⋅,⋅).(30)f(t) \preceq\tilde{f}(\cdot) \Longleftrightarrow\bar{g}_{\hat{\rho}_{\theta},f(\cdot)}(\cdot,\cdot) \succeq\bar{g}_{\hat{\rho}_{\theta},\tilde{f}(\cdot)}(\cdot,\cdot). \tag*{(30)}

The proof of Thm. 5 is almost the same with Thm. 4. We then discuss the dependence of the speed of QNG on the quantum Fisher metrics. Metrics g(⋅,⋅)g(\cdot,\cdot) and g~(⋅,⋅)\tilde{g}(\cdot,\cdot) satisfy the following relation: g(⋅,⋅)⪰g~(⋅,⋅)⟺g−1(⋅,⋅)⪯g~−1(⋅,⋅)g(\cdot,\cdot) \succeq\tilde{g}(\cdot,\cdot) \Longleftrightarrow g^{-1}(\cdot,\cdot) \preceq\tilde{g}^{-1}(\cdot,\cdot). In the case of Eq. (10), we have

L(θτ+1)−L(θτ)=−2ϵ∇θL(θτ)TGα−1(θτ)∇θL(θτ).(31)L(\theta_{\tau+1})-L(\theta_\tau)=-\sqrt{2\epsilon\nabla_\theta L(\theta_\tau)^{\mathsf{T}}G_\alpha^{-1}(\theta_\tau)\nabla_\theta L(\theta_\tau)}. \tag*{(31)}

And in the case of Eq. (11), we also have

L(θτ+1)−L(θτ)=−η∇θL(θτ)TGα−1(θτ)∇θL(θτ).(32)L(\theta_{\tau+1})-L(\theta_\tau)=-\eta\nabla_\theta L(\theta_\tau)^{\mathsf{T}}G_\alpha^{-1}(\theta_\tau)\nabla_\theta L(\theta_\tau). \tag*{(32)}

Thus, for both of Eqs. (10) and (11), Gα(θτ)G_\alpha(\theta_\tau) decrease the value of L(θτ)L(\theta_\tau) faster than Gα′(θτ)G_{\alpha'}(\theta_\tau) when Gα(θτ)⪯Gα′(θτ)G_\alpha(\theta_\tau) \preceq G_{\alpha'}(\theta_\tau).

Numerical simulations

We show numerical simulations to support the main claim of this paper. We begin with the setup of numerical simulations. Using θ:=[θ1,θ2,θ3]T\theta:= [\theta_1,\theta_2,\theta_3]^{\mathsf{T}},

we define the following parameterized quantum state: ρ^θ:=U^(θ)ρ^iniU^†(θ)\hat{\rho}_\theta:= \hat{U}(\theta)\hat{\rho}_{\mathrm{ini}}\hat{U}^{\dagger}(\theta) where U^(θ):=R^z(θ3)R^y(θ2)R^z(θ1)\hat{U}(\theta) := \hat{R}_z(\theta_3)\hat{R}_y(\theta_2)\hat{R}_z(\theta_1), R^z(ϕ):=exp⁡(−iϕσ^z/2)\hat{R}_z(\phi) := \exp(-i\phi\hat{\sigma}_z/2), and R^y(ϕ):=exp⁡(−iϕσ^y/2)\hat{R}_y(\phi) := \exp(-i\phi\hat{\sigma}_y/2). We also define ρ^ini:=12(1^+xσ^x+yσ^y+zσ^z)\hat{\rho}_{\mathrm{ini}} := \frac{1}{2}(\hat{1}+x\hat{\sigma}_x+y\hat{\sigma}_y+z\hat{\sigma}_z) where 1^\hat{1} is the 2×22\times2 identity operator and x2+y2+z2<1x^2+y^2+z^2<1. Then, we consider the following minimization problem with respect to θ\theta:

min⁡θL(θ),(33)\min_\theta L(\theta), \tag*{(33)}

where L(θ):=Tr⁡[(ρ^θ−ρ^θ∗)†(ρ^θ−ρ^θ∗)]L(\theta) := \operatorname{Tr}[(\hat{\rho}_\theta-\hat{\rho}_{\theta_*})^\dagger(\hat{\rho}_\theta-\hat{\rho}_{\theta_*})]. To stabilize the numerical calculations, we conduct the following operations to the density operator and metric: ρ^θ←(1−δ)ρ^θ+δ1^N\hat{\rho}_\theta\leftarrow(1-\delta)\hat{\rho}_\theta+\delta\frac{\hat{1}}{N}, and gρ^θ,f(⋅)(⋅,⋅)←(1−ξ)gρ^θ,f(⋅)(⋅,⋅)+ξIg_{\hat{\rho}_\theta,f(\cdot)}(\cdot,\cdot)\leftarrow(1-\xi)g_{\hat{\rho}_\theta,f(\cdot)}(\cdot,\cdot)+\xi I where II is the identity matrix whose size is identical to that of gg, and δ\delta and ξ\xi are tiny positive numbers.

In the following calculations, we set [x,y,z]=[0.5,0.0,0.0][x,y,z]=[0.5,0.0,0.0], θ0=[π/2,π/2,π/4]T\theta_0=[\pi/2,\pi/2,\pi/4]^{\mathsf{T}}, and θ∗=[0.0,0.0,0.0]T\theta_*=[0.0,0.0,0.0]^{\mathsf{T}}. In Figure 2, we plot the time evolution of the cost function in the case of Eq. (10) and highlight the regime of the monotone Petz functions by light cyan. In Figure 3, we show the time evolution of the cost function in the case of Eq. (11). In both cases, QNG with α∈(0,0.5)\alpha\in(0,0.5) outperforms SLD-based QNG proposed in Refs. [15, 16]. Furthermore, these figures show that the gaps between different values of α\alpha becomes large in the case of Eq. (11) than Eq. (10). However, this phenomenon depends on the maximum eigenvalue of the quantum Fisher metric; thus, we have to choose either Eq. (10) or Eq. (11) depending on problems.

Figure 2. Cost functions for several α\alpha in the case of Eq. (10). We set ϵ=1.0×10−8\epsilon= 1.0 \times10^{-8}, ξ=1.0×10−3\xi= 1.0 \times10^{-3}, and δ=1.0×10−3\delta= 1.0 \times10^{-3}. The regime of the monotone metrics is highlighted by light cyan.

Figure 3. Cost functions for several α\alpha in the case of Eq. (11). We set η=5.0×10−4\eta= 5.0 \times10^{-4}, ξ=1.0×10−3\xi= 1.0 \times10^{-3}, and δ=1.0×10−3\delta= 1.0 \times10^{-3}. The regime of the monotone metrics is highlighted by light cyan.

Conclusions

In this paper, we have presented a generalization of QNG based on QIG. Notably, the existing literature on QNG relies on the SLD metric, which is not the exclusive definition of the logarithmic derivative of density operators. In QNG, the e-representation, specified by the Petz function, aligns with the logarithmic derivative of density operators, and it identifies the quantum Fisher metric. In our work, we utilize the non-monotone quantum Fisher metrics to generalize QNG, successfully enhancing the speed of QNG. Monotonicity has been believed to be a necessary condition to construct a geometry in physics; however, we have clarified that it is not necessary; in fact, it should be eliminated for optimization purposes. Our findings have shed light on the fact that we need to be cautious even with mathematical principles to advance science.

Acknowledgments

H.M. was supported by JSPS KAKENHI Grant Number JP23H04489. H.M. thanks Akio Fujiwara, Lei Wang, Yusuke Nomura, and Shunsuke Daimon for fruitful discussions.

Proof of Thm. 4

The proof of Thm. 4 is as follows:

Proof. We show Eq. (28). From Eq. (17), we have

gρ^θ,f(⋅)(X,X)=∑i,j=1N1pjf(pi/pj)⟨ψj∣X^ρ^θm∣ψi⟩⟨ψi∣X^ρ^θm∣ψj⟩(34)g_{\hat{\rho}_{\theta},f(\cdot)}(X,X)=\sum_{i,j=1}^{N}\frac{1}{p_j f(p_i/p_j)}\langle\psi_j|\hat{X}_{\hat{\rho}_{\theta}}^m|\psi_i\rangle\langle\psi_i|\hat{X}_{\hat{\rho}_{\theta}}^m|\psi_j\rangle \tag*{(34)}
=∑i,j=1N1pjf(pi/pj)∣⟨ψj∣X^ρ^θm∣ψi⟩∣2.(35)=\sum_{i,j=1}^{N}\frac{1}{p_j f(p_i/p_j)}\left|\langle\psi_j|\hat{X}_{\hat{\rho}_{\theta}}^m|\psi_i\rangle\right|^2. \tag*{(35)}

Since f(⋅)⪯f~(⋅)f(\cdot)\preceq\tilde{f}(\cdot), we have

gρ^θ,f(⋅)(X,X)=∑i,j=1N1pjf(pi/pj)∣⟨ψj∣X^ρ^θm∣ψi⟩∣2(36)g_{\hat{\rho}_{\theta},f(\cdot)}(X,X)=\sum_{i,j=1}^{N}\frac{1}{p_j f(p_i/p_j)}\left|\langle\psi_j|\hat{X}_{\hat{\rho}_{\theta}}^m|\psi_i\rangle\right|^2 \tag*{(36)}
≥∑i,j=1N1pjf~(pi/pj)∣⟨ψj∣X^ρ^θm∣ψi⟩∣2(37)\ge\sum_{i,j=1}^{N}\frac{1}{p_j\tilde{f}(p_i/p_j)}\left|\langle\psi_j|\hat{X}_{\hat{\rho}_{\theta}}^m|\psi_i\rangle\right|^2 \tag*{(37)}
=gρ^θ,f~(⋅)(X,X).(38)=g_{\hat{\rho}_{\theta},\tilde{f}(\cdot)}(X,X). \tag*{(38)}

Thus, Eq. (28) is proved.

References

References

  1. [1]J. Nocedal and S. Wright, Numerical Optimization, Springer Series in Operations Research and Financial Engineering (Springer New York, 2009), ISBN 9781493937110, URL https://books.google.co.jp/books?id=en-YSWEaCAAJ.
  2. [2]S.-i. Amari and H. Nagaoka, Methods of information geometry, vol. 191 (American Mathematical Soc., 2000).
  3. [3]S.-i. Amari, Information Geometry and Its Applications, Applied Mathematical Sciences (Springer Japan, 2016), ISBN 9784431559788, URL https://books.google.co.jp/books?id=UkSFCwAAQBAJ.
  4. [4]S.-I. Amari, Numerical computation 10, 251 (1998).
  5. [5]C. M. Bishop, Pattern recognition and machine learning (springer, 2006).
  6. [6]K. Murphy, Probabilistic Machine Learning: An Introduction, Adaptive Computation and Machine Learning series (MIT Press, 2022), ISBN 9780262369305, URL https://books.google.co.jp/books?id=0yYueAAAQBAJ.
  7. [7]K. Murphy, Probabilistic Machine Learning: Advanced Topics, Adaptive Computation and Machine Learning series (MIT Press, 2023), ISBN 9780262048439, URL https://books.google.co.jp/books?id=8iycEAAAQBAJ.
  8. [8]J. Martens, The Journal of Machine Learning Research 21, 5776 (2020).
  9. [9]J. Preskill, Quantum 2, 79 (2018).
  10. [10]K. Mitarai, M. Negoro, M. Kitagawa, and K. Fujii, Phys. Rev. A 98, 032309 (2018), URL https://link.aps.org/doi/10.1103/PhysRevA.98.032309.DOI
  11. [11]M. Schuld, A. Bocharov, K. M. Svore, and N. Wiebe, Phys. Rev. A 101, 032308 (2020), URL https://link.aps.org/doi/10.1103/PhysRevA.101.032308.DOI
  12. [12]H. Miyahara and V. Roychowdhury, Scientific Reports 12, 19520 (2022).
  13. [13]P. O. Scherer and P. O. Scherer, Computational physics: simulation of classical and quantum systems (Springer, 2017).
  14. [14]R. Orús, Nature Reviews Physics 1, 538 (2019).
  15. [15]J. Stokes, J. Izaac, N. Killoran, and G. Carleo, Quantum 4, 269 (2020).
  16. [16]B. Koczor and S. C. Benjamin, Phys. Rev. A 106, 062416 (2022), URL https://link.aps.org/doi/10.1103/PhysRevA.106.062416.DOI
  17. [17]S. Sorella and L. Capriotti, Phys. Rev. B 61, 2599 (2000), URL https://link.aps.org/doi/10.1103/PhysRevB.61.2599.DOI
  18. [18]S. Sorella, Phys. Rev. B 64, 024512 (2001), URL https://link.aps.org/doi/10.1103/PhysRevB.64.024512.DOI
  19. [19]G. Mazzola, A. Zen, and S. Sorella, The Journal of Chemical Physics 137, 134112 (2012), ISSN 0021-9606, https://pubs.aip.org/aip/jcp/article-pdf/doi/10.1063/1.4755992/15454421/134112_1_online.pdf, URL https://doi.org/10.1063/1.4755992.
  20. [20]C.-Y. Park and M. J. Kastoryano, Phys. Rev. Res. 2, 023232 (2020), URL https://link.aps.org/doi/10.1103/PhysRevResearch.2.023232.DOI
  21. [21]H. Xie, L. Zhang, and L. Wang, SciPost Phys. 14, 154 (2023), URL https://scipost.org/10.21468/SciPostPhys.14.6.154.
  22. [22]A. Lopatnikova, M.-N. Tran, and S. A. Sisson, arXiv preprint arXiv:2112.06587 (2021).arxiv.org/abs/2112.06587
  23. [23]H. Miyahara, K. Aihara, and W. Lechner, Physical Review A 101, 012326 (2020).
  24. [24]H. Miyahara and Y. Sugihiyama, Physical Review A 98, 022330 (2018).
  25. [25]H. Miyahara and V. Roychowdhury, Proceedings of the National Academy of Sciences 120, e2212660120 (2023).
  26. [26]T. Van Erven and P. Harremos, IEEE Transactions on Information Theory 60, 3797 (2014).
  27. [27]T. Mizohata, T. J. Kobayashi, L.-S. Bouchard, and H. Miyahara, arXiv preprint arXiv:2309.10334 (2023).DOI
  28. [28]D. Petz, Linear Algebra and its Applications 244, 81 (1996), ISSN 0024-3795, URL https://www.sciencedirect.com/science/article/pii/0024379594002118.
  29. [29]D. Petz, Quantum information theory and quantum statistics (Springer Science & Business Media, 2007).DOI
  30. [30]D. Petz and C. Ghinea, in Quantum probability and related topics (World Scientific, 2011), pp. 261–281.
  31. [31]T. Sagawa, Entropy, Divergence, and Majorization in Classical and Quantum Thermodynamics, vol. 16 (Springer Nature, 2022).
  32. [32]K. Takahashi and A. Fujiwara, Journal of Physics A: Mathematical and Theoretical 50, 165301 (2017), URL https://dx.doi.org/10.1088/1751-8121/aa6326.
  33. [33]H. Umegaki, in Kodai Mathematical Seminar Reports (Department of Mathematics, Tokyo Institute of Technology, 1962), vol. 14, pp. 59–85.
  34. [34]F. Hiai and D. Petz, Introduction to matrix analysis and applications (Springer Science & Business Media, 2014).DOI
  35. [35]F. HIAI, Interdisciplinary Information Sciences 16, 139 (2010).
  36. [36]R. Bhatia, Matrix Analysis, Graduate Texts in Mathematics (Springer New York, 1996), ISBN 9780387948461, URL https://books.google.co.jp/books?id=F4hRy1F1M6QC.
  37. [37]R. Horn and C. Johnson, Matrix Analysis (Cambridge University Press, 2012), ISBN 9780521548236, URL https://books.google.co.jp/books?id=mlQ-PgAACAAJ.

Paper details

vlnc:W_562nqxac
Version
v1 · latest
Published
Fresh — added to the Hub within the last 30 days
Added
License
CC BY 4.0
Usage

views · 0

downloads · 0

A view counts once per browser per day, a download each time the PDF is requested.

  • Physics and Astronomy

Not recorded for this paper

View statement
Looking for related papers…
Contents