betaFeedback

WorksPhysics and Astronomy

Decision-aware validation of zero-noise extrapolation in QAOA optimization landscapes

Abstract

Zero-noise extrapolation (ZNE) is usually validated by the accuracy of mitigated observables, yet variational quantum optimization uses those observables to select parameters. We ask whether, and by how much, an accuracy gain from ZNE coincides with a worse decision. In depth-one simulations of the quantum approximate optimization algorithm (QAOA) for MaxCut on four to six qubits, each sampled 120×120120\times120 landscape yields both its mean-squared error (MSE) and the ideal regret of its selected grid minimum, comparing Richardson orders one to three with unmitigated estimation at the same total shot budget per grid point. In an exploratory screen of 675 conditions, whose per-point random seeds collide, a familywise (Holm) analysis retains only four of 540 replication conditions as showing both directional MSE improvement and regret increase. A frozen confirmation with 100 fresh paired repetitions per condition reproduces all four: median MSE improvements of 7.65-73.09% accompany median normalized regret increases of only 0.0031-0.0073. We distinguish a bias route, in which residual bias reorders the mean landscape, from a variance route, in which Richardson weights amplify finite-shot noise. Exact first and second moments on a bounded control grid find no bias-route reversal: mitigated mean landscapes preserve the ideal minima, and ZNE can more than halve expected MSE, yet finite-shot selections incur higher mean regret. Decision losses that survive strict testing are few and small in this benchmark, but reproducible and not revealed by aggregate MSE. We present a paired benchmark and recommend reporting decision regret alongside estimation error when mitigation is assessed for optimization. Results concern simulated exhaustive grids, not hardware or optimizer loops.

Introduction

Variational quantum optimization, as in the quantum approximate optimization algorithm (QAOA), uses estimated objectives to choose circuit parameters [11, 33, 7]. Error mitigation can improve those estimates without full fault tolerance, at a sampling cost that matters when measurements are limited [30, 21, 6, 29]. Zero-noise extrapolation (ZNE) is usually validated by the accuracy of the mitigated observable. For optimization, however, the quantity of interest is the quality of the parameter that the mitigated estimate selects. Richardson extrapolation reduces bias by combining folded circuits with weights whose magnitudes amplify sampling variance [18], and the two error sources need not affect accuracy and decisions in the same way: landscape mean-squared error (MSE) averages over every parameter, whereas the selected parameter is decided by its contrasts with the ideal minimum, which are smallest, and therefore most easily reversed, at near-optimal parameters. Whether an accuracy gain becomes a decision gain is therefore an empirical question for each mitigation setting.

The general distinction is well established. Predict-then-optimize methods separate prediction error from the loss of the decision induced by a prediction [10]. In variational quantum algorithms, convergence analyses with quasiprobabilistic mitigation balance reduced bias against added variance [16], and mitigation can fail to restore the resolvability of cost differences at acceptable resource cost [32]; the QAOA optimizer-loop experiments in that study find no improvement from ZNE over noisy optimization in the evaluated settings. Landscape diagnostics show that Richardson extrapolation can introduce roughness that complicates gradient-based optimization [22]. Shot-budget benchmarks compare mitigated QAOA MaxCut observables at parameters optimized beforehand without noise [5], and hardware QAOA studies combine ZNE with readout correction and layout selection while evaluating optimization trajectories and final sampled-solution success [8]. Conference reports examine ZNE in QAOA workflows [31, 23], and mitigation within variational training has been demonstrated for function fitting [25]. Studies of local noise, parameter setting and energy landscapes characterize the underlying QAOA problem [24, 28] (Boy and Wales 2024).

The closest precedents compare estimation quality with downstream outcomes. Sack and Egger report QAOA runs in which optimizing a machine-learning-mitigated cost yields worse parameters under noiseless sampling than optimizing the unmitigated cost [26]; their reported MSE concerns correlator prediction, not whole landscapes. A response-model-learning preprint reports landscape root-mean-square error and selected-point regret separately, using different corrections and calibration budgets from a raw-versus-ZNE comparison [17]. A preprint by the present author develops residual-gap theory for finite-shot mitigation, including ZNE, and evaluates static failure probabilities and dynamic regret [27]. What remains unquantified for conventional Richardson ZNE is whether, and by how much, a whole-landscape accuracy gain coincides with a worse selected parameter when both are measured on the same sampled landscape, at an equal shot budget, and without the trajectory and stopping-rule choices of an optimizer.

We measure this paired relationship in depth-one QAOA MaxCut on four to six qubits. Exhaustive 120×120120 \times120 grids replace the optimizer, so each sampled landscape yields both its MSE against the exact ideal reference and the ideal regret of its selected minimum. Mitigated and unmitigated estimates use the same total number of shots at each grid point. Fifteen graphs and 675 conditions, spanning five depolarizing levels and three budgets, form an exploratory screen. Four selected conditions are then confirmed prospectively on fresh data, and an exact-moment control separates squared bias from sampling variance. The contributions are:

  • A paired accuracy–decision benchmark. Per-repetition landscape MSE and ideal regret measured on the same sampled landscape, at equal per-point budgets and against exact ideal grids.

  • Reproducible but small discordance. A familywise (Holm) analysis of the exploratory screen retains four conditions that combine directional MSE improvement with directional regret increase, and a frozen confirmation on fresh repetitions reproduces all four, with regret shifts below the pre-specified practical-effect threshold.

  • Bias and variance routes to a decision loss. Decomposing the observed contrast separates a bias route, in which residual bias reorders the mean landscape, from a variance route, in which Richardson weights amplify finite-shot noise. An exact-moment control finds the variance route at work, and an oracle reallocation of shots shows that the implemented allocation is already close to variance-optimal in the confirmed conditions.

The scope is bounded. The screen is exploratory: its sampler reuses some random streams, and its directional analysis was chosen after the screening results were known. The confirmation addresses only the four selected conditions, so it establishes reproducibility rather than frequency across graphs. Hardware, adaptive optimizers and deeper circuits lie outside this simulation study.

We first define the design and paired endpoints, then show why a relative MSE gain cannot order decisions and identify the bias and variance routes. The statistical analysis precedes the confirmation, screening, control and allocation results, followed by a discussion of limitations.

Problem and experimental design

Finite-grid QAOA and paired endpoints

For a positive-weight graph G=(V,E,w)G = (V, E, w), let

HC=∑(i,j)∈Ewij(I−ZiZj)/2,HM=∑iXi.(1)H_C = \sum_{(i,j)\in E} w_{ij}(I - Z_iZ_j)/2,\qquad H_M = \sum_i X_i. \tag*{(1)}

Depth-one QAOA prepares ∣ψ(γ,β)⟩=e−iβHMe−iγHC∣+⟩⊗∣V∣|\psi(\gamma,\beta)\rangle= e^{-i\beta H_M}e^{-i\gamma H_C}|+\rangle^{\otimes|V|}. We minimize L0(γ,β)=−⟨ψ∣HC∣ψ⟩L_0(\gamma,\beta) = -\langle\psi|H_C|\psi\rangle over a 120×120120 \times120 grid Θ\Theta on [0,2π)×[0,π)[0,2\pi) \times[0,\pi). Zero is included and each upper endpoint is excluded. This is a prescribed finite domain, and the results concern it alone; arbitrary weighted graphs need not have a 2π2\pi period in γ\gamma. In β\beta the depth-one landscape has period π/2\pi/2: e−i(π/2)HM=(−i)∣V∣X⊗∣V∣e^{-i(\pi/2)H_M} = (-i)^{|V|}X^{\otimes|V|}, and X⊗∣V∣X^{\otimes|V|} commutes with both HMH_M and HCH_C, so it leaves ⟨HC⟩\langle H_C\rangle unchanged. The β\beta range therefore contains two copies of the landscape, aligned with the grid because π/2\pi/2 spans 60 grid steps, and the ideal minimizers on Θ\Theta occur in symmetry-related pairs whose computed values agree up to floating-point roundoff. Such symmetries produce the equivalent ideal minima that the analysis below treats explicitly.

Write L∗=min⁡ΘL0L_* = \min_{\Theta} L_0, D0=max⁡ΘL0−L∗>0D_0 = \max_{\Theta} L_0 - L_* > 0, and Θ∗=arg⁡min⁡ΘL0\Theta_* = \arg\min_{\Theta} L_0. A row-major ordering resolves ties in any sampled landscape. For θ^=arg⁡min⁡ΘL^\hat{\theta} = \arg\min_{\Theta} \hat{L}, define

MSE⁡(L^,L0)=∣Θ∣−1∑θ∈Θ(L^(θ)−L0(θ))2,(2)\operatorname{MSE}(\hat{L}, L_0) = |\Theta|^{-1}\sum_{\theta\in\Theta}(\hat{L}(\theta) - L_0(\theta))^2, \tag*{(2)}
R(L^;L0)={L0(θ^)−L∗}/D0.(3)R(\hat{L}; L_0) = \{L_0(\hat{\theta}) - L_*\}/D_0. \tag*{(3)}

This is normalized simple regret for a terminal recommendation from a finite set, as in fixed-budget best-arm identification [1]. Here observations may remain biased relative to the ideal objective and multiple ideal optima are allowed, so standard best-arm guarantees are not imported. For each graph/noise/budget/order condition and sampling seed, the paired quantities are

rMSE=MSE⁡(L^noisy,L0)−MSE⁡(L^ZNE,L0)MSE⁡(L^noisy,L0),(4)r_{\mathrm{MSE}} = \frac{\operatorname{MSE}(\hat{L}_{\mathrm{noisy}}, L_0) - \operatorname{MSE}(\hat{L}_{\mathrm{ZNE}}, L_0)}{\operatorname{MSE}(\hat{L}_{\mathrm{noisy}}, L_0)}, \tag*{(4)}
dR=R(L^ZNE;L0)−R(L^noisy;L0).(5)d_R = R(\hat{L}_{\mathrm{ZNE}}; L_0) - R(\hat{L}_{\mathrm{noisy}}; L_0). \tag*{(5)}

Positive values of both describe improved aggregate accuracy and a worse selected parameter for that repetition. The denominator in Eq. (4) is positive in the retained data. Regret uses the exact ideal reference available in simulation.

Noise, extrapolation and resource accounting

Local depolarizing channels follow circuit gates. The channel on a dd-dimensional subsystem is Dκ(ρ)=(1−κ)ρ+κI/dD_{\kappa}(\rho)=(1-\kappa)\rho+\kappa I/d, with κ=p\kappa=p after one-qubit gates and κ=2p\kappa=2p after two-qubit gates. Thus pp is the depolarizing-channel parameter; the corresponding probabilities of a nonidentity Pauli error are 3p/43p/4 after one-qubit gates and 15p/815p/8 after two-qubit gates. We use p∈{0.001,0.003,0.005,0.01,0.02}p\in\{0.001,0.003,0.005,0.01,0.02\}.

Deterministic global circuit folding ([12]) produces scale sets (1,3)(1,3), (1,3,5)(1,3,5) and (1,3,5,7)(1,3,5,7) for Richardson orders m=1,2,3m=1,2,3. Folding preserves the ideal circuit, but local noisy folded circuits are not assumed to equal a single channel with parameter ajpa_jp. The estimator is

L^Z(θ)=∑jλjL[aj](θ),∑jλj=1,∑jλjajr=0 (1≤r≤m).(6)\widehat{L}_Z(\theta)=\sum_j\lambda_jL^{[a_j]}(\theta),\qquad\sum_j\lambda_j=1,\qquad\sum_j\lambda_ja_j^r=0\ (1\le r\le m). \tag*{(6)}

The total budget B∈{512,1024,4096}B\in\{512,1024,4096\} is allocated across scales in proportion to ∣λj∣|\lambda_j|, using largest remainders to obtain positive integers BjB_j with ∑jBj=B\sum_jB_j=B. The unmitigated estimate uses all BB shots. This is a budget per grid point: one full landscape costs 14 400B14\,400B shots (14 745 60014\,745\,600 at B=1024B=1024). Each screening condition has 30 sampling repetitions; the same noisy baseline is shared between extrapolation orders for a given graph, noise, budget and seed.

Discovery and generated replication

Discovery comprises three graphs and 3×5×3×3=1353\times5\times3\times3=135 conditions. Replication comprises twelve additional graphs, H1–H12, and 12×5×3×3=54012\times5\times3\times3=540 conditions. Graphs have four to six vertices. Two replication graphs were selected in each of six strata: sparse, regular or near-regular, Erdos–Renyi, heterogeneous weighted, dense positive-weight, and hardware-friendly/control. Graph generation, selection and grid-adequacy checks were fixed before any noisy simulation, which protects instance selection from the outcomes.

Probabilities were evaluated with a custom NumPy density-matrix kernel validated against Qiskit Aer within the Qiskit software framework ([15]); a bounded cross-check of 540 graph/point/noise/scale combinations against Aer gave a maximum objective discrepancy 9.45×10−149.45\times10^{-14}. Probabilities are cached across budgets and repetitions, and finite-shot samples use deterministic pseudorandom seeds.

Why relative MSE improvement does not order decisions

A finite-grid example and an absolute-error guarantee

On two points, take L0=(0,1)L_0=(0,1), L^N=(2,3)\widehat{L}_N=(2,3) and L^Z=(0.6,0.4)\widehat{L}_Z=(0.6,0.4). Their MSEs are 4 and 0.36, yet their normalized regrets are 0 and 1; the landscapes are arbitrary and illustrate only the logical nonimplication. The same construction works on any finite grid Θ\Theta of size NN with nonconstant L0L_0, including grids with several ideal minimizers. For a point with ideal gap Δ>0\Delta>0, adding a constant C>2Δ/NC>2\Delta/\sqrt{N} to L0L_0 preserves the ideal optimal set, whereas lowering that point by 2Δ2\Delta makes it the unique observed minimizer, with regret Δ/D0\Delta/D_0 and the smaller MSE 4Δ2/N<C24\Delta^2/N<C^2.

Absolute MSE nevertheless controls regret on a fixed finite grid. With e=L^−L0e=\widehat{L}-L_0,

R(L^;L0)≤min⁡{1,2NMSE⁡(L^,L0)D0}.(7)R(\widehat{L};L_0)\leq\min\left\{1,\frac{\sqrt{2N\operatorname{MSE}(\widehat{L},L_0)}}{D_0}\right\}. \tag*{(7)}

Indeed, for u∈Θ∗u\in\Theta_\ast, selection implies L0(θ^)−L∗≤e(u)−e(θ^)L_0(\widehat{\theta})-L_\ast\leq e(u)-e(\widehat{\theta}). Cauchy–Schwarz bounds this contrast by 2∑θe(θ)2\sqrt{2\sum_{\theta}e(\theta)^2}. Likewise ∥e∥∞≤δ\lVert e\rVert_\infty\leq\delta implies unnormalized regret at most 2δ2\delta. If the smallest positive ideal gap is g∗g_\ast, then 2δ<g∗2\delta<g_\ast ensures that every selected minimizer belongs to Θ∗\Theta_\ast. Thus MSE tending to zero does imply vanishing regret on a fixed grid. A relative improvement between two finite errors does not order their actual regrets.

Integer-budget variance and two routes to a decision change

If the single-shot objective variance at folded scale jj is vj(θ)v_j(\theta), independent samples across scales give

Var⁡[L^Z(θ)]=∑jλj2vj(θ)Bj≤vmax⁡(θ)SB,SB=∑jλj2Bj.(8)\operatorname{Var}[\widehat{L}_Z(\theta)]=\sum_j\frac{\lambda_j^2v_j(\theta)}{B_j}\leq v_{\max}(\theta)S_B,\qquad S_B=\sum_j\frac{\lambda_j^2}{B_j}. \tag*{(8)}

For an exactly proportional allocation, including the continuous ideal, SB=Am/BS_B=A_m/B, where Am=(∑j∣λj∣)2A_m=(\sum_j|\lambda_j|)^2. The weights and amplification factors are

mλAm1(3/2,−1/2)42(15/8,−5/4,3/8)49/43(35/16,−35/16,21/16,−5/16)36(9)\begin{array}{c|c|c} m & \lambda& A_m\\ 1 & (3/2,-1/2) & 4\\ 2 & (15/8,-5/4,3/8) & 49/4\\ 3 & (35/16,-35/16,21/16,-5/16) & 36 \tag*{(9)} \end{array}

Integer rounding makes SB≥Am/BS_B\geq A_m/B, with relative excess at most $1.39\times10^{-5}$ for the nine implemented allocations (Appendix § 10). Proportional allocation minimizes this variance upper-bound coefficient; minimizing the actual variance for unequal vjv_j instead gives $B_j\propto ∣λj∣vj|\lambda_j|\sqrt{v_j} in the continuous positive-variance case [18]. Write L^Z=L0+bZ+ηZ\widehat{L}_Z = L_0 + b_Z + \eta_Z, where bZb_Z is the exact mean residual and ηZ\eta_Z is centered sampling noise. For a fixed ideal minimizer uu and competitor vv, the observed contrast is

L^Z(v)−L^Z(u)=L0(v)−L∗+bZ(v)−bZ(u)+ηZ(v)−ηZ(u).(10)\widehat{L}_Z(v) - \widehat{L}_Z(u) = L_0(v) - L_* + b_Z(v) - b_Z(u) + \eta_Z(v) - \eta_Z(u). \tag*{(10)}

Beating one ideal minimizer is a pairwise ranking event, not a guarantee that vv is the selected global minimum. With equivalent optima, a sufficient condition for positive regret is that some nonoptimal point beats all ideal minimizers. By Eq. (10), vv does so whenever, for every u∈Θ∗u \in\Theta_*, ∣ηZ(v)−ηZ(u)∣≤δu|\eta_Z(v) - \eta_Z(u)| \le\delta_u and bZ(v)−bZ(u)+δu<−[L0(v)−L∗]b_Z(v) - b_Z(u) + \delta_u < -[L_0(v) - L_*]; if the unmitigated selection lies in Θ∗\Theta_*, this also gives dR>0d_R > 0.

(10) separates two routes by which ZNE can change a decision relative to the ideal ordering. In the bias route, the residual contrast bZ(v)−bZ(u)b_Z(v)-b_Z(u) reverses the order of vv and uu even without sampling noise. The exact Richardson example in Appendix § 10 shows that this route is compatible with lower MSE: on two points with bounded expectation values, Richardson extrapolation lowers the deterministic MSE from 12.5 to 4.5 while reversing a decision that the unmitigated expectation preserves. The example is abstract, and the studied circuits need not realize such coefficients. In the variance route, the mean landscape keeps the ideal ordering, but the centered contrast ηZ(v)−ηZ(u)\eta_Z(v)-\eta_Z(u) reverses it in some finite-shot repetitions. By Eq. (8), the scale of that contrast is governed by SB≥Am/BS_B \ge A_m/B, at least AmA_m times the coefficient 1/B1/B of unmitigated estimation at the same budget. The routes are not exclusive, because residual bias also changes the margins that sampling noise must overcome.

Appendix § 10 applies Hoeffding’s inequality [13] to bound the probability of excess regret in terms of SBS_B and an ideal anchor, without assuming a unique optimum; § 6 interprets it. It is a structural bound under independent shots rather than a calibrated predictor of dRd_R. § 5.3 examines which route is present in a bounded control.

Statistical analysis

Screening analysis

The exploratory screen is analyzed with the directional tests below and Holm correction. This analysis replaces the pre-specified bootstrap classification rule, whose results and calibration and resolution limitations are reported as a secondary descriptive analysis in Appendix § 11. Nine discovery and 33 replication conditions excluded by the detection-floor rule, which flags noisy MSE below 10−4D0210^{-4}D_0^2 in some seed, remain in their families with pc=1p_c = 1.

Directional inference

For a fixed condition cc, the reference inferential model assumes independent, identically distributed sampling repetitions with circuit probabilities held fixed. We test

πr,c=Pr⁡(rMSE>0)>1/2,πd,c=Pr⁡(dR>ϵnum)>1/2,ϵnum=10−12.(11)\pi_{r,c} = \Pr(r_{\mathrm{MSE}} > 0) > 1/2,\qquad\pi_{d,c} = \Pr(d_R > \epsilon_{\mathrm{num}}) > 1/2,\qquad\epsilon_{\mathrm{num}} = 10^{-12}. \tag*{(11)}

The small regret tolerance treats roundoff-level splitting of equivalent ideal minima as nonpositive; it is not a practical-effect threshold. All nn observations remain in the denominator (n=30n = 30 in the screen, n=100n = 100 in the confirmation), with ties counted as failures. Under this model, the indicator counts Kr,KdK_r, K_d give exact one-sided binomial component tests [20]:

px=∑k=Kxn(nk)2−n,pc=max⁡(pr,pd).(12)p_x = \sum_{k=K_x}^{n} \binom{n}{k}2^{-n},\qquad p_c = \max(p_r,p_d). \tag*{(12)}

This is an intersection–union test (IUT) [4]. Under the union null that at least one probability is at most 1/21/2, pcp_c is valid whenever the component tests are valid: if component xx is null, Pr⁡(pc≤t)≤Pr⁡(px≤t)≤t\Pr(p_c \le t) \le\Pr(p_x \le t) \le t. This requires neither independence of the two endpoints nor symmetry of their difference distributions. It tests two marginal directional probabilities, not the probability of their joint occurrence.

The screening analysis applies Holm at familywise level 0.05 to all 540 replication conditions [14], which allows arbitrary dependence between conditions; no effect-size filter defines the rejection set. Benjamini–Yekutieli (BY) and Benjamini–Hochberg (BH) adjustments are reported as false-discovery-rate (FDR) sensitivities, the latter conditional on dependence assumptions not established here [3]. Discovery is analyzed separately. This procedure and the numerical tolerance were chosen after the screening results were known, so their error guarantees do not cover that choice. Effect sizes are reported separately against the pre-specified thresholds of 10% median MSE improvement and τR=0.039962\tau_R = 0.039962 normalized regret.

Screening sampler

The screening sampler hashes each point/scale/repetition label into a 31-bit seed and initializes a new generator at each point. In the four conditions retained by Holm, this produces 637–1059 colliding seed pairs between repetitions and 16–51 within repetitions per condition, all at distinct grid points (Appendix § 11). The screening repetitions therefore do not implement the independent-sampling model exactly, and Holm’s robustness to dependence between conditions does not extend to dependence within a component test. The four screening rejections are accordingly model-based and exploratory.

Prospective targeted confirmation

A protocol fixed and hashed before any new sample was drawn specifies the four screening candidates, n=100n = 100, the screening grids, circuits, exact ideal references and integer allocations; the confirmation uses only new samples. A new 256-bit entropy value initializes NumPy SeedSequence; separately spawned PCG64DXSM streams are consumed sequentially across grid points for each group, repetition and method/scale.

The primary indicators remain rMSE>0r_{\mathrm{MSE}} > 0 and dR>10−12d_R > 10^{-12}, and Eq. (12) uses all 100 repetitions. Holm at .05 is applied to the four intersection–union p-values, with no exclusions or interim analyses; conclusions are conditional on the selection from the screen. Appendix C gives allocations and design sensitivity.

Computational verification

A second, separately written implementation reconstructs all 400 paired confirmation endpoints from the saved landscapes, evaluates binomial tails with integer binomial coefficients and recomputes the Holm adjustments.

Results

Fresh confirmation of four selected conditions

All four selected conditions pass Holm at .05 on 100 fresh repetitions (Table 1). Median relative MSE improvements range from 7.65% to 73.09%, and median normalized regret shifts from 0.00308 to 0.00732, or 0.0109–0.0260 expected-cut units. Three of the four MSE medians exceed the pre-specified 10% threshold, the exception being H3 quadratic at 7.65%, and no regret median reaches the pre-specified threshold τR\tau_R: the directional effects are clear, while their practical size is small.

Graph(p,B,m)(p, B, m)KrK_rKdK_drrdRd_RNative shiftHolm pp
H1(0.02, 1024, 2)100660.43580.006460.015208.95×10−48.95 \times10^{-4}
H3(0.02, 1024, 2)100700.07650.006430.013611.18×10−41.18 \times10^{-4}
H8(0.01, 4096, 3)100840.26130.007320.025965.21×10−125.21 \times10^{-12}
H8(0.01, 4096, 2)100670.73090.003080.010938.74×10−48.74 \times10^{-4}

Table 1. Prospective targeted family, n=100n = 100 per condition. KrK_r and KdK_d count positive indicators; rr and dRd_R are medians. Native shift is D0D_0 median(dRd_R) in expected-cut units. All four conditions were fixed before new sampling; Holm corrects these four tests only.

Exploratory screen

Four of 540 replication conditions meet the Holm cutoff, distributed across H1, H3 and H8 (Table 2). All four improve MSE in 30 of 30 repetitions; increased regret beyond numerical tolerance occurs in 26 or 28 repetitions. Their median MSE improvements range from 8.05% to 73.11%; three meet the pre-specified 10% threshold, and the H3 quadratic condition does not. The median native shifts range from 0.0131 to 0.0317 expected-cut units, or 0.146%–0.635% of total graph edge weight, and none reaches τR\tau_R. Figure 1 places them among all eligible conditions and displays within-condition variability; its interquartile bars are descriptive.

Graph(p,B,m)(p, B, m)KdK_drrdRd_RNative shiftHolm pp
H1(0.02,1024,2)(0.02, 1024, 2)260.43380.013500.031740.015999
H3(0.02,1024,2)(0.02, 1024, 2)280.08050.008810.018650.000234
H8(0.01,4096,3)(0.01, 4096, 3)260.26270.007030.024910.015999
H8(0.01,4096,2)(0.01, 4096, 2)280.73110.003700.013110.000234

Table 2. Four replication conditions retained by the sign/IUT/Holm analysis of the screen. Columns as in Table 1, with counts out of 30 repetitions.

Figure 1. Paired effects in the replication family. (a) Median relative mean-squared-error improvement and median normalized regret change for the 507 eligible conditions; excluded conditions are omitted, and the four Holm rejections are shown as larger orange points. The horizontal axis uses a symmetric logarithmic scale to retain large negative relative improvements. (b) Medians and seed interquartile ranges of the regret change for the four retained conditions.

Holm and BY retain the same four replication conditions, while BH retains twelve; these screening results are exploratory (§ 4.3). The retained sets are unchanged at regret tolerances 10−1410^{-14}, 10−1210^{-12}, 10−1010^{-10} and 10−610^{-6}. In the separately analyzed discovery family, Holm retains one condition, in G2. Appendix § 11 reports the complete sensitivities, including strict floating-point positivity and the original bootstrap classification.

Bounded bias–variance control

An explanatory control uses all three discovery graphs, two endpoint noise parameters (0.001, 0.02), B=1024B = 1024, all three orders and the unmitigated baseline. It evaluates a new 12×1212 \times12 grid and 500 independent multinomial landscape repetitions per configuration, and complements rather than retests the 540-condition endpoint (Appendix § 13).

Exact density-matrix probabilities give each scale’s mean μj(θ)\mu_j(\theta) and single-shot variance vj(θ)v_j(\theta). With bZ=∑jλjμj−L0b_Z = \sum_j \lambda_j\mu_j - L_0, the exact decomposition is

E[MSE⁡(L^Z,L0)]=1∣Θ∣∑θ[bZ(θ)2+∑jλj2vj(θ)/Bj].(13)\mathbb{E}\left[\operatorname{MSE}(\widehat{L}_Z,L_0)\right] = \frac{1}{|\Theta|}\sum_{\theta}\left[b_Z(\theta)^2 + \sum_j \lambda_j^2 v_j(\theta)/B_j\right]. \tag*{(13)}

At p=.02p = .02, linear and quadratic ZNE reduce expected MSE on all three graphs; cubic ZNE increases it despite reducing squared bias. At p=.001p = .001, all three orders increase expected MSE. The Monte Carlo mean MSE agrees with the exact decomposition within 1.919 Monte Carlo standard errors in every configuration.

All exact mean landscapes select ideal minima to numerical precision. Nevertheless,

Figure 2. Bias–variance control on a 12×1212 \times12 grid with B=1024B = 1024 shots per point for every method and 500 repetitions per configuration: exact grid-averaged squared bias and sampling variance (stacked bars) and Monte Carlo estimates of the mean-squared error with ±1.96\pm1.96 standard errors (points). This control is separate from the 120×120120 \times120 screen.

finite-shot ZNE selections have greater Monte Carlo mean regret on G2 and G3 in the tested regimes. For G2 at p=.02p = .02, expected MSE falls from 0.017405 without mitigation to 0.007840 with linear ZNE, while Monte Carlo mean normalized regret increases from 0.003365 to 0.008734. Quadratic ZNE gives MSE 0.013914 and Monte Carlo mean regret 0.01883. In each G1 configuration, all 500 repetitions select symmetry-related ideal minima to numerical precision on this coarse grid (Figure 3).

Figure 3. Decision outcomes for the bias–variance control (12×1212 \times12 grid, B=1024B = 1024, 500 repetitions per configuration): normalized ideal regret of exact-mean and finite-shot selections. A common vertical scale is used for all graphs. Error bars denote ±1.96\pm1.96 Monte Carlo standard errors and are descriptive.

This control separates contributions to expected MSE exactly. Since the mean selections are ideal, the bias route of § 3.2 alone produces no regret here, and the regret observed after sampling arises through the variance route. Residual bias can still change the margins that sampling must overcome, so the control identifies the route but not the separate causal contributions of bias and variance.

Sensitivity to shot allocation

An additional exact-moment analysis compares the implemented allocation with a pointwise oracle that knows every scale variance and minimizes ZNE variance over positive integer shot counts at the same total per-point budget. Across the four confirmation conditions, this reduces grid-mean variance by 0.0443%–0.3652%; even the largest pointwise improvement allowed by the continuous optimum is below 1.26%. Appendix § 14 gives each condition and a fixed-allocation comparison. The oracle uses the saved probabilities and is charged no calibration cost; the comparison concerns variance only.

Discussion and limitations

In the four confirmed conditions, ZNE improves landscape MSE in every fresh repetition, while the directional tests indicate a probability above one half of increased regret. These decision losses are small but reproducible and are not captured by aggregate MSE. In the control, ideal mean selections become imperfect under finite-shot sampling. The bound in Appendix § 10 relates this variance route to the mean margins in Eq. (10) and the noise scale WGSBW_G\sqrt{S_B}, where WGW_G is the total edge weight. Near-optimal competitors with small margins can remain sensitive to sampling even when aggregate MSE falls. Richardson weights increase the variance-bound coefficient relative to unmitigated estimation at the same budget, while residual bias also changes those margins. This provides a structural interpretation of the small observed regret shifts.

Relative to prior work, the contribution is a paired measurement. Bias–variance trade-offs in Richardson extrapolation, mitigation-induced landscape roughness and the accuracy–decision distinction are known from theory, landscape diagnostics and optimizer runs [18, 32, 22, 26]. Here the same sampled landscape supplies both whole-landscape MSE and ideal regret at an equal shot budget, which isolates the selection step from optimizer dynamics; a prospective confirmation shows that the resulting discordance reproduces on fresh streams; and exact moments show the variance route at work in a bounded control. The related decision-kernel preprint develops residual-gap theory and evaluates failure probabilities and dynamic regret [27]; the present work supplies the corresponding empirical characterization for conventional Richardson extrapolation on exhaustive grids. The finite-grid bounds used here are elementary and serve to organize this evidence.

Several restrictions matter. The primary circuits are shallow and small, with local depolarizing noise. The generated graphs satisfy stratification and grid-adequacy rules, so the observed frequency is not a prevalence estimate for arbitrary QAOA instances. The ideal oracle and exhaustive grid are simulation tools; an adaptive optimizer on hardware has different resource and selection constraints. Measurement-frugal variational optimizers can instead allocate shots by iteration and gradient component [19]; the present benchmark uses a prescribed per-point allocation. Auxiliary exploratory depth-two slices, thermal/readout simulations and COBYLA checks are summarized in Appendix F; the COBYLA conditions did not meet their prescribed endpoint-effect rule.

Conclusion

In this benchmark, accuracy gains from ZNE seldom came with decision losses that survive strict testing: a model-based familywise analysis retains four of 540 replication conditions. Those four losses are nevertheless reproducible. A frozen confirmation on fresh random streams recovered all of them, with median MSE improvements of up to 73.09% alongside median normalized regret increases of 0.0031–0.0073. The losses are small, but aggregate MSE does not reveal them. Exact moments on a bounded control show the variance route producing such losses: mitigated mean landscapes keep the ideal minima, and the regret appears only once finite-shot landscapes are sampled and minimized, a step that a grid-averaged error does not resolve.

When mitigation is assessed as a component of optimization, decision regret, or a validated decision-level proxy, should therefore be reported alongside estimation error; the two can disagree even when the shot allocation is close to variance-optimal. Extending paired accuracy–decision measurements to deeper circuits, optimizer loops and hardware noise is the natural next step. Validated decision-level proxies will be needed in settings where the ideal reference is unavailable.

Acknowledgements

The author received no specific funding for this work and declares no competing interests. OpenAI Codex and GPT-6.1-sol were used to assist with code development and review, statistical computation, checking of mathematical derivations, implementation of the control and confirmation analyses, and manuscript editing. AI tools are not authors. The author is responsible for the analyses and for the content of the manuscript.

Data availability

Code and data supporting this study are available in the GitHub repository and archived on Zenodo (doi:10.5281/zenodo.23607395; version 1.0.0). The archive contains seed-level metrics, reference landscapes, complete targeted-confirmation data and protocol, analysis code and figure-generation scripts, with instructions for reproducing the reported results.

Finite-grid mathematical details

This appendix collects the finite-grid results referred to in § 3. The integer-budget bound formalizes the variance route of § 3.2, and the exact Richardson example illustrates the bias route.

Integer-budget bound with an ideal optimal set. Let Θ∗={θ:L0(θ)=L∗}\Theta_\ast= \{\theta: L_0(\theta) = L_\ast\} and choose a deterministic u∈Θ∗u \in\Theta_\ast independently of sampled landscapes. For the implemented integer allocations Bj≥1B_j \ge1, write bp[aj](θ)=E[L^[aj](θ)]−L0(θ)b_p^{[a_j]}(\theta) = \mathbb{E}[\widehat{L}^{[a_j]}(\theta)] - L_0(\theta), ηZ=L^Z−E[L^Z]\eta_Z = \widehat{L}_Z - \mathbb{E}[\widehat{L}_Z], and define

SB=∑jλj2Bj,bZ(θ)=∑jλjbp[aj](θ),Mu(θ)=L0(θ)−L∗+bZ(θ)−bZ(u).S_B = \sum_j \frac{\lambda_j^2}{B_j}, \qquad b_Z(\theta) = \sum_j \lambda_j b_p^{[a_j]}(\theta), \qquad M_u(\theta) = L_0(\theta) - L_\ast+ b_Z(\theta) - b_Z(u).

Assume independent shot samples across scales and grid points and a single-shot objective interval width at most WGW_G. Hoeffding’s inequality ([13]) gives, for every ϵ≥0\epsilon\ge0,

Pr⁡{R(L^Z;L0)>ϵ}≤min⁡{1,∑θ:L0(θ)−L∗>ϵexp⁡[−(Mu(θ)+)2WG2SB]}.\Pr\{R(\widehat{L}_Z;L_0) > \epsilon\} \le\min\left\{1,\sum_{\theta:L_0(\theta)-L_\ast>\epsilon} \exp\left[-\frac{(M_u(\theta)_+)^2}{W_G^2 S_B}\right]\right\}.

Proof. Here x+=max⁡(x,0)x_+ = \max(x,0). Each weighted individual shot has interval width ∣λj∣WG/Bj|\lambda_j|W_G/B_j. Summing squared widths over the two independently sampled points gives 2WG2SB2W_G^2S_B, so Hoeffding’s inequality bounds the probability that ηZ(θ)−ηZ(u)≤−Mu(θ)\eta_Z(\theta)-\eta_Z(u) \le-M_u(\theta) by the displayed exponential when Mu(θ)>0M_u(\theta)>0; otherwise the bound one is trivial. If excessive regret occurs, the selected point is a summation point and its observed loss is no larger than the observed loss at uu. A union bound proves the claim. At ϵ=0\epsilon=0 the bound concerns selection outside the entire ideal optimal set. The comparison events may be dependent through their common anchor. For the positive-weight graphs used here, single-shot objective values lie in [−WG,0][-W_G,0] with WG=∑eweW_G=\sum_e w_e. The same coefficient SBS_B controls the variance bound in Eq. (8). The implemented largest-remainder allocations resolve ties between equal fractional parts in floating point, which can differ from exact-rational resolution; reproduction must therefore retain the recorded BjB_j.

This bound uses exact mean residuals and fixed independent sampling budgets. Replacing the residuals by estimates obtained from the same repetitions does not produce a certified probability bound. The bound concerns the optimal-set event rather than a change of argmin coordinate, because a coordinate change between equivalent minima has zero ideal regret. No empirical tightness or predictive-accuracy claim is made for it.

Exact abstract Richardson example. Consider deterministic expectation landscapes on Θ={0,1}\Theta= \{0,1\} with L0(0)=0L_0(0)=0, L0(1)=Δ>0L_0(1)=\Delta>0. For scales a∈{1,3}a\in\{1,3\} define

bp[a](0)=acp,bp[a](1)=acp+a2hp2,c,h>0.b_p^{[a]}(0)=acp,\qquad b_p^{[a]}(1)=acp+a^2hp^2,\qquad c,h>0.

With Richardson weights (3/2,−1/2)(3/2,-1/2), the ZNE bias is (0,−3hp2)(0,-3hp^2). The raw expectation landscape always preserves the ideal decision, while ZNE reverses it strictly when p>Δ/(3h)p>\sqrt{\Delta/(3h)}. The exact deterministic MSEs are

MSE⁡(Lp[1],L0)=c2p2+chp3+h2p42,MSE⁡(LZ,L0)=9h2p42.\operatorname{MSE}(L_p^{[1]},L_0)=c^2p^2+chp^3+\frac{h^2p^4}{2},\qquad\operatorname{MSE}(L_Z,L_0)=\frac{9h^2p^4}{2}.

Consequently ZNE has lower MSE exactly for

0<p<c(1+17)8h.0<p<\frac{c(1+\sqrt{17})}{8h}.

For any reference p0>0p_0>0, set Δ=1\Delta=1, h=p0−2h=p_0^{-2} and c=3p0−1c=3p_0^{-1}. Both strict reversal and strict MSE improvement hold throughout p0/3<p≤p0p_0/\sqrt{3}<p\leq p_0. At p=p0p=p_0, the raw and ZNE MSEs are 12.5 and 4.5, and their regrets are zero and one. A common shift by −20-20 places all ideal and folded expectation values in [−20,0][-20,0] on 0≤p≤p00\leq p\leq p_0. This is an exact abstract bounded-observable example, not a model of the studied circuits; its deterministic MSEs exclude shot variance, which the integer-budget bound treats.

Statistical methods and conventions

C denotes the discovery family and D the generated replication family in the tables below.

Pre-specified screening rule

The screen was planned with a bootstrap classification rule based on 10 000 percentile-bootstrap resamples of the 30 paired seed metrics [9]. A nominal condition required median rMSE≥0.10r_{\mathrm{MSE}}\geq0.10, a positive lower bootstrap limit for rMSEr_{\mathrm{MSE}}, positive median dRd_R, nonnegative lower bootstrap limit for dRd_R, and at least 60% positive dRd_R values. Bootstrap positivity tails with a one-count correction were combined using their maximum, followed by BH adjustment [2], with q=0.10q=0.10 for discovery and q=0.05q=0.05 for replication. Nine discovery and 33 replication conditions were excluded because at least one seed had noisy MSE below 10−4D0210^{-4}D_0^2. No condition triggered the extrapolation-breakdown rule, which required more than half the grid to fall outside the ideal range extended by 0.10D00.10D_0.

Bootstrap positivity tails need not be null-calibrated p-values, so this rule does not yield calibrated familywise statements. Its zero Holm rejections also reflect a Monte Carlo resolution limit, examined in Appendix § 11.§ 6. Under the rule, 18 discovery conditions are nominal and 13 survive BH, and 69 replication conditions are nominal and 39 survive BH. We report these classifications as a secondary descriptive analysis.

Sampling unit and complete families

Every screening condition contains the same 30 seed labels. The reference test model assumes independent, identically distributed shot repetitions conditional on a fixed graph, noise model, circuit folding, integer allocation and grid; Appendix § 11.§ 4 describes how the screening sampler departs from it. Metrics are formed from the paired noisy and mitigated landscapes. Sharing the noisy baseline between orders creates cross-condition dependence, but does not require assuming independent endpoints within a pair for an intersection–union test.

Discovery and replication are separate families of 135 and 540 tests. Conditions excluded by the detection-floor rule receive adjusted input p-values of one, so they remain nonrejectable members of their families. An exclusion based on observed data can only increase these p-values; it cannot invalidate super-uniformity of an otherwise valid unfiltered test.

Exact directional tests and multiplicity

For X=rMSEX = r_{\mathrm{MSE}} and Y=dRY = d_R, the component nulls are Pr⁡(X>0)≤1/2\Pr(X > 0) \le1/2 and Pr⁡(Y>10−12)≤1/2\Pr(Y > 10^{-12}) \le1/2. Under that sampling model, standard exact binomial testing (Lehmann and Romano [20]) gives, for either positive count KK, the p-value ∑k=K30(30k)2−30\sum_{k=K}^{30} \binom{30}{k}2^{-30}. A binomial upper tail is largest at the boundary 1/21/2 of this composite null. Zeros and numerical ties are failures, with denominator 30; deleting them would change the estimand.

The conjunction alternative requires both marginal probabilities to exceed one half; this is the intersection–union construction (Berger [4]), whose validity is shown in § 4.2. Holm’s sorted adjusted values (Holm [14]) are

p(i)Holm=min⁡{1,max⁡l≤i(T−l+1)p(l)},p^{\mathrm{Holm}}_{(i)} = \min\left\{1,\max_{l\le i}(T-l+1)p_{(l)}\right\},

where TT is the number of tests in the family; they control the familywise error at level α\alpha under arbitrary dependence between conditions. This is distinct from an FDR claim on an outcome-filtered subset. BY sensitivity (Benjamini and Yekutieli [3]) uses the harmonic factor ∑l=1T1/l\sum_{l=1}^{T}1/l. BH sensitivity (Benjamini and Hochberg [2]) does not supply arbitrary-dependence control.

Seed collisions in the screening sampler

The screening code initializes default_rng at every point and scale from the first eight hexadecimal SHA-256 digits masked with 0x7fffffff (31 bits). Distinct labels can there fore reuse a stream. Counting all random-number-generator (RNG) initializations in each of the four conditions retained by Holm gives:

Condition (G,p,B,mG,p,B,m)RNG callsWithin repetitionBetween repetitions
H1, .02, 1024, 21 728 00016677
H3, .02, 1024, 21 728 00032690
H8, .01, 4096, 32 160 000511059
H8, .01, 4096, 21 728 00028637

The last two columns count colliding pairs of RNG initializations, not duplicated landscapes or changed decisions, and all colliding pairs refer to distinct grid indices. The counts therefore do not quantify the effect on signs; the directional analysis retains the four conditions. Repeated streams nevertheless induce dependence not represented by the ideal binomial model, so the four screening results are model-based diagnostics, without a certified error probability for this generator.

Roundoff-sensitive signs

Strict floating-point positivity, without the numerical tolerance, retains five D conditions. In H3 at p=.02p = .02, B=4096B = 4096, cubic order, two positive dRd_R values are approximately 2.1×10−162.1 \times10^{-16}. Discounting them as numerical ties lowers its regret count from 26 to 24, and it no longer survives Holm. H8 at p=.01p = .01, B=4096B = 4096, cubic order also has two roundoff-level positives; its count falls from 28 to 26, and it remains retained.

ThresholdC HolmC BYC BHD HolmD BYD BH
022115534
10−1410^{-14}1044412
10−1210^{-12}1044412
10−1010^{-10}1044412
10−610^{-6}1044412

Table B.1. Directional-test sensitivity to the regret threshold. Holm uses .05 for each separate family. BY/BH use .10 for C and .05 for D. Values are counts before any practical-effect filtering.

The tolerance is in normalized ideal-regret units, far below the observed median shifts. The exact median relative MSE improvement of the retained H3 quadratic condition is 0.080523.

Isolating bootstrap resolution from calibration

For the empirical bootstrap ([9]), the lower bound 1/(10000+1)1/(10000 + 1) on Monte Carlo bootstrap tails exceeds the first Holm cutoff .05/540.05/540. To isolate this resolution limit, we also compute the conditional empirical-bootstrap median distribution without Monte Carlo sampling.

AnalysisHolm .05BYBH
D: pre-specified bootstrap rule01539
D: exact conditional bootstrap tail, same filters141540
D: sign tests, strict floating-point positivity5534
D: sign tests, dR>10−12d_R > 10^{-12}4412
C: sign tests, dR>10−12d_R > 10^{-12}104

Table B.2. Pre-specified bootstrap classifications and directional tests. Bootstrap rows include the pre-specified nominal filters; sign rows do not. Consequently, these rows differ in estimand and decision rule, not only in multiplicity adjustment. C and D are separate families.

BY/BH use .05 for D and .10 for C. Exact conditional bootstrap tails remove Monte Carlo error only; they are not exact frequentist p-values.

For n=2sn = 2s and empirical distinct values xix_i with probabilities pip_i, write Fi=∑l≤iplF_i = \sum_{l \le i} p_l and Fi−=Fi−piF_i^{-} = F_i - p_i. If the two middle order statistics equal distinct values xi<xlx_i < x_l, their joint probability is

(2ss){Fis−(Fi−)s}{(1−Fl−)s−(1−Fl)s}\binom{2s}{s}\left\{F_i^s - (F_i^{-})^s\right\}\left\{(1-F_l^{-})^s - (1-F_l)^s\right\}

If both middle values equal xix_i, the probability is

∑a=0s−1∑b=0s−1(2s)!a!b!(2s−a−b)!(Fi−)a(1−Fi)bpi2s−a−b\sum_{a=0}^{s-1}\sum_{b=0}^{s-1}\frac{(2s)!}{a!b!(2s-a-b)!}(F_i^{-})^a(1-F_i)^b p_i^{2s-a-b}

Assign these masses to (xi+xl)/2(x_i + x_l)/2 and xix_i, respectively. The implementation verifies normalization and compares the cumulative distribution function to exhaustive resampling enumeration for small samples with and without ties. The pre-specified nominal filters remain attached only to this resolution sensitivity: D gives 40 BH, 15 BY and 14 Holm classifications, compared with 39, 15 and zero under the Monte Carlo rule.

Sign-test rejection probabilities are also enumerated at the null boundary.

Graph-level interpretation

The pre-specified stress rule counts conditions with p∈{.005,.01,.02}p \in\{.005, .01, .02\}, B∈{1024,4096}B \in\{1024, 4096\} and all orders, requiring at least three nominal classifications per graph. The observed count is 11/12. The six fixed strata have two selected graphs each, and the positivity probabilities need not be identical across strata. The homogeneous binomial tail 13/4096 is not an exact test of a heterogeneous population-average probability. A related bound would require the stronger null that every independent graph-specific probability is at most 1/2. We report the 11/12 count descriptively.

Prospective targeted confirmation

Frozen design and sampling

The protocol was fixed before any confirmatory landscape was sampled. Its machine-readable form, explanatory text and SHA-256 lock identify the analysis script, graph definitions, exact ideal arrays and source modules; its timestamped record is included in the reproducibility package, and it is not externally registered. All four screening candidates were retained: H1 and H3 at p=.02p = .02, B=1024B = 1024, quadratic order; H8 at p=.01p = .01, B=4096B = 4096, quadratic and cubic orders. The planned sample is 100 repetitions for every condition, without pooling screening data.

In increasing scale order, the exact integer allocations are

(548,366,110),(2194,1463,439),(1493,1493,896,214)(548, 366, 110), \qquad(2194, 1463, 439), \qquad(1493, 1493, 896, 214)

for quadratic order at B=1024B = 1024, quadratic order at B=4096B = 4096 and cubic order at B=4096B = 4096, respectively. The same 120×120120 \times120 grids, row-major first-index argmin, circuit and depolarizing model are used. Probabilities must be finite, nonnegative and sum to one within 10−910^{-9}; normalization by the sum removes floating-point drift before sampling. The ideal arrays match independent statevector calculations at eight fixed points per graph.

A recorded 256-bit entropy value seeds the root SeedSequence. Children are spawned in group order H1, H3, H8, then repetition 0–99, then baseline followed by the cell/scale order in the protocol. H8 cubic precedes quadratic. Each child initializes one PCG64DXSM generator, consumed sequentially over grid points. There are 1600 distinct stream paths and initial states; baseline draws are shared only between the two H8 orders at the same repetition. Distinct paths and states support the usual independent-stream model. Software versions, including NumPy 2.2.6, are fixed in the protocol.

A preliminary pilot that measured only runtime and pointwise agreement with Aer is excluded, together with its streams and draws. No interim endpoint analysis, optional stopping, sample-size extension or metric-based exclusion is permitted.

Inference and complete outcomes

Before execution, exact design calculations showed that 62 successes in both components suffice to pass the most stringent Holm cutoff .0125. For a component success probability .60, .65 or .70, the probability of reaching 62 is .3822, .7699 or .9660, respectively. These are design scenarios, not estimates from the screening success rates. Power can be limited for probabilities close to one half.

Medians, quartiles, native regret shifts and individual 95% Clopper–Pearson intervals accompany all 400 paired endpoints in the reproducibility package. The intervals are descriptive and do not have simultaneous family coverage. The verification implementation of § 4.5 also checks the stream records, complemented by partial stream replay and bounded Aer checks.

Conditionprp_rpdp_dpIUTp_{\mathrm{IUT}}pHolmp_{\mathrm{Holm}}Both
H1, m=2m = 27.89×10−317.89 \times10^{-31}8.95×10−48.95 \times10^{-4}8.95×10−48.95 \times10^{-4}8.95×10−48.95 \times10^{-4}66
H3, m=2m = 27.89×10−317.89 \times10^{-31}3.93×10−53.93 \times10^{-5}3.93×10−53.93 \times10^{-5}1.18×10−41.18 \times10^{-4}70
H8, m=3m = 37.89×10−317.89 \times10^{-31}1.30×10−121.30 \times10^{-12}1.30×10−121.30 \times10^{-12}5.21×10−125.21 \times10^{-12}84
H8, m=2m = 27.89×10−317.89 \times10^{-31}4.37×10−44.37 \times10^{-4}4.37×10−44.37 \times10^{-4}8.74×10−48.74 \times10^{-4}67

Table C.1. Complete primary p-values for the targeted family (n=100n = 100 each). The final column is the descriptive count of repetitions with both positive indicators; it is not the tested probability.

Probability generation and sampling took 535.74 and 160.55 seconds, respectively (11.60 minutes combined), with probabilities cached and reused across repetitions; these timings indicate scale only.

Bias–variance control: design and validation

The control of § 5.3 uses the three discovery graphs, chosen for coverage, and was designed after the screening results were known. Its 24 graph/noise/method configurations comprise 3456 pointwise rows and 12 000 complete Monte Carlo landscape repetitions, with independent random streams across methods, scales and grid points; common repetition indices are labels, not common random numbers.

The simulator’s moments agree with Aer at two specified validation cases to maximum discrepancies 2.73×10−142.73 \times10^{-14} and 1.33×10−131.33 \times10^{-13}. An independent ideal statevector calculation at all 432 graph/grid points agrees within 6.22×10−156.22 \times10^{-15}.

The three ideal grids contain 32, two and two equivalent minima within 10−1010^{-10} objective units. The saved outcomes also record an illustrative single-competitor contrast, between the first ideal minimum and the point with the smallest strictly positive ideal gap.

The control took 69.29 seconds, compared with approximately 10.21 and 50.46 hours for the discovery and replication screens on different machines.

Allocation sensitivity

This deterministic sensitivity analysis uses the saved probability caches of the four confirmation conditions and does not modify the confirmation. At each grid point, basis-state objective values LxL_x and cached probabilities pj,xp_{j,x} give

μj=∑xpj,xLx,vj=∑xpj,x(Lx−μj)2.\mu_j = \sum_x p_{j,x}L_x,\qquad v_j = \sum_x p_{j,x}(L_x-\mu_j)^2.

All scale variances in these caches are positive. For fixed weights, independent scale samples and total budget BB, the continuous variance minimum is

Vcont∗(θ)=(∑j∣λj∣vj(θ))2B,Bj∗(θ)∝∣λj∣vj(θ).V_{\mathrm{cont}}^{*}(\theta)=\frac{\left(\sum_j|\lambda_j|\sqrt{v_j(\theta)}\right)^2}{B},\qquad B_j^{*}(\theta)\propto|\lambda_j|\sqrt{v_j(\theta)}.

The actual variance uses the implemented integer BjB_j. For the exact positive-integer minimum, write qj=λj2vjq_j=\lambda_j^2v_j, initialize every count at one and assign each remaining shot to the largest decrease qj/[Bj(Bj+1)]q_j/[B_j(B_j+1)]. These decreases are monotonically diminishing for each scale, so the greedy sequence gives the global optimum of this separable integer problem. A final one-shot exchange check is performed at every point.

The pointwise oracle may also change allocations between grid points, so it is a favorable reference for variance reduction, not an experimentally available protocol at the same acquisition cost. With an overbar denoting a grid mean, Table E.1 reports 100(1−V‾int/V‾used)100(1-\overline{V}_{\mathrm{int}}/\overline{V}_{\mathrm{used}}). These are ratios of mean variances, not averages of pointwise ratios. A single fixed allocation for each entire condition is also optimized, using grid-mean qjq_j in the integer calculation.

ConditionBBV‾used\overline{V}_{\mathrm{used}}Vint∗V_{\mathrm{int}}^{*}Pointwise gain (%)Fixed gain (%)
H1, m=2m=210240.015656290.015637910.117380.01077
H3, m=2m=210240.012191000.012185600.044330.00005
H8, m=3m=340960.023336660.023251430.365210.17148
H8, m=2m=240960.008214500.008190930.286890.13492

Table E.1. Exact-moment allocation sensitivity for the four confirmation conditions. Pointwise and fixed-oracle gains are percentage reductions in grid-mean variance; all allocations retain the same total shots per point.

The largest pointwise reduction relative to the continuous lower bound is 1.2566%, and the reduction in grid-mean excess variance above the unmitigated baseline is below 0.38% in every condition. A continuous uniform allocation has greater grid-mean variance than the implemented allocation in all four conditions. These results concern these cached distributions and fixed estimator coefficients.

Because moments alone do not determine the selected minimum, the confirmation applies to its prescribed allocation.

Auxiliary exploratory checks

The following exploratory checks accompany the screen. They are not pooled into the depth-one test family; their full outputs are archived with the screening data.

DiagnosticInterpretation
Depth-two slicesSelected instances, slices and budgets provide exploratory directional evidence only; they are not a full two-layer parameter search or an independent replication of the paired endpoint.
Thermal/readout noiseSynthetic component checks are not hardware-calibrated. The MSE-improvement precondition often fails, especially for thermal-only noise.
COBYLA endpointsNo examined instance/order condition met the prescribed joint rule of at least 80% positive repetitions and median optimizer regret shift above .02.
No-reference scoresOn the pre-specified D classifications, areas under the receiver-operating-characteristic curve were .546 for order-to-order argmin distance, .498 for seed instability and .504 for observed-margin risk. They do not validate an oracle-free replacement for ideal regret.
Leave-one-out checksLeave-one-seed, graph and factor checks used the pre-specified bootstrap classifications. Their conclusions are not transferred to the sign/Holm set.

Table F.1. Scope of the auxiliary checks. None supplies hardware or optimizer-loop confirmation of the paired endpoint.

For example, the H11 quadratic random-start COBYLA check had 22/25 positive repetitions and median shift about .0195, below its .02 criterion. The warm-start H11 quadratic check had a slightly negative median. These mixed results delimit the grid-based claim.

References

  1. [1]Jean-Yves Audibert, Sébastien Bubeck, and Rémi Munos. Best arm identification in multi-armed bandits. In Proceedings of the 23rd Conference on Learning Theory, pages 41–53, 2010. URL https://www.learningtheory.org/colt2010/papers/59Audibert.pdf.
  2. [2]Yoav Benjamini and Yosef Hochberg. Controlling the false discovery rate: A practical and powerful approach to multiple testing. J. R. Stat. Soc. B, 57:289–300, 1995. doi:10.1111/j.2517-6161.1995.tb02031.x.DOI
  3. [3]Yoav Benjamini and Daniel Yekutieli. The control of the false discovery rate in multiple testing under dependency. The Annals of Statistics, 29(4):1165–1188, 2001. doi:10.1214/aos/1013699998.DOI
  4. [4]Roger L. Berger. Multiparameter hypothesis testing and acceptance sampling. Technometrics, 24(4):295–300, 1982. doi:10.1080/00401706.1982.10487790. Choy Boy and David J. Wales. Energy landscapes for the quantum approximate optimization algorithm. Phys. Rev. A, 109:062602, 2024. doi:10.1103/PhysRevA.109.062602.
  5. [5]Daniel Bultrini, Max Hunter Gordon, Piotr Czarnik, Andrew Arrasmith, Marco Cerezo, Patrick J. Coles, and Lukasz Cincio. Unifying and benchmarking state-of-the-art quantum error mitigation techniques. Quantum, 7:1034, 2023. doi:10.22331/q-2023-06-06-1034.DOI
  6. [6]Zhenyu Cai, Ryan Babbush, Simon C. Benjamin, Suguru Endo, William J. Huggins, Ying Li, Jarrod R. McClean, and Thomas E. O’Brien. Quantum error mitigation. Rev. Mod. Phys., 95:045005, 2023. doi:10.1103/RevModPhys.95.045005.DOI
  7. [7]M. Cerezo, Andrew Arrasmith, Ryan Babbush, Simon C. Benjamin, Suguru Endo, Keisuke Fujii, Jarrod R. McClean, Kosuke Mitarai, Xiao Yuan, Lukasz Cincio, and Patrick J. Coles. Variational quantum algorithms. Nature Reviews Physics, 3(9):625–644, 2021. doi:10.1038/s42254-021-00348-9.DOI
  8. [8]Lixue Cheng, Yu-Qin Chen, Shi-Xin Zhang, and Shengyu Zhang. Quantum approximate optimization via learning-based adaptive optimization. Communications Physics, 7(1):83, 2024. doi:10.1038/s42005-024-01577-x.DOI
  9. [9]Bradley Efron and Robert J. Tibshirani. An Introduction to the Bootstrap. Chapman and Hall, New York, 1993. doi:10.1007/978-1-4899-4541-9.DOI
  10. [10]Adam N. Elmachtoub and Paul Grigas. Smart “predict, then optimize”. Management Science, 68(1):9–26, 2022. doi:10.1287/mnsc.2020.3922.DOI
  11. [11]Edward Farhi, Jeffrey Goldstone, and Sam Gutmann. A quantum approximate optimization algorithm. arXiv, 2014. doi:10.48550/arXiv.1411.4028.DOI
  12. [12]Tudor Giurgica-Tiron, Yousef Hindy, Ryan LaRose, Andrea Mari, and William J. Zeng. Digital zero noise extrapolation for quantum error mitigation. In 2020 IEEE International Conference on Quantum Computing and Engineering (QCE), pages 306–316, 2020. doi:10.1109/QCE49297.2020.00045.
  13. [13]Wassily Hoeffding. Probability inequalities for sums of bounded random variables. Journal of the American Statistical Association, 58(301):13–30, 1963. doi:10.1080/01621459.1963.10500830.DOI
  14. [14]Sture Holm. A simple sequentially rejective multiple test procedure. Scandinavian Journal of Statistics, 6(2):65–70, 1979. URL https://www.jstor.org/stable/4615733.DOI
  15. [15]Ali Javadi-Abhari, Matthew Treinish, Kevin Krsulich, Christopher J. Wood, Jake Lishman, Julien Gacon, Simon Martiel, Paul D. Nation, Lev S. Bishop, Andrew W. Cross, Blake R. Johnson, and Jay M. Gambetta. Quantum computing with Qiskit. arXiv, 2024. doi:10.48550/arXiv.2405.08810.
  16. [16]Sharu Theresa Jose and Osvaldo Simeone. Error-mitigation-aided optimization of parameterized quantum circuits: Convergence analysis. IEEE Transactions on Quantum Engineering, 3:3103119, 2022. doi:10.1109/TQE.2022.3229747.DOI
  17. [17]Ebrahim Khaleghian and Özgür E. Müste­caplıoğlu. Physics-informed learning of effective error processes from limited noisy transmon measurements for robust QAOA reliability, 2026. URL https://arxiv.org/abs/2606.00353v2. Preprint, version 2.
  18. [18]Michael Krebsbach, Björn Trauzettel, and Alessio Calzona. Optimization of Richardson extrapolation for quantum error mitigation. Phys. Rev. A, 106:062436, 2022. doi:10.1103/PhysRevA.106.062436.DOI
  19. [19]Jonas M. Kübler, Andrew Arrasmith, Lukasz Cincio, and Patrick J. Coles. An adaptive optimizer for measurement-frugal variational algorithms. Quantum, 4:263, 2020. doi:10.22331/q-2020-05-11-263.DOI
  20. [20]E. L. Lehmann and Joseph P. Romano. Testing Statistical Hypotheses. Springer Texts in Statistics. Springer, New York, 3 edition, 2005. doi:10.1007/0-387-27605-X.DOI
  21. [21]Ying Li and Simon C. Benjamin. Efficient variational quantum simulator incorporating active error minimization. Phys. Rev. X, 7:021050, 2017. doi:10.1103/PhysRevX.7.021050.DOI
  22. [22]Kun Liu, Tianyi Hao, and Swamit Tannu. Enabling high performance debugging for variational quantum algorithms using compressed sensing. In Proceedings of the 50th Annual International Symposium on Computer Architecture, ISCA ’23, pages 1–13, New York, NY, USA, 2023. Association for Computing Machinery. doi:10.1145/3579371.3589044.DOI
  23. [23]Adriano Lusso, Marco Venere, Victor Onofre, Alberto Maldonado-Romo, Alejandro Montanez-Barrera, and Marco D. Santambrogio. Evaluating the role of noise mitigation in QAOA: A study of zero-noise extrapolation and CVaR. In 2025 IEEE International Conference on Quantum Computing and Engineering (QCE), pages 602–603, 2025. doi:10.1109/QCE65121.2025.10466.DOI
  24. [24]Jeffrey Marshall, Filip Wudarski, Stuart Hadfield, and Tad Hogg. Characterizing local noise in QAOA circuits. IOP SciNotes, 1(2):025208, 2020. doi:10.1088/2633-1357/abb0d7.DOI
  25. [25]Matteo Robbiati, Alejandro Sopena, Andrea Papaluca, and Stefano Carrazza. Real-time error mitigation for variational optimization on quantum hardware. Phys. Rev. Research, 8:013262, 2026. doi:10.1103/zyb2-zl2d.DOI
  26. [26]Stefan H. Sack and Daniel J. Egger. Large-scale quantum approximate optimization on nonplanar graphs with machine learning noise mitigation. Phys. Rev. Research, 6:013223, 2024. doi:10.1103/PhysRevResearch.6.013223.DOI
  27. [27]Vicenzo Scavino. Decision kernels for quantum error mitigation: Why accuracy gains need not improve downstream decisions, 2026. URL https://arxiv.org/abs/2607.02888. Preprint.
  28. [28]Shree Hari Sureshbabu, Dylan Herman, Ruslan Shaydu­lin, Joao Basso, Shouvanik Chakrabarti, Yue Sun, and Marco Pistoia. Parameter setting in quantum approximate optimization of weighted problems. Quantum, 8:1231, 2024. doi:10.22331/q-2024-01-18-1231.DOI
  29. [29]Ryuji Takagi, Suguru Endo, Shintaro Minagawa, and Mile Gu. Fundamental limits of quantum error mitigation. npj Quantum Information, 8(1):114, 2022. doi:10.1038/s41534-022-00618-z.DOI
  30. [30]Kristan Temme, Sergey Bravyi, and Jay M. Gambetta. Error mitigation for short-depth quantum circuits. Phys. Rev. Lett., 119:180509, 2017. doi:10.1103/PhysRevLett.119.180509.DOI
  31. [31]Marco Venere, Adriano Lusso, Victor Onofre, Alberto Maldonado-Romo, and Marco D. Santambrogio. Characterizing the effects of zero-noise extrapolation on a QAOA workflow. In 2024 IEEE International Conference on Quantum Computing and Engineering (QCE), pages 426–427, 2024. doi:10.1109/QCE60285.2024.10338.DOI
  32. [32]Samson Wang, Piotr Czarnik, Andrew Arrasmith, M. Cerezo, Lukasz Cincio, and Patrick J. Coles. Can error mitigation improve trainability of noisy variational quantum algorithms? Quantum, 8:1287, 2024. doi:10.22331/q-2024-03-14-1287.DOI
  33. [33]Leo Zhou, Sheng-Tao Wang, Soonwon Choi, Hannes Pichler, and Mikhail D. Lukin. Quantum approximate optimization algorithm: Performance, mechanism, and implementation on near-term devices. Phys. Rev. X, 10:021067, 2020. doi:10.1103/PhysRevX.10.021067.DOI

Paper details

vlnc:W_k4z4p37h
Version
v1 · latest
Published
Fresh — added to the Hub within the last 30 days
Added
License
CC BY 4.0
Usage

views · 0

downloads · 0

A view counts once per browser per day, a download each time the PDF is requested.

  • Physics and Astronomy

Codex, GPT-6.1 Sol (bare)

View statement
Looking for related papers…
Contents