Introduction
Most quantum machine learning (QML) models share a common structure: an input quantum state is measured after evolution through some quantum dynamics, and a classical model is then trained on features extracted from the measurement outcomes [1 , 2 , 3 , 4 ] . These features are never known exactly, since expectation values, outcome probabilities, and state overlaps can only be estimated from finitely many shots. While the resulting sampling noise is usually treated as a nuisance that more shots can make arbitrarily small, this picture is incomplete: sampling noise can produce effects that do not vanish with more shots, and reducing it can even worsen performance in some cases. In a companion paper [5 ] , for example, we showed that standard training methods can end up fitting the sampling noise itself, a form of quantum overfitting that worsens as the training statistics increase.
Quantum linear regression — We study these effects in quantum linear regression (QLR) models [5 ] , a class of QML protocols that includes quantum extreme learning machines [6 , 7 , 8 , 9 , 10 , 11 ] , quantum reservoir computing [12 , 13 , 14 ] , and quantum fidelity kernels [3 , 4 , 15 , 16 ] . In QLR, a quantum device produces the features as expectation values of fixed measurement operators, and the prediction is a linear combination of these features whose coefficients are fitted classically by standard regression [17 , 18 , 19 , 20 ] .
Spectral origins of double descent — Fitting these coefficients generally involves inverting the matrix of features measured on the training states, an operation which can amplify errors along its nearly singular directions. In ridgeless and random-feature regression, this mechanism underlies double descent phenomena [21 , 22 , 23 ] : as features are added, the test error peaks when their number matches the number of training examples, and then decreases again. The peak arises because the feature matrix is square at that point, and random matrix theory shows that square random matrices typically have singular values close to zero [24 , 25 , 26 ] . In shadow tomography, the same mechanism makes observable estimation from poorly conditioned measurements particularly sensitive to shot noise [27 ] . Spectral analyses have recently extended this picture to QML [28 , 29 , 30 , 31 ] , revealing double-descent phenomena that do not originate from shot noise and persist even when the features are known exactly.
Triple descent from finite sampling — Here, we show that sampling noise adds a second peak to this picture, producing a triple descent as the number of measurement outcomes is varied. Unlike previously identified double-descent peaks, this new peak has an intrinsically stochastic origin: more training statistics do not suppress it — in the test variance, its height actually grows and then saturates to a value depending on the dimension — and it disappears only in the theoretical limit of exactly known training features. Unlike the peak at informational completeness, which affects only the test variance when the target is reconstructed exactly, the new peak can also distort the learned observable itself, and is therefore not removed by increasing the statistics at inference. We focus our analysis on the simplest type of quantum features: the outcome probabilities of a fixed measurement performed after a fixed quantum evolution. This choice loses little generality, since the mechanisms we identify rely only on two properties shared by all QLR models: the exact features depend linearly on the input state, and they are estimated from finite samples. Learning a target observable then means reconstructing its expectation value from the outcome probabilities, using n t r n_{\mathrm{tr}} n tr training states labeled by their target values.
Two spectral instabilities — More precisely, as the number of measurement outcomes n o u t n_{\mathrm{out}} n out grows, the prediction error peaks twice, as illustrated schematically in Figure 1 , and the two peaks have different origins. We call a peak classical if it is caused by ill-conditioning of the exact feature matrix, typically inherited from the measurement itself, and quantum if it is caused by nearly singular directions that sampling fluctuations create. In both cases, the peak appears because a random matrix that is close to square is likely to be nearly singular, as described by the Marchenko–Pastur law. We also map out the full landscape of possible peaks arising at the various completeness and interpolation thresholds in Figure 2 .
Figure 1. Triple descent in quantum linear regression. Pictorial representation of the MSE versus the number of measurement outcomes n o u t n_{\mathrm{out}} n out , for n t r > d 2 n_{\mathrm{tr}} > d^2 n tr > d 2 training states and various test statistics N N N . Top: With exact training probabilities (N = ∞ N = \infty N = ∞ ), the error exhibits a classical peak at the threshold for informational completeness, n o u t = d 2 n_{\mathrm{out}} = d^2 n out = d 2 , caused by ill-conditioning of the measurement frame. Middle: With large but finite training statistics (N ≫ 1 N \gg1 N ≫ 1 shots per training state), sampling fluctuations populate additional feature directions absent from the exact probabilities. These generate a second, quantum peak at the interpolation threshold, n o u t = n t r n_{\mathrm{out}} = n_{\mathrm{tr}} n out = n tr , producing the triple-descent profile. Bottom: At low training statistics, shot noise suppresses the classical peak through effective regularization, and the quantum peak becomes dominant. The labels indicate regions where the measurement is informationally complete (IC), not informationally complete (NO-IC), underparameterized (UP), and overparameterized (OP).
Figure 2. Overview of classical and quantum peaks. Schematic representation of the regression regimes and the instabilities that separate them, for generic random POVMs and training states. With high probability, the measurement is informationally complete for n o u t ≥ d 2 n_{\mathrm{out}} \ge d^2 n out ≥ d 2 , while the training states span operator space for n t r ≥ d 2 n_{\mathrm{tr}} \ge d^2 n tr ≥ d 2 . For n t r > d 2 n_{\mathrm{tr}} > d^2 n tr > d 2 , increasing n o u t n_{\mathrm{out}} n out we cross we cross two peak: a classical one at n o u t = d 2 n_{\mathrm{out}} = d^2 n out = d 2 , caused by ill-conditioning of the measurement and affecting the test variance even with exact training features (§ 3 ), and a quantum peak at n o u t = n t r n_{\mathrm{out}} = n_{\mathrm{tr}} n out = n tr , caused by finite training shot-noise (section IV). Increasing n o u t n_{\mathrm{out}} n out at n t r > d 2 n_{\mathrm{tr}} > d^2 n tr > d 2 thus causes a triple descent phenomenon, as also illustrated in Figure 1 . Similarly, for n o u t > d 2 n_{\mathrm{out}} > d^2 n out > d 2 , increasing n t r n_{\mathrm{tr}} n tr crosses a classical interpolation threshold at n t r = d 2 n_{\mathrm{tr}} = d^2 n tr = d 2 , where label noise can produce a peak even with exact features, followed by the quantum peak at n t r = n o u t n_{\mathrm{tr}} = n_{\mathrm{out}} n tr = n out . When both n o u t , n t r < d 2 n_{\mathrm{out}}, n_{\mathrm{tr}} < d^2 n out , n tr < d 2 the interpolation peak n o u t = n t r n_{\mathrm{out}} = n_{\mathrm{tr}} n out = n tr changes nature and becomes classical, and remains even with exact training and test features and no label noise, being caused by inaccessible components of the target observable (§ 3.2 ). This is analogous to the peak observed in [32 ] . The classical peak at n t r > d 2 n_{\mathrm{tr}} > d^2 n tr > d 2 is caused by a divergence in the test variance and is thus visible only accounting for finite test statistics; the classical peak at n t r = d 2 n_{\mathrm{tr}} = d^2 n tr = d 2 is caused by label noise and is thus visible only for γ > 0 \gamma> 0 γ > 0 ; the quantum peak at n o u t = n t r n_{\mathrm{out}} = n_{\mathrm{tr}} n out = n tr is instead caused by stochastic instabilities in the estimated regression weights, and is thus visible only accounting for finite training statistics N < ∞ N < \infty N < ∞ .
Peak at informational completeness — The first peak occurs at informational completeness, n o u t = d 2 n_{\mathrm{out}} = d^2 n out = d 2 with d d d the Hilbert-space dimension, the point at which exact outcome probabilities first suffice to reconstruct the input state. This peak is classical and is the direct counterpart of the double descent observed in classical linear regression [21 ] and quantum kernel methods [29 ] . Formally, it originates from the near-singularity of the measurement frame operator [27 ] , a superoperator built from the POVM that describes which operator directions the measurement resolves, and how well. For the random POVMs we consider, the POVM elements form an effectively random n o u t × d 2 n_{\mathrm{out}} \times d^2 n out × d 2 matrix, so the frame-operator spectrum follows the Marchenko–Pastur law, and becomes poorly conditioned exactly where the POVM first becomes informationally complete. Because this ill-conditioning belongs to the measurement, the peak persists with exact training probabilities, and would appear even if the measurement were known exactly and the target were reconstructed with the optimal unbiased linear estimator [27 ] ; suitably chosen symmetric measurements, however, can avoid it: for instance symmetric informationally complete POVMs, whose measurement frame operator is proportional to the identity on traceless operators [33 ] . At low training statistics, shot noise acts as a regularizer and dampens the peak [5 , 32 ] , while at high training statistics its height saturates to a level set by the exact features. Because this peak stems from large exact regression coefficients, its effect on predictions is confined to their variance, and more shots at inference suppress it.
Classical peak from label noise — For n o u t > d 2 n_{\mathrm{out}} > d^2 n out > d 2 , a further classical peak can occur at n t r = d 2 n_{\mathrm{tr}} = d^2 n tr = d 2 when the training labels are noisy, even with exact measurement probabilities. Near this threshold, the training states become nearly linearly dependent: certain combinations ∑ i c i ρ i \sum_i c_i \rho_i ∑ i c i ρ i almost vanish, while the corresponding combinations of noisy labels generally do not. Least-squares regression attempts to fit these fluctuations by introducing large components in the reconstructed observable along the poorly constrained operator directions. The resulting amplification of label noise produces a peak in the prediction error that persists even for N = M = ∞ N = M = \infty N = M = ∞ . In the absence of label noise, the near-dependencies are exactly reflected in the labels, and this instability does not occur.
Peak at interpolation — At the interpolation threshold n o u t = n t r n_{\mathrm{out}} = n_{\mathrm{tr}} n out = n tr , the classification depends on whether the measurement is informationally complete. For n t r < d 2 n_{\mathrm{tr}} < d^2 n tr < d 2 , the exact training-feature matrix can itself become poorly conditioned and the resulting peak is classical, as also observed in [32 ] . For n t r > d 2 n_{\mathrm{tr}} > d^2 n tr > d 2 , the peak is quantum: exact probabilities span at most d 2 d^2 d 2 dimensions, but training-shot fluctuations populate the remaining directions. The noise-only part of the empirical feature matrix becomes square at n o u t = n t r n_{\mathrm{out}} = n_{\mathrm{tr}} n out = n tr ; its small singular values make the least-squares fit amplify test-shot noise and perturb the reconstructed observable. Consequently, adding outcomes beyond informational completeness can worsen predictions even as the measurement frame becomes better conditioned.
Finite-size behavior and limits — At finite Hilbert-space dimension, the peaks are rounded and their heights fluctuate across measurements and training records. The divergences arise in distinct high-dimensional limits, studied below. In particular, the typical quantum test-variance peak saturates as the training-shot budget N N N grows at fixed dimension, although the peak is absent when the training probabilities are supplied exactly. The order of these limiting operations is therefore essential.
Analytical approach and implications — We make all these observations quantitative by analyzing the frame operator with random-matrix methods and by separating, in the empirical feature matrix, the directions carried by the training states from those generated only by sampling. The resulting analysis proves that both peaks exist and yields their shape analytically, both with and without ridge regularization, in good agreement with extensive numerical simulations. More broadly, these results show that the spectrum of an ideal quantum feature map is only part of the learning problem: treating the features as exactly known misses the quantum peak entirely and overestimates the classical one. A reliable analysis must therefore treat training and test statistics separately, and account both for the constraints that quantum states and measurements impose on the features and for the finite records from which they are estimated. In practice, measurement design, training-set size, and shot budget cannot be chosen independently: whether adding outcomes helps or hurts depends on how n o u t n_{\rm out} n out compares with both d 2 d^2 d 2 and n t r n_{\rm tr} n tr .
We first define the regression protocol and separate prediction error into its ideal-test and test-variance contributions in § 2 . § 3 identifies the classical peak at informational completeness. Section IV analyzes the quantum peak at interpolation above informational completeness, including its training-shot and ridge dependence. The classical interpolation peak below informational completeness is treated separately in § 3.2 . We close with implications and open questions in section VI. For readability, theorem statements in the main text are informal; precise formulations and proofs are in the Supplemental Material.
Quantum linear regression and prediction error
In this section we set up the learning problem and isolate the contributions of training and test measurement statistics to the prediction error. This separation will let us identify the two thresholds characterizing the triple-descent phenomenon and the nature of the quantum and classical peaks. A schematic of the measurement protocol we consider is given in Figure 3 .
Figure 3. Learning protocol. Each training state ρ i \rho_i ρ i is measured N N N times with the POVM μ \mu μ , and the resulting outcome frequencies are used to train a linear least-squares regressor with weights w w w . The regressor then predicts the target value for a new test state σ \sigma σ from the outcome frequencies of M M M measurements of σ \sigma σ . For any w w w , the prediction y ^ \hat{y} y ^ averaged over test shot noise is Tr ( O ~ σ ) \operatorname{Tr}(\widetilde{O}\sigma) Tr ( O σ ) , with the effective observable O ~ = ∑ b w b μ b \widetilde{O} = \sum_b w_b\mu_b O = ∑ b w b μ b . When the training labels are y i = Tr ( O ρ i ) y_i = \operatorname{Tr}(O\rho_i) y i = Tr ( O ρ i ) and O ∈ span { μ b } O \in\operatorname{span}\{\mu_b\} O ∈ span { μ b } , which always holds for informationally complete POVMs, and the training states span the operator space, the learned weights give O ~ ≈ O \widetilde{O} \approx O O ≈ O for large N N N .
Quantum features and empirical regression
We consider d d d -dimensional states ρ \rho ρ measured with a fixed positive-operator-valued measure (POVM) μ = ( μ a ) a = 1 n o u t \mu= (\mu_a)_{a=1}^{n_{\rm out}} μ = ( μ a ) a = 1 n out with n o u t n_{\rm out} n out outcomes, where μ a ≥ 0 \mu_a \ge0 μ a ≥ 0 and ∑ a μ a = I d \sum_a \mu_a = I_d ∑ a μ a = I d . Here μ \mu μ is the effective POVM [6 ] , which accounts
for both the physical measurement and any quantum evolution applied before it. The outcome probabilities p ( ρ ) p(\rho) p ( ρ ) , with components p a ( ρ ) = Tr ( μ a ρ ) p_a(\rho) = \operatorname{Tr}(\mu_a\rho) p a ( ρ ) = Tr ( μ a ρ ) , serve as features for a classical linear model trained to predict the expectation value y ( ρ ) = Tr ( O ρ ) y(\rho) = \operatorname{Tr}(O\rho) y ( ρ ) = Tr ( O ρ ) of a Hermitian target observable O O O . We assume that the training labels are known exactly, so that finite statistics affect learning only through the features.
Rank constraint and informational completeness — For a training set of n t r n_{\rm tr} n tr states ρ = ( ρ i ) i = 1 n t r \rho= (\rho_i)_{i=1}^{n_{\rm tr}} ρ = ( ρ i ) i = 1 n tr , we collect the labels y i = y ( ρ i ) y_i = y(\rho_i) y i = y ( ρ i ) in the vector y y y and the exact probabilities in the matrix P ∈ R n o u t × n t r P \in\mathbb{R}^{n_{\rm out}\times n_{\rm tr}} P ∈ R n out × n tr , whose i i i -th column is p ( ρ i ) p(\rho_i) p ( ρ i ) . The probability matrix factorizes as
P = M μ T M ρ , rank P ≤ d 2 , (1) P = M_\mu^{T}M_\rho,\qquad\operatorname{rank} P \le d^2, \tag*{(1)} P = M μ T M ρ , rank P ≤ d 2 , (1)
where the columns of M μ ∈ R d 2 × n o u t M_\mu\in\mathbb{R}^{d^2\times n_{\rm out}} M μ ∈ R d 2 × n out and M ρ ∈ R d 2 × n t r M_\rho\in\mathbb{R}^{d^2\times n_{\rm tr}} M ρ ∈ R d 2 × n tr are the effects μ a \mu_a μ a and the states ρ i \rho_i ρ i , vectorized in an orthonormal basis of the d 2 d^2 d 2 -dimensional real vector space of Hermitian operators on C d \mathbb{C}^d C d ; this rank is bounded because all effects and states live in this d 2 d^2 d 2 -dimensional space. Unless stated otherwise, we assume that the training states span the space of Hermitian operators, which requires n t r ≥ d 2 n_{\mathrm{tr}} \ge d^2 n tr ≥ d 2 . The bound is then saturated, rank P = d 2 \operatorname{rank} P=d^2 rank P = d 2 , precisely when μ \mu μ is informationally complete, i.e., when its effects also span the space. For an informationally complete POVM, every target observable lies in span ( { μ b } ) \operatorname{span}(\{\mu_b\}) span ({ μ b }) and can therefore be reconstructed from the measurement data. For other POVMs, the components of O \mathcal{O} O outside span ( { μ b } ) \operatorname{span}(\{\mu_b\}) span ({ μ b }) are inaccessible: whenever such components are present, the prediction error remains nonzero even with unlimited training resources.
Finite-shot feature matrix — In an experiment, however, P P P is not directly available: its i i i -th column is estimated as n ^ i / N \hat{n}_i/N n ^ i / N , where the count vector n ^ i \hat{n}_i n ^ i records the outcomes of N N N measurements of ρ i \rho_i ρ i and is multinomially distributed,
n ^ i ∣ ρ i ∼ Mult ( N , p i ) , Σ i = diag p i − p i p i T , (2) \hat{n}_i \mid\rho_i \sim\operatorname{Mult}(N,p_i), \qquad\Sigma_i=\operatorname{diag}p_i-p_i p_i^{\mathsf{T}}, \tag*{(2)} n ^ i ∣ ρ i ∼ Mult ( N , p i ) , Σ i = diag p i − p i p i T , (2)
with p i = p ( ρ i ) p_i=p(\rho_i) p i = p ( ρ i ) , and Σ i \Sigma_i Σ i the single-shot covariance. We collect the observed frequencies in the empirical feature matrix P ^ N = [ n ^ 1 / N ⋯ n ^ n t r / N ] \hat{P}_N=[\hat{n}_1/N\ \cdots\ \hat{n}_{n_{\mathrm{tr}}}/N] P ^ N = [ n ^ 1 / N ⋯ n ^ n tr / N ] and write P ^ N = P + N − 1 / 2 Ξ ^ N \hat{P}_N=P+N^{-1/2}\hat{\Xi}_N P ^ N = P + N − 1/2 Ξ ^ N , which defines the normalized fluctuation matrix Ξ ^ N \hat{\Xi}_N Ξ ^ N . For fixed training states, the columns of Ξ ^ N \hat{\Xi}_N Ξ ^ N are independent, with zero mean and covariances Σ i \Sigma_i Σ i . The mean and covariance of Ξ ^ N \hat{\Xi}_N Ξ ^ N are thus independent of N N N , which enters the distribution of Ξ ^ N \hat{\Xi}_N Ξ ^ N only through higher-order cumulants that vanish as N → ∞ N\to\infty N → ∞ ; when only these first two moments matter, we thus drop the subscript and write Ξ ^ \hat{\Xi} Ξ ^ . Shot noise also changes the spectrum of the features: it adds singular directions absent from the exact features, with singular values of order N − 1 / 2 N^{-1/2} N − 1/2 , making P ^ N \hat{P}_N P ^ N full rank with high probability.
Least-squares and ridge estimators — Training the resulting classical model amounts to ordinary least squares with noisy features. The learner assigns a weight to each measurement outcome so as to minimize the training error ∥ P ^ N T w − y ∥ 2 \lVert\hat{P}_N^{\mathsf{T}}w-y\rVert^2 ∥ P ^ N T w − y ∥ 2 , and takes the minimum-norm solution via the Moore–Penrose pseudoinverse when the minimizer is not unique. The learned weights and the resulting prediction for a test state σ \sigma σ are
w ^ N = ( P ^ N T ) + y , y ^ = w ^ N T p ^ M ( σ ) , (3) \hat{w}_N=(\hat{P}_N^{\mathsf{T}})^+y,\qquad\hat{y}=\hat{w}_N^{\mathsf{T}}\hat{p}_M(\sigma), \tag*{(3)} w ^ N = ( P ^ N T ) + y , y ^ = w ^ N T p ^ M ( σ ) , (3)
where ( P ^ N T ) + (\hat{P}_N^{\mathsf{T}})^+ ( P ^ N T ) + is the Moore–Penrose pseudoinverse, which inverts all nonzero singular values of P ^ N T \hat{P}_N^{\mathsf{T}} P ^ N T , including the small ones generated by shot noise, and p ^ M ( σ ) \hat{p}_M(\sigma) p ^ M ( σ ) is the vector of outcome frequencies obtained from M M M measurements of σ \sigma σ . Thus N N N sets the precision of the training features and M M M that of the test features. We also consider regularization via ridge regression, which gives weights w ^ N , τ \hat{w}_{N,\tau} w ^ N , τ solving
min w [ n t r − 1 ∥ P ^ N T w − y ∥ 2 + τ ∥ w ∥ 2 ] . (4) \min_w\left[n_{\mathrm{tr}}^{-1}\lVert\hat{P}_N^{\mathsf{T}}w-y\rVert^2+\tau\lVert w\rVert^2\right]. \tag*{(4)} w min [ n tr − 1 ∥ P ^ N T w − y ∥ 2 + τ ∥ w ∥ 2 ] . (4)
Explicitly, this minimization has solution w ^ N , τ = ( P ^ N P ^ N T + n t r τ I o u t ) − 1 P ^ N y \hat{w}_{N,\tau}=(\hat{P}_N\hat{P}_N^{\mathsf{T}}+n_{\mathrm{tr}}\tau I_{\mathrm{out}})^{-1}\hat{P}_Ny w ^ N , τ = ( P ^ N P ^ N T + n tr τ I out ) − 1 P ^ N y . Ridge regression filters each singular value s s s of P ^ N \hat{P}_N P ^ N as s / ( s 2 + n t r τ ) s/(s^2+n_{\mathrm{tr}}\tau) s / ( s 2 + n tr τ ) instead of inverting it as 1 / s 1/s 1/ s , thus suppressing the contribution of singular values below n t r τ \sqrt{n_{\mathrm{tr}}\tau} n tr τ , and w ^ N , τ → w ^ N \hat{w}_{N,\tau}\to\hat{w}_N w ^ N , τ → w ^ N as τ → 0 + \tau\to0^+ τ → 0 + .
Prediction error and observable reconstruction
MSE decomposition averaging over test shot noise — We quantify the performance of the learned predictor by its mean squared error (MSE). For a fixed training record, a fixed target O \mathcal{O} O , and a fixed test state σ \sigma σ , averaging over the test shot noise gives
E y ^ [ ( y ^ − y σ ) 2 ] = E N ( σ , O ) + V N ( σ , O ) M , (5) \mathbb{E}_{\hat{y}}\left[(\hat{y}-y_\sigma)^2\right]=\mathcal{E}_N(\sigma,\mathcal{O})+\frac{V_N(\sigma,\mathcal{O})}{M}, \tag*{(5)} E y ^ [ ( y ^ − y σ ) 2 ] = E N ( σ , O ) + M V N ( σ , O ) , (5)
E N ( σ , O ) ≡ ( w ^ N T p σ − y σ ) 2 , V N ( σ , O ) ≡ w ^ N T Σ σ w ^ N , \mathcal{E}_N(\sigma,\mathcal{O})\equiv(\hat{w}_N^{\mathsf{T}}p_\sigma-y_\sigma)^2,\qquad V_N(\sigma,\mathcal{O})\equiv\hat{w}_N^{\mathsf{T}}\Sigma_\sigma\hat{w}_N, E N ( σ , O ) ≡ ( w ^ N T p σ − y σ ) 2 , V N ( σ , O ) ≡ w ^ N T Σ σ w ^ N ,
where p σ = p ( σ ) p_\sigma=p(\sigma) p σ = p ( σ ) , y σ = y ( σ ) y_\sigma=y(\sigma) y σ = y ( σ ) , and Σ σ = diag ( p σ ) − p σ p σ T \Sigma_\sigma=\operatorname{diag}(p_\sigma)-p_\sigma p_\sigma^{\mathsf{T}} Σ σ = diag ( p σ ) − p σ p σ T is the single-shot covariance of the test outcomes; the target enters through the training labels from which w ^ N \hat{w}_N w ^ N is learned. The first term, E N ( σ , O ) \mathcal{E}_N(\sigma,\mathcal{O}) E N ( σ , O ) , is the error that remains when the test probabilities are known exactly (M → ∞ M\to\infty M → ∞ ), which depends on N N N because w ^ N \hat{w}_N w ^ N was learned from noisy features. The second term is the additional error caused by amplification of shot noise at test, with V N ( σ , O ) V_N(\sigma,\mathcal{O}) V N ( σ , O ) the single-shot test variance. We call E \mathcal{E} E the ideal-test error and V V V the test variance , which measures how sensitive the learned predictor is to finite test statistics.
Averages over test states and targets — The arguments of E N \mathcal{E}_N E N and V N V_N V N list what is held fixed, and we drop an argument when averaging over it. Averaging over Haar-random pure test states gives E N ( O ) ≡ E σ [ E N ( σ , O ) ] \mathcal{E}_N(\mathcal{O})\equiv\mathbb{E}_{\sigma}[\mathcal{E}_N(\sigma,\mathcal{O})] E N ( O ) ≡ E σ [ E N ( σ , O )] and V N ( O ) ≡ E σ [ V N ( σ , O ) ] = w ^ N T Σ ‾ t e w ^ N V_N(\mathcal{O})\equiv\mathbb{E}_{\sigma}[V_N(\sigma,\mathcal{O})]=\hat{w}_N^{\mathsf{T}}\overline{\Sigma}_{\mathrm{te}}\hat{w}_N V N ( O ) ≡ E σ [ V N ( σ , O )] = w ^ N T Σ te w ^ N , with Σ ‾ t e ≡ E σ [ Σ σ ] \overline{\Sigma}_{\mathrm{te}}\equiv\mathbb{E}_{\sigma}[\Sigma_\sigma] Σ te ≡ E σ [ Σ σ ] , so that MSE N , M ( O ) ≡ E σ E y ^ [ ( y ^ − y σ ) 2 ] = E N ( O ) + V N ( O ) / M \operatorname{MSE}_{N,M}(\mathcal{O})\equiv\mathbb{E}_{\sigma}\mathbb{E}_{\hat{y}}[(\hat{y}-y_\sigma)^2]=\mathcal{E}_N(\mathcal{O})+V_N(\mathcal{O})/M MSE N , M ( O ) ≡ E σ E y ^ [( y ^ − y σ ) 2 ] = E N ( O ) + V N ( O ) / M . Averaging further over the random targets introduced below defines E N ≡ E O [ E N ( O ) ] \mathcal{E}_N\equiv\mathbb{E}_{\mathcal{O}}[\mathcal{E}_N(\mathcal{O})] E N ≡ E O [ E N ( O )] , V N ≡ E O [ V N ( O ) ] V_N\equiv\mathbb{E}_{\mathcal{O}}[V_N(\mathcal{O})] V N ≡ E O [ V N ( O )] , and MSE N , M ≡ E N + V N / M \operatorname{MSE}_{N,M}\equiv\mathcal{E}_N+V_N/M MSE N , M ≡ E N + V N / M . All these quantities still depend on the measurement, the training states, and the training record; averages over these are taken only where stated. Replacing w ^ N \hat{w}_N w ^ N with w ^ N , τ \hat{w}_{N,\tau} w ^ N , τ gives the ridge counterparts E N , τ \mathcal{E}_{N,\tau} E N , τ , V N , τ V_{N,\tau} V N , τ , and MSE N , M , τ \operatorname{MSE}_{N,M,\tau} MSE N , M , τ , with the same arguments.
Ideal-test error and the reconstructed observable — Averaging over the test shot noise gives E y ^ [ y ^ ] = w ^ N T p σ = Tr ( O ~ N σ ) \mathbb{E}_{\hat{y}}[\hat{y}]=\hat{w}_N^{\mathsf{T}}p_\sigma=\operatorname{Tr}(\widetilde{\mathcal{O}}_N\sigma) E y ^ [ y ^ ] = w ^ N T p σ = Tr ( O N σ ) , where O ~ N = ∑ b ( w ^ N ) b μ b \widetilde{\mathcal{O}}_N=\sum_b(\hat{w}_N)_b\mu_b O N = ∑ b ( w ^ N ) b μ b is the observable reconstructed by the learned (noisy) weights w ^ N \hat{w}_N w ^ N ; for a general w w w , we write O ~ w = ∑ b w b μ b \widetilde{\mathcal{O}}_w=\sum_b w_b\mu_b O w = ∑ b w b μ b . Denoting by A 0 ≡ A − ( Tr ( A ) / d ) I d A_0\equiv A-(\operatorname{Tr}(A)/d)I_d A 0 ≡ A − ( Tr ( A ) / d ) I d the traceless part of an operator A A A , the Haar average over test states gives (lemma A1)
E N ( O ) = Tr [ ( O ~ N − O ) 0 2 ] d ( d + 1 ) + [ Tr ( O ~ N − O ) d ] 2 . (6) \mathcal{E}_N(\mathcal{O})=\frac{\operatorname{Tr}[(\widetilde{\mathcal{O}}_N-\mathcal{O})_0^2]}{d(d+1)}+\left[\frac{\operatorname{Tr}(\widetilde{\mathcal{O}}_N-\mathcal{O})}{d}\right]^2. \tag*{(6)} E N ( O ) = d ( d + 1 ) Tr [( O N − O ) 0 2 ] + [ d Tr ( O N − O ) ] 2 . (6)
The first term is the squared Hilbert–Schmidt error of the state-dependent part of the reconstruction. The factor 1 / [ d ( d + 1 ) ] 1/[d(d+1)] 1/ [ d ( d + 1 )] is the variance of Tr ( A σ ) \operatorname{Tr}(A\sigma) Tr ( A σ ) over Haar-random σ \sigma σ for any traceless A A A with Tr ( A 2 ) = 1 \operatorname{Tr}(A^2)=1 Tr ( A 2 ) = 1 , i.e., the typical size of the state-to-state variations of an expectation value. Thus E N ( O ) \mathcal{E}_N(\mathcal{O}) E N ( O ) vanishes only when the learned weights reproduce the target exactly, O ~ N = O \widetilde{\mathcal{O}}_N=\mathcal{O} O N = O , which is impossible when O ∉ span ( { μ b } ) \mathcal{O}\notin\operatorname{span}(\{\mu_b\}) O ∈ / span ({ μ b }) .
Reference coefficients — We compare the learned weights with the minimum-norm reconstruction coefficients w e x ≡ M μ + v O w_{\rm ex}\equiv M_\mu^{+}v_{\mathcal{O}} w ex ≡ M μ + v O , where v O v_{\mathcal{O}} v O is the vectorization of O \mathcal{O} O in the basis of eq. (1) . Their effective observable O ~ w e x \widetilde{\mathcal{O}}_{w_{\rm ex}} O w ex is the Hilbert–Schmidt projection of O \mathcal{O} O onto span ( { μ b } ) \operatorname{span}(\{\mu_b\}) span ({ μ b }) , i.e., O \mathcal{O} O itself for an informationally complete POVM, and they are the weights that least squares returns from exact training probabilities when the POVM is informationally complete and the training states span the operator space (§ 3 A). Replacing w ^ N \widehat{w}_N w N with w e x w_{\rm ex} w ex in eq. (5) defines the reference test variance V e x ( σ , O ) V_{\rm ex}(\sigma,\mathcal{O}) V ex ( σ , O ) and its averages V e x ( O ) V_{\rm ex}(\mathcal{O}) V ex ( O ) and V e x V_{\rm ex} V ex .
Target averaging and normalization — Finally, to describe a typical target rather than a specific one, we average over the unitarily rotated targets U † O U U^\dagger\mathcal{O}U U † O U , with U U U a Haar-random unitary independent of the measurement and of the training data. As anticipated, these target averages are denoted by dropping the argument O \mathcal{O} O , e.g., V N = E U [ V N ( U † O U ) ] V_N=\mathbb{E}_U[V_N(U^\dagger\mathcal{O}U)] V N = E U [ V N ( U † O U )] ; they depend on O \mathcal{O} O only through its spectrum. Decomposing O = ( Tr ( O ) / d ) I d + O 0 \mathcal{O}=(\operatorname{Tr}(\mathcal{O})/d)I_d+\mathcal{O}_0 O = ( Tr ( O ) / d ) I d + O 0 , we observe that only the traceless part O 0 \mathcal{O}_0 O 0 distinguishes input states, and its size can be quantified by
Δ O 2 = Tr ( O 0 2 ) / d = Tr ( O 2 ) / d − ( Tr ( O ) / d ) 2 , (7) \Delta_{\mathcal{O}}^2=\operatorname{Tr}(\mathcal{O}_0^2)/d=\operatorname{Tr}(\mathcal{O}^2)/d-(\operatorname{Tr}(\mathcal{O})/d)^2, \tag*{(7)} Δ O 2 = Tr ( O 0 2 ) / d = Tr ( O 2 ) / d − ( Tr ( O ) / d ) 2 , (7)
which equals the variance of the eigenvalues of O \mathcal{O} O (equivalently, of O \mathcal{O} O in the maximally mixed state). Note that Δ O 2 > 0 \Delta_{\mathcal{O}}^2>0 Δ O 2 > 0 iff O \mathcal{O} O is not a multiple of the identity and thus represents a nontrivial target; we will assume throughout the rest of the paper that this is the case. The rotation leaves the identity component unchanged, whereas the rotated traceless part U † O 0 U U^\dagger\mathcal{O}_0U U † O 0 U has zero mean and a second moment proportional to the identity on traceless operators (eq. (32) ), so that no operator direction is preferred. Since w ^ N \widehat{w}_N w N is linear in y y y , and hence in O \mathcal{O} O , both E N ( O ) \mathcal{E}_N(\mathcal{O}) E N ( O ) and V N ( O ) V_N(\mathcal{O}) V N ( O ) are quadratic in the target, and their target averages are linear combinations of d Δ O 2 d\Delta_{\mathcal{O}}^2 d Δ O 2 and ( Tr ( O ) / d ) 2 (\operatorname{Tr}(\mathcal{O})/d)^2 ( Tr ( O ) / d ) 2 with coefficients set by the measurement and the training data. We therefore report the normalized averages V N / ( d Δ O 2 ) V_N/(d\Delta_{\mathcal{O}}^2) V N / ( d Δ O 2 ) and d ( d + 1 ) E N / ( d Δ O 2 ) d(d+1)\mathcal{E}_N/(d\Delta_{\mathcal{O}}^2) d ( d + 1 ) E N / ( d Δ O 2 ) , which do not depend on the scale of the target. By eq. (6) , the second is the mean squared Hilbert–Schmidt error of the reconstructed state-dependent part relative to Tr ( O 0 2 ) \operatorname{Tr}(\mathcal{O}_0^2) Tr ( O 0 2 ) , plus the contribution of the identity component; it equals one for the trivial predictor that assigns the constant value Tr ( O ) / d \operatorname{Tr}(\mathcal{O})/d Tr ( O ) / d to every input. The same averages hold for any random target, drawn independently of the measurement and training data, whose traceless part has these two moments (definition 1), such as a target drawn uniformly from the unit sphere of traceless operators. Unless stated otherwise, our simulations draw one such target per realization, so that d Δ O 2 = Tr ( O 2 ) = 1 d\Delta_{\mathcal{O}}^2=\operatorname{Tr}(\mathcal{O}^2)=1 d Δ O 2 = Tr ( O 2 ) = 1 , and report the realized costs V N ( O ) V_N(\mathcal{O}) V N ( O ) and E N ( O ) \mathcal{E}_N(\mathcal{O}) E N ( O ) ; at large d d d and fixed ridge parameter, these concentrate around their target averages (lemma D9).
Classical peak at informational completeness
The first instability occurs at informational completeness, n o u t = d 2 n_{\rm out}=d^2 n out = d 2 , persists even with exact training probabilities, and is caused by a property of the measurement itself: near this threshold, the POVM frame operator has small positive eigenvalues with high probability; this causes a blow up in the learned exact weights, which strongly amplify shot noise at inference.
In § 3 A we show why weakly resolved operator directions cause large reconstruction weights. In § 3 B we determine when these directions occur for random POVMs. We combine these two ingredients in § 3 C to derive the classical variance peak and interpret its finite-dimensional behavior. Finally, in § 3 D we return to regression on finite training data and explain when shot noise suppresses the peak rather than amplifying it.
Prediction variance and the POVM frame
Training with exact features — We start from the idealized case where training features, i.e. the elements of the probability matrix P P P , are known exactly. In this scenario the learner has perfect knowledge of how the effective measurement interacts with the training states. With labels y i = Tr ( O ρ i ) y_i=\operatorname{Tr}(\mathcal{O}\rho_i) y i = Tr ( O ρ i ) , i.e., y = M ρ T v O y=M_\rho^Tv_{\mathcal{O}} y = M ρ T v O , least squares returns ( P T ) + y (P^T)^+y ( P T ) + y . When the POVM is informationally complete and the training states span the operator space, both M μ M_\mu M μ and M ρ M_\rho M ρ have rank d 2 d^2 d 2 , and eq. (1) gives (corollary C1)
( P T ) + y = M μ + v O = w e x . (8) (P^T)^+y=M_\mu^+v_{\mathcal{O}}=w_{\rm ex}. \tag*{(8)} ( P T ) + y = M μ + v O = w ex . (8)
The reconstruction is then exact, O ~ w e x = O \widetilde{\mathcal{O}}_{w_{\rm ex}}=\mathcal{O} O w ex = O [6 ] , and the error vanishes if the test probabilities are also known exactly. Below informational completeness, ( P T ) + y (P^T)^+y ( P T ) + y generally differs from w e x w_{\rm ex} w ex for a finite training set, but approaches it for large Haar training sets (§ 3 D); we therefore use w e x w_{\rm ex} w ex , which reconstructs the projection of O \mathcal{O} O onto the span of the effects, in both regimes. Even with exact training features, however, the weights w e x , a w_{{\rm ex},a} w ex , a can be large, so that their test variance V e x ( σ , O ) V_{\rm ex}(\sigma,\mathcal{O}) V ex ( σ , O ) strongly amplifies shot noise at inference.
Weakly resolved measurement directions — The size of these coefficients is controlled by the POVM frame operator F μ = M μ M μ T F_\mu= M_\mu M_\mu^{T} F μ = M μ M μ T , which acts on operators as F μ ( A ) = ∑ a Tr ( μ a A ) μ a F_\mu(A) = \sum_a \operatorname{Tr}(\mu_a A)\mu_a F μ ( A ) = ∑ a Tr ( μ a A ) μ a . The quadratic form induced by this operator has a direct operational meaning: for a Hermitian A A A with vectorization v A v_A v A , v A T F μ v A = Tr [ A F μ ( A ) ] = ∑ a [ Tr ( μ a A ) ] 2 v_A^{T}F_\mu v_A = \operatorname{Tr}[A F_\mu(A)] = \sum_a [\operatorname{Tr}(\mu_a A)]^2 v A T F μ v A = Tr [ A F μ ( A )] = ∑ a [ Tr ( μ a A ) ] 2 . If a state is shifted along a traceless direction, ρ → ρ + ϵ A \rho\to\rho+ \epsilon A ρ → ρ + ϵ A , the outcome probabilities change by δ p a = ϵ Tr ( μ a A ) \delta p_a = \epsilon\operatorname{Tr}(\mu_a A) δ p a = ϵ Tr ( μ a A ) , so this quadratic form equals the squared change of the outcome distribution per unit shift. In particular, if Tr ( A 2 ) = 1 \operatorname{Tr}(A^2) = 1 Tr ( A 2 ) = 1 and F μ ( A ) = λ A F_\mu(A) = \lambda A F μ ( A ) = λ A , the outcome distribution moves only by ϵ λ \epsilon\sqrt{\lambda} ϵ λ . A small eigenvalue λ \lambda λ therefore marks an operator direction that the measurement barely resolves: states that differ along it produce nearly identical statistics. Reconstructing an observable along such a direction requires correspondingly large coefficients, since the minimum-norm coefficients satisfy ∥ M μ + v A ∥ 2 = v A T F μ + v A = 1 / λ \lVert M_\mu^{+}v_A\rVert^2 = v_A^{T}F_\mu^{+}v_A = 1/\lambda ∥ M μ + v A ∥ 2 = v A T F μ + v A = 1/ λ . Large coefficients in turn amplify the statistical fluctuations of the test frequencies, so the test variance is governed by the inverse eigenvalues of F μ F_\mu F μ ; specifically, by the largest eigenvalue, ∥ F μ + ∥ \lVert F_\mu^{+}\rVert ∥ F μ + ∥ , for the worst-case target, and by their average, Tr ( F μ + ) \operatorname{Tr}(F_\mu^{+}) Tr ( F μ + ) , for a typical one [27 ] . For effects of equal trace, Tr ( μ a ) = d / n o u t \operatorname{Tr}(\mu_a) = d/n_{\mathrm{out}} Tr ( μ a ) = d / n out , this connection is exact. By eq. (34) , every weight vector that reconstructs the target of an informationally complete POVM, O ~ w = O \widetilde{O}_w = O O w = O , has Haar-averaged test variance ∥ w ∥ 2 / n o u t − [ Tr ( O 2 ) + ( Tr O ) 2 ] / [ d ( d + 1 ) ] \lVert w\rVert^2/n_{\mathrm{out}} - [\operatorname{Tr}(O^2) + (\operatorname{Tr}O)^2]/[d(d+1)] ∥ w ∥ 2 / n out − [ Tr ( O 2 ) + ( Tr O ) 2 ] / [ d ( d + 1 )] , because the remaining terms of Σ ‾ t e \overline{\Sigma}_{\mathrm{te}} Σ te depend on w w w only through O ~ w \widetilde{O}_w O w . The minimum-norm coefficients w e x w_{\mathrm{ex}} w ex therefore also minimize the test variance among all unbiased linear readouts [27 ] . Averaging ∥ w e x ∥ 2 = v O T F μ + v O \lVert w_{\mathrm{ex}}\rVert^2 = v_O^{T}F_\mu^{+}v_O ∥ w ex ∥ 2 = v O T F μ + v O over the random targets of § 2 B gives, for equal effect traces and with or without informational completeness (eq. (68) ),
V e x d Δ 0 2 = Tr ( F μ + ) n o u t ( d 2 − 1 ) + O ( d − 2 ) . (9) \frac{V_{\mathrm{ex}}}{d\Delta_0^2} = \frac{\operatorname{Tr}(F_\mu^{+})}{n_{\mathrm{out}}(d^2-1)} + O(d^{-2}). \tag*{(9)} d Δ 0 2 V ex = n out ( d 2 − 1 ) Tr ( F μ + ) + O ( d − 2 ) . (9)
For random POVMs, whose effect traces are only approximately equal, the same relation holds up to relative corrections that vanish as d → ∞ d \to\infty d → ∞ (theorem C1).
Spectrum of a random POVM
To describe the frame spectrum of a typical measurement, we consider Haar rank-one POVMs. Their effects are μ a = v a v a † \mu_a = v_a v_a^\dagger μ a = v a v a † , where the v a v_a v a are the rows of a Haar-random isometry V μ ∈ C n o u t × d V_\mu\in\mathbb{C}^{n_{\mathrm{out}}\times d} V μ ∈ C n out × d [34 ] . The isometry condition guarantees ∑ a μ a = I \sum_a \mu_a = I ∑ a μ a = I , but also makes the effects mutually dependent, so it is not obvious that the frame behaves like a standard random covariance matrix. The following result shows that, asymptotically, it does.
Theorem 1 (Spectrum of random POVM (informal)). Consider a normalized Haar rank-one POVM with n o u t n_{\mathrm{out}} n out outcomes on a d d d -dimensional Hilbert space. In the limit d → ∞ d \to\infty d → ∞ with d 2 / n o u t → γ C ∈ ( 0 , ∞ ) d^2/n_{\mathrm{out}} \to\gamma_C \in(0,\infty) d 2 / n out → γ C ∈ ( 0 , ∞ ) , the empirical eigenvalue distribution of the rescaled frame n o u t F μ n_{\mathrm{out}}F_\mu n out F μ converges in probability to the Marchenko–Pastur law with aspect ratio γ C \gamma_C γ C , whose continuous part is supported between
x ± = ( 1 ± γ C ) 2 . (10) x_{\pm} = (1 \pm\sqrt{\gamma_C})^2. \tag*{(10)} x ± = ( 1 ± γ C ) 2 . (10) For n o u t < d 2 n_{\mathrm{out}} < d^2 n out < d 2 , the frame also has d 2 − n o u t d^2-n_{\mathrm{out}} d 2 − n out exact zero eigenvalues, corresponding to inaccessible operator directions. A single further eigenvalue, asymptotically associated with the identity, lies on a parametrically larger scale than the bulk.
Informational completeness and the spectral gap — The precise statement and proof are given in theorem B1 and corollary B1. Theorem 1 identifies informational completeness as a critical point of the measurement spectrum. For n o u t < d 2 n_{\mathrm{out}} < d^2 n out < d 2 the POVM cannot reconstruct every observable, and the frame has exact zero modes. As n o u t → d 2 n_{\mathrm{out}} \to d^2 n out → d 2 , the lower edge x − x_- x − of the nonzero spectrum also approaches zero, and at n o u t = d 2 n_{\mathrm{out}} = d^2 n out = d 2 it reaches the origin, so that some operator directions are resolved arbitrarily weakly. For n o u t > d 2 n_{\mathrm{out}} > d^2 n out > d 2 a spectral gap opens, and each additional outcome improves the conditioning.
Numerical spectrum and identity outlier — Figure 4 shows that the Marchenko–Pastur law already describes random POVMs at moderate dimension, both below and above informational completeness. The insets show the isolated eigenvalue associated with the identity, well separated from the bulk. This outlier plays no role in the instability: since ∑ a μ a = I \sum_a \mu_a = I ∑ a μ a = I , the identity component of a target can be reconstructed by uniform outcome weights, whose prediction does not depend on the state and is therefore not affected by test shot noise. What matters is the lower edge of the spectrum.
Figure 4. Spectral shape of the measurement frame operator. Eigenvalues x = n o u t λ x=n_{\rm out}\lambda x = n out λ of the rescaled frame operator n o u t F μ n_{\rm out}F_{\mu} n out F μ , restricted to the subspace of traceless Hermitian operators, for normalized Haar rank-one POVMs (§ 3 B) with d 2 = 256 d^2=256 d 2 = 256 and n o u t = 128 , 256 , 512 n_{\rm out}=128,256,512 n out = 128 , 256 , 512 . Each panel aggregates 64 independent POVMs. Dashed curves show the limiting Marchenko–Pastur density at γ C = d 2 / n o u t \gamma_{\mathrm C}=d^2/n_{\rm out} γ C = d 2 / n out (theorem 1). For n o u t < d 2 n_{\rm out}<d^2 n out < d 2 , exact zero eigenvalues are omitted without renormalizing the positive weights; w 0 = max ( d 2 − n o u t , 0 ) / d 2 w_0=\max(d^2-n_{\rm out},0)/d^2 w 0 = max ( d 2 − n out , 0 ) / d 2 is the fraction of zero eigenvalues. Insets show the largest eigenvalue of the full rescaled frame, compared with its asymptotic value d + 1 d+1 d + 1 (corollary B1); the corresponding eigenvector is asymptotically the identity.
Classical variance peak
Here we combine the relation between the POVM frame and test variance from § 3 A with the random-POVM spectrum of § 3 B. Our aim is to predict how the classical peak depends on the number of measurement outcomes, and to distinguish the asymptotic divergence from the finite peak observed in numerical experiments.
Why small frame eigenvalues dominate — With exact training probabilities, eq. (9) expresses the target-averaged test variance through the inverse of the POVM frame operator. Writing x = n o u t λ x = n_{\mathrm{out}}\lambda x = n out λ for an eigenvalue λ \lambda λ of the frame, the identity F μ + = n o u t ( n o u t F μ ) + F_\mu^{+} = n_{\mathrm{out}}(n_{\mathrm{out}}F_\mu)^{+} F μ + = n out ( n out F μ ) + shows that the normalized variance is, to leading order, the sum of 1 / x 1/x 1/ x over the positive rescaled eigenvalues, divided by d 2 − 1 d^2-1 d 2 − 1 . The inverse gives greatest weight to the operator directions that the POVM resolves most weakly: reconstructing a target along such a direction requires large outcome weights, which in turn amplify fluctuations in the test frequencies. Exact zero eigenvalues do not contribute to this sum, because the pseudoinverse discards them. Below informational completeness, the corresponding inaccessible target components instead contribute to the ideal-test error defined in eq. (5) .
For Haar-random POVMs, theorem 1 gives a Marchenko–Pastur spectrum with aspect ratio γ C = d 2 / n o u t \gamma_{\mathrm C}=d^2/n_{\rm out} γ C = d 2 / n out . As n o u t n_{\rm out} n out approaches d 2 d^2 d 2 from either side, the smallest positive frame eigenvalues approach zero. At γ C = 1 \gamma_{\mathrm C}=1 γ C = 1 the spectral density behaves as x − 1 / 2 x^{-1/2} x − 1/2 near the origin, so its inverse-eigenvalue average becomes unbounded in the large-d d d limit. The resulting instability is already present in the measurement frame, without any noise in the training features.
Theorem 2 (Classical test-variance peak (informal)). Consider the random POVM ensemble of theorem 1 and the minimum-norm reconstruction, with perfect device knowledge, of a target observable with Δ O 2 > 0 \Delta_O^2>0 Δ O 2 > 0 and bounded ∣ Tr ( O ) ∣ / ( d Δ O 2 ) |\operatorname{Tr}(O)|/(d\sqrt{\Delta_O^2}) ∣ Tr ( O ) ∣/ ( d Δ O 2 ) . In the limit d → ∞ d\to\infty d → ∞ with d 2 / n o u t → γ C ∈ ( 0 , ∞ ) d^2/n_{\rm out}\to\gamma_{\mathrm C}\in(0,\infty) d 2 / n out → γ C ∈ ( 0 , ∞ ) , the normalized test variance, averaged over Haar test states and unitary rotations of the target, converges in probability to
V e x d Δ O 2 ⟶ P min { 1 , γ C − 1 } ∣ 1 − γ C ∣ , γ C ≠ 1. (11) \frac{V_{\mathrm{ex}}}{d\Delta_O^2}\overset{\mathbb{P}}{\longrightarrow}\frac{\min\{1,\gamma_{\mathrm C}^{-1}\}}{|1-\gamma_{\mathrm C}|},\qquad\gamma_{\mathrm C}\ne1. \tag*{(11)} d Δ O 2 V ex ⟶ P ∣1 − γ C ∣ min { 1 , γ C − 1 } , γ C = 1. (11)
At γ C = 1 \gamma_{\mathrm C}=1 γ C = 1 , i.e. n o u t = d 2 n_{\rm out}=d^2 n out = d 2 , the normalized variance diverges in probability.
Classical double-descent profile — Theorem 2 makes this mechanism quantitative. For n o u t < d 2 n_{\rm out}<d^2 n out < d 2 (γ C > 1 \gamma_{\mathrm C}>1 γ C > 1 ), only a fraction of operator directions is accessible and the exact zero modes are omitted from the variance; the missing target components nevertheless leave an ideal-test error. As n o u t n_{\rm out} n out increases toward d 2 d^2 d 2 , the smallest nonzero frame eigenvalues shrink, and the normalized variance grows as 1 / ∣ 1 − γ C ∣ 1/|1-\gamma_{\mathrm C}| 1/∣1 − γ C ∣ , with the prefactor specified in eq. (11) . For n o u t > d 2 n_{\rm out}>d^2 n out > d 2 (γ C < 1 \gamma_{\mathrm C}<1 γ C < 1 ), all operator directions are accessible and additional outcomes open a spectral gap, reducing the variance again. The classical double-descent peak thus measures the difficulty of reconstructing an observable from a nearly informationally complete measurement, not the difficulty of estimating its training probabilities.
The theorem concerns the minimum-norm coefficients obtained from the POVM itself, before introducing finite training-shot noise. Its bound on the trace of the target prevents a growing state-independent component from dominating the normalization; such a component is reconstructed by nearly uniform outcome weights and does not cause the peak (§ 3 B). The precise control of small frame eigenvalues used to establish eq. (11) is given in theorem C1.
Finite-dimensional peak — The divergence at γ C = 1 \gamma_{\mathrm C}=1 γ C = 1 refers to the limit d → ∞ d\to\infty d → ∞ with d 2 / n o u t → 1 d^2/n_{\rm out}\to1 d 2 / n out → 1 . At any fixed dimension, each informationally complete POVM has finite test variance, but a few exceptionally small positive eigenvalues can make it very large. Their values fluctuate substantially between random POVMs, so the finite-dimensional peak has a broad distribution even though its typical height remains finite. We therefore compare the asymptotic curve with sample medians and percentile bands in Figure 5 , rather than relying on averages that are sensitive to nearly singular realizations. The large-N N N results already reflect the predicted peak at d = 8 d=8 d = 8 . The progressive suppression of the peak at lower training-shot budgets is the subject of the next subsection.
Figure 5. Classical variance peak and its suppression by finite training statistics. Realized test variance V N ( O ) V_N(\mathcal{O}) V N ( O ) at d = 8 d=8 d = 8 and n t r = 512 n_{\mathrm{tr}}=512 n tr = 512 . Colored curves correspond to multinomial training records with N = 16 , 256 , 2048 , 10 4 , 10 8 N=16, 256, 2048, 10^4, 10^8 N = 16 , 256 , 2048 , 1 0 4 , 1 0 8 shots, with darker blue for larger N N N . Each point aggregates 192 independent realizations of the normalized Haar rank-one POVM, Haar training ensemble, traceless unit-sphere target, and training record. Markers and curves show medians; shading shows pointwise 10th–90th percentiles. The N = 10 8 N=10^8 N = 1 0 8 median is drawn with markers only, to distinguish it from the theory. The black dashed curve is the asymptotic prediction of eq. (11) at d Δ O 2 = 1 d\Delta_{\mathcal{O}}^2=1 d Δ O 2 = 1 , which diverges at n o u t = d 2 = 64 n_{\mathrm{out}}=d^2=64 n out = d 2 = 64 (vertical line). Records for which P ^ N \hat{P}_N P ^ N is rank deficient, e.g. because some outcome is never observed, are retained; test states are averaged analytically.
Finite training data and noise-induced regularization
So far, the coefficients have been obtained from exact knowledge of the measurement apparatus. We now ask how finite training resources affect the classical peak: first, which coefficients regression on exact training probabilities returns; then, how training-shot noise changes the least-squares problem.
What exact-feature regression reconstructs — With exact training probabilities, an informationally complete POVM and training states spanning the operator space give O ~ w e x = O \widetilde{\mathcal{O}}_{\mathrm{w}_{\mathrm{ex}}}=\mathcal{O} O w ex = O (eq. (8) ): the labels determine the target observable without reconstruction error. Below informational completeness, instead, only the component
of O \mathcal{O} O in the span of the POVM effects can be reconstructed. Write O = O ∥ + O ⊥ \mathcal{O}=\mathcal{O}_{\parallel}+\mathcal{O}_{\perp} O = O ∥ + O ⊥ , where O ∥ = ∑ a w e x , a μ a \mathcal{O}_{\parallel}=\sum_a w_{\mathrm{ex},a}\mu_a O ∥ = ∑ a w ex , a μ a is the Hilbert–Schmidt projection onto that span, with the minimum-norm coefficients w e x w_{\mathrm{ex}} w ex of § 2 B, and O ⊥ \mathcal{O}_{\perp} O ⊥ is orthogonal to every effect. Because the POVM effects sum to I d I_d I d , the inaccessible part is traceless: Tr ( O ⊥ ) = 0 \operatorname{Tr}(\mathcal{O}_{\perp})=0 Tr ( O ⊥ ) = 0 .
To see why a large Haar training ensemble selects O ∥ \mathcal{O}_{\parallel} O ∥ , consider any observable A A A in the POVM span and put D = O − A D=\mathcal{O}-A D = O − A . For a Haar-random pure training state ρ \rho ρ , the second-moment identity (lemma A1) gives
E ρ [ Tr ( D ρ ) 2 ] = Tr ( D 2 ) + [ Tr ( D ) ] 2 d ( d + 1 ) . (12) \mathbb{E}_{\rho}\left[\operatorname{Tr}(D\rho)^2\right]=\frac{\operatorname{Tr}(D^2)+\left[\operatorname{Tr}(D)\right]^2}{d(d+1)}. \tag*{(12)} E ρ [ Tr ( D ρ ) 2 ] = d ( d + 1 ) Tr ( D 2 ) + [ Tr ( D ) ] 2 . (12)
The difference A − O ∥ A-\mathcal{O}_{\parallel} A − O ∥ lies in the POVM span and is therefore Hilbert–Schmidt orthogonal to O ⊥ \mathcal{O}_{\perp} O ⊥ . The squared error in eq. (12) consequently equals the unavoidable contribution from O ⊥ \mathcal{O}_{\perp} O ⊥ plus a nonnegative contribution from A − O ∥ A-\mathcal{O}_{\parallel} A − O ∥ , minimized at A = O ∥ A=\mathcal{O}_{\parallel} A = O ∥ . Among coefficient vectors producing that observable, the pseudoinverse chooses w e x w_{\mathrm{ex}} w ex with minimum norm.
For a finite Haar training set the same orthogonality need not hold after summing over the particular sampled states. An accessible operator A A A and an inaccessible one B B B satisfy Tr ( A B ) = 0 \operatorname{Tr}(AB)=0 Tr ( A B ) = 0 and E ρ [ Tr ( A ρ ) Tr ( B ρ ) ] = 0 \mathbb{E}_{\rho}[\operatorname{Tr}(A\rho)\operatorname{Tr}(B\rho)]=0 E ρ [ Tr ( A ρ ) Tr ( B ρ )] = 0 , but the sample sum ∑ i Tr ( A ρ i ) Tr ( B ρ i ) \sum_i\operatorname{Tr}(A\rho_i)\operatorname{Tr}(B\rho_i) ∑ i Tr ( A ρ i ) Tr ( B ρ i ) is generally nonzero. Least squares can exploit this accidental overlap by changing the accessible observable to reproduce part of the inaccessible labels on the training states. Such a change can reduce the training error while increasing the mean squared error on independently sampled Haar test states. For Haar training ensembles these sample overlaps become negligible in the regime d 2 log d / n t r → 0 d^2\log d/n_{\mathrm{tr}}\to0 d 2 log d / n tr → 0 , under the assumptions of corollary C1; the fitted variance then approaches the frame-based variance of § 3 A.
Finite shots suppress the classical peak — With N N N shots per training state, least squares uses P ^ N \hat{P}_N P ^ N rather than the exact matrix P P P . Figure 5 shows that large N N N gives a sharp variance peak near n o u t = d 2 n_{\mathrm{out}}=d^2 n out = d 2 , whereas reducing N N N progressively flattens it. The reason is that the learned weights act on noisy frequencies both at training and at test. Reconstructing a target component along a weakly resolved operator direction requires large weights (§ 3 A), and these make the prediction for a test state fluctuate with variance V ( σ , O ) / M V(\sigma,\mathcal{O})/M V ( σ , O ) / M . On each training state, the same weights make the prediction w T n ^ i / N w^T\hat{n}_i/N w T n ^ i / N fluctuate around its exact value with variance w T Σ i w / N w^T\Sigma_iw/N w T Σ i w / N . When there are many more training states than outcomes, the weights cannot follow these fluctuations, and since the labels are exact, the fluctuations add to the training error. Least squares therefore trades reconstruction accuracy against weight size, and shrinks the weights along directions whose variation across training states is weaker than their sampling noise. These are precisely the directions responsible for the classical peak.
The shot-averaged training loss — To make this trade-off precise, fix the training states and their exact labels, and consider any weight vector w w w that does not depend on the measured counts. We denote by E n ^ \mathbb{E}_{\hat{n}} E n ^ the average over the multinomial count records n ^ 1 , … , n ^ n t r \hat{n}_1,\ldots,\hat{n}_{n_{\mathrm{tr}}} n ^ 1 , … , n ^ n tr of eq. (2) , with the training states held fixed. On state ρ i \rho_i ρ i , the predicted label w T n ^ i / N w^{T}\hat{n}_i/N w T n ^ i / N has mean w T p i w^{T}p_i w T p i and variance w T Σ i w / N w^{T}\Sigma_iw/N w T Σ i w / N , so its mean squared deviation from y i y_i y i is the squared bias ( w T p i − y i ) 2 (w^{T}p_i-y_i)^2 ( w T p i − y i ) 2 plus this variance. Averaging over the training set the loss that enters eq. (4) therefore gives the exact identity (lemma C2)
1 n t r E n ^ [ ∥ P ^ N T w − y ∥ 2 ] = 1 n t r ∥ P T w − y ∥ 2 + w T Σ ‾ t r w N , (13) \frac{1}{n_{\mathrm{tr}}}\mathbb{E}_{\hat{n}}\left[\left\|\widehat{P}_{N}^{T}w-y\right\|^{2}\right]=\frac{1}{n_{\mathrm{tr}}}\left\|P^{T}w-y\right\|^{2}+\frac{w^{T}\overline{\Sigma}_{\mathrm{tr}}w}{N}, \tag*{(13)} n tr 1 E n ^ [ P N T w − y 2 ] = n tr 1 P T w − y 2 + N w T Σ tr w , (13)
where Σ ‾ t r ≡ n t r − 1 ∑ i Σ i \overline{\Sigma}_{\mathrm{tr}}\equiv n_{\mathrm{tr}}^{-1}\sum_i\Sigma_i Σ tr ≡ n tr − 1 ∑ i Σ i is the single-shot covariance averaged over the training states. The first term is the loss obtained with exact features. The second measures the shot noise that the weights feed into the training predictions. Only the counts are averaged: the training states are the given ones, not samples from an ensemble.
Averaged objective and fitted weights — Least squares minimizes the loss of the record actually observed, not the average in eq. (13) , which holds for a fixed w w w . The two are related through the normal equations P ^ N P ^ N T w = P ^ N y \widehat{P}_{N}\widehat{P}_{N}^{T}w=\widehat{P}_{N}y P N P N T w = P N y satisfied by the fitted weights. Their coefficient matrices have shot averages E n ^ [ P ^ N P ^ N T ] / n t r = P P T / n t r + Σ ‾ t r / N \mathbb{E}_{\hat{n}}[\widehat{P}_{N}\widehat{P}_{N}^{T}]/n_{\mathrm{tr}}=PP^{T}/n_{\mathrm{tr}}+\overline{\Sigma}_{\mathrm{tr}}/N E n ^ [ P N P N T ] / n tr = P P T / n tr + Σ tr / N and E n ^ [ P ^ N y ] = P y \mathbb{E}_{\hat{n}}[\widehat{P}_{N}y]=Py E n ^ [ P N y ] = P y , which are exactly the normal equations of the averaged objective (lemma C2). Both matrices are sums of n t r n_{\mathrm{tr}} n tr independent contributions, one per training state. When n t r ≫ n o u t n_{\mathrm{tr}}\gg n_{\mathrm{out}} n tr ≫ n out they concentrate around their averages, and the fitted weights approach the minimizer of eq. (13) . We use this concentration as a heuristic and do not quantify it; near n o u t = n t r n_{\mathrm{out}}=n_{\mathrm{tr}} n out = n tr it fails, as discussed at the end of this subsection.
When the penalty resembles ridge — The extra term in eq. (13) suppresses large weights in directions sensitive to shot noise, much as explicit ridge regularization does in classical regression [35 , 37 ] [36]. There is one exception: for weights proportional to the all-ones vector 1 n o u t \mathbf{1}_{n_{\mathrm{out}}} 1 n out , the prediction is constant because the frequencies sum to one, and Σ i 1 n o u t = 0 \Sigma_i\mathbf{1}_{n_{\mathrm{out}}}=0 Σ i 1 n out = 0 , so shot noise leaves the identity component unpenalized. On the remaining, nonconstant outcome directions the penalty is nearly isotropic for balanced measurements. If the mean training probabilities are nearly uniform, n t r − 1 ∑ i p i ≈ 1 n o u t / n o u t n_{\mathrm{tr}}^{-1}\sum_i p_i\approx\mathbf{1}_{n_{\mathrm{out}}}/n_{\mathrm{out}} n tr − 1 ∑ i p i ≈ 1 n out / n out , as for Haar training states and effects of nearly equal trace, then n o u t Σ ‾ t r n_{\mathrm{out}}\overline{\Sigma}_{\mathrm{tr}} n out Σ tr is close to the projector Π n o u t = I n o u t − 1 n o u t 1 n o u t T / n o u t \Pi_{n_{\mathrm{out}}}=I_{n_{\mathrm{out}}}-\mathbf{1}_{n_{\mathrm{out}}}\mathbf{1}_{n_{\mathrm{out}}}^{T}/n_{\mathrm{out}} Π n out = I n out − 1 n out 1 n out T / n out onto these directions, up to corrections of order d − 2 d^{-2} d − 2 from the variation of the exact probabilities across training states (lemma C2). The averaged objective is then the ridge objective of eq. (4) applied to exact features, with an unpenalized uniform weight and ridge parameter τ N = 1 / ( N n o u t ) \tau_N=1/(Nn_{\mathrm{out}}) τ N = 1/ ( N n out ) .
Shot noise sets a spectral resolution floor — The scale τ N \tau_N τ N tells us which weakly resolved measurement directions are damped. For Haar-random pure training states, a traceless operator A A A with Tr ( A 2 ) = 1 \operatorname{Tr}(A^2)=1 Tr ( A 2 ) = 1 has mean squared expectation value 1 / [ d ( d + 1 ) ] 1/[d(d+1)] 1/ [ d ( d + 1 )] (lemma A1). Accordingly, a traceless frame direction with eigenvalue λ \lambda λ contributes an eigenvalue approximately λ / [ d ( d + 1 ) ] \lambda/[d(d+1)] λ / [ d ( d + 1 )] to the normalized exact-feature matrix P P T / n t r PP^{T}/n_{\mathrm{tr}} P P T / n tr , and ridge reduces its coefficient when this eigenvalue is smaller than τ N \tau_N τ N . We define the training-shot ratio
α = N d ( d + 1 ) . (14) \alpha=\frac{N}{d(d+1)}. \tag*{(14)} α = d ( d + 1 ) N . (14)
In terms of the rescaled frame eigenvalue x = n o u t λ x=n_{\mathrm{out}}\lambda x = n out λ of theorem 1, the damping condition then reads α x ≲ 1 \alpha x\lesssim1 α x ≲ 1 . The product α x \alpha x α x is the signal-to-noise ratio of the direction: the variance of its exact expectation value across Haar-random states divided by the variance of its N N N -shot estimate (lemma D1). Finite training shots therefore impose a resolution floor: regression tends not to invert measurement directions whose variation across training states is weaker than their sampling noise. Since the classical peak comes from frame eigenvalues approaching zero, the floor suppresses the peak. Because the bulk of the Marchenko–Pastur spectrum has x x x of order one, the crossover occurs for α \alpha α of order one, i.e., for shot budgets of order d 2 d^2 d 2 ; recovering the contribution of the very smallest eigenvalues of a finite-dimensional frame can require substantially more shots. At fixed d d d and for a sufficiently large training set, increasing N N N eventually removes this floor and restores the exact-feature classical peak.
Why the quantum peak survives — The effective-ridge picture requires the measured normal equations to stay close to their shot averages. Their noise part Ξ ^ N Ξ ^ N T / ( N n t r ) \widehat{\Xi}_{N}\widehat{\Xi}_{N}^{T}/(Nn_{\mathrm{tr}}) Ξ N Ξ N T / ( N n tr ) has average Σ ‾ t r / N ≈ Π n o u t / ( N n o u t ) \overline{\Sigma}_{\mathrm{tr}}/N\approx\Pi_{n_{\mathrm{out}}}/(Nn_{\mathrm{out}}) Σ tr / N ≈ Π n out / ( N n out ) , but it is a sample covariance of n t r n_{\mathrm{tr}} n tr independent vectors in n o u t n_{\mathrm{out}} n out dimensions. Its eigenvalues therefore spread around this average over a range set by n o u t / n t r n_{\mathrm{out}}/n_{\mathrm{tr}} n out / n tr , and for n o u t n_{\mathrm{out}} n out close to n t r n_{\mathrm{tr}} n tr some of them approach zero, as for any nearly square random matrix [25 , 26 ] . On the outcome directions that carry no exact signal this noise part is all there is (section IV A). Near n o u t = n t r n_{\mathrm{out}}=n_{\mathrm{tr}} n out = n tr , the measured feature matrix may thus have extremely small singular values in an individual record even though its averaged loss is regularized, and least squares strongly amplifies the fluctuations of that particular record. Finite-shot noise can therefore suppress the classical peak of the measurement frame while creating the distinct quantum interpolation peak analyzed in section IV.
Quantum peak at the interpolation threshold
We now analyze interpolation above informational completeness, n o u t = n t r > d 2 n_{\mathrm{out}} = n_{\mathrm{tr}} > d^2 n out = n tr > d 2 , where the peak originates in the empirical feature matrix rather than in the exact measurement frame. Although the POVM can reconstruct every target observable, the exact probability matrix has rank at most d 2 d^2 d 2 ; finite-shot fluctuations generate additional outcome directions without exact signal. Near interpolation, least squares can fit these directions with large weights even for exact training labels. We first explain how this mechanism amplifies test variance and distorts the reconstructed observable, then quantify its singularity and its dependence on training shots and ridge regularization. Interpolation below informational completeness has a distinct, classical mechanism and is considered in § 3.2 .
Noise-only features and the quantum mechanism
The origin of the quantum peak can be seen by separating the exact quantum subspace from the directions created by noise. When the POVM and training states span operator space, let the orthonormal columns of U 1 , U 2 U_1,U_2 U 1 , U 2 span im ( P ) \operatorname{im}(P) im ( P ) and ker ( P T ) \operatorname{ker}(P^{T}) ker ( P T ) in R n o u t \mathbb{R}^{n_{\mathrm{out}}} R n out , and let those of V 1 , V 2 V_1,V_2 V 1 , V 2 span im ( P T ) \operatorname{im}(P^{T}) im ( P T ) and ker ( P ) \operatorname{ker}(P) ker ( P ) in R n t r \mathbb{R}^{n_{\mathrm{tr}}} R n tr , respectively. Because the POVM is informationally complete, ker ( P ) \operatorname{ker}(P) ker ( P ) consists of the combinations c ∈ R n t r c \in\mathbb{R}^{n_{\mathrm{tr}}} c ∈ R n tr of training states that cancel as operators, ∑ i c i ρ i = 0 \sum_i c_i\rho_i = 0 ∑ i c i ρ i = 0 , whereas ker ( P T ) \operatorname{ker}(P^{T}) ker ( P T ) consists of the outcome weights w ∈ R n o u t w \in\mathbb{R}^{n_{\mathrm{out}}} w ∈ R n out that reconstruct the zero observable, ∑ a w a μ a = 0 \sum_a w_a\mu_a = 0 ∑ a w a μ a = 0 . Since rank ( P ) = d 2 \operatorname{rank}(P) = d^2 rank ( P ) = d 2 , the matrices U 1 U_1 U 1 and V 1 V_1 V 1 have d 2 d^2 d 2 columns, whereas U 2 U_2 U 2 and V 2 V_2 V 2 have n o u t − d 2 n_{\mathrm{out}} - d^2 n out − d 2 and n t r − d 2 n_{\mathrm{tr}} - d^2 n tr − d 2 columns. The measured matrix takes the block form
\begin{pmatrix} U_1^{T} \\ U_2^{T} \end{pmatrix}\widehat{P}_N[V_1\ V_2] =
\begin{pmatrix}
P_{11} + N^{-1/2}\widehat{\Xi}_{11} & N^{-1/2}\widehat{\Xi}_{12} \\
N^{-1/2}\widehat{\Xi}_{21} & N^{-1/2}\widehat{\Xi}_{22}
\end{pmatrix}, \tag*{(15)}\end{pmatrix}
where P 11 = U 1 T P V 1 P_{11} = U_1^{T}PV_1 P 11 = U 1 T P V 1 and Ξ ^ k l = U k T Ξ ^ N V l \widehat{\Xi}_{kl} = U_k^{T}\widehat{\Xi}_NV_l Ξ k l = U k T Ξ N V l ; we drop the subscript N N N from the blocks of Ξ ^ \widehat{\Xi} Ξ for brevity. Only the upper-left block contains exact probabilities; the other three blocks consist entirely of measurement fluctuations and vanish for large N N N . In particular the noise-only block Ξ ^ 22 \widehat{\Xi}_{22} Ξ 22 has size ( n o u t − d 2 ) × ( n t r − d 2 ) (n_{\mathrm{out}} - d^2) \times(n_{\mathrm{tr}} - d^2) ( n out − d 2 ) × ( n tr − d 2 ) and thus becomes square precisely at n o u t = n t r n_{\mathrm{out}} = n_{\mathrm{tr}} n out = n tr , where, as for any nearly square random matrix, its smallest singular values are much smaller than its typical ones with high probability [24 , 25 , 26 ] .
Weights along noise-only directions — At interpolation, the effect of this block on the learned weights can be made explicit. Whenever n o u t ≥ n t r n_{\mathrm{out}} \ge n_{\mathrm{tr}} n out ≥ n tr and P ^ N \widehat{P}_N P N has full column rank, least squares fits the training labels exactly, P ^ N T w ^ N = y \widehat{P}_N^{T}\widehat{w}_N = y P N T w N = y ; at n o u t = n t r > d 2 n_{\mathrm{out}} = n_{\mathrm{tr}} > d^2 n out = n tr > d 2 this solution is unique and can be obtained block by block. Write w ^ 1 = U 1 T w ^ N \widehat{w}_1 = U_1^{T}\widehat{w}_N w 1 = U 1 T w N and w ^ 2 = U 2 T w ^ N \widehat{w}_2 = U_2^{T}\widehat{w}_N w 2 = U 2 T w N for the learned weights along the signal and noise-only outcome directions. Because the labels are exact and the target lies in the span of the effects, y = P T w e x y = P^{T}w_{\mathrm{ex}} y = P T w ex has no component along ker ( P ) \operatorname{ker}(P) ker ( P ) : the label combinations ∑ i c i y i = Tr ( 0 ∑ i c i ρ i ) \sum_i c_i y_i = \operatorname{Tr}(0\sum_i c_i\rho_i) ∑ i c i y i = Tr ( 0 ∑ i c i ρ i ) vanish on the cancelling combinations of training states. By eq. (15) , the interpolation conditions along ker ( P ) \operatorname{ker}(P) ker ( P ) therefore read N − 1 / 2 ( Ξ ^ 12 T w ^ 1 + Ξ ^ 22 T w ^ 2 ) = 0 N^{-1/2}(\widehat{\Xi}_{12}^{T}\widehat{w}_1 + \widehat{\Xi}_{22}^{T}\widehat{w}_2) = 0 N − 1/2 ( Ξ 12 T w 1 + Ξ 22 T w 2 ) = 0 , so that
w ^ 2 = − ( Ξ ^ 22 T ) − 1 Ξ ^ 12 T w ^ 1 . (16) \widehat{w}_2 = -(\widehat{\Xi}_{22}^{T})^{-1}\widehat{\Xi}_{12}^{T}\widehat{w}_1. \tag*{(16)} w 2 = − ( Ξ 22 T ) − 1 Ξ 12 T w 1 . (16)
The factor N − 1 / 2 N^{-1/2} N − 1/2 has cancelled. The signal weights w ^ 1 \widehat{w}_1 w 1 are of order one, since they reconstruct the target, and through the noisy training features they add a spurious contribution N − 1 / 2 Ξ ^ 12 T w ^ 1 N^{-1/2}\widehat{\Xi}_{12}^{T}\widehat{w}_1 N − 1/2 Ξ 12 T w 1 to the predictions on the cancelling combinations of training states, whose labels vanish. The noise-only weights w ^ 2 \widehat{w}_2 w 2 must cancel this contribution using the only features available along ker ( P ) \operatorname{ker}(P) ker ( P ) , which are themselves of order N − 1 / 2 N^{-1/2} N − 1/2 . The noise-only weights are therefore of order one as well, independently of N N N , and they become large when Ξ ^ 22 \widehat{\Xi}_{22} Ξ 22 is nearly singular. Inserting eq. (16) into the conditions along im ( P T ) \operatorname{im}(P^{T}) im ( P T ) shows that the signal weights solve the exact equations P 11 T U 1 T w e x = V 1 T y P_{11}^{T}U_1^{T}w_{\mathrm{ex}} = V_1^{T}y P 11 T U 1 T w ex = V 1 T y with P 11 P_{11} P 11 replaced by P 11 + N − 1 / 2 ( Ξ ^ 11 − Ξ ^ 12 Ξ ^ 22 − 1 Ξ ^ 21 ) P_{11} + N^{-1/2}(\widehat{\Xi}_{11} - \widehat{\Xi}_{12}\widehat{\Xi}_{22}^{-1}\widehat{\Xi}_{21}) P 11 + N − 1/2 ( Ξ 11 − Ξ 12 Ξ 22 − 1 Ξ 21 ) (eq. (146) ) of proposition E1.
Two contributions to prediction error — Two distinct effects follow, matching the two error contributions in eq. (5) . First, the reconstructed observable O ^ N \widehat{O}_N O N does not depend on the noise-only weights: every vector U 2 w ^ 2 ∈ ker ( P T ) U_2\widehat{w}_2 \in\operatorname{ker}(P^{T}) U 2 w 2 ∈ ker ( P T ) reconstructs the zero observable, so that O ^ N = ∑ a ( U 1 w ^ 1 ) a μ a \widehat{O}_N = \sum_a (U_1\widehat{w}_1)_a\mu_a O N = ∑ a ( U 1 w 1 ) a μ a . The noise-only weights still respond to the shot noise of the test frequencies, however, and large w ^ 2 \widehat{w}_2 w 2 inflate the test variance. Second, the signal weights solve a perturbed version of the exact equations, in which the Schur complement Ξ ^ 12 Ξ ^ 22 − 1 Ξ ^ 21 \widehat{\Xi}_{12}\widehat{\Xi}_{22}^{-1}\widehat{\Xi}_{21} Ξ 12 Ξ 22 − 1 Ξ 21 can be large near interpolation. The weights w ^ 1 \widehat{w}_1 w 1 then deviate from the exact coefficients U 1 T w e x U_1^{T}w_{\mathrm{ex}} U 1 T w ex , and the reconstructed observable acquires an error that persists with exact test probabilities and is measured by the ideal-test error. The block identities are exact whenever P ^ N \widehat{P}_N P N and Ξ ^ 22 \widehat{\Xi}_{22} Ξ 22 are invertible (proposition E1). The heuristic step is the size estimate, which treats the blocks of Ξ ^ N \widehat{\Xi}_N Ξ N as generic random matrices, although they are projections of the same multinomial fluctuations, whose covariances Σ i \Sigma_i Σ i depend on the training state. The results below do not rely on this estimate; they are proved for the minimum-norm and ridge estimators computed from the actual multinomial counts, including records for which P ^ N \widehat{P}_N P N is rank deficient, for instance because some outcome is never observed.
Quantum peak: divergence and ridge-rounded profiles
To make these statements quantitative, we consider large Hilbert-space dimensions, d → ∞ d \to\infty d → ∞ , with n o u t n_{\mathrm{out}} n out , n t r n_{\mathrm{tr}} n tr , and N N N also increasing proportionally to d 2 d^2 d 2 . More precisely, we generally consider the limit with fixed values of the ratios
γ Q = n o u t n t r , κ = d 2 − 1 n o u t − 1 , α = N d ( d + 1 ) (17) \gamma_Q = \frac{n_{\mathrm{out}}}{n_{\mathrm{tr}}}, \qquad\kappa= \frac{d^2 - 1}{n_{\mathrm{out}} - 1}, \qquad\alpha= \frac{N}{d(d+1)} \tag*{(17)} γ Q = n tr n out , κ = n out − 1 d 2 − 1 , α = d ( d + 1 ) N (17)
and consider the scaled ridge parameter η = n o u t N τ \eta= n_{\mathrm{out}}N\tau η = n out N τ . We study γ Q \gamma_Q γ Q near one and take 0 < κ < 1 0 < \kappa< 1 0 < κ < 1 , so that the measurement is informationally complete. The ratio κ \kappa κ is the fraction of nonconstant outcome directions that can carry exact signal: probability normalization removes one of the n o u t n_{\mathrm{out}} n out outcome directions, and the trace removes one of the d 2 d^2 d 2 operator directions. In the limit, κ \kappa κ coincides with the aspect ratio γ C = d 2 / n o u t \gamma_C = d^2/n_{\mathrm{out}} γ C = d 2 / n out of § 3 . The training-shot ratio α \alpha α of eq. (14) sets the training signal-to-noise ratio: an operator direction with rescaled frame eigenvalue x x x is resolved by N N N shots with signal-to-noise ratio α x \alpha x α x across Haar-random states (lemma D1). Since the Marchenko–Pastur law of theorem 1 has unit mean, α \alpha α is the signal-to-noise ratio of a typical direction, and N ∝ d 2 N \propto d^2 N ∝ d 2 is precisely the regime in which the training shots resolve the state-dependent signal only partially. The scaled ridge parameter η \eta η compares τ \tau τ with the shot-noise scale of the measured features: a fixed η > 0 \eta> 0 η > 0 corresponds to τ = η / ( n o u t N ) \tau= \eta/(n_{\mathrm{out}}N) τ = η / ( n out N ) , which decreases as the training statistics improve, and η = 1 \eta= 1 η = 1 reproduces the parameter τ N \tau_N τ N of the regularization that shot noise induces on average (§ 3 D).
Divergence at interpolation — Our first result concerns the physical, unregularized estimator w ^ N \hat{w}_N w ^ N of eq. (3) . Its divergence does not follow from the analysis of ridge regression below, because the limits τ → 0 \tau\to0 τ → 0 and d → ∞ d \to\infty d → ∞ need not commute.
Theorem 3 (Divergence of the ridgeless test variance (informal)). Consider the proportional regime of eq. (17) with n o u t / n t r → 1 n_{\mathrm{out}}/n_{\mathrm{tr}} \to1 n out / n tr → 1 , 0 < κ < 1 0 < \kappa< 1 0 < κ < 1 and α > 0 \alpha> 0 α > 0 , independent multinomial training records, and a target with Δ O 2 > 0 \Delta_{\mathcal{O}}^2 > 0 Δ O 2 > 0 and bounded ∣ Tr ( O ) ∣ / ( d Δ O 2 ) |\operatorname{Tr}(\mathcal{O})|/(d\sqrt{\Delta_{\mathcal{O}}^2}) ∣ Tr ( O ) ∣/ ( d Δ O 2 ) . Assume that (i) the training-state and measurement frames are bounded, so that no operator direction carries an anomalously large weight; (ii) shot noise is nondegenerate, with strength of order 1 / n o u t 1/n_{\mathrm{out}} 1/ n out along every nonconstant outcome direction, for both training and test states; and (iii) the training states remain spread around their mean, so that the labels vary across the training set. Then, as d → ∞ d \to\infty d → ∞ , the target-averaged ridgeless test variance diverges,
V N d Δ O 2 ⟶ P + ∞ . (18) \frac{V_N}{d\Delta_{\mathcal{O}}^2} \mathrel{\mathop{\longrightarrow}^{\mathrm{P}}} +\infty. \tag*{(18)} d Δ O 2 V N ⟶ P + ∞. (18) The same holds for the test variance V N ( O ) V_N(\mathcal{O}) V N ( O ) of a single random target and for its median. Records for which P ^ N \hat{P}_N P ^ N is rank deficient are included.
The precise conditions (i)–(iii) are eqs. (93) to (95) , and the formal statement is theorem E2.
Generality of the interpolation divergence — Theorem 3 does not require the training states to span the full operator space: whenever n o u t > d 2 n_{\mathrm{out}} > d^2 n out > d 2 , the deviations p i − p ˉ \mathbf{p}_i-\bar{\mathbf{p}} p i − p ˉ of the exact probability vectors from their training-set mean p ˉ \bar{\mathbf{p}} p ˉ span at most d 2 − 1 d^2-1 d 2 − 1 of the n o u t − 1 n_{\mathrm{out}}-1 n out − 1 nonconstant outcome directions, independently of the training ensemble, leaving at least n o u t − d 2 n_{\mathrm{out}}-d^2 n out − d 2 directions without exact signal. Finite-shot noise populates these directions, creating spurious features that can be strongly amplified near interpolation. Conditions (ii) and (iii) ensure that these fluctuations are nondegenerate and that the training labels vary enough to require large weights. Since the divergence holds with probability tending to one over the shot noise in the training records, it describes typical records rather than rare ill-conditioned realizations. The theorem does not specify the limiting distribution of the peak height, which depends on the smallest singular values of P ^ N \hat{P}_N P ^ N ; Figure 6 shows the finite-size distributions at γ Q = 1 \gamma_Q=1 γ Q = 1 and their growth with d d d at nearly fixed κ \kappa κ and α \alpha α .
Figure 6. Distribution of the ridgeless test variance at interpolation. Distributions of the ridgeless test variance V N ( O ) V_{N}(\mathcal{O}) V N ( O ) at interpolation, n o u t = n t r n_{\mathrm{out}} = n_{\mathrm{tr}} n out = n tr , for d = 4 , 8 , 12 , 16 d = 4, 8, 12, 16 d = 4 , 8 , 12 , 16 and n o u t = 64 , 256 , 512 , 1024 n_{\mathrm{out}} = 64, 256, 512, 1024 n out = 64 , 256 , 512 , 1024 , respectively, with N = d ( d + 1 ) / 2 N = d(d + 1)/2 N = d ( d + 1 ) /2 . These choices give n o u t ≈ 4 d 2 n_{\mathrm{out}} \approx4d^{2} n out ≈ 4 d 2 , so that κ = ( d 2 − 1 ) / ( n o u t − 1 ) ≈ 0.24 \kappa= (d^{2} - 1)/(n_{\mathrm{out}} - 1) \approx0.24 κ = ( d 2 − 1 ) / ( n out − 1 ) ≈ 0.24 –0.28 0.28 0.28 and α = N / [ d ( d + 1 ) ] = 1 / 2 \alpha= N/[d(d + 1)] = 1/2 α = N / [ d ( d + 1 )] = 1/2 stay nearly fixed while d d d grows (eq. (17) ). Each violin contains 10 000 independent realizations of a normalized Haar rank-one POVM, a Haar training ensemble, a traceless target drawn uniformly from the unit sphere (d O Δ = 1 d_{\mathcal{O}}^{\Delta} = 1 d O Δ = 1 ), and multinomial training records. Widths show densities on a logarithmic scale; markers and bars indicate medians, 95% confidence intervals and percentile ranges. Realizations with rank-deficient P ^ N \hat{P}_{N} P ^ N or extremely large V N V_{N} V N are retained.
Shape of the peak — To describe the shape of the peak, we analyze ridge regression at a fixed scaled ridge parameter η > 0 \eta> 0 η > 0 and use the normalized target averages V N , τ / ( d Δ O 2 ) V_{N,\tau}/(d\Delta_{\mathcal{O}}^2) V N , τ / ( d Δ O 2 ) and d ( d + 1 ) E N , τ / ( d Δ O 2 ) d(d+1)\mathcal{E}_{N,\tau}/(d\Delta_{\mathcal{O}}^2) d ( d + 1 ) E N , τ / ( d Δ O 2 ) of § 2 ; the second is the relative Hilbert–Schmidt error of the reconstructed state-dependent observable (eq. (6) ). The analysis is simplest for least squares with an unpenalized intercept, which is equivalent to subtracting the training-set averages from labels and features before fitting; we call this the centered fit. The intercept absorbs the constant part of the prediction, so that the centered fit isolates the state-dependent part of the problem, where the peak arises. We denote by F η ( γ ) F_\eta(\gamma) F η ( γ ) and G η ( γ ) G_\eta(\gamma) G η ( γ ) the large-d d d limits, at γ Q → γ \gamma_Q \to\gamma γ Q → γ , of the two normalized error contributions of the centered fit, defined in eqs. (104) and (105) . The physical fit has the same leading singular test variance. Its ideal-test error can contain additional contributions from the empirical training mean and from the identity component of the target (proposition D2). At every fixed η > 0 \eta> 0 η > 0 , these contributions vanish for traceless targets whenever the training states are pure and satisfy conditions (i) and (iii), and for all targets when, in addition, the training states are Haar random and the effects have nearly equal traces (section F1); training sets of mixed states can retain them.
Theorem 4 (Quantum peak and ridge rounding (informal)). Under the assumptions of theorem 3, together with a regularity condition on the large-d d d limits of the normalized traces entering the calculation (theorem E1), F η ( γ ) F_\eta(\gamma) F η ( γ ) and
G η ( γ ) G_{\eta}(\gamma) G η ( γ ) are deterministic functions for every η > 0 \eta> 0 η > 0 . Taking the dimensional limit first and then ( γ , η ) → ( 1 , 0 ) (\gamma, \eta) \to(1, 0) ( γ , η ) → ( 1 , 0 ) gives
F η ( γ ) ∼ C V ( γ − 1 ) 2 + 4 h η , F_{\eta}(\gamma) \sim\frac{C_{V}}{\sqrt{(\gamma- 1)^{2} + 4h\eta}}, F η ( γ ) ∼ ( γ − 1 ) 2 + 4 h η C V ,
G η ( γ ) ∼ C G ( γ − 1 ) 2 + 4 h η ( C G > 0 ) , (19) G_{\eta}(\gamma) \sim\frac{C_{G}}{\sqrt{(\gamma- 1)^{2} + 4h\eta}} \qquad(C_{G} > 0), \tag*{(19)} G η ( γ ) ∼ ( γ − 1 ) 2 + 4 h η C G ( C G > 0 ) , (19)
where C V > 0 C_{V} > 0 C V > 0 , C G ≥ 0 C_{G} \ge0 C G ≥ 0 and h > 0 h > 0 h > 0 depend on the training and measurement geometry at interpolation, as given in eqs. (154) and (155) .
Pole and ridge-rounded profile — The square-root denominator in eq. (19) interpolates between two regimes. For 2 h η ≪ ∣ γ − 1 ∣ ≪ 1 2\sqrt{h\eta} \ll|\gamma- 1| \ll1 2 h η ≪ ∣ γ − 1∣ ≪ 1 , both contributions decay as 1 / ∣ γ − 1 ∣ 1/|\gamma- 1| 1/∣ γ − 1∣ ; the upper bound on ∣ γ − 1 ∣ |\gamma- 1| ∣ γ − 1∣ is needed because eq. (19) describes only the singular part of the profiles, which dominates near interpolation. This pole is the profile of the ridgeless fit: corollary E1 shows that the centered ridgeless costs obey F 0 ( γ ) ∼ C V / ∣ γ − 1 ∣ F_{0}(\gamma) \sim C_{V}/|\gamma- 1| F 0 ( γ ) ∼ C V /∣ γ − 1∣ and G 0 ( γ ) ∼ C G / ∣ γ − 1 ∣ G_{0}(\gamma) \sim C_{G}/|\gamma- 1| G 0 ( γ ) ∼ C G /∣ γ − 1∣ (eq. (168) ), provided the smallest measured singular values carry a vanishing share of the coefficient norm. For ∣ γ − 1 ∣ ≲ 2 h η |\gamma- 1| \lesssim2\sqrt{h\eta} ∣ γ − 1∣ ≲ 2 h η , any fixed η > 0 \eta> 0 η > 0 rounds off the pole into a peak of finite height. The two amplitudes C V C_{V} C V and C G C_{G} C G correspond to the two effects identified at the beginning of this section: C V C_{V} C V quantifies the amplification of finite test-shot fluctuations by large weights, while C G C_{G} C G quantifies the error of the reconstructed observable, which persists even with exact test probabilities. Their dependence on N N N need not be the same (section IV C). The simulations in Figure 7 compare both contributions with the complete Haar profiles as γ Q \gamma_{Q} γ Q crosses interpolation.
Figure 7. Quantum peak and ridge rounding. Haar prediction-error profiles near the quantum interpolation threshold, as n t r n_{\mathrm{tr}} n tr varies at fixed d = 12 d = 12 d = 12 , n o u t = 512 n_{\mathrm{out}} = 512 n out = 512 and N = d ( d + 1 ) = 156 N = d(d + 1) = 156 N = d ( d + 1 ) = 156 , i.e., κ ≈ 0.28 \kappa\approx0.28 κ ≈ 0.28 and α = 1 \alpha= 1 α = 1 . (a) Test variance V N , τ ( O ) V_{N,\tau}(\mathcal{O}) V N , τ ( O ) . (b) Normalized ideal-test error d ( d + 1 ) E N , τ ( O ) d(d + 1)\mathcal{E}_{N,\tau}(\mathcal{O}) d ( d + 1 ) E N , τ ( O ) . The three red tones indicate scaled ridge parameters η = n o u t N τ = 0 , 0.01 , 0.1 \eta= n_{\mathrm{out}}N\tau= 0, 0.01, 0.1 η = n out N τ = 0 , 0.01 , 0.1 , consistently in both panels. Open red markers show simulated medians; charcoal dashed curves show the complete analytical predictions for Haar training states and Haar POVMs, eqs. (213) to (216) , including the nonsingular background, evaluated without fitting at the stated d d d , N N N , and n o u t n_{\mathrm{out}} n out . Each point contains 128 independent realizations of a normalized Haar rank-one POVM, a Haar pure training ensemble, a traceless unit-sphere target (d Δ O 2 = 1 d\Delta_{\mathcal{O}}^2 = 1 d Δ O 2 = 1 ), and multinomial records; within each realization, all values of η \eta η share the same apparatus, states, target, and training counts. Shading shows pointwise 10th–90th percentiles.
Frame-spectrum control of the amplitudes — For Haar pure training states and effects of nearly equal trace, Tr ( μ a ) ≈ d / n o u t \operatorname{Tr}(\mu_{a}) \approx d/n_{\mathrm{out}} Tr ( μ a ) ≈ d / n out , shot noise has the same strength along every nonconstant outcome direction, and the coefficients C V , C G C_{V}, C_{G} C V , C G and h h h have an intuitive spectral form. If ν \nu ν is the limiting distribution of the rescaled traceless POVM-frame eigenvalues (the Marchenko–Pastur law of theorem 1 for Haar POVMs), then
ϕ = ∫ d ν ( x ) 1 + α x , h = 1 − κ + κ ϕ , \phi= \int\frac{\mathrm{d}\nu(x)}{1 + \alpha x}, \qquad h = 1 - \kappa+ \kappa\phi, ϕ = ∫ 1 + α x d ν ( x ) , h = 1 − κ + κ ϕ ,
C V = α ϕ h , C G = κ ϕ ( 1 − ϕ ) . (20) C_{V} = \alpha\phi h, \qquad C_{G} = \kappa\phi(1 - \phi). \tag*{(20)} C V = α ϕ h , C G = κ ϕ ( 1 − ϕ ) . (20)
The quantity ϕ \phi ϕ has a direct operational meaning: it is the relative error of the best linear estimate of a Haar-random state from N N N shots of the measurement, i.e., the minimum mean squared Hilbert–Schmidt error divided by the mean squared distance of the state from I d / d I_{d}/d I d / d (eq. (177) ). Along each frame eigendirection, the traceless coordinate of a Haar-random state has variance 1 / [ d ( d + 1 ) ] 1/[d(d + 1)] 1/ [ d ( d + 1 )] and is measured with the signal-to-noise ratio α x \alpha x α x (lemma D1). The best linear estimate of such a coordinate retains the fraction 1 / ( 1 + α x ) 1/(1 + \alpha x) 1/ ( 1 + α x ) of its variance, and ϕ \phi ϕ averages this fraction over the frame spectrum: well-resolved directions (α x ≫ 1 \alpha x \gg1 α x ≫ 1 ) contribute little, and inaccessible ones (x = 0 x = 0 x = 0 ) contribute fully. Both amplitudes vanish when the training shots resolve nothing, ϕ → 1 \phi\to1 ϕ → 1 , but they behave differently as the resolution improves: C G C_{G} C G also vanishes for ϕ → 0 \phi\to0 ϕ → 0 , whereas C V C_{V} C V does not.
Training-shot dependence and noncommuting limits
The effect of increasing training precision depends on how the shot budget scales with dimension. For Haar-random measurements the peak amplitudes can be evaluated explicitly; fixed-shot and fixed-dimension limits then reveal behaviors that are not apparent from proportional scaling alone.
Haar-random measurements — For independent Haar pure training states, the expectation value Tr ( A ρ i ) \operatorname{Tr}(A\rho_{i}) Tr ( A ρ i ) of every traceless observable A A A with Tr A 2 = 1 \operatorname{Tr} A^{2} = 1 Tr A 2 = 1 has the same variance 1 / [ d ( d + 1 ) ] 1/[d(d + 1)] 1/ [ d ( d + 1 )] over the training states, and the measurement enters the coefficients of eq. (20) only through the eigenvalue distribution ν \nu ν of the rescaled traceless POVM frame. For normalized Haar rank-one POVMs, ν \nu ν is the limiting law of theorem 1 restricted to traceless operators (theorem B1), i.e., the Marchenko–Pastur law μ M P , κ \mu_{\mathrm{MP},\kappa} μ MP , κ , because κ \kappa κ and γ C \gamma_C γ C have the same limit. Its support is [ ( 1 − κ ) 2 , ( 1 + κ ) 2 ] [(1-\sqrt{\kappa})^2,(1+\sqrt{\kappa})^2] [( 1 − κ ) 2 , ( 1 + κ ) 2 ] in the informationally complete regime κ < 1 \kappa< 1 κ < 1 .
Closed-form Haar amplitudes — For this law, ϕ \phi ϕ is available in closed form: ϕ \phi ϕ equals α − 1 \alpha^{-1} α − 1 times the Stieltjes transform ∫ d ν ( x ) / ( x − z ) \int\mathrm{d}\nu(x)/(x-z) ∫ d ν ( x ) / ( x − z ) evaluated at z = − 1 / α z=-1/\alpha z = − 1/ α , and this transform obeys a quadratic self-consistent equation [26 ] (section E2). For ϕ \phi ϕ , the equation reads 1 − ϕ = α ϕ ( 1 − κ + κ ϕ ) 1-\phi=\alpha\phi(1-\kappa+\kappa\phi) 1 − ϕ = α ϕ ( 1 − κ + κ ϕ ) , whose positive solution is
ϕ = 2 1 + α ( 1 − κ ) + [ 1 + α ( 1 − κ ) ] 2 + 4 κ α (21) \phi= \frac{2}{1+\alpha(1-\kappa)+\sqrt{[1+\alpha(1-\kappa)]^2+4\kappa\alpha}} \tag*{(21)} ϕ = 1 + α ( 1 − κ ) + [ 1 + α ( 1 − κ ) ] 2 + 4 κ α 2 (21)
Figure 8. Training-shot dependence of triple descent. Full test MSE. We fix d = 4 d = 4 d = 4 , n t r = 96 n_{\mathrm{tr}} = 96 n tr = 96 , and M = 256 M = 256 M = 256 test shots, and vary the number of training shots per state: N = 10 3 N = 10^3 N = 1 0 3 (yellow), 10 4 10^4 1 0 4 (orange), and 10 6 10^6 1 0 6 (dark red). The minimum-norm readout is trained without ridge regularization, and its full test error is M S E N , M = E N + V N / M \mathrm{MSE}_{N,M} = \mathcal{E}_N + V_N/M MSE N , M = E N + V N / M . The outcome count varies crossing n o u t = d 2 = 16 n_{\mathrm{out}} = d^2 = 16 n out = d 2 = 16 (dotted line) and n o u t = n t r = 96 n_{\mathrm{out}} = n_{\mathrm{tr}} = 96 n out = n tr = 96 (dashed line). Decreasing N N N strongly rounds the first peak, while the interpolation peak remains pronounced. Markers show medians over 1024 independent Haar-POVM, training-state, and measurement-record realizations per point; apparatus and training states are paired across budgets. Shading shows the 10th–90th percentiles, and error bars show pointwise 95% confidence intervals for the median. Target-direction and Haar test-state averages are evaluated exactly.
The right-hand side of this equation is α ϕ \alpha\phi α ϕ , by eq. (20) , so that C V = α ϕ = 1 − ϕ C_V=\alpha\phi=1-\phi C V = α ϕ = 1 − ϕ , and the two amplitudes depend only on ϕ \phi ϕ and κ \kappa κ .
C V = 1 − ϕ , C G = κ ϕ ( 1 − ϕ ) . (22) C_V = 1-\phi,\qquad C_G=\kappa\phi(1-\phi). \tag*{(22)} C V = 1 − ϕ , C G = κ ϕ ( 1 − ϕ ) . (22)
Contrasting dependence on training shots — The two amplitudes respond differently to training statistics. As α \alpha α increases, ϕ \phi ϕ decreases, reflecting the improved resolution of the exact probability features. The variance amplitude C V C_V C V therefore increases monotonically towards 1, whereas the ideal-test amplitude C G C_G C G is nonmonotonic: it reaches its maximum C G = κ / 4 C_G=\kappa/4 C G = κ /4 at ϕ = 1 / 2 \phi=1/2 ϕ = 1/2 , i.e., at α = 2 / ( 2 − κ ) \alpha=2/(2-\kappa) α = 2/ ( 2 − κ ) , and then decays. For fixed 0 < κ < 1 0<\kappa<1 0 < κ < 1 and large α \alpha α ,
C V = 1 − 1 ( 1 − κ ) α + O ( α − 2 ) , C G = κ ( 1 − κ ) α + O ( α − 2 ) . (23) C_V = 1-\frac{1}{(1-\kappa)\alpha}+O(\alpha^{-2}),
\qquad
C_G = \frac{\kappa}{(1-\kappa)\alpha}+O(\alpha^{-2}). \tag*{(23)} C V = 1 − ( 1 − κ ) α 1 + O ( α − 2 ) , C G = ( 1 − κ ) α κ + O ( α − 2 ) . (23)
Increasing N N N thus improves the reconstructed observable but strengthens the variance pole, whose amplitude saturates at C V = 1 C_{\mathrm{V}}=1 C V = 1 rather than diverging. The target-averaged MSE of the centered fit is approximately Δ O 2 [ G η / ( d ( d + 1 ) ) + F η / M ] \Delta_{\mathcal{O}}^2[G_{\eta}/(d(d+1))+F_{\eta}/M] Δ O 2 [ G η / ( d ( d + 1 )) + F η / M ] , so that its singular coefficient is Δ O 2 [ C G / ( d ( d + 1 ) ) + C V / M ] \Delta_{\mathcal{O}}^2[C_{\mathrm{G}}/(d(d+1))+C_{\mathrm{V}}/M] Δ O 2 [ C G / ( d ( d + 1 )) + C V / M ] . With finite test statistics, additional training shots therefore do not suppress the peak: the V / M V/M V / M contribution approaches the nonzero amplitude Δ O 2 / M \Delta_{\mathcal{O}}^2/M Δ O 2 / M , while the ideal-test contribution decays as 1 / α 1/\alpha 1/ α . Because the two contributions are weighted by 1 / [ d ( d + 1 ) ] 1/[d(d+1)] 1/ [ d ( d + 1 )] and 1 / M 1/M 1/ M , the variance dominates the peak unless M ≳ d ( d + 1 ) C V / C G M \gtrsim d(d+1)C_{\mathrm{V}}/C_{\mathrm{G}} M ≳ d ( d + 1 ) C V / C G . The complete Haar profiles and multinomial simulations in Figure 9 show this contrast.
Figure 9. Training-shot dependence at interpolation. Parameters: d = 8 d=8 d = 8 , n o u t = n t r = 256 n_{\mathrm{out}}=n_{\mathrm{tr}}=256 n out = n tr = 256 (κ ≈ 0.25 \kappa\approx0.25 κ ≈ 0.25 ). Panels (a),(b) show V N , τ ( O ) V_{N,\tau}(\mathcal{O}) V N , τ ( O ) and d ( d + 1 ) E N , τ ( O ) d(d+1)\mathcal{E}_{N,\tau}(\mathcal{O}) d ( d + 1 ) E N , τ ( O ) as N = 4 k N=4^k N = 4 k , k = 2 , … , 10 k=2,\ldots,10 k = 2 , … , 10 , varies at η = 10 − 3 , 10 − 2 , 10 − 1 \eta=10^{-3},10^{-2},10^{-1} η = 1 0 − 3 , 1 0 − 2 , 1 0 − 1 . Open markers are medians and shading gives 10th–90th percentiles over 1024 independent Haar and multinomial realizations. Dashed curves are the complete analytical Haar predictions, evaluated at the actual budgets.
Fixed shot number or fixed dimension — The proportional limit fixes α = N / [ d ( d + 1 ) ] \alpha=N/[d(d+1)] α = N / [ d ( d + 1 )] , so the amplitudes above describe training budgets that grow with the dimension. Two other ways of varying N N N lead to different behaviors.
Sparse records at fixed shot number — At fixed N N N and growing dimension, α → 0 \alpha\to0 α → 0 and the training records become sparse. For approximately balanced outcome probabilities, a fraction e − N / Y Q e^{-N/\mathcal{Y}_{Q}} e − N / Y Q of the outcomes is never observed in any training record (proposition F2). Their rows in P ^ N \hat{P}_{N} P ^ N vanish, so that P ^ N \hat{P}_{N} P ^ N becomes rank deficient and the minimum-norm fit assigns these outcomes zero weight. Discarding these outcomes removes directions that could otherwise carry large weights and thus limits the test variance: at N = 1 N=1 N = 1 and Tr ( O 2 ) = 1 \operatorname{Tr}(\mathcal{O}^{2})=1 Tr ( O 2 ) = 1 , every record gives V 1 ( O ) ≤ 1 V_{1}(\mathcal{O})\leq1 V 1 ( O ) ≤ 1 and MSE 1 , M ( O ) ≤ 4 \operatorname{MSE}_{1,M}(\mathcal{O})\leq4 MSE 1 , M ( O ) ≤ 4 . Predictions do not become accurate, however, since unseen outcomes still occur at test time, where they contribute nothing to the prediction. Figure 10 shows the finite-shot test variance and the fraction of unseen outcomes.
Figure 10. Finite-record effects. (a) Ridgeless test variance V N ( O ) V_{N}(O) V N ( O ) at interpolation for d = 4 , 8 , 12 , 16 d = 4, 8, 12, 16 d = 4 , 8 , 12 , 16 , with n o u t = n t r = 64 , 256 , 512 , 1024 n_{\mathrm{out}} = n_{\mathrm{tr}} = 64, 256, 512, 1024 n out = n tr = 64 , 256 , 512 , 1024 and N = 4 k N = 4^k N = 4 k , k = 0 , … , 10 k = 0, \ldots, 10 k = 0 , … , 10 . (b) Fraction u N u_N u N of outcomes never observed in any training record (section IV C) at d = 16 d = 16 d = 16 , n o u t = 1024 n_{\mathrm{out}} = 1024 n out = 1024 , γ Q = n o u t / n t r = 4 , 8 , 16 \gamma_Q = n_{\mathrm{out}}/n_{\mathrm{tr}} = 4, 8, 16 γ Q = n out / n tr = 4 , 8 , 16 and N = 1 , 2 , 4 , 6 , 8 N = 1, 2, 4, 6, 8 N = 1 , 2 , 4 , 6 , 8 . Markers show medians in (a) and ensemble means in (b), using 1024 independent realizations per point. Dashed lines in (b) show the large-d d d prediction e − N / γ Q e^{-N/\gamma_Q} e − N / γ Q of proposition F2; bars and shading indicate uncertainty and percentile ranges. Realizations with rank-deficient P ^ N \hat{P}_N P ^ N are included.
Saturation at fixed dimension — At fixed dimension and growing N N N , instead, the peak saturates, as can be understood from eq. (16) . As N → ∞ N\to\infty N → ∞ , w ^ 1 \hat{w}_{1} w ^ 1 converges to the exact coefficients and Ξ ^ N \hat{\Xi}_{N} Ξ ^ N to a Gaussian matrix, by the multivariate central limit theorem, so w ^ 2 \hat{w}_{2} w ^ 2 converges in distribution to a nonzero random vector that does not depend on N N N . The test variance at the peak, V N ( O ) = w ^ N T Σ t e w ^ N V_{N}(\mathcal{O})=\hat{w}_{N}^{\mathsf{T}}\Sigma_{\mathrm{te}}\hat{w}_{N} V N ( O ) = w ^ N T Σ te w ^ N , is a continuous function of w ^ N \hat{w}_{N} w ^ N and therefore converges in distribution to a finite random variable, whose typical size is set by the smallest singular values of the square noise block Ξ ^ 22 \hat{\Xi}_{22} Ξ ^ 22 , whereas the ideal-test error, to which w ^ 2 \hat{w}_{2} w ^ 2 does not contribute, decreases as 1 / N 1/N 1/ N . Away from interpolation, an analogous argument with a pseudoinverse gives smaller but still N N N -independent weights w ^ 2 \hat{w}_{2} w ^ 2 , because the noise block is rectangular and better conditioned. With exact features (N = ∞ N=\infty N = ∞ ), in contrast, the noise-only directions do not exist, and the variance reduces to the shadow variance of § 3 . The limits N → ∞ N\to\infty N → ∞ and N = ∞ N=\infty N = ∞ thus do not commute, consistently with the proportional-limit amplitudes C V → 1 C_{\mathrm{V}}\to1 C V → 1 and C G = O ( 1 / α ) C_{\mathrm{G}}=O(1/\alpha) C G = O ( 1/ α ) ; Figure 10 (a) shows the resulting plateau of the test variance at large N N N . This argument is heuristic: it assumes that P ^ N \hat{P}_{N} P ^ N and the limiting Gaussian block remain invertible with probability one, and we do not prove the convergence in distribution.
Explicit ridge regularization
Explicit ridge regularization, eq. (4) , acts on the measured matrix itself: in every record, it replaces each inverse singular value 1 / s 1/s 1/ s of P ^ N \hat{P}_{N} P ^ N by s / ( s 2 + n t r τ ) s/(s^{2}+n_{\mathrm{tr}}\tau) s / ( s 2 + n tr τ ) (§ 2 ), and thus bounds the weights along the small singular values of the particular noise realization. The noise-induced regularization of § 3 D, by contrast, acts only on the loss averaged over training records, and near interpolation the fit follows the particular record instead. Since η = n o u t N τ \eta=n_{\mathrm{out}}N\tau η = n out N τ sets the natuose ral scale of the ridge parameter, varying N N N at fixed η \eta η is not the same experiment as varying N N N at fixed τ \tau τ .
Ridge scaling at interpolation — At γ = 1 \gamma= 1 γ = 1 , eq. (19) of theorem 4 gives peak heights that grow as the ridge parameter decreases,
F η ( 1 ) ∼ C V 2 η , G η ( 1 ) ∼ C G 2 η ( C G > 0 ) . (24) F_{\eta}(1) \sim\frac{C_V}{2\sqrt{\eta}}, \qquad G_{\eta}(1) \sim\frac{C_G}{2\sqrt{\eta}} \qquad(C_G > 0). \tag*{(24)} F η ( 1 ) ∼ 2 η C V , G η ( 1 ) ∼ 2 η C G ( C G > 0 ) . (24)
The exponent − 1 / 2 -1/2 − 1/2 is fixed by the square-root denominator and is therefore the same for every training set and measurement satisfying the assumptions of theorem 4, whereas the prefactors C V C_V C V , C G C_G C G and the width 2 η 2\sqrt{\eta} 2 η depend on the training and measurement geometry, through ν \nu ν in the Haar case, where h = 1 − κ + κ ϕ h = 1 - \kappa+ \kappa\phi h = 1 − κ + κ ϕ .
Moreover, eq. (24) holds when d → ∞ d \to\infty d → ∞ is taken before η → 0 \eta\to0 η → 0 , and does not apply to arbitrarily weak ridge at finite dimension: at fixed d d d , the values of V N , τ V_{N,\tau} V N , τ and E N , τ \mathcal{E}_{N,\tau} E N , τ at γ Q = 1 \gamma_Q = 1 γ Q = 1 saturate at their finite ridgeless values as η → 0 \eta\to0 η → 0 .
Regularization and prediction accuracy — As shown in Figure 11 (a),(Figure 11 b), ridge rounds both error contributions, while the remaining deviations at extremely small η \eta η reflect the finite-dimensional saturation discussed above. In panel (c), increasing ridge first reduces the MSE by suppressing overfitting and then increases it by attenuating the target signal; the minimum depends on M M M . For Haar training states, d ( d + 1 ) M S E N , M , τ / ( d Δ t 2 ) d(d + 1)\mathrm{MSE}_{N,M,\tau}/(d\Delta_t^2) d ( d + 1 ) MSE N , M , τ / ( d Δ t 2 ) tends to G η + [ d ( d + 1 ) / M ] F η G_\eta+ [d(d + 1)/M]F_\eta G η + [ d ( d + 1 ) / M ] F η ; for general training sets, the additional terms of proposition D2 must be added. Ridge offers a controlled way to reduce the peak, although its useful strength depends on the POVM, the training states, and both shot budgets.
Figure 11. Ridge rounding at interpolation. Parameters: d = 16 d = 16 d = 16 , n o u t = n t r = 1024 n_{\mathrm{out}} = n_{\mathrm{tr}} = 1024 n out = n tr = 1024 . (a),(b) Test variance V N , τ ( O ) V_{N,\tau}(\mathcal{O}) V N , τ ( O ) and d ( d + 1 ) E N , τ ( O ) d(d + 1)E_{N,\tau}(\mathcal{O}) d ( d + 1 ) E N , τ ( O ) at interpolation versus η \eta η , for N = 64 , 256 , 512 N = 64,256,512 N = 64 , 256 , 512 ; (c) d ( d + 1 ) MSE N , M , τ ( O ) d(d + 1)\operatorname{MSE}_{N,M,\tau}(\mathcal{O}) d ( d + 1 ) MSE N , M , τ ( O ) at N = 256 N = 256 N = 256 for M = ∞ , N , N / 4 M = \infty,N,N/4 M = ∞ , N , N /4 . The scaled ridge parameter is η = n o u t N τ \eta= n_{\mathrm{out}}N\tau η = n out N τ . Markers show medians of 1024 Haar and multinomial realizations, each shared by all values of η \eta η , shading gives 10th–90th percentiles, and dashed curves are the full analytical Haar predictions. Dotted guides in (a),(b) illustrate the η − 1 / 2 \eta^{-1/2} η − 1/2 laws of eq. (24) (rescaled for visibility); stars in (c) mark minima on the displayed grid of η \eta η .
Classical peak below informational completeness
When n o u t = n t r < d 2 n_{\mathrm{out}} = n_{\mathrm{tr}} < d^2 n out = n tr < d 2 , i.e., κ > 1 \kappa> 1 κ > 1 , the interpolation peak is classical: it is present even with exact features, and a peak of this type was also recently reported in [32 ] . For generic measurements and training states, the exact feature matrix now has full rank, so no outcome direction is guaranteed to carry pure noise. Instead, the target O O O generally contains a component outside the POVM span, which the measurement cannot access. Let w e x = M μ + ⊤ v w_{\mathrm{ex}} = M_\mu^{+\top}v w ex = M μ + ⊤ v be the minimum-norm reconstruction coefficients of § 2 B, which reconstruct the orthogonal projection of O O O onto the span of the effects, and write O ⊥ = O − ∑ a w e x , a μ a O_\perp= O - \sum_a w_{\mathrm{ex},a}\mu_a O ⊥ = O − ∑ a w ex , a μ a for the inaccessible part. Since p i T w e x = Tr [ ( O − O ⊥ ) ρ i ] = y i − Tr ( O ⊥ ρ i ) p_i^{\mathsf T}w_{\mathrm{ex}} = \operatorname{Tr}[(O-O_\perp)\rho_i] = y_i - \operatorname{Tr}(O_\perp\rho_i) p i T w ex = Tr [( O − O ⊥ ) ρ i ] = y i − Tr ( O ⊥ ρ i ) , the residuals differ from the predictions of w e x w_{\mathrm{ex}} w ex on the measured training frequencies by the residual
r N , i = y i − p ^ i T w e x = Tr ( O ⊥ ρ i ) − ( p ^ i − p i ) T w e x . (25) r_{N,i} = y_i - \hat{p}_i^{\mathsf T}w_{\mathrm{ex}} = \operatorname{Tr}(O_\perp\rho_i) - (\hat{p}_i - p_i)^{\mathsf T}w_{\mathrm{ex}}. \tag*{(25)} r N , i = y i − p ^ i T w ex = Tr ( O ⊥ ρ i ) − ( p ^ i − p i ) T w ex . (25)
The first contribution is the inaccessible part of the target and survives even for exact training probabilities; the second is measurement noise. Above informational completeness, O ⊥ = 0 O_\perp= 0 O ⊥ = 0 and only the noise term remains.
Amplification of inaccessible residuals — Least squares corrects w e x w_{\mathrm{ex}} w ex so as to reproduce this residual on the training states: it seeks a correction w ^ N − w e x \hat{w}_N - w_{\mathrm{ex}} w ^ N − w ex with P N T ( w ^ N − w e x ) ≈ r N P_N^{\mathsf T}(\hat{w}_N - w_{\mathrm{ex}}) \approx r_N P N T ( w ^ N − w ex ) ≈ r N . Let s j > 0 s_j > 0 s j > 0 be a singular value of P ^ N \hat{P}_N P ^ N , with left (outcome) and right (training) singular vectors u j ∈ R n o u t u_j \in\mathbb{R}^{n_{\mathrm{out}}} u j ∈ R n out and v j ∈ R n t r v_j \in\mathbb{R}^{n_{\mathrm{tr}}} v j ∈ R n tr . Writing y = P ^ N T w e x + r N y = \hat{P}_N^{\mathsf T}w_{\mathrm{ex}} + r_N y = P ^ N T w ex + r N and using ( P ^ N T ) + = ∑ j u j v j T / s j (\hat{P}_N^{\mathsf T})^+ = \sum_j u_jv_j^{\mathsf T}/s_j ( P ^ N T ) + = ∑ j u j v j T / s j , the minimum-norm solution w ^ N = ( P ^ N T ) + y \hat{w}_N = (\hat{P}_N^{\mathsf T})^+y w ^ N = ( P ^ N T ) + y of eq. (3) satisfies
u j T ( w ^ N − w e x ) = v j T r N s j . (26) u_j^{T}(\hat{w}_N-w_{\mathrm{ex}})=\frac{v_j^{T}r_N}{s_j}. \tag*{(26)} u j T ( w ^ N − w ex ) = s j v j T r N . (26)
Each right singular vector v j v_j v j defines a combination of training states whose measured frequency vectors add up to ∑ i ( v j ) i p ^ i = P ^ N v j = s j u j \sum_i(v_j)_i\hat{p}_i=\hat{P}_Nv_j=s_ju_j ∑ i ( v j ) i p ^ i = P ^ N v j = s j u j ; for small s j s_j s j , these frequency vectors nearly cancel. To reproduce the component v j T r N = ∑ i ( v j ) i r N , i v_j^{T}r_N=\sum_i(v_j)_ir_{N,i} v j T r N = ∑ i ( v j ) i r N , i of the residual on such a combination, the weights must change by v j T r N / s j v_j^{T}r_N/s_j v j T r N / s j along u j u_j u j . Near n o u t = n t r n_{\mathrm{out}}=n_{\mathrm{tr}} n out = n tr , the matrix P ^ N \hat{P}_N P ^ N is nearly square and has singular values close to zero, and the resulting large weights inflate the test variance. Because these weights also change the reconstructed observable, adapting it to the inaccessible values Tr ( O ⊥ ρ i ) \operatorname{Tr}(\mathcal{O}_{\perp}\rho_i) Tr ( O ⊥ ρ i ) on the training states but not on new states, they inflate the ideal-test error as well.
Small singular values without shot noise — Unlike above informational completeness, these small singular values are already present in the exact feature matrix P P P . Its columns p i p_i p i are random because the training states are random, and near n o u t = n t r n_{\mathrm{out}}=n_{\mathrm{tr}} n out = n tr the matrix is nearly square, as in random-design regression [21 ] . The near-singularity thus belongs to the finite training set rather than to the measurement frame, and it occurs even if the POVM resolves all the operator directions it can access equally well. To isolate this effect, we remove the constant part absorbed by the intercept of the fit and consider the centered exact matrix P − p ˉ 1 n t r T P-\bar{p}\mathbf{1}_{n_{\mathrm{tr}}}^{T} P − p ˉ 1 n tr T , whose columns are the deviations of the exact probability vectors from their training mean p ˉ \bar{p} p ˉ , with 1 n t r \mathbf{1}_{n_{\mathrm{tr}}} 1 n tr the all-ones vector.
vectors from their training mean p ˉ \bar{p} p ˉ , with 1 n t r \mathbf{1}_{n_{\mathrm{tr}}} 1 n tr the all-ones vector. For Haar pure training states, unitary invariance makes these columns nearly independent and isotropic on the n o u t − 1 n_{\mathrm{out}}-1 n out − 1 nonconstant outcome directions, so the centered matrix behaves like a square random matrix with independent columns. Take, for instance, a POVM whose rescaled traceless frame has all its nonzero eigenvalues equal to some x 0 > 0 x_0>0 x 0 > 0 . The squared singular values of the suitably rescaled centered matrix then follow the Marchenko–Pastur law with lower edge x 0 ( 1 − γ ) 2 x_0(1-\sqrt{\gamma})^2 x 0 ( 1 − γ ) 2 , where γ \gamma γ is the limit of ( n o u t − 1 ) / n t r (n_{\mathrm{out}}-1)/n_{\mathrm{tr}} ( n out − 1 ) / n tr (lemma E1). The lower edge reaches zero at γ = 1 \gamma=1 γ = 1 , where the limiting density diverges as x − 1 / 2 x^{-1/2} x − 1/2 , and the inverse moment of its positive part diverges as ∣ γ − 1 ∣ − 1 |\gamma-1|^{-1} ∣ γ − 1 ∣ − 1 , as for the measurement frame at n o u t = d 2 n_{\mathrm{out}}=d^2 n out = d 2 . A target whose residual has negligible projection on small singular directions need not display the peak, so this divergence alone is not a statement about individual observables.
Effect of finite shots — Finite-shot noise adds a random matrix to the centered features. This changes their singular values, but does not in general move the smallest ones away from zero at n o u t = n t r n_{\mathrm{out}}=n_{\mathrm{tr}} n out = n tr . Such a gap, i.e., a lower bound on the singular values that stays positive as d → ∞ d\to\infty d → ∞ , would keep the factors 1 / s j 1/s_j 1/ s j in eq. (26) bounded and remove the peak. A gap does open for the classical peak when n t r ≫ n o u t n_{\mathrm{tr}}\gg n_{\mathrm{out}} n tr ≫ n out : there, the noise contribution to P ^ N P ^ N T \hat{P}_N\hat{P}_N^{T} P ^ N P ^ N T concentrates around a multiple of the identity on the nonconstant outcome directions and lifts every eigenvalue (§ 3 D). At n o u t = n t r n_{\mathrm{out}}=n_{\mathrm{tr}} n out = n tr , instead, the noise is itself a nearly square random matrix. As an illustration, model the centered exact features and the shot noise by independent Gaussian matrices with independent entries, of variances α x 0 / n t r \alpha x_0/n_{\mathrm{tr}} α x 0 / n tr and 1 / n t r 1/n_{\mathrm{tr}} 1/ n tr , respectively, in the shot-noise units in which the scaled ridge parameter η \eta η is defined eq. (191) . Their sum is again such a Gaussian matrix, with entry variance ( 1 + α x 0 ) / n t r (1+\alpha x_0)/n_{\mathrm{tr}} ( 1 + α x 0 ) / n tr , so its spectrum still reaches zero at γ = 1 \gamma=1 γ = 1 . At γ = 1 \gamma=1 γ = 1 , the squared norm of the ridge weights fitted to a residual with no preferred direction then grows as [ 4 ( 1 + α x 0 ) η ] − 1 / 2 [4(1+\alpha x_0)\eta]^{-1/2} [ 4 ( 1 + α x 0 ) η ] − 1/2 as η → 0 \eta\to0 η → 0 eq. (192) , rather than remaining bounded. Finite shots thus lower the peak without removing it, as Figure 12 shows for actual multinomial records.
Figure 12. Interpolation below informational completeness. Parameters: d = 8 d = 8 d = 8 , n o u t = 32 < d 2 n_{\mathrm{out}} = 32 < d^2 n out = 32 < d 2 (κ ≈ 2.0 \kappa\approx2.0 κ ≈ 2.0 ). (a) Small-eigenvalue spectra of centered exact and N = 64 N = 64 N = 64 -shot training matrices at n t r = 32 n_{\mathrm{tr}} = 32 n tr = 32 . (b) Target-averaged physical test variance as n t r n_{\mathrm{tr}} n tr crosses interpolation, for N = 16 , 64 , 256 N = 16, 64, 256 N = 16 , 64 , 256 and η = 10 − 3 \eta= 10^{-3} η = 1 0 − 3 . Histograms and medians use 1024 independent Haar and multinomial realizations; shading indicates 10th–90th percentiles and dashed curves are the analytical Haar predictions.
Condition for a singular profile — Whether this hard edge produces a singular profile at finite α \alpha α is decided by comparing the state-dependent signal with shot noise. Two sources of variability compete in the measured features: the exact probability vectors differ from one training state to another, which is the signal to be learned, and each of these vectors is estimated from only N N N shots. To compare them, we use the training-averaged single-shot covariance Σ ‾ t r \overline{\Sigma}_{\mathrm{tr}} Σ tr of eq. (13) . Define λ j \lambda_j λ j , j = 1 , … , n o u t − 1 j=1,\ldots,n_{\mathrm{out}}-1 j = 1 , … , n out − 1 , as the squared singular values, including zeros, of
N n t r − 1 ( Σ ‾ t r + ) 1 / 2 ( P − p ˉ 1 n t r T ) . (27) \sqrt{N n_{\mathrm{tr}}^{-1}}\left(\overline{\Sigma}_{\mathrm{tr}}^{+}\right)^{1/2}\left(P-\bar{p}\mathbf{1}_{n_{\mathrm{tr}}}^{T}\right). \tag*{(27)} N n tr − 1 ( Σ tr + ) 1/2 ( P − p ˉ 1 n tr T ) . (27)
The factor ( Σ ‾ t r + ) 1 / 2 \left(\overline{\Sigma}_{\mathrm{tr}}^{+}\right)^{1/2} ( Σ tr + ) 1/2 measures the deviations of the exact probability vectors from their training mean in units of shot noise. The λ j \lambda_j λ j are therefore signal-to-shot-noise ratios: they measure the variation of an exact outcome combination between training states, relative to the fluctuations of its N N N -shot estimate eq. (151) , generalizing the ratios α x \alpha_x α x of section IV B. The singular profile eq. (19) rests on a positive solution ζ ∗ \zeta_* ζ ∗ of the critical equation (sections E 1 a and E 3 c)
1 n o u t − 1 ∑ j = 1 n o u t − 1 1 ζ ∗ + λ j = 1 , ζ ∗ > 0. (28) \frac{1}{n_{\mathrm{out}}-1}\sum_{j=1}^{n_{\mathrm{out}}-1}\frac{1}{\zeta_*+\lambda_j}=1,\qquad\zeta_*>0. \tag*{(28)} n out − 1 1 j = 1 ∑ n out − 1 ζ ∗ + λ j 1 = 1 , ζ ∗ > 0. (28)
Since the left-hand side decreases with ζ ∗ \zeta_* ζ ∗ , a positive solution exists if and only if
1 n o u t − 1 ∑ j = 1 n o u t − 1 λ j − 1 > 1 , (29) \frac{1}{n_{\mathrm{out}}-1}\sum_{j=1}^{n_{\mathrm{out}}-1}\lambda_j^{-1}>1, \tag*{(29)} n out − 1 1 j = 1 ∑ n out − 1 λ j − 1 > 1 , (29)
where a zero eigenvalue contributes + ∞ +\infty + ∞ . Above informational completeness this condition holds automatically: the centered exact probabilities span at most d 2 − 1 d^2-1 d 2 − 1 of the n o u t − 1 n_{\mathrm{out}}-1 n out − 1 nonconstant outcome directions, whereas shot noise acts on all of them, so that at least n o u t − d 2 n_{\mathrm{out}}-d^2 n out − d 2 of the λ j \lambda_j λ j vanish. These are the noise-only directions of section IV B, and they are the reason why theorems 3 and 4 need no spectral assumption. Below informational completeness, the exact features can occupy all n o u t − 1 n_{\mathrm{out}}-1 n out − 1 nonconstant directions, so no eigenvalue is forced to vanish, and the condition holds only if sufficiently many signal directions are weak compared with shot noise. Equivalently, multiplying eq. (28) by ζ ∗ \zeta_* ζ ∗ gives ζ ∗ = 1 − ( n o u t − 1 ) − 1 ∑ j λ j / ( ζ ∗ + λ j ) \zeta_* = 1-(n_{\mathrm{out}}-1)^{-1}\sum_j\lambda_j/(\zeta_*+\lambda_j) ζ ∗ = 1 − ( n out − 1 ) − 1 ∑ j λ j / ( ζ ∗ + λ j ) . The normalized sum is the fraction of nonconstant outcome directions in which the state-dependent signal is resolved above the self-consistent noise level ζ ∗ \zeta_* ζ ∗ , and ζ ∗ \zeta_* ζ ∗ is the fraction left unresolved. For the equal-strength POVM above, the hard edge of the exact features makes the left-hand side of eq. (29) diverge as γ Q = 1 \gamma_Q=1 γ Q = 1 , so that the condition holds at every finite α \alpha α .
Theorem 5 (Incomplete interpolation peak (informal)). Assume κ > 1 \kappa>1 κ > 1 , γ → 1 \gamma\to1 γ → 1 , fixed α ∈ ( 0 , ∞ ) \alpha\in(0,\infty) α ∈ ( 0 , ∞ ) , conditions (i)–(iii) of theorem 3, a POVM whose rescaled traceless frame has a positive average eigenvalue, a positive solution of eq. (28) bounded away from zero, and the trace regularity of theorem E3. For independent multinomial training records, traceless targets averaged as in § 2 and Haar test states, with a training mean approaching the maximally mixed state, ∥ ρ ˉ − I d / d ∥ F → 0 \lVert\bar{\rho}-I_d/d\rVert_F\to0 ∥ ρ ˉ − I d / d ∥ F → 0 , the target-averaged physical variance and ideal-test error have the same ridge-rounded singular denominator as in eq. (19) , with positive amplitudes. At interpolation the target-averaged minimum-norm variance diverges in probability; the ideal-test error also diverges when the accessible traceless POVM frame is uniformly well conditioned.
Below informational completeness the interpolation peak is therefore conditional on eq. (29) , whereas above completeness the noise-only directions guarantee it.
Haar-random measurements — For Haar pure training states and normalized Haar-rank-one POVMs, the amplitudes are again given by eq. (22) , now with κ > 1 \kappa>1 κ > 1 , where ν = μ M P , κ \nu=\mu_{\mathrm{MP},\kappa} ν = μ MP , κ has an atom of mass 1 − 1 / κ 1-1/\kappa 1 − 1/ κ at zero. At small α \alpha α , C V = α + O ( α 2 ) C_V=\alpha+O(\alpha^2) C V = α + O ( α 2 ) and C G = κ α + O ( α 2 ) C_G=\kappa\alpha+O(\alpha^2) C G = κ α + O ( α 2 ) ; at large α \alpha α ,
C V ⟶ 1 κ , C G ⟶ 1 − 1 κ , h ∼ 1 ( κ − 1 ) α . (30) C_V\longrightarrow\frac{1}{\kappa},\qquad C_G\longrightarrow1-\frac{1}{\kappa},\qquad h\sim\frac{1}{(\kappa-1)\alpha}. \tag*{(30)} C V ⟶ κ 1 , C G ⟶ 1 − κ 1 , h ∼ ( κ − 1 ) α 1 . (30)
The singular amplitude of the ideal-test error no longer vanishes with increasing training precision: the inaccessible part of the target persists even with exact features. For 1 < κ < 2 1<\kappa<2 1 < κ < 2 , C G C_G C G is also nonmonotonic and reaches κ / 4 \kappa/4 κ /4 before approaching its large-shot limit. The interpolation peaks above and below informational completeness, driven by shot noise and by inaccessible target components, respectively, thus differ both in mechanism and in their scaling with measurement resources.
Conclusions and perspectives
In this work, we have investigated how finite quantum measurement statistics affect the generalization properties of quantum linear regression, with quantum extreme learning machines as a particularly relevant setting. We have shown that the interplay between the geometry of quantum measurements and the statistical fluctuations of their outcomes can give rise to a triple-descent behavior as the number of measurement outcomes increases. The triple descent originates from two distinct spectral instabilities, which occur at different thresholds and respond differently to finite measurement statistics.
Classical peak — The first peak arises near informational completeness, when the number of outcomes approaches the dimension d 2 d^2 d 2 of operator space. In this regime, small eigenvalues of the POVM frame make the reconstruction of certain observables increasingly sensitive to measurement fluctuations. This instability is already present when the training probabilities are known exactly, and its asymptotic behavior can be understood through the spectrum of random quantum measurements. Interestingly, finite training statistics can suppress this classical peak, illustrating how measurement noise can sometimes have an effective regularizing role.
Two interpolation mechanisms — Above informational completeness, the interpolation peak at n o u t = n t r > d 2 n_{\mathrm{out}} = n_{\mathrm{tr}} > d^2 n out = n tr > d 2 has a fundamentally different origin: statistical fluctuations populate directions absent from the exact quantum feature representation. Our analysis of multinomial measurement records establishes that the test variance grows at this threshold for typical training realizations, rather than only through rare events. Away from interpolation, we derive deterministic high-dimensional profiles for both the test variance and the error that remains when test probabilities are known exactly. Their singular behavior is governed by the distance from interpolation, while the measurement-frame spectrum and the training-shot budget determine its magnitude. At fixed dimension, the peak in the test variance saturates as the number of training shots grows, yet it is absent when the training features are exact: the limits N → ∞ N \to\infty N → ∞ and N = ∞ N = \infty N = ∞ do not commute, which is the clearest signature of the quantum origin of the peak. Below informational completeness, the interpolation peak is instead classical: it is driven by target components that the measurement cannot access, it is present with exact feature vectors, and finite statistics change its amplitude without generally removing it.
Training shots and regularization — These results reveal a subtle relationship between measurement precision and learning stability. Increasing the number of shots improves the accuracy of individual quantum features, but does not necessarily reduce the variance of the resulting predictor. Conversely, very limited statistics may suppress unstable directions by leaving the empirical feature matrix rank deficient, without necessarily improving prediction accuracy. We have also shown that ridge regularization provides a controlled way to mitigate the quantum peak. A positive ridge parameter makes the limiting prediction-error profiles finite at interpolation, while the peak height grows as the inverse square root of the ridge parameter when regularization is weakened. The optimal choice depends on both training and test measurement resources, since suppressing statistical fluctuations must be balanced against the loss of predictive information.
Estimator and measurement design — Several questions remain open. One is to characterize more precisely the behavior at the quantum interpolation threshold, including the finite-size scaling and distribution of the peak height. Another is whether the quantum peak can be avoided by training methods that exploit the structure of quantum features. Because it originates in outcome directions that exact Born probabilities cannot occupy, the quantum peak is tied to the least-squares estimator rather than to the measurement, and we expect estimators that discard these directions, for instance by restricting the fit to a d 2 d^2 d 2 -dimensional feature subspace, to suppress it. The classical peak, in contrast, is tied to the measurement: for informationally complete POVMs with equal effect traces, the minimum-norm reconstruction already minimizes the average test variance among unbiased linear estimators (section III A), so that the classical peak can only be traded against bias, as ridge regularization does, or avoided by redesigning the measurement. A related question concerns the design of quantum measurements for learning. Our results show that informational completeness alone does not guarantee stable predictions: the spectrum of the measurement frame and its interplay with finite sampling are equally important. This suggests exploring POVMs designed to optimize generalization performance, rather than reconstruction accuracy alone, and investigating how measurement geometry, shot allocation, and regularization can be jointly optimized under a fixed experimental budget.
Beyond linear regression — A further direction is to understand whether the mechanisms identified here extend beyond linear regression. Particularly relevant settings include nonlinear classical readouts, quantum models with multiple data injections and quantum memory, and learning algorithms based on quantum fidelity kernels. In these architectures, the relationship between quantum measurements and the effective feature representation can be considerably more complex, and finite sampling may introduce different correlations and spectral instabilities. Understanding whether analogous double- or triple-descent phenomena arise, and how they depend on the structure of the model and the available quantum resources, remains an interesting open problem.
Broader implication — More broadly, our findings show that finite measurement statistics cannot always be regarded as a small perturbation of an ideal quantum learning model. They can fundamentally alter the geometry of the learning problem, with consequences for both generalization and the efficient use of quantum measurement resources.
Acknowledgements
We are grateful to S. Meyer, E. Yilmaz, A. Lucchi, F. Tacchino, and F. Scala for insightful discussions about their work [32 ] , which addresses aspects complementary to those investigated here. We thank Alessandro Romancino for helpful discussions. GLM acknowledges funding from the European Union–NextGenerationEU through the Italian Ministry of University and Research under PNRR-M4C2-I1.3 Project PE-00000019 “HEAL ITALIA” (CUP B73C22001250006). SL, AF, and GMP acknowledge support by MUR under PRIN Project No. 2022FEXLYB, Quantum Reservoir Computing (QuReCo). LI, SL, MP, and GMP acknowledge funding from the “National Centre for HPC, Big Data and Quantum Computing (HPC)” Project CN00000013, HyQELM–Spoke 10. MP is grateful for support from the Royal Society Wolfson Fellowship (RSWF/R3/183013), the Department for the Economy of Northern Ireland under the US-Ireland R&D Partnership Programme, the PNRR PE Italian National Quantum Science and Technology Institute (PE0000023), and the EU Horizon Europe EIC Pathfinder project QuCoM (GA no. 1003223).
Supplemental Material
Here we discuss separately the two mechanisms discussed in the main text: weakly resolved measurement directions near informational completeness (n o u t = d 2 n_{\mathrm{out}} = d^2 n out = d 2 ), and small singular directions of the measured training matrix near interpolation (n o u t = n t r n_{\mathrm{out}} = n_{\mathrm{tr}} n out = n tr ). Appendix A fixes operator coordinates, norms, asymptotic conventions, and the target and test-state averages. These conventions specify which error is being studied and which randomness remains in the main-text spectral and regression claims. Appendix § 5.6 proves the Haar-POVM spectrum used in § 3 B: a bulk of state-dependent directions, an identity outlier, and exact zero modes when outcomes are insufficient. It also treats the finite-dimensional outlier correction and fixed-rank extensions. Appendix C turns this spectrum into the classical test-variance peak of § 3 C. Small eigenvalues are inverted by the shadow readout, so their total inverse weight requires control beyond a limiting spectral density. The final subsections relate the shadow result to exact-feature training and derive the shot-averaged training loss used in § 3 D. Appendix § 5.14 develops the common regression calculation behind sections IV B, IV C and V. It separates training signal from shot noise, evaluates a centered auxiliary fit at positive ridge, and restores the empirical mean needed for the physical readout and its ideal-test error. Appendix § 5.7 derives the peak near n o u t = n t r n_{\mathrm{out}} = n_{\mathrm{tr}} n out = n tr . Above informational completeness, signal-free outcome directions force a critical solution. Below completeness, a positive-root condition identifies when weak training directions still produce a peak. The section gives amplitudes and ridge rounding, and distinguishes positive-ridge limits from claims about the actual minimum-norm estimator. Appendix § 5.15 adds the regular background to the Haar-training curves used in section IV C, then treats finite records and fixed training-shot budgets. These limits explain why the proportional interpolation divergence does not imply infinite error at fixed resources. Appendix § 5.16 collects the spectral comparisons, Gaussian-lift bounds, and covariance-resolvent calculations used in the proofs. The physical results and their assumptions can be read first, returning to these estimates at their cited uses.
Conventions and preliminaries
The spectral and regression arguments use a common separation between the identity response and the state-dependent, traceless operator directions. Appendix A1 fixes the coordinates, matrix operations, and probabilistic limits; Section A2 specifies the target and test-state averages used in the main-text error profiles.
Coordinates and asymptotic notation
The learning problem of § 2 uses outcome probabilities p a ( ρ i ) = Tr ( μ a ρ i ) p_a(\rho_i) = \operatorname{Tr}(\mu_a\rho_i) p a ( ρ i ) = Tr ( μ a ρ i ) as features and exact expectation values y i = Tr ( O ρ i ) y_i = \operatorname{Tr}(\mathcal{O}\rho_i) y i = Tr ( O ρ i ) as labels. Each training state is measured N N N times, and a fitted outcome-weight vector predicts a new state’s label from M M M test measurements. Operator coordinates turn the Born features into matrix products; the conventions below distinguish exact identities from large-dimension statements.
Two contributions to prediction error — For fixed training data, weights w w w reconstruct the observable O ~ w = ∑ a w a μ a \widetilde{\mathcal{O}}_w = \sum_a w_a\mu_a O w = ∑ a w a μ a . As in § 2 B, for a fixed target, Haar test-state and test-shot averaging gives $\operatorname{MSE}_{N,M,\tau}(\mathcal{O}) = \mathcal{E}_{N,\tau}(\mathcal{O}) + V N , τ ( O ) / M V_{N,\tau}(\mathcal{O})/M V N , τ ( O ) / M : the ideal-test error is E N , τ ( O ) = E σ [ Tr ( ( O ~ w − O ) σ ) 2 ] \mathcal{E}_{N,\tau}(\mathcal{O})=\mathbb{E}_{\sigma}\left[\operatorname{Tr}\left((\widetilde{\mathcal{O}}_{w}-\mathcal{O})\sigma\right)^2\right] E N , τ ( O ) = E σ [ Tr ( ( O w − O ) σ ) 2 ] , while V N , τ ( O ) = w T Σ t e w V_{N,\tau}(\mathcal{O})=w^{T}\Sigma_{\mathrm{te}}w V N , τ ( O ) = w T Σ te w measures sensitivity to test-shot fluctuations, with w = w ^ N , τ w=\widehat{w}_{N,\tau} w = w N , τ and Σ t e \Sigma_{\mathrm{te}} Σ te the single-shot outcome covariance averaged over Haar test states. The training-shot count N N N and ridge penalty τ \tau τ enter through the fitted weights. Dropping the argument O \mathcal{O} O denotes the average over a random target drawn from definition 1. All costs still depend on the training record; averages over the apparatus, the training states, or the record are taken only when stated.
Operator coordinates and traceless compression — Represent Hermitian operators on H ≃ C d \mathcal{H}\simeq\mathbb{C}^{d} H ≃ C d in an orthonormal Hermitian basis ( η j ) j = 1 d 2 (\eta_j)_{j=1}^{d^2} ( η j ) j = 1 d 2 for ⟨ A , B ⟩ = Tr ( A † B ) \langle A,B\rangle=\operatorname{Tr}(A^\dagger B) ⟨ A , B ⟩ = Tr ( A † B ) . Their real coordinates ( v A ) j = Tr ( η j A ) (v_A)_j=\operatorname{Tr}(\eta_j A) ( v A ) j = Tr ( η j A ) satisfy v A T v B = ⟨ A , B ⟩ v_A^T v_B=\langle A,B\rangle v A T v B = ⟨ A , B ⟩ ; vec ( A ) \operatorname{vec}(A) vec ( A ) denotes the same vector unless another vectorization is specified. For the n t r n_{\mathrm{tr}} n tr training states, M ρ = [ v ρ 1 ⋯ v ρ n t r ] M_\rho=[v_{\rho_1}\ \cdots\ v_{\rho_{n_{\mathrm{tr}}}}] M ρ = [ v ρ 1 ⋯ v ρ n tr ] . The measurement matrix M μ M_\mu M μ is defined analogously, and P = ⟨ μ , ρ ⟩ = M μ T M ρ P=\langle\mu,\rho\rangle=M_\mu^T M_\rho P = ⟨ μ , ρ ⟩ = M μ T M ρ is the n o u t × n t r n_{\mathrm{out}}\times n_{\mathrm{tr}} n out × n tr Born probability matrix. The operator space has dimension d 2 d^2 d 2 ; its traceless sector and orthogonal projector are
L ( H ) 0 = { A : Tr ( A ) = 0 } , P 0 = I d 2 − v I d v I d T d . (31) \mathcal{L}(\mathcal{H})_0=\{A:\operatorname{Tr}(A)=0\},\qquad P_0=I_{d^2}-\frac{v_{I_d}v_{I_d}^{T}}{d}. \tag*{(31)} L ( H ) 0 = { A : Tr ( A ) = 0 } , P 0 = I d 2 − d v I d v I d T . (31)
A compression to this sector means P 0 A P 0 P_0 A P_0 P 0 A P 0 restricted to its ( d 2 − 1 ) (d^2-1) ( d 2 − 1 ) -dimensional range. The identity and inverses on the sector are understood in this restricted sense.
Norms, inverses, and sampled matrices — Bold Latin symbols denote vectors and matrices. Unsubscripted vector norms are Euclidean. Matrix and operator norms carry an explicit subscript: ∥ ⋅ ∥ o p \|\cdot\|_{\mathrm{op}} ∥ ⋅ ∥ op is the spectral norm and ∥ A ∥ F 2 = Tr ( A † A ) \|A\|_{\mathrm{F}}^2=\operatorname{Tr}(A^\dagger A) ∥ A ∥ F 2 = Tr ( A † A ) defines the Frobenius norm. For a linear map on operators, ∥ ⋅ ∥ o p \|\cdot\|_{\mathrm{op}} ∥ ⋅ ∥ op is induced by the Frobenius norm, equivalently the spectral norm in orthonormal operator coordinates. The entrywise maximum norm is ∥ A ∥ max = max i j ∣ A i j ∣ \|A\|_{\max}=\max_{ij}|A_{ij}| ∥ A ∥ m a x = max ij ∣ A ij ∣ . The Moore–Penrose inverse A + A^+ A + inverts nonzero singular values and sets zero modes to zero; λ min + ( A ) \lambda_{\min}^{+}(A) λ m i n + ( A ) is the smallest positive eigenvalue, and Π μ = M μ M μ + \Pi_\mu=M_\mu M_\mu^+ Π μ = M μ M μ + projects onto the measurement-visible operator subspace. Hats identify sampled quantities; removing a hat need not denote an expectation. In particular, N N N training shots give P ^ N = P + N − 1 / 2 Ξ ^ \widehat{P}_N=P+N^{-1/2}\widehat{\Xi} P N = P + N − 1/2 Ξ , while test records use M M M shots. We use γ o u t = d 2 / n o u t \gamma_{\mathrm{out}}=d^2/n_{\mathrm{out}} γ out = d 2 / n out , γ t r = d 2 / n t r \gamma_{\mathrm{tr}}=d^2/n_{\mathrm{tr}} γ tr = d 2 / n tr , and γ Q = n o u t / n t r \gamma_Q=n_{\mathrm{out}}/n_{\mathrm{tr}} γ Q = n out / n tr ; any finite-dimensional adjustment to these ratios is stated where needed.
Probabilistic limits and medians — For random X j X_j X j and deterministic a j > 0 a_j>0 a j > 0 , X j = o P ( a j ) X_j=o_{\mathrm{P}}(a_j) X j = o P ( a j ) means X j / a j → 0 X_j/a_j\to0 X j / a j → 0 in probability, and X j = O P ( a j ) X_j=O_{\mathrm{P}}(a_j) X j = O P ( a j ) means that ∣ X j ∣ / a j |X_j|/a_j ∣ X j ∣/ a j is tight: for every ε > 0 \varepsilon>0 ε > 0 , some finite C ε C_\varepsilon C ε bounds P ( ∣ X j ∣ > C ε a j ) \mathbb{P}(|X_j|>C_\varepsilon a_j) P ( ∣ X j ∣ > C ε a j ) by ε \varepsilon ε for all sufficiently large j j j . Almost-sure o ( a j ) o(a_j) o ( a j ) means X j / a j → 0 X_j/a_j\to0 X j / a j → 0 almost surely, and almost-sure O ( a j ) O(a_j) O ( a j ) means lim sup j ∣ X j ∣ / a j < ∞ \limsup_j|X_j|/a_j<\infty lim sup j ∣ X j ∣/ a j < ∞ almost surely. For vectors or matrices, these definitions apply to the stated norm; a j ≍ b j a_j\asymp b_j a j ≍ b j means their ratio is eventually bounded above and below by positive deterministic constants. The median is med X = inf { x : P ( X ≤ x ) ≥ 1 / 2 } \operatorname{med}X=\inf\{x:\mathbb{P}(X\le x)\ge1/2\} med X = inf { x : P ( X ≤ x ) ≥ 1/2 } . If X j / b j → c X_j/b_j\to c X j / b j → c in probability for deterministic b j > 0 b_j>0 b j > 0 and c c c , then med X j / b j → c \operatorname{med}X_j/b_j\to c med X j / b j → c , also under a conditional law with fixed apparatus.
Target ensembles and Haar moments
The main-text error profiles separate imperfect observable reconstruction from amplified test-shot fluctuations. Both costs are quadratic in the target and depend on the averages below; these are the moments used in § 3 C and IV B. At fixed target trace and Hilbert–Schmidt norm, Haar unitary rotations, sphere directions, and sign directions have the same traceless second moment, but their concentration properties must be treated separately.
Unitary target rotations — Classical variance averages use O U = U † O U \mathcal{O}_U=U^\dagger\mathcal{O}U O U = U † O U for Haar U U U and a fixed Hermitian O \mathcal{O} O . Its eigenvalue variance is Δ O 2 = Tr ( O 2 ) / d − ( Tr ( O ) / d ) 2 \Delta_{\mathcal{O}}^2=\operatorname{Tr}(\mathcal{O}^2)/d-(\operatorname{Tr}(\mathcal{O})/d)^2 Δ O 2 = Tr ( O 2 ) / d − ( Tr ( O ) / d ) 2 . Haar integration gives E U v O U = ( Tr ( O ) / d ) v I d \mathbb{E}_U v_{\mathcal{O}_U}=(\operatorname{Tr}(\mathcal{O})/d)v_{I_d} E U v O U = ( Tr ( O ) / d ) v I d and [38 , 39 ]
E U [ v O U v O U T ] = Tr ( O ) 2 d 2 v I d v I d T + d Δ O 2 d 2 − 1 P 0 . (32) \mathbb{E}_U[v_{\mathcal{O}_U}v_{\mathcal{O}_U}^{T}]
=\frac{\operatorname{Tr}(\mathcal{O})^2}{d^2}v_{I_d}v_{I_d}^{T}
+\frac{d\Delta_{\mathcal{O}}^2}{d^2-1}P_0. \tag*{(32)} E U [ v O U v O U T ] = d 2 Tr ( O ) 2 v I d v I d T + d 2 − 1 d Δ O 2 P 0 . (32)
Haar test states — For an independent Haar pure state, E ρ v ρ = v I d / d \mathbb{E}_{\rho}v_{\rho}=v_{I_d}/d E ρ v ρ = v I d / d and
E ρ [ v ρ v ρ T ] = I d 2 + v I d v I d T d ( d + 1 ) . (33) \mathbb{E}_{\rho}[v_{\rho}v_{\rho}^{T}]
=\frac{I_{d^2}+v_{I_d}v_{I_d}^{T}}{d(d+1)}. \tag*{(33)} E ρ [ v ρ v ρ T ] = d ( d + 1 ) I d 2 + v I d v I d T . (33)
Averaged test-shot covariance — Write ω a = Tr ( μ a ) \omega_a=\operatorname{Tr}(\mu_a) ω a = Tr ( μ a ) for the effect traces, p I d , a = ω a / d p_{I_d,a}=\omega_a/d p I d , a = ω a / d , D ρ = diag p ( ρ ) D_\rho=\operatorname{diag}p(\rho) D ρ = diag p ( ρ ) , and Σ ( ρ ) = D ρ − p ( ρ ) p ( ρ ) T \Sigma(\rho)=D_\rho-p(\rho)p(\rho)^T Σ ( ρ ) = D ρ − p ( ρ ) p ( ρ ) T . The state moments give E p a = ω a / d \mathbb{E}p_a=\omega_a/d E p a = ω a / d and E [ p a p b ] = ( ω a ω b + Tr ( μ a μ b ) ) / [ d ( d + 1 ) ] \mathbb{E}[p_a p_b]=(\omega_a\omega_b+\operatorname{Tr}(\mu_a\mu_b))/[d(d+1)] E [ p a p b ] = ( ω a ω b + Tr ( μ a μ b )) / [ d ( d + 1 )] . Thus, for every POVM, the Haar-averaged categorical covariance is
Σ ‾ t e = D I d − ω ω T + G μ d ( d + 1 ) , Σ ‾ t e 1 n o u t = 0 , (34) \overline{\Sigma}_{\mathrm{te}} = \frac{D_I}{d} - \frac{\omega\omega^{T} + \mathcal{G}_{\mu}}{d(d+1)}, \qquad\overline{\Sigma}_{\mathrm{te}}1_{n_{\mathrm{out}}}=0, \tag*{(34)} Σ te = d D I − d ( d + 1 ) ω ω T + G μ , Σ te 1 n out = 0 , (34)
where G μ = M μ T M μ \mathcal{G}_{\mu}=M_{\mu}^{T}M_{\mu} G μ = M μ T M μ .
Haar average of a squared expectation value — The ideal-test error and the training loss with exact features are both Haar averages of squared expectation values. The following lemma gives their exact form.
Lemma A1 (Haar average of a squared expectation value). For every Hermitian operator D D D and a Haar-random pure state σ \sigma σ ,
E σ [ Tr ( D σ ) 2 ] = Tr ( D 2 ) + ( Tr D ) 2 d ( d + 1 ) = Tr ( D 0 2 ) d ( d + 1 ) + ( Tr D d ) 2 , (35) \mathbb{E}_{\sigma}\left[\operatorname{Tr}(D\sigma)^{2}\right] = \frac{\operatorname{Tr}(D^{2})+(\operatorname{Tr}D)^{2}}{d(d+1)} = \frac{\operatorname{Tr}(D_{0}^{2})}{d(d+1)}+\left(\frac{\operatorname{Tr}D}{d}\right)^{2}, \tag*{(35)} E σ [ Tr ( D σ ) 2 ] = d ( d + 1 ) Tr ( D 2 ) + ( Tr D ) 2 = d ( d + 1 ) Tr ( D 0 2 ) + ( d Tr D ) 2 , (35) where D 0 = D − ( Tr ( D ) / d ) I d D_{0}=D-(\operatorname{Tr}(D)/d)I_{d} D 0 = D − ( Tr ( D ) / d ) I d . In particular, for outcome weights w w w and a target O O O , the ideal-test error of eq. (5) averaged over Haar test states is
d ( d + 1 ) E ( O ) = ∥ P 0 M μ w − v O 0 ∥ 2 + d ( d + 1 ) ( p I / d T w − c O ) 2 , (36) d(d+1)\mathcal{E}(O)=\left\|P_{0}M_{\mu}w-v_{O_{0}}\right\|^{2}+d(d+1)\left(p_{I/d}^{T}w-c_{O}\right)^{2}, \tag*{(36)} d ( d + 1 ) E ( O ) = ∥ P 0 M μ w − v O 0 ∥ 2 + d ( d + 1 ) ( p I / d T w − c O ) 2 , (36) with p I / d = p ( I d / d ) p_{I/d}=p(I_{d}/d) p I / d = p ( I d / d ) and c O = Tr ( O ) / d c_{O}=\operatorname{Tr}(O)/d c O = Tr ( O ) / d .
Proof. Since Tr ( D σ ) = v D T v σ \operatorname{Tr}(D\sigma)=v_{D}^{T}v_{\sigma} Tr ( D σ ) = v D T v σ , eq. (33) gives E σ [ Tr ( D σ ) 2 ] = [ ∥ v D ∥ 2 + ( v I d T v D ) 2 ] / [ d ( d + 1 ) ] = [ Tr ( D 2 ) + ( Tr D ) 2 ] / [ d ( d + 1 ) ] \mathbb{E}_{\sigma}[\operatorname{Tr}(D\sigma)^{2}]=[\|v_{D}\|^{2}+(v_{I_{d}}^{T}v_{D})^{2}]/[d(d+1)]=[\operatorname{Tr}(D^{2})+(\operatorname{Tr}D)^{2}]/[d(d+1)] E σ [ Tr ( D σ ) 2 ] = [ ∥ v D ∥ 2 + ( v I d T v D ) 2 ] / [ d ( d + 1 )] = [ Tr ( D 2 ) + ( Tr D ) 2 ] / [ d ( d + 1 )] . Inserting Tr ( D 2 ) = Tr ( D 0 2 ) + ( Tr D ) 2 / d \operatorname{Tr}(D^{2})=\operatorname{Tr}(D_{0}^{2})+(\operatorname{Tr}D)^{2}/d Tr ( D 2 ) = Tr ( D 0 2 ) + ( Tr D ) 2 / d gives the second form, because ( 1 + 1 / d ) ( Tr D ) 2 / [ d ( d + 1 ) ] = ( Tr D / d ) 2 (1+1/d)(\operatorname{Tr}D)^{2}/[d(d+1)]=(\operatorname{Tr}D/d)^{2} ( 1 + 1/ d ) ( Tr D ) 2 / [ d ( d + 1 )] = ( Tr D / d ) 2 . For eq. (36) , take D = O e w − O D=O_{e}w-O D = O e w − O , so that ( w T p σ − Tr ( O σ ) ) 2 = Tr ( D σ ) 2 (w^{T}p_{\sigma}-\operatorname{Tr}(O\sigma))^{2}=\operatorname{Tr}(D\sigma)^{2} ( w T p σ − Tr ( O σ ) ) 2 = Tr ( D σ ) 2 and v D = M μ w − v O v_{D}=M_{\mu}w-v_{O} v D = M μ w − v O . The traceless part has coordinates P 0 v D = P 0 M μ w − v O 0 P_{0}v_{D}=P_{0}M_{\mu}w-v_{O_{0}} P 0 v D = P 0 M μ w − v O 0 , and Tr ( D ) / d = ∑ a w a Tr ( μ a ) / d − c O = p I / d T w − c O \operatorname{Tr}(D)/d=\sum_{a}w_{a}\operatorname{Tr}(\mu_{a})/d-c_{O}=p_{I/d}^{T}w-c_{O} Tr ( D ) / d = ∑ a w a Tr ( μ a ) / d − c O = p I / d T w − c O .
Random target ensembles — The error profiles describe a typical target observable rather than a specific one. We therefore draw the target at random, independently of the measurement, the training states, and the counts, and average the quadratic costs over it. The definition below fixes the admissible ensembles: their second moments are the only input to target-averaged costs, whereas their concentration properties control the realized cost of a single draw.
Definition 1 (Target ensembles). Write a target as O = c O I d + O 0 O=c_{O}I_{d}+O_{0} O = c O I d + O 0 , with c O = Tr ( O ) / d c_{O}=\operatorname{Tr}(O)/d c O = Tr ( O ) / d and Tr ( O 0 ) = 0 \operatorname{Tr}(O_{0})=0 Tr ( O 0 ) = 0 , and assume
Tr ( O 0 2 ) = d Δ O 2 > 0 , ∣ c O ∣ d Δ O 2 ≤ C . (37) \operatorname{Tr}(O_{0}^{2})=d\Delta_{O}^{2}>0,\qquad\frac{\lvert c_{O}\rvert}{\sqrt{d\Delta_{O}^{2}}}\le C. \tag*{(37)} Tr ( O 0 2 ) = d Δ O 2 > 0 , d Δ O 2 ∣ c O ∣ ≤ C . (37) A random target is drawn independently of the apparatus, the training states, and the counts. Its invariants c O c_{O} c O and Δ O 2 \Delta_{O}^{2} Δ O 2 may be deterministic or random; in the latter case target averages E O \mathbb{E}_{O} E O are conditional on their values, and the bound in eq. (37) holds uniformly or with probability tending to one. Its normalized traceless direction v O 0 / d Δ O 2 v_{O_{0}}/\sqrt{d\Delta_{O}^{2}} v O 0 / d Δ O 2 follows one of three laws: (i) sphere : uniform on the real unit sphere of the traceless sector; (ii) sign : independent coordinates ± 1 / d 2 − 1 \pm1/\sqrt{d^{2}-1} ± 1/ d 2 − 1 in a fixed orthonormal traceless basis; (iii) unitary orbit : v U † Ω U v_{U^{\dagger}\Omega U} v U † Ω U for a fixed traceless Ω \Omega Ω with Tr ( Ω 2 ) = 1 \operatorname{Tr}(\Omega^{2})=1 Tr ( Ω 2 ) = 1 and a Haar unitary U U U .
By eq. (32) for law (iii), and by direct computation for (i) and (ii), all three laws share the isotropic moments
E O v O 0 = 0 , E O [ v O 0 v O 0 T ] = d Δ O 2 d 2 − 1 P 0 . (38) \mathbb{E}_{O}v_{O_{0}}=0,\qquad\mathbb{E}_{O}\left[v_{O_{0}}v_{O_{0}}^{T}\right]=\frac{d\Delta_{O}^{2}}{d^{2}-1}P_{0}. \tag*{(38)} E O v O 0 = 0 , E O [ v O 0 v O 0 T ] = d 2 − 1 d Δ O 2 P 0 . (38)
Law (iii) with Ω = O 0 / d Δ O 2 \Omega=O_{0}/\sqrt{d\Delta_{O}^{2}} Ω = O 0 / d Δ O 2 describes the rotated targets U † O U U^{\dagger}OU U † O U of § 2 B, and law (i) is the one used in our simulations. The laws differ in their concentration bounds (lemmas D9 and D10). Pure identity targets have Δ O 2 = 0 \Delta_{O}^{2}=0 Δ O 2 = 0 and are treated in lemma D8.
Spectrum of Haar-random rank-one POVMs
The spectral claim in § 3 B rests on two scales: the positive traces of the effects make their identity components add coherently, producing an outlier of order d / n o u t d/n_{\mathrm{out}} d / n out , while their centered components produce a bulk on the scale n o u t − 1 n_{\mathrm{out}}^{-1} n out − 1 . Appendix B1 separates these contributions using independent Gaussian vectors, and Appendix B2 establishes the bulk law and exact rank. Section B3 refines the outlier at finite dimension; Appendix B4 supplies the fixed-rank covariance laws used in the generalized peak amplitudes.
Gaussian construction and effect traces
Normalizing a Gaussian matrix into a Haar isometry enforces ∑ a μ a = I d \sum_a \mu_a = I_d ∑ a μ a = I d through a common inverse square root. The Gaussian lift below simply represents each rank-one matrix g g † g g^\dagger g g † as an operator-coordinate vector. When n o u t n_{\mathrm{out}} n out grows in proportion to d 2 d^2 d 2 , the common normalization approaches the identity, allowing the spectrum to be obtained from independent lifts. The trace estimate below also makes the mean outcome probabilities nearly uniform, as required to convert the spectrum into test variance.
Exact frame and Gram matrices — Sample a Haar isometry V μ ∈ C n o u t × d V_\mu\in\mathbb{C}^{n_{\mathrm{out}}\times d} V μ ∈ C n out × d , equivalently the first d d d columns of a Haar unitary in U ( n o u t ) U(n_{\mathrm{out}}) U ( n out ) [34 ] . For canonical basis vectors e a e_a e a , put v a = V μ † e a v_a = V_\mu^\dagger e_a v a = V μ † e a and μ a = v a v a † \mu_a = v_a v_a^\dagger μ a = v a v a † . Then ∑ a μ a = I d \sum_a \mu_a = I_d ∑ a μ a = I d , and
M μ = [ vec ( μ 1 ) ⋯ vec ( μ n o u t ) ] , G μ = M μ † M μ , F μ = M μ M μ † . (39) M_\mu= [\operatorname{vec}(\mu_1)\ \cdots\ \operatorname{vec}(\mu_{n_{\mathrm{out}}})], \qquad G_\mu= M_\mu^\dagger M_\mu, \qquad F_\mu= M_\mu M_\mu^\dagger. \tag*{(39)} M μ = [ vec ( μ 1 ) ⋯ vec ( μ n out )] , G μ = M μ † M μ , F μ = M μ M μ † . (39)
The Gram matrix compares effects with one another; the frame measures apparatus response along operator directions. For a Hermitian A A A , v A T F μ v A = ∑ a [ Tr ( A μ a ) ] 2 v_A^T F_\mu v_A = \sum_a [\operatorname{Tr}(A\mu_a)]^2 v A T F μ v A = ∑ a [ Tr ( A μ a ) ] 2 , so small frame eigenvalues identify weak probability responses. The two matrices are positive semidefinite and have the same nonzero spectrum. In particular, ( G μ ) a b = Tr ( μ a μ b ) = ∣ ( V μ V μ † ) a b ∣ 2 (G_\mu)_{ab} = \operatorname{Tr}(\mu_a\mu_b) = |(V_\mu V_\mu^\dagger)_{ab}|^2 ( G μ ) ab = Tr ( μ a μ b ) = ∣ ( V μ V μ † ) ab ∣ 2 , or G μ = ∣ V μ V μ † ∣ ∘ 2 G_\mu= |V_\mu V_\mu^\dagger|^{\circ2} G μ = ∣ V μ V μ † ∣ ∘ 2 , with entrywise squared modulus. We may use column-stacking coordinates for the following Gaussian calculations: the fixed unitary change from Hermitian coordinates preserves all spectra, norms, and inner products. The notation C N ( 0 , 1 ) \mathcal{CN}(0,1) C N ( 0 , 1 ) denotes a zero-mean circular complex Gaussian variable with mean squared modulus one.
Lemma B1 (Gaussian lift and rank). Let n o u t ≥ d n_{\mathrm{out}} \ge d n out ≥ d and let G ^ ∈ C n o u t × d \widehat{G} \in\mathbb{C}^{n_{\mathrm{out}}\times d} G ∈ C n out × d have independent C N ( 0 , 1 ) \mathcal{CN}(0,1) C N ( 0 , 1 ) entries, S = G ^ † G ^ / n o u t S = \widehat{G}^\dagger\widehat{G}/n_{\mathrm{out}} S = G † G / n out , and g ^ a = G ^ † e a \widehat{g}_a = \widehat{G}^\dagger e_a g a = G † e a . Define x a = vec ( g ^ a g ^ a † ) x_a = \operatorname{vec}(\widehat{g}_a\widehat{g}_a^\dagger) x a = vec ( g a g a † ) , X = [ x 1 , … , x n o u t ] X = [x_1,\ldots,x_{n_{\mathrm{out}}}] X = [ x 1 , … , x n out ] , and T = S − T / 2 ⊗ S − 1 / 2 T = S^{-T/2} \otimes S^{-1/2} T = S − T /2 ⊗ S − 1/2 . The exact Haar construction and lifted covariance are
V μ = G ^ S − 1 / 2 n o u t , M μ = T X n o u t , V_\mu= \frac{\widehat{G}S^{-1/2}}{\sqrt{n_{\mathrm{out}}}}, \qquad M_\mu= \frac{TX}{n_{\mathrm{out}}}, V μ = n out G S − 1/2 , M μ = n out T X , A = X X † n o u t , n o u t F μ = T A T † . (40) A = \frac{XX^\dagger}{n_{\mathrm{out}}}, \qquad n_{\mathrm{out}}F_\mu= TAT^\dagger. \tag*{(40)} A = n out X X † , n out F μ = T A T † . (40) Almost surely, rank X = rank M μ = min ( d 2 , n o u t ) \operatorname{rank}X = \operatorname{rank}M_\mu= \min(d^2,n_{\mathrm{out}}) rank X = rank M μ = min ( d 2 , n out ) . If n o u t ≲ d 2 n_{\mathrm{out}} \lesssim d^2 n out ≲ d 2 , then ∥ T − I d 2 ∥ o p = O P ( d − 1 / 2 ) \lVert T-I_{d^2}\rVert_{\mathrm{op}} = O_{\mathrm{P}}(d^{-1/2}) ∥ T − I d 2 ∥ op = O P ( d − 1/2 ) . The centered lifts m a = x a − v I d v I d † m_a = x_a-v_{I_d}v_{I_d}^\dagger m a = x a − v I d v I d † are independent and isotropic:
E [ x a x a † ] = I d 2 + v I d v I d † , E m a = 0 , E [ m a m a † ] = I d 2 . (41) \mathbb{E}[x_a x_a^\dagger] = I_{d^2} + v_{I_d}v_{I_d}^\dagger, \qquad\mathbb{E}m_a = 0, \qquad\mathbb{E}[m_a m_a^\dagger] = I_{d^2}. \tag*{(41)} E [ x a x a † ] = I d 2 + v I d v I d † , E m a = 0 , E [ m a m a † ] = I d 2 . (41)
Proof. Normalization and covariance — The Gaussian representation of a Haar isometry [34 ] and vec ( A X B ) = ( B T ⊗ A ) vec ( X ) \operatorname{vec}(AXB) = (B^T \otimes A)\operatorname{vec}(X) vec ( A X B ) = ( B T ⊗ A ) vec ( X ) give eq. (40) . The Wishart estimate lemma G3 and eq. (230) [40 ] gives ∥ S − 1 / 2 − I d ∥ o p = O P ( d / n o u t ) \lVert S^{-1/2}-I_d\rVert_{\mathrm{op}} = O_{\mathrm{P}}(\sqrt{d/n_{\mathrm{out}}}) ∥ S − 1/2 − I d ∥ op = O P ( d / n out ) , hence ∥ T − I d 2 ∥ o p ≤ 2 ∥ S − 1 / 2 − I d ∥ o p + ∥ S − 1 / 2 − I d ∥ o p 2 = O P ( d − 1 / 2 ) \lVert T-I_{d^2}\rVert_{\mathrm{op}} \le2\lVert S^{-1/2}-I_d\rVert_{\mathrm{op}}+\lVert S^{-1/2}-I_d\rVert_{\mathrm{op}}^2 = O_{\mathrm{P}}(d^{-1/2}) ∥ T − I d 2 ∥ op ≤ 2 ∥ S − 1/2 − I d ∥ op + ∥ S − 1/2 − I d ∥ op 2 = O P ( d − 1/2 ) in the proportional regime. Wick’s identity gives eq. (41) .
Almost-sure rank — The d 2 d^2 d 2 rank-one matrices e i e i † e_i e_i^\dagger e i e i † (1 ≤ i ≤ d 1 \le i \le d 1 ≤ i ≤ d ), ( e i + e j ) ( e i + e j ) † (e_i+e_j)(e_i+e_j)^\dagger ( e i + e j ) ( e i + e j ) † , and ( e i + i e j ) ( e i + i e j ) † (e_i+\mathrm{i}e_j)(e_i+\mathrm{i}e_j)^\dagger ( e i + i e j ) ( e i + i e j ) † (i < j i<j i < j ) form a real Hermitian basis: subtracting their diagonal parts recovers the real and imaginary antisymmetric off-diagonal units. Therefore, with q = min ( d 2 , n o u t ) q=\min(d^2,n_{\mathrm{out}}) q = min ( d 2 , n out ) , some q × q q\times q q × q minor of [ vec ( g 1 g 1 † ) , … , vec ( g q g q † ) ] [\operatorname{vec}(g_1g_1^\dagger),\ldots,\operatorname{vec}(g_qg_q^\dagger)] [ vec ( g 1 g 1 † ) , … , vec ( g q g q † )] is a nonzero polynomial in the real and imaginary Gaussian coordinates. Its zero set has Lebesgue measure zero. Thus X X X has rank q q q almost surely, and the invertibility of T T T transfers the rank to M μ M_\mu M μ .
Why effect traces matter — The Haar-averaged test probability of outcome a a a is ω a / d \omega_a/d ω a / d . Concentration of all ω a \omega_a ω a around d / n o u t d/n_{\mathrm{out}} d / n out therefore makes these probabilities uniformly close to 1 / n o u t 1/n_{\mathrm{out}} 1/ n out ; the same traces are the Gram-matrix row sums and will locate the identity outlier in eq. (49) .
Lemma B2 (Uniform concentration of effect traces). For a Haar-random rank-one POVM with n o u t ≥ 2 d n_{\mathrm{out}} \ge2d n out ≥ 2 d , each ω a = Tr ( μ a ) \omega_a = \operatorname{Tr}(\mu_a) ω a = Tr ( μ a ) has distribution Beta ( d , n o u t − d ) \operatorname{Beta}(d,n_{\mathrm{out}}-d) Beta ( d , n out − d ) and mean d / n o u t d/n_{\mathrm{out}} d / n out . For ε ∈ ( 0 , 1 / 2 ) \varepsilon\in(0,1/2) ε ∈ ( 0 , 1/2 ) ,
P ( max a ≤ n o u t ∣ ω a − d / n o u t ∣ ≥ 4 ε d / n o u t ) ≤ 4 n o u t exp ( − ε 2 d / 3 ) . (42) \mathbb{P}\left(\max_{a\le n_{\mathrm{out}}}\left|\omega_a-d/n_{\mathrm{out}}\right|\ge4\varepsilon d/n_{\mathrm{out}}\right)\le4n_{\mathrm{out}}\exp\left(-\varepsilon^2d/3\right). \tag*{(42)} P ( a ≤ n out max ∣ ω a − d / n out ∣ ≥ 4 ε d / n out ) ≤ 4 n out exp ( − ε 2 d /3 ) . (42) If log n o u t = o ( d ) \log n_{\mathrm{out}}=o(d) log n out = o ( d ) , then
max a ∣ n o u t ω a / d − 1 ∣ = ∥ n o u t D I / d − I n o u t ∥ o p = O P ( log n o u t d ) . (43) \max_a\left|n_{\mathrm{out}}\omega_a/d-1\right|=\left\|n_{\mathrm{out}}D_I/d-I_{n_{\mathrm{out}}}\right\|_{\mathrm{op}}=O_{\mathbb{P}}\left(\sqrt{\frac{\log n_{\mathrm{out}}}{d}}\right). \tag*{(43)} a max ∣ n out ω a / d − 1 ∣ = ∥ n out D I / d − I n out ∥ op = O P ( d log n out ) . (43) Proof. Beta representation — A row of a Haar unitary is a normalized complex Gaussian vector, so ω a = X / ( X + Y ) \omega_a=X/(X+Y) ω a = X / ( X + Y ) for independent X ∼ Γ ( d , 1 ) X\sim\Gamma(d,1) X ∼ Γ ( d , 1 ) and Y ∼ Γ ( n o u t − d , 1 ) Y\sim\Gamma(n_{\mathrm{out}}-d,1) Y ∼ Γ ( n out − d , 1 ) . This gives the Beta law and its mean. On { ∣ X − d ∣ ≤ ε d , ∣ Y − ( n o u t − d ) ∣ ≤ ε ( n o u t − d ) } \{|X-d|\le\varepsilon d,\ |Y-(n_{\mathrm{out}}-d)|\le\varepsilon(n_{\mathrm{out}}-d)\} { ∣ X − d ∣ ≤ ε d , ∣ Y − ( n out − d ) ∣ ≤ ε ( n out − d )} , the ratio lies between ( d / n o u t ) ( 1 − ε ) / ( 1 + ε ) (d/n_{\mathrm{out}})(1-\varepsilon)/(1+\varepsilon) ( d / n out ) ( 1 − ε ) / ( 1 + ε ) and ( d / n o u t ) ( 1 + ε ) / ( 1 − ε ) (d/n_{\mathrm{out}})(1+\varepsilon)/(1-\varepsilon) ( d / n out ) ( 1 + ε ) / ( 1 − ε ) , hence ∣ ω a − d / n o u t ∣ < 4 ε d / n o u t |\omega_a-d/n_{\mathrm{out}}|<4\varepsilon d/n_{\mathrm{out}} ∣ ω a − d / n out ∣ < 4 ε d / n out .
Uniform tail bound — For S ∼ Γ ( k , 1 ) S\sim\Gamma(k,1) S ∼ Γ ( k , 1 ) , E e t S = ( 1 − t ) − k \mathbb{E}e^{tS}=(1-t)^{-k} E e tS = ( 1 − t ) − k . The Chernoff choice t = ε / ( 1 + ε ) t=\varepsilon/(1+\varepsilon) t = ε / ( 1 + ε ) and ε − log ( 1 + ε ) ≥ ε 2 / 3 \varepsilon-\log(1+\varepsilon)\ge\varepsilon^2/3 ε − log ( 1 + ε ) ≥ ε 2 /3 , together with the analogous lower-tail estimate, give
P ( S ≥ ( 1 + ε ) k ) ≤ e − ε 2 k / 3 , P ( ∣ S − k ∣ > ε k ) ≤ 2 e − ε 2 k / 3 . (44) \mathbb{P}(S\ge(1+\varepsilon)k)\le e^{-\varepsilon^2k/3},\qquad\mathbb{P}(|S-k|>\varepsilon k)\le2e^{-\varepsilon^2k/3}. \tag*{(44)} P ( S ≥ ( 1 + ε ) k ) ≤ e − ε 2 k /3 , P ( ∣ S − k ∣ > ε k ) ≤ 2 e − ε 2 k /3 . (44) Apply these bounds to X , Y X,Y X , Y , use n o u t − d ≥ d n_{\mathrm{out}}-d\ge d n out − d ≥ d , and take a union bound over outcomes. Choosing ε \varepsilon ε proportional to log n o u t / d \sqrt{\log n_{\mathrm{out}}/d} log n out / d proves eq. (43) .
Bulk spectrum, exact rank, and identity outlier
Subtracting the mean from the independent Gaussian lifts gives identity covariance: every unit operator direction has the same second-moment strength, although the coordinates of a lift remain dependent. Their sample covariance generates the Marchenko–Pastur (MP) bulk. Restoring the mean is a rank-at-most-two change and cannot alter the limiting eigenvalue histogram; Haar normalization changes positive eigenvalues by a factor tending to one. The theorem below makes the main-text spectrum claim in § 3 B precise, including the zero modes below informational completeness and the separate identity outlier.
Limiting spectral measure — The empirical spectral measure is the eigenvalue histogram with equal weight assigned to each eigenvalue. Its large-dimension limit is the Marchenko–Pastur law μ M P , γ \mu_{\mathrm{MP},\gamma} μ MP , γ },
d μ M P , γ ( x ) = ( 1 − 1 γ ) + δ 0 + ( λ + − x ) ( x − λ − ) 2 π γ x 1 [ λ − , λ + ] ( x ) d x , λ ± = ( 1 ± γ ) 2 . (45) d\mu_{\mathrm{MP},\gamma}(x)=\left(1-\frac{1}{\gamma}\right)_+\delta_0+\frac{\sqrt{(\lambda_+-x)(x-\lambda_-)}}{2\pi\gamma x}\mathbf{1}_{[\lambda_-,\lambda_+]}(x)\,dx,\qquad\lambda_{\pm}=(1\pm\sqrt{\gamma})^2. \tag*{(45)} d μ MP , γ ( x ) = ( 1 − γ 1 ) + δ 0 + 2 π γ x ( λ + − x ) ( x − λ − ) 1 [ λ − , λ + ] ( x ) d x , λ ± = ( 1 ± γ ) 2 . (45)
Here δ 0 \delta_0 δ 0 is unit mass at zero and ( x ) + = max ( x , 0 ) (x)_+=\max(x,0) ( x ) + = max ( x , 0 ) . The atom at zero counts inaccessible operator directions. The lower endpoint of the continuous bulk reaches zero at γ = 1 \gamma=1 γ = 1 , identifying the weakly resolved directions responsible for the classical peak. Weak convergence means convergence of averages of bounded continuous functions of the eigenvalues; it does not by itself bound the smallest positive eigenvalue.
Theorem B1 (Spectrum of a Haar-random rank-one POVM). Let d → ∞ d\to\infty d → ∞ with γ o u t = d 2 / n o u t → γ ∞ ∈ ( 0 , ∞ ) \gamma_{\mathrm{out}}=d^2/n_{\mathrm{out}}\to\gamma_{\infty}\in(0,\infty) γ out = d 2 / n out → γ ∞ ∈ ( 0 , ∞ ) . For a Haar-random rank-one POVM, let λ 1 , … , λ d 2 \lambda_1,\ldots,\lambda_{d^2} λ 1 , … , λ d 2 be the frame eigenvalues and λ ~ 1 , … , λ ~ d 2 − 1 \widetilde{\lambda}_1,\ldots,\widetilde{\lambda}_{d^2-1} λ 1 , … , λ d 2 − 1 those of its traceless compression. For every bounded continuous f f f ,
1 d 2 ∑ i = 1 d 2 f ( n o u t λ i ) → P ∫ f d μ M P , γ ∞ , 1 d 2 − 1 ∑ i = 1 d 2 − 1 f ( n o u t λ ~ i ) → P ∫ f d μ M P , γ ∞ . (46) \frac{1}{d^2}\sum_{i=1}^{d^2}f(n_{\mathrm{out}}\lambda_i)\xrightarrow{\mathbb{P}}\int f\,d\mu_{\mathrm{MP},\gamma_{\infty}},\qquad\frac{1}{d^2-1}\sum_{i=1}^{d^2-1}f(n_{\mathrm{out}}\widetilde{\lambda}_i)\xrightarrow{\mathbb{P}}\int f\,d\mu_{\mathrm{MP},\gamma_{\infty}}. \tag*{(46)} d 2 1 i = 1 ∑ d 2 f ( n out λ i ) P ∫ f d μ MP , γ ∞ , d 2 − 1 1 i = 1 ∑ d 2 − 1 f ( n out λ i ) P ∫ f d μ MP , γ ∞ . (46) The largest eigenvalue is λ max ( F μ ) = ( d / n o u t ) ( 1 + o P ( 1 ) ) \lambda_{\max}(\mathcal{F}_{\mu})=(d/n_{\mathrm{out}})(1+o_{\mathbb{P}}(1)) λ m a x ( F μ ) = ( d / n out ) ( 1 + o P ( 1 )) . More precisely, for every ε ∈ ( 0 , 1 / 2 ) \varepsilon\in(0,1/2) ε ∈ ( 0 , 1/2 ) and all sufficiently large d d d , an event of probability at least 1 − 4 n o u t e − ε 2 d / 3 1-4n_{\mathrm{out}}e^{-\varepsilon^2d/3} 1 − 4 n out e − ε 2 d /3 satisfies both
( 1 − 4 ε ) d n o u t ≤ λ max ( F μ ) ≤ ( 1 + 4 ε ) d n o u t , (1-4\varepsilon)\frac{d}{n_{\mathrm{out}}}\le\lambda_{\max}(\mathcal{F}_{\mu})\le(1+4\varepsilon)\frac{d}{n_{\mathrm{out}}}, ( 1 − 4 ε ) n out d ≤ λ m a x ( F μ ) ≤ ( 1 + 4 ε ) n out d , 1 d ∥ F μ v I d − d n o u t v I d ∥ 2 ≤ 4 ε 1 + 4 ε d n o u t . (47) \frac{1}{\sqrt{d}}\left\|\mathcal{F}_{\mu}v_{I_d}-\frac{d}{n_{\mathrm{out}}}v_{I_d}\right\|_2\le4\varepsilon\sqrt{1+4\varepsilon}\frac{d}{n_{\mathrm{out}}}. \tag*{(47)} d 1 F μ v I d − n out d v I d 2 ≤ 4 ε 1 + 4 ε n out d . (47)
Almost surely, rank M μ = min ( d 2 , n o u t ) \operatorname{rank} M_\mu= \min(d^2,n_{\rm out}) rank M μ = min ( d 2 , n out ) , so the frame and Gram matrix have ( d 2 − n o u t ) + (d^2-n_{\rm out})_+ ( d 2 − n out ) + and ( n o u t − d 2 ) + (n_{\rm out}-d^2)_+ ( n out − d 2 ) + zero eigenvalues, respectively.
Proof. Centered Gaussian bulk — Set W = n o u t − 1 ∑ a m a m a † \mathbf{W}=n_{\rm out}^{-1}\sum_a \mathbf{m}_a\mathbf{m}_a^\dagger W = n out − 1 ∑ a m a m a † and m ˉ = n o u t − 1 ∑ a m a \bar{\mathbf{m}}=n_{\rm out}^{-1}\sum_a\mathbf{m}_a m ˉ = n out − 1 ∑ a m a . Expanding the Gaussian lift gives
A = W + v I d v I d † + v I d m ˉ † + m ˉ v I d † , P 0 A P 0 = P 0 W P 0 . (48) \mathbf{A}=\mathbf{W}+v_{I_d}v_{I_d}^{\dagger}+v_{I_d}\bar{\mathbf{m}}^{\dagger}+\bar{\mathbf{m}}v_{I_d}^{\dagger},\qquad P_0\mathbf{A}P_0=P_0\mathbf{W}P_0. \tag*{(48)} A = W + v I d v I d † + v I d m ˉ † + m ˉ v I d † , P 0 A P 0 = P 0 W P 0 . (48)
The difference A − W \mathbf{A}-\mathbf{W} A − W has rank at most two. The quadratic-form estimate lemma G4 says that m a † H m a / d 2 \mathbf{m}_a^\dagger H\mathbf{m}_a/d^2 m a † H m a / d 2 concentrates around Tr ( H ) / d 2 \operatorname{Tr}(H)/d^2 Tr ( H ) / d 2 for each deterministic bounded Hermitian H H H . That is the condition in theorem G1 giving the MP law despite dependence among lift coordinates. A rank-two change shifts eigenvalue counts across any threshold by at most two (interlacing, lemma G1), so A \mathbf{A} A has the same limiting histogram. By lemmas B1 and G1, every positive eigenvalue changes by a uniform multiplicative factor 1 + o P ( 1 ) 1+o_{\mathbb{P}}(1) 1 + o P ( 1 ) under A ↦ T A T † = n o u t F μ \mathbf{A}\mapsto\mathbf{T}\mathbf{A}\mathbf{T}^{\dagger}=n_{\rm out}\mathcal{F}_\mu A ↦ TA T † = n out F μ , so the full frame has this limit in probability. Cauchy interlacing lemma G1 changes its empirical distribution function by at most 1 / ( d 2 − 1 ) 1/(d^2-1) 1/ ( d 2 − 1 ) under traceless compression, proving eq. (46) .
Identity outlier from Gram row sums — The matrix G μ \mathcal{G}_\mu G μ has nonnegative entries and row sums ω a \omega_a ω a because ∑ b Tr ( μ a μ b ) = Tr ( μ a ) \sum_b\operatorname{Tr}(\mu_a\mu_b)=\operatorname{Tr}(\mu_a) ∑ b Tr ( μ a μ b ) = Tr ( μ a ) . Its Rayleigh quotient on the uniform vector is n o u t − 1 ∑ a ω a = d / n o u t n_{\rm out}^{-1}\sum_a\omega_a=d/n_{\rm out} n out − 1 ∑ a ω a = d / n out , while its norm is at most its largest row sum. Consequently,
0 ≤ λ max ( G μ ) − d n o u t ≤ max a ∣ ω a − d n o u t ∣ . (49) 0\leq\lambda_{\max}(\mathcal{G}_\mu)-\frac{d}{n_{\rm out}}\leq\max_a\left|\omega_a-\frac{d}{n_{\rm out}}\right|. \tag*{(49)} 0 ≤ λ m a x ( G μ ) − n out d ≤ a max ω a − n out d . (49)
Moreover, M μ † v I d = ω M_\mu^\dagger v_{I_d}=\omega M μ † v I d = ω and M μ 1 n o u t = v I d M_\mu\mathbf{1}_{n_{\rm out}}=v_{I_d} M μ 1 n out = v I d imply
F μ v I d − d n o u t v I d = M μ ( ω − d n o u t 1 n o u t ) , \mathcal{F}_\mu v_{I_d}-\frac{d}{n_{\rm out}}v_{I_d}=M_\mu\left(\omega-\frac{d}{n_{\rm out}}\mathbf{1}_{n_{\rm out}}\right), F μ v I d − n out d v I d = M μ ( ω − n out d 1 n out ) ,
∥ F μ v I d − d n o u t v I d ∥ d ≤ ∥ M μ ∥ o p d ∥ ω − d n o u t 1 n o u t ∥ . (50) \frac{\left\|\mathcal{F}_\mu v_{I_d}-\frac{d}{n_{\rm out}}v_{I_d}\right\|}{\sqrt d}\leq\frac{\|M_\mu\|_{\rm op}}{\sqrt d}\left\|\omega-\frac{d}{n_{\rm out}}\mathbf{1}_{n_{\rm out}}\right\|. \tag*{(50)} d F μ v I d − n out d v I d ≤ d ∥ M μ ∥ op ω − n out d 1 n out . (50)
On the event in lemma B2, the last two norms are bounded by ( 1 + 4 ε ) d / n o u t \sqrt{(1+4\varepsilon)d/n_{\rm out}} ( 1 + 4 ε ) d / n out and 4 ε d / n o u t 4\varepsilon d/\sqrt{n_{\rm out}} 4 ε d / n out . These bounds prove eq. (47) ; taking ε → 0 \varepsilon\to0 ε → 0 slowly proves the outlier limit. The rank assertion follows from lemma B1. □
Singular-value scales — The MP law controls empirical spectra, allowing a vanishing fraction of eigenvalues outside the bulk. The corresponding bulk singular values of M μ M_\mu M μ have scale n o u t − 1 / 2 n_{\rm out}^{-1/2} n out − 1/2 , whereas its leading singular value has scale d / n o u t \sqrt{d/n_{\rm out}} d / n out . At finite dimension, the identity direction is only approximately an eigenvector.
Finite-dimensional outlier correction
The leading outlier scale of theorem B1 can be sharpened to the additive d + 1 d+1 d + 1 value shown in the insets of main-text Figure 4 . Effect-trace fluctuations raise the identity Rayleigh quotient above d / n o u t d/n_{\rm out} d / n out ; the coupling to traceless directions produces only a vanishing correction after rescaling by n o u t n_{\rm out} n out .
Trace fluctuations shift the quotient — The identity Rayleigh quotient satisfies the exact identity
v I d † F μ v I d d = 1 d ∑ a ω a 2 = d n o u t + 1 d ∑ a ( ω a − d n o u t ) 2 . (51) \frac{v_{I_d}^{\dagger}\mathcal{F}_\mu v_{I_d}}{d}=\frac{1}{d}\sum_a\omega_a^2=\frac{d}{n_{\rm out}}+\frac{1}{d}\sum_a\left(\omega_a-\frac{d}{n_{\rm out}}\right)^2. \tag*{(51)} d v I d † F μ v I d = d 1 a ∑ ω a 2 = n out d + d 1 a ∑ ( ω a − n out d ) 2 . (51)
Its expectation is ( d + 1 ) / ( n o u t + 1 ) (d+1)/(n_{\rm out}+1) ( d + 1 ) / ( n out + 1 ) by the Beta second moment. Controlling its coupling to the traceless sector gives the following refinement.
Corollary B1 (Additive identity-outlier correction). In the proportional limit of theorem B1,
n o u t λ max ( F μ ) = d + 1 + o P ( 1 ) . (52) n_{\rm out}\lambda_{\max}(\mathcal{F}_\mu)=d+1+o_{\mathbb{P}}(1). \tag*{(52)} n out λ m a x ( F μ ) = d + 1 + o P ( 1 ) . (52) The scaled identity Rayleigh quotient has exact mean n o u t ( d + 1 ) / ( n o u t + 1 ) n_{\rm out}(d+1)/(n_{\rm out}+1) n out ( d + 1 ) / ( n out + 1 ) and variance O ( n o u t − 1 ) O(n_{\rm out}^{-1}) O ( n out − 1 ) ; its difference from n o u t λ max ( F μ ) n_{\rm out}\lambda_{\max}(\mathcal{F}_\mu) n out λ m a x ( F μ ) is O P ( log d / d ) O_{\mathbb{P}}(\log d/d) O P ( log d / d ) .
Proof. Concentration of the identity quotient — Let H \mathbf{H} H be the Haar rank-d d d projection in C n o u t \mathbb{C}^{n_{\mathrm{out}}} C n out and δ a = H a a − d / n o u t = ω a − d / n o u t \delta_a = H_{aa} - d/n_{\mathrm{out}} = \omega_a - d/n_{\mathrm{out}} δ a = H aa − d / n out = ω a − d / n out . The scaled quotient is v = ( n o u t / d ) v I d T F μ v I d = d + ( n o u t / d ) ∑ a δ a 2 v = (n_{\mathrm{out}}/d)v^{\mathsf{T}}_{\mathrm{Id}}F_{\mu}v_{\mathrm{Id}} = d + (n_{\mathrm{out}}/d)\sum_a \delta_a^2 v = ( n out / d ) v Id T F μ v Id = d + ( n out / d ) ∑ a δ a 2 , with the stated expectation. The logarithmic Sobolev inequality on U ( n o u t ) U(n_{\mathrm{out}}) U ( n out ) implies the variance bound Var v ≤ ( 6 / n o u t ) E ∥ ∇ v ∥ F 2 \operatorname{Var}v \le(6/n_{\mathrm{out}})\mathbb{E}\|\nabla v\|_F^2 Var v ≤ ( 6/ n out ) E ∥∇ v ∥ F 2 [41 Theorem 15] . Differentiating along H ↦ e t X H e − t X H \mapsto e^{tX}He^{-tX} H ↦ e tX H e − tX , with D δ = diag δ D_\delta= \operatorname{diag}\delta D δ = diag δ , gives
∥ ∇ v ∥ F 2 ≤ 4 ( n o u t / d ) 2 ∥ [ H , D δ ] ∥ F 2 ≤ 16 ( n o u t / d ) 2 ∑ a δ a 2 ω a , \|\nabla v\|_F^2 \le4(n_{\mathrm{out}}/d)^2\|[H,D_\delta]\|_F^2 \le16(n_{\mathrm{out}}/d)^2\sum_a \delta_a^2\omega_a, ∥∇ v ∥ F 2 ≤ 4 ( n out / d ) 2 ∥ [ H , D δ ] ∥ F 2 ≤ 16 ( n out / d ) 2 a ∑ δ a 2 ω a ,
E [ δ a 2 ω a ] = d ( n o u t − d ) [ ( d + 2 ) n o u t − 2 d ] n o u t 3 ( n o u t + 1 ) ( n o u t + 2 ) ≤ d ( d + 2 ) n o u t 3 . (53) \mathbb{E}[\delta_a^2\omega_a] = \frac{d(n_{\mathrm{out}}-d)[(d+2)n_{\mathrm{out}}-2d]}{n_{\mathrm{out}}^3(n_{\mathrm{out}}+1)(n_{\mathrm{out}}+2)} \le\frac{d(d+2)}{n_{\mathrm{out}}^3}. \tag*{(53)} E [ δ a 2 ω a ] = n out 3 ( n out + 1 ) ( n out + 2 ) d ( n out − d ) [( d + 2 ) n out − 2 d ] ≤ n out 3 d ( d + 2 ) . (53)
The last expression uses the first three Beta moments. Hence E ∥ ∇ v ∥ F 2 ≤ 16 ( d + 2 ) / d \mathbb{E}\|\nabla v\|_F^2 \le16(d+2)/d E ∥∇ v ∥ F 2 ≤ 16 ( d + 2 ) / d , Var v ≤ C / n o u t \operatorname{Var}v \le C/n_{\mathrm{out}} Var v ≤ C / n out , and v = d + 1 + o P ( 1 ) v = d+1+o_{\mathbb{P}}(1) v = d + 1 + o P ( 1 ) .
Coupling to traceless directions — Put C = n o u t P 0 F μ P 0 C = n_{\mathrm{out}}P_0F_\mu P_0 C = n out P 0 F μ P 0 on the traceless sector and b = n o u t P 0 F μ v I d / d b = n_{\mathrm{out}}P_0F_\mu v_{\mathrm{Id}}/\sqrt{d} b = n out P 0 F μ v Id / d . The Gaussian lift yields ∥ C ∥ o p ≤ 2 ∥ T ∥ o p 2 ∥ W ∥ o p + 2 ∥ P 0 T v I d ∥ 2 = O P ( log d ) \|C\|_{\mathrm{op}} \le2\|T\|_{\mathrm{op}}^2\|W\|_{\mathrm{op}} + 2\|P_0Tv_{\mathrm{Id}}\|^2 = O_{\mathbb{P}}(\log d) ∥ C ∥ op ≤ 2∥ T ∥ op 2 ∥ W ∥ op + 2∥ P 0 T v Id ∥ 2 = O P ( log d ) . Indeed, ∥ T − I d 2 ∥ o p = O P ( d − 1 / 2 ) \|T-I_{d^2}\|_{\mathrm{op}} = O_{\mathbb{P}}(d^{-1/2}) ∥ T − I d 2 ∥ op = O P ( d − 1/2 ) . Truncating the independent centered-lift outer products to ∥ g ^ a ∥ 2 ≤ 2 d \|\hat{g}_a\|^2 \le2d ∥ g ^ a ∥ 2 ≤ 2 d changes no column with probability tending to one; each summand of W W W then has norm at most C d 2 / n o u t Cd^2/n_{\mathrm{out}} C d 2 / n out , and their summed expectation is at most I d 2 I_{d^2} I d 2 . The matrix Chernoff bound for sums of independent positive matrices [42 ] therefore gives ∥ W ∥ o p = O P ( log d ) \|W\|_{\mathrm{op}} = O_{\mathbb{P}}(\log d) ∥ W ∥ op = O P ( log d ) . Finally, eq. (50) and P 0 M μ 1 n o u t = 0 P_0M_\mu\mathbf{1}_{n_{\mathrm{out}}}=0 P 0 M μ 1 n out = 0 give ∥ b ∥ 2 ≤ ∥ C ∥ o p ( n o u t / d ) ∑ a δ a 2 = ∥ C ∥ o p ( v − d ) \|b\|^2 \le\|C\|_{\mathrm{op}}(n_{\mathrm{out}}/d)\sum_a\delta_a^2 = \|C\|_{\mathrm{op}}(v-d) ∥ b ∥ 2 ≤ ∥ C ∥ op ( n out / d ) ∑ a δ a 2 = ∥ C ∥ op ( v − d ) . With probability tending to one, v > ∥ C ∥ o p v>\|C\|_{\mathrm{op}} v > ∥ C ∥ op , so the Schur complement for Λ = n o u t λ max ( F μ ) \Lambda= n_{\mathrm{out}}\lambda_{\max}(F_\mu) Λ = n out λ m a x ( F μ ) gives 0 ≤ Λ − v ≤ ∥ b ∥ 2 v − ∥ C ∥ o p = O P ( log d / d ) = o P ( 1 ) 0 \le\Lambda-v \le\frac{\|b\|^2}{v-\|C\|_{\mathrm{op}}} = O_{\mathbb{P}}(\log d/d) = o_{\mathbb{P}}(1) 0 ≤ Λ − v ≤ v − ∥ C ∥ op ∥ b ∥ 2 = O P ( log d / d ) = o P ( 1 ) . This proves eq. (52) .
Identity direction in outcome space — In Gram space, the identity direction maps to M μ † v I d = ω M_\mu^\dagger v_{\mathrm{Id}}=\omega M μ † v Id = ω . Trace concentration gives ∥ ω / d − ( d / n o u t ) 1 n o u t ∥ = O P ( log n o u t / n o u t ) \|\omega/\sqrt{d}-(\sqrt{d}/n_{\mathrm{out}})\mathbf{1}_{n_{\mathrm{out}}}\|=O_{\mathbb{P}}(\sqrt{\log n_{\mathrm{out}}/n_{\mathrm{out}}}) ∥ ω / d − ( d / n out ) 1 n out ∥ = O P ( log n out / n out ) . Since ∑ a ω a = d \sum_a\omega_a=d ∑ a ω a = d , the squared overlap of ω / ∥ ω ∥ \omega/\|\omega\| ω /∥ ω ∥ with the uniform unit vector is d 2 / ( n o u t ∑ a ω a 2 ) d^2/(n_{\mathrm{out}}\sum_a\omega_a^2) d 2 / ( n out ∑ a ω a 2 ) . By eq. (51) ,
P ( ∣ ⟨ ω ∥ ω ∥ , 1 n o u t n o u t ⟩ ∣ 2 ≥ 1 1 + 16 ε 2 ) ≥ 1 − 4 n o u t e − ε 2 d / 3 . (54) \mathbb{P}\left(\left|\left\langle\frac{\omega}{\|\omega\|},\frac{\mathbf{1}_{n_{\mathrm{out}}}}{\sqrt{n_{\mathrm{out}}}}\right\rangle\right|^2 \ge\frac{1}{1+16\varepsilon^2}\right) \ge1-4n_{\mathrm{out}}e^{-\varepsilon^2d/3}. \tag*{(54)} P ( ⟨ ∥ ω ∥ ω , n out 1 n out ⟩ 2 ≥ 1 + 16 ε 2 1 ) ≥ 1 − 4 n out e − ε 2 d /3 . (54)
Thus the identity-induced Gram direction approaches the uniform vector.
Fixed-rank states and measurement effects
The fixed-rank ensembles below extend the covariance input to the quantum peak of section IV B. Mixing k k k orthogonal pure states reduces the traceless training covariance by an asymptotic factor 1 / k 1/k 1/ k ; grouping ℓ \ell ℓ microscopic effects into each POVM outcome gives the measurement factor 1 / ℓ 1/\ell 1/ ℓ . The lemma makes these bulk laws precise and supplies the scales entering the peak amplitudes in eq. (180) , with k k k and ℓ \ell ℓ fixed as d → ∞ d\to\infty d → ∞ . ESD denotes the empirical spectral distribution, or normalized eigenvalue histogram.
Distinct identity scales — Independent training states have no resolution-of-identity constraint across samples. For pure states, E ∑ i ρ i = ( n t r / d ) I d \mathbb{E}\sum_i\rho_i=(n_{\mathrm{tr}}/d)I_d E ∑ i ρ i = ( n tr / d ) I d , so their frame has an identity spike of order n t r / d n_{\mathrm{tr}}/d n tr / d , rather than the measurement scale d / n o u t d/n_{\mathrm{out}} d / n out .
Lemma B3 (Bulk laws for fixed-rank states and measurement effects). Let d → ∞ d\to\infty d → ∞ . Fix positive integers k k k and ℓ \ell ℓ , independent of d d d , and assume ( d 2 − 1 ) / n t r → γ t r ∈ ( 0 , ∞ ) (d^2-1)/n_{\mathrm{tr}}\to\gamma_{\mathrm{tr}}\in(0,\infty) ( d 2 − 1 ) / n tr → γ tr ∈ ( 0 , ∞ ) and ( d 2 − 1 ) / n o u t → γ o u t ∈ ( 0 , ∞ ) (d^2-1)/n_{\mathrm{out}}\to\gamma_{\mathrm{out}}\in(0,\infty) ( d 2 − 1 ) / n out → γ out ∈ ( 0 , ∞ ) . All empirical spectral distributions below are normalized by ( d 2 − 1 ) (d^2-1) ( d 2 − 1 ) , include zero eigenvalues, and act on the real ( d 2 − 1 ) (d^2-1) ( d 2 − 1 ) -dimensional space of traceless Hermitian operators. Convergence is weak in probability.
Let ρ i = U i P k U i † / k \rho_i=U_iP_kU_i^\dagger/k ρ i = U i P k U i † / k , where P k P_k P k is a deterministic rank-k k k orthogonal projector and the U i ∈ U ( d ) U_i\in U(d) U i ∈ U ( d ) are independent Haar unitaries. With Π n t r = I n t r − 1 n t r 1 n t r T / n t r \Pi_{n_{\mathrm{tr}}}=I_{n_{\mathrm{tr}}}-\mathbf{1}_{n_{\mathrm{tr}}}\mathbf{1}_{n_{\mathrm{tr}}}^{T}/n_{\mathrm{tr}} Π n tr = I n tr − 1 n tr 1 n tr T / n tr and the convention of eq. (85) ,
ESD ( k d ( d + 1 ) n t r P 0 M ρ Π n t r M ρ T P 0 ∣ L ( H 0 ) ) ⟹ μ M P , γ t r . (55) \operatorname{ESD}\left(\frac{kd(d+1)}{n_{\mathrm{tr}}}P_0M_\rho\Pi_{n_{\mathrm{tr}}}M_\rho^{T}P_0\big|_{\mathcal{L}(\mathcal{H}_0)}\right)\Longrightarrow\mu_{\mathrm{MP},\gamma_{\mathrm{tr}}}. \tag*{(55)} ESD ( n tr k d ( d + 1 ) P 0 M ρ Π n tr M ρ T P 0 L ( H 0 ) ) ⟹ μ MP , γ tr . (55)
For every deterministic symmetric matrix A A A on this sector, the exactly isotropic column x = a d ρ − I d / d x = a_d\sqrt{\rho}-I_d/d x = a d ρ − I d / d , with a d 2 = k d ( d 2 − 1 ) / ( d − k ) = k d ( d + 1 ) ( d − 1 ) / ( d − k ) a_d^2 = kd(d^2-1)/(d-k)=kd(d+1)(d-1)/(d-k) a d 2 = k d ( d 2 − 1 ) / ( d − k ) = k d ( d + 1 ) ( d − 1 ) / ( d − k ) , satisfies E x = 0 \mathbb{E}x=0 E x = 0 , E x x T = I d 2 − 1 \mathbb{E}xx^{T}=I_{d^2-1} E x x T = I d 2 − 1 , and, for d > k d>k d > k ,
Var ( x T A x ) ≤ C ( d 2 − 1 ) 2 k ( d − k ) ∥ A ∥ o p 2 = O k ( ( d 2 − 1 ) 2 d ) ∥ A ∥ o p 2 . (56) \operatorname{Var}(x^{T}Ax)\leq\frac{C(d^2-1)^2}{k(d-k)}\lVert A\rVert_{\mathrm{op}}^2=O_k\left(\frac{(d^2-1)^2}{d}\right)\lVert A\rVert_{\mathrm{op}}^2. \tag*{(56)} Var ( x T A x ) ≤ k ( d − k ) C ( d 2 − 1 ) 2 ∥ A ∥ op 2 = O k ( d ( d 2 − 1 ) 2 ) ∥ A ∥ op 2 . (56)
Let V ∈ C ( n o u t ℓ ) × d V\in\mathbb{C}^{(n_{\mathrm{out}}\ell)\times d} V ∈ C ( n out ℓ ) × d be a Haar isometry, partitioned into blocks V a ∈ C ℓ × d V_a\in\mathbb{C}^{\ell\times d} V a ∈ C ℓ × d , and set μ a = V a † V a \mu_a=V_a^\dagger V_a μ a = V a † V a . Then
ESD ( n o u t ℓ P 0 F μ P 0 ∣ L ( H 0 ) ) ⇒ μ M P , γ o u t . (57) \operatorname{ESD}\left(n_{\mathrm{out}}\ell P_0F_{\mu}P_0\big|_{\mathcal{L}(\mathcal{H}_0)}\right)\Rightarrow\mu_{\mathrm{MP},\gamma_{\mathrm{out}}}. \tag*{(57)} ESD ( n out ℓ P 0 F μ P 0 L ( H 0 ) ) ⇒ μ MP , γ out . (57)
The state list and POVM may be drawn independently when both statements are used together.
Proof. Normalized projector states — The Haar moment formula eq. (32) , applied to P k / k − I d / d P_k/k-I_d/d P k / k − I d / d , gives E v ρ − I d / d v ρ − I d / d T = ( 1 / k − 1 / d ) I d 2 − 1 / ( d 2 − 1 ) \mathbb{E}v_{\rho-I_d/d}v_{\rho-I_d/d}^{T}=(1/k-1/d)I_{d^2-1}/(d^2-1) E v ρ − I d / d v ρ − I d / d T = ( 1/ k − 1/ d ) I d 2 − 1 / ( d 2 − 1 ) . Thus x x x is centered and isotropic, with ∥ x ∥ 2 = d 2 − 1 \lVert x\rVert^2=d^2-1 ∥ x ∥ 2 = d 2 − 1 deterministically. The unitary Poincaré inequality following from [41 Theorem 15] bounds variance by C / d C/d C / d times the mean squared Hilbert–Schmidt gradient. To apply it, let F ( U ) = x T A x F(U)=x^{T}Ax F ( U ) = x T A x and differentiate along U ↦ e t X U U\mapsto e^{tX}U U ↦ e tX U , where X † = − X X^\dagger=-X X † = − X . Since ρ ˙ = [ X , ρ ] \dot{\rho}=[X,\rho] ρ ˙ = [ X , ρ ] and ∥ ρ ∥ o p = 1 / k \lVert\rho\rVert_{\mathrm{op}}=1/k ∥ ρ ∥ op = 1/ k , ∣ F ˙ ∣ ≤ 2 a d ∥ A ∥ o p d 2 − 1 ∥ [ X , ρ ] ∥ F ≤ 4 a d d 2 − 1 ∥ A ∥ o p ∥ X ∥ F / k \lvert\dot{F}\rvert\leq2a_d\lVert A\rVert_{\mathrm{op}}\sqrt{d^2-1}\lVert[X,\rho]\rVert_F\leq4a_d\sqrt{d^2-1}\lVert A\rVert_{\mathrm{op}}\lVert X\rVert_F/k ∣ F ˙ ∣ ≤ 2 a d ∥ A ∥ op d 2 − 1 ∥[ X , ρ ] ∥ F ≤ 4 a d d 2 − 1 ∥ A ∥ op ∥ X ∥ F / k . The resulting gradient bound proves eq. (56) . In particular, the variance divided by ( d 2 − 1 ) 2 (d^2-1)^2 ( d 2 − 1 ) 2 tends to zero uniformly for ∥ A ∥ o p ≤ 1 \lVert A\rVert_{\mathrm{op}}\leq1 ∥ A ∥ op ≤ 1 . The MP theorem theorem G1 therefore applies to n t r − 1 ∑ i x i x i T n_{\mathrm{tr}}^{-1}\sum_i x_ix_i^{T} n tr − 1 ∑ i x i x i T . Subtracting the empirical mean changes this matrix by rank at most one, so lemma G1 gives the same limit for the sample-centered frame. Finally, k d ( d + 1 ) / a d 2 = ( d − k ) / ( d − 1 ) → 1 kd(d+1)/a_d^2=(d-k)/(d-1)\to1 k d ( d + 1 ) / a d 2 = ( d − k ) / ( d − 1 ) → 1 , proving eq. (55) . Equivalently, generate each ρ i \rho_i ρ i as G i ( G i † G i ) − 1 G i † / k G_i(G_i^\dagger G_i)^{-1}G_i^\dagger/k G i ( G i † G i ) − 1 G i † / k with G i ∈ C d × k G_i\in\mathbb{C}^{d\times k} G i ∈ C d × k standard Gaussian. The proof uses the normalized-projector law itself.
Independent block lifts — Let G ∈ C ( n o u t ℓ ) × d G\in\mathbb{C}^{(n_{\mathrm{out}}\ell)\times d} G ∈ C ( n out ℓ ) × d have independent C N ( 0 , 1 ) \mathcal{CN}(0,1) C N ( 0 , 1 ) entries and put S = G † G / ( n o u t ℓ ) S=G^\dagger G/(n_{\mathrm{out}}\ell) S = G † G / ( n out ℓ ) . Write the conjugate-transposed rows of its a a a th block as g a t ∈ C d g_{at}\in\mathbb{C}^d g a t ∈ C d , 1 ≤ t ≤ ℓ 1\leq t\leq\ell 1 ≤ t ≤ ℓ , and define Y a = ∑ t = 1 ℓ g a t g a t † Y_a=\sum_{t=1}^{\ell}g_{at}g_{at}^\dagger Y a = ∑ t = 1 ℓ g a t g a t † and z a = Y a Y a − ℓ I d / ℓ z_a=\sqrt{\vphantom{Y_a} }Y_a-\ell I_d/\sqrt{\ell} z a = Y a Y a − ℓ I d / ℓ . The d 2 d^2 d 2 -dimensional real vectors z a z_a z a are independent across a a a , centered, and isotropic by the Wick identity eq. (41) . They also satisfy the quadratic-form concentration needed for the MP law. Indeed, for symmetric H H H on the full Hermitian space and Q = z a T H z a Q=z_a^{T}Hz_a Q = z a T H z a , Gaussian Poincaré and differentiation with respect to the ℓ \ell ℓ Gaussian vectors give
Var Q ≤ C ℓ ∥ H ∥ o p 2 E [ ( ∑ t = 1 ℓ ∥ g a t ∥ 2 ) ∥ z a ∥ 2 ] = C ℓ ( ℓ d 3 + 2 d 2 ) ∥ H ∥ o p 2 . (58) \operatorname{Var}Q\leq\frac{C}{\ell}\lVert H\rVert_{\mathrm{op}}^2\mathbb{E}\left[\left(\sum_{t=1}^{\ell}\lVert g_{at}\rVert^2\right)\lVert z_a\rVert^2\right]=\frac{C}{\ell}(\ell d^3+2d^2)\lVert H\rVert_{\mathrm{op}}^2. \tag*{(58)} Var Q ≤ ℓ C ∥ H ∥ op 2 E [ ( t = 1 ∑ ℓ ∥ g a t ∥ 2 ) ∥ z a ∥ 2 ] = ℓ C ( ℓ d 3 + 2 d 2 ) ∥ H ∥ op 2 . (58)
For the last equality, expand the centered sum: cross terms vanish by independence, E ∥ g g g † − I d ∥ 2 = d 2 \mathbb{E}\lVert\sqrt{\vphantom{g} }gg^\dagger-I_d\rVert^2=d^2 E ∥ g g g † − I d ∥ 2 = d 2 , and E [ ∥ g ∥ 2 ∥ g g † − I d ∥ 2 ] = d 3 + 2 d 2 \mathbb{E}[\lVert g\rVert^2\lVert gg^\dagger-I_d\rVert^2]=d^3+2d^2 E [∥ g ∥ 2 ∥ g g † − I d ∥ 2 ] = d 3 + 2 d 2 . Hence d − 4 Var Q = O ℓ ( d − 1 ) ∥ H ∥ o p 2 d^{-4}\operatorname{Var}Q=O_{\ell}(d^{-1})\lVert H\rVert_{\mathrm{op}}^2 d − 4 Var Q = O ℓ ( d − 1 ) ∥ H ∥ op 2 , as in lemma G4. Consequently W = n o u t − 1 ∑ a z a z a T W=n_{\mathrm{out}}^{-1}\sum_a z_az_a^{T} W = n out − 1 ∑ a z a z a T has MP limit with aspect d 2 / n o u t → γ o u t d^2/n_{\mathrm{out}}\to\gamma_{\mathrm{out}} d 2 / n out → γ out .
Restoring measurement normalization — The exact Haar normalization is V = G S − 1 / 2 / n o u t ℓ V=GS^{-1/2}/\sqrt{n_{\mathrm{out}}\ell} V = G S − 1/2 / n out ℓ , so μ a = S − 1 / 2 γ a S − 1 / 2 / ( n o u t ℓ ) \mu_a=S^{-1/2}\gamma_aS^{-1/2}/(n_{\mathrm{out}}\ell) μ a = S − 1/2 γ a S − 1/2 / ( n out ℓ ) . Let T T T represent the linear map A ↦ S − 1 / 2 A S − 1 / 2 A\mapsto S^{-1/2}AS^{-1/2} A ↦ S − 1/2 A S − 1/2 in the same orthonormal Hermitian coordinates, and let Y = [ Y 1 y 1 , … , Y n o u t y n o u t ] Y=[\sqrt{\vphantom{Y_1}}y_1,\ldots,\sqrt{\vphantom{Y_{n_{\mathrm{out}}}}}y_{n_{\mathrm{out}}}] Y = [ Y 1 y 1 , … , Y n out y n out ] . Then
n o u t ℓ F μ = T ( Y Y T n o u t ℓ ) T T , rank ( Y Y T n o u t ℓ − W ) ≤ 2. (59) n_{\mathrm{out}}\ell F_{\mu}=T\left(\frac{YY^{T}}{n_{\mathrm{out}}\ell}\right)T^{T},\qquad\operatorname{rank}\left(\frac{YY^{T}}{n_{\mathrm{out}}\ell}-W\right)\leq2. \tag*{(59)} n out ℓ F μ = T ( n out ℓ Y Y T ) T T , rank ( n out ℓ Y Y T − W ) ≤ 2. (59)
The rank bound follows by writing Y / ℓ = [ z 1 , … , z n o u t ] + ℓ v d 1 n o u t T Y/\sqrt{\ell}=[z_1,\ldots,z_{n_{\mathrm{out}}}]+\sqrt{\ell}\,v_d1_{n_{\mathrm{out}}}^{T} Y / ℓ = [ z 1 , … , z n out ] + ℓ v d 1 n out T . By lemma G3 and eq. (230) , ∥ T − I d 2 ∥ o p = O P ( d / ( n o u t ℓ ) ) = o P ( 1 ) \lVert T-I_{d^2}\rVert_{\mathrm{op}}=O_{\mathbb{P}}(\sqrt{d/(n_{\mathrm{out}}\ell)})=o_{\mathbb{P}}(1) ∥ T − I d 2 ∥ op = O P ( d / ( n out ℓ ) ) = o P ( 1 ) . The finite-rank, near-identity congruence, and codimension-one compression bounds in lemma G1 transfer the MP limit to the exact traceless POVM frame, proving eq. (57) . □ \square □
Covariance scales for peak amplitudes — The bulk statements supply the fixed-k k k and fixed-ℓ \ell ℓ covariance scales used in eq. (180) : the frame F ρ \mathcal{F}_{\rho} F ρ has the MP law rescaled by 1 / k 1/k 1/ k , and n o u t P 0 F μ P 0 ∣ L ( H 0 ) n_{\mathrm{out}}P_0\mathcal{F}_{\mu}P_0|_{\mathcal{L}(\mathcal{H}_0)} n out P 0 F μ P 0 ∣ L ( H 0 ) has the MP law rescaled by 1 / ℓ 1/\ell 1/ ℓ . The MP zero atom is included once. The lemma does not identify an additive outlier correction, an extremal spectral edge, or an inverse spectral moment.
Separate control of the largest eigenvalues — The upper-frame hypotheses used in the fixed-rank peak examples follow separately from the rank-one bounds. Write ρ i = k − 1 ∑ t = 1 k ρ i t \rho_i=k^{-1}\sum_{t=1}^{k}\rho_{it} ρ i = k − 1 ∑ t = 1 k ρ i t as its constituent orthogonal pure states. For each fixed t t t , the list ρ t = ( ρ i t ) i \rho_t=(\rho_{it})_i ρ t = ( ρ i t ) i consists of independent Haar pure states. Applying the outer-product Cauchy inequality to the centered coordinates gives F ρ c ⪯ k − 1 ∑ t F ρ t c \mathcal{F}_{\rho}^{c} \preceq k^{-1}\sum_t \mathcal{F}_{\rho_t}^{c} F ρ c ⪯ k − 1 ∑ t F ρ t c . Each term is bounded by the Haar fourth moment eq. (217) and lemma G7; fixed k k k makes their sum bounded with probability tending to one. Likewise, the rank-ℓ \ell ℓ effects group a single Haar rank-one POVM ν \nu ν with n o u t ℓ n_{\mathrm{out}}\ell n out ℓ microscopic outcomes. Cauchy–Schwarz for each operator response gives n o u t P 0 F μ P 0 ⪯ n o u t ℓ P 0 F ν P 0 n_{\mathrm{out}}P_0\mathcal{F}_{\mu}P_0 \preceq n_{\mathrm{out}}\ell P_0\mathcal{F}_{\nu}P_0 n out P 0 F μ P 0 ⪯ n out ℓ P 0 F ν P 0 . The right side is bounded by lemma G8 at the fixed microscopic aspect ratio ( d 2 − 1 ) / ( n o u t ℓ ) → γ o u t / ℓ (d^2-1)/(n_{\mathrm{out}}\ell) \to\gamma_{\mathrm{out}}/\ell ( d 2 − 1 ) / ( n out ℓ ) → γ out / ℓ . These upper bounds do not rely on weak spectral convergence or assert an extremal-edge limit.
Classical peak in test variance
The classical calculation uses the main-text reconstruction weights w e x = M μ + v O w_{\mathrm{ex}}=M_{\mu}^{+}v_{\mathrm{O}} w ex = M μ + v O , which reproduce the measurement-visible part of the target with minimum coefficient norm. An outcome a a a is assigned the value w e x , a w_{\mathrm{ex},a} w ex , a . At fixed test state, averaging M M M independent outcomes divides the single-shot variance by M M M . Small positive frame eigenvalues correspond to weak probability responses; inverting them enlarges these weights and amplifies test-shot fluctuations. The resulting variance peaks at n o u t = d 2 n_{\mathrm{out}}=d^2 n out = d 2 , as stated in § 3 C. Appendix C 1 controls the inverse weight of small eigenvalues, Appendix C 2 proves the variance profile, and Appendix C 3 identifies when exact-feature training returns the same coefficients, as discussed in § 3 D.
Positive modes and their inverse weight — Define the positive spectral measure and its inverse weight,
ν d + = 1 d 2 − 1 ∑ j : λ j > 0 δ n o u t λ j , S d = ∫ ( 0 , ∞ ) d ν d + ( x ) x = Tr ( F μ + ) n o u t ( d 2 − 1 ) . (60) \nu_d^+ = \frac{1}{d^2-1}\sum_{j:\lambda_j>0}\delta_{n_{\mathrm{out}}\lambda_j}, \qquad S_d=\int_{(0,\infty)}\frac{d\nu_d^+(x)}{x}=\frac{\operatorname{Tr}(F_{\mu}^+)}{n_{\mathrm{out}}(d^2-1)}. \tag*{(60)} ν d + = d 2 − 1 1 j : λ j > 0 ∑ δ n out λ j , S d = ∫ ( 0 , ∞ ) x d ν d + ( x ) = n out ( d 2 − 1 ) Tr ( F μ + ) . (60)
where λ j \lambda_j λ j are the frame eigenvalues. If d 2 / n o u t → γ d^2/n_{\mathrm{out}}\to\gamma d 2 / n out → γ , then ν d + \nu_d^+ ν d + has total mass min ( d 2 , n o u t ) / ( d 2 − 1 ) → min ( 1 , γ − 1 ) \min(d^2,n_{\mathrm{out}})/(d^2-1)\to\min(1,\gamma^{-1}) min ( d 2 , n out ) / ( d 2 − 1 ) → min ( 1 , γ − 1 ) . The remaining MP mass comes from the exact zero eigenvalues in theorem B1. For test functions vanishing at zero, replacing the full empirical measure by ν d + \nu_d^+ ν d + changes only the asymptotically immaterial factor d 2 / ( d 2 − 1 ) d^2/(d^2-1) d 2 / ( d 2 − 1 ) . Weak spectral convergence alone does not control S d S_d S d , because x − 1 x^{-1} x − 1 is unbounded at zero.
Inverse weight near zero
A vanishing fraction of exceptionally small positive eigenvalues can dominate S d S_d S d without affecting the MP limit. Above informational completeness, the estimate below rules out a finite contribution from such modes by bounding their total inverse weight, rather than the smallest eigenvalue. The bound is the extra input needed for the overcomplete branch of the main-text classical variance law, through eq. (77) .
Lemma C1 (Inverse moments without an extremal-edge bound). For independent standard complex Gaussian g a ∈ C d g_a\in\mathbb{C}^d g a ∈ C d , let x a = vec ( g a g a † ) x_a=\operatorname{vec}(g_ag_a^\dagger) x a = vec ( g a g a † ) and K = ∑ a = 1 n o u t x a x a † \mathbf{K}=\sum_{a=1}^{n_{\mathrm{out}}}x_ax_a^\dagger K = ∑ a = 1 n out x a x a † . If d 2 / n o u t → γ ∈ ( 0 , 1 ) d^2/n_{\mathrm{out}}\to\gamma\in(0,1) d 2 / n out → γ ∈ ( 0 , 1 ) , then Tr ( K − 1 ) = O P ( 1 ) \operatorname{Tr}(\mathbf{K}^{-1})=O_{\mathbb{P}}(1) Tr ( K − 1 ) = O P ( 1 ) and Tr ( K − 2 ) = O P ( 1 ) \operatorname{Tr}(\mathbf{K}^{-2})=O_{\mathbb{P}}(1) Tr ( K − 2 ) = O P ( 1 ) . Consequently, n o u t d 2 − 1 ∑ j : λ j ( K ) ≤ θ o u t λ j ( K ) − 1 = O P ( θ ) \frac{n_{\mathrm{out}}}{d^2-1}\sum_{j:\lambda_j(\mathbf{K})\le\theta_{\mathrm{out}}}\lambda_j(\mathbf{K})^{-1}=O_{\mathbb{P}}(\sqrt{\theta}) d 2 − 1 n out ∑ j : λ j ( K ) ≤ θ out λ j ( K ) − 1 = O P ( θ ) uniformly for sufficiently large d d d . Thus the eigenvalues below θ o u t \theta_{\mathrm{out}} θ out carry vanishing inverse weight without a lower bound on the smallest eigenvalue.
Proof. Removing one independent column — Remove column a a a 's outer product so that the remaining matrix is independent of x a x_a x a . Put K ( a ) = K − x a x a † \mathbf{K}_{(a)}=\mathbf{K}-x_ax_a^\dagger K ( a ) = K − x a x a † , ζ ~ a = x a † K ( a ) − 1 x a \widetilde{\zeta}_a=x_a^\dagger\mathbf{K}_{(a)}^{-1}x_a ζ a = x a † K ( a ) − 1 x a , η a = x a † K ( a ) − 2 x a \eta_a=x_a^\dagger\mathbf{K}_{(a)}^{-2}x_a η a = x a † K ( a ) − 2 x a , and T j = Tr ( K − j ) \mathcal{T}_j=\operatorname{Tr}(\mathbf{K}^{-j}) T j = Tr ( K − j ) for j = 1 , 2 j=1,2 j = 1 , 2 . For sufficiently large d d d , n o u t − 1 ≥ d 2 n_{\mathrm{out}}-1\ge d^2 n out − 1 ≥ d 2 , so lemma B1 makes every K ( a ) \mathbf{K}_{(a)} K ( a ) invertible almost surely. Sherman–Morrison gives K − 1 x a = K ( a ) − 1 x a / ( 1 + ζ ~ a ) \mathbf{K}^{-1}x_a=\mathbf{K}_{(a)}^{-1}x_a/(1+\widetilde{\zeta}_a) K − 1 x a = K ( a ) − 1 x a / ( 1 + ζ a ) . Consequently, x a † K − 1 x a = ζ ~ a / ( 1 + ζ ~ a ) x_a^\dagger\mathbf{K}^{-1}x_a=\widetilde{\zeta}_a/(1+\widetilde{\zeta}_a) x a † K − 1 x a = ζ a / ( 1 + ζ a ) and x a † K − 2 x a = η a / ( 1 + ζ ~ a ) 2 x_a^\dagger\mathbf{K}^{-2}x_a=\eta_a/(1+\widetilde{\zeta}_a)^2 x a † K − 2 x a = η a / ( 1 + ζ a ) 2 . Summing over columns yields the two exact sum rules
∑ a = 1 n o u t ζ ~ a 1 + ζ ~ a = d 2 = γ o u t n o u t , ∑ a = 1 n o u t η a ( 1 + ζ ~ a ) 2 = T 1 . (61) \sum_{a=1}^{n_{\mathrm{out}}}\frac{\widetilde{\zeta}_a}{1+\widetilde{\zeta}_a}=d^2=\gamma_{\mathrm{out}}n_{\mathrm{out}}, \qquad\sum_{a=1}^{n_{\mathrm{out}}}\frac{\eta_a}{(1+\widetilde{\zeta}_a)^2}=\mathcal{T}_1. \tag*{(61)} a = 1 ∑ n out 1 + ζ a ζ a = d 2 = γ out n out , a = 1 ∑ n out ( 1 + ζ a ) 2 η a = T 1 . (61)
Since K ( a ) ⪯ K \mathbf{K}_{(a)}\preceq\mathbf{K} K ( a ) ⪯ K , Tr ( K ( a ) − j ) ≥ T j \operatorname{Tr}(\mathbf{K}_{(a)}^{-j})\ge\mathcal{T}_j Tr ( K ( a ) − j ) ≥ T j for j = 1 , 2 j=1,2 j = 1 , 2 . The small-ball bound lemma G6 says that an independent lift is unlikely to have quadratic weight much smaller than Tr ( B ) \operatorname{Tr}(\mathbf{B}) Tr ( B ) , even for an ill-conditioned B \mathbf{B} B . Specifically,
P ( x † B x ≤ ε Tr ( B ) ∣ B ) ≤ C 0 ε 1 / 4 (62) \mathbb{P}\left(x^\dagger\mathbf{B}x\le\varepsilon\operatorname{Tr}(\mathbf{B})\mid\mathbf{B}\right)\le C_0\varepsilon^{1/4} \tag*{(62)} P ( x † B x ≤ ε Tr ( B ) ∣ B ) ≤ C 0 ε 1/4 (62)
Fix γ ′ ∈ ( γ , 1 ) \gamma' \in(\gamma,1) γ ′ ∈ ( γ , 1 ) and set R = 2 γ ′ / ( 1 − γ ′ ) R = 2\gamma'/(1-\gamma') R = 2 γ ′ / ( 1 − γ ′ ) , β = ( 1 − γ ′ ) / 2 \beta= (1-\gamma')/2 β = ( 1 − γ ′ ) /2 . We show, for all sufficiently large d d d with γ o u t ≤ γ ′ \gamma_{\mathrm{out}} \le\gamma' γ out ≤ γ ′ and all ε ∈ ( 0 , 1 ) \varepsilon\in(0,1) ε ∈ ( 0 , 1 ) , that
P ( T 1 > R ε ) ≤ C 0 ε 1 / 4 β , P ( n o u t T 2 > 2 R ( 1 + R ) 2 ε 2 β ) ≤ 3 C 0 ε 1 / 4 β . (63) \mathbb{P}\left(\mathcal{T}_1 > \frac{R}{\varepsilon}\right) \le\frac{C_0\varepsilon^{1/4}}{\beta}, \qquad\mathbb{P}\left(n_{\mathrm{out}}\mathcal{T}_2 > \frac{2R(1+R)^2}{\varepsilon^2\beta}\right) \le\frac{3C_0\varepsilon^{1/4}}{\beta}. \tag*{(63)} P ( T 1 > ε R ) ≤ β C 0 ε 1/4 , P ( n out T 2 > ε 2 β 2 R ( 1 + R ) 2 ) ≤ β 3 C 0 ε 1/4 . (63)
These bounds imply both asserted inverse-moment estimates.
First inverse moment — Take t > 0 t>0 t > 0 and N 1 = # { a : ξ ~ a ≤ ε t } N_1=\#\{a:\widetilde{\xi}_a\le\varepsilon t\} N 1 = # { a : ξ a ≤ εt } . The event { T 1 ≥ t , ξ ~ a ≤ ε t } \{\mathcal{T}_1\ge t,\widetilde{\xi}_a\le\varepsilon t\} { T 1 ≥ t , ξ a ≤ εt } is contained in F a = { ξ ~ a ≤ ε Tr ( K ( a ) − 1 ) } F_a=\{\widetilde{\xi}_a\le\varepsilon\operatorname{Tr}(\mathbf{K}_{(a)}^{-1})\} F a = { ξ a ≤ ε Tr ( K ( a ) − 1 )} . Independence of x a \mathbf{x}_a x a and K ( a ) \mathbf{K}_{(a)} K ( a ) gives P ( F a ) ≤ C 0 ε 1 / 4 \mathbb{P}(F_a)\le C_0\varepsilon^{1/4} P ( F a ) ≤ C 0 ε 1/4 . Summing and applying Markov’s inequality gives P ( T 1 ≥ t , N 1 ≥ β n o u t ) ≤ C 0 ε 1 / 4 / β \mathbb{P}(\mathcal{T}_1\ge t,N_1\ge\beta n_{\mathrm{out}})\le C_0\varepsilon^{1/4}/\beta P ( T 1 ≥ t , N 1 ≥ β n out ) ≤ C 0 ε 1/4 / β . On { N 1 < β n o u t } \{N_1<\beta n_{\mathrm{out}}\} { N 1 < β n out } , the first sum rule instead implies γ o u t ≥ ( 1 − β ) ε t / ( 1 + ε t ) \gamma_{\mathrm{out}}\ge(1-\beta)\varepsilon t/(1+\varepsilon t) γ out ≥ ( 1 − β ) εt / ( 1 + εt ) , hence ε t ≤ γ ′ / ( 1 − β − γ ′ ) = R \varepsilon t\le\gamma'/(1-\beta-\gamma')=R εt ≤ γ ′ / ( 1 − β − γ ′ ) = R . Thus { T 1 ≥ t , N 1 < β n o u t } \{\mathcal{T}_1\ge t,N_1<\beta n_{\mathrm{out}}\} { T 1 ≥ t , N 1 < β n out } is empty for t > R / ε t>R/\varepsilon t > R / ε , proving the first bound in eq. (63) .
Second inverse moment — The first sum rule bounds the number of large ξ ~ a \widetilde{\xi}_a ξ a deterministically:
# { a : ξ ~ a ≥ R } ≤ γ ′ n o u t 1 + R R = 1 + γ ′ 2 n o u t , ∣ A ∣ ≥ β n o u t , A = { a : ξ ~ a < R } . (64) \#\{a:\widetilde{\xi}_a\ge R\}\le\gamma'n_{\mathrm{out}}\frac{1+R}{R}=\frac{1+\gamma'}{2}n_{\mathrm{out}}, \qquad|\mathcal{A}|\ge\beta n_{\mathrm{out}}, \qquad\mathcal{A}=\{a:\widetilde{\xi}_a<R\}. \tag*{(64)} # { a : ξ a ≥ R } ≤ γ ′ n out R 1 + R = 2 1 + γ ′ n out , ∣ A ∣ ≥ β n out , A = { a : ξ a < R } . (64)
Let N 2 = # { a : η a ≤ ε t } N_2=\#\{a:\eta_a\le\varepsilon t\} N 2 = # { a : η a ≤ εt } . Apply the same small-ball argument to K ( a ) − 2 \mathbf{K}_{(a)}^{-2} K ( a ) − 2 to obtain P ( T 2 ≥ t , N 2 ≥ β n o u t / 2 ) ≤ 2 C 0 ε 1 / 4 / β \mathbb{P}(\mathcal{T}_2\ge t,N_2\ge\beta n_{\mathrm{out}}/2)\le2C_0\varepsilon^{1/4}/\beta P ( T 2 ≥ t , N 2 ≥ β n out /2 ) ≤ 2 C 0 ε 1/4 / β . On { N 2 < β n o u t / 2 } \{N_2<\beta n_{\mathrm{out}}/2\} { N 2 < β n out /2 } , at least β n o u t / 2 \beta n_{\mathrm{out}}/2 β n out /2 indices in A \mathcal{A} A satisfy η a > ε t \eta_a>\varepsilon t η a > εt . The second sum rule then gives T 1 ≥ β n o u t ε t / [ 2 ( 1 + R ) 2 ] \mathcal{T}_1\ge\beta n_{\mathrm{out}}\varepsilon t/[2(1+R)^2] T 1 ≥ β n out εt / [ 2 ( 1 + R ) 2 ] . Intersecting with { T 1 ≤ R / ε } \{\mathcal{T}_1\le R/\varepsilon\} { T 1 ≤ R / ε } forces t ≤ 2 R ( 1 + R ) 2 / ( ε 2 β n o u t ) t\le2R(1+R)^2/(\varepsilon^2\beta n_{\mathrm{out}}) t ≤ 2 R ( 1 + R ) 2 / ( ε 2 β n out ) . Adding the two failure probabilities proves the second bound in eq. (63) .
Total weight of small eigenvalues — Every eigenvalue below θ n o u t \theta n_{\mathrm{out}} θ n out contributes at least ( θ n o u t ) − 1 (\theta n_{\mathrm{out}})^{-1} ( θ n out ) − 1 to T 1 \mathcal{T}_1 T 1 . Cauchy–Schwarz gives
∑ λ j ( K ) ≤ θ n o u t 1 λ j ( K ) ≤ # { j : λ j ( K ) ≤ θ n o u t } T 2 ≤ θ T 1 ( n o u t T 2 ) . (65) \sum_{\lambda_j(\mathbf{K})\le\theta n_{\mathrm{out}}}\frac{1}{\lambda_j(\mathbf{K})}\le\sqrt{\#\{j:\lambda_j(\mathbf{K})\le\theta n_{\mathrm{out}}\}}\sqrt{\mathcal{T}_2}\le\sqrt{\theta}\sqrt{\mathcal{T}_1(n_{\mathrm{out}}\mathcal{T}_2)}. \tag*{(65)} λ j ( K ) ≤ θ n out ∑ λ j ( K ) 1 ≤ # { j : λ j ( K ) ≤ θ n out } T 2 ≤ θ T 1 ( n out T 2 ) . (65)
The inverse-moment estimates and n o u t / ( d 2 − 1 ) → γ − 1 n_{\mathrm{out}}/(d^2-1)\to\gamma^{-1} n out / ( d 2 − 1 ) → γ − 1 prove the tail bound uniformly in d d d .
Classical variance profile
The theorem below gives the precise variance law stated in § 3 C: test states and target rotations are averaged at fixed POVM, and convergence in probability is over the POVM. Nearly uniform mean outcome probabilities reduce the normalized variance to S d S_d S d . Its limit diverges at γ = 1 \gamma=1 γ = 1 because the positive bulk reaches zero; inaccessible directions have zero pseudoinverse weight and account for the factor min { 1 , γ − 1 } \min\{1,\gamma^{-1}\} min { 1 , γ − 1 } . Under the stated target bound, the identity component contributes asymptotically vanishing normalized variance.
Theorem C1 (Classical variance peak). Let μ \mu μ be a Haar-random rank-one POVM with n o u t n_{\mathrm{out}} n out outcomes in dimension d d d , σ \sigma σ an independent Haar pure state, and O U = U † O U O_U=U^\dagger O U O U = U † O U for fixed Hermitian O O O and Haar U U U independent of the POVM and test state. Assume Δ O 2 > 0 \Delta_O^2>0 Δ O 2 > 0 and ∣ Tr ( O ) ∣ / ( d Δ O 2 ) ≤ C |\operatorname{Tr}(O)|/(d\sqrt{\Delta_O^2})\le C ∣ Tr ( O ) ∣/ ( d Δ O 2 ) ≤ C . Define the conditional Haar average, which depends on the POVM through M μ M_\mu M μ ,
V e x = E U , σ [ ∥ D σ 1 / 2 M μ + v O U ∥ 2 − ∣ v O U † Π μ v σ ∣ 2 ] ∣ μ . (66) V_{\mathrm{ex}}=\mathbb{E}_{U,\sigma}\left[\left\|\mathbb{D}_\sigma^{1/2}M_\mu^+v_{O_U}\right\|^2-\left|v_{O_U}^{\dagger}\Pi_\mu v_\sigma\right|^2\right]\mid\mu. \tag*{(66)} V ex = E U , σ [ D σ 1/2 M μ + v O U 2 − v O U † Π μ v σ 2 ] ∣ μ . (66) As d → ∞ d\to\infty d → ∞ with γ o u t → γ ∈ ( 0 , ∞ ) \gamma_{\mathrm{out}}\to\gamma\in(0,\infty) γ out → γ ∈ ( 0 , ∞ ) , convergence in probability over the POVM gives
V e x d Δ O 2 → P { J c l ( γ ) = min { 1 , γ − 1 } ∣ 1 − γ ∣ , γ ≠ 1 , + ∞ , γ = 1. (67) \frac{V_{\mathrm{ex}}}{d\Delta_O^2}\xrightarrow{\mathbb{P}}
\begin{cases}
\mathcal{J}_{\mathrm{cl}}(\gamma)=\dfrac{\min\{1,\gamma^{-1}\}}{|1-\gamma|}, & \gamma\ne1,\\
+\infty, & \gamma=1.
\end{cases} \tag*{(67)} d Δ O 2 V ex P ⎩ ⎨ ⎧ J cl ( γ ) = ∣1 − γ ∣ min { 1 , γ − 1 } , + ∞ , γ = 1 , γ = 1. (67)
Proof. Identity target contribution — Write O U = c O I d + U † O U O_U=c_O I_d+U^\dagger O U O U = c O I d + U † O U . By eq. (32) , the traceless term has mean zero and covariance d Δ O 2 P 0 / ( d 2 − 1 ) d\Delta_O^2P_0/(d^2-1) d Δ O 2 P 0 / ( d 2 − 1 ) , so its mixed variance term with the identity vanishes after the U U U average. The identity shadow coefficients are w s h a d ( I d ) = Π i m M μ T 1 n o u t w_{\mathrm{shad}}(I_d)=\Pi_{\mathrm{im}M_\mu}^{\mathsf{T}}1_{n_{\mathrm{out}}} w shad ( I d ) = Π im M μ T 1 n out . Since n o u t P I / d n_{\mathrm{out}}P_I/d n out P I / d lies in this outcome-space range, Δ d = max a ∣ n o u t P I / d , a − 1 ∣ \Delta_d=\max_a|n_{\mathrm{out}}P_{I/d,a}-1| Δ d = max a ∣ n out P I / d , a − 1∣ gives ∥ w s h a d ( I d ) − 1 n o u t ∥ ≤ n o u t Δ d \|w_{\mathrm{shad}}(I_d)-1_{n_{\mathrm{out}}}\|\le\sqrt{n_{\mathrm{out}}}\Delta_d ∥ w shad ( I d ) − 1 n out ∥ ≤ n out Δ d and V e x ( I d ) ≤ ( 1 + Δ d ) Δ d 2 V_{\mathrm{ex}}(I_d)\le(1+\Delta_d)\Delta_d^2 V ex ( I d ) ≤ ( 1 + Δ d ) Δ d 2 . The latter uses Σ ˉ t e 1 n o u t = 0 \bar{\Sigma}_{te1_{nout}} = 0 Σ ˉ t e 1 n o u t = 0 and Σ ˉ t e ⪯ D I / d ⪯ ( 1 + Δ d ) I n o u t / n o u t \bar{\Sigma}_{te} \preceq D_{I/d} \preceq(1+\Delta_d)I_{nout}/n_{out} Σ ˉ t e ⪯ D I / d ⪯ ( 1 + Δ d ) I n o u t / n o u t . Trace concentration and the target assumption therefore imply c O 2 V e x ( I d ) / ( d Δ O 2 ) = o P ( 1 ) c_{\mathcal{O}}^2V_{\mathrm{ex}}(I_d)/(d\Delta_{\mathcal{O}}^2)=o_P(1) c O 2 V ex ( I d ) / ( d Δ O 2 ) = o P ( 1 ) , without requiring uniform minimum-norm identity coefficients.
Reduction to inverse spectral weight — The independent target and test-state moments give the exact average
V e x = d Δ O 2 d 2 − 1 ∥ D I / d 1 / 2 M μ + P 0 ∥ F 2 − B d ( μ ) + c O 2 V e x ( I d ) , (68) V_{\mathrm{ex}} = \frac{d\Delta_{\mathcal{O}}^2}{d^2-1}\left\|D_{I/d}^{1/2}M_\mu^+P_0\right\|_F^2-\mathcal{B}_d(\mu)+c_{\mathcal{O}}^2V_{\mathrm{ex}}(I_d), \tag*{(68)} V ex = d 2 − 1 d Δ O 2 D I / d 1/2 M μ + P 0 F 2 − B d ( μ ) + c O 2 V ex ( I d ) , (68)
B d ( μ ) = Δ O 2 ( d 2 − 1 ) ( d + 1 ) Tr ( P 0 Π μ ( I d 2 + v I d v I d † ) Π μ ) . \mathcal{B}_d(\mu)=\frac{\Delta_{\mathcal{O}}^2}{(d^2-1)(d+1)}\operatorname{Tr}\left(P_0\Pi_\mu(I_{d^2}+v_{I_d}v_{I_d}^{\dagger})\Pi_\mu\right). B d ( μ ) = ( d 2 − 1 ) ( d + 1 ) Δ O 2 Tr ( P 0 Π μ ( I d 2 + v I d v I d † ) Π μ ) .
Because the two projectors are contractions and Tr ( I d 2 + v I d v I d † ) = d 2 + d \operatorname{Tr}(I_{d^2}+v_{I_d}v_{I_d}^{\dagger})=d^2+d Tr ( I d 2 + v I d v I d † ) = d 2 + d , the subtracted term obeys 0 ≤ B d ≤ d Δ O 2 / ( d 2 − 1 ) 0\leq\mathcal{B}_d\leq d\Delta_{\mathcal{O}}^2/(d^2-1) 0 ≤ B d ≤ d Δ O 2 / ( d 2 − 1 ) . By lemma B2, Δ d = ∥ n o u t D I / d − I n o u t ∥ o p = O P ( log n o u t / d ) = o P ( 1 ) \Delta_d=\left\|n_{out}D_{I/d}-I_{n_{out}}\right\|_{\mathrm{op}}=O_P\left(\sqrt{\log n_{out}/d}\right)=o_P(1) Δ d = n o u t D I / d − I n o u t op = O P ( log n o u t / d ) = o P ( 1 ) , so on { Δ d < 1 } \{\Delta_d<1\} { Δ d < 1 } ,
1 − Δ d n o u t ∥ M μ + P 0 ∥ F 2 ≤ ∥ D I / d 1 / 2 M μ + P 0 ∥ F 2 ≤ 1 + Δ d n o u t ∥ M μ + P 0 ∥ F 2 . (69) \frac{1-\Delta_d}{n_{out}}\left\|M_\mu^+P_0\right\|_F^2\leq\left\|D_{I/d}^{1/2}M_\mu^+P_0\right\|_F^2\leq\frac{1+\Delta_d}{n_{out}}\left\|M_\mu^+P_0\right\|_F^2. \tag*{(69)} n o u t 1 − Δ d M μ + P 0 F 2 ≤ D I / d 1/2 M μ + P 0 F 2 ≤ n o u t 1 + Δ d M μ + P 0 F 2 . (69)
The identity contribution is removed exactly by
∥ M μ + P 0 ∥ F 2 = Tr ( F μ + ) − v I d † F μ + v I d d , (70) \left\|M_\mu^+P_0\right\|_F^2=\operatorname{Tr}(\mathcal{F}_\mu^+)-\frac{v_{I_d}^{\dagger}\mathcal{F}_\mu^+v_{I_d}}{d}, \tag*{(70)} M μ + P 0 F 2 = Tr ( F μ + ) − d v I d † F μ + v I d , (70)
0 ≤ v I d † F μ + v I d d ≤ n o u t d . 0\leq\frac{v_{I_d}^{\dagger}\mathcal{F}_\mu^+v_{I_d}}{d}\leq\frac{n_{out}}{d}. 0 ≤ d v I d † F μ + v I d ≤ d n o u t .
For the upper bound, M μ 1 n o u t = v I d M_\mu\mathbf{1}_{n_{out}}=v_{I_d} M μ 1 n o u t = v I d makes 1 n o u t \mathbf{1}_{n_{out}} 1 n o u t a feasible solution, so ∥ M μ + v I d ∥ 2 ≤ n o u t \left\|M_\mu^+v_{I_d}\right\|^2\leq n_{out} M μ + v I d 2 ≤ n o u t . The normalized subtracted term is at most 1 / ( d 2 − 1 ) 1/(d^2-1) 1/ ( d 2 − 1 ) , and the removed identity contribution is at most 1 / [ d ( d 2 − 1 ) ] 1/[d(d^2-1)] 1/ [ d ( d 2 − 1 )] . Together with trace concentration and the identity-target estimate, these bounds give
V e x d Δ O 2 = ( 1 + o P ( 1 ) ) S d + o P ( 1 ) . (71) \frac{V_{\mathrm{ex}}}{d\Delta_{\mathcal{O}}^2}=(1+o_P(1))S_d+o_P(1). \tag*{(71)} d Δ O 2 V ex = ( 1 + o P ( 1 )) S d + o P ( 1 ) . (71)
Transferring positive eigenvalues — By lemma B1, n o u t F μ = T A T † n_{out}\mathcal{F}_\mu=TAT^\dagger n o u t F μ = T A T † , with δ d = ∥ T − I d 2 ∥ o p = O P ( d − 1 / 2 ) \delta_d=\left\|T-I_{d^2}\right\|_{\mathrm{op}}=O_P(d^{-1/2}) δ d = ∥ T − I d 2 ∥ op = O P ( d − 1/2 ) . Both matrices have rank min ( d 2 , n o u t ) \min(d^2,n_{out}) min ( d 2 , n o u t ) . The congruence estimate lemma G1 bounds their ordered positive eigenvalues between ( 1 − δ d ) 2 λ j ( A ) (1-\delta_d)^2\lambda_j(A) ( 1 − δ d ) 2 λ j ( A ) and ( 1 + δ d ) 2 λ j ( A ) (1+\delta_d)^2\lambda_j(A) ( 1 + δ d ) 2 λ j ( A ) . Inverting gives
S d = ( 1 + O P ( d − 1 / 2 ) ) Tr ( A + ) d 2 − 1 , S_d=(1+O_P(d^{-1/2}))\frac{\operatorname{Tr}(A^+)}{d^2-1}, S d = ( 1 + O P ( d − 1/2 )) d 2 − 1 Tr ( A + ) ,
∫ ( 0 , θ ) d ν d + ( x ) x ≤ 4 d 2 − 1 ∑ 0 < λ j ( A ) ≤ 4 θ 1 λ j ( A ) ( δ d ≤ 1 / 2 ) . (72) \int_{(0,\theta)}\frac{d\nu_d^+(x)}{x}\leq\frac{4}{d^2-1}\sum_{0<\lambda_j(A)\leq4\theta}\frac{1}{\lambda_j(A)}\qquad(\delta_d\leq1/2). \tag*{(72)} ∫ ( 0 , θ ) x d ν d + ( x ) ≤ d 2 − 1 4 0 < λ j ( A ) ≤ 4 θ ∑ λ j ( A ) 1 ( δ d ≤ 1/2 ) . (72)
Indeed, an eigenvalue of n o u t F μ n_{out}\mathcal{F}_\mu n o u t F μ below θ \theta θ corresponds to one of A A A below 4 θ 4\theta 4 θ , with reciprocal enlarged by at most four.
Critical divergence from bounded tests — For a > 0 a>0 a > 0 , f a ( x ) = x / ( x + a ) 2 f_a(x)=x/(x+a)^2 f a ( x ) = x / ( x + a ) 2 is bounded and continuous, vanishes at zero, and increases to x − 1 x^{-1} x − 1 for x > 0 x>0 x > 0 as a ↓ 0 a\downarrow0 a ↓ 0 . The MP law and monotone convergence give
S d ≥ ∫ f a d ν d + → P ∫ f a d μ M P , γ ↗ ∫ ( 0 , ∞ ) d μ M P , γ ( x ) x ( a ↓ 0 ) . (73) S_d\geq\int f_a\,d\nu_d^+\xrightarrow{\mathbb{P}}\int f_a\,d\mu_{\mathrm{MP},\gamma}\nearrow\int_{(0,\infty)}\frac{d\mu_{\mathrm{MP},\gamma}(x)}{x}\qquad(a\downarrow0). \tag*{(73)} S d ≥ ∫ f a d ν d + P ∫ f a d μ MP , γ ↗ ∫ ( 0 , ∞ ) x d μ MP , γ ( x ) ( a ↓ 0 ) . (73)
At γ = 1 \gamma=1 γ = 1 , the density behaves as x − 1 / 2 x^{-1/2} x − 1/2 near zero, so its inverse moment diverges. Given K K K , choose a a a with ∫ f a d μ M P , 1 > K + 1 \int f_a\,d\mu_{\mathrm{MP},1}>K+1 ∫ f a d μ MP , 1 > K + 1 ; then P ( S d > K ) → 1 \mathbb{P}(S_d>K)\to1 P ( S d > K ) → 1 . Away from γ = 1 \gamma=1 γ = 1 , the same argument gives P ( S d ≥ J c l ( γ ) − δ ) → 1 \mathbb{P}(S_d\geq\mathcal{J}_{\mathrm{cl}}(\gamma)-\delta)\to1 P ( S d ≥ J cl ( γ ) − δ ) → 1 for every δ > 0 \delta>0 δ > 0 .
Below informational completeness, γ > 1 \gamma>1 γ > 1 — Here X X X has independent columns and full column rank. The negative second moment identity lemma G2 gives
Tr ( A + ) = n o u t ∑ a = 1 n o u t 1 D a , D a = dist ( x a , span { x b : b ≠ a } ) 2 . (74) \operatorname{Tr}(A^+)=n_{out}\sum_{a=1}^{n_{out}}\frac{1}{D_a},\qquad D_a=\operatorname{dist}(x_a,\operatorname{span}\{x_b:b\ne a\})^2. \tag*{(74)} Tr ( A + ) = n o u t a = 1 ∑ n o u t D a 1 , D a = dist ( x a , span { x b : b = a } ) 2 . (74)
The orthogonal complement of the other columns has projector Q a \mathbf{Q}_a Q a , independent of g ^ a \hat{g}_a g ^ a , of rank d 2 − n o u t + 1 d^2-n_{\mathrm{out}}+1 d 2 − n out + 1 . Thus D a = x a T Q a x a D_a=x_a^\mathsf{T}Q_ax_a D a = x a T Q a x a has conditional mean d 2 − n o u t + 1 + ∥ Q a v I d 2 ∥ 2 = d 2 − n o u t + 1 + O ( d ) d^2-n_{\mathrm{out}}+1+\lVert Q_av_{I d^2}\rVert^2=d^2-n_{\mathrm{out}}+1+O(d) d 2 − n out + 1 + ∥ Q a v I d 2 ∥ 2 = d 2 − n out + 1 + O ( d ) . Apply lemma G5 at scale d − 1 / 4 d^{-1/4} d − 1/4 and take a union bound over n o u t ≤ d 2 n_{\mathrm{out}}\le d^2 n out ≤ d 2 columns to obtain max a ∣ D a / d 2 − ( 1 − n o u t / d 2 ) ∣ = O P ( d − 1 / 4 ) \max_a|D_a/d^2-(1-n_{\mathrm{out}}/d^2)|=O_{\mathrm{P}}(d^{-1/4}) max a ∣ D a / d 2 − ( 1 − n out / d 2 ) ∣ = O P ( d − 1/4 ) . Since 1 − n o u t / d 2 → 1 − γ − 1 > 0 1-n_{\mathrm{out}}/d^2\to1-\gamma^{-1}>0 1 − n out / d 2 → 1 − γ − 1 > 0 , these distances can be inverted uniformly. Therefore,
S d = ( 1 + O P ( d − 1 / 4 ) ) n o u t 2 ( d 2 − 1 ) ( d 2 − n o u t ) → P 1 γ ( γ − 1 ) = J c l ( γ ) . (75) S_d=\left(1+O_{\mathrm{P}}(d^{-1/4})\right)\frac{n_{\mathrm{out}}^2}{(d^2-1)(d^2-n_{\mathrm{out}})}\xrightarrow{\mathrm{P}}\frac{1}{\gamma(\gamma-1)}=\mathcal{J}_{\mathrm{cl}}(\gamma). \tag*{(75)} S d = ( 1 + O P ( d − 1/4 ) ) ( d 2 − 1 ) ( d 2 − n out ) n out 2 P γ ( γ − 1 ) 1 = J cl ( γ ) . (75)
Above informational completeness, γ < 1 \gamma<1 γ < 1 — The rows of X \mathbf{X} X are dependent quadratic functions, so the column-distance argument cannot be applied to them. Instead choose 0 < θ < λ − = ( 1 − γ ) 2 0<\theta<\lambda_-=(1-\sqrt{\gamma})^2 0 < θ < λ − = ( 1 − γ ) 2 and split S d S_d S d into integrals on [ θ , ∞ ) [\theta,\infty) [ θ , ∞ ) and ( 0 , θ ) (0,\theta) ( 0 , θ ) . The first integrand is bounded and its only discontinuity lies outside the MP support. Hence theorem B1 gives
∫ [ θ , ∞ ) d ν d + ( x ) x → P ∫ [ θ , ∞ ) d μ M P , γ ( x ) x = 1 1 − γ = J c l ( γ ) . (76) \int_{[\theta,\infty)}\frac{d\nu_d^+(x)}{x}\xrightarrow{\mathrm{P}}\int_{[\theta,\infty)}\frac{d\mu_{\mathrm{MP},\gamma}(x)}{x}=\frac{1}{1-\gamma}=\mathcal{J}_{\mathrm{cl}}(\gamma). \tag*{(76)} ∫ [ θ , ∞ ) x d ν d + ( x ) P ∫ [ θ , ∞ ) x d μ MP , γ ( x ) = 1 − γ 1 = J cl ( γ ) . (76)
For K = X X † = n o u t A K=XX^\dagger=n_{\mathrm{out}}A K = X X † = n out A , lemma C1 and eq. (72) give
∫ ( 0 , θ ) d ν d + ( x ) x ≤ 4 n o u t d 2 − 1 ∑ λ j ( K ) ≤ 4 θ n o u t 1 λ j ( K ) = O P ( θ ) (77) \int_{(0,\theta)}\frac{d\nu_d^+(x)}{x}\le\frac{4n_{\mathrm{out}}}{d^2-1}\sum_{\lambda_j(K)\le4\theta n_{\mathrm{out}}}\frac{1}{\lambda_j(K)}=O_{\mathrm{P}}(\sqrt{\theta}) \tag*{(77)} ∫ ( 0 , θ ) x d ν d + ( x ) ≤ d 2 − 1 4 n out λ j ( K ) ≤ 4 θ n out ∑ λ j ( K ) 1 = O P ( θ ) (77)
uniformly in d d d . Given ε , ϱ > 0 \varepsilon,\varrho>0 ε , ϱ > 0 , choose θ \theta θ below λ − \lambda_- λ − so that the limiting upper probability of a tail exceeding ε / 2 \varepsilon/2 ε /2 is at most ϱ \varrho ϱ . For this fixed θ \theta θ , eq. (76) puts the bulk within ε / 2 \varepsilon/2 ε /2 of J c l ( γ ) \mathcal{J}_{\mathrm{cl}}(\gamma) J cl ( γ ) with probability tending to one. Letting ϱ ↓ 0 \varrho\downarrow0 ϱ ↓ 0 proves S d → P 1 / ( 1 − γ ) S_d\xrightarrow{\mathrm{P}}1/(1-\gamma) S d P 1/ ( 1 − γ ) . All three regimes, together with eq. (71) , prove the theorem.
Relation to exact-feature training
Exact-feature regression uses P a i = Tr ( μ a ρ i ) P_{ai}=\operatorname{Tr}(\mu_a\rho_i) P ai = Tr ( μ a ρ i ) and y i = Tr ( O ρ i ) y_i=\operatorname{Tr}(O\rho_i) y i = Tr ( O ρ i ) , choosing the minimum-norm least-squares readout w 0 = ( P + ) T y w_0=(P^+)^\mathsf{T}y w 0 = ( P + ) T y . The question in § 3 D is when this training fit returns the reconstruction coefficients used above. Full-rank measurement and training designs give those coefficients exactly. Below informational completeness, finite training sets can couple accessible and inaccessible operator directions through their empirical state covariance; sufficiently many Haar training states suppress that coupling and recover the projected target in the relevant test-noise norm.
Corollary C1 (Relation to exact training). Under the measurement and target assumptions of theorem C1, if both measurement and training designs have rank d 2 d^2 d 2 , exact minimum-norm regression gives w 0 = M μ + v O w_0=M_\mu^+v_O w 0 = M μ + v O , and the theorem applies to its test variance. If n o u t < d 2 n_{\mathrm{out}}<d^2 n out < d 2 and the training states are independent Haar pure states with d 2 log d / n t r → 0 d^2\log d/n_{\mathrm{tr}}\to0 d 2 log d / n tr → 0 , the learned coefficients approach the shadow coefficients in the Haar-averaged test-noise norm normalized by q d Δ O 2 q\sqrt{d\Delta_O^2} q d Δ O 2 . At fixed γ o u t > 1 \gamma_{\mathrm{out}}>1 γ out > 1 , the averaged variance consequently has the limit in eq. (67) .
Proof. Full-rank designs — If both designs have rank d 2 d^2 d 2 , the reverse-order identity gives P + = M ρ + ( M μ + ) T P^+=M_\rho^+(M_\mu^+)^\mathsf{T} P + = M ρ + ( M μ + ) T . Transpose this identity and apply it to y = M ρ T v O y=M_\rho^\mathsf{T}v_O y = M ρ T v O . Since M ρ M ρ + = I d 2 M_\rho M_\rho^+=I_{d^2} M ρ M ρ + = I d 2 , the result is w 0 = M μ + v O w_0=M_\mu^+v_O w 0 = M μ + v O .
Whitened training covariance — The raw state frame is F ρ = M ρ M ρ T \mathcal{F}_\rho=M_\rho M_\rho^\mathsf{T} F ρ = M ρ M ρ T . For n o u t < d 2 n_{\mathrm{out}}<d^2 n out < d 2 , multiply state coordinates by C ρ − 1 / 2 C_\rho^{-1/2} C ρ − 1/2 , where C ρ = E [ v ρ v ρ T ] C_\rho=\mathbb{E}[v_\rho v_\rho^\mathsf{T}] C ρ = E [ v ρ v ρ T ] . This whitening equalizes the population second moments without subtracting the mean: put H ρ = C ρ − 1 / 2 F ρ C ρ − 1 / 2 / n t r H_\rho=C_\rho^{-1/2}\mathcal{F}_\rho C_\rho^{-1/2}/n_{\mathrm{tr}} H ρ = C ρ − 1/2 F ρ C ρ − 1/2 / n tr and e n t r = ∥ H ρ − I d 2 ∥ o p e_{n_{\mathrm{tr}}}=\lVert H_\rho-I_{d^2}\rVert_{\mathrm{op}} e n tr = ∥ H ρ − I d 2 ∥ op . Each whitened state has squared norm d 2 d^2 d 2 and second moment I d 2 I_{d^2} I d 2 . Matrix Bernstein [42 ] gives e n t r = O P ( 1 ) e_{n_{\mathrm{tr}}}=O_{\mathrm{P}}(1) e n tr = O P ( 1 ) when d 2 log d / n t r → 0 d^2\log d/n_{\mathrm{tr}}\to0 d 2 log d / n tr → 0 .
Mixing of accessible and inaccessible directions — The measurement range L = im M μ L=\operatorname{im}M_\mu L = im M μ contains v I d v_{I_d} v I d , so L ⊥ L^\perp L ⊥ is traceless and Π μ \Pi_\mu Π μ commutes with C ρ C_\rho C ρ . Write w 0 = M μ + w w_0=M_\mu^+w w 0 = M μ + w with w ∈ L w\in L w ∈ L . The normal equations give
w − Π μ v O = C ρ , L − 1 / 2 ( Π μ H ρ Π μ ∣ L ) − 1 Π μ ( H ρ − I d 2 ) ( I d 2 − Π μ ) C ρ 1 / 2 v O . (78) w-\Pi_\mu v_O=C_{\rho,L}^{-1/2}(\Pi_\mu H_\rho\Pi_\mu|_L)^{-1}\Pi_\mu(H_\rho-I_{d^2})(I_{d^2}-\Pi_\mu)C_\rho^{1/2}v_O. \tag*{(78)} w − Π μ v O = C ρ , L − 1/2 ( Π μ H ρ Π μ ∣ L ) − 1 Π μ ( H ρ − I d 2 ) ( I d 2 − Π μ ) C ρ 1/2 v O . (78)
The eigenvalue of C ρ C_{\rho} C ρ on L ⊥ L^{\perp} L ⊥ is 1 / [ d ( d + 1 ) ] 1/[d(d+1)] 1/ [ d ( d + 1 )] , and its eigenvalues on L L L are no smaller. On { ε n t r < 1 } \{\varepsilon_{\mathrm{ntr}}<1\} { ε ntr < 1 } , the map on the right has norm at most ε n t r / ( 1 − ε n t r ) \varepsilon_{\mathrm{ntr}}/(1-\varepsilon_{\mathrm{ntr}}) ε ntr / ( 1 − ε ntr ) and annihilates v I d v_{\mathrm{Id}} v Id . For the learned weights corresponding to O U \mathcal{O}_{U} O U , the target second moment therefore gives
E U ∥ D I / d 1 / 2 ( w 0 − M μ + v O U ) ∥ 2 ≤ d Δ O 2 d 2 − 1 ( ε n t r 1 − ε n t r ) 2 ∥ D I / d 1 / 2 M μ + ∥ F 2 . (79) \mathbb{E}_{U}\left\|D_{I/d}^{1/2}(w_{0}-M_{\mu}^{+}v_{\mathcal{O}_{U}})\right\|^{2}
\leq\frac{d\Delta_{\mathcal{O}}^{2}}{d^{2}-1}\left(\frac{\varepsilon_{\mathrm{ntr}}}{1-\varepsilon_{\mathrm{ntr}}}\right)^{2}\left\|D_{I/d}^{1/2}M_{\mu}^{+}\right\|_{F}^{2}. \tag*{(79)} E U D I / d 1/2 ( w 0 − M μ + v O U ) 2 ≤ d 2 − 1 d Δ O 2 ( 1 − ε ntr ε ntr ) 2 D I / d 1/2 M μ + F 2 . (79)
By theorem C1 and eq. (69) , the right side is o P ( d Δ O 2 ) o_{P}(d\Delta_{\mathcal{O}}^{2}) o P ( d Δ O 2 ) at fixed γ o u t > 1 \gamma_{\mathrm{out}}>1 γ out > 1 . Since Σ ‾ t e ⪯ D I / d \overline{\Sigma}_{\mathrm{te}}\preceq D_{I/d} Σ te ⪯ D I / d , Cauchy–Schwarz bounds the variance cross term by o P ( d Δ O 2 ) o_{P}(d\Delta_{\mathcal{O}}^{2}) o P ( d Δ O 2 ) as well. The limiting shadow observable is Π μ O \Pi_{\mu}\mathcal{O} Π μ O .
Shot-averaged least-squares problem
The noise-induced regularization discussed in § 3 D compares the least-squares problem of a measured record with its average over the training shots. The lemma below collects the exact identities behind this comparison. The training states are held fixed throughout; only the multinomial counts are averaged.
Lemma C2 (Shot-averaged least-squares problem). Fix training states ρ 1 , … , ρ n t r \rho_{1},\ldots,\rho_{n_{\mathrm{tr}}} ρ 1 , … , ρ n tr with exact probability vectors p i p_{i} p i and labels y y y , and let n ^ i ∼ Mult ( N , p i ) \hat{n}_{i}\sim\operatorname{Mult}(N,p_{i}) n ^ i ∼ Mult ( N , p i ) be independent. Write E n ^ \mathbb{E}_{\hat{n}} E n ^ for the expectation over the counts, Σ ‾ t r = n t r − 1 ∑ i Σ i \overline{\Sigma}_{\mathrm{tr}}=n_{\mathrm{tr}}^{-1}\sum_{i}\Sigma_{i} Σ tr = n tr − 1 ∑ i Σ i with Σ i = diag p i − p i p i T \Sigma_{i}=\operatorname{diag}p_{i}-p_{i}p_{i}^{T} Σ i = diag p i − p i p i T , and p ˉ = n t r − 1 ∑ i p i \bar{p}=n_{\mathrm{tr}}^{-1}\sum_{i}p_{i} p ˉ = n tr − 1 ∑ i p i .
For every w ∈ R n o u t w\in\mathbb{R}^{n_{\mathrm{out}}} w ∈ R n out independent of the counts,
1 n t r E n ^ ∥ P ^ N T w − y ∥ 2 = 1 n t r ∥ P T w − y ∥ 2 + 1 N w T Σ ‾ t r w . (80) \frac{1}{n_{\mathrm{tr}}}\mathbb{E}_{\hat{n}}\left\|\hat{P}_{N}^{T}w-y\right\|^{2}
=
\frac{1}{n_{\mathrm{tr}}}\left\|P^{T}w-y\right\|^{2}
+\frac{1}{N}w^{T}\overline{\Sigma}_{\mathrm{tr}}w. \tag*{(80)} n tr 1 E n ^ P ^ N T w − y 2 = n tr 1 P T w − y 2 + N 1 w T Σ tr w . (80) The coefficient matrices of the normal equations P ^ N P ^ N T w = P ^ N y \hat{P}_{N}\hat{P}_{N}^{T}w=\hat{P}_{N}y P ^ N P ^ N T w = P ^ N y have the averages
1 n t r E n ^ [ P ^ N P ^ N T ] = 1 n t r P P T + 1 N Σ ‾ t r , E n ^ [ P ^ N y ] = P y , (81) \frac{1}{n_{\mathrm{tr}}}\mathbb{E}_{\hat{n}}\left[\hat{P}_{N}\hat{P}_{N}^{T}\right]
=
\frac{1}{n_{\mathrm{tr}}}PP^{T}+\frac{1}{N}\overline{\Sigma}_{\mathrm{tr}},
\qquad
\mathbb{E}_{\hat{n}}\left[\hat{P}_{N}y\right]=Py, \tag*{(81)} n tr 1 E n ^ [ P ^ N P ^ N T ] = n tr 1 P P T + N 1 Σ tr , E n ^ [ P ^ N y ] = P y , (81) which are the normal equations of the right side of eq. (80) .
Σ ‾ t r 1 n o u t = 0 \overline{\Sigma}_{\mathrm{tr}}\mathbf{1}_{n_{\mathrm{out}}}=0 Σ tr 1 n out = 0 and Σ ‾ t r = Σ ( p ˉ ) − n t r − 1 ∑ i ( p i − p ˉ ) ( p i − p ˉ ) T \overline{\Sigma}_{\mathrm{tr}}=\Sigma(\bar{p})-n_{\mathrm{tr}}^{-1}\sum_{i}(p_{i}-\bar{p})(p_{i}-\bar{p})^{T} Σ tr = Σ ( p ˉ ) − n tr − 1 ∑ i ( p i − p ˉ ) ( p i − p ˉ ) T , where Σ ( p ˉ ) = diag p ˉ − p ˉ p ˉ T \Sigma(\bar{p})=\operatorname{diag}\bar{p}-\bar{p}\bar{p}^{T} Σ ( p ˉ ) = diag p ˉ − p ˉ p ˉ T .
If max a ∣ n o u t p ˉ a − 1 ∣ ≤ ε \max_{a}|n_{\mathrm{out}}\bar{p}_{a}-1|\leq\varepsilon max a ∣ n out p ˉ a − 1∣ ≤ ε , ∥ F ρ c ∥ o p ≤ K \|\mathcal{F}_{\rho}^{c}\|_{\mathrm{op}}\leq K ∥ F ρ c ∥ op ≤ K and ∥ n o u t P 0 F μ P 0 ∥ o p ≤ K \|n_{\mathrm{out}}P_{0}F_{\mu}P_{0}\|_{\mathrm{op}}\leq K ∥ n out P 0 F μ P 0 ∥ op ≤ K , with the centered training frame of eq. (85) , then
∥ n o u t Σ ‾ t r − Π n o u t ∥ o p ≤ 3 ε + ε 2 + K 2 d ( d + 1 ) . (82) \left\|n_{\mathrm{out}}\overline{\Sigma}_{\mathrm{tr}}-\Pi_{n_{\mathrm{out}}}\right\|_{\mathrm{op}}
\leq3\varepsilon+\varepsilon^{2}+\frac{K^{2}}{d(d+1)}. \tag*{(82)} n out Σ tr − Π n out op ≤ 3 ε + ε 2 + d ( d + 1 ) K 2 . (82)
Proof. Items 1 and 2 — Each frequency vector n ^ i / N \hat{n}_{i}/N n ^ i / N has mean p i p_{i} p i and covariance Σ i / N \Sigma_{i}/N Σ i / N , and different training states are independent. For fixed w w w , the prediction w T n ^ i / N w^{T}\hat{n}_{i}/N w T n ^ i / N therefore has mean w T p i w^{T}p_{i} w T p i and variance w T Σ i w / N w^{T}\Sigma_{i}w/N w T Σ i w / N , and E n ^ ( w T n ^ i / N − y i ) 2 = ( w T p i − y i ) 2 + w T Σ i w / N \mathbb{E}_{\hat{n}}(w^{T}\hat{n}_{i}/N-y_{i})^{2}=(w^{T}p_{i}-y_{i})^{2}+w^{T}\Sigma_{i}w/N E n ^ ( w T n ^ i / N − y i ) 2 = ( w T p i − y i ) 2 + w T Σ i w / N . Summing over i i i and dividing by n t r n_{\mathrm{tr}} n tr gives eq. (80) . Likewise E n ^ [ ( n ^ i / N ) ( n ^ i / N ) T ] = p i p i T + Σ i / N \mathbb{E}_{\hat{n}}[(\hat{n}_{i}/N)(\hat{n}_{i}/N)^{T}]=p_{i}p_{i}^{T}+\Sigma_{i}/N E n ^ [( n ^ i / N ) ( n ^ i / N ) T ] = p i p i T + Σ i / N and E n ^ [ n ^ i / N ] = p i \mathbb{E}_{\hat{n}}[\hat{n}_{i}/N]=p_{i} E n ^ [ n ^ i / N ] = p i ; summing over i i i gives eq. (81) . Setting the gradient of the right side of eq. (80) to zero gives ( P P T / n t r + Σ ‾ t r / N ) w = P y / n t r (PP^{T}/n_{\mathrm{tr}}+\overline{\Sigma}_{\mathrm{tr}}/N)w=Py/n_{\mathrm{tr}} ( P P T / n tr + Σ tr / N ) w = P y / n tr .
Item 3 — Since 1 n o u t T p i = 1 \mathbf{1}_{n_{\mathrm{out}}}^{T}p_{i}=1 1 n out T p i = 1 , Σ i 1 n o u t = p i − p i = 0 \Sigma_{i}\mathbf{1}_{n_{\mathrm{out}}}=p_{i}-p_{i}=0 Σ i 1 n out = p i − p i = 0 . The decomposition follows from n t r − 1 ∑ i p i p i T = p ˉ p ˉ T + n t r − 1 ∑ i ( p i − p ˉ ) ( p i − p ˉ ) T n_{\mathrm{tr}}^{-1}\sum_{i}p_{i}p_{i}^{T}=\bar{p}\bar{p}^{T}+n_{\mathrm{tr}}^{-1}\sum_{i}(p_{i}-\bar{p})(p_{i}-\bar{p})^{T} n tr − 1 ∑ i p i p i T = p ˉ p ˉ T + n tr − 1 ∑ i ( p i − p ˉ ) ( p i − p ˉ ) T .
Item 4 — Put δ a = n o u t p ˉ a − 1 \delta_{a}=n_{\mathrm{out}}\bar{p}_{a}-1 δ a = n out p ˉ a − 1 , so ∥ δ ∥ ≤ ε n o u t \|\delta\|\leq\varepsilon\sqrt{n_{\mathrm{out}}} ∥ δ ∥ ≤ ε n out . Then n o u t Σ ( p ˉ ) − Π n o u t = diag δ − ( δ 1 n o u t T + 1 n o u t δ T + δ δ T ) / n o u t n_{\mathrm{out}}\Sigma(\bar{p})-\Pi_{n_{\mathrm{out}}}=\operatorname{diag}\delta-(\delta\mathbf{1}_{n_{\mathrm{out}}}^{T}+\mathbf{1}_{n_{\mathrm{out}}}\delta^{T}+\delta\delta^{T})/n_{\mathrm{out}} n out Σ ( p ˉ ) − Π n out = diag δ − ( δ 1 n out T + 1 n out δ T + δ δ T ) / n out , whose operator norm is at most ε + 2 ε + ε 2 \varepsilon+2\varepsilon+\varepsilon^{2} ε + 2 ε + ε 2 . For the between-state term, p i − p ˉ = M μ T P 0 v ρ i − ρ ˉ p_{i}-\bar{p}=M_{\mu}^{T}P_{0}v_{\rho_{i}-\bar{\rho}} p i − p ˉ = M μ T P 0 v ρ i − ρ ˉ because ρ i − ρ ˉ \rho_{i}-\bar{\rho} ρ i − ρ ˉ is traceless, so that, with eq. (85) , n o u t n t r − 1 ∑ i ( p i − p ˉ ) ( p i − p ˉ ) T = [ d ( d + 1 ) ] − 1 n o u t M μ T P 0 F ρ c P 0 M μ n_{\mathrm{out}}n_{\mathrm{tr}}^{-1}\sum_{i}(p_{i}-\bar{p})(p_{i}-\bar{p})^{T}=[d(d+1)]^{-1}n_{\mathrm{out}}M_{\mu}^{T}P_{0}\mathcal{F}_{\rho}^{c}P_{0}M_{\mu} n out n tr − 1 ∑ i ( p i − p ˉ ) ( p i − p ˉ ) T = [ d ( d + 1 ) ] − 1 n out M μ T P 0 F ρ c P 0 M μ . Its norm is at most ∥ F ρ c ∥ o p ∥ n o u t P 0 F μ P 0 ∥ o p / [ d ( d + 1 ) ] ≤ K 2 / [ d ( d + 1 ) ] \|\mathcal{F}_{\rho}^{c}\|_{\mathrm{op}}\|n_{\mathrm{out}}P_{0}F_{\mu}P_{0}\|_{\mathrm{op}}/[d(d+1)]\leq K^{2}/[d(d+1)] ∥ F ρ c ∥ op ∥ n out P 0 F μ P 0 ∥ op / [ d ( d + 1 )] ≤ K 2 / [ d ( d + 1 )] .
Scope — Item 4 makes the averaged objective a ridge objective on 1 n o u t ⊥ \mathbf{1}_{n_{\mathrm{out}}}^{\perp} 1 n out ⊥ with τ N = 1 / ( N n o u t ) \tau_{N}=1/(Nn_{\mathrm{out}}) τ N = 1/ ( N n out ) , i.e., scaled ridge η = 1 \eta=1 η = 1 in the units of section D1c. The lemma concerns averages at fixed w w w . It describes the fitted weights of a single record only if the realized matrices in eq. (81) concentrate around their averages, which we do not prove; near n o u t = n t r n_{\mathrm{out}}=n_{\mathrm{tr}} n out = n tr they do not (section E3b).
Finite-shot regression and physical readout
The interpolation peaks of sections IV and § 3.2 occur near n o u t = n t r n_{\mathrm{out}} = n_{\mathrm{tr}} n out = n tr , where the measured feature matrix is square and small singular directions can require large fitted weights. They concern the actual multinomial records, both above and below informational completeness. Their analysis begins with a common calculation at fixed positive scaled ridge, valid above and below the outcome-count threshold n o u t = d 2 n_{\mathrm{out}} = d^2 n out = d 2 . Section D 1 specifies the empirical geometry and averages, section D 2 evaluates the centered costs, and section D 3 restores the empirical mean. That restoration is essential because the physical fit has no separately fitted intercept.
Geometry, targets, and asymptotic regime
The hypotheses below express which operator directions the training states explore, which directions the apparatus resolves, and how strongly shot noise perturbs each measured feature. Section D 1 a defines the physical estimator and its two costs; section D 1 b separates state variation from categorical noise; section D 1 c fixes the large-dimension regime used for the main-text peak laws.
Readout and target ensembles
We first specify the physical ridge readout of eq. (4) and the averages used to compare it with minimum norm. The conventions are those of Appendix A: d ( d + 1 ) d(d+1) d ( d + 1 ) normalizes Haar expectation-value fluctuations, while d 2 d^2 d 2 bounds the rank of the Born matrix. Haar test averaging separates reconstruction of the traceless target from the constant prediction, which must be tracked independently.
Physical ridge and minimum norm — For each training state ρ i \rho_i ρ i , independently sample n ^ i ∼ Mult ( N , p i ) \hat n_i \sim\operatorname{Mult}(N,p_i) n ^ i ∼ Mult ( N , p i ) and collect frequencies in P ^ N = [ n ^ i / N ] \hat P_N = [\hat n_i/N] P ^ N = [ n ^ i / N ] . The physical ridge readout is
w ^ N , τ = ( P ^ N P ^ N T n t r + τ I n o u t ) − 1 P ^ N y n t r , y i = Tr ( O ρ i ) , η = n o u t N τ . (83) \hat w_{N,\tau} = \left(\frac{\hat P_N\hat P_N^{T}}{n_{\mathrm{tr}}}+\tau I_{n_{\mathrm{out}}}\right)^{-1}\frac{\hat P_N y}{n_{\mathrm{tr}}}, \qquad y_i = \operatorname{Tr}(O\rho_i), \qquad\eta= n_{\mathrm{out}}N\tau. \tag*{(83)} w ^ N , τ = ( n tr P ^ N P ^ N T + τ I n out ) − 1 n tr P ^ N y , y i = Tr ( O ρ i ) , η = n out N τ . (83)
Here τ \tau τ is the coefficient of ∥ w ∥ 2 \lVert w\rVert^2 ∥ w ∥ 2 added to the averaged fitting loss n t r − 1 ∥ P ^ N T w − y ∥ 2 n_{\mathrm{tr}}^{-1}\lVert\hat P_N^{T}w-y\rVert^2 n tr − 1 ∥ P ^ N T w − y ∥ 2 ; the equivalent penalty for the unnormalized sum of squares is n t r τ n_{\mathrm{tr}}\tau n tr τ . For a measured singular value s s s , ridge replaces 1 / s 1/s 1/ s by s / ( s 2 + n t r τ ) s/(s^2+n_{\mathrm{tr}}\tau) s / ( s 2 + n tr τ ) , limiting the weight assigned to features with small singular values. At zero penalty, w ^ N , 0 = ( P ^ N + ) T y \hat w_{N,0}=(\hat P_N^{+})^{T}y w ^ N , 0 = ( P ^ N + ) T y is the readout w ^ N \hat w_N w ^ N of eq. (3) : among all least-squares minimizers, it has the smallest Euclidean weight norm.
Target law and conditional averages — The target is drawn from one of the ensembles of definition 1, whose isotropic moments eq. (38) are all that the target-averaged costs require. Unless stated otherwise, states and POVMs are held fixed, target averages condition on the measured record, and probability limits concern the counts and the independent target. For random training states or apparatuses, probability statements also include that randomness; an ensemble expectation is taken only when explicitly indicated.
Physical error decomposition — For the fixed fitted record, the ideal-test error of eq. (5) , averaged over Haar test states, is E N , τ ( O ) = E σ [ ( p T T w ^ N , τ − Tr ( O σ ) ) 2 ] \mathcal{E}_{N,\tau}(\mathcal{O})=\mathbb{E}_{\sigma}[(p_{\mathcal{T}}^{T}\hat w_{N,\tau}-\operatorname{Tr}(\mathcal{O}\sigma))^2] E N , τ ( O ) = E σ [( p T T w ^ N , τ − Tr ( O σ ) ) 2 ] . By lemma A1, this average separates traceless reconstruction from the error in the constant prediction:
d ( d + 1 ) E N , τ ( O ) = ∥ P 0 M μ w ^ N , τ − v O ∥ 2 + d ( d + 1 ) ( p I d / d T w ^ N , τ − c O ) 2 . (84) d(d+1)\mathcal{E}_{N,\tau}(\mathcal{O})=\lVert P_0M_\mu\hat w_{N,\tau}-v_{\mathcal{O}}\rVert^2+d(d+1)(p_{I_d/d}^{T}\hat w_{N,\tau}-c_{\mathcal{O}})^2. \tag*{(84)} d ( d + 1 ) E N , τ ( O ) = ∥ P 0 M μ w ^ N , τ − v O ∥ 2 + d ( d + 1 ) ( p I d / d T w ^ N , τ − c O ) 2 . (84)
The second term evaluates the mean prediction on I d / d I_d/d I d / d and can retain the empirical training mean even when normalized spectral traces do not. The variance numerator V N , τ ( O ) = w ^ N , τ T Σ ^ t w ^ N , τ V_{N,\tau}(\mathcal{O})=\hat w_{N,\tau}^{T}\widehat{\Sigma}_t\hat w_{N,\tau} V N , τ ( O ) = w ^ N , τ T Σ t w ^ N , τ contributes V N , τ ( O ) / M V_{N,\tau}(\mathcal{O})/M V N , τ ( O ) / M to the error of M M M independent test shots, with covariance eq. (34) . Neither cost here is averaged over targets or training records.
Training geometry and measurement-outcome noise
The peak depends on two sources of variability in the measured features: the variation of the exact probabilities across training states, which is the signal to be learned, and the shot fluctuations within each state. All fixed-ridge formulas of section D 2 and all peak coefficients of Appendix § 5.7 depend on the training states, the measurement, and the counts only through three matrices, which we define in this subsection: the centered training frame F ρ c F_\rho^{\mathrm{c}} F ρ c , which measures the first source in operator coordinates; the rescaled traceless measurement matrix M ~ μ \widetilde{M}_\mu M μ , which transfers it to outcome space in units of shot noise; and the training-averaged single-shot covariance Σ ‾ t r \overline{\Sigma}_{\mathrm{tr}} Σ tr , which measures the second source. Keeping these matrices distinct identifies which small eigenvalues are supplied by noise in section IV B and which already occur in the exact training matrix in § 3.2 .
Empirical means and shot covariance — Write ρ ˉ = n t r − 1 ∑ i ρ i \bar{\rho}=n_{\mathrm{tr}}^{-1}\sum_i\rho_i ρ ˉ = n tr − 1 ∑ i ρ i and p ˉ = M μ T v ρ ˉ \bar{p}=M_\mu^{T}v_{\bar{\rho}} p ˉ = M μ T v ρ ˉ for the empirical means. The single-shot covariance is Σ ( ρ i ) = diag p i − p i p i T \Sigma(\rho_i)=\operatorname{diag}p_i-p_ip_i^{T} Σ ( ρ i ) = diag p i − p i p i T , p i ≡ p ( ρ i ) p_i\equiv p(\rho_i) p i ≡ p ( ρ i ) , as in eq. (2) , and Σ ‾ t r = n t r − 1 ∑ i Σ ( ρ i ) \overline{\Sigma}_{\mathrm{tr}}=n_{\mathrm{tr}}^{-1}\sum_i\Sigma(\rho_i) Σ tr = n tr − 1 ∑ i Σ ( ρ i ) averages it over the actual training list, as in eq. (13) . A frequency vector has covariance Σ ( ρ i ) / N \Sigma(\rho_i)/N Σ ( ρ i ) / N . We define the projectors Π n o u t = I n o u t − 1 n o u t 1 n o u t T / n o u t \Pi_{n_{\mathrm{out}}}=I_{n_{\mathrm{out}}}-\mathbf{1}_{n_{\mathrm{out}}}\mathbf{1}_{n_{\mathrm{out}}}^{T}/n_{\mathrm{out}} Π n out = I n out − 1 n out 1 n out T / n out and Π n t r = I n t r − 1 n t r 1 n t r T / n t r \Pi_{n_{\mathrm{tr}}}=I_{n_{\mathrm{tr}}}-\mathbf{1}_{n_{\mathrm{tr}}}\mathbf{1}_{n_{\mathrm{tr}}}^{T}/n_{\mathrm{tr}} Π n tr = I n tr − 1 n tr 1 n tr T / n tr , which remove the constant outcome direction and the mean training coordinate, respectively. They play for outcome and training coordinates the role that the projector P 0 P_0 P 0 of eq. (31) plays for operator coordinates.
Explored operator directions — We define the normalized centered training frame as the sample covariance of the traceless coordinates of the training states, rescaled by the Haar variance 1 / [ d ( d + 1 ) ] 1/[d(d+1)] 1/ [ d ( d + 1 )] :
F ρ c = d ( d + 1 ) n t r P 0 M ρ Π n t r M ρ T P 0 , 1 d 2 − 1 Tr ( F ρ c ) = d ( d + 1 ) d 2 − 1 [ 1 n t r ∑ i Tr ( ρ i 2 ) − Tr ( ρ ˉ 2 ) ] . (85) F_\rho^{\mathrm{c}}=\frac{d(d+1)}{n_{\mathrm{tr}}}P_0M_\rho\Pi_{n_{\mathrm{tr}}}M_\rho^{T}P_0,\qquad\frac{1}{d^2-1}\operatorname{Tr}\left(F_\rho^{\mathrm{c}}\right)=\frac{d(d+1)}{d^2-1}\left[\frac{1}{n_{\mathrm{tr}}}\sum_i\operatorname{Tr}\left(\rho_i^2\right)-\operatorname{Tr}\left(\bar{\rho}^2\right)\right]. \tag*{(85)} F ρ c = n tr d ( d + 1 ) P 0 M ρ Π n tr M ρ T P 0 , d 2 − 1 1 Tr ( F ρ c ) = d 2 − 1 d ( d + 1 ) [ n tr 1 i ∑ Tr ( ρ i 2 ) − Tr ( ρ ˉ 2 ) ] . (85)
It is the analogue, for the training states, of the measurement frame operator F μ F_\mu F μ of § 3 A [27 , 33 ] , with the empirical mean removed. For a traceless observable A A A with Tr ( A 2 ) = 1 \operatorname{Tr}(A^2)=1 Tr ( A 2 ) = 1 , v A T F ρ c v A = ( d ( d + 1 ) / n t r ) ∑ i [ Tr ( A ( ρ i − ρ ˉ ) ) ] 2 v_A^TF_\rho^{\mathrm{c}}v_A=(d(d+1)/n_{\mathrm{tr}})\sum_i[\operatorname{Tr}(A(\rho_i-\bar{\rho}))]^2 v A T F ρ c v A = ( d ( d + 1 ) / n tr ) ∑ i [ Tr ( A ( ρ i − ρ ˉ )) ] 2 . The frame eigenvalues therefore measure the empirical variances of expectation values across the training list in units of the Haar value 1 / [ d ( d + 1 ) ] 1/[d(d+1)] 1/ [ d ( d + 1 )] , so that independent Haar training states give eigenvalues of order one (lemma B3); unexplored operator directions give zero eigenvalues. The raw frame differs by the empirical-mean contribution:
d ( d + 1 ) n t r P 0 F ρ P 0 = F ρ c + d ( d + 1 ) v ρ ˉ − I d / d v ρ ˉ − I d / d T . (86) \frac{d(d+1)}{n_{\mathrm{tr}}}P_0F_\rho P_0=F_\rho^{\mathrm{c}}+d(d+1)v_{\bar{\rho}-I_d/d}v_{\bar{\rho}-I_d/d}^{T}. \tag*{(86)} n tr d ( d + 1 ) P 0 F ρ P 0 = F ρ c + d ( d + 1 ) v ρ ˉ − I d / d v ρ ˉ − I d / d T . (86)
The rank-one difference leaves the limiting eigenvalue distribution unchanged but can affect the constant prediction in eq. (84) .
Signal in units of shot noise — We define the rescaled traceless measurement matrix
M ~ μ = n o u t N d ( d + 1 ) P 0 M μ , M ~ μ 1 n o u t = 0 , M ~ μ M ~ μ T = n o u t N d ( d + 1 ) P 0 F μ P 0 . (87) \widetilde{M}_\mu=\sqrt{\frac{n_{\mathrm{out}}N}{d(d+1)}}P_0M_\mu,\qquad\widetilde{M}_\mu\mathbf{1}_{n_{\mathrm{out}}}=0,\qquad\widetilde{M}_\mu\widetilde{M}_\mu^{T}=\frac{n_{\mathrm{out}}N}{d(d+1)}P_0F_\mu P_0. \tag*{(87)} M μ = d ( d + 1 ) n out N P 0 M μ , M μ 1 n out = 0 , M μ M μ T = d ( d + 1 ) n out N P 0 F μ P 0 . (87)
The squared singular values of M ~ μ \widetilde{M}_\mu M μ measure the apparatus response along traceless operator directions; the normalization is chosen so that they are signal-to-noise ratios. An operator direction with rescaled frame eigenvalue α \alpha α gives the squared singular value α α x \alpha\alpha_x α α x , with α x = N / [ d ( d + 1 ) ] \alpha_x=N/[d(d+1)] α x = N / [ d ( d + 1 )] , and lemma D1 below identifies α x \alpha_x α x as the ratio between the variation of that direction across Haar-random states and the noise of its N N N -shot estimate. Combining the two frames gives the exact signal covariance
S ≡ M ~ μ T F ρ c M ~ μ = n o u t N n t r ∑ i = 1 n t r ( p i − p ˉ ) ( p i − p ˉ ) T . (88) S\equiv\widetilde{M}_\mu^{T}F_\rho^{\mathrm{c}}\widetilde{M}_\mu=\frac{n_{\mathrm{out}}N}{n_{\mathrm{tr}}}\sum_{i=1}^{n_{\mathrm{tr}}}(p_i-\bar{p})(p_i-\bar{p})^{T}. \tag*{(88)} S ≡ M μ T F ρ c M μ = n tr n out N i = 1 ∑ n tr ( p i − p ˉ ) ( p i − p ˉ ) T . (88)
whereas the categorical covariances obey
Σ ‾ t r = diag p ˉ − 1 n t r M μ T F ρ M μ , n o u t N [ Σ ( p ˉ ) − Σ ‾ t r ] = M ~ μ F ρ c M ~ μ T . (89) \overline{\Sigma}_{\mathrm{tr}}=\operatorname{diag}\bar{p}-\frac{1}{n_{\mathrm{tr}}}M_\mu^{T}F_\rho M_\mu,\qquad n_{\mathrm{out}}N[\Sigma(\bar{p})-\overline{\Sigma}_{\mathrm{tr}}]=\widetilde{M}_\mu F_\rho^{\mathrm{c}}\widetilde{M}_\mu^{T}. \tag*{(89)} Σ tr = diag p ˉ − n tr 1 M μ T F ρ M μ , n out N [ Σ ( p ˉ ) − Σ tr ] = M μ F ρ c M μ T . (89)
where Σ ( p ˉ ) = diag p ˉ − p ˉ p ˉ T \Sigma(\bar{p})=\operatorname{diag}\bar{p}-\bar{p}\bar{p}^{T} Σ ( p ˉ ) = diag p ˉ − p ˉ p ˉ T . Thus eq. (89) identifies S S S as n o u t N n_{\mathrm{out}}N n out N times the covariance of exact training probabilities, distinct from within-state noise n o u t Σ ‾ t r n_{\mathrm{out}}\overline{\Sigma}_{\mathrm{tr}} n out Σ tr . These matrices enter all subsequent formulas: the deterministic equivalent eq. (107) contains S S S and n o u t Σ ‾ t r n_{\mathrm{out}}\overline{\Sigma}_{\mathrm{tr}} n out Σ tr , the costs eqs. (104) and (D23) are weighted traces involving M ~ μ \widetilde{M}_\mu M μ , and the peak coefficients eq. (154) involve all three.
Signal-to-noise ratio of an operator direction — The following lemma justifies the normalization of M ~ μ \widetilde{M}_\mu M μ and supplies the interpretation of the shot ratio α \alpha α used in § 3 D and IV B.
Lemma D1 (Signal-to-noise ratio of a frame direction). Let A A A be a traceless Hermitian operator with Tr ( A 2 ) = 1 \operatorname{Tr}(A^2)=1 Tr ( A 2 ) = 1 and F μ ( A ) = λ A \mathcal{F}_{\mu}(A)=\lambda A F μ ( A ) = λ A for some λ > 0 \lambda>0 λ > 0 , put x = n o u t λ x=n_{\mathrm{out}}\lambda x = n out λ , and let w A = M μ T v A / λ w_A=M_{\mu}^{T}v_A/\sqrt{\lambda} w A = M μ T v A / λ , a unit vector of outcome weights. Then w A T p ( ρ ) = λ Tr ( A ρ ) w_A^{T}p(\rho)=\sqrt{\lambda}\operatorname{Tr}(A\rho) w A T p ( ρ ) = λ Tr ( A ρ ) for every state ρ \rho ρ . For a Haar-random pure state ρ \rho ρ ,
Var ρ [ w A T p ( ρ ) ] = λ d ( d + 1 ) , w A T Σ t e w A = w A T D I / d w A − λ d ( d + 1 ) . (90) \operatorname{Var}_{\rho}[w_A^{T}p(\rho)]=\frac{\lambda}{d(d+1)},\qquad w_A^{T}\Sigma_{\mathrm{te}}w_A=w_A^{T}D_{I/d}w_A-\frac{\lambda}{d(d+1)}. \tag*{(90)} Var ρ [ w A T p ( ρ )] = d ( d + 1 ) λ , w A T Σ te w A = w A T D I / d w A − d ( d + 1 ) λ . (90) If max a ∣ n o u t ω a / d − 1 ∣ ≤ ε \max_a|n_{\mathrm{out}}\omega_a/d-1|\le\varepsilon max a ∣ n out ω a / d − 1∣ ≤ ε , the ratio R A R_A R A of the across-state variance to the Haar-averaged variance of an N N N -shot estimate satisfies
R A ≡ N Var ρ [ w A T p ( ρ ) ] w A T Σ t e w A = α x 1 + δ − x / [ d ( d + 1 ) ] , ∣ δ ∣ ≤ ε , (91) R_A\equiv\frac{N\operatorname{Var}_{\rho}[w_A^{T}p(\rho)]}{w_A^{T}\Sigma_{\mathrm{te}}w_A}=\frac{\alpha x}{1+\delta-x/[d(d+1)]},\qquad|\delta|\le\varepsilon, \tag*{(91)} R A ≡ w A T Σ te w A N Var ρ [ w A T p ( ρ )] = 1 + δ − x / [ d ( d + 1 )] α x , ∣ δ ∣ ≤ ε , (91) with α = N / [ d ( d + 1 ) ] \alpha=N/[d(d+1)] α = N / [ d ( d + 1 )] . Moreover, α x \alpha x α x is the squared singular value of M ~ μ \widetilde{M}_{\mu} M μ along v A v_A v A .
Proof. The vector w A w_A w A has unit norm because ∥ M μ T v A ∥ 2 = v A T F μ v A = λ \lVert M_{\mu}^{T}v_A\rVert^2=v_A^{T}\mathcal{F}_{\mu}v_A=\lambda ∥ M μ T v A ∥ 2 = v A T F μ v A = λ . Since M μ w A = F μ v A / λ = λ v A M_{\mu}w_A=\mathcal{F}_{\mu}v_A/\sqrt{\lambda}=\sqrt{\lambda}v_A M μ w A = F μ v A / λ = λ v A , the weights reconstruct λ A \sqrt{\lambda}A λ A , so w A T p ( ρ ) = λ Tr ( A ρ ) w_A^{T}p(\rho)=\sqrt{\lambda}\operatorname{Tr}(A\rho) w A T p ( ρ ) = λ Tr ( A ρ ) . As A A A is traceless, lemma A1 gives E ρ [ Tr ( A ρ ) ] = 0 \mathbb{E}_{\rho}[\operatorname{Tr}(A\rho)]=0 E ρ [ Tr ( A ρ )] = 0 and E ρ [ Tr ( A ρ ) 2 ] = 1 / [ d ( d + 1 ) ] \mathbb{E}_{\rho}[\operatorname{Tr}(A\rho)^2]=1/[d(d+1)] E ρ [ Tr ( A ρ ) 2 ] = 1/ [ d ( d + 1 )] , hence the first identity. For the second, insert eq. (34) : ω T w A = v A T M μ w A = λ Tr ( A ) = 0 \omega^{T}w_A=v_A^{T}M_{\mu}w_A=\sqrt{\lambda}\operatorname{Tr}(A)=0 ω T w A = v A T M μ w A = λ Tr ( A ) = 0 and w A T G μ w A = ∥ M μ w A ∥ 2 = λ w_A^{T}\mathcal{G}_{\mu}w_A=\lVert M_{\mu}w_A\rVert^2=\lambda w A T G μ w A = ∥ M μ w A ∥ 2 = λ . The trace condition gives w A T D I / d w A = ( 1 + δ ) / n o u t w_A^{T}D_{I/d}w_A=(1+\delta)/n_{\mathrm{out}} w A T D I / d w A = ( 1 + δ ) / n out with ∣ δ ∣ ≤ ε |\delta|\le\varepsilon ∣ δ ∣ ≤ ε , and dividing N λ / [ d ( d + 1 ) ] N\lambda/[d(d+1)] N λ / [ d ( d + 1 )] by ( 1 + δ ) / n o u t − λ / [ d ( d + 1 ) ] (1+\delta)/n_{\mathrm{out}}-\lambda/[d(d+1)] ( 1 + δ ) / n out − λ / [ d ( d + 1 )] gives eq. (91) . Finally, M ~ μ M ~ μ T v A = [ n o u t N / ( d ( d + 1 ) ) ] P 0 F μ v A = α x v A \widetilde{M}_{\mu}\widetilde{M}_{\mu}^{T}v_A=[n_{\mathrm{out}}N/(d(d+1))]P_0\mathcal{F}_{\mu}v_A=\alpha x v_A M μ M μ T v A = [ n out N / ( d ( d + 1 ))] P 0 F μ v A = α x v A by eq. (87) . □
Proportional limit and empirical bounds
The main-text interpolation laws keep the numbers of operator directions, outcomes, training states, and shots comparable as dimension grows. The ratios below locate the measurement and interpolation thresholds separately; the empirical bounds exclude collapse of the training signal and anomalously large or vanishing noise. All fixed-ridge comparisons take the dimensional limit at positive scaled penalty before any zero-penalty limit.
Dimension and shot ratios — Take
κ d = d 2 − 1 n o u t − 1 ⟶ κ ∈ ( 0 , ∞ ) , γ d = n o u t − 1 n t r ⟶ γ ∈ ( 0 , ∞ ) , α d = N d ( d + 1 ) ⟶ α ∈ ( 0 , ∞ ) . (92) \kappa_d=\frac{d^2-1}{n_{\mathrm{out}}-1}\longrightarrow\kappa\in(0,\infty),\qquad\gamma_d=\frac{n_{\mathrm{out}}-1}{n_{\mathrm{tr}}}\longrightarrow\gamma\in(0,\infty),\qquad\alpha_d=\frac{N}{d(d+1)}\longrightarrow\alpha\in(0,\infty). \tag*{(92)} κ d = n out − 1 d 2 − 1 ⟶ κ ∈ ( 0 , ∞ ) , γ d = n tr n out − 1 ⟶ γ ∈ ( 0 , ∞ ) , α d = d ( d + 1 ) N ⟶ α ∈ ( 0 , ∞ ) . (92)
The ratio κ \kappa κ places the outcome count above (κ < 1 \kappa<1 κ < 1 ) or below (κ > 1 \kappa>1 κ > 1 ) the informational-completeness threshold; outcome count alone does not assert full operator rank. The separate peak asymptotics below take κ ≠ 1 \kappa\ne1 κ = 1 ; the fixed-positive-ridge comparison itself applies at every fixed κ > 0 \kappa>0 κ > 0 . The ratio γ \gamma γ locates interpolation, and α \alpha α compares shot precision with Haar expectation-value fluctuations (lemma D1). The physical ratio n o u t / n t r n_{\mathrm{out}}/n_{\mathrm{tr}} n out / n tr has the same limit as γ d \gamma_d γ d . At finite dimension the centered matrix has n o u t − 1 n_{\mathrm{out}}-1 n out − 1 outcome and n t r − 1 n_{\mathrm{tr}}-1 n tr − 1 training coordinates, so it is exactly square at n o u t = n t r n_{\mathrm{out}}=n_{\mathrm{tr}} n out = n tr .
Bounds on geometry and noise — Assume uniform empirical bounds
0 ⪯ F ρ c ⪯ K P 0 , n o u t P 0 F μ P 0 ⪯ K P 0 , (93) 0\preceq\mathcal{F}_{\rho}^{c}\preceq KP_0,\qquad n_{\mathrm{out}}P_0\mathcal{F}_{\mu}P_0\preceq KP_0, \tag*{(93)} 0 ⪯ F ρ c ⪯ K P 0 , n out P 0 F μ P 0 ⪯ K P 0 , (93)
c Π n o u t ⪯ n o u t Σ ‾ t r ⪯ K Π n o u t , c Π n o u t ⪯ n o u t Σ ‾ t e ⪯ K Π n o u t , (94) c\Pi_{n_{\mathrm{out}}}\preceq n_{\mathrm{out}}\overline{\Sigma}_{\mathrm{tr}}\preceq K\Pi_{n_{\mathrm{out}}},\qquad c\Pi_{n_{\mathrm{out}}}\preceq n_{\mathrm{out}}\overline{\Sigma}_{\mathrm{te}}\preceq K\Pi_{n_{\mathrm{out}}}, \tag*{(94)} c Π n out ⪯ n out Σ tr ⪯ K Π n out , c Π n out ⪯ n out Σ te ⪯ K Π n out , (94)
with dimension-independent c > 0 c>0 c > 0 and K < ∞ K<\infty K < ∞ . The frame bounds exclude unbounded geometric eigenvalues, while the covariance bounds ensure controlled, nonzero shot noise in every nonconstant outcome direction. A nonzero variance amplitude additionally requires
lim inf 1 d 2 − 1 Tr ( F ρ c ) > 0. (95) \liminf\frac{1}{d^2-1}\operatorname{Tr}(\mathcal{F}_{\rho}^{c})>0. \tag*{(95)} lim inf d 2 − 1 1 Tr ( F ρ c ) > 0. (95)
For random states or apparatuses, these empirical conditions are imposed on events of probability tending to one.
Centered auxiliary fit and fixed-ridge costs
Centering makes the state-dependent fit accessible to spectral analysis, but changes how the training mean is fitted. Section D2a derives that change exactly, and section D2b gives the centered variance and traceless reconstruction cost at fixed positive ridge. Their physical interpretation requires the mean restoration in section D3; neither the centered calculation nor its Gaussian comparison alone controls the physical minimum-norm inverse.
Probability normalization allows a uniform outcome weight to predict a constant. Eliminating that weight reveals a centered auxiliary regression plus a single mean-fitting correction. The correction disappears from normalized traces with bounded weights at fixed positive ridge, but can survive in the constant prediction and is therefore retained exactly below.
Eliminating the uniform weight — The physical readout minimizes L N , τ ( w ) = n t r − 1 ∥ P ^ N T w − y ∥ 2 + τ ∥ w ∥ 2 \mathcal{L}_{N,\tau}(\mathbf{w}) = n_{\mathrm{tr}}^{-1}\lVert\hat{P}_{N}^{\mathsf{T}}\mathbf{w}-\mathbf{y}\rVert^{2}+\tau\lVert\mathbf{w}\rVert^{2} L N , τ ( w ) = n tr − 1 ∥ P ^ N T w − y ∥ 2 + τ ∥ w ∥ 2 . Since P ^ N T 1 n o u t = 1 n t r \hat{P}_{N}^{\mathsf{T}}\mathbf{1}_{n_{\mathrm{out}}}=\mathbf{1}_{n_{\mathrm{tr}}} P ^ N T 1 n out = 1 n tr , a uniform outcome weight predicts a constant. Write w = w 0 1 n o u t + w ⊥ \mathbf{w}=w_{0}\mathbf{1}_{n_{\mathrm{out}}}+\mathbf{w}_{\perp} w = w 0 1 n out + w ⊥ , with 1 n o u t T w ⊥ = 0 \mathbf{1}_{n_{\mathrm{out}}}^{\mathsf{T}}\mathbf{w}_{\perp}=0 1 n out T w ⊥ = 0 , and set y ˉ = n t r − 1 1 n t r T y \bar{y}=n_{\mathrm{tr}}^{-1}\mathbf{1}_{n_{\mathrm{tr}}}^{\mathsf{T}}\mathbf{y} y ˉ = n tr − 1 1 n tr T y and p ^ = n t r − 1 P ^ N 1 n t r \hat{\mathbf{p}}=n_{\mathrm{tr}}^{-1}\hat{P}_{N}\mathbf{1}_{n_{\mathrm{tr}}} p ^ = n tr − 1 P ^ N 1 n tr . Orthogonal mean and fluctuation coordinates give
L N , τ ( w 0 1 n o u t + w ⊥ ) = 1 n t r ∥ Π n t r ( P ^ N T w ⊥ − y ) ∥ 2 + τ ∥ w ⊥ ∥ 2 + ( w 0 + p ^ T w ⊥ − y ˉ ) 2 + n o u t τ w 0 2 . (96) \mathcal{L}_{N,\tau}(w_{0}\mathbf{1}_{n_{\mathrm{out}}}+\mathbf{w}_{\perp})=\frac{1}{n_{\mathrm{tr}}}\left\lVert\Pi_{n_{\mathrm{tr}}}\left(\hat{P}_{N}^{\mathsf{T}}\mathbf{w}_{\perp}-\mathbf{y}\right)\right\rVert^{2}+\tau\lVert\mathbf{w}_{\perp}\rVert^{2}+\left(w_{0}+\hat{\mathbf{p}}^{\mathsf{T}}\mathbf{w}_{\perp}-\bar{y}\right)^{2}+n_{\mathrm{out}}\tau w_{0}^{2}. \tag*{(96)} L N , τ ( w 0 1 n out + w ⊥ ) = n tr 1 Π n tr ( P ^ N T w ⊥ − y ) 2 + τ ∥ w ⊥ ∥ 2 + ( w 0 + p ^ T w ⊥ − y ˉ ) 2 + n out τ w 0 2 . (96)
Minimizing over w 0 w_{0} w 0 leaves
min w 0 L N , τ = 1 n t r ∥ Π n t r ( P ^ N T w ⊥ − y ) ∥ 2 + τ ∥ w ⊥ ∥ 2 + n o u t τ 1 + n o u t τ ( p ^ T w ⊥ − y ˉ ) 2 . (97) \min_{w_{0}}\mathcal{L}_{N,\tau}=\frac{1}{n_{\mathrm{tr}}}\left\lVert\Pi_{n_{\mathrm{tr}}}\left(\hat{P}_{N}^{\mathsf{T}}\mathbf{w}_{\perp}-\mathbf{y}\right)\right\rVert^{2}+\tau\lVert\mathbf{w}_{\perp}\rVert^{2}+\frac{n_{\mathrm{out}}\tau}{1+n_{\mathrm{out}}\tau}\left(\hat{\mathbf{p}}^{\mathsf{T}}\mathbf{w}_{\perp}-\bar{y}\right)^{2}. \tag*{(97)} w 0 min L N , τ = n tr 1 Π n tr ( P ^ N T w ⊥ − y ) 2 + τ ∥ w ⊥ ∥ 2 + 1 + n out τ n out τ ( p ^ T w ⊥ − y ˉ ) 2 . (97)
The centered labels ( Π n t r y ) i = Tr ( O 0 ( ρ i − ρ ˉ ) ) (\Pi_{n_{\mathrm{tr}}}\mathbf{y})_{i}=\operatorname{Tr}(O_{0}(\rho_{i}-\bar{\rho})) ( Π n tr y ) i = Tr ( O 0 ( ρ i − ρ ˉ )) depend only on the traceless target. Dropping the final mean-fitting penalty defines the auxiliary centered fit
w ^ N , τ c ( O 0 ) ≡ arg min w ∈ 1 n o u t ⊥ { 1 n t r ∥ Π n t r ( P ^ N T w − y ) ∥ 2 + τ ∥ w ∥ 2 } . (98) \hat{\mathbf{w}}_{N,\tau}^{c}(O_{0})\equiv\underset{\mathbf{w}\in\mathbf{1}_{n_{\mathrm{out}}}^{\perp}}{\arg\min}\left\{\frac{1}{n_{\mathrm{tr}}}\left\lVert\Pi_{n_{\mathrm{tr}}}\left(\hat{P}_{N}^{\mathsf{T}}\mathbf{w}-\mathbf{y}\right)\right\rVert^{2}+\tau\lVert\mathbf{w}\rVert^{2}\right\}. \tag*{(98)} w ^ N , τ c ( O 0 ) ≡ w ∈ 1 n out ⊥ arg min { n tr 1 Π n tr ( P ^ N T w − y ) 2 + τ ∥ w ∥ 2 } . (98)
At τ = 0 \tau=0 τ = 0 choose the minimum-Euclidean-norm solution in 1 n o u t ⊥ \mathbf{1}_{n_{\mathrm{out}}}^{\perp} 1 n out ⊥ ; at τ > 0 \tau>0 τ > 0 its normal equation is
( P ^ N Π n t r P ^ N T / n t r + τ Π n o u t ) w ^ N , τ c = 1 n t r P ^ N Π n t r y . (99) \left(\hat{P}_{N}\Pi_{n_{\mathrm{tr}}}\hat{P}_{N}^{\mathsf{T}}/n_{\mathrm{tr}}+\tau\Pi_{n_{\mathrm{out}}}\right)\hat{\mathbf{w}}_{N,\tau}^{c}=\frac{1}{n_{\mathrm{tr}}}\hat{P}_{N}\Pi_{n_{\mathrm{tr}}}\mathbf{y}. \tag*{(99)} ( P ^ N Π n tr P ^ N T / n tr + τ Π n out ) w ^ N , τ c = n tr 1 P ^ N Π n tr y . (99)
The physical nonconstant coefficients instead satisfy
( P ^ N Π n t r P ^ N T / n t r + τ Π n o u t + β η q q T ) w ⊥ = 1 n t r P ^ N Π n t r y + β η y ˉ q , (100) \left(\hat{P}_{N}\Pi_{n_{\mathrm{tr}}}\hat{P}_{N}^{\mathsf{T}}/n_{\mathrm{tr}}+\tau\Pi_{n_{\mathrm{out}}}+\beta_{\eta}\mathbf{q}\mathbf{q}^{\mathsf{T}}\right)\mathbf{w}_{\perp}=\frac{1}{n_{\mathrm{tr}}}\hat{P}_{N}\Pi_{n_{\mathrm{tr}}}\mathbf{y}+\beta_{\eta}\bar{y}\mathbf{q}, \tag*{(100)} ( P ^ N Π n tr P ^ N T / n tr + τ Π n out + β η q q T ) w ⊥ = n tr 1 P ^ N Π n tr y + β η y ˉ q , (100)
where q = Π n o u t p ^ \mathbf{q}=\Pi_{n_{\mathrm{out}}}\hat{\mathbf{p}} q = Π n out p ^ and β η = η / ( N + η ) = n o u t τ / ( 1 + n o u t τ ) \beta_{\eta}=\eta/(N+\eta)=n_{\mathrm{out}}\tau/(1+n_{\mathrm{out}}\tau) β η = η / ( N + η ) = n out τ / ( 1 + n out τ ) . The extra matrix and source fit the empirical mean. At fixed positive η \eta η , the resulting rank-one map correction vanishes from normalized traces with bounded weights. Its constant prediction in eq. (84) must still be restored exactly.
Comparable signal and noise scales — Introduce the rescaled matrices
M ρ c = d ( d + 1 ) P 0 M ρ Π n t r , P ^ N c = n o u t N / n t r P ^ N Π n t r , 1 n t r M ρ c ( M ρ c ) T = F ρ c . (101) M_{\rho}^{c}=\sqrt{d(d+1)}P_{0}M_{\rho}\Pi_{n_{\mathrm{tr}}},\qquad\hat{P}_{N}^{c}=\sqrt{n_{\mathrm{out}}N/n_{\mathrm{tr}}}\hat{P}_{N}\Pi_{n_{\mathrm{tr}}},\qquad\frac{1}{n_{\mathrm{tr}}}M_{\rho}^{c}(M_{\rho}^{c})^{\mathsf{T}}=F_{\rho}^{c}. \tag*{(101)} M ρ c = d ( d + 1 ) P 0 M ρ Π n tr , P ^ N c = n out N / n tr P ^ N Π n tr , n tr 1 M ρ c ( M ρ c ) T = F ρ c . (101)
For η > 0 \eta>0 η > 0 , define on 1 n o u t ⊥ \mathbf{1}_{n_{\mathrm{out}}}^{\perp} 1 n out ⊥
Q ^ = [ P ^ N c ( P ^ N c ) T + η Π n o u t ] − 1 , K ^ = Q ^ P ^ N c ( M ρ c ) T / n t r . (102) \hat{Q}=\left[\hat{P}_{N}^{c}(\hat{P}_{N}^{c})^{\mathsf{T}}+\eta\Pi_{n_{\mathrm{out}}}\right]^{-1},\qquad\hat{K}=\hat{Q}\hat{P}_{N}^{c}(M_{\rho}^{c})^{\mathsf{T}}/\sqrt{n_{\mathrm{tr}}}. \tag*{(102)} Q ^ = [ P ^ N c ( P ^ N c ) T + η Π n out ] − 1 , K ^ = Q ^ P ^ N c ( M ρ c ) T / n tr . (102)
The normal equation eq. (99) gives
w ^ N , τ c ( O 0 ) = ( P ^ N Π n t r P ^ N T / n t r + τ Π n o u t ) − 1 P ^ N Π n t r y / n t r = n o u t N d ( d + 1 ) K ^ v O 0 . (103) \hat{\mathbf{w}}_{N,\tau}^{c}(O_{0})=\left(\hat{P}_{N}\Pi_{n_{\mathrm{tr}}}\hat{P}_{N}^{\mathsf{T}}/n_{\mathrm{tr}}+\tau\Pi_{n_{\mathrm{out}}}\right)^{-1}\hat{P}_{N}\Pi_{n_{\mathrm{tr}}}\mathbf{y}/n_{\mathrm{tr}}=\sqrt{\frac{n_{\mathrm{out}}N}{d(d+1)}}\,\hat{K}\mathbf{v}_{O_{0}}. \tag*{(103)} w ^ N , τ c ( O 0 ) = ( P ^ N Π n tr P ^ N T / n tr + τ Π n out ) − 1 P ^ N Π n tr y / n tr = d ( d + 1 ) n out N K ^ v O 0 . (103)
The factors d ( d + 1 ) \sqrt{d(d+1)} d ( d + 1 ) and n o u t N / n t r \sqrt{n_{\mathrm{out}}N/n_{\mathrm{tr}}} n out N / n tr place state fluctuations and frequency noise on comparable scales. The map K ^ \hat{K} K ^ depends on the training record; a new target enters only through v O 0 \mathbf{v}_{O_{0}} v O 0 .
Centered costs and their fixed-ridge equivalent
The centered fit has two distinct costs: amplification of independent test-shot noise and failure to reconstruct the traceless target. Proposition D1 evaluates both at fixed positive scaled ridge for every fixed κ > 0 \kappa> 0 κ > 0 . The proof replaces count fluctuations only inside normalized regularized traces, so the result does not yet justify substituting a pseudoinverse at zero penalty.
Centered costs — Define V N , τ c ( O ) = ( w ^ N , τ c ) T Σ ‾ t e w ^ N , τ c V^{\mathrm{c}}_{N,\tau}(\mathcal{O}) = \left(\hat{w}^{\mathrm{c}}_{N,\tau}\right)^{\mathsf{T}}\overline{\Sigma}_{\mathrm{te}}\hat{w}^{\mathrm{c}}_{N,\tau} V N , τ c ( O ) = ( w ^ N , τ c ) T Σ te w ^ N , τ c and the traceless reconstruction cost d ( d + 1 ) E N , τ c ( O ) = ∥ P 0 M μ w ^ N , τ c − v O 0 ∥ 2 d(d+1)\mathcal{E}^{\mathrm{c}}_{N,\tau}(\mathcal{O}) = \left\|P_0M_\mu\hat{w}^{\mathrm{c}}_{N,\tau}-v_{\mathcal{O}0}\right\|^2 d ( d + 1 ) E N , τ c ( O ) = P 0 M μ w ^ N , τ c − v O 0 2 . Their conditional target averages V N , τ c V^{\mathrm{c}}_{N,\tau} V N , τ c and E N , τ c \mathcal{E}^{\mathrm{c}}_{N,\tau} E N , τ c give
F ^ η , d ≡ V N , τ c d Δ 0 2 = α d d 2 − 1 Tr ( K ^ T n ^ o u t Σ ‾ t e K ^ ) , (104) \widehat{F}_{\eta,d} \equiv\frac{V^{\mathrm{c}}_{N,\tau}}{d\Delta_0^2} = \frac{\alpha_d}{d^2-1}\operatorname{Tr}\left(\hat{K}^{\mathsf{T}}\hat{n}_{\mathrm{out}}\overline{\Sigma}_{\mathrm{te}}\hat{K}\right), \tag*{(104)} F η , d ≡ d Δ 0 2 V N , τ c = d 2 − 1 α d Tr ( K ^ T n ^ out Σ te K ^ ) , (104)
G ^ η , d ≡ d ( d + 1 ) E N , τ c d Δ 0 2 = 1 d 2 − 1 ∥ M ~ μ K ^ − P 0 ∥ F 2 . (105) \widehat{G}_{\eta,d} \equiv\frac{d(d+1)\mathcal{E}^{\mathrm{c}}_{N,\tau}}{d\Delta_0^2} = \frac{1}{d^2-1}\left\|\widetilde{M}_\mu\hat{K}-P_0\right\|_{\mathrm{F}}^2. \tag*{(105)} G η , d ≡ d Δ 0 2 d ( d + 1 ) E N , τ c = d 2 − 1 1 M μ K ^ − P 0 F 2 . (105)
The first cost measures amplification of test-shot noise; the second measures traceless reconstruction. At strong ridge the centered prediction vanishes, giving F → 0 F \to0 F → 0 and G → 1 G \to1 G → 1 .
Count comparison at fixed ridge — For every fixed κ > 0 \kappa> 0 κ > 0 , the centered measured matrix eq. (101) has conditional mean E [ P ^ N c ∣ ρ , μ ] = 1 n t r M ~ μ T M ρ c \mathbb{E}\left[\hat{P}^{\mathrm{c}}_N\mid\rho,\mu\right] = \frac{1}{\sqrt{n_{\mathrm{tr}}}}\widetilde{M}_\mu^{\mathsf{T}}M_\rho^{\mathrm{c}} E [ P ^ N c ∣ ρ , μ ] = n tr 1 M μ T M ρ c . The fluctuations are categorical and independent before centering, with average outcome covariance n o u t Σ ‾ t r / n t r n_{\mathrm{out}}\overline{\Sigma}_{\mathrm{tr}}/n_{\mathrm{tr}} n out Σ tr / n tr . At fixed η > 0 \eta> 0 η > 0 , lemma D3 permits a Gaussian replacement inside the normalized traces of regularized inverse covariance matrices, called resolvents:
P ^ N , G c ≡ 1 n t r [ M ~ μ T M ρ c + ( n o u t Σ ‾ t r ) 1 / 2 G ] , G a i ∼ i i d N ( 0 , 1 ) . (106) \hat{P}^{\mathrm{c}}_{N,G} \equiv\frac{1}{\sqrt{n_{\mathrm{tr}}}}\left[\widetilde{M}_\mu^{\mathsf{T}}M_\rho^{\mathrm{c}} + \left(n_{\mathrm{out}}\overline{\Sigma}_{\mathrm{tr}}\right)^{1/2}G\right], \qquad G_{ai}\mathrel{\stackrel{\mathrm{iid}}{\sim}}\mathcal{N}(0,1). \tag*{(106)} P ^ N , G c ≡ n tr 1 [ M μ T M ρ c + ( n out Σ tr ) 1/2 G ] , G ai ∼ iid N ( 0 , 1 ) . (106)
The replacement preserves these averaged inverse-covariance quantities at fixed positive penalty; it does not control the smallest measured singular values or the zero-penalty pseudoinverse. The matrix R \mathcal{R} R below is a deterministic equivalent: with the geometry fixed, its normalized weighted traces approximate those of the random inverse, rather than every matrix entry. In its inverse, a − 1 a^{-1} a − 1 scales the signal covariance S S S , and b b b scales the shot covariance n o u t Σ ‾ t r n_{\mathrm{out}}\overline{\Sigma}_{\mathrm{tr}} n out Σ tr . The scalar b b b describes the mean eigenvalue of the training residual filter. All outcome matrices here are restricted to 1 n o u t 1 n o u t − 1 \frac{1}{n_{\mathrm{out}}}\mathbb{1}_{n_{\mathrm{out}}-1} n out 1 1 n out − 1 ; 1 n o u t − 1 \mathbb{1}_{n_{\mathrm{out}}-1} 1 n out − 1 is the identity in orthonormal coordinates on that subspace. For z z z near zero and a bounded positive weight matrix W W W , select the positive solution of
R = [ η 1 n o u t − 1 + z W + b n o u t Σ ‾ t r + a − 1 S ] − 1 , a = 1 + 1 n t r Tr ( n o u t Σ ‾ t r R ) , (107) \mathcal{R} = \left[\eta\mathbb{1}_{n_{\mathrm{out}}-1}+zW+b\,n_{\mathrm{out}}\overline{\Sigma}_{\mathrm{tr}}+a^{-1}S\right]^{-1}, \qquad a=1+\frac{1}{n_{\mathrm{tr}}}\operatorname{Tr}\left(n_{\mathrm{out}}\overline{\Sigma}_{\mathrm{tr}}\mathcal{R}\right), \tag*{(107)} R = [ η 1 n out − 1 + z W + b n out Σ tr + a − 1 S ] − 1 , a = 1 + n tr 1 Tr ( n out Σ tr R ) , (107)
b = 1 a − 1 n t r a 2 Tr ( S R ) . (108) b=\frac{1}{a}-\frac{1}{n_{\mathrm{tr}}a^2}\operatorname{Tr}(S\mathcal{R}). \tag*{(108)} b = a 1 − n tr a 2 1 Tr ( S R ) . (108)
Define
L d ( η , z ; W ) ≡ 1 a ( d 2 − 1 ) Tr ( F ρ c − a − 1 F ρ c M ~ μ R M ~ μ T F ρ c ) . (109) \mathcal{L}_d(\eta,z;W)\equiv\frac{1}{a(d^2-1)}\operatorname{Tr}\left(\mathcal{F}^{\mathrm{c}}_\rho-a^{-1}\mathcal{F}^{\mathrm{c}}_\rho\widetilde{M}_\mu\mathcal{R}\widetilde{M}_\mu^{\mathsf{T}}\mathcal{F}^{\mathrm{c}}_\rho\right). \tag*{(109)} L d ( η , z ; W ) ≡ a ( d 2 − 1 ) 1 Tr ( F ρ c − a − 1 F ρ c M μ R M μ T F ρ c ) . (109)
Extracting quadratic costs — Fix η > 0 \eta> 0 η > 0 and a bounded positive semidefinite outcome metric W W W . The derivative of a minimized loss with respect to a quadratic penalty measures the fitted coefficient norm weighted by that penalty. Temporarily varying the matrix penalty by z W zW z W therefore extracts test variance or the quadratic term of the traceless reconstruction cost, according to the choice of W W W . Set
Q ^ z = [ P ^ N c ( P ^ N c ) T + η 1 n o u t − 1 + z W ] − 1 , \widehat{Q}_z=\left[\hat{P}^{\mathrm{c}}_N\left(\hat{P}^{\mathrm{c}}_N\right)^{\mathsf{T}}+\eta\mathbb{1}_{n_{\mathrm{out}}-1}+zW\right]^{-1}, Q z = [ P ^ N c ( P ^ N c ) T + η 1 n out − 1 + z W ] − 1 ,
K ^ z = Q ^ z P ^ N c ( M ρ c ) T / n t r , \widehat{K}_z=\widehat{Q}_z\hat{P}^{\mathrm{c}}_N\left(M_\rho^{\mathrm{c}}\right)^{\mathsf{T}}/\sqrt{n_{\mathrm{tr}}}, K z = Q z P ^ N c ( M ρ c ) T / n tr ,
L ^ ( η , z ; W ) = 1 n t r ( d 2 − 1 ) Tr ( M ρ c ( 1 n o u t − ( P ^ N c ) T Q ^ z P ^ N c ) ( M ρ c ) T ) . (110) \widehat{\mathcal{L}}(\eta,z;W)=\frac{1}{n_{\mathrm{tr}}(d^2-1)}\operatorname{Tr}\left(M_\rho^{\mathrm{c}}\left(\mathbb{1}_{n_{\mathrm{out}}}-\left(\hat{P}^{\mathrm{c}}_N\right)^{\mathsf{T}}\widehat{Q}_z\hat{P}^{\mathrm{c}}_N\right)\left(M_\rho^{\mathrm{c}}\right)^{\mathsf{T}}\right). \tag*{(110)} L ( η , z ; W ) = n tr ( d 2 − 1 ) 1 Tr ( M ρ c ( 1 n out − ( P ^ N c ) T Q z P ^ N c ) ( M ρ c ) T ) . (110)
All outcome-space inverses here and below act on 1 n o u t 1 \frac{1}{n_{\mathrm{out}}}\mathbb{1} n out 1 1 . The quantity L ^ \widehat{\mathcal{L}} L is the minimum of the centered fitting loss including the temporary penalty z W zW z W , averaged over unit traceless directions. At the minimizing weights, derivatives through the optimizer cancel by stationarity; differentiating the minimum therefore returns the explicit penalty term (the envelope identity). Using ∂ z Q ^ z = − Q ^ z W Q ^ z \partial_z\widehat{Q}_z=-\widehat{Q}_zW\widehat{Q}_z ∂ z Q z = − Q z W Q z gives
∂ z L ^ ( η , z ; W ) = 1 d 2 − 1 Tr ( K ~ z T W K ~ z ) . (111) \partial_z\widehat{\mathcal{L}}(\eta,z;W)=\frac{1}{d^2-1}\operatorname{Tr}(\widetilde{K}_z^{T}W\widetilde{K}_z). \tag*{(111)} ∂ z L ( η , z ; W ) = d 2 − 1 1 Tr ( K z T W K z ) . (111)
For z = 0 z=0 z = 0 , K ~ z = K ^ \widetilde{K}_z=\widehat{K} K z = K . Thus the z z z -derivative with W = n o u t Σ ‾ t e W=n_{\mathrm{out}}\overline{\Sigma}_{\mathrm{te}} W = n out Σ te gives the centered test variance; with W = M ~ μ T M ~ μ W=\widetilde{M}_{\mu}^{T}\widetilde{M}_{\mu} W = M μ T M μ it gives the quadratic term in the traceless reconstruction error. Covariance bounds on 1 n o u t \mathbf{1}_{n_{\mathrm{out}}} 1 n out force individual mean probabilities to have order n o u t − 1 n_{\mathrm{out}}^{-1} n out − 1 , as needed for the shotwise replacement.
Lemma D2 (Balanced mean outcome probabilities). Under eqs. (D10) to (D12) , the numbers n o u t p I / d , a n_{\mathrm{out}}p_{I/d,a} n out p I / d , a and n o u t p ‾ a n_{\mathrm{out}}\overline{p}_a n out p a are bounded above and below by fixed positive constants. In particular p a i ≤ Tr ( μ a ) ≤ K d / n o u t p_{ai}\leq\operatorname{Tr}(\mu_a)\leq Kd/n_{\mathrm{out}} p ai ≤ Tr ( μ a ) ≤ K d / n out for every state and outcome.
Proof. Balanced outcome probabilities — Equation eq. (89) shows that n o u t Σ ( p ‾ ) n_{\mathrm{out}}\Sigma(\overline{p}) n out Σ ( p ) differs from n o u t Σ ‾ t r n_{\mathrm{out}}\overline{\Sigma}_{\mathrm{tr}} n out Σ tr by a positive matrix of norm O ( N − 1 ) O(N^{-1}) O ( N − 1 ) . The Haar test identity gives
n o u t Σ ‾ t e = n o u t Σ ( p I / d ) − M ~ μ T M ~ μ / N . (112) n_{\mathrm{out}}\overline{\Sigma}_{\mathrm{te}}=n_{\mathrm{out}}\Sigma(p_{I/d})-\widetilde{M}_{\mu}^{T}\widetilde{M}_{\mu}/N. \tag*{(112)} n out Σ te = n out Σ ( p I / d ) − M μ T M μ / N . (112)
For either mean vector p p p , the diagonal bounds imply c / 2 ≤ n o u t p a ( 1 − p a ) ≤ K c/2\leq n_{\mathrm{out}}p_a(1-p_a)\leq K c /2 ≤ n out p a ( 1 − p a ) ≤ K for large dimension. Thus p a ≥ c / ( 2 n o u t ) p_a\geq c/(2n_{\mathrm{out}}) p a ≥ c / ( 2 n out ) ; summing all other entries bounds 1 − p a 1-p_a 1 − p a below by a constant. The upper bound then gives n o u t p a ≤ K ′ n_{\mathrm{out}}p_a\leq K' n out p a ≤ K ′ . Finally ρ i ⪯ I d \rho_i\preceq I_d ρ i ⪯ I d gives p a i ≤ Tr ( μ a ) = d p I / d , a p_{ai}\leq\operatorname{Tr}(\mu_a)=dp_{I/d,a} p ai ≤ Tr ( μ a ) = d p I / d , a .
Lemma D3 (Multinomial comparison with the empirical categorical matrix). Under the same hypotheses, normalized bounded-weight fixed positive penalty traces of the count matrix P ^ N C \widehat{P}^{C}_{N} P N C in eqs. (110) and (116) agree in probability with those of the Gaussian design {xref}eq. (D24)`, whose entries are standard real Gaussian in orthonormal outcome-range coordinates. The convergence is local on positive-penalty intervals and transfers first penalty derivatives.
Proof. Shotwise count replacement — Condition on the complete list of training states. Start with P ^ N , ∗ C = n o u t N / n t r ( P ^ N − p ‾ 1 n t r T ) \widehat{P}^{C}_{N,*}=\sqrt{n_{\mathrm{out}}N/n_{\mathrm{tr}}}(\widehat{P}_{N}-\overline{p}\mathbf{1}_{n_{\mathrm{tr}}}^{T}) P N , ∗ C = n out N / n tr ( P N − p 1 n tr T ) . It has independent centered-noise columns and mean M ~ μ T M ρ c / n t r \widetilde{M}_{\mu}^{T}M_{\rho}^{c}/\sqrt{n_{\mathrm{tr}}} M μ T M ρ c / n tr ; centering its training columns changes it by rank one. A single block inverse contains the regularized feature inverse, the fitted prediction map, and the training residual filter. Controlling its traces therefore controls all three quantities needed for the costs. For Λ ⪰ η I / 2 \Lambda\succeq\eta I/2 Λ ⪰ η I /2 use
R ( P ^ N , ∗ C ) = ( ( P ^ N , ∗ C ) T P ^ N , ∗ C − I n t r ) − 1 = ( ( P ^ N , ∗ C ) T Q ^ − I n t r + ( P ^ N , ∗ C ) T Q ^ P ^ N , ∗ C ) − 1 , R(\widehat{P}^{C}_{N,*})=\left((\widehat{P}^{C}_{N,*})^{T}\widehat{P}^{C}_{N,*}-I_{n_{\mathrm{tr}}}\right)^{-1}=\left(\left(\widehat{P}^{C}_{N,*}\right)^{T}\widehat{Q}-I_{n_{\mathrm{tr}}}+\left(\widehat{P}^{C}_{N,*}\right)^{T}\widehat{Q}\widehat{P}^{C}_{N,*}\right)^{-1}, R ( P N , ∗ C ) = ( ( P N , ∗ C ) T P N , ∗ C − I n tr ) − 1 = ( ( P N , ∗ C ) T Q − I n tr + ( P N , ∗ C ) T Q P N , ∗ C ) − 1 ,
Q ^ = ( P ^ N , ∗ C ( P ^ N , ∗ C ) T + Λ ) − 1 . (113) \widehat{Q}=\left(\widehat{P}^{C}_{N,*}\left(\widehat{P}^{C}_{N,*}\right)^{T}+\Lambda\right)^{-1}. \tag*{(113)} Q = ( P N , ∗ C ( P N , ∗ C ) T + Λ ) − 1 . (113)
Intermediate diagonal-noise matrices act on the full outcome space. There extend the range penalty by η ( I n o u t − Π n o u t ) \eta(I_{n_{\mathrm{out}}}-\Pi_{n_{\mathrm{out}}}) η ( I n out − Π n out ) . It is uniformly positive, and at the two categorical endpoints the data lie in im Π n o u t \operatorname{im}\Pi_{n_{\mathrm{out}}} im Π n out , so their restricted traces agree with the original ones. Removing or projecting the extra uniform coordinate is a bounded-rank change. The ridge filter bounds all four blocks by K η K_\eta K η for every possible feature matrix. For a deterministic bounded weight W 0 W_0 W 0 , the third directional derivative of ( d 2 − 1 ) − 1 Tr ( W 0 R ) (d^2-1)^{-1}\operatorname{Tr}(W_0R) ( d 2 − 1 ) − 1 Tr ( W 0 R ) in a rank-one feature perturbation is bounded by K η ∥ W 0 ∥ o p ∥ Δ P ^ N , ∗ ∥ o p 3 / ( d 2 − 1 ) K_\eta\lVert W_0\rVert_{\mathrm{op}}\lVert\Delta\widehat{P}_{N,*}\rVert_{\mathrm{op}}^3/(d^2-1) K η ∥ W 0 ∥ op ∥ Δ P N , ∗ ∥ op 3 / ( d 2 − 1 ) . Each shot replacement has matching mean and covariance, so the first two Taylor terms cancel. Replacing all n t r N n_{\mathrm{tr}}N n tr N independent categorical shots by these Gaussian increments gives total error K η ∥ W 0 ∥ o p n o u t 3 / 2 / ( ( d 2 − 1 ) N n t r ) = o ( 1 ) K_\eta\lVert W_0\rVert_{\mathrm{op}}n_{\mathrm{out}}^{3/2}/((d^2-1)\sqrt{Nn_{\mathrm{tr}}})=o(1) K η ∥ W 0 ∥ op n out 3/2 / (( d 2 − 1 ) N n tr ) = o ( 1 ) . The Gaussian third moments obey the same estimate because each increment has covariance trace at most n o u t / ( N n t r ) n_{\mathrm{out}}/(Nn_{\mathrm{tr}}) n out / ( N n tr ) . Bounding the effect of resampling one independent shot and summing its squared change (the Efron–Stein variance inequality) gives variance at most K η ∥ W 0 ∥ o p 2 n o u t / ( d 2 − 1 ) 2 = o ( 1 ) K_\eta\lVert W_0\rVert_{\mathrm{op}}^2n_{\mathrm{out}}/(d^2-1)^2=o(1) K η ∥ W 0 ∥ op 2 n out / ( d 2 − 1 ) 2 = o ( 1 ) .
State-dependent Gaussian covariances — The matched Gaussian column with covariance n o u t Σ ( ρ i ) n_{\mathrm{out}}\Sigma(\rho_i) n out Σ ( ρ i ) is
n o u t diag ( p i ) g i − n o u t p i ( p i T g i ) , g i ∼ N ( 0 , I n o u t ) . (114) \sqrt{n_{\mathrm{out}}}\operatorname{diag}(\sqrt{p_i})g_i-\sqrt{n_{\mathrm{out}}}p_i(\sqrt{p_i}^{T}g_i),\qquad g_i\sim\mathcal{N}(0,I_{n_{\mathrm{out}}}). \tag*{(114)} n out diag ( p i ) g i − n out p i ( p i T g i ) , g i ∼ N ( 0 , I n out ) . (114)
After division by n t r \sqrt{n_{\mathrm{tr}}} n tr , the second term has a rank-one mean part plus a remainder E E E with E ∥ E ∥ F 2 = n o u t n t r ∥ P − p ‾ 1 n t r T ∥ F 2 ≤ K Tr ( ρ F c ) / [ d ( d + 1 ) ] = O ( 1 ) \mathbb{E}\lVert E\rVert_{F}^{2}=\frac{n_{\mathrm{out}}}{n_{\mathrm{tr}}}\lVert P-\overline{p}\mathbf{1}_{n_{\mathrm{tr}}}^{T}\rVert_{F}^{2}\leq K\operatorname{Tr}(\rho_{\mathcal{F}}^{c})/[d(d+1)]=O(1) E ∥ E ∥ F 2 = n tr n out ∥ P − p 1 n tr T ∥ F 2 ≤ K Tr ( ρ F c ) / [ d ( d + 1 )] = O ( 1 ) . Bounded rank changes normalized weighted inverse traces by O η ( ( d 2 − 1 ) − 1 ) O_\eta((d^2-1)^{-1}) O η (( d 2 − 1 ) − 1 ) ; the remainder changes them by O η ( ∥ E ∥ F / d 2 − 1 ) = o P ( 1 ) O_\eta(\lVert E\rVert_F/\sqrt{d^2-1})=o_{\mathbb{P}}(1) O η (∥ E ∥ F / d 2 − 1 ) = o P ( 1 ) . A common Gaussian covariance — For the remaining independent Gaussian entries, interpolate their variances n o u t p a i n_{\mathrm{out}}p_{ai} n out p ai to the row variances n o u t p ˉ a n_{\mathrm{out}}\bar p_a n out p ˉ a . Write Δ = n o u t ( P − p ˉ 1 n t r T ) \Delta=n_{\mathrm{out}}\left(P-\bar p\mathbf{1}_{n_{\mathrm{tr}}}^{\mathsf{T}}\right) Δ = n out ( P − p ˉ 1 n tr T ) , where P P P is the exact probability matrix. Gaussian integration by parts bounds the weighted trace error by
K η ∥ W 0 ∥ o p ( ∥ Δ ∥ o p n t r + ∥ Δ ∥ max n t r ) = O η ( [ d ( d + 1 ) ] − 1 / 2 + d n t r ) = o ( 1 ) . (115) K\eta\lVert W_0\rVert_{\mathrm{op}}\left(\frac{\lVert\Delta\rVert_{\mathrm{op}}}{n_{\mathrm{tr}}}+\frac{\lVert\Delta\rVert_{\max}}{n_{\mathrm{tr}}}\right)=O_\eta\left([d(d+1)]^{-1/2}+\frac{d}{n_{\mathrm{tr}}}\right)=o(1). \tag*{(115)} K η ∥ W 0 ∥ op ( n tr ∥ Δ ∥ op + n tr ∥ Δ ∥ m a x ) = O η ( [ d ( d + 1 ) ] − 1/2 + n tr d ) = o ( 1 ) . (115)
Indeed ∥ Δ ∥ o p ≤ K n o u t n t r / [ d ( d + 1 ) ] \lVert\Delta\rVert_{\mathrm{op}}\le K\sqrt{n_{\mathrm{out}}n_{\mathrm{tr}}/[d(d+1)]} ∥ Δ ∥ op ≤ K n out n tr / [ d ( d + 1 )] by the two frame bounds, and the maximum entry is at most K d Kd K d by lemma D2. For clarity, the second derivative of the block inverse trace is a sum of two products of diagonal entries and one product of off-diagonal entries. The first two sums use ∥ Δ ∥ o p \lVert\Delta\rVert_{\mathrm{op}} ∥ Δ ∥ op and Euclidean diagonal-vector norms. The last uses ∥ Δ ∥ max \lVert\Delta\rVert_{\max} ∥ Δ ∥ m a x and the two block Frobenius norms. This gives the two terms in eq. (115) .
Categorical covariance and derivatives — The resulting common diagonal covariance can be changed, by a rank-one Gaussian bridge, to n o u t Σ ( p ˉ ) n_{\mathrm{out}}\Sigma(\bar p) n out Σ ( p ˉ ) . Its difference from n o u t Σ ‾ t r n_{\mathrm{out}}\overline{\Sigma}_{\mathrm{tr}} n out Σ tr is N − 1 M ~ μ T F ρ c M ~ μ N^{-1}\widetilde M_\mu^{\mathsf{T}}F_\rho^c\widetilde M_\mu N − 1 M μ T F ρ c M μ , of norm O ( N − 1 ) O(N^{-1}) O ( N − 1 ) . The square-root inequality for positive matrices bounds the difference of Gaussian noise matrices in operator norm by O P ( N − 1 / 2 ) O_{\mathbb{P}}(N^{-1/2}) O P ( N − 1/2 ) . Thus the endpoint is eq. (106) . Outcome and training projections change bounded rank. Concavity and local positive-penalty difference quotients give the first derivatives, as used in the main proof.
Lemma D4 (Evaluation of the common-covariance Gaussian traces). Under the empirical bounds, the Gaussian design eq. (106) has the unique positive resolvent solution eqs. (107) and (108) . Its weighted residual and mixed prediction traces satisfy
L ^ − L d → P 0 , 1 d 2 − 1 Tr ( M ~ μ K ^ ) − 1 a ( d 2 − 1 ) Tr ( F ρ c M ~ μ R M ~ μ T ) → P 0. (116) \widehat{\mathcal{L}}-\mathcal{L}_d\xrightarrow{\mathbb{P}}0,\qquad\frac{1}{d^2-1}\operatorname{Tr}(\widetilde M_\mu\widehat K)-\frac{1}{a(d^2-1)}\operatorname{Tr}(F_\rho^c\widetilde M_\mu\mathcal{R}\widetilde M_\mu^{\mathsf{T}})\xrightarrow{\mathbb{P}}0. \tag*{(116)} L − L d P 0 , d 2 − 1 1 Tr ( M μ K ) − a ( d 2 − 1 ) 1 Tr ( F ρ c M μ R M μ T ) P 0. (116) where L ^ , K ^ \widehat{\mathcal{L}},\widehat K L , K are evaluated with the Gaussian design. The equivalents are smooth locally at positive penalty, and the comparison transfers first penalty derivatives.
Proof. Gaussian resolvent equations — The deterministic mean and its covariance are given by eqs. (88) and (106) . For a positive penalty Λ = η Π n o u t + z W \Lambda=\eta\Pi n_{\mathrm{out}}+zW Λ = η Π n out + z W , apply the weighted Gaussian inverse-trace theorem [43 ] after multiplication by Λ − 1 / 2 \Lambda^{-1/2} Λ − 1/2 . It supplies deterministic approximations to the normalized weighted inverse and residual traces, with the unique positive solution displayed below. Diagonalize Λ − 1 / 2 ( n o u t Σ ‾ t r ) Λ − 1 / 2 \Lambda^{-1/2}(n_{\mathrm{out}}\overline{\Sigma}_{\mathrm{tr}})\Lambda^{-1/2} Λ − 1/2 ( n out Σ tr ) Λ − 1/2 by a real orthogonal matrix. The resulting row covariance is bounded above and below, the column covariance is the identity, and the deterministic mean has bounded norm. Real Gaussian independence is preserved. The positive deterministic matrices are
R = [ Λ + b n o u t Σ ‾ t r + a − 1 S ] − 1 , \mathcal{R}=\left[\Lambda+b\,n_{\mathrm{out}}\overline{\Sigma}_{\mathrm{tr}}+a^{-1}S\right]^{-1}, R = [ Λ + b n out Σ tr + a − 1 S ] − 1 ,
U = [ a I n t r + 1 n t r ( M ρ c ) T M ~ μ ( Λ + b n o u t Σ ‾ t r ) − 1 M ~ μ T M ρ c ] − 1 , (117) U=\left[aI_{n_{\mathrm{tr}}}+\frac{1}{n_{\mathrm{tr}}}(M_\rho^c)^{\mathsf{T}}\widetilde M_\mu\left(\Lambda+b\,n_{\mathrm{out}}\overline{\Sigma}_{\mathrm{tr}}\right)^{-1}\widetilde M_\mu^{\mathsf{T}}M_\rho^c\right]^{-1}, \tag*{(117)} U = [ a I n tr + n tr 1 ( M ρ c ) T M μ ( Λ + b n out Σ tr ) − 1 M μ T M ρ c ] − 1 , (117)
a = 1 + 1 n t r Tr ( n o u t Σ ‾ t r R ) , b = 1 n t r Tr ( U ) . a=1+\frac{1}{n_{\mathrm{tr}}}\operatorname{Tr}(n_{\mathrm{out}}\overline{\Sigma}_{\mathrm{tr}}\mathcal{R}),\qquad b=\frac{1}{n_{\mathrm{tr}}}\operatorname{Tr}(U). a = 1 + n tr 1 Tr ( n out Σ tr R ) , b = n tr 1 Tr ( U ) .
Woodbury’s identity gives
U = 1 a I n t r − 1 n t r a 2 ( M ρ c ) T M ~ μ R M ~ μ T M ρ c . (118) U=\frac{1}{a}I_{n_{\mathrm{tr}}}-\frac{1}{n_{\mathrm{tr}}a^2}(M_\rho^c)^{\mathsf{T}}\widetilde M_\mu\mathcal{R}\widetilde M_\mu^{\mathsf{T}}M_\rho^c. \tag*{(118)} U = a 1 I n tr − n tr a 2 1 ( M ρ c ) T M μ R M μ T M ρ c . (118)
Tracing it gives eq. (108) ; weighting it by M ρ c / n t r M_\rho^c/\sqrt{n_{\mathrm{tr}}} M ρ c / n tr gives eq. (109) . The same pair also gives the exact deterministic trace identity
b = 1 − γ d + Tr ( Λ R ) / n t r . (119) b=1-\gamma_d+\operatorname{Tr}(\Lambda\mathcal{R})/n_{\mathrm{tr}}. \tag*{(119)} b = 1 − γ d + Tr ( Λ R ) / n tr . (119)
This follows by tracing I = Λ R + b ( n o u t Σ ‾ t r ) R + S R / a I=\Lambda\mathcal{R}+b(n_{\mathrm{out}}\overline{\Sigma}_{\mathrm{tr}})\mathcal{R}+S\mathcal{R}/a I = Λ R + b ( n out Σ tr ) R + S R / a and using a − 1 = Tr ( ( n o u t Σ ‾ t r ) R ) / n t r a-1=\operatorname{Tr}((n_{\mathrm{out}}\overline{\Sigma}_{\mathrm{tr}})\mathcal{R})/n_{\mathrm{tr}} a − 1 = Tr (( n out Σ tr ) R ) / n tr . Existence, positivity, uniqueness of the resolvent branch and its local parameter convergence are supplied by the positive Gaussian resolvent equations; all input covariance and penalty bounds are uniform here.
Mixed prediction trace — For the mixed prediction trace, use the Gaussian design eq. (106) and its resolvent Q ^ = ( P N , G c ^ ( P N , G c ^ ) T + Λ ) − 1 \widehat Q=(P_{N,G}^{\widehat c}(P_{N,G}^{\widehat c})^{\mathsf{T}}+\Lambda)^{-1} Q = ( P N , G c ( P N , G c ) T + Λ ) − 1 . Gaussian integration by parts gives, with δ = Tr ( ( n o u t Σ ‾ t r ) Q ^ ) / n t r \delta=\operatorname{Tr}((n_{\mathrm{out}}\overline{\Sigma}_{\mathrm{tr}})\widehat Q)/n_{\mathrm{tr}} δ = Tr (( n out Σ tr ) Q ) / n tr ,
E [ Q ^ ( n o u t Σ ‾ t r ) 1 / 2 G / n t r ] = − E [ δ Q ^ P N , G ] − n t r − 1 E [ Q ^ ( n o u t Σ ‾ t r ) Q ^ P N , G ] . (120) \mathbb{E}\left[\widehat Q(n_{\mathrm{out}}\overline{\Sigma}_{\mathrm{tr}})^{1/2}G/\sqrt{n_{\mathrm{tr}}}\right]=-\mathbb{E}\left[\delta\widehat QP_{N,G}\right]-n_{\mathrm{tr}}^{-1}\mathbb{E}\left[\widehat Q(n_{\mathrm{out}}\overline{\Sigma}_{\mathrm{tr}})\widehat QP_{N,G}\right]. \tag*{(120)} E [ Q ( n out Σ tr ) 1/2 G / n tr ] = − E [ δ Q P N , G ] − n tr − 1 E [ Q ( n out Σ tr ) Q P N , G ] . (120)
Poincaré and the filter give Var δ = O η ( n t r − 2 ) \operatorname{Var}\delta= O_{\eta}(n_{\mathrm{tr}}^{-2}) Var δ = O η ( n tr − 2 ) and bounded norms of the two filtered matrices. Hence, in operator norm,
E ( Q ^ P ^ N , G c ) = ( E Q ^ ) M ~ μ T M ρ c n t r ( 1 + E δ ) + O η ( n t r − 1 ) . (121) \mathbb{E}\left(\widehat{Q}\widehat{P}^{\mathrm{c}}_{N,G}\right)=\frac{\left(\mathbb{E}\widehat{Q}\right)\widetilde{M}_{\mu}^{\mathsf{T}}M_{\rho}^{\mathrm{c}}}{\sqrt{n_{\mathrm{tr}}}\left(1+\mathbb{E}\delta\right)}+O_{\eta}\left(n_{\mathrm{tr}}^{-1}\right). \tag*{(121)} E ( Q P N , G c ) = n tr ( 1 + E δ ) ( E Q ) M μ T M ρ c + O η ( n tr − 1 ) . (121)
The weighted inverse theorem replaces the normalized traces of Q ^ \widehat{Q} Q by those of R \mathcal{R} R , while concentration makes the corresponding fluctuations vanish. Substituting the displayed mixed matrix mean gives the second limit in eq. (116) .
Uniform derivative transfer — The derivative comparison can be made uniform in the dimension even when the empirical spectra have no limits. For Λ = η I n o u t − 1 + z W ⪰ η I n o u t − 1 / 2 \Lambda=\eta I_{\mathrm{nout}}^{-1}+zW\succeq\eta I_{\mathrm{nout}}^{-1/2} Λ = η I nout − 1 + z W ⪰ η I nout − 1/2 , differentiating the sample envelope gives
∂ z 2 L ^ = − 2 ( d 2 − 1 ) − 1 Tr ( K ^ z T W Q ^ z W K ^ z ) \partial_z^2\widehat{\mathcal{L}}=-2(d^2-1)^{-1}\operatorname{Tr}\left(\widehat{K}_z^{\mathsf{T}}W\widehat{Q}_zW\widehat{K}_z\right) ∂ z 2 L = − 2 ( d 2 − 1 ) − 1 Tr ( K z T W Q z W K z )
and hence ∣ ∂ z 2 L ^ ∣ ≤ 2 ∥ W ∥ o p 2 Tr ( F ρ c ) / ( ( d 2 − 1 ) η 2 ) \left|\partial_z^2\widehat{\mathcal{L}}\right|\le2\lVert W\rVert_{\mathrm{op}}^2\operatorname{Tr}(\mathcal{F}_{\rho}^{\mathrm{c}})/((d^2-1)\eta^2) ∂ z 2 L ≤ 2 ∥ W ∥ op 2 Tr ( F ρ c ) / (( d 2 − 1 ) η 2 ) by the ridge filter. To obtain the same bound for L d \mathcal{L}_d L d , fix its finite deterministic geometry. Write its Gaussian mean as A = M ~ μ T M ρ c / n t r A=\widetilde{M}_{\mu}^{\mathsf{T}}M_{\rho}^{\mathrm{c}}/\sqrt{n_{\mathrm{tr}}} A = M μ T M ρ c / n tr , its response map as R = M ρ c / n t r R=M_{\rho}^{\mathrm{c}}/\sqrt{n_{\mathrm{tr}}} R = M ρ c / n tr , and its noise covariance as C = n o u t Σ ‾ t r C=n_{\mathrm{out}}\overline{\Sigma}_{\mathrm{tr}} C = n out Σ tr . Replicate this fixed geometry as an auxiliary mathematical construction: replace A , R , C , Λ , W A,R,C,\Lambda,W A , R , C , Λ , W by their tensor products with I k I_k I k and use independent Gaussian noise scaled by 1 / n t r k 1/\sqrt{n_{\mathrm{tr}}k} 1/ n tr k . The enlarged dimensions are ( n o u t − 1 ) k , n t r k , ( d 2 − 1 ) k (n_{\mathrm{out}}-1)k,n_{\mathrm{tr}}k,(d^2-1)k ( n out − 1 ) k , n tr k , ( d 2 − 1 ) k . The scalar equations, normalized deterministic loss, and curvature bound are unchanged. At fixed original geometry, the same Gaussian weighted inverse-trace theorem makes the enlarged sample loss converge to L d \mathcal{L}_d L d as k → ∞ k\to\infty k → ∞ . The sample loss is bounded by Tr ( F ρ c ) / ( d 2 − 1 ) \operatorname{Tr}(\mathcal{F}_{\rho}^{\mathrm{c}})/(d^2-1) Tr ( F ρ c ) / ( d 2 − 1 ) , so the convergence also holds in expectation. Its uniform second-difference bound passes to L d \mathcal{L}_d L d ; smoothness on the positive resolvent branch then gives the same curvature bound. Centered difference quotients therefore approximate both sample and deterministic derivatives with an error O η ( h ) O_{\eta}(h) O η ( h ) uniformly in d d d . Apply the value comparison at fixed step h h h and then let h ↓ 0 h\downarrow0 h ↓ 0 to transfer first penalty derivatives.
Proposition D1 (Fixed-ridge centered costs). Under eqs. (92) to (94) , for any fixed κ ∈ ( 0 , ∞ ) \kappa\in(0,\infty) κ ∈ ( 0 , ∞ ) , condition on the states and POVM and fix η > 0 \eta>0 η > 0 . Let a a a , b b b , R \mathcal{R} R and L d \mathcal{L}_d L d be defined by eqs. (107) to (109) . The deterministic centered costs are
F η , d ≡ α d ∂ z L d ( η , z ; n o u t Σ ‾ t e ) ∣ z = 0 , (122) F_{\eta,d}\equiv\alpha_d\partial_z\mathcal{L}_d(\eta,z;n_{\mathrm{out}}\overline{\Sigma}_{\mathrm{te}})\big|_{z=0}, \tag*{(122)} F η , d ≡ α d ∂ z L d ( η , z ; n out Σ te ) z = 0 , (122) G η , d ≡ 1 − 2 a ( d 2 − 1 ) Tr ( F ρ c M ~ μ R M ~ μ T ) + ∂ z L d ( η , z ; M ~ μ T M ~ μ ) ∣ z = 0 . (123) G_{\eta,d}\equiv1-\frac{2}{a(d^2-1)}\operatorname{Tr}\left(\mathcal{F}_{\rho}^{\mathrm{c}}\widetilde{M}_{\mu}\mathcal{R}\widetilde{M}_{\mu}^{\mathsf{T}}\right)+\left.\partial_z\mathcal{L}_d(\eta,z;\widetilde{M}_{\mu}^{\mathsf{T}}\widetilde{M}_{\mu})\right|_{z=0}. \tag*{(123)} G η , d ≡ 1 − a ( d 2 − 1 ) 2 Tr ( F ρ c M μ R M μ T ) + ∂ z L d ( η , z ; M μ T M μ ) z = 0 . (123) with all z z z -dependence included in the derivatives. Then F ^ η , d − F η , d → P 0 \widehat{F}_{\eta,d}-F_{\eta,d}\xrightarrow{\mathbb{P}}0 F η , d − F η , d P 0 and G ^ η , d − G η , d → P 0 \widehat{G}_{\eta,d}-G_{\eta,d}\xrightarrow{\mathbb{P}}0 G η , d − G η , d P 0 .
Proof. Variance and reconstruction derivatives — The envelope identity eq. (111) with W = n o u t Σ ‾ t e W=n_{\mathrm{out}}\overline{\Sigma}_{\mathrm{te}} W = n out Σ te gives F ^ η , d / α d \widehat{F}_{\eta,d}/\alpha_d F η , d / α d . With W = M ~ μ T M ~ μ W=\widetilde{M}_{\mu}^{\mathsf{T}}\widetilde{M}_{\mu} W = M μ T M μ it gives the quadratic term in
G ^ η , d = 1 − 2 d 2 − 1 Tr ( M ~ μ K ^ ) + 1 d 2 − 1 Tr ( K ^ T M ~ μ T M ~ μ K ^ ) . (124) \widehat{G}_{\eta,d}=1-\frac{2}{d^2-1}\operatorname{Tr}\left(\widetilde{M}_{\mu}\widehat{K}\right)+\frac{1}{d^2-1}\operatorname{Tr}\left(\widehat{K}^{\mathsf{T}}\widetilde{M}_{\mu}^{\mathsf{T}}\widetilde{M}_{\mu}\widehat{K}\right). \tag*{(124)} G η , d = 1 − d 2 − 1 2 Tr ( M μ K ) + d 2 − 1 1 Tr ( K T M μ T M μ K ) . (124)
The count comparison lemma D3 transfers these normalized positive-penalty traces to the Gaussian design. Exact empirical centering changes the independent-column model by bounded rank and has no effect on these limits. The Gaussian trace identities eq. (116) then replace the sample loss and mixed prediction trace by their deterministic counterparts.
Recovering the penalty responses — To transfer derivatives, the sample residual is concave in z z z , being a minimum of affine penalty functions. Its derivative lies between positive and negative difference quotients. The dimension-uniform curvature bound in lemma D4 controls the secant error for both losses. Apply the value comparison at fixed step size, take the dimensional limit, and only then let the step decrease. The two envelope derivatives and the mixed-trace limit prove eqs. (122) and (123) , without assuming a limiting empirical spectrum.
Limiting centered profiles — At fixed geometry, F η , d F_{\eta,d} F η , d and G η , d G_{\eta,d} G η , d are deterministic approximations to the record-dependent, target-averaged centered costs. Write their dimensional limits as F η ( γ ) F_{\eta}(\gamma) F η ( γ ) and G η ( γ ) G_{\eta}(\gamma) G η ( γ ) when those limits exist. The comparison itself needs no limiting empirical spectrum; the peak and complete-curve results later impose the trace limits they use.
Restoring the physical readout
The physical readout must fit the training mean with its own outcome weights. A one-dimensional Schur complement restores that constraint exactly, including at zero penalty on count matrices of any rank. Lemma D5 gives the finite-record identities; proposition D2 combines them with the centered calculation to identify the physical costs used in sections IV B and IV C. The ideal-test error can retain one directional mean contribution even when normalized bulk traces have deterministic limits.
Mean displacement and residual label — Define
h ˉ = d ( d + 1 ) v ρ ˉ − I d / d , b N = n o u t N Π n o u t p ^ , b 0 = n o u t N Π n o u t p I / d . (125) \bar{h}=\sqrt{d(d+1)v_{\bar{\rho}}-I_d/d},\qquad b_N=\sqrt{n_{\mathrm{out}}N\Pi_{n_{\mathrm{out}}}\hat{p}},\qquad b_0=\sqrt{n_{\mathrm{out}}N\Pi_{n_{\mathrm{out}}}p_{I/d}}. \tag*{(125)} h ˉ = d ( d + 1 ) v ρ ˉ − I d / d , b N = n out N Π n out p ^ , b 0 = n out N Π n out p I / d . (125)
The difference b N − b 0 b_N-b_0 b N − b 0 is the measured displacement of the training mean from the Haar test mean, and r η = h ˉ − K ^ T b N r_\eta=\bar{h}-\hat{K}^{T}b_N r η = h ˉ − K ^ T b N is the mean label not supplied by the centered weights. With β η = η / ( N + η ) \beta_\eta=\eta/(N+\eta) β η = η / ( N + η ) as above, set
J η = 1 + β η b N T Q ^ b N , A η = 1 − β η + β η b 0 T Q ^ b N J η . (126) J_\eta=1+\beta_\eta b_N^{T}\hat{Q}b_N,\qquad A_\eta=\frac{1-\beta_\eta+\beta_\eta b_0^{T}\hat{Q}b_N}{J_\eta}. \tag*{(126)} J η = 1 + β η b N T Q ^ b N , A η = J η 1 − β η + β η b 0 T Q ^ b N . (126)
The factor J η J_\eta J η normalizes the rank-one correction, and A η A_\eta A η is the Haar mean prediction for constant unit labels. Define the identity-label readout w ^ N , τ I = w ^ N , τ ( I d ) \hat{w}^{I}_{N,\tau}=\hat{w}_{N,\tau}(I_d) w ^ N , τ I = w ^ N , τ ( I d ) and the mean-error vector t η = K ^ T b 0 + A η r η t_\eta=\hat{K}^{T}b_0+A_\eta r_\eta t η = K ^ T b 0 + A η r η . The latter singles out the target direction affected by the mean prediction.
Exact finite-record restoration — The formulas below recover the original weights, identity-label readout, and target-averaged costs from the centered fit. Their zero-penalty form includes the nullspace correction selected by the physical minimum-norm criterion; the subsequent bounds identify which terms survive the dimensional limit.
Lemma D5 (Exact restoration of the empirical mean). For every count record and η > 0 \eta>0 η > 0 , the quantities in eqs. (D43) and (D44) give the original readout as follows. Write
z η = β η Q ^ b N J η , Z η = K ^ + z η r η T . (127) z_\eta=\frac{\beta_\eta\hat{Q}b_N}{J_\eta},\qquad Z_\eta=\hat{K}+z_\eta r_\eta^{T}. \tag*{(127)} z η = J η β η Q ^ b N , Z η = K ^ + z η r η T . (127) If w = w 0 1 n o u t + w c w=w_0\mathbf{1}_{n_{\mathrm{out}}}+w_c w = w 0 1 n out + w c , with 1 n o u t T w c = 0 \mathbf{1}_{n_{\mathrm{out}}}^{T}w_c=0 1 n out T w c = 0 , then exactly
w c = n o u t N d ( d + 1 ) [ Z η v O 0 + d ( d + 1 ) c O z η ] , w 0 = 1 − β η d ( d + 1 ) J η ( r η T v O 0 + d ( d + 1 ) c O ) . (128) w_c=\sqrt{\frac{n_{\mathrm{out}}N}{d(d+1)}}\left[Z_\eta v_{O_0}+\sqrt{d(d+1)}c_Oz_\eta\right],\qquad
w_0=\frac{1-\beta_\eta}{\sqrt{d(d+1)}J_\eta}\left(r_\eta^{T}v_{O_0}+\sqrt{d(d+1)}c_O\right). \tag*{(128)} w c = d ( d + 1 ) n out N [ Z η v O 0 + d ( d + 1 ) c O z η ] , w 0 = d ( d + 1 ) J η 1 − β η ( r η T v O 0 + d ( d + 1 ) c O ) . (128) The identity-label readout and mean prediction are exactly
w ^ N , τ I = 1 − β η J η 1 n o u t + n o u t N β η J η Q ^ b N . (129) \hat{w}^{I}_{N,\tau}=\frac{1-\beta_\eta}{J_\eta}\mathbf{1}_{n_{\mathrm{out}}}+\frac{\sqrt{n_{\mathrm{out}}N}\beta_\eta}{J_\eta}\hat{Q}b_N. \tag*{(129)} w ^ N , τ I = J η 1 − β η 1 n out + J η n out N β η Q ^ b N . (129) p I / d T w ^ N , τ I = A η , d ( d + 1 ) ( p I / d T w ^ N , τ − c O ) = t η T v O 0 + d ( d + 1 ) c O ( A η − 1 ) . (130) p_{I/d}^{T}\hat{w}^{I}_{N,\tau}=A_\eta,\qquad
\sqrt{d(d+1)}\left(p_{I/d}^{T}\hat{w}_{N,\tau}-c_O\right)=t_\eta^{T}v_{O_0}+\sqrt{d(d+1)}c_O(A_\eta-1). \tag*{(130)} p I / d T w ^ N , τ I = A η , d ( d + 1 ) ( p I / d T w ^ N , τ − c O ) = t η T v O 0 + d ( d + 1 ) c O ( A η − 1 ) . (130) Conditional on the record and target invariants, all stated target laws have the exact cost averages
V N , τ d Δ O 2 = α d d 2 − 1 Tr ( Z η T n o u t Σ ˉ t e Z η ) + N c O 2 d Δ O 2 z η T n o u t Σ ˉ t e z η . (131) \frac{V_{N,\tau}}{d\Delta_O^2}=\frac{\alpha_d}{d^2-1}\operatorname{Tr}\left(Z_\eta^{T}n_{\mathrm{out}}\bar{\Sigma}_{\mathrm{te}}Z_\eta\right)+\frac{Nc_O^2}{d\Delta_O^2}z_\eta^{T}n_{\mathrm{out}}\bar{\Sigma}_{\mathrm{te}}z_\eta. \tag*{(131)} d Δ O 2 V N , τ = d 2 − 1 α d Tr ( Z η T n out Σ ˉ te Z η ) + d Δ O 2 N c O 2 z η T n out Σ ˉ te z η . (131) d ( d + 1 ) E N , τ d Δ O 2 = 1 d 2 − 1 ∥ M ~ μ Z η − P 0 ∥ F 2 + d ( d + 1 ) c O 2 d Δ O 2 ∥ M ~ μ z η ∥ 2 + ∥ t η ∥ 2 d 2 − 1 + d ( d + 1 ) c O 2 d Δ O 2 ( A η − 1 ) 2 . (132) \frac{d(d+1)\mathcal{E}_{N,\tau}}{d\Delta_O^2}=\frac{1}{d^2-1}\left\|\tilde{M}_\mu Z_\eta-P_0\right\|_{F}^{2}+\frac{d(d+1)c_O^2}{d\Delta_O^2}\left\|\tilde{M}_\mu z_\eta\right\|^{2}+\frac{\|t_\eta\|^{2}}{d^2-1}+\frac{d(d+1)c_O^2}{d\Delta_O^2}(A_\eta-1)^2. \tag*{(132)} d Δ O 2 d ( d + 1 ) E N , τ = d 2 − 1 1 M ~ μ Z η − P 0 F 2 + d Δ O 2 d ( d + 1 ) c O 2 M ~ μ z η 2 + d 2 − 1 ∥ t η ∥ 2 + d Δ O 2 d ( d + 1 ) c O 2 ( A η − 1 ) 2 . (132) These identities also hold at zero penalty, on every rank, with K ^ 0 = ( ( P ^ N c ) T ) + ( M ρ c ) T / n t r \hat{K}_0=((\hat{P}^{c}_N)^{T})^{+}(M_{\rho}^{c})^{T}/\sqrt{n_{\mathrm{tr}}} K ^ 0 = (( P ^ N c ) T ) + ( M ρ c ) T / n tr and Π N = Π n o u t − P ^ N c ( P ^ N c ) + \Pi_N=\Pi_{n_{\mathrm{out}}}-\hat{P}^{c}_N(\hat{P}^{c}_N)^{+} Π N = Π n out − P ^ N c ( P ^ N c ) + , after setting
z 0 = Π N b N N + ∥ Π N b N ∥ 2 , A 0 = N + b 0 T Π N b N N + ∥ Π N b N ∥ 2 , w 0 = r 0 T v O 0 + d ( d + 1 ) c O d ( d + 1 ) [ 1 + ∥ Π N b N ∥ 2 / N ] . (133) z_0=\frac{\Pi_Nb_N}{N+\|\Pi_Nb_N\|^2},\qquad A_0=\frac{N+b_0^{T}\Pi_Nb_N}{N+\|\Pi_Nb_N\|^2},\qquad w_0=\frac{r_0^{T}v_{O_0}+\sqrt{d(d+1)}c_O}{\sqrt{d(d+1)}[1+\|\Pi_Nb_N\|^2/N]}. \tag*{(133)} z 0 = N + ∥ Π N b N ∥ 2 Π N b N , A 0 = N + ∥ Π N b N ∥ 2 N + b 0 T Π N b N , w 0 = d ( d + 1 ) [ 1 + ∥ Π N b N ∥ 2 / N ] r 0 T v O 0 + d ( d + 1 ) c O . (133)
Here r 0 r_0 r 0 , Z 0 Z_0 Z 0 , t 0 t_0 t 0 have the same definitions using K ^ 0 \widehat{K}_0 K 0 , z 0 z_0 z 0 , A 0 A_0 A 0 . The physical identity readout at zero penalty is
w ^ N , 0 I = N 1 n o u t + n o u t N Π N b N N + ∥ Π N b N ∥ 2 . (134) \widehat{w}^{\mathrm{I}}_{N,0}=\frac{N1_{\mathrm{nout}}+\sqrt{\mathrm{nout}N}\Pi_N b_N}{N+\lVert\Pi_N b_N\rVert^2}. \tag*{(134)} w N , 0 I = N + ∥ Π N b N ∥ 2 N 1 nout + nout N Π N b N . (134)
Proof. Positive-ridge Schur complement — Eliminate w 0 w_0 w 0 in the exact objective eq. (96) . The centered normal matrix acquires β η b N b N T \beta_\eta b_Nb_N^{T} β η b N b N T , and its right side acquires β η b N ( h ˉ T v O 0 + d ( d + 1 ) c O ) \beta_\eta b_N(\bar{h}^{T}v_{O_0}+\sqrt{d(d+1)}c_{O}) β η b N ( h ˉ T v O 0 + d ( d + 1 ) c O ) in the scaled coordinates. Sherman–Morrison gives eqs. (127) and (D46). Since d ( d + 1 ) p I / d T w = d ( d + 1 ) w 0 + b 0 T [ Z η v O 0 + d ( d + 1 ) c O z η ] \sqrt{d(d+1)}p^{T}_{I/d}w=\sqrt{d(d+1)}w_0+b_0^{T}[Z_\eta v_{O_0}+\sqrt{d(d+1)}c_Oz_\eta] d ( d + 1 ) p I / d T w = d ( d + 1 ) w 0 + b 0 T [ Z η v O 0 + d ( d + 1 ) c O z η ] , substitution gives eq. (130) . The target second moment is d Δ 2 P 0 / ( d 2 − 1 ) d\Delta^2P_0/(d^2-1) d Δ 2 P 0 / ( d 2 − 1 ) and its first moment is zero. Applying these identities to the variance and eq. (84) proves eqs. (131) and (D50).
Minimum-norm nullspace correction — At zero ridge every centered least-squares solution is the minimum-norm centered solution plus a vector in ker ( P ^ N c ) T \ker(\widehat{P}_N^{c})^{T} ker ( P N c ) T . Write its scaled correction as z z z . The part of the original coefficient norm that depends on z z z is proportional to
N ∥ z ∥ 2 + ( r 0 T v O 0 + d ( d + 1 ) c O − b N T z ) 2 , z ∈ im Π N . (135) N\lVert z\rVert^2+\left(r_0^{T}v_{O_0}+\sqrt{d(d+1)}c_O-b_N^{T}z\right)^2,\qquad z\in\operatorname{im}\Pi_N. \tag*{(135)} N ∥ z ∥ 2 + ( r 0 T v O 0 + d ( d + 1 ) c O − b N T z ) 2 , z ∈ im Π N . (135)
Its minimum gives eq. (133) and the same exact physical costs. Taking constant labels gives eq. (134) .
Descriptors of the empirical mean — For the bounds used in the asymptotic arguments, introduce the descriptors
q d = ∥ ρ ˉ − I d / d ∥ F 2 , t d 2 = n o u t ∥ p I / d − 1 n o u t / n o u t ∥ 2 . q_d=\lVert\bar{\rho}-I_d/d\rVert_F^2,\qquad t_d^2=n_{\mathrm{out}}\lVert p_{I/d}-1_{\mathrm{nout}}/n_{\mathrm{out}}\rVert^2. q d = ∥ ρ ˉ − I d / d ∥ F 2 , t d 2 = n out ∥ p I / d − 1 nout / n out ∥ 2 .
They measure mean-state purity above 1 / d 1/d 1/ d and imbalance of effect traces. Both are bounded under the basic empirical assumptions; no vanishing condition is imposed on them.
Lemma D6 (Fixed-ridge size of the mean correction). *Under the empirical bounds, at each fixed η > 0 \eta>0 η > 0 ,
∥ K ^ ∥ o p , ∥ Z η ∥ o p , ∣ A η ∣ = O P , η ( 1 ) , ∥ z η ∥ = O P , η ( [ d ( d + 1 ) ] − 1 / 2 ) and ∥ r η ∥ = O P , η ( d ( d + 1 ) ) . \lVert\widehat{K}\rVert_{\mathrm{op}},\lVert Z_\eta\rVert_{\mathrm{op}},\lvert A_\eta\rvert=O_{\mathrm{P},\eta}(1),\quad\lVert z_\eta\rVert=O_{\mathrm{P},\eta}([d(d+1)]^{-1/2})\quad\text{and}\quad\lVert r_\eta\rVert=O_{\mathrm{P},\eta}(\sqrt{d(d+1)}). ∥ K ∥ op , ∥ Z η ∥ op , ∣ A η ∣ = O P , η ( 1 ) , ∥ z η ∥ = O P , η ([ d ( d + 1 ) ] − 1/2 ) and ∥ r η ∥ = O P , η ( d ( d + 1 ) ) . The difference Z η − K ^ Z_\eta-\widehat{K} Z η − K has rank at most one and bounded norm, while
∥ t η ∥ 2 / ( d 2 − 1 ) = O P , η ( q d + ( d 2 − 1 ) − 1 ) . (136) \lVert t_\eta\rVert^2/(d^2-1)=O_{\mathrm{P},\eta}(q_d+(d^2-1)^{-1}). \tag*{(136)} ∥ t η ∥ 2 / ( d 2 − 1 ) = O P , η ( q d + ( d 2 − 1 ) − 1 ) . (136) **
Proof. Sizes of the mean vectors — The bounded mean probabilities and independence of the records give
∥ b N ∥ 2 = O P [ N ( q d + t d 2 ) + 1 ] , ∥ h ˉ ∥ 2 = d ( d + 1 ) q d , b N − b 0 = M ~ μ T h ˉ + O P ( 1 ) . (137) \lVert b_N\rVert^2=O_{\mathrm{P}}[N(q_d+t_d^2)+1],\qquad\lVert\bar{h}\rVert^2=d(d+1)q_d,\qquad b_N-b_0=\widetilde{M}_\mu^{T}\bar{h}+O_{\mathrm{P}}(1). \tag*{(137)} ∥ b N ∥ 2 = O P [ N ( q d + t d 2 ) + 1 ] , ∥ h ˉ ∥ 2 = d ( d + 1 ) q d , b N − b 0 = M μ T h ˉ + O P ( 1 ) . (137)
The filter ∥ Q ^ P ^ N c ∥ o p ≤ 1 / ( 2 η ) \lVert\widehat{Q}\widehat{P}_N^{c}\rVert_{\mathrm{op}}\le1/(2\sqrt{\eta}) ∥ Q P N c ∥ op ≤ 1/ ( 2 η ) and ∥ M ρ c / n t r ∥ o p ≤ K ^ \lVert M_\rho^c/\sqrt{n_{\mathrm{tr}}}\rVert_{\mathrm{op}}\le\sqrt{\widehat{K}} ∥ M ρ c / n tr ∥ op ≤ K bound K ^ \widehat{K} K . Since J η ≥ 1 J_\eta\ge1 J η ≥ 1 and ∥ Q ^ ∥ o p ≤ 1 / η \lVert\widehat{Q}\rVert_{\mathrm{op}}\le1/\eta ∥ Q ∥ op ≤ 1/ η , the definitions give the sizes of z η , r η , Z η z_\eta,r_\eta,Z_\eta z η , r η , Z η . They also bound A η A_\eta A η , using ∥ b 0 ∥ 2 = N t d 2 \lVert b_0\rVert^2=Nt_d^2 ∥ b 0 ∥ 2 = N t d 2 .
Directional mean bound — For the sharper bound on the mean query, use the original uniform normal equation to write its coefficient for a traceless target as
t η = h ˉ − ( Z η ) T ( b N − b 0 ) − β η J η r η . (138) t_\eta=\bar{h}-(Z_\eta)^{T}(b_N-b_0)-\frac{\beta_\eta}{J_\eta}r_\eta. \tag*{(138)} t η = h ˉ − ( Z η ) T ( b N − b 0 ) − J η β η r η . (138)
The last term is O P , η ( [ d ( d + 1 ) ] − 1 / 2 ) O_{\mathrm{P},\eta}([d(d+1)]^{-1/2}) O P , η ([ d ( d + 1 ) ] − 1/2 ) . Together with eq. (137) and the bounded map Z η Z_\eta Z η , this bounds ∥ t η ∥ 2 \lVert t_\eta\rVert^2 ∥ t η ∥ 2 by O P , η ( d ( d + 1 ) q d + 1 ) O_{\mathrm{P},\eta}(d(d+1)q_d+1) O P , η ( d ( d + 1 ) q d + 1 ) , proving the claim.
Lemma D7 (Diffuse mean for a pure-state training frame). *For pure training states, the upper frame bound and eq. (95) imply ∥ ρ ˉ ∥ o p = O ( d − 1 ) \lVert\bar{\rho}\rVert_{\mathrm{op}}=O(d^{-1}) ∥ ρ ˉ ∥ op = O ( d − 1 ) and q d = O ( d − 1 ) q_d=O(d^{-1}) q d = O ( d − 1 ) .
Proof. Purity and a diffuse training mean — For an eigenvector of ρ ˉ \bar{\rho} ρ ˉ with eigenvalue λ \lambda λ , purity gives the mean squared length of ( ρ i − ρ ˉ ) (\rho_i-\bar{\rho}) ( ρ i − ρ ˉ ) applied to that vector as λ − λ 2 \lambda-\lambda^2 λ − λ 2 . Sum its d d d matrix-entry variances and use the upper centered-frame bound to obtain λ ( 1 − λ ) ≤ K d / [ d ( d + 1 ) ] \lambda(1-\lambda)\le Kd/[d(d+1)] λ ( 1 − λ ) ≤ K d / [ d ( d + 1 )] . On the other hand eq. (85) and the positive average frame trace bound Tr ( ρ ˉ 2 ) \operatorname{Tr}(\bar{\rho}^2) Tr ( ρ ˉ 2 ) away from one. Thus λ max ( ρ ˉ ) \lambda_{\max}(\bar{\rho}) λ m a x ( ρ ˉ ) stays away from one; the bound on λ ( 1 − λ ) \lambda(1-\lambda) λ ( 1 − λ ) forces every eigenvalue to be O ( d − 1 ) O(d^{-1}) O ( d − 1 ) . Finally q d = Tr ( ρ ˉ 2 ) − 1 / d ≤ ∥ ρ ˉ ∥ o p q_d=\operatorname{Tr}(\bar{\rho}^2)-1/d\le\lVert\bar{\rho}\rVert_{\mathrm{op}} q d = Tr ( ρ ˉ 2 ) − 1/ d ≤ ∥ ρ ˉ ∥ op .
Lemma D8 (Identity-label readout). For constant unit labels, every multinomial record and every η ≥ 0 \eta\ge0 η ≥ 0 satisfy
∥ w ^ N , η / ( n o u t N ) ( I d ) ∥ ≤ n o u t , ∥ Π n o u t w ^ N , η / ( n o u t N ) ( I d ) ∥ ≤ n o u t / N ∥ b N ∥ . (139) \lVert\widehat{w}_{N,\eta/(n_{\mathrm{out}}N)}(I_d)\rVert\le\sqrt{n_{\mathrm{out}}},\qquad\lVert\Pi_{n_{\mathrm{out}}}\widehat{w}_{N,\eta/(n_{\mathrm{out}}N)}(I_d)\rVert\le\sqrt{n_{\mathrm{out}}/N}\lVert b_N\rVert. \tag*{(139)} ∥ w N , η / ( n out N ) ( I d )∥ ≤ n out , ∥ Π n out w N , η / ( n out N ) ( I d )∥ ≤ n out / N ∥ b N ∥ . (139) Under the proportional-dimensional assumptions, uniformly for bounded η ≥ 0 \eta\ge0 η ≥ 0 ,
V N , η / ( n o u t N ) ( I d ) = O P ( q d + t d 2 + [ d ( d + 1 ) ] − 1 ) , V_{N,\eta/(n_{\mathrm{out}}N)}(I_d)=O_{\mathrm{P}}(q_d+t_d^2+[d(d+1)]^{-1}), V N , η / ( n out N ) ( I d ) = O P ( q d + t d 2 + [ d ( d + 1 ) ] − 1 ) , d ( d + 1 ) E N , η / ( n o u t N ) ( I d ) = O P [ d ( d + 1 ) q d ( q d + t d 2 ) + q d + t d 2 + [ d ( d + 1 ) ] − 1 ] . (140) d(d+1)\mathcal{E}_{N,\eta/(n_{\mathrm{out}}N)}(I_d)=O_{\mathrm{P}}[d(d+1)q_d(q_d+t_d^2)+q_d+t_d^2+[d(d+1)]^{-1}]. \tag*{(140)} d ( d + 1 ) E N , η / ( n out N ) ( I d ) = O P [ d ( d + 1 ) q d ( q d + t d 2 ) + q d + t d 2 + [ d ( d + 1 ) ] − 1 ] . (140) The assertions include the actual minimum-norm solution on deficient records.
Proof. Identity-label coefficient bounds — Probability normalization gives P ^ N T 1 n o u t = 1 n t r \widehat{P}_N^{T}1_{n_{\mathrm{out}}}=1_{n_{\mathrm{tr}}} P N T 1 n out = 1 n tr . For τ > 0 \tau>0 τ > 0 , the identity readout is ( S ^ + τ I ) − 1 S ^ 1 n o u t (\widehat{S}+\tau I)^{-1}\widehat{S}1_{n_{\mathrm{out}}} ( S + τ I ) − 1 S 1 n out with S ^ = P ^ N P ^ N T / n t r \widehat{S}=\widehat{P}_N\widehat{P}_N^{T}/n_{\mathrm{tr}} S = P N P N T / n tr ; this is a contraction applied to 1 n o u t 1_{n_{\mathrm{out}}} 1 n out . At zero ridge it is the orthogonal projection onto im P ^ N \operatorname{im}\widehat{P}_N im P N . This proves the first bound. For positive ridge, eq. (129) gives w c = n o u t N β η Q ^ N / J η w_c=\sqrt{n_{\mathrm{out}}N}\,\beta_\eta\widehat{Q}_N/J_\eta w c = n out N β η Q N / J η . The bounds J η ≥ 1 J_\eta\ge1 J η ≥ 1 and ∥ Q ^ ∥ o p ≤ 1 / η \lVert\widehat{Q}\rVert_{\mathrm{op}}\le1/\eta ∥ Q ∥ op ≤ 1/ η prove the second coefficient estimate. At zero ridge, eq. (134) gives the same bound with the existing nullspace projector Π N \Pi_N Π N , for every rank. Equation eq. (137) now implies ∥ w c ∥ 2 = O P [ n o u t ( q d + t d 2 ) + 1 ] \lVert w_c\rVert^2=O_{\mathrm{P}}[n_{\mathrm{out}}(q_d+t_d^2)+1] ∥ w c ∥ 2 = O P [ n out ( q d + t d 2 ) + 1 ] . The upper bound on n o u t Σ ^ t e n_{\mathrm{out}}\widehat{\Sigma}_{t e} n out Σ t e proves the variance estimate.
Identity prediction error — The original normal equation in the uniform direction gives exactly p ^ T T w ( I d ) − 1 = η 1 n o u t T w ( I d ) / ( n o u t N ) \widehat{p}_T^T w(I_d)-1=\eta1_{n_{\mathrm{out}}}^T w(I_d)/(n_{\mathrm{out}}N) p T T w ( I d ) − 1 = η 1 n out T w ( I d ) / ( n out N ) . Also ∥ p ˉ − p I / d ∥ 2 ≤ K q d / n o u t \lVert\bar{p}-p_I/d\rVert^2\le Kq_d/n_{\mathrm{out}} ∥ p ˉ − p I / d ∥ 2 ≤ K q d / n out and the record mean has mean-square fluctuation at most 1 / ( N n t r ) 1/(Nn_{\mathrm{tr}}) 1/ ( N n tr ) . These facts and the coefficient bounds show that d ( d + 1 ) ∣ p I T / d w ( I d ) − 1 ∣ 2 d(d+1)|p_I^T/d\,w(I_d)-1|^2 d ( d + 1 ) ∣ p I T / d w ( I d ) − 1 ∣ 2 is bounded in probability by the right side of eq. (140) . The Haar split eq. (84) adds the squared traceless prediction norm, bounded by K ∥ w c ∥ 2 / n o u t K\lVert w_c\rVert^2/n_{\mathrm{out}} K ∥ w c ∥ 2 / n out . This proves the ideal-test bound.
From averaged to realized costs — The target bounds promote conditional quadratic traces to typical realized centered costs. The squared error of the mean prediction, which probes a single direction, remains separate.
Lemma D9 (Concentration for spherical and sign target directions). Let v v v be an independent uniform unit vector on the traceless operator sphere of dimension d 2 − 1 d^2-1 d 2 − 1 , or let v j = ε j / d 2 − 1 v_j=\varepsilon_j/\sqrt{d^2-1} v j = ε j / d 2 − 1 for independent symmetric signs ε j \varepsilon_j ε j . For every deterministic real symmetric operator A A A on this space,
E ( v T A v ) = 1 d 2 − 1 Tr ( A ) , Var ( v T A v ) ≤ 2 ( d 2 − 1 ) 2 Tr ( A 2 ) . (141) \mathbb{E}(v^TAv)=\frac{1}{d^2-1}\operatorname{Tr}(A),\qquad\operatorname{Var}(v^TAv)\le\frac{2}{(d^2-1)^2}\operatorname{Tr}(A^2). \tag*{(141)} E ( v T A v ) = d 2 − 1 1 Tr ( A ) , Var ( v T A v ) ≤ ( d 2 − 1 ) 2 2 Tr ( A 2 ) . (141) The same conclusions hold conditionally on any independent training record and apparatus.
Proof. Spherical and sign fourth moments — For a sphere vector, E [ v i v j v k v l ] = ( δ i j δ k l + δ i k δ j l + δ i l δ j k ) / [ ( d 2 − 1 ) ( d 2 + 1 ) ] \mathbb{E}[v_i v_j v_k v_l]=(\delta_{ij}\delta_{kl}+\delta_{ik}\delta_{jl}+\delta_{il}\delta_{jk})/[(d^2-1)(d^2+1)] E [ v i v j v k v l ] = ( δ ij δ k l + δ ik δ j l + δ i l δ j k ) / [( d 2 − 1 ) ( d 2 + 1 )] , so Var ( v T A v ) = 2 [ Tr ( A 2 ) − ( Tr ( A ) ) 2 / ( d 2 − 1 ) ] / [ ( d 2 − 1 ) ( d 2 + 1 ) ] \operatorname{Var}(v^TAv)=2[\operatorname{Tr}(A^2)-(\operatorname{Tr}(A))^2/(d^2-1)]/[(d^2-1)(d^2+1)] Var ( v T A v ) = 2 [ Tr ( A 2 ) − ( Tr ( A ) ) 2 / ( d 2 − 1 )] / [( d 2 − 1 ) ( d 2 + 1 )] . For signs, v T A v = ( d 2 − 1 ) − 1 Tr ( A ) + 2 ( d 2 − 1 ) − 1 ∑ i < j A i j ε i ε j v^TAv=(d^2-1)^{-1}\operatorname{Tr}(A)+2(d^2-1)^{-1}\sum_{i<j}A_{ij}\varepsilon_i\varepsilon_j v T A v = ( d 2 − 1 ) − 1 Tr ( A ) + 2 ( d 2 − 1 ) − 1 ∑ i < j A ij ε i ε j . Distinct unordered pairs have zero cross covariance, giving Var ( v T A v ) = 4 ( d 2 − 1 ) − 2 ∑ i < j A i j 2 ≤ 2 ( d 2 − 1 ) − 2 Tr ( A 2 ) \operatorname{Var}(v^TAv)=4(d^2-1)^{-2}\sum_{i<j}A_{ij}^2\le2(d^2-1)^{-2}\operatorname{Tr}(A^2) Var ( v T A v ) = 4 ( d 2 − 1 ) − 2 ∑ i < j A ij 2 ≤ 2 ( d 2 − 1 ) − 2 Tr ( A 2 ) . Both laws have mean Tr ( A ) / ( d 2 − 1 ) \operatorname{Tr}(A)/(d^2-1) Tr ( A ) / ( d 2 − 1 ) .
Lemma D10 (Concentration for a target on a unitary orbit). For a fixed traceless Hermitian Ω \Omega Ω with Tr ( Ω 2 ) = 1 \operatorname{Tr}(\Omega^2)=1 Tr ( Ω 2 ) = 1 , an independent Haar unitary U U U , and real symmetric A A A on the traceless operator space,
E [ v U + Ω T A v U + Ω T ] = P 0 / ( d 2 − 1 ) , Var ( v U + Ω T A v U + Ω ) ≤ K ∥ Ω ∥ o p 2 d ( d 2 − 1 ) Tr ( A 2 ) ≤ K d ( d 2 − 1 ) 2 Tr ( A 2 ) . (142) \mathbb{E}[v^T_{U+\Omega}Av^T_{U+\Omega}]=P_0/(d^2-1),\qquad\operatorname{Var}(v^T_{U+\Omega}Av_{U+\Omega})\le\frac{K\lVert\Omega\rVert_{\mathrm{op}}^2}{d(d^2-1)}\operatorname{Tr}(A^2)\le\frac{Kd}{(d^2-1)^2}\operatorname{Tr}(A^2). \tag*{(142)} E [ v U + Ω T A v U + Ω T ] = P 0 / ( d 2 − 1 ) , Var ( v U + Ω T A v U + Ω ) ≤ d ( d 2 − 1 ) K ∥ Ω ∥ op 2 Tr ( A 2 ) ≤ ( d 2 − 1 ) 2 K d Tr ( A 2 ) . (142)
Proof. Concentration on a unitary orbit — The second moment is eq. (32) . Regard A A A as a self-adjoint map on Hermitian operators. Differentiation along a unitary tangent gives a gradient bounded in squared norm by 16 ∥ Ω ∥ o p 2 ∥ A v U + Ω ∥ 2 16\lVert\Omega\rVert_{\mathrm{op}}^2\lVert Av_{U+\Omega}\rVert^2 16 ∥ Ω ∥ op 2 ∥ A v U + Ω ∥ 2 . The unitary Poincaré inequality with constant K / d K/d K / d from [41 ] , followed by the second moment, gives the first variance bound. Use ∥ Ω ∥ o p ≤ 1 \lVert\Omega\rVert_{\mathrm{op}}\le1 ∥ Ω ∥ op ≤ 1 and ( d 2 − 1 ) ≤ d 2 (d^2-1)\le d^2 ( d 2 − 1 ) ≤ d 2 for the last one.
Proposition D2 (Fixed-ridge physical costs). Assume eqs. (92) to (94) , independent multinomial records, and a random target from definition 1. For fixed η > 0 \eta>0 η > 0 ,
V N , τ ( O ) d Δ O 2 = F η , d + c O 2 d Δ O 2 ( w ^ N , τ T Σ ^ t e w ^ N , τ ) + o P ( 1 ) , τ = η / ( n o u t N ) , (143) \frac{V_{N,\tau}(\mathcal{O})}{d\Delta_{\mathcal{O}}^2}=F_{\eta,d}+\frac{c_{\mathcal{O}}^2}{d\Delta_{\mathcal{O}}^2}(\widehat{w}_{N,\tau}^{T}\widehat{\Sigma}_{t e}\widehat{w}_{N,\tau})+o_{\mathrm{P}}(1),\qquad\tau=\eta/(n_{\mathrm{out}}N), \tag*{(143)} d Δ O 2 V N , τ ( O ) = F η , d + d Δ O 2 c O 2 ( w N , τ T Σ t e w N , τ ) + o P ( 1 ) , τ = η / ( n out N ) , (143)
d ( d + 1 ) E N , τ ( O ) d Δ O 2 = G η , d + c O 2 d Δ O 2 ∥ P 0 M μ w ^ η , τ ∥ 2 + [ t η T v 0 + d ( d + 1 ) c O ( A η − 1 ) ] 2 d Δ O 2 + o P ( 1 ) . (144) \frac{d(d+1)\mathcal{E}_{N,\tau}(\mathcal{O})}{d\Delta_{\mathcal{O}}^2}
=G_{\eta,d}+\frac{c_{\mathcal{O}}^2}{d\Delta_{\mathcal{O}}^2}\lVert P_0M_\mu\widehat{w}_{\eta,\tau}\rVert^2
+\frac{\left[t_\eta^T v_0+\sqrt{d(d+1)}c_{\mathcal{O}}(A_\eta-1)\right]^2}{d\Delta_{\mathcal{O}}^2}
+o_P(1). \tag*{(144)} d Δ O 2 d ( d + 1 ) E N , τ ( O ) = G η , d + d Δ O 2 c O 2 ∥ P 0 M μ w η , τ ∥ 2 + d Δ O 2 [ t η T v 0 + d ( d + 1 ) c O ( A η − 1 ) ] 2 + o P ( 1 ) . (144)
The empirical mean is arbitrary. Its error square is retained exactly, even when it grows with dimension; the remainders concern the bounded normalized bulk contributions at fixed ridge.
Proof. Bulk correction and target concentration — By lemma D5, the physical nonconstant map is Z η = K ^ + z η r η T Z_\eta=\widehat{K}+z_\eta r_\eta^T Z η = K + z η r η T , and its constant prediction is exactly eq. (130) . The mean-size estimate lemma D6 makes Z η − K ^ Z_\eta-\widehat{K} Z η − K a bounded rank-one map at each fixed positive ridge. The ridge filter bounds K ^ \widehat{K} K , and the apparatus and categorical metrics are bounded. Expanding the quadratic traces therefore gives
1 d 2 − 1 Tr ( Z η T n o u t Σ ‾ t e Z η ) − 1 d 2 − 1 Tr ( K ^ T n o u t Σ ‾ t e K ^ ) = O P , η ( ( d 2 − 1 ) − 1 ) , \frac{1}{d^2-1}\operatorname{Tr}(Z_\eta^T n_{\mathrm{out}}\overline{\Sigma}_{t e}Z_\eta)
-\frac{1}{d^2-1}\operatorname{Tr}(\widehat{K}^T n_{\mathrm{out}}\overline{\Sigma}_{t e}\widehat{K})
=O_{P,\eta}\left((d^2-1)^{-1}\right), d 2 − 1 1 Tr ( Z η T n out Σ t e Z η ) − d 2 − 1 1 Tr ( K T n out Σ t e K ) = O P , η ( ( d 2 − 1 ) − 1 ) ,
1 d 2 − 1 ∥ M ~ μ Z η − P 0 ∥ F 2 − G ^ η , d = O P , η ( ( d 2 − 1 ) − 1 ) . (145) \frac{1}{d^2-1}\lVert\widetilde{M}_\mu Z_\eta-P_0\rVert_F^2-\widehat{G}_{\eta,d}
=O_{P,\eta}\left((d^2-1)^{-1}\right). \tag*{(145)} d 2 − 1 1 ∥ M μ Z η − P 0 ∥ F 2 − G η , d = O P , η ( ( d 2 − 1 ) − 1 ) . (145)
The fixed-ridge centered proposition identifies their limits. The target concentration lemmas transfer the normalized quadratic traces to realized costs. The identity-label readout has bounded state-dependent prediction norm by lemma D8; the target second moment makes its cross term with the independent traceless target vanish. Keeping the squared mean-prediction error exactly proves eqs. (143) and (144) . These remainder estimates hold at fixed positive ridge, with no uniformity asserted when η \eta η decreases with dimension.
One directional error can survive — For a traceless target, the normalized physical variance equals F η , d + o P ( 1 ) F_{\eta,d}+o_P(1) F η , d + o P ( 1 ) , while the ideal-test error includes one additional target projection. Normalized bulk traces average over many operator directions; this mean term probes a single direction and need not concentrate. Conditional on the record and scalar target invariants, the mean-error square averages to ∥ t η ∥ 2 / ( d 2 − 1 ) + d ( d + 1 ) c O 2 ( A η − 1 ) 2 / ( d Δ O 2 ) \lVert t_\eta\rVert^2/(d^2-1)+d(d+1)c_{\mathcal{O}}^2(A_\eta-1)^2/(d\Delta_{\mathcal{O}}^2) ∥ t η ∥ 2 / ( d 2 − 1 ) + d ( d + 1 ) c O 2 ( A η − 1 ) 2 / ( d Δ O 2 ) . For a spherical traceless target, the extra square has distribution ( ∥ t η ∥ 2 / ( d 2 − 1 ) ) Z d 2 − 1 2 (\lVert t_\eta\rVert^2/(d^2-1))Z_{d^2-1}^2 (∥ t η ∥ 2 / ( d 2 − 1 )) Z d 2 − 1 2 , where Z d 2 − 1 Z_{d^2-1} Z d 2 − 1 is d 2 − 1 \sqrt{d^2-1} d 2 − 1 times a coordinate of a uniform unit sphere and tends to a standard normal variable. If ∥ t η ∥ 2 / ( d 2 − 1 ) → P σ η 2 \lVert t_\eta\rVert^2/(d^2-1)\xrightarrow{\mathbb{P}} \sigma_\eta^2 ∥ t η ∥ 2 / ( d 2 − 1 ) P σ η 2 and G η , d → G η G_{\eta,d}\to G_\eta G η , d → G η have finite deterministic limits, the ideal-test cost converges in distribution to G η + σ η 2 χ 1 2 G_\eta+\sigma_\eta^2\chi_1^2 G η + σ η 2 χ 1 2 ; its target average and median generally differ. The other direction laws share the second moment but need not share the projection distribution.
When the mean term vanishes — For pure training states with a bounded, noncollapsed frame, lemma D7 gives ∥ ρ ‾ ∥ o p = O ( d − 1 ) \lVert\overline{\rho}\rVert_{\mathrm{op}}=O(d^{-1}) ∥ ρ ∥ op = O ( d − 1 ) , and eq. (136) makes the traceless-target mean term vanish at fixed positive ridge. Mixed-state lists can retain it. A deterministic full profile therefore requires limits of the explicit mean terms as well as of the centered traces; replacing the measured mean terms by spectral integrals would require additional directional inverse control.
Interpolation mechanisms and peaks
As in the main text, the interpolation ratio is γ = lim n o u t / n t r \gamma=\lim n_{\mathrm{out}}/n_{\mathrm{tr}} γ = lim n out / n tr , the shot ratio is α = lim N / [ d ( d + 1 ) ] \alpha=\lim N/[d(d+1)] α = lim N / [ d ( d + 1 )] , and the scaled ridge is η = n o u t N τ \eta=n_{\mathrm{out}}N\tau η = n out N τ . Interpolation at γ = 1 \gamma=1 γ = 1 has two origins of weak training features. Above the outcome-count threshold, shot noise fills exact Born null modes and creates the quantum peak of section IV B; below it, a nearly square exact training matrix can amplify the inaccessible part of the target, as in § 3.2 . The fixed-ridge equations of Appendix § 5.14 connect both mechanisms to the same rounded denominator, under different conditions for its existence. Section E1 gives the universal peak above the threshold, section E2 evaluates its geometry-dependent coefficients, and section E3 states the additional spectral criterion below it.
For κ < 1 \kappa<1 κ < 1 , exact centered probabilities span at most d 2 − 1 d^2-1 d 2 − 1 of the n o u t − 1 n_{\mathrm{out}}-1 n out − 1 nonconstant outcome directions, while shot noise acts on all of them. The signal-free directions guarantee the positive critical solution behind the quantum peak in section IV B. When the exact Born matrix has rank d 2 d^2 d 2 , projecting away its row and column spaces leaves a shot-noise block of size ( n o u t − d 2 ) × ( n t r − d 2 ) (n_{\mathrm{out}}-d^2)\times(n_{\mathrm{tr}}-d^2) ( n out − d 2 ) × ( n tr − d 2 ) . Its becoming square at n o u t = n t r n_{\mathrm{out}}=n_{\mathrm{tr}} n out = n tr explains the small measured singular values in the mechanism of section IV A, whose exact block algebra is given in proposition E1; the theorems below establish the peak through the critical equations, without assuming a Gaussian smallest-singular-value law for the counts. Section E1a determines the ridge-rounded profile and its coefficients; section E1b proves divergence of the actual minimum-norm variance and states the extra inverse-tail condition needed away from interpolation.
Proposition E1 (Block form of the interpolating weights). Let the POVM be informationally complete and the training states span the operator space, so that rank P = d 2 \operatorname{rank} P = d^{2} rank P = d 2 , and let U 1 , U 2 , V 1 , V 2 U_{1}, U_{2}, V_{1}, V_{2} U 1 , U 2 , V 1 , V 2 and the blocks P 11 P_{11} P 11 , Ξ ^ k l \hat{\Xi}_{kl} Ξ ^ k l be those of eq. (15) . Suppose n o u t = n t r n_{\mathrm{out}} = n_{\mathrm{tr}} n out = n tr and that P ^ N \hat{P}_{N} P ^ N and Ξ ^ 22 \hat{\Xi}_{22} Ξ ^ 22 are invertible. Then the least-squares weights interpolate, P ^ N T w ^ N = y \hat{P}_{N}^{T}\hat{w}_{N} = y P ^ N T w ^ N = y , and their components w ^ k = U k T w ^ N \hat{w}_{k} = U_{k}^{T}\hat{w}_{N} w ^ k = U k T w ^ N satisfy eq. (16) and
[ P 11 + N − 1 2 ( Ξ ^ 11 − Ξ ^ 12 Ξ ^ 22 − 1 Ξ ^ 21 ) ] T w ^ 1 = V 1 T y , (146) \left[P_{11} + N^{-\frac{1}{2}}\left(\hat{\Xi}_{11} - \hat{\Xi}_{12}\hat{\Xi}_{22}^{-1}\hat{\Xi}_{21}\right)\right]^{T}\hat{w}_{1} = V_{1}^{T}y, \tag*{(146)} [ P 11 + N − 2 1 ( Ξ ^ 11 − Ξ ^ 12 Ξ ^ 22 − 1 Ξ ^ 21 ) ] T w ^ 1 = V 1 T y , (146) whereas the exact coefficients satisfy P 11 T U 1 T w e x = V 1 T y P_{11}^{T}U_{1}^{T}w_{\mathrm{ex}} = V_{1}^{T}y P 11 T U 1 T w ex = V 1 T y . The reconstructed observable depends only on w ^ 1 \hat{w}_{1} w ^ 1 , O ~ N = ∑ a ( U 1 w ^ 1 ) a μ a \widetilde{O}_{N} = \sum_{a}(U_{1}\hat{w}_{1})_{a}\mu_{a} O N = ∑ a ( U 1 w ^ 1 ) a μ a , whereas the test variance V N ( σ , O ) = w ^ N T Σ σ w ^ N V_{N}(\sigma,O) = \hat{w}_{N}^{T}\Sigma_{\sigma}\hat{w}_{N} V N ( σ , O ) = w ^ N T Σ σ w ^ N depends on both components.
Proof. Since P ^ N \hat{P}_{N} P ^ N is square and invertible, P ^ N T w = y \hat{P}_{N}^{T}w = y P ^ N T w = y has a unique solution, which is the least-squares minimizer. Let B B B denote the block matrix on the right side of eq. (15) . Multiplying the interpolation conditions by [ V 1 V 2 ] T [V_{1}\ V_{2}]^{T} [ V 1 V 2 ] T and inserting [ U 1 U 2 ] [ U 1 U 2 ] T = I n o u t [U_{1}\ U_{2}][U_{1}\ U_{2}]^{T} = I_{n_{\mathrm{out}}} [ U 1 U 2 ] [ U 1 U 2 ] T = I n out gives B T ( w ^ 1 ; w ^ 2 ) = ( V 1 T y ; V 2 T y ) B^{T}(\hat{w}_{1};\hat{w}_{2}) = (V_{1}^{T}y;V_{2}^{T}y) B T ( w ^ 1 ; w ^ 2 ) = ( V 1 T y ; V 2 T y ) . The columns of V 2 V_{2} V 2 span ker P = ker ( M μ T M ρ ) \ker P = \ker(M_{\mu}^{T}M_{\rho}) ker P = ker ( M μ T M ρ ) ; because the POVM is informationally complete, M μ T M_{\mu}^{T} M μ T is injective, so M ρ V 2 = 0 M_{\rho}V_{2} = 0 M ρ V 2 = 0 and V 2 T y = ( M ρ V 2 ) T v O = 0 V_{2}^{T}y = (M_{\rho}V_{2})^{T}v_{O} = 0 V 2 T y = ( M ρ V 2 ) T v O = 0 . The second block row then reads N − 1 / 2 ( Ξ ^ 12 T w ^ 1 + Ξ ^ 22 T w ^ 2 ) = 0 N^{-1/2}(\hat{\Xi}_{12}^{T}\hat{w}_{1} + \hat{\Xi}_{22}^{T}\hat{w}_{2}) = 0 N − 1/2 ( Ξ ^ 12 T w ^ 1 + Ξ ^ 22 T w ^ 2 ) = 0 , which is eq. (16) . Substituting it into the first block row, ( P 11 + N − 1 / 2 Ξ ^ 11 ) T w ^ 1 + N − 1 / 2 Ξ ^ 21 T w ^ 2 = V 1 T y (P_{11} + N^{-1/2}\hat{\Xi}_{11})^{T}\hat{w}_{1} + N^{-1/2}\hat{\Xi}_{21}^{T}\hat{w}_{2} = V_{1}^{T}y ( P 11 + N − 1/2 Ξ ^ 11 ) T w ^ 1 + N − 1/2 Ξ ^ 21 T w ^ 2 = V 1 T y , gives eq. (146) . The exact coefficients obey P T w e x = M ρ T M μ w e x = M ρ T v O = y P^{T}w_{\mathrm{ex}} = M_{\rho}^{T}M_{\mu}w_{\mathrm{ex}} = M_{\rho}^{T}v_{O} = y P T w ex = M ρ T M μ w ex = M ρ T v O = y ; multiplying by V 1 T V_{1}^{T} V 1 T and using P T U 2 = 0 P^{T}U_{2} = 0 P T U 2 = 0 gives P 11 T U 1 T w e x = V 1 T y P_{11}^{T}U_{1}^{T}w_{\mathrm{ex}} = V_{1}^{T}y P 11 T U 1 T w ex = V 1 T y . Finally, the columns of U 2 U_{2} U 2 span ker P T = ker ( M ρ T M μ ) \ker P^{T} = \ker(M_{\rho}^{T}M_{\mu}) ker P T = ker ( M ρ T M μ ) , and M ρ T M_{\rho}^{T} M ρ T is injective because the training states span the operator space; hence M μ U 2 = 0 M_{\mu}U_{2} = 0 M μ U 2 = 0 , i.e., ∑ a ( U 2 w ^ 2 ) a μ a = 0 \sum_{a}(U_{2}\hat{w}_{2})_{a}\mu_{a} = 0 ∑ a ( U 2 w ^ 2 ) a μ a = 0 .
Critical coefficients and universal profile
After the dimensional limit, each centered cost with positive amplitude grows as 1 / ∣ γ − 1 ∣ 1/|\gamma- 1| 1/∣ γ − 1∣ near interpolation. Positive ridge rounds this divergence over a width of order η \sqrt{\eta} η , with height of order η − 1 / 2 \eta^{-1/2} η − 1/2 . Theorem E1 states that profile under the empirical bounds and critical trace regularity. The coefficients depend on how much signal remains unresolved when the fitted noise strength and inverse covariance are determined together. The trace-regularity assumption requires the spectral averages and penalty responses used below to have compatible limits near interpolation; the fixed-ridge comparison alone does not ensure this. The definitions below separate training, apparatus, and shot-noise contributions.
Critical inverse and signal spectrum — At interpolation, define the inverse on 1 n o u t ⊥ 1_{n_{\mathrm{out}}}^{\perp} 1 n out ⊥ by
R ⋆ ≡ [ ζ ⋆ n o u t Σ ‾ t r + S ] − 1 , 1 n o u t − 1 Tr ( n o u t Σ ‾ t r R ⋆ ) = 1. (147) \mathcal{R}_{\star} \equiv[\zeta_{\star}n_{\mathrm{out}}\overline{\Sigma}_{\mathrm{tr}} + S]^{-1}, \qquad\frac{1}{n_{\mathrm{out}}-1}\operatorname{Tr}(n_{\mathrm{out}}\overline{\Sigma}_{\mathrm{tr}}\mathcal{R}_{\star}) = 1. \tag*{(147)} R ⋆ ≡ [ ζ ⋆ n out Σ tr + S ] − 1 , n out − 1 1 Tr ( n out Σ tr R ⋆ ) = 1. (147)
To determine ζ ⋆ \zeta_{\star} ζ ⋆ in eq. (147) , let λ 1 , … , λ n o u t − 1 \lambda_{1},\ldots,\lambda_{n_{\mathrm{out}}-1} λ 1 , … , λ n out − 1 include all eigenvalues of
( n o u t Σ ‾ t r ) − 1 / 2 S ( n o u t Σ ‾ t r ) − 1 / 2 on 1 n o u t ⊥ . (148) (n_{\mathrm{out}}\overline{\Sigma}_{\mathrm{tr}})^{-1/2}S(n_{\mathrm{out}}\overline{\Sigma}_{\mathrm{tr}})^{-1/2}\quad\text{on }1_{n_{\mathrm{out}}}^{\perp}. \tag*{(148)} ( n out Σ tr ) − 1/2 S ( n out Σ tr ) − 1/2 on 1 n out ⊥ . (148)
The positive spectrum also equals that of the training Gram matrix
N n t r Π n t r P T Σ ‾ t r + P Π n t r . (149) \frac{N}{n_{\mathrm{tr}}}\Pi_{n_{\mathrm{tr}}}P^{T}\overline{\Sigma}_{\mathrm{tr}}^{+}P\Pi_{n_{\mathrm{tr}}}. \tag*{(149)} n tr N Π n tr P T Σ tr + P Π n tr . (149)
Both matrices are Gram products of N / n t r ( Σ ‾ t r + ) 1 / 2 Π n t r \sqrt{N/n_{\mathrm{tr}}}(\overline{\Sigma}_{\mathrm{tr}}^{+})^{1/2}\Pi_{n_{\mathrm{tr}}} N / n tr ( Σ tr + ) 1/2 Π n tr . At n o u t = n t r n_{\mathrm{out}} = n_{\mathrm{tr}} n out = n tr , their restrictions to 1 n o u t ⊥ 1_{n_{\mathrm{out}}}^{\perp} 1 n out ⊥ and 1 n t r ⊥ 1_{n_{\mathrm{tr}}}^{\perp} 1 n tr ⊥ have equal dimension, so zero multiplicities agree as well; away from interpolation they must be counted separately.
Signal-to-noise eigenvalues — The whitening compares between-state signal with within-state noise. Indeed,
1 n t r Π Π n t r P T = Σ ( p ˉ ) − Σ ‾ t r , (150) \frac{1}{n_{\mathrm{tr}}}\Pi\Pi_{n_{\mathrm{tr}}}P^{T} = \Sigma(\bar{p}) - \overline{\Sigma}_{\mathrm{tr}}, \tag*{(150)} n tr 1 Π Π n tr P T = Σ ( p ˉ ) − Σ tr , (150)
and the λ j \lambda_j λ j are the stationary values over nonzero w ∈ 1 n o u t ⊥ \boldsymbol{w} \in\mathbf{1}_{n_{\mathrm{out}}}^{\perp} w ∈ 1 n out ⊥ of
N n t r − 1 ∑ i [ w T ( p i − p ˉ ) ] 2 n t r − 1 ∑ i [ ∑ a p a i w a 2 − ( ∑ a p a i w a ) 2 ] . (151) \frac{N n_{\mathrm{tr}}^{-1}\sum_i[\boldsymbol{w}^{T}(\boldsymbol{p}_i-\bar{\boldsymbol{p}})]^2}{n_{\mathrm{tr}}^{-1}\sum_i[\sum_a p_{ai}w_a^2-(\sum_a p_{ai}w_a)^2]}. \tag*{(151)} n tr − 1 ∑ i [ ∑ a p ai w a 2 − ( ∑ a p ai w a ) 2 ] N n tr − 1 ∑ i [ w T ( p i − p ˉ ) ] 2 . (151)
The numerator is the variance of exact predictions across training states; the denominator is their mean single-shot variance. The factor N N N converts the ratio to the signal-to-noise ratio of an N N N -shot record. When n o u t Σ ˉ t r → Π n o u t n_{\mathrm{out}}\bar{\Sigma}_{\mathrm{tr}}\to\Pi_{n_{\mathrm{out}}} n out Σ ˉ tr → Π n out in operator norm, the eigenvalues approach those of ( n o u t N / n t r ) Π n t r P T Π n t r P Π n t r (n_{\mathrm{out}}N/n_{\mathrm{tr}})\Pi_{n_{\mathrm{tr}}}P^{T}\Pi_{n_{\mathrm{tr}}}P\Pi_{n_{\mathrm{tr}}} ( n out N / n tr ) Π n tr P T Π n tr P Π n tr , apart from zero multiplicities.
Existence from signal-free directions — The critical equation becomes
1 n o u t − 1 ∑ j = 1 n o u t − 1 1 ζ ∗ + λ j = 1 , 1 − κ d ≤ ζ ∗ ≤ 1. (152) \frac{1}{n_{\mathrm{out}}-1}\sum_{j=1}^{n_{\mathrm{out}}-1}\frac{1}{\zeta_*+\lambda_j}=1,\qquad1-\kappa_d\le\zeta_*\le1. \tag*{(152)} n out − 1 1 j = 1 ∑ n out − 1 ζ ∗ + λ j 1 = 1 , 1 − κ d ≤ ζ ∗ ≤ 1. (152)
The left-hand side decreases strictly, is at most one at ζ = 1 \zeta=1 ζ = 1 , and is at least one at ζ = 1 − κ d \zeta=1-\kappa_d ζ = 1 − κ d because at least n o u t − d 2 n_{\mathrm{out}}-d^2 n out − d 2 eigenvalues vanish. Hence the positive root is unique and bounded away from zero for κ < 1 \kappa<1 κ < 1 . Below completeness, existence requires a separate spectral condition.
Residual signal and peak amplitudes — The residual signal at this effective noise scale is
H ∗ ≡ 1 d 2 − 1 min W { ∥ ( P 0 − W M ~ μ T ) ( F ρ c ) 1 / 2 ∥ F 2 + ζ ∗ Tr ( W ( n o u t Σ ˉ t r ) W T ) } . (153) \mathcal{H}_*\equiv\frac{1}{d^2-1}\min_W\left\{\left\|(P_0-W\widetilde{M}_{\mu}^{T})(\mathcal{F}_{\rho}^{c})^{1/2}\right\|_{F}^{2}+\zeta_*\operatorname{Tr}\left(W(n_{\mathrm{out}}\bar{\Sigma}_{\mathrm{tr}})W^{T}\right)\right\}. \tag*{(153)} H ∗ ≡ d 2 − 1 1 W min { ( P 0 − W M μ T ) ( F ρ c ) 1/2 F 2 + ζ ∗ Tr ( W ( n out Σ ˉ tr ) W T ) } . (153)
Here W W W estimates centered operator coordinates from the rescaled outcome coordinates. The first term is its training-frame-weighted reconstruction error; the second is its variance for outcome-noise covariance ζ ∗ n o u t Σ ˉ t r \zeta_*n_{\mathrm{out}}\bar{\Sigma}_{\mathrm{tr}} ζ ∗ n out Σ ˉ tr . Completing the square gives W ∗ = F ρ c M ~ μ R ∗ W_*=\mathcal{F}_{\rho}^{c}\widetilde{M}_{\mu}\mathcal{R}_* W ∗ = F ρ c M μ R ∗ and
H ∗ = 1 d 2 − 1 Tr ( F ρ c − F ρ c M ~ μ R ∗ M ~ μ T F ρ c ) , \mathcal{H}_*=\frac{1}{d^2-1}\operatorname{Tr}\left(\mathcal{F}_{\rho}^{c}-\mathcal{F}_{\rho}^{c}\widetilde{M}_{\mu}\mathcal{R}_*\widetilde{M}_{\mu}^{T}\mathcal{F}_{\rho}^{c}\right), H ∗ = d 2 − 1 1 Tr ( F ρ c − F ρ c M μ R ∗ M μ T F ρ c ) ,
C V = H ∗ n o u t − 1 Tr ( n o u t Σ ˉ t e R ∗ ) , C_V=\frac{\mathcal{H}_*}{n_{\mathrm{out}}-1}\operatorname{Tr}\left(n_{\mathrm{out}}\bar{\Sigma}_{\mathrm{te}}\mathcal{R}_*\right), C V = n out − 1 H ∗ Tr ( n out Σ ˉ te R ∗ ) ,
C G = H ∗ n o u t − 1 Tr ( M ~ μ T M ~ μ R ∗ ) . (154) C_G=\frac{\mathcal{H}_*}{n_{\mathrm{out}}-1}\operatorname{Tr}\left(\widetilde{M}_{\mu}^{T}\widetilde{M}_{\mu}\mathcal{R}_*\right). \tag*{(154)} C G = n out − 1 H ∗ Tr ( M μ T M μ R ∗ ) . (154)
The coefficients in eq. (154) share the unresolved-signal factor 0 ≤ H ∗ ≤ ( d 2 − 1 ) − 1 Tr ( F ρ c ) 0\le\mathcal{H}_*\le(d^2-1)^{-1}\operatorname{Tr}(\mathcal{F}_{\rho}^{c}) 0 ≤ H ∗ ≤ ( d 2 − 1 ) − 1 Tr ( F ρ c ) . The two traces weight that residual by test-shot noise and the traceless POVM response. Under eq. (95) , C V > 0 C_V>0 C V > 0 ; C G > 0 C_G>0 C G > 0 additionally requires a positive limiting average scaled measurement-frame eigenvalue. The ridge width is
h ≡ ζ ∗ n o u t − 1 Tr ( R ∗ ) . (155) h\equiv\frac{\zeta_*}{n_{\mathrm{out}}-1}\operatorname{Tr}(\mathcal{R}_*). \tag*{(155)} h ≡ n out − 1 ζ ∗ Tr ( R ∗ ) . (155)
Flat noise n o u t Σ ˉ t r = Π n o u t n_{\mathrm{out}}\bar{\Sigma}_{\mathrm{tr}}=\Pi_{n_{\mathrm{out}}} n out Σ ˉ tr = Π n out gives h = ζ ∗ h=\zeta_* h = ζ ∗ ; the covariance bounds give ( 1 − κ ) / K ≤ h ≤ 1 / c (1-\kappa)/K\le h\le1/c ( 1 − κ ) / K ≤ h ≤ 1/ c in the limit.
Remark E1 (Trace regularity for the critical expansion). The rounded-profile statements assume limits, at each fixed η > 0 \eta>0 η > 0 , of the normalized traces in eqs. (107) to (109) and the mixed trace ( d 2 − 1 ) − 1 Tr ( F ρ c M ~ μ R M ~ μ T ) (d^2-1)^{-1}\operatorname{Tr}(\mathcal{F}_{\rho}^{c}\widetilde{M}_{\mu}\mathcal{R}\widetilde{M}_{\mu}^{T}) ( d 2 − 1 ) − 1 Tr ( F ρ c M μ R M μ T ) , including first derivatives in the two penalty directions n o u t Σ ˉ t e n_{\mathrm{out}}\bar{\Sigma}_{\mathrm{te}} n out Σ ˉ te and M ~ μ T M ~ μ \widetilde{M}_{\mu}^{T}\widetilde{M}_{\mu} M μ T M μ . They also require local convergence, including first penalty derivatives, of the corresponding weighted normalized traces of [ u I n o u t − 1 + v n o u t Σ ˉ t r + w W + S ] − 1 [uI_{n_{\mathrm{out}}-1}+vn_{\mathrm{out}}\bar{\Sigma}_{\mathrm{tr}}+wW+S]^{-1} [ u I n out − 1 + v n out Σ ˉ tr + w W + S ] − 1 near ( u , v , w ) = ( 0 , ζ ∗ , 0 ) (u,v,w)=(0,\zeta_*,0) ( u , v , w ) = ( 0 , ζ ∗ , 0 ) , with limits continuous as γ → 1 \gamma\to1 γ → 1 . Here u , v , w u,v,w u , v , w are scalar arguments and W W W is either of the two penalty metrics above. Mere existence of fixed-ridge limits does not supply this additional critical regularity. The mechanisms guaranteeing a positive critical root are stated separately.
Theorem E1 (Quantum peak and ridge rounding). Assume eqs. (92) to (95) with κ < 1 \kappa<1 κ < 1 . Assume the critical trace regularity of remark E1. After the proportional limit at each fixed η > 0 \eta>0 η > 0 , the joint limit ( γ , η ) → ( 1 , 0 ) (\gamma,\eta)\to(1,0) ( γ , η ) → ( 1 , 0 ) gives
F η ( γ ) ∼ C V ( γ − 1 ) 2 + 4 h η , G η ( γ ) ∼ C G ( γ − 1 ) 2 + 4 h η if C G > 0 , (156) F_{\eta}(\gamma)\sim\frac{C_V}{\sqrt{(\gamma-1)^2+4h\eta}},\qquad G_{\eta}(\gamma)\sim\frac{C_G}{\sqrt{(\gamma-1)^2+4h\eta}}\quad\text{if }C_G>0, \tag*{(156)} F η ( γ ) ∼ ( γ − 1 ) 2 + 4 h η C V , G η ( γ ) ∼ ( γ − 1 ) 2 + 4 h η C G if C G > 0 , (156) with coefficients evaluated at interpolation.
Proof. Critical scalar balances — The rescaling below separates a vanishing scalar e = 1 / a e = 1/a e = 1/ a from a finite inverse R ♯ \mathcal{R}^{\sharp} R ♯ . The loss becomes L = e H \mathcal{L} = e\mathcal{H} L = e H ; its singular penalty response is isolated in the derivative of e e e . Work with the deterministic equations from proposition D1, and take the local limits of their normalized traces, assumed continuous in γ \gamma γ at one. The signal matrix S S S is defined in eq. (88) . Let e = 1 / a e = 1/a e = 1/ a , u = η / e u = \eta/e u = η / e , v = a b v = ab v = ab and w = z / e w = z/e w = z / e , and write
R ♯ ≡ [ u I n o u t − 1 + v n o u t Σ ‾ t r + w W + S ] − 1 , \mathcal{R}^{\sharp} \equiv\left[uI_{n_{\mathrm{out}}-1}+v n_{\mathrm{out}}\overline{\Sigma}_{\mathrm{tr}}+wW+S\right]^{-1}, R ♯ ≡ [ u I n out − 1 + v n out Σ tr + w W + S ] − 1 ,
f ≡ 1 n o u t − 1 Tr ( n o u t Σ ‾ t r R ♯ ) , j ≡ 1 n o u t − 1 Tr ( R ♯ ) , k ≡ 1 n o u t − 1 Tr ( W R ♯ ) . (157) f \equiv\frac{1}{n_{\mathrm{out}}-1}\operatorname{Tr}(n_{\mathrm{out}}\overline{\Sigma}_{\mathrm{tr}}\mathcal{R}^{\sharp}),\qquad
j \equiv\frac{1}{n_{\mathrm{out}}-1}\operatorname{Tr}(\mathcal{R}^{\sharp}),\qquad
k \equiv\frac{1}{n_{\mathrm{out}}-1}\operatorname{Tr}(W\mathcal{R}^{\sharp}). \tag*{(157)} f ≡ n out − 1 1 Tr ( n out Σ tr R ♯ ) , j ≡ n out − 1 1 Tr ( R ♯ ) , k ≡ n out − 1 1 Tr ( W R ♯ ) . (157)
Multiplying the first equation of eq. (107) by e = 1 / a e = 1/a e = 1/ a , and using the trace identity b = 1 − γ + Tr ( ( η I n o u t − 1 + z W ) R ) / n t r b = 1-\gamma+\operatorname{Tr}((\eta I_{n_{\mathrm{out}}-1}+zW)R)/n_{\mathrm{tr}} b = 1 − γ + Tr (( η I n out − 1 + z W ) R ) / n tr proved in eq. (119) , yields the following equivalent , rather than additional, scalar equations:
1 − e = γ f , 1-e=\gamma f, 1 − e = γ f ,
v e 2 = ( 1 − γ ) e + η γ j + z γ k , ve^{2}=(1-\gamma)e+\eta\gamma j+z\gamma k, v e 2 = ( 1 − γ ) e + η γ j + z γ k ,
L = e H , H = 1 d 2 − 1 Tr ( F ρ c − F ρ c M ~ μ R ♯ M ~ μ T F ρ c ) . (158) \mathcal{L}=e\mathcal{H},\qquad
\mathcal{H}=\frac{1}{d^{2}-1}\operatorname{Tr}\left(\mathcal{F}_{\rho}^{c}-\mathcal{F}_{\rho}^{c}\widetilde{M}_{\mu}\mathcal{R}^{\sharp}\widetilde{M}_{\mu}^{\mathsf{T}}\mathcal{F}_{\rho}^{c}\right). \tag*{(158)} L = e H , H = d 2 − 1 1 Tr ( F ρ c − F ρ c M μ R ♯ M μ T F ρ c ) . (158)
Positive critical root — We first identify the critical values of e , u , v e,u,v e , u , v . The trace identity above implies 0 < v = 1 − Tr ( S R ♯ ) / n t r ≤ 1 0<v=1-\operatorname{Tr}(S\mathcal{R}^{\sharp})/n_{\mathrm{tr}}\leq1 0 < v = 1 − Tr ( S R ♯ ) / n tr ≤ 1 . Because rank S ≤ d 2 − 1 \operatorname{rank}S\leq d^{2}-1 rank S ≤ d 2 − 1 and ( d 2 − 1 ) / ( n o u t − 1 ) → κ < 1 (d^{2}-1)/(n_{\mathrm{out}}-1)\to\kappa<1 ( d 2 − 1 ) / ( n out − 1 ) → κ < 1 , ker S \ker S ker S has dimension at least ( 1 − κ + o ( 1 ) ) ( n o u t − 1 ) (1-\kappa+o(1))(n_{\mathrm{out}}-1) ( 1 − κ + o ( 1 )) ( n out − 1 ) . For n o u t Σ ‾ t r ⪰ c I n o u t − 1 n_{\mathrm{out}}\overline{\Sigma}_{\mathrm{tr}}\succeq cI_{n_{\mathrm{out}}-1} n out Σ tr ⪰ c I n out − 1 and n o u t Σ ‾ t r ⪯ K I n o u t − 1 n_{\mathrm{out}}\overline{\Sigma}_{\mathrm{tr}}\preceq KI_{n_{\mathrm{out}}-1} n out Σ tr ⪯ K I n out − 1 , the inverse restricted to this kernel obeys the lower trace bound below. Indeed, if P P P projects onto ker S \ker S ker S , the Schur-complement inequality gives P R ♯ P ⪰ [ P ( u I n o u t − 1 + v n o u t Σ ‾ t r ) P ] − 1 P\mathcal{R}^{\sharp}P\succeq[P(uI_{n_{\mathrm{out}}-1}+vn_{\mathrm{out}}\overline{\Sigma}_{\mathrm{tr}})P]^{-1} P R ♯ P ⪰ [ P ( u I n out − 1 + v n out Σ tr ) P ] − 1 on im P \operatorname{im}P im P . Using n o u t Σ ‾ t r ⪰ c I n o u t − 1 n_{\mathrm{out}}\overline{\Sigma}_{\mathrm{tr}}\succeq cI_{n_{\mathrm{out}}-1} n out Σ tr ⪰ c I n out − 1 and n o u t Σ ‾ t r ⪯ K I n o u t − 1 n_{\mathrm{out}}\overline{\Sigma}_{\mathrm{tr}}\preceq KI_{n_{\mathrm{out}}-1} n out Σ tr ⪯ K I n out − 1 then yields
f = 1 n o u t − 1 Tr ( n o u t Σ ‾ t r R ♯ ) ≥ c ( 1 − κ + o ( 1 ) ) u + K v . (159) f=\frac{1}{n_{\mathrm{out}}-1}\operatorname{Tr}(n_{\mathrm{out}}\overline{\Sigma}_{\mathrm{tr}}\mathcal{R}^{\sharp})\geq\frac{c(1-\kappa+o(1))}{u+Kv}. \tag*{(159)} f = n out − 1 1 Tr ( n out Σ tr R ♯ ) ≥ u + K v c ( 1 − κ + o ( 1 )) . (159)
Suppose e e e were bounded below along a sequence with ( γ , η ) → ( 1 , 0 ) (\gamma,\eta)\to(1,0) ( γ , η ) → ( 1 , 0 ) . Then u = η / e → 0 u=\eta/e\to0 u = η / e → 0 , while the second equation of eq. (158) forces v → 0 v\to0 v → 0 . The displayed lower bound would give f → ∞ f\to\infty f → ∞ , contrary to 1 − e = γ f ≤ 1 1-e=\gamma f\leq1 1 − e = γ f ≤ 1 . Hence e → 0 e\to0 e → 0 . At z = 0 z=0 z = 0 , division of the second scalar equation by e e e gives v e = 1 − γ + γ u j ve=1-\gamma+\gamma uj v e = 1 − γ + γ u j , so u j → 0 uj\to0 u j → 0 . Since S S S is bounded and v ≤ 1 v\leq1 v ≤ 1 , u j ≥ u / ( u + K ′ ) uj\geq u/(u+K') u j ≥ u / ( u + K ′ ) for a fixed K ′ K' K ′ ; consequently u → 0 u\to0 u → 0 . The same lower bound for f f f now prevents v → 0 v\to0 v → 0 . Any limit point v ∗ v_{\ast} v ∗ therefore lies in ( 0 , 1 ] (0,1] ( 0 , 1 ] and satisfies the critical normalization eq. (147) with v ∗ v_{\ast} v ∗ in place of ζ ∗ \zeta_{\ast} ζ ∗ . After whitening n o u t Σ ‾ t r n_{\mathrm{out}}\overline{\Sigma}_{\mathrm{tr}} n out Σ tr , the left side is strictly decreasing in v ∗ v_{\ast} v ∗ ; the nullity of S S S and its nonnegativity give a unique solution v ∗ = ζ ∗ ∈ [ 1 − κ , 1 ] v_{\ast}=\zeta_{\ast}\in[1-\kappa,1] v ∗ = ζ ∗ ∈ [ 1 − κ , 1 ] . This proves eqs. (147) and (152) . For bounded positive W W W , the derivatives of the normalized inverse traces with respect to u , v , w u,v,w u , v , w are uniformly bounded near this point. In particular ∂ v f = − ( n o u t − 1 ) − 1 Tr ( n o u t Σ ‾ t r R ♯ n o u t Σ ‾ t r R ♯ ) \partial_v f=-(n_{\mathrm{out}}-1)^{-1}\operatorname{Tr}(n_{\mathrm{out}}\overline{\Sigma}_{\mathrm{tr}}\mathcal{R}^{\sharp}n_{\mathrm{out}}\overline{\Sigma}_{\mathrm{tr}}\mathcal{R}^{\sharp}) ∂ v f = − ( n out − 1 ) − 1 Tr ( n out Σ tr R ♯ n out Σ tr R ♯ ) is bounded away from zero in absolute value, because n o u t Σ ‾ t r ⪰ c I n o u t − 1 n_{\mathrm{out}}\overline{\Sigma}_{\mathrm{tr}}\succeq cI_{n_{\mathrm{out}}-1} n out Σ tr ⪰ c I n out − 1 and R ♯ \mathcal{R}^{\sharp} R ♯ has uniformly bounded spectrum above and a positive normalized trace below.
Singular penalty response — The partial resolvent derivatives with respect to u , v , w u,v,w u , v , w remain bounded, but the envelope formula contains the potentially singular factor e z e_z e z . Set δ = γ − 1 \delta=\gamma-1 δ = γ − 1 and Δ = δ 2 + 4 η γ j \Delta=\sqrt{\delta^{2}+4\eta\gamma j} Δ = δ 2 + 4 η γ j , at z = 0 z=0 z = 0 . The scalar equation gives exactly
e = Δ − δ 2 v , u = Δ + δ 2 γ j , 2 v e + δ = Δ . (160) e=\frac{\Delta-\delta}{2v},\qquad
u=\frac{\Delta+\delta}{2\gamma j},\qquad
2ve+\delta=\Delta. \tag*{(160)} e = 2 v Δ − δ , u = 2 γ j Δ + δ , 2 v e + δ = Δ. (160)
so e + u = O ( Δ ) e+u=O(\Delta) e + u = O ( Δ ) . The identity v e 2 + δ e − η γ j − z γ k = 0 ve^{2}+\delta e-\eta\gamma j-z\gamma k=0 v e 2 + δ e − η γ j − z γ k = 0 shows explicitly why a quadratic discriminant appears. Differentiate it and 1 − e = γ f 1-e=\gamma f 1 − e = γ f with respect to z z z , keeping u = η / e u=\eta/e u = η / e and w = z / e w=z/e w = z / e dependent on z z z . Differentiating 1 − e = γ f 1-e=\gamma f 1 − e = γ f gives ∣ e z ∣ ≤ K [ ( 1 + η / e 2 ) ∣ e z ∣ + e − 1 ] |e_z|\leq K[(1+\eta/e^{2})|e_z|+e^{-1}] ∣ e z ∣ ≤ K [( 1 + η / e 2 ) ∣ e z ∣ + e − 1 ] . The second gives Δ e z = γ k + O ( Δ ) + O ( Δ 2 ∣ e z ∣ ) \Delta e_z=\gamma k+O(\Delta)+O(\Delta^{2}|e_z|) Δ e z = γ k + O ( Δ ) + O ( Δ 2 ∣ e z ∣ ) ; hence ( e 2 + η ) ( 1 + η / e 2 ) = ( e + u ) 2 (e^{2}+\eta)(1+\eta/e^{2})=(e+u)^{2} ( e 2 + η ) ( 1 + η / e 2 ) = ( e + u ) 2 controls the derivative errors. Consequently
e z = γ k Δ + O ( 1 ) , e H z = O ( 1 ) , ∂ z L = H γ k Δ + O ( 1 ) . (161) e_z=\frac{\gamma k}{\Delta}+O(1),\qquad
e\mathcal{H}_z=O(1),\qquad
\partial_z\mathcal{L}=\mathcal{H}\frac{\gamma k}{\Delta}+O(1). \tag*{(161)} e z = Δ γ k + O ( 1 ) , e H z = O ( 1 ) , ∂ z L = H Δ γ k + O ( 1 ) . (161)
For the middle bound, use e u z = − u e z eu_z=-ue_z e u z = − u e z and e w z = 1 ew_z=1 e w z = 1 at z = 0 z=0 z = 0 ; the bound on v z v_z v z gives e v z = O ( 1 ) ev_z=O(1) e v z = O ( 1 ) because e + u = O ( Δ ) e+u=O(\Delta) e + u = O ( Δ ) . Take W = n o u t Σ ‾ t e W=n_{\mathrm{out}}\overline{\Sigma}_{\mathrm{te}} W = n out Σ te or M ~ μ T M ~ μ \widetilde{M}_{\mu}^{\mathsf{T}}\widetilde{M}_{\mu} M μ T M μ . The mixed prediction trace in eq. (123) is bounded by positive-ridge and frame bounds. In eq. (161) , the factor H \mathcal{H} H tends to the residual H ∗ \mathcal{H}_{\ast} H ∗ of eq. (153) , whereas k k k tends to ( n o u t − 1 ) − 1 Tr ( W R ∗ ) (n_{\mathrm{out}}-1)^{-1}\operatorname{Tr}(W\mathcal{R}_{\ast}) ( n out − 1 ) − 1 Tr ( W R ∗ ) . Also j v → ( ζ ∗ / ( n o u t − 1 ) ) Tr ( R ∗ ) = h jv\to(\zeta_{\ast}/(n_{\mathrm{out}}-1))\operatorname{Tr}(\mathcal{R}_{\ast})=h j v → ( ζ ∗ / ( n out − 1 )) Tr ( R ∗ ) = h . Thus Δ ∼ ( γ − 1 ) 2 + 4 h η \Delta\sim\sqrt{(\gamma-1)^{2}+4h\eta} Δ ∼ ( γ − 1 ) 2 + 4 h η . Inserting the two indicated choices of W W W into the normalized derivative, and restoring the prefactor α \alpha α for test-shot variance, gives exactly eqs. (154) and (156) .
Positive amplitudes and physical variance — The whitened residual identity is
H ∗ = ζ ∗ d 2 − 1 Tr ( F ρ c { ζ ∗ P 0 + ( F ρ c ) 1 / 2 M ~ μ ( n o u t Σ ‾ t r ) − 1 M ~ μ T ( F ρ c ) 1 / 2 } − 1 ) . (162) \mathcal{H}_\ast=\frac{\zeta_\ast}{d^2-1}\operatorname{Tr}\left(\mathcal{F}_{\rho}^{c}\left\{\zeta_\ast P_0+\left(\mathcal{F}_{\rho}^{c}\right)^{1/2}\widetilde{M}_{\mu}\left(n_{\mathrm{out}}\overline{\Sigma}_{\mathrm{tr}}\right)^{-1}\widetilde{M}_{\mu}^{\mathsf{T}}\left(\mathcal{F}_{\rho}^{c}\right)^{1/2}\right\}^{-1}\right). \tag*{(162)} H ∗ = d 2 − 1 ζ ∗ Tr ( F ρ c { ζ ∗ P 0 + ( F ρ c ) 1/2 M μ ( n out Σ tr ) − 1 M μ T ( F ρ c ) 1/2 } − 1 ) . (162)
The frame and categorical bounds make this uniformly positive under eq. (95) . They also bound h h h above and below by positive constants. The test categorical lower bound makes C V C_V C V positive; a positive average measurement-frame eigenvalue makes C G C_G C G positive. The identity-label variance bound is uniform over bounded η \eta η , and q d , t d q_d,t_d q d , t d are bounded. Its variance contribution is O P ( 1 ) O_{\mathrm{P}}(1) O P ( 1 ) for the full target class, and its mixed term is at most of the order of the square root of the divergent variance. Both are lower order than the centered variance pole. The ideal-test cost retains its explicit mean contribution in eq. (144) .
Width, height, and physical costs — The singular tails scale as 1 / ∣ γ − 1 ∣ 1/|\gamma-1| 1/∣ γ − 1∣ . Ridge rounds them over ∣ γ − 1 ∣ ≲ 2 h η |\gamma-1|\lesssim2\sqrt{h\eta} ∣ γ − 1∣ ≲ 2 h η , with heights C V / ( 2 h η ) C_V/(2\sqrt{h\eta}) C V / ( 2 h η ) and C G / ( 2 h η ) C_G/(2\sqrt{h\eta}) C G / ( 2 h η ) when the coefficients are positive. The nonsingular background retains the full geometry. The physical variance has the same leading singularity by proposition D2 and lemma D8; its complete ideal-test error retains the mean terms of eq. (144) .
Minimum norm and small measured singular values
The unregularized estimator in section IV B inverts each positive measured singular value at finite dimension, whereas theorem E1 first takes a dimensional limit at positive ridge. Theorem E2 bridges that distinction at interpolation: the physical minimum-norm variance diverges without an inverse-tail assumption, even on deficient records. Away from interpolation, corollary E1 identifies the centered zero-penalty profiles only when the total label-weighted contribution of measured modes with arbitrarily small singular values vanishes.
Theorem E2 (Minimum-norm variance at interpolation). Assume eqs. (92) to (95) with κ < 1 \kappa<1 κ < 1 , independent multinomial records, and a random target from definition 1. If n o u t / n t r → 1 n_{\mathrm{out}}/n_{\mathrm{tr}}\to1 n out / n tr → 1 , the physical minimum-norm readout satisfies
V N , 0 ( O ) d Δ O 2 → P + ∞ , V N , 0 d Δ O 2 → P + ∞ . (163) \frac{V_{N,0}(\mathcal{O})}{d\Delta_{\mathcal{O}}^2}\xrightarrow{\mathrm{P}}+\infty,\qquad\frac{V_{N,0}}{d\Delta_{\mathcal{O}}^2}\xrightarrow{\mathrm{P}}+\infty. \tag*{(163)} d Δ O 2 V N , 0 ( O ) P + ∞ , d Δ O 2 V N , 0 P + ∞. (163) The median diverges. The empirical mean is arbitrary, and deficient count matrices are included.
Proof. Whitened lower bound for minimum norm — We lower-bound the physical minimum-norm variance by a positive-ridge coefficient norm. A uniform square-root bound on the minimized loss supplies the divergence without assuming convergence of the empirical spectra. Write C t r = n o u t Σ ‾ t r C_{\mathrm{tr}}=n_{\mathrm{out}}\overline{\Sigma}_{\mathrm{tr}} C tr = n out Σ tr and C t e = n o u t Σ ‾ t e C_{\mathrm{te}}=n_{\mathrm{out}}\overline{\Sigma}_{\mathrm{te}} C te = n out Σ te on 1 n o u t ⊥ 1_{n_{\mathrm{out}}}^{\perp} 1 n out ⊥ , and whiten the centered design as X = C t r − 1 / 2 P ^ N c X=C_{\mathrm{tr}}^{-1/2}\widehat{P}^{c}_{N} X = C tr − 1/2 P N c . Set R = M ρ c / n t r R=M_{\rho}^{c}/\sqrt{n_{\mathrm{tr}}} R = M ρ c / n tr and K η w = ( X X T + η I n o u t − 1 ) − 1 X R T K_{\eta}^{w}=(XX^{\mathsf{T}}+\eta I_{n_{\mathrm{out}}-1})^{-1}XR^{\mathsf{T}} K η w = ( X X T + η I n out − 1 ) − 1 X R T . For a unit target direction v = v O / d Δ O 2 v=v_{\mathcal{O}}/\sqrt{d\Delta_{\mathcal{O}}^2} v = v O / d Δ O 2 , the nonconstant part of every physical least-squares solution solves the centered problem. After whitening, its coefficient norm is at least the centered minimum-norm coefficient norm, which dominates ∥ K η w v ∥ \lVert K_{\eta}^{w}v\rVert ∥ K η w v ∥ by singular-value calculus. The covariance bounds give, record by record,
V N , 0 ( O ) d Δ O 2 ≥ α d c κ ∥ K η w v ∥ 2 . (164) \frac{V_{N,0}(\mathcal{O})}{d\Delta_{\mathcal{O}}^2}\geq\alpha_d\frac{c}{\kappa}\lVert K_{\eta}^{w}v\rVert^2. \tag*{(164)} d Δ O 2 V N , 0 ( O ) ≥ α d κ c ∥ K η w v ∥ 2 . (164)
The constant target component disappears from the centered labels, so this bound applies to the full target class.
Uniform square-root loss bound — For the whitened fixed-ridge equivalent, let B = M ~ μ C t r − 1 / 2 B=\widetilde{M}_{\mu}C_{\mathrm{tr}}^{-1/2} B = M μ C tr − 1/2 , F = F ρ c F=\mathcal{F}_{\rho}^{c} F = F ρ c , and S = B T F B S=B^{\mathsf{T}}FB S = B T F B . Choose fixed constants q 0 > 0 q_0>0 q 0 > 0 , L < ∞ L<\infty L < ∞ , and ζ 0 > 0 \zeta_0>0 ζ 0 > 0 such that eventually ( d 2 − 1 ) − 1 Tr ( F ) ≥ q 0 (d^2-1)^{-1}\operatorname{Tr}(F)\geq q_0 ( d 2 − 1 ) − 1 Tr ( F ) ≥ q 0 , ∥ F ρ c ∥ o p ∥ B ∥ o p 2 ≤ L \lVert F_{\rho}^{c}\rVert_{\mathrm{op}}\lVert B\rVert_{\mathrm{op}}^2\leq L ∥ F ρ c ∥ op ∥ B ∥ op 2 ≤ L , and 1 − ( d 2 − 1 ) / n t r ≥ ζ 0 1-(d^2-1)/n_{\mathrm{tr}}\geq\zeta_0 1 − ( d 2 − 1 ) / n tr ≥ ζ 0 ; these exist by noncollapse, the frame and covariance bounds, and κ < 1 \kappa<1 κ < 1 , γ d → 1 \gamma_d\to1 γ d → 1 . The rescaled equations eqs. (157) and (158) now have identity noise. In particular j = f = ( 1 − ϵ ) / γ d j=f=(1-\epsilon)/\gamma_d j = f = ( 1 − ϵ ) / γ d , and
v ≥ 1 − d 2 − 1 n t r ≥ ζ 0 , v ≤ 1 , v ϵ 2 = ( 1 − γ d ) ϵ + η ( 1 − ϵ ) . (165) v\geq1-\frac{d^2-1}{n_{\mathrm{tr}}}\geq\zeta_0,\qquad v\leq1,\qquad v\epsilon^2=(1-\gamma_d)\epsilon+\eta(1-\epsilon). \tag*{(165)} v ≥ 1 − n tr d 2 − 1 ≥ ζ 0 , v ≤ 1 , v ϵ 2 = ( 1 − γ d ) ϵ + η ( 1 − ϵ ) . (165)
The lower bound on v v v follows from v = 1 − n t r − 1 Tr ( S ( u I n o u t − 1 + v I n o u t − 1 + S ) − 1 ) v=1-n_{\mathrm{tr}}^{-1}\operatorname{Tr}(S(uI_{n_{\mathrm{out}}-1}+vI_{n_{\mathrm{out}}-1}+S)^{-1}) v = 1 − n tr − 1 Tr ( S ( u I n out − 1 + v I n out − 1 + S ) − 1 ) and rank S ≤ d 2 − 1 \operatorname{rank}S\leq d^2-1 rank S ≤ d 2 − 1 . For every fixed sufficiently small η > 0 \eta>0 η > 0 , taking d → ∞ d\to\infty d → ∞ in the last balance bounds every scalar limit point by η / 2 ≤ ϵ ≤ η / ζ 0 \sqrt{\eta/2}\leq\epsilon\leq\sqrt{\eta/\zeta_0} η /2 ≤ ϵ ≤ η / ζ 0 . Hence u = η / ϵ ≤ 2 η u=\eta/\epsilon\leq\sqrt{2\eta} u = η / ϵ ≤ 2 η . The residual has the exact whitened form H = ( u + v ) ( d 2 − 1 ) − 1 Tr ( F [ ( u + v ) P 0 + \mathcal{H}=(u+v)(d^2-1)^{-1}\operatorname{Tr}(F[(u+v)P_0+ H = ( u + v ) ( d 2 − 1 ) − 1 Tr ( F [( u + v ) P 0 + F 1 / 2 B B T F 1 / 2 − 1 ) F^{1/2}BB^{\mathsf{T}}F^{1/2}-1) F 1/2 B B T F 1/2 − 1 ) . For η \eta η small enough that u ≤ 1 u \le1 u ≤ 1 , it obeys ζ 0 q 0 / ( 2 + L ) ≤ H ≤ K \zeta_0 q_0/(2+L) \le\mathcal{H} \le K ζ 0 q 0 / ( 2 + L ) ≤ H ≤ K . Since L d w = e H \mathcal{L}^{\mathrm{w}}_d=e\mathcal{H} L d w = e H , fixed constants a , b > 0 a,b>0 a , b > 0 therefore satisfy
a η ≤ lim inf d L d w ( η ) ≤ lim sup d L d w ( η ) ≤ b η . (166) a\sqrt{\eta}\le\liminf_d\mathcal{L}^{\mathrm{w}}_d(\eta)\le\limsup_d\mathcal{L}^{\mathrm{w}}_d(\eta)\le b\sqrt{\eta}. \tag*{(166)} a η ≤ d lim inf L d w ( η ) ≤ d lim sup L d w ( η ) ≤ b η . (166)
For example, one may use a = ζ 0 q 0 / 2 ( 2 + L ) a=\zeta_0q_0/\sqrt{2(2+L)} a = ζ 0 q 0 / 2 ( 2 + L ) and b = K / ζ 0 b=K/\sqrt{\zeta_0} b = K / ζ 0 . No matrix spectral limit has been taken.
A divergent coefficient norm — Choose a fixed number R > ( b / a ) 2 R>(b/a)^2 R > ( b / a ) 2 . The sampled whitened minimized loss is concave, and its envelope derivative is ( d 2 − 1 ) − 1 ∥ K η w ∥ F 2 (d^2-1)^{-1}\lVert K^{\mathrm{w}}_\eta\rVert_F^2 ( d 2 − 1 ) − 1 ∥ K η w ∥ F 2 . Thus that derivative is at least its forward difference quotient between η \eta η and R η R\eta R η . The fixed-positive-penalty count comparison transfers the two loss values to their deterministic equivalents. Applying eq. (166) at both penalties gives, for every sufficiently small fixed η \eta η , the lower bound ( a R − b ) / [ ( R − 1 ) η ] + o P ( 1 ) (a\sqrt{R}-b)/[(R-1)\sqrt{\eta}]+o_P(1) ( a R − b ) / [( R − 1 ) η ] + o P ( 1 ) on ( d 2 − 1 ) − 1 ∥ K η w ∥ F 2 (d^2-1)^{-1}\lVert K^{\mathrm{w}}_\eta\rVert_F^2 ( d 2 − 1 ) − 1 ∥ K η w ∥ F 2 .
Typical targets and deficient records — Conditional target concentration transfers this trace bound to ∥ K η w v ∥ 2 \lVert K^{\mathrm{w}}_\eta v\rVert^2 ∥ K η w v ∥ 2 : at each fixed η \eta η , the ridge filter and response-frame bound give a dimension-independent operator norm, so the sphere, sign, and unitary-orbit variance estimates vanish. Given any threshold, choose the positive penalty small enough first and then take the dimensional limit. Together with eq. (164) , this proves divergence in probability and hence divergence of the median. Averaging eq. (164) over the target instead of using concentration bounds V N , 0 / ( d Δ ρ 2 ) V_{N,0}/(d\Delta^2_\rho) V N , 0 / ( d Δ ρ 2 ) below by α d ( c / K ) ( d 2 − 1 ) − 1 ∥ K η w ∥ F 2 \alpha_d(c/K)(d^2-1)^{-1}\lVert K^{\mathrm{w}}_\eta\rVert_F^2 α d ( c / K ) ( d 2 − 1 ) − 1 ∥ K η w ∥ F 2 , which diverges by the previous step. Deficient count matrices are included throughout.
Required control away from interpolation — Let σ j > 0 \sigma_j>0 σ j > 0 be the positive singular values of the measured matrix P ^ N c \widehat{P}^{\mathrm{c}}_N P N c , and let v j v_j v j be their right singular vectors in training space. For the scaled response ( M ρ c ) T v 0 / n t r (M^\mathrm{c}_\rho)^{\mathsf{T}}v_0/\sqrt{n_{\mathrm{tr}}} ( M ρ c ) T v 0 / n tr , the mean squared label in that direction, averaged over the independent target and divided by d Δ ρ 2 d\Delta^2_\rho d Δ ρ 2 , is ∥ M ρ c v j ∥ 2 / ( ( d 2 − 1 ) n t r ) \lVert M^\mathrm{c}_\rho v_j\rVert^2/((d^2-1)n_{\mathrm{tr}}) ∥ M ρ c v j ∥ 2 / (( d 2 − 1 ) n tr ) . Minimum norm divides this label by σ j \sigma_j σ j , so the contribution to its normalized squared coefficient norm is ∥ M ρ c v j ∥ 2 / ( ( d 2 − 1 ) n t r σ j 2 ) \lVert M^\mathrm{c}_\rho v_j\rVert^2/((d^2-1)n_{\mathrm{tr}}\sigma_j^2) ∥ M ρ c v j ∥ 2 / (( d 2 − 1 ) n tr σ j 2 ) . At fixed γ ≠ 1 \gamma\ne1 γ = 1 , impose
lim u ↓ 0 lim sup d P { 1 ( d 2 − 1 ) n t r ∑ j : 0 < σ j 2 < u ∥ M ρ c v j ∥ 2 σ j 2 > ε } = 0 for every ε > 0. (167) \lim_{u\downarrow0}\limsup_d\mathbb{P}\left\{\frac{1}{(d^2-1)n_{\mathrm{tr}}}\sum_{j:0<\sigma_j^2<u}\frac{\lVert M^\mathrm{c}_\rho v_j\rVert^2}{\sigma_j^2}>\varepsilon\right\}=0\quad\text{for every }\varepsilon>0. \tag*{(167)} u ↓ 0 lim d lim sup P ⎩ ⎨ ⎧ ( d 2 − 1 ) n tr 1 j : 0 < σ j 2 < u ∑ σ j 2 ∥ M ρ c v j ∥ 2 > ε ⎭ ⎬ ⎫ = 0 for every ε > 0. (167)
It requires the total coefficient norm from measured modes with arbitrarily small singular values to vanish, rather than requiring every mode to have a fixed lower singular-value bound. A bounded corresponding weighted inverse moment of order 1 + ϵ 1+\epsilon 1 + ϵ is sufficient.
Corollary E1 (Centered zero-penalty profiles). Under eqs. (92) to (94) and the random target laws of definition 1, fix γ ≠ 1 \gamma\ne1 γ = 1 and assume the fixed-ridge trace limits and eq. (167) . The normalized realized centered variance and traceless ideal-test error, computed with K 0 = ( ( P ^ N c ) T + ( M ρ c ) T / n t r K_0=((\widehat{P}^{\mathrm{c}}_N)^{\mathsf{T}}+(M^\mathrm{c}_\rho)^{\mathsf{T}}/\sqrt{n_{\mathrm{tr}}} K 0 = (( P N c ) T + ( M ρ c ) T / n tr converge in probability to F 0 = lim η ↓ 0 F η F_0=\lim_{\eta\downarrow0}F_\eta F 0 = lim η ↓ 0 F η and G 0 = lim η ↓ 0 G η G_0=\lim_{\eta\downarrow0}G_\eta G 0 = lim η ↓ 0 G η . Their conditional target expectations converge to the same limits in probability over the counts; their medians have these limits as well. The apparatus and training list are conditioned on unless a geometry ensemble is specified. Under the continuity hypotheses of theorem E1, each positive amplitude gives
F 0 ( γ ) ∼ C V / ∣ γ − 1 ∣ , G 0 ( γ ) ∼ C G / ∣ γ − 1 ∣ . (168) F_0(\gamma)\sim C_V/|\gamma-1|,\qquad G_0(\gamma)\sim C_G/|\gamma-1|. \tag*{(168)} F 0 ( γ ) ∼ C V /∣ γ − 1∣ , G 0 ( γ ) ∼ C G /∣ γ − 1∣. (168) The complete physical minimum-norm costs retain the mean and nullspace restoration in eq. (133) .
Proof. Transfer from ridge to pseudoinverse — Use the weighted inverse-tail condition eq. (167) . The exact minimum-norm coefficients, including deficient records, are given in eq. (133) . To identify the centered zero-penalty limits, use R = M ρ c / n t r R=M^\mathrm{c}_\rho/\sqrt{n_{\mathrm{tr}}} R = M ρ c / n tr and K ^ η = ( P ^ N c ( P ^ N c ) T + η Π o u t ) − 1 P ^ N c R T \widehat{K}_\eta=(\widehat{P}^{\mathrm{c}}_N(\widehat{P}^{\mathrm{c}}_N)^{\mathsf{T}}+\eta\Pi_{\mathrm{out}})^{-1}\widehat{P}^{\mathrm{c}}_N R^{\mathsf{T}} K η = ( P N c ( P N c ) T + η Π out ) − 1 P N c R T . Singular-value calculus gives
1 d 2 − 1 ∥ K ^ 0 − K ^ η ∥ F 2 ≤ 1 d 2 − 1 Tr ( R 1 ( 0 , u ) ( ( P ^ N c ) T P ^ N c ) ( ( P ^ N c ) T P ^ N c + R T ) + η 2 u 3 ( d 2 − 1 ) Tr ( R R T ) . (169) \frac{1}{d^2-1}\lVert\widehat{K}_0-\widehat{K}_\eta\rVert_F^2\le\frac{1}{d^2-1}\operatorname{Tr}(R1_{(0,u)}((\widehat{P}^{\mathrm{c}}_N)^{\mathsf{T}}\widehat{P}^{\mathrm{c}}_N)((\widehat{P}^{\mathrm{c}}_N)^{\mathsf{T}}\widehat{P}^{\mathrm{c}}_N+R^{\mathsf{T}})+\frac{\eta^2}{u^3(d^2-1)}\operatorname{Tr}(RR^{\mathsf{T}}). \tag*{(169)} d 2 − 1 1 ∥ K 0 − K η ∥ F 2 ≤ d 2 − 1 1 Tr ( R 1 ( 0 , u ) (( P N c ) T P N c ) (( P N c ) T P N c + R T ) + u 3 ( d 2 − 1 ) η 2 Tr ( R R T ) . (169) The normalized response trace is bounded. After the dimensional limit, take η ↓ 0 \eta\downarrow0 η ↓ 0 at fixed u u u , then u ↓ 0 u\downarrow0 u ↓ 0 . The inverse-tail condition makes the maps converge in normalized Frobenius norm. The upper categorical and apparatus bounds
transfer their two quadratic costs; target second moments transfer realized costs in probability. Fixed-positive-ridge limits then identify F 0 F_0 F 0 , G 0 G_0 G 0 . Their central poles follow from eq. (156) .
Restoring the zero-penalty physical fit — For the original solution, the additional nullspace coefficient and mean query remain in eq. (133) . Their exact physical and target-averaged costs are eqs. (84) , (131) and (D50). In particular, if P ^ N c \hat{P}^{\mathrm{c}}_N P ^ N c has full nonconstant row rank, then Π N = 0 \Pi_N = 0 Π N = 0 and w N , 0 I = 1 o u t w^{I}_{N,0} = 1_{\mathrm{out}} w N , 0 I = 1 out exactly. Constant labels then have zero variance and zero ideal-test error. A nonzero mean query for a traceless target is still evaluated by t 0 t_0 t 0 . This proves corollary E1 without a restriction on the empirical mean.
The universal denominator does not fix how strongly the two physical costs grow. The examples below evaluate its coefficients for κ < 1 \kappa< 1 κ < 1 , clarifying the geometry and shot-budget dependence discussed in section IV C. Section E 2 a gives an equal-strength benchmark; sections E 2 b and E 2 c isolate apparatus and training randomness; section E 2 d includes fixed-rank states and effects. All examples assume asymptotically flat categorical covariances:
n o u t Σ ‾ t r , n o u t Σ ‾ t e → Π n o u t in operator norm , F μ s ≡ M ~ μ M ~ μ T . (170) n_{\mathrm{out}}\overline{\Sigma}_{\mathrm{tr}}, n_{\mathrm{out}}\overline{\Sigma}_{\mathrm{te}} \to\Pi_{n_{\mathrm{out}}} \quad\text{in operator norm}, \qquad\mathcal{F}^{\mathrm{s}}_{\mu} \equiv\widetilde{M}_{\mu}\widetilde{M}_{\mu}^{\mathsf{T}}. \tag*{(170)} n out Σ tr , n out Σ te → Π n out in operator norm , F μ s ≡ M μ M μ T . (170)
Then eqs. (154) and (E10) gives h = ζ ∗ h = \zeta_* h = ζ ∗ and C V = α H ∗ C_{\mathrm{V}} = \alpha\mathcal{H}_* C V = α H ∗ . The coefficients describe the centered singularity; the full physical ideal-test error follows eq. (144) .
Tight empirical training and measurement frames
Equal-strength empirical frames remove directional variation from both the state exploration and apparatus response, leaving a solvable benchmark for the peak coefficients. At interpolation, suppose F ρ c → β P 0 \mathcal{F}^{\mathrm{c}}_{\rho} \to\beta P_0 F ρ c → β P 0 and F μ s → λ μ P 0 \mathcal{F}^{\mathrm{s}}_{\mu} \to\lambda_{\mu}P_0 F μ s → λ μ P 0 , with β , λ μ > 0 \beta,\lambda_{\mu} > 0 β , λ μ > 0 . The empirical expectation variance of every unit traceless observable is β / [ d ( d + 1 ) ] \beta/[d(d+1)] β / [ d ( d + 1 )] , and λ μ \lambda_{\mu} λ μ is the scaled measurement-frame eigenvalue. Writing x = β λ μ x = \beta\lambda_{\mu} x = β λ μ , the signal covariance has d 2 − 1 d^2 - 1 d 2 − 1 eigenvalues x x x and n o u t − d 2 n_{\mathrm{out}} - d^2 n out − d 2 zeros, which gives
ζ ∗ = 1 − x + ( 1 − x ) 2 + 4 ( 1 − κ ) x 2 , h = ζ ∗ , H ∗ = β ζ ∗ ζ ∗ + x , (171) \zeta_* = \frac{1-x+\sqrt{(1-x)^2+4(1-\kappa)x}}{2}, \qquad h = \zeta_*, \qquad\mathcal{H}_* = \frac{\beta\zeta_*}{\zeta_*+x}, \tag*{(171)} ζ ∗ = 2 1 − x + ( 1 − x ) 2 + 4 ( 1 − κ ) x , h = ζ ∗ , H ∗ = ζ ∗ + x β ζ ∗ , (171)
C V = α β ζ ∗ ζ ∗ + x , C G = κ λ μ β ζ ∗ ( ζ ∗ + x ) 2 . (172) C_{\mathrm{V}} = \frac{\alpha\beta\zeta_*}{\zeta_*+x}, \qquad C_{\mathrm{G}} = \frac{\kappa\lambda_{\mu}\beta\zeta_*}{(\zeta_*+x)^2}. \tag*{(172)} C V = ζ ∗ + x α β ζ ∗ , C G = ( ζ ∗ + x ) 2 κ λ μ β ζ ∗ . (172)
The root tends to one as x ↓ 0 x \downarrow0 x ↓ 0 and to 1 − κ 1-\kappa 1 − κ as x → ∞ x \to\infty x → ∞ ; at κ = 1 / 2 \kappa= 1/2 κ = 1/2 , x = 1 x = 1 x = 1 , it equals 1 / 2 1/\sqrt{2} 1/ 2 .
Evaluation for tight frames — The normalization of the critical inverse is ( 1 − κ ) / ζ ∗ + κ / ( ζ ∗ + x ) = 1 (1-\kappa)/\zeta_*+\kappa/(\zeta_*+x)=1 ( 1 − κ ) / ζ ∗ + κ / ( ζ ∗ + x ) = 1 . Multiplication by the two denominators gives the quadratic whose positive root is eq. (171) . The residual and the two weighted inverse traces then give eq. (172) .
Haar apparatus and an empirical training frame
For an independent Haar rank-one apparatus, the covariance-resolvent calculation reduces the peak coefficients to an integral over the empirical training spectrum. The integral shows how unequal training-frame eigenvalues change the unresolved signal. For a centered empirical training-frame law μ 1 \mu_1 μ 1 at interpolation, define
ϕ = ∫ d μ 1 ( x ) 1 + α x , H ∗ = ∫ x d μ 1 ( x ) 1 + α x = 1 − ϕ α . (173) \phi= \int\frac{\mathrm{d}\mu_1(x)}{1+\alpha x}, \qquad\mathcal{H}_* = \int\frac{x\,\mathrm{d}\mu_1(x)}{1+\alpha x} = \frac{1-\phi}{\alpha}. \tag*{(173)} ϕ = ∫ 1 + α x d μ 1 ( x ) , H ∗ = ∫ 1 + α x x d μ 1 ( x ) = α 1 − ϕ . (173)
Then
C V = 1 − ϕ , C G = κ ϕ ( 1 − ϕ ) , h = ζ ∗ = 1 − κ + κ ϕ . (174) C_{\mathrm{V}} = 1-\phi, \qquad C_{\mathrm{G}} = \kappa\phi(1-\phi), \qquad h = \zeta_* = 1-\kappa+\kappa\phi. \tag*{(174)} C V = 1 − ϕ , C G = κ ϕ ( 1 − ϕ ) , h = ζ ∗ = 1 − κ + κ ϕ . (174)
Each eigenvalue x x x is d ( d + 1 ) d(d+1) d ( d + 1 ) times an empirical expectation variance. Its residual contribution x / ( 1 + α x ) x/(1+\alpha x) x / ( 1 + α x ) increases with x x x and decreases with α \alpha α ; concavity in x x x implies that a tight frame maximizes H ∗ \mathcal{H}_* H ∗ at fixed mean eigenvalue.
Tight-training specialization — For F ρ c → β P 0 \mathcal{F}^{c}_{\rho} \to\beta P_{0} F ρ c → β P 0 , put q = α β q = \alpha\beta q = α β . The coefficients reduce to
C V = q 1 + q , C G = κ q ( 1 + q ) 2 , h = ζ ∗ = 1 − κ + κ 1 + q . (175) C_{V} = \frac{q}{1+q}, \qquad C_{G} = \frac{\kappa q}{(1+q)^{2}}, \qquad h = \zeta_{*} = 1-\kappa+\frac{\kappa}{1+q}. \tag*{(175)} C V = 1 + q q , C G = ( 1 + q ) 2 κ q , h = ζ ∗ = 1 − κ + 1 + q κ . (175)
At q = 1 q=1 q = 1 , C V = 1 / 2 C_{V}=1/2 C V = 1/2 and C G = κ / 4 C_{G}=\kappa/4 C G = κ /4 . The variance amplitude increases toward one with q q q , while the ideal-test amplitude is maximal at q = 1 q=1 q = 1 .
Covariance-resolvent evaluation — For the independent Haar apparatus, the covariance resolvent for its Gaussian operator lifts gives, at positive ζ \zeta ζ and with critical training-frame law μ 1 \mu_{1} μ 1 ,
w = α 1 + α κ ∫ x / ( ζ + w x ) d μ 1 ( x ) , g = ∫ d μ 1 ( x ) ζ + w x , H ( ζ ) = ζ ∫ x d μ 1 ( x ) ζ + w x . (176) w = \frac{\alpha}{1+\alpha\kappa\int x/(\zeta+wx)\,\mathrm{d}\mu_{1}(x)}, \qquad g = \int\frac{\mathrm{d}\mu_{1}(x)}{\zeta+wx}, \qquad\mathcal{H}(\zeta) = \zeta\int\frac{x\,\mathrm{d}\mu_{1}(x)}{\zeta+wx}. \tag*{(176)} w = 1 + α κ ∫ x / ( ζ + w x ) d μ 1 ( x ) α , g = ∫ ζ + w x d μ 1 ( x ) , H ( ζ ) = ζ ∫ ζ + w x x d μ 1 ( x ) . (176)
On the traceless sector, put Q ζ = [ ζ P 0 + ( F μ s ) 1 / 2 F c ( F μ s ) 1 / 2 ] − 1 Q_{\zeta} = [\zeta P_{0} + (F^{s}_{\mu})^{1/2}F_{c}(F^{s}_{\mu})^{1/2}]^{-1} Q ζ = [ ζ P 0 + ( F μ s ) 1/2 F c ( F μ s ) 1/2 ] − 1 . The normalized traces ( d 2 − 1 ) − 1 Tr ( Q ζ ) (d^{2}-1)^{-1}\operatorname{Tr}(Q_{\zeta}) ( d 2 − 1 ) − 1 Tr ( Q ζ ) and ( d 2 − 1 ) − 1 Tr ( F μ s Q ζ ) (d^{2}-1)^{-1}\operatorname{Tr}(F^{s}_{\mu}Q_{\zeta}) ( d 2 − 1 ) − 1 Tr ( F μ s Q ζ ) have limits g g g and w g wg w g , respectively. The bounded empirical training-state frame and quadratic-form concentration of the independent effect lifts justify the covariance resolvent lemma G9. Haar normalization changes the bounded traces by a near-identity congruence and bounded-rank identity coupling. The equation also reads w = α ( 1 − κ + κ ζ g ) w=\alpha(1-\kappa+\kappa\zeta g) w = α ( 1 − κ + κ ζ g ) . At the critical value ζ = ζ ∗ = h \zeta=\zeta_{*}=h ζ = ζ ∗ = h , the inverse normalization is h = 1 − κ + κ h g h=1-\kappa+\kappa hg h = 1 − κ + κh g . Thus w = α h w=\alpha h w = α h , h g = ϕ hg=\phi h g = ϕ and H ( h ) = ( 1 − ϕ ) / α \mathcal{H}(h)=(1-\phi)/\alpha H ( h ) = ( 1 − ϕ ) / α . The two weighted metrics give eq. (174) . A tight training-frame law μ 1 = δ β \mu_{1}=\delta_{\beta} μ 1 = δ β yields eq. (175) .
Haar training states and a fixed apparatus spectrum
For independent Haar pure training states, every unit traceless observable has ensemble expectation-value variance 1 / [ d ( d + 1 ) ] 1/[d(d+1)] 1/ [ d ( d + 1 )] . A finite training list still has unequal frame eigenvalues when n t r n_{\mathrm{tr}} n tr is comparable with d 2 d^{2} d 2 ; the coefficients below include those sampling fluctuations. As in section IV C, the apparatus enters through its spectrum. Let ν \nu ν be the limiting traceless spectrum of n o u t P 0 F μ P 0 n_{\mathrm{out}}P_{0}F_{\mu}P_{0} n out P 0 F μ P 0 . Define
ϕ = ∫ d ν ( λ ) 1 + α λ , h = ζ ∗ = 1 − κ + κ ϕ . (177) \phi=\int\frac{\mathrm{d}\nu(\lambda)}{1+\alpha\lambda}, \qquad h=\zeta_{*}=1-\kappa+\kappa\phi. \tag*{(177)} ϕ = ∫ 1 + α λ d ν ( λ ) , h = ζ ∗ = 1 − κ + κ ϕ . (177)
For a fresh Haar pure state measured with N N N shots, ϕ \phi ϕ is the limiting minimum linear state-reconstruction error normalized by its mean squared Hilbert–Schmidt distance from I d / d I_{d}/d I d / d . The empirical residual is H ∗ = ϕ h \mathcal{H}_{*}=\phi h H ∗ = ϕ h , giving
C V = α ϕ h , C G = κ ϕ ( 1 − ϕ ) . (178) C_{V}=\alpha\phi h, \qquad C_{G}=\kappa\phi(1-\phi). \tag*{(178)} C V = α ϕ h , C G = κ ϕ ( 1 − ϕ ) . (178)
Complete centered curves, including the regular background, follow in section F1.
Critical expansion for Haar training — The outcome covariance eigenvalue associated with apparatus eigenvalue λ \lambda λ is t = 1 + α λ t=1+\alpha\lambda t = 1 + α λ : unit shot noise plus signal. Its limiting law is H = ( 1 − κ ) δ 1 + κ ( 1 + α λ ) ∗ ν H=(1-\kappa)\delta_{1}+\kappa(1+\alpha\lambda)_{*}\nu H = ( 1 − κ ) δ 1 + κ ( 1 + α λ ) ∗ ν , where the mapped measure replaces λ \lambda λ by 1 + α λ 1+\alpha\lambda 1 + α λ with the same weight. Thus h = ∫ t − 1 d H = 1 − κ + κ ϕ h=\int t^{-1}\mathrm{d}H=1-\kappa+\kappa\phi h = ∫ t − 1 d H = 1 − κ + κ ϕ . The scalar c > 0 c>0 c > 0 solves 1 = η c + γ ∫ t c / ( 1 + t c ) d H 1=\eta c+\gamma\int tc/(1+tc)\,\mathrm{d}H 1 = η c + γ ∫ t c / ( 1 + t c ) d H , the equation used for the complete curves in eq. (212) . As ( γ , η ) → ( 1 , 0 ) (\gamma,\eta)\to(1,0) ( γ , η ) → ( 1 , 0 ) , it gives c → ∞ c\to\infty c → ∞ and η c 2 + ( γ − 1 ) c − h = o ( 1 ) \eta c^{2}+(\gamma-1)c-h=o(1) η c 2 + ( γ − 1 ) c − h = o ( 1 ) at leading order. Differentiating this balance in the two physical penalty metrics gives the amplitudes in eq. (178) .
Independent Haar states and effects of fixed rank
The independent fixed-rank ensembles of lemma B3 give explicit shot-dependent coefficients and distinguish the large-shot limit from exact-feature training. With state rank k k k and effect rank ℓ \ell ℓ fixed as d → ∞ d\to\infty d → ∞ , put q = ℓ / ( k ℓ ) q=\ell/(k\ell) q = ℓ / ( k ℓ ) . The spectral integral is
ϕ = 2 1 + q ( 1 − κ ) + [ 1 + q ( 1 − κ ) ] 2 + 4 κ q , (179) \phi=\frac{2}{1+q(1-\kappa)+\sqrt{[1+q(1-\kappa)]^{2}+4\kappa q}}, \tag*{(179)} ϕ = 1 + q ( 1 − κ ) + [ 1 + q ( 1 − κ ) ] 2 + 4 κ q 2 , (179)
C V = ℓ ( 1 − ϕ ) , C G = κ ϕ ( 1 − ϕ ) , h = ζ ∗ = 1 − κ + κ ϕ . (180) C_{V}=\ell(1-\phi), \qquad C_{G}=\kappa\phi(1-\phi), \qquad h=\zeta_{*}=1-\kappa+\kappa\phi. \tag*{(180)} C V = ℓ ( 1 − ϕ ) , C G = κ ϕ ( 1 − ϕ ) , h = ζ ∗ = 1 − κ + κ ϕ . (180)
For the pure-state, rank-one-POVM case k = ℓ = 1 k=\ell=1 k = ℓ = 1 , fixed 0 < κ < 1 0<\kappa<1 0 < κ < 1 gives
C V = 1 − 1 ( 1 − κ ) α + O ( α − 2 ) , C G = κ ( 1 − κ ) α + O ( α − 2 ) , (181) \begin{aligned}
C_{\mathrm{V}}&=1-\frac{1}{(1-\kappa)\alpha}+O(\alpha^{-2}),\\
C_{\mathrm{G}}&=\frac{\kappa}{(1-\kappa)\alpha}+O(\alpha^{-2}), \tag*{(181)}
\end{aligned} C V C G = 1 − ( 1 − κ ) α 1 + O ( α − 2 ) , = ( 1 − κ ) α κ + O ( α − 2 ) , (181)
( α → ∞ ) (\alpha\to\infty) ( α → ∞ ) .
Increasing training shots suppresses the traceless ideal-test singular coefficient but leaves the test-variance coefficient nonzero. A weight component in ker M μ \ker M_{\mu} ker M μ reconstructs no observable but still carries categorical test-shot variance. Finite-shot fitting can use these directions; exact-feature minimum norm removes them. These parameter limits follow the dimensional limit and cannot be interchanged with setting N = ∞ N=\infty N = ∞ before fitting.
Fixed-rank covariance scales — For Haar conjugates of a fixed state ρ ∗ \rho_{\ast} ρ ∗ , the traceless covariance scale is β d = d ( d + 1 ) ( Tr ( ρ ∗ 2 ) − 1 / d ) / ( d 2 − 1 ) \beta_d=d(d+1)(\operatorname{Tr}(\rho_{\ast}^{2})-1/d)/(d^{2}-1) β d = d ( d + 1 ) ( Tr ( ρ ∗ 2 ) − 1/ d ) / ( d 2 − 1 ) . At fixed projector rank k k k , β d → 1 / k \beta_d\to1/k β d → 1/ k . For the exact normalized rank-k k k projector states, lemma B3 gives the empirical covariance law ( x ↦ x / k ) ∗ μ M P , κ (x\mapsto x/k)_{\ast}\mu_{\mathrm{MP},\kappa} ( x ↦ x / k ) ∗ μ MP , κ at interpolation. The same lemma gives the independent rank-ℓ \ell ℓ apparatus law scaled by 1 / ℓ 1/\ell 1/ ℓ . These scales replace α \alpha α inside the spectral integral by α / ℓ \alpha/\ell α / ℓ , while leaving its physical variance prefactor α \alpha α . Evaluating ϕ = ∫ ( 1 + q x ) − 1 d μ M P , κ ( x ) \phi=\int(1+qx)^{-1}\,\mathrm{d}\mu_{\mathrm{MP},\kappa}(x) ϕ = ∫ ( 1 + q x ) − 1 d μ MP , κ ( x ) , including the zero atom, gives eqs. (179) and (180) .
At n o u t = n t r < d 2 n_{\mathrm{out}}=n_{\mathrm{tr}}<d^{2} n out = n tr < d 2 , the inaccessible part of a generic target cannot be reconstructed on all states, yet its labels can be fitted on the finite training list when the square exact feature matrix is nonsingular. Near interpolation, small singular values of the exact training matrix can make that fit require large weights even when the accessible POVM directions are well conditioned. Section E3a establishes this exact-feature mechanism, and section E3b explains why finite shots need not remove it. Section E3c gives the positive-root condition and physical interpolation theorem supporting § 3.2 ; section E3d evaluates coefficients and distinguishes conditions that do and do not force a peak.
Exact probabilities and the spectral edge at zero
The exact-feature example below separates near-singularity of the training matrix from poor conditioning of the apparatus. Haar training creates a spectrum reaching zero at interpolation even for a flat accessible POVM frame; an error peak additionally requires label strength in those small singular directions. At the Haar fluctuation scale, the exact centered training matrix is
P c ≡ n o u t d ( d + 1 ) n t r Π Π n t r = n o u t n t r M μ T P 0 M μ c . (182) P^{\mathrm{c}}\equiv\sqrt{\frac{n_{\mathrm{out}}d(d+1)}{n_{\mathrm{tr}}}}\Pi\Pi_{n_{\mathrm{tr}}}
=\sqrt{\frac{n_{\mathrm{out}}}{n_{\mathrm{tr}}}}M_{\mu}^{\mathsf{T}}P_{0}M_{\mu}^{\mathrm{c}}. \tag*{(182)} P c ≡ n tr n out d ( d + 1 ) Π Π n tr = n tr n out M μ T P 0 M μ c . (182)
It maps n t r − 1 n_{\mathrm{tr}}-1 n tr − 1 centered training coordinates to n o u t − 1 n_{\mathrm{out}}-1 n out − 1 nonconstant outcomes and becomes square at n o u t = n t r n_{\mathrm{out}}=n_{\mathrm{tr}} n out = n tr .
Hard edge from training-state sampling — The accessible measurement Gram matrix can stay gapped while sampling a nearly square training matrix creates a lower spectral edge at zero, called a hard edge.
Lemma E1 (Exact-feature hard edge). *Let the training states be independent Haar pure states, and let the POVM satisfy n o u t M μ T P 0 M μ = x 0 Π n o u t n_{\mathrm{out}}M_{\mu}^{\mathsf{T}}P_{0}M_{\mu}=x_{0}\Pi_{n_{\mathrm{out}}} n out M μ T P 0 M μ = x 0 Π n out for some fixed x 0 > 0 x_{0}>0 x 0 > 0 , i.e., its rescaled traceless frame has all its nonzero eigenvalues equal to x 0 x_{0} x 0 , which requires n o u t ≤ d 2 n_{\mathrm{out}}\le d^{2} n out ≤ d 2 . As d → ∞ d\to\infty d → ∞ with ( d 2 − 1 ) / ( n o u t − 1 ) → κ ∈ [ 1 , ∞ ) (d^{2}-1)/(n_{\mathrm{out}}-1)\to\kappa\in[1,\infty) ( d 2 − 1 ) / ( n out − 1 ) → κ ∈ [ 1 , ∞ ) and ( n o u t − 1 ) / n t r → γ ∈ ( 0 , ∞ ) (n_{\mathrm{out}}-1)/n_{\mathrm{tr}}\to\gamma\in(0,\infty) ( n out − 1 ) / n tr → γ ∈ ( 0 , ∞ ) , the empirical eigenvalue distribution of P c ( P c ) T P^{\mathrm{c}}(P^{\mathrm{c}})^{\mathsf{T}} P c ( P c ) T on 1 n o u t ⊥ \mathbb{1}_{n_{\mathrm{out}}}^{\perp} 1 n out ⊥ converges weakly in probability to the law of x 0 X x_{0}X x 0 X with X ∼ μ M P , γ X\sim\mu_{\mathrm{MP},\gamma} X ∼ μ MP , γ of eq. (45) . Its continuous part has edges x ± = x 0 ( 1 ± γ ) 2 x_{\pm}=x_{0}(1\pm\sqrt{\gamma})^{2} x ± = x 0 ( 1 ± γ ) 2 , and at γ = 1 \gamma=1 γ = 1 its density is
ρ x 0 ( x ) = 4 x 0 − x 2 π x 0 x 1 ( 0 , 4 x 0 ) ( x ) ∼ 1 π x 0 x ( x ↓ 0 ) . (183) \rho_{x_{0}}(x)=\frac{\sqrt{4x_{0}-x}}{2\pi x_{0}\sqrt{x}}\mathbf{1}_{(0,4x_{0})}(x)\sim\frac{1}{\pi\sqrt{x_{0}x}}\quad(x\downarrow0). \tag*{(183)} ρ x 0 ( x ) = 2 π x 0 x 4 x 0 − x 1 ( 0 , 4 x 0 ) ( x ) ∼ π x 0 x 1 ( x ↓ 0 ) . (183) For γ ≠ 1 \gamma\ne1 γ = 1 , the inverse moment of the positive part of the limiting law is
∫ ( 0 , ∞ ) d μ x 0 ( x ) x = 1 x 0 min { 1 , γ − 1 } ∣ 1 − γ ∣ . (184) \int_{(0,\infty)}\frac{\mathrm{d}\mu_{x_{0}}(x)}{x}
=\frac{1}{x_{0}}\frac{\min\{1,\gamma^{-1}\}}{|1-\gamma|}. \tag*{(184)} ∫ ( 0 , ∞ ) x d μ x 0 ( x ) = x 0 1 ∣1 − γ ∣ min { 1 , γ − 1 } . (184) where μ x 0 \mu_{x_{0}} μ x 0 is the limiting law; it diverges as γ → 1 \gamma\to1 γ → 1 .
Proof. Because the columns of P Π n t r P\Pi_{n_{\mathrm{tr}}} P Π n tr are traceless state differences, P c = n t r − 1 / 2 [ x 1 ⋯ x n t r ] Π n t r P^{\mathrm{c}}=n_{\mathrm{tr}}^{-1/2}[x_1\ \cdots\ x_{n_{\mathrm{tr}}}]\Pi_{n_{\mathrm{tr}}} P c = n tr − 1/2 [ x 1 ⋯ x n tr ] Π n tr with x i = n o u t M μ T P 0 h i x_i=\sqrt{n_{\mathrm{out}}}M_{\mu}^{\mathrm{T}}P_0h_i x i = n out M μ T P 0 h i and h i = d ( d + 1 ) P 0 v ρ i h_i=\sqrt{d(d+1)}P_0v_{\rho_i} h i = d ( d + 1 ) P 0 v ρ i . The vectors h i h_i h i are independent, centered, and isotropic on the traceless sector, with the quadratic-form concentration Var ( h i T A h i ) ≤ K ( d 2 − 1 ) 2 ∥ A ∥ o p 2 / d \operatorname{Var}(h_i^{\mathrm{T}}Ah_i)\le K(d^2-1)^2\lVert A\rVert_{\mathrm{op}}^2/d Var ( h i T A h i ) ≤ K ( d 2 − 1 ) 2 ∥ A ∥ op 2 / d used in the proof of proposition F1. Hence E x i x i T = x 0 Π n o u t \mathbb{E}x_ix_i^{\mathrm{T}}=x_0\Pi_{n_{\mathrm{out}}} E x i x i T = x 0 Π n out , and for symmetric A A A on 1 n o u t ⊥ 1_{n_{\mathrm{out}}}^{\perp} 1 n out ⊥ , Var ( x i T A x i ) ≤ K x 0 2 ( d 2 − 1 ) 2 ∥ A ∥ o p 2 / d = o ( ( n o u t − 1 ) 2 ) ∥ A ∥ o p 2 \operatorname{Var}(x_i^{\mathrm{T}}Ax_i)\le Kx_0^2(d^2-1)^2\lVert A\rVert_{\mathrm{op}}^2/d=o((n_{\mathrm{out}}-1)^2)\lVert A\rVert_{\mathrm{op}}^2 Var ( x i T A x i ) ≤ K x 0 2 ( d 2 − 1 ) 2 ∥ A ∥ op 2 / d = o (( n out − 1 ) 2 ) ∥ A ∥ op 2 , because n o u t − 1 ≍ d 2 n_{\mathrm{out}}-1\asymp d^2 n out − 1 ≍ d 2 . Theorem G1 therefore gives the stated Marchenko–Pastur limit for n t r − 1 ∑ i x i x i T n_{\mathrm{tr}}^{-1}\sum_i x_ix_i^{\mathrm{T}} n tr − 1 ∑ i x i x i T , and the rank-one centering by Π n t r \Pi_{n_{\mathrm{tr}}} Π n tr does not change it (lemma G1); equivalently, lemma G9 applies. The density eq. (183) is eq. (45) at γ = 1 \gamma=1 γ = 1 , rescaled by x 0 x_0 x 0 . The inverse moment of the positive part of μ M P , γ \mu_{\mathrm{MP},\gamma} μ MP , γ is min { 1 , γ − 1 } / ∣ 1 − γ ∣ \min\{1,\gamma^{-1}\}/\lvert1-\gamma\rvert min { 1 , γ − 1 } / ∣ 1 − γ ∣ [26 ] , the function J c l \mathcal{J}_{\mathrm{cl}} J cl of eq. (67) , and rescaling by x 0 x_0 x 0 gives eq. (184) . These are statements about the limiting law; they do not control the smallest empirical eigenvalues.
Its divergent inverse moment satisfies the limiting positive-root criterion at every fixed finite α > 0 \alpha>0 α > 0 . Centering leaves the spectral law unchanged, but that law alone does not control finite-dimensional pseudoinverses.
Label strength in small singular directions — Small singular directions produce an error peak only when their labels carry nonnegligible weight. Representable labels inherit the feature singular-value factors, whereas an inaccessible target component need not supply a factor that cancels the inverse singular value. In this subsection use an independent isotropic traceless target with the second moment eq. (38) , Tr ( O 2 ) = d Δ O 2 > 0 \operatorname{Tr}(\mathcal{O}^2)=d\Delta_{\mathcal{O}}^2>0 Tr ( O 2 ) = d Δ O 2 > 0 . Omitting the target argument denotes its average conditional on the apparatus, training states, and any counts. If σ j > 0 \sigma_j>0 σ j > 0 and v j v_j v j are the positive singular values and right singular vectors of P c P^{\mathrm{c}} P c , then
V ∞ , 0 c d Δ O 2 = ( 1 + o ( 1 ) ) 1 ( d 2 − 1 ) n t r ∑ σ j > 0 ∥ M ρ c v j ∥ 2 σ j 2 , (185) \frac{V_{\infty,0}^{\mathrm{c}}}{d\Delta_{\mathcal{O}}^2}=(1+o(1))\frac{1}{(d^2-1)n_{\mathrm{tr}}}\sum_{\sigma_j>0}\frac{\lVert M_{\rho}^{\mathrm{c}}v_j\rVert^2}{\sigma_j^2}, \tag*{(185)} d Δ O 2 V ∞ , 0 c = ( 1 + o ( 1 )) ( d 2 − 1 ) n tr 1 σ j > 0 ∑ σ j 2 ∥ M ρ c v j ∥ 2 , (185)
provided ∥ n o u t Σ ‾ t e − Π n o u t ∥ o p → 0 \lVert n_{\mathrm{out}}\overline{\Sigma}_{\mathrm{te}}-\Pi_{n_{\mathrm{out}}}\rVert_{\mathrm{op}}\to0 ∥ n out Σ te − Π n out ∥ op → 0 . Here N = ∞ N=\infty N = ∞ means exact training probabilities, while V V V remains the numerator of the test-shot variance. Each summand divides target-averaged label strength by the squared feature response.
Physical minimum-norm lower bound — For the physical fit, eliminating the uniform weight w 0 w_0 w 0 leaves the centered least-squares equations. Its nonconstant coefficients therefore have at least the centered minimum norm. If n o u t Σ ‾ t e ⪰ c Π n o u t n_{\mathrm{out}}\overline{\Sigma}_{\mathrm{te}}\succeq c\Pi_{n_{\mathrm{out}}} n out Σ te ⪰ c Π n out , then
V ∞ , 0 d Δ O 2 ≥ c ( d 2 − 1 ) n t r ∑ σ j > 0 ∥ M ρ c v j ∥ 2 σ j 2 . (186) \frac{V_{\infty,0}}{d\Delta_{\mathcal{O}}^2}\ge\frac{c}{(d^2-1)n_{\mathrm{tr}}}\sum_{\sigma_j>0}\frac{\lVert M_{\rho}^{\mathrm{c}}v_j\rVert^2}{\sigma_j^2}. \tag*{(186)} d Δ O 2 V ∞ , 0 ≥ ( d 2 − 1 ) n tr c σ j > 0 ∑ σ j 2 ∥ M ρ c v j ∥ 2 . (186)
The inaccessible target component can supply the amplified residual; a square matrix alone does not force a peak for every target. A well-conditioned accessible measurement also converts large coefficients into a large reconstruction error, as follows.
Lemma E2 (Accessible-frame lower bound on ideal-test error). Suppose
a Π n o u t ⪯ n o u t M μ T P 0 M μ ⪯ K Π n o u t , n o u t Σ ‾ t e ⪯ K Π n o u t , (187) a\Pi_{n_{\mathrm{out}}}\preceq n_{\mathrm{out}}M_{\mu}^{\mathrm{T}}P_0M_{\mu}\preceq K\Pi_{n_{\mathrm{out}}},\qquad n_{\mathrm{out}}\overline{\Sigma}_{\mathrm{te}}\preceq K\Pi_{n_{\mathrm{out}}}, \tag*{(187)} a Π n out ⪯ n out M μ T P 0 M μ ⪯ K Π n out , n out Σ te ⪯ K Π n out , (187) with dimension-independent a , K > 0 a,K>0 a , K > 0 . For any physical readout, with E \mathcal{E} E and V V V defined as above,
d ( d + 1 ) E N , τ ( O ) d Δ O 2 ≥ [ a K V N , τ ( O ) d Δ O 2 − 1 ] + 2 , [ x ] + = max { x , 0 } . (188) \frac{d(d+1)\mathcal{E}_{N,\tau}(\mathcal{O})}{d\Delta_{\mathcal{O}}^2}\ge\left[\sqrt{\frac{a}{K}\frac{V_{N,\tau}(\mathcal{O})}{d\Delta_{\mathcal{O}}^2}}-1\right]_+^2,\qquad[x]_+=\max\{x,0\}. \tag*{(188)} d Δ O 2 d ( d + 1 ) E N , τ ( O ) ≥ [ K a d Δ O 2 V N , τ ( O ) − 1 ] + 2 , [ x ] + = max { x , 0 } . (188) The same bound holds for target-averaged costs.
Proof. Accessible-frame comparison — By eq. (84) , the reconstructed traceless norm is at least a / n o u t ∥ w ⊥ ∥ \sqrt{a/n_{\mathrm{out}}}\lVert w_{\perp}\rVert a / n out ∥ w ⊥ ∥ , whereas V N , τ ( O ) ≤ K ∥ w ⊥ ∥ 2 / n o u t V_{N,\tau}(\mathcal{O})\le K\lVert w_{\perp}\rVert^2/n_{\mathrm{out}} V N , τ ( O ) ≤ K ∥ w ⊥ ∥ 2 / n out . The reverse triangle inequality gives eq. (188) ; applying it in target L 2 L^2 L 2 gives the averaged version.
Finite shots and residual amplification
Finite shots penalize large weights in the loss averaged at a fixed readout, but the fitted weights depend on the realized noise. Near interpolation the fit can follow that noise, so the averaged penalty does not establish a spectral gap. The residual and singular-vector identities below make this distinction precise for the mechanism of § 3.2 .
Averaged loss and realized fit — By lemma C2, averaging the training loss over independent multinomial shots at a fixed readout gives
1 n t r E n ∥ P ^ N T w − y ∥ 2 = 1 n t r ∥ P T w − y ∥ 2 + 1 N w T Σ t r w . (189) \frac{1}{n_{\mathrm{tr}}}\mathbb{E}_{n}\left\|\hat{P}_{N}^{T}w-y\right\|^{2}
=
\frac{1}{n_{\mathrm{tr}}}\left\|P^{T}w-y\right\|^{2}
+
\frac{1}{N}w^{T}\Sigma_{\mathrm{tr}}w. \tag*{(189)} n tr 1 E n P ^ N T w − y 2 = n tr 1 P T w − y 2 + N 1 w T Σ tr w . (189)
The final term penalizes large weights and can suppress the classical peak when the averaged objective approximates the realized one uniformly over the readouts relevant to the fit. Near interpolation, however, the fit can follow the particular observed noise: if n o u t = n t r n_{\mathrm{out}}=n_{\mathrm{tr}} n out = n tr and P ^ N \hat{P}_{N} P ^ N is invertible, every label is fitted exactly. Averaging at fixed w w w does not constrain this record-dependent solution.
Inaccessible labels and shot residual — Let w e x w_{\mathrm{ex}} w ex represent the Hilbert–Schmidt projection of O \mathcal{O} O onto the effects, and write O w e x = ∑ a w e x , a μ a \mathcal{O}w_{\mathrm{ex}}=\sum_a w_{\mathrm{ex},a}\mu_a O w ex = ∑ a w ex , a μ a . The residual is
( y − P ^ N T w e x ) i = Tr ( ( O − O w e x ) ρ i ) − w e x T ( p ^ i − p i ) . (190) \left(y-\hat{P}_{N}^{T}w_{\mathrm{ex}}\right)_i
=
\operatorname{Tr}\left((\mathcal{O}-\mathcal{O}_{w_{\mathrm{ex}}})\rho_i\right)
-
w_{\mathrm{ex}}^{T}(\hat{p}_i-p_i). \tag*{(190)} ( y − P ^ N T w ex ) i = Tr ( ( O − O w ex ) ρ i ) − w ex T ( p ^ i − p i ) . (190)
Its inaccessible-target term persists with exact probabilities; changing N N N does not generally cancel it.
Why shot noise need not open a gap — An isotropic Gaussian surrogate illustrates why finite-shot noise need not open a gap. Replace the rescaled exact signal and noise by α x 0 / n t r G 1 \sqrt{\alpha x_0/n_{\mathrm{tr}}}\,G_1 α x 0 / n tr G 1 and G 2 / n t r G_2/\sqrt{n_{\mathrm{tr}}} G 2 / n tr , respectively, with independent standard Gaussian ( n o u t − 1 ) × ( n t r − 1 ) (n_{\mathrm{out}}-1)\times(n_{\mathrm{tr}}-1) ( n out − 1 ) × ( n tr − 1 ) matrices. Their sum satisfies
α x 0 G 1 + G 2 n t r = l a w 1 + α x 0 n t r G . (191) \frac{\sqrt{\alpha x_0}G_1+G_2}{\sqrt{n_{\mathrm{tr}}}}
\mathrel{\stackrel{\mathrm{law}}{=}}
\sqrt{\frac{1+\alpha x_0}{n_{\mathrm{tr}}}}\,G. \tag*{(191)} n tr α x 0 G 1 + G 2 = law n tr 1 + α x 0 G . (191)
The limiting squared-singular-value edges are ( 1 + α x 0 ) ( 1 ± γ ) 2 (1+\alpha x_0)(1\pm\sqrt{\gamma})^2 ( 1 + α x 0 ) ( 1 ± γ ) 2 , so the lower edge remains zero at γ = 1 \gamma=1 γ = 1 . An independent isotropic label residual contributes the inverse moment
∫ x ( x + η ) 2 ρ 1 + α x 0 ( x ) d x ∼ 1 2 ( 1 + α x 0 ) η ( η ↓ 0 ) . (192) \int\frac{x}{(x+\eta)^2}\rho_{1+\alpha x_0}(x)\,\mathrm{d}x
\sim
\frac{1}{2\sqrt{(1+\alpha x_0)\eta}}
\qquad(\eta\downarrow0). \tag*{(192)} ∫ ( x + η ) 2 x ρ 1 + α x 0 ( x ) d x ∼ 2 ( 1 + α x 0 ) η 1 ( η ↓ 0 ) . (192)
The inverse-moment asymptotic concerns the stated Gaussian surrogate; the physical multinomial amplitudes require the categorical comparison and interpolation theorem.
Residual amplification in measured modes — For the positive singular values and singular vectors σ j , u j , v j \sigma_j,u_j,v_j σ j , u j , v j of P ^ N T \hat{P}_N^T P ^ N T , the zero-penalty normal equations give
u j T ( w ^ N − w e x ) = n o u t N n t r v j T Π n t r ( y − P ^ N T w e x ) σ j . (193) u_j^{T}(\hat{w}_N-w_{\mathrm{ex}})
=
\sqrt{\frac{n_{\mathrm{out}}N}{n_{\mathrm{tr}}}}\,
\frac{v_j^{T}\Pi_{n_{\mathrm{tr}}}(y-\hat{P}_N^{T}w_{\mathrm{ex}})}{\sigma_j}. \tag*{(193)} u j T ( w ^ N − w ex ) = n tr n out N σ j v j T Π n tr ( y − P ^ N T w ex ) . (193)
Small measured singular values amplify residual components that do not decay sufficiently fast. Finite shots preserve the nearly square geometry; ridge instead replaces each inverse singular value by σ j / ( σ j 2 + η ) \sigma_j/(\sigma_j^2+\eta) σ j / ( σ j 2 + η ) in the observed record.
Positive critical root and interpolation theorem
Below completeness, no exact signal-free outcome direction is guaranteed, so a peak requires sufficiently many weak signal directions relative to shot noise. The positive critical root below expresses that requirement. Under the stated geometry, mean, and trace assumptions, theorem E3 gives both the rounded physical target-averaged profiles and divergence of the actual minimum-norm variance, supplying the precise version of theorem 5.
Geometry and mean assumptions — The fixed-ridge equivalent of proposition D1 applies to either ordering of d 2 − 1 d^2-1 d 2 − 1 and n o u t − 1 n_{\mathrm{out}}-1 n out − 1 . Use eq. (92) with κ > 1 \kappa>1 κ > 1 , γ \gamma γ near one, and κ γ > 1 \kappa\gamma>1 κγ > 1 , so both n o u t , n t r < d 2 n_{\mathrm{out}},n_{\mathrm{tr}}<d^2 n out , n tr < d 2 . Retain eqs. (93) to (95) , and additionally require
lim inf n o u t − 1 1 n o u t − 1 Tr ( M ~ μ T M ~ μ ) > 0 , q d = ∥ ρ ˉ − I d / d ∥ F 2 ⟶ 0. (194) \liminf_{n_{\mathrm{out}}-1}\frac{1}{n_{\mathrm{out}}-1}\operatorname{Tr}(\widetilde{M}_{\mu}^{T}\widetilde{M}_{\mu})>0,
\qquad
q_d=\left\|\bar{\rho}-I_d/d\right\|_{F}^{2}\longrightarrow0. \tag*{(194)} n out − 1 lim inf n out − 1 1 Tr ( M μ T M μ ) > 0 , q d = ∥ ρ ˉ − I d / d ∥ F 2 ⟶ 0. (194)
The first condition ensures positive ideal-test amplitude; the second removes the mean-prediction contribution. For random states or apparatuses, these empirical conditions must hold with probability tending to one.
A positive critical root — For the centered Born covariance S S S of eq. (88) , require at γ = 1 \gamma= 1 γ = 1
R ⋆ = [ ζ ⋆ n o u t Σ ‾ t r + S ] − 1 , 1 n o u t − 1 Tr ( n o u t Σ ‾ t r R ⋆ ) = 1 , ζ ⋆ ≥ ζ 0 > 0 , (195) \mathcal{R}_{\star} = [\zeta_{\star} n_{\mathrm{out}}\overline{\Sigma}_{\mathrm{tr}} + S]^{-1}, \qquad\frac{1}{n_{\mathrm{out}}-1}\operatorname{Tr}(n_{\mathrm{out}}\overline{\Sigma}_{\mathrm{tr}}\mathcal{R}_{\star}) = 1, \qquad\zeta_{\star} \ge\zeta_{0} > 0, \tag*{(195)} R ⋆ = [ ζ ⋆ n out Σ tr + S ] − 1 , n out − 1 1 Tr ( n out Σ tr R ⋆ ) = 1 , ζ ⋆ ≥ ζ 0 > 0 , (195)
with inverses on 1 / n o u t 1/n_{\mathrm{out}} 1/ n out . Using the generalized eigenvalues of eqs. (148) , (149) and (151) , write f d ( ζ ) ≡ 1 n o u t − 1 ∑ j = 1 n o u t − 1 1 ζ + λ j f_d(\zeta) \equiv\frac{1}{n_{\mathrm{out}}-1}\sum_{j=1}^{n_{\mathrm{out}}-1}\frac{1}{\zeta+\lambda_j} f d ( ζ ) ≡ n out − 1 1 ∑ j = 1 n out − 1 ζ + λ j 1 . The function decreases strictly on ζ > 0 \zeta> 0 ζ > 0 , and f d ( 1 ) ≤ 1 f_d(1) \le1 f d ( 1 ) ≤ 1 . A strictly positive finite-dimensional root exists if and only if
lim ζ ↓ 0 f d ( ζ ) > 1. (196) \lim_{\zeta\downarrow0} f_d(\zeta) > 1. \tag*{(196)} ζ ↓ 0 lim f d ( ζ ) > 1. (196)
For positive eigenvalues this is ( n o u t − 1 ) − 1 ∑ j λ j − 1 > 1 (n_{\mathrm{out}}-1)^{-1}\sum_j\lambda_j^{-1} > 1 ( n out − 1 ) − 1 ∑ j λ j − 1 > 1 ; a zero eigenvalue makes the inverse trace infinite. Equality at zero is a boundary case. The proportional theorem further requires ζ ⋆ ≥ ζ 0 > 0 \zeta_{\star} \ge\zeta_0 > 0 ζ ⋆ ≥ ζ 0 > 0 and regular trace limits.
Resolved and unresolved directions — An equivalent interpretation uses the effective number of signal-bearing directions:
d e f f ( ζ ) ≡ ∑ j = 1 n o u t − 1 λ j ζ + λ j , ζ ⋆ = 1 − d e f f ( ζ ⋆ ) n o u t − 1 , ζ ⋆ > 0. (197) d_{\mathrm{eff}}(\zeta) \equiv\sum_{j=1}^{n_{\mathrm{out}}-1}\frac{\lambda_j}{\zeta+\lambda_j}, \qquad\zeta_{\star} = 1 - \frac{d_{\mathrm{eff}}(\zeta_{\star})}{n_{\mathrm{out}}-1}, \qquad\zeta_{\star} > 0. \tag*{(197)} d eff ( ζ ) ≡ j = 1 ∑ n out − 1 ζ + λ j λ j , ζ ⋆ = 1 − n out − 1 d eff ( ζ ⋆ ) , ζ ⋆ > 0. (197)
The identity is equivalent to the critical equation only for ζ ⋆ > 0 \zeta_{\star} > 0 ζ ⋆ > 0 . Strong modes λ j ≫ ζ ⋆ \lambda_j \gg\zeta_{\star} λ j ≫ ζ ⋆ contribute approximately one to d e f f d_{\mathrm{eff}} d eff , while modes with λ j ≪ ζ ⋆ \lambda_j \ll\zeta_{\star} λ j ≪ ζ ⋆ contribute little. Thus ζ ⋆ \zeta_{\star} ζ ⋆ is a self-consistent unresolved fraction of outcome directions, not the physical ridge penalty. Above completeness exact null modes guarantee that fraction; below completeness sufficiently many weak modes can sustain it.
Trace assumptions and coefficients — Impose the critical trace regularity of remark E1, in addition to the uniformly positive root. The amplitudes and ridge width retain the common form eqs. (154) and (155) ; the theorem below concerns target-averaged physical costs for traceless targets, with the empirical-mean contribution removed by eq. (194) .
Theorem E3 (Interpolation below informational completeness). Assume κ > 1 \kappa> 1 κ > 1 and κ γ > 1 \kappa\gamma> 1 κγ > 1 , eqs. (92) to (95) , (194) and (195) and the trace regularity just specified. Use independent multinomial records and an independent isotropic traceless target; the training set and POVM are otherwise arbitrary.
At fixed η > 0 \eta> 0 η > 0 , with τ = η / ( n o u t N ) \tau= \eta/(n_{\mathrm{out}}N) τ = η / ( n out N ) , the target-averaged physical costs V N , τ / ( d Δ 0 2 ) V_{N,\tau}/(d\Delta_0^2) V N , τ / ( d Δ 0 2 ) and d ( d + 1 ) E N , τ / ( d Δ 0 2 ) d(d+1)E_{N,\tau}/(d\Delta_0^2) d ( d + 1 ) E N , τ / ( d Δ 0 2 ) converge in probability to F η ( γ ) F_\eta(\gamma) F η ( γ ) and G η ( γ ) G_\eta(\gamma) G η ( γ ) . After this dimensional limit,
F η ( γ ) ∼ C V ( γ − 1 ) 2 + 4 h η , G η ( γ ) ∼ C G ( γ − 1 ) 2 + 4 h η , ( γ , η ) → ( 1 , 0 ) , (198) F_\eta(\gamma) \sim\frac{C_V}{\sqrt{(\gamma-1)^2+4h\eta}}, \qquad G_\eta(\gamma) \sim\frac{C_G}{\sqrt{(\gamma-1)^2+4h\eta}}, \qquad(\gamma,\eta) \to(1,0), \tag*{(198)} F η ( γ ) ∼ ( γ − 1 ) 2 + 4 h η C V , G η ( γ ) ∼ ( γ − 1 ) 2 + 4 h η C G , ( γ , η ) → ( 1 , 0 ) , (198) with positive C V , C G , h C_V,C_G,h C V , C G , h from eqs. (154) and (155) .
At n o u t / n t r → 1 n_{\mathrm{out}}/n_{\mathrm{tr}} \to1 n out / n tr → 1 , the physical minimum-norm readout also satisfies V N , 0 / ( d Δ 0 2 ) → P + ∞ V_{N,0}/(d\Delta_0^2) \xrightarrow{\mathbb{P}} +\infty V N , 0 / ( d Δ 0 2 ) P + ∞ . Its target-averaged ideal-test error diverges as well if n o u t M μ T P 0 M μ ⪰ a I n o u t n_{\mathrm{out}}M_\mu^{\mathsf{T}}P_0M_\mu\succeq a\mathbb{I}_{n_{\mathrm{out}}} n out M μ T P 0 M μ ⪰ a I n out for a dimension-independent a > 0 a > 0 a > 0 , by eq. (188) .
Proof. Excluding a noncritical limit — The fixed-ridge comparison and scalar balances eqs. (157) and (158) also hold for κ > 1 \kappa> 1 κ > 1 . We identify their critical solution from the positive-root assumption eq. (195) , since the kernel argument for κ < 1 \kappa< 1 κ < 1 no longer applies. Write e = a − 1 e = a^{-1} e = a − 1 , u = η / e u = \eta/e u = η / e and v = a b v = ab v = ab , as in eq. (157) , and initially set z = 0 z = 0 z = 0 . The balances eq. (158) hold with 0 < v ≤ 1 0 < v \le1 0 < v ≤ 1 . Suppose that along a sequence ( γ , η ) → ( 1 , 0 ) (\gamma,\eta) \to(1,0) ( γ , η ) → ( 1 , 0 ) we had e ≥ ϵ 0 > 0 e \ge\epsilon_0 > 0 e ≥ ϵ 0 > 0 . Then u → 0 u \to0 u → 0 and the second equation forces v → 0 v \to0 v → 0 , since j j j is bounded by the categorical lower bound and f = ( 1 − e ) / γ f = (1-e)/\gamma f = ( 1 − e ) / γ . Let λ 1 , … , λ n o u t − 1 \lambda_1,\ldots,\lambda_{n_{\mathrm{out}}-1} λ 1 , … , λ n out − 1 denote the eigenvalues of the noise-whitened signal, as in eq. (148) . Choose 0 < ϵ < ζ 0 0 < \epsilon< \zeta_0 0 < ϵ < ζ 0 so that, for all sufficiently large dimensions, u I n o u t − 1 + v n o u t Σ ‾ t r ⪯ ϵ n o u t Σ ‾ t r u\mathbb{I}_{n_{\mathrm{out}}-1}+v n_{\mathrm{out}}\overline{\Sigma}_{\mathrm{tr}} \preceq\epsilon n_{\mathrm{out}}\overline{\Sigma}_{\mathrm{tr}} u I n out − 1 + v n out Σ tr ⪯ ϵ n out Σ tr . Operator monotonicity of inversion gives f ≥ 1 n o u t − 1 ∑ j = 1 n o u t − 1 1 ϵ + λ j > 1 f \ge\frac{1}{n_{\mathrm{out}}-1}\sum_{j=1}^{n_{\mathrm{out}}-1}\frac{1}{\epsilon+\lambda_j} > 1 f ≥ n out − 1 1 ∑ j = 1 n out − 1 ϵ + λ j 1 > 1 . The last inequality holds uniformly in a neighborhood of the critical geometry: the root condition equals one at ζ ⋆ ≥ ζ 0 \zeta_{\star} \ge\zeta_0 ζ ⋆ ≥ ζ 0 , the whitened signal is bounded, and the assumed local trace convergence preserves the strictly positive gap between its values at ϵ \epsilon ϵ and ζ ⋆ \zeta_{\star} ζ ⋆ . This contradicts f = ( 1 − e ) / γ f = (1-e)/\gamma f = ( 1 − e ) / γ . Hence e → 0 e \to0 e → 0 .
Identification of the positive limit — At z = 0 z = 0 z = 0 the second balance divided by e e e reads v e = 1 − γ + γ u j ve = 1-\gamma+\gamma uj v e = 1 − γ + γ u j ; it implies u j → 0 uj \to0 u j → 0 . The covariance and frame bounds imply j ≥ ( u + K ′ ) − 1 j \ge(u+K')^{-1} j ≥ ( u + K ′ ) − 1 for a dimension-independent K ′ K' K ′ , so u → 0 u \to0 u → 0 . If $v
had a subsequential limit of zero, the same spectral comparison with ε = ζ 0 / 2 \varepsilon= \zeta_0/2 ε = ζ 0 /2 would contradict f → 1 f \to1 f → 1 . Thus v v v stays positive. Taking limits in 1 − e = γ f 1-e=\gamma f 1 − e = γ f makes the normalized trace in eq. (195) tend to one. The normalized inverse trace is strictly decreasing in v v v , so the positive-root assumption identifies v → ζ ∗ v \to\zeta_\ast v → ζ ∗ and R ♯ → R ∗ \mathcal{R}^{\sharp} \to\mathcal{R}_\ast R ♯ → R ∗ in the required normalized traces. We have established exactly the critical properties e → 0 e \to0 e → 0 , u → 0 u \to0 u → 0 , v → ζ ∗ > 0 v \to\zeta_\ast> 0 v → ζ ∗ > 0 used after the root-identification step in the complete-regime proof.
Rounded peak below completeness — Since ζ ∗ ≥ ζ 0 \zeta_\ast\ge\zeta_0 ζ ∗ ≥ ζ 0 , the inverse and its u , v , w u,v,w u , v , w trace derivatives remain bounded. The discriminant and derivative calculation eqs. (160) and (E16) therefore apply unchanged. Using the two penalty directions n o u t Σ ‾ t e n_{\mathrm{out}}\overline{\Sigma}_{\mathrm{te}} n out Σ te and M ~ μ M ~ μ \widetilde{M}_{\mu}\widetilde{M}_{\mu} M μ M μ gives the centered profiles eq. (198) with precisely the coefficients eqs. (154) and (E10). The residual identity eq. (162) , together with the positive-root, frame and covariance hypotheses, makes H ∗ > 0 \mathcal{H}_\ast> 0 H ∗ > 0 . The test covariance lower bound makes C V > 0 C_V > 0 C V > 0 ; the assumed average traceless POVM strength also makes C G > 0 C_G > 0 C G > 0 . The same assumptions bound h h h away from zero.
Physical fixed-ridge costs — The identity lemma D5 is exact for each count record, while lemma D6 makes its rank-one bulk correction negligible at fixed positive ridge. For a traceless independent isotropic target, the target-averaged constant-prediction term is ∥ t η ∥ 2 / ( d 2 − 1 ) \lVert t_\eta\rVert^2/(d^2-1) ∥ t η ∥ 2 / ( d 2 − 1 ) . Its fixed-ridge bound is O P , η ( q d + ( d 2 − 1 ) − 1 ) O_{P,\eta}(q_d+(d^2-1)^{-1}) O P , η ( q d + ( d 2 − 1 ) − 1 ) , which tends to zero under the present q d → 0 q_d \to0 q d → 0 assumption. This proves that the physical target-averaged costs have the centered limits used above. We do not claim this replacement for a general target with a nonzero identity component or a nonvanishing empirical mean correction.
Minimum-norm divergence — For the minimum-norm statement, take an arbitrary count record and eliminate the constant label direction. The nonconstant part of the physical least-squares solution solves the centered equations. After whitening by ( n o u t Σ ‾ t r ) − 1 / 2 (n_{\mathrm{out}}\overline{\Sigma}_{\mathrm{tr}})^{-1/2} ( n out Σ tr ) − 1/2 , its coefficient norm is no smaller than that of the whitened minimum-norm centered solution, and the latter dominates its fixed-positive-ridge norm. The uniform covariance bounds give the same lower bound, up to a positive constant, for the physical test variance. At γ = 1 \gamma=1 γ = 1 , the preceding centered critical calculation makes the regularized lower bound diverge as its fixed penalty tends to zero. For any finite threshold, choose that positive penalty first and then take the proportional limit. The target-averaged physical minimum-norm variance consequently diverges in probability even when the count matrix is deficient. Finally, under the stated uniform lower bound on the accessible measurement Gram matrix, eq. (188) transfers this divergence to the target-averaged ideal-test error. This completes the proof.
Order of limits and physical scope — Dimensions must tend to infinity at fixed ridge before ( γ , η ) → ( 1 , 0 ) (\gamma,\eta) \to(1,0) ( γ , η ) → ( 1 , 0 ) . At fixed γ ≠ 1 \gamma\ne1 γ = 1 , identifying a full zero-penalty profile additionally requires weighted inverse-tail control, as in eq. (167) . Minimum-norm divergence at interpolation needs no such condition. Without q d → 0 q_d \to0 q d → 0 , the centered profiles remain valid but the physical ideal-test error retains its mean contribution; nontraceless targets also require the identity restoration of lemma D5.
Peak amplitudes and limits of the root criterion
The positive-root criterion makes the incomplete peak conditional on geometry. The examples below show how training shots change its amplitudes and width, including the nonzero large-shot ideal-test coefficient highlighted in § 3.2 . They also identify the scope of the result: strict failure of the root condition bounds centered regularized costs, while the threshold case and physical minimum norm require separate control.
Small shot parameter with general geometry — Hold the apparatus and training geometry fixed while varying α = N / [ d ( d + 1 ) ] \alpha=N/[d(d+1)] α = N / [ d ( d + 1 )] , and evaluate critical traces at interpolation. Since S = O ( α ) S=O(\alpha) S = O ( α ) , ζ ∗ = 1 + O ( α ) \zeta_\ast=1+O(\alpha) ζ ∗ = 1 + O ( α ) and R ∗ = ( n o u t Σ ‾ t r ) − 1 + O ( α ) \mathcal{R}_\ast=(n_{\mathrm{out}}\overline{\Sigma}_{\mathrm{tr}})^{-1}+O(\alpha) R ∗ = ( n out Σ tr ) − 1 + O ( α ) . Hence
C V = α Tr ( F ρ ) d 2 − 1 Tr ( Σ ‾ t e Σ ‾ t r − 1 ) n o u t − 1 + O ( α 2 ) , C G = α Tr ( F ρ ) d 2 − 1 Tr ( M ~ μ T P 0 M μ Σ ‾ t r − 1 ) n o u t − 1 + O ( α 2 ) . (199) \begin{aligned}
C_V &= \alpha\frac{\operatorname{Tr}(\mathcal{F}_\rho)}{d^2-1}\frac{\operatorname{Tr}(\overline{\Sigma}_{\mathrm{te}}\overline{\Sigma}_{\mathrm{tr}}^{-1})}{n_{\mathrm{out}}-1}+O(\alpha^2),\\
C_G &= \alpha\frac{\operatorname{Tr}(\mathcal{F}_\rho)}{d^2-1}\frac{\operatorname{Tr}(\widetilde{M}_\mu^{\mathsf T}P_0M_\mu\overline{\Sigma}_{\mathrm{tr}}^{-1})}{n_{\mathrm{out}}-1}+O(\alpha^2). \tag*{(199)}
\end{aligned} C V C G = α d 2 − 1 Tr ( F ρ ) n out − 1 Tr ( Σ te Σ tr − 1 ) + O ( α 2 ) , = α d 2 − 1 Tr ( F ρ ) n out − 1 Tr ( M μ T P 0 M μ Σ tr − 1 ) + O ( α 2 ) . (199)
Both amplitudes vanish linearly as α ↓ 0 \alpha\downarrow0 α ↓ 0 , yet remain positive at every fixed α > 0 \alpha>0 α > 0 within the theorem’s regime. These limits follow the dimensional limit and do not describe fixed N N N .
Haar apparatus and general training — Assume flat categorical covariances and an independent normalized Haar rank-one POVM. Let μ 1 \mu_1 μ 1 be the centered training-frame law on all d 2 − 1 d^2-1 d 2 − 1 traceless directions at interpolation, including zeros. The transform eq. (176) allows singular frames and gives
ϕ = ∫ d μ 1 ( x ) 1 + α x , C V = 1 − ϕ , C G = κ ϕ ( 1 − ϕ ) , \phi= \int\frac{d\mu_1(x)}{1+\alpha x}, \qquad C_V = 1-\phi, \qquad C_G = \kappa\phi(1-\phi), ϕ = ∫ 1 + α x d μ 1 ( x ) , C V = 1 − ϕ , C G = κ ϕ ( 1 − ϕ ) ,
h = ζ ∗ = 1 − κ + κ ϕ . (200) h = \zeta_* = 1-\kappa+\kappa\phi. \tag*{(200)} h = ζ ∗ = 1 − κ + κ ϕ . (200)
The rank bound rank F ρ c ≤ n t r − 1 \operatorname{rank}\mathcal{F}^c_\rho\le n_{\mathrm{tr}}-1 rank F ρ c ≤ n tr − 1 gives zero mass at least 1 − 1 / κ 1-1/\kappa 1 − 1/ κ . If the spectrum is bounded by K K K , then h ≥ ( 1 + α K ) − 1 > 0 h \ge(1+\alpha K)^{-1}>0 h ≥ ( 1 + α K ) − 1 > 0 ; noncollapse ensures positive amplitudes at finite α \alpha α . The first two expansions below are for α ↓ 0 \alpha\downarrow0 α ↓ 0 and the last two limits for α → ∞ \alpha\to\infty α → ∞ , after the proportional limit:
C V = α ∫ x d μ 1 ( x ) + O ( α 2 ) , C_V = \alpha\int x\,d\mu_1(x)+O(\alpha^2), C V = α ∫ x d μ 1 ( x ) + O ( α 2 ) ,
C G = κ α ∫ x d μ 1 ( x ) + O ( α 2 ) , C_G = \kappa\alpha\int x\,d\mu_1(x)+O(\alpha^2), C G = κ α ∫ x d μ 1 ( x ) + O ( α 2 ) ,
C V ⟶ 1 − μ 1 ( { 0 } ) , C_V \longrightarrow1-\mu_1(\{0\}), C V ⟶ 1 − μ 1 ({ 0 }) ,
C G ⟶ κ μ 1 ( { 0 } ) [ 1 − μ 1 ( { 0 } ) ] . (201) C_G \longrightarrow\kappa\mu_1(\{0\})[1-\mu_1(\{0\})]. \tag*{(201)} C G ⟶ κ μ 1 ({ 0 }) [ 1 − μ 1 ({ 0 })] . (201)
If the zero mass equals 1 − 1 / κ 1-1/\kappa 1 − 1/ κ , the large-shot amplitudes are 1 / κ 1/\kappa 1/ κ and 1 − 1 / κ 1-1/\kappa 1 − 1/ κ , while h → 0 h\to0 h → 0 . The shot and ridge limits are then nonuniform; identifying these coefficients with an exact-training calculation requires inverse-spectrum control.
A frame flat on its sampled subspace — For μ 1 = ( 1 − 1 / κ ) δ 0 + κ − 1 δ β \mu_1=(1-1/\kappa)\delta_0+\kappa^{-1}\delta_\beta μ 1 = ( 1 − 1/ κ ) δ 0 + κ − 1 δ β , with 0 < β ≤ κ 0<\beta\le\kappa 0 < β ≤ κ , direct integration gives
C V = α β κ ( 1 + α β ) , C G = α β [ κ + ( κ − 1 ) α β ] κ ( 1 + α β ) 2 , h = 1 1 + α β . (202) C_V=\frac{\alpha\beta}{\kappa(1+\alpha\beta)}, \qquad C_G=\frac{\alpha\beta[\kappa+(\kappa-1)\alpha\beta]}{\kappa(1+\alpha\beta)^2}, \qquad h=\frac{1}{1+\alpha\beta}. \tag*{(202)} C V = κ ( 1 + α β ) α β , C G = κ ( 1 + α β ) 2 α β [ κ + ( κ − 1 ) α β ] , h = 1 + α β 1 . (202)
A physical realization in prime-power dimensions uses all n t r = b d n_{\mathrm{tr}}=bd n tr = b d projectors from b ∼ d / κ b\sim d/\kappa b ∼ d / κ mutually unbiased orthonormal bases, with n o u t = n t r n_{\mathrm{out}}=n_{\mathrm{tr}} n out = n tr [44 ] . Their mean is I d / d I_d/d I d / d , and their centered state Gram matrix has b b b blocks I d − 1 d 1 d T / d I_d-\mathbf{1}_d\mathbf{1}_d^{\mathsf T}/d I d − 1 d 1 d T / d . The frame therefore has b ( d − 1 ) b(d-1) b ( d − 1 ) positive eigenvalues d ( d + 1 ) / n t r → κ d(d+1)/n_{\mathrm{tr}}\to\kappa d ( d + 1 ) / n tr → κ , realizing β = κ \beta=\kappa β = κ ; uniform depolarization yields 0 < β ≤ κ 0<\beta\le\kappa 0 < β ≤ κ . Balanced effect traces and the bounded frame give flat categorical covariances for the independent Haar apparatus.
Haar training and a fixed apparatus — Retain flat categorical covariances and a bounded apparatus frame. For independent Haar pure training states, let ν \nu ν be the traceless spectral law of n o u t P 0 F μ P 0 n_{\mathrm{out}}P_0\mathcal{F}\mu P_0 n out P 0 F μ P 0 , including zeros. Then
ϕ = ∫ d ν ( λ ) 1 + α λ , h = 1 − κ + κ ϕ , \phi=\int\frac{d\nu(\lambda)}{1+\alpha\lambda}, \qquad h=1-\kappa+\kappa\phi, ϕ = ∫ 1 + α λ d ν ( λ ) , h = 1 − κ + κ ϕ ,
C V = α ϕ h , C G = κ ϕ ( 1 − ϕ ) . (203) C_V=\alpha\phi h, \qquad C_G=\kappa\phi(1-\phi). \tag*{(203)} C V = α ϕ h , C G = κ ϕ ( 1 − ϕ ) . (203)
The outcome covariance law is H = ( 1 − κ ) δ 1 + κ ( λ ↦ 1 + α λ ) ∗ ν H=(1-\kappa)\delta_1+\kappa(\lambda\mapsto1+\alpha\lambda)_*\nu H = ( 1 − κ ) δ 1 + κ ( λ ↦ 1 + α λ ) ∗ ν . The zero atom of ν \nu ν , of mass at least 1 − 1 / κ 1-1/\kappa 1 − 1/ κ , cancels the formally negative first term, so H H H is a probability law with harmonic moment h = ∫ t − 1 d H ( t ) > 0 h=\int t^{-1}dH(t)>0 h = ∫ t − 1 d H ( t ) > 0 . The positive-ridge scalar obeys 1 = η c + γ ∫ t c / ( 1 + t c ) d H ( t ) 1=\eta c+\gamma\int tc/(1+tc)\,dH(t) 1 = η c + γ ∫ t c / ( 1 + t c ) d H ( t ) . Its large-c c c expansion gives η c 2 + ( γ − 1 ) c ∼ h \eta c^2+(\gamma-1)c\sim h η c 2 + ( γ − 1 ) c ∼ h , from which the penalty derivatives yield the amplitudes. Haar training gives q d → 0 q_d\to0 q d → 0 , so physical and centered fixed-ridge limits agree.
Equal accessible apparatus strengths — For a flat accessible apparatus spectrum ν = ( 1 − 1 / κ ) δ 0 + κ − 1 δ x 0 \nu=(1-1/\kappa)\delta_0+\kappa^{-1}\delta_{x_0} ν = ( 1 − 1/ κ ) δ 0 + κ − 1 δ x 0 , with 0 < x 0 ≤ κ 0<x_0\le\kappa 0 < x 0 ≤ κ for a balanced physical POVM,
C V = α [ κ + ( κ − 1 ) α x 0 ] κ ( 1 + α x 0 ) 2 , C G = x 0 C V . (204) C_V=\frac{\alpha[\kappa+(\kappa-1)\alpha x_0]}{\kappa(1+\alpha x_0)^2}, \qquad C_G=x_0C_V. \tag*{(204)} C V = κ ( 1 + α x 0 ) 2 α [ κ + ( κ − 1 ) α x 0 ] , C G = x 0 C V . (204)
At small α \alpha α , C V ∼ α C_V\sim\alpha C V ∼ α and C G ∼ α x 0 C_G\sim\alpha x_0 C G ∼ α x 0 ; at large α \alpha α they approach ( κ − 1 ) / ( κ x 0 ) (\kappa-1)/(\kappa x_0) ( κ − 1 ) / ( κ x 0 ) and 1 − 1 / κ 1-1/\kappa 1 − 1/ κ . Both increase monotonically for κ ≥ 2 \kappa\ge2 κ ≥ 2 , whereas for 1 < κ < 2 1<\kappa<2 1 < κ < 2 they can exceed their large-shot limits.
Independent Haar states and apparatus — For independent Haar training states and a normalized Haar rank-one POVM, ν = μ M P , κ \nu=\mu_{\mathrm{MP},\kappa} ν = μ MP , κ includes a zero atom of mass 1 − 1 / κ 1-1/\kappa 1 − 1/ κ . The transform in eq. (179) with k = ℓ = 1 k=\ell=1 k = ℓ = 1 gives ϕ \phi ϕ . At fixed κ > 1 \kappa>1 κ > 1 , after the proportional limit,
\begin{aligned}
C_V &= \alpha+ O(\alpha^2),\\
C_G &= \kappa\alpha+ O(\alpha^2)
\end{aligned}
\qquad(\alpha\downarrow0). \tag*{(205)}\end{aligned}
\begin{aligned}
C_V &\longrightarrow\frac{1}{\kappa},\\
C_G &\longrightarrow1-\frac{1}{\kappa},\\
h &\sim\frac{1}{(\kappa-1)\alpha}
\end{aligned}
\qquad(\alpha\to\infty). \tag*{(206)}\end{aligned}
The variance amplitude C V = 1 − ϕ C_V=1-\phi C V = 1 − ϕ increases monotonically with α \alpha α . For 1 < κ < 2 1<\kappa<2 1 < κ < 2 , however, C G = κ ϕ ( 1 − ϕ ) C_G=\kappa\phi(1-\phi) C G = κ ϕ ( 1 − ϕ ) reaches C G max = κ 4 C_G^{\max}=\frac{\kappa}{4} C G m a x = 4 κ at α = 2 2 − κ \alpha=\frac{2}{2-\kappa} α = 2 − κ 2 , 1 < κ < 2 1<\kappa<2 1 < κ < 2 , exceeding its large-shot limit by ( 2 − κ ) 2 / ( 4 κ ) (2-\kappa)^2/(4\kappa) ( 2 − κ ) 2 / ( 4 κ ) ; for κ ≥ 2 \kappa\ge2 κ ≥ 2 it increases monotonically. Thus shot noise changes the undercomplete peak’s amplitude and width rather than creating its exact-data mechanism. The variance reduction at smaller budgets is illustrated in Figure 12 (b), but monotonicity need not hold for every geometry or both costs. The limit h → 0 h\to0 h → 0 makes large-shot and zero-ridge limits nonuniform. With M M M independent test shots, MSE N , M , τ = E N , τ + V N , τ / M \operatorname{MSE}_{N,M,\tau}=\mathcal{E}_{N,\tau}+V_{N,\tau}/M MSE N , M , τ = E N , τ + V N , τ / M .
Strict failure of the root condition — Failure of eq. (196) , interpreted by eq. (197) , excludes the positive-root expansion eq. (198) ; it does not alone establish bounded costs. Strict failure gives the following sufficient condition.
Proposition E2 (Bounded centered costs under strict failure of the root condition). Under eqs. (92) to (94) with κ > 1 \kappa>1 κ > 1 , suppose S S S is invertible on 1 / n o u t ⊥ 1/n_{\mathrm{out}}^{\perp} 1/ n out ⊥ at n o u t = n t r n_{\mathrm{out}}=n_{\mathrm{tr}} n out = n tr for all sufficiently large dimensions and
lim sup d → ∞ 1 n o u t − 1 ∑ j = 1 n o u t − 1 1 λ j < 1. (207) \limsup_{d\to\infty}\frac{1}{n_{\mathrm{out}}-1}\sum_{j=1}^{n_{\mathrm{out}}-1}\frac{1}{\lambda_j}<1. \tag*{(207)} d → ∞ lim sup n out − 1 1 j = 1 ∑ n out − 1 λ j 1 < 1. (207) Then the centered deterministic costs at interpolation remain bounded as η ↓ 0 \eta\downarrow0 η ↓ 0 after the proportional limit.
Proof. Strict root failure keeps the filter finite — Work at n o u t = n t r n_{\mathrm{out}}=n_{\mathrm{tr}} n out = n tr and use the existing fixed-point variables e , u , v , f , j e,u,v,f,j e , u , v , f , j and R ♯ \mathcal{R}^{\sharp} R ♯ from eqs. (157) and (158) , with z = 0 z=0 z = 0 and finite-dimensional ratio γ d = n o u t − 1 n t r = 1 − 1 / n t r \gamma_d=\frac{n_{\mathrm{out}}-1}{n_{\mathrm{tr}}}=1-1/n_{\mathrm{tr}} γ d = n tr n out − 1 = 1 − 1/ n tr . Since u , v ≥ 0 u,v\ge0 u , v ≥ 0 , invertibility of S S S gives R ♯ ⪯ S − 1 \mathcal{R}^{\sharp}\preceq S^{-1} R ♯ ⪯ S − 1 . Consequently,
1 − e = γ d f ≤ γ d 1 n o u t − 1 Tr ( n o u t Σ ‾ t r S − 1 ) = γ d 1 n o u t − 1 ∑ j = 1 n o u t − 1 λ j − 1 . (208) 1-e=\gamma_d f\le\gamma_d\frac{1}{n_{\mathrm{out}}-1}\operatorname{Tr}(n_{\mathrm{out}}\overline{\Sigma}_{\mathrm{tr}}S^{-1})=\gamma_d\frac{1}{n_{\mathrm{out}}-1}\sum_{j=1}^{n_{\mathrm{out}}-1}\lambda_j^{-1}. \tag*{(208)} 1 − e = γ d f ≤ γ d n out − 1 1 Tr ( n out Σ tr S − 1 ) = γ d n out − 1 1 j = 1 ∑ n out − 1 λ j − 1 . (208)
Since γ d = n o u t − 1 n t r < 1 \gamma_d=\frac{n_{\mathrm{out}}-1}{n_{\mathrm{tr}}}<1 γ d = n tr n out − 1 < 1 at n o u t = n t r n_{\mathrm{out}}=n_{\mathrm{tr}} n out = n tr , the strict upper limit in eq. (207) makes e e e uniformly positive. The categorical lower bound also gives j ≤ f / c j\le f/c j ≤ f / c . The second scalar balance therefore implies u = η / e = O ( η ) u=\eta/e=O(\eta) u = η / e = O ( η ) and v = O ( η + n t r − 1 ) v=O(\eta+n_{\mathrm{tr}}^{-1}) v = O ( η + n tr − 1 ) , uniformly in dimension.
Bounding the centered residual — At n o u t = n t r n_{\mathrm{out}}=n_{\mathrm{tr}} n out = n tr , the centered training frame has rank at most n t r − 1 = ( n o u t − 1 ) n_{\mathrm{tr}}-1=(n_{\mathrm{out}}-1) n tr − 1 = ( n out − 1 ) . Invertibility of S S S forces that rank to equal n o u t − 1 n_{\mathrm{out}}-1 n out − 1 , and F ρ c M ~ μ F_\rho^{c}\widetilde{M}_\mu F ρ c M μ spans its range. The corresponding projection identity is
F ρ c = F ρ c M ~ μ S − 1 M ~ μ T F ρ c . (209) F_\rho^{c}=F_\rho^{c}\widetilde{M}_\mu S^{-1}\widetilde{M}_\mu^{\mathsf{T}}F_\rho^{c}. \tag*{(209)} F ρ c = F ρ c M μ S − 1 M μ T F ρ c . (209)
Using 0 ⪯ F ρ c ⪯ K P 0 0\preceq F_\rho^{c}\preceq KP_0 0 ⪯ F ρ c ⪯ K P 0 , the residual in eq. (158) satisfies
0 ≤ H = 1 d 2 − 1 Tr ( F ρ c M ~ μ ( S − 1 − R ♯ ) M ~ μ T F ρ c ) ≤ K d 2 − 1 Tr ( I n o u t − 1 − S R ♯ ) = K ( n o u t − 1 ) d 2 − 1 ( u j + v f ) = O ( η + n t r − 1 ) . (210) \begin{aligned}
0\le\mathcal{H}
&=\frac{1}{d^2-1}\operatorname{Tr}\left(F_\rho^{c}\widetilde{M}_\mu(S^{-1}-\mathcal{R}^{\sharp})\widetilde{M}_\mu^{\mathsf{T}}F_\rho^{c}\right)\\
&\le\frac{K}{d^2-1}\operatorname{Tr}(I_{n_{\mathrm{out}}-1}-S\mathcal{R}^{\sharp})
=\frac{K(n_{\mathrm{out}}-1)}{d^2-1}(uj+vf)
=O(\eta+n_{\mathrm{tr}}^{-1}). \tag*{(210)}
\end{aligned} 0 ≤ H = d 2 − 1 1 Tr ( F ρ c M μ ( S − 1 − R ♯ ) M μ T F ρ c ) ≤ d 2 − 1 K Tr ( I n out − 1 − S R ♯ ) = d 2 − 1 K ( n out − 1 ) ( u j + v f ) = O ( η + n tr − 1 ) . (210)
Here the trace inequality uses ( F ρ c ) 2 ⪯ K F ρ c (F_\rho^{c})^2\preceq KF_\rho^{c} ( F ρ c ) 2 ⪯ K F ρ c , and the equality follows from ( u I n o u t − 1 + v n o u t Σ ‾ t r + S ) R ♯ = I n o u t − 1 (uI_{n_{\mathrm{out}}-1}+vn_{\mathrm{out}}\overline{\Sigma}_{\mathrm{tr}}+S)\mathcal{R}^{\sharp}=I_{n_{\mathrm{out}}-1} ( u I n out − 1 + v n out Σ tr + S ) R ♯ = I n out − 1 . Since L d = e H \mathcal{L}_d=e\mathcal{H} L d = e H and 0 < e ≤ 1 0<e\le1 0 < e ≤ 1 , the minimized deterministic loss obeys L d ≤ C ( η + n t r − 1 ) \mathcal{L}_d\le C(\eta+n_{\mathrm{tr}}^{-1}) L d ≤ C ( η + n tr − 1 ) . Gaussian replication as in lemma D4 makes this loss nonnegative, nondecreasing and concave, just as each sampled penalized loss. Hence 0 ≤ ∂ η L d ≤ L d / η ≤ C [ 1 + ( n t r η ) − 1 ] 0 \le\partial_{\eta}\mathcal{L}_d \le\mathcal{L}_d/\eta\le C[1 + (n_{\mathrm{tr}}\eta)^{-1}] 0 ≤ ∂ η L d ≤ L d / η ≤ C [ 1 + ( n tr η ) − 1 ] . Taking the dimensional upper limit at fixed η > 0 \eta> 0 η > 0 , then η ↓ 0 \eta\downarrow0 η ↓ 0 , bounds the derivative without requiring a unique dimensional loss limit. For any bounded positive penalty direction W W W , the envelope identity eq. (111) bounds its penalty derivative by ∥ W ∥ o p ∂ η L d \lVert W\rVert_{\mathrm{op}}\partial_{\eta}\mathcal{L}_d ∥ W ∥ op ∂ η L d . Both derivative terms defining the centered costs are therefore bounded. The mixed term in G η , d G_{\eta,d} G η , d is bounded as well, because 0 ≤ Tr ( S R ♯ ) ≤ ( n o u t − 1 ) 0 \le\operatorname{Tr}(S R^{\sharp}) \le(n_{\mathrm{out}} - 1) 0 ≤ Tr ( S R ♯ ) ≤ ( n out − 1 ) . This proves the stated absence of a divergent centered fixed-ridge cost at interpolation, without asserting an unregularized inverse limit.
Boundary cases and physical scope — The bounded centered result does not automatically extend to the physical Moore–Penrose readout or its full ideal-test error: measured modes with small singular values and the empirical mean still require control. At the boundary where the inverse trace approaches one, ζ ∗ \zeta_{\ast} ζ ∗ can approach zero and different singular scaling is possible. A uniformly gapped measured Gram matrix, together with response and mean bounds, also yields bounded costs, but a fixed-positive-ridge comparison does not establish such a gap.
Targets and geometries outside the peak regime — Label structure can remove a peak despite a hard edge. With exact features, a target represented by weights satisfying ∥ w r e p r ∥ 2 / ( n o u t d Δ 0 2 ) = O ( 1 ) \lVert w_{\mathrm{repr}}\rVert^{2}/(n_{\mathrm{out}}d\Delta_{0}^{2}) = O(1) ∥ w repr ∥ 2 / ( n out d Δ 0 2 ) = O ( 1 ) has no inaccessible residual; its labels already contain the singular-value factors. Such a target is outside the independent isotropic target average. A zero traceless Born map gives C G = 0 C_{G} = 0 C G = 0 even if noise fitting produces C V > 0 C_{V} > 0 C V > 0 , violating measurement strength; collapsed training fluctuations violate noncollapse and need not produce either pole. Outside the positive-root, noncollapse regime, persistence of an exact-data instability requires separate spectral analysis.
Complete profiles and finite-resource limits
The peak laws of Appendix § 5.7 determine the singular contribution near interpolation, but comparisons with the full curves in section IV C also need the regular background. Section F1 evaluates that complete centered curve for Haar training and identifies the assumptions for its physical interpretation. Section F2 then treats fixed resources and fixed training-shot budgets, which lie outside the proportional regime N / [ d ( d + 1 ) ] → α > 0 N/[d(d + 1)] \to\alpha> 0 N / [ d ( d + 1 )] → α > 0 and need not display its divergent limit.
Complete centered curves for Haar training states
For independent Haar pure training states, proposition F1 gives the full centered test-variance and traceless-reconstruction curves, including the finite background omitted by the main-text peak expansion. The input is the apparatus eigenvalue law ν \nu ν on all traceless directions, including zeros. The quantities ϕ \phi ϕ and h h h below measure the unresolved fraction in minimum linear single-state reconstruction after N N N shots and set the ridge-rounding width, respectively. Under the stated trace balance and frame bounds, physical mean and identity corrections vanish at fixed positive ridge. Minimum-norm limits additionally require measured modes with small singular values to carry vanishing label-weighted inverse contribution, as specified in eq. (167) ; exact physical mean restoration is retained at zero ridge.
Proposition F1 (Complete centered Haar-training profiles). Let the training states be independent Haar pure states, independent of an apparatus with bounded rescaled frame as in eq. (93) and balanced traces max a ∣ n o u t P I , d , a − 1 ∣ ⟶ P 0 \max_a|n_{\mathrm{out}}P_{I,d,a}-1| \overset{\mathrm{P}}{\longrightarrow} 0 max a ∣ n out P I , d , a − 1∣ ⟶ P 0 . Let ν \nu ν be the limiting scaled apparatus law, including its zero modes on the d 2 − 1 d^2-1 d 2 − 1 -dimensional traceless operator space. Let κ ∈ ( 0 , ∞ ) \kappa\in(0,\infty) κ ∈ ( 0 , ∞ ) be fixed away from the measurement threshold κ = 1 \kappa= 1 κ = 1 . Write ϕ = ∫ ( 1 + α λ ) − 1 d ν ( λ ) \phi= \int(1+\alpha\lambda)^{-1}\,\mathrm{d}\nu(\lambda) ϕ = ∫ ( 1 + α λ ) − 1 d ν ( λ ) and h = 1 − κ + κ ϕ h = 1-\kappa+\kappa\phi h = 1 − κ + κ ϕ . In the proportional regime eq. (92) , with fixed α > 0 \alpha> 0 α > 0 and η > 0 \eta> 0 η > 0 , the conditional target-averaged centered profiles are determined by
H = ( 1 − κ ) δ 1 + κ ( 1 + α λ ) ∗ ν . (211) H = (1-\kappa)\delta_{1}+\kappa(1+\alpha\lambda)\ast\nu. \tag*{(211)} H = ( 1 − κ ) δ 1 + κ ( 1 + α λ ) ∗ ν . (211)
*For κ < 1 \kappa< 1 κ < 1 , the first term counts the extra outcome directions, whose categorical covariance is asymptotically one; the second counts the measured operator directions. For κ > 1 \kappa> 1 κ > 1 the expression is still a nonnegative probability measure: the rank of the Born map is at most n o u t − 1 n_{\mathrm{out}} - 1 n out − 1 , so ν \nu ν has an atom at zero of mass at least 1 − 1 / κ 1 - 1/\kappa 1 − 1/ κ . Its image at t = 1 t = 1 t = 1 cancels the formally negative ( 1 − κ ) δ 1 (1-\kappa)\delta_{1} ( 1 − κ ) δ 1 ; the remaining modes have total covariance 1 + α λ 1+\alpha\lambda 1 + α λ . The measure H H H in eq. (211) is therefore the limiting covariance law on the total outcome space. The mapped measure ( 1 + α λ ) ∗ ν (1+\alpha\lambda)\ast\nu ( 1 + α λ ) ∗ ν assigns t = 1 + α λ t = 1+\alpha\lambda t = 1 + α λ the same weight as λ \lambda λ . At fixed η > 0 \eta> 0 η > 0 , c > 0 c > 0 c > 0 parametrizes the regularized training inverse: η c \eta c η c is the normalized trace of its residual filter. The derivative c ′ = ∂ η c c' = \partial_{\eta}c c ′ = ∂ η c describes the response to ridge, and ν \nu ν the response of the residual-filter trace to a penalty weighted by the apparatus strength t − 1 t-1 t − 1 . They determine the profiles through
1 = η c + γ ∫ t c 1 + t c d H ( t ) , c ′ = − η + γ ∫ c t ( 1 + t c ) 2 d H ( t ) , v = − γ c ′ ∫ t ( t − 1 ) ( 1 + t c ) 2 d H ( t ) . (212) \begin{aligned}
1 &= \eta c+\gamma\int\frac{tc}{1+tc}\,\mathrm{d}H(t),\\
c'&=-\frac{\eta+\gamma\int\frac{c}{t(1+tc)^2}\,\mathrm{d}H(t)},\\
v&=-\gamma c'\int\frac{t(t-1)}{(1+tc)^2}\,\mathrm{d}H(t). \tag*{(212)}
\end{aligned} 1 c ′ v = η c + γ ∫ 1 + t c t c d H ( t ) , = − , η + γ ∫ t ( 1 + t c ) 2 c d H ( t ) = − γ c ′ ∫ ( 1 + t c ) 2 t ( t − 1 ) d H ( t ) . (212)
With t = 1 + α λ t=1+\alpha\lambda t = 1 + α λ in integrals over ν \nu ν ,
F η = α { ∫ t − 1 t 2 [ t c 1 + t c + η t c ′ ( 1 + t c ) 2 ] d ν ( λ ) + ϕ ( c + η c ′ ) } , (213) F_{\eta}=\alpha\left\{\int\frac{t-1}{t^2}\left[\frac{tc}{1+tc}+\frac{\eta tc'}{(1+tc)^2}\right]\mathrm{d}\nu(\lambda)+\phi(c+\eta c')\right\}, \tag*{(213)} F η = α { ∫ t 2 t − 1 [ 1 + t c t c + ( 1 + t c ) 2 η t c ′ ] d ν ( λ ) + ϕ ( c + η c ′ ) } , (213)
G η = ∫ ( 1 + c 1 + t c ) 2 d ν ( λ ) + v [ ϕ + ∫ t − 1 t ( 1 + t c ) 2 d ν ( λ ) ] . (214) G_{\eta}=\int\left(\frac{1+c}{1+tc}\right)^2\mathrm{d}\nu(\lambda)+v\left[\phi+\int\frac{t-1}{t(1+tc)^2}\mathrm{d}\nu(\lambda)\right]. \tag*{(214)} G η = ∫ ( 1 + t c 1 + c ) 2 d ν ( λ ) + v [ ϕ + ∫ t ( 1 + t c ) 2 t − 1 d ν ( λ ) ] . (214)
For the conditional target averages, convergence in probability is over the Haar training states and counts, and the apparatus draw when specified. The independent sphere, sign, and unitary-orbit target laws also give convergence of the realized centered costs to these profiles. The first equation in eq. (212) has a unique positive solution for every fixed η , γ > 0 \eta,\gamma>0 η , γ > 0 . With ϕ 2 = ∫ ( 1 + α λ ) − 2 d ν ( λ ) \phi_2=\int(1+\alpha\lambda)^{-2}\mathrm{d}\nu(\lambda) ϕ 2 = ∫ ( 1 + α λ ) − 2 d ν ( λ ) , the weighted inverse-tail condition eq. (167) gives the centered minimum-norm limits, for γ < 1 \gamma<1 γ < 1 ,
F 0 = α ( ϕ − ϕ 2 ) + α ϕ h γ 1 − γ , G 0 = ϕ 2 + κ ϕ ( 1 − ϕ ) γ 1 − γ . (215) F_0=\alpha(\phi-\phi_2)+\alpha\phi h\frac{\gamma}{1-\gamma},\qquad G_0=\phi_2+\kappa\phi(1-\phi)\frac{\gamma}{1-\gamma}. \tag*{(215)} F 0 = α ( ϕ − ϕ 2 ) + α ϕ h 1 − γ γ , G 0 = ϕ 2 + κ ϕ ( 1 − ϕ ) 1 − γ γ . (215)
For γ > 1 \gamma>1 γ > 1 , let c 0 > 0 c_0>0 c 0 > 0 solve 1 = γ ∫ t c 0 / ( 1 + t c 0 ) d H ( t ) 1=\gamma\int tc_0/(1+tc_0)\,\mathrm{d}H(t) 1 = γ ∫ t c 0 / ( 1 + t c 0 ) d H ( t ) and put v 0 = c 0 ∫ t ( t − 1 ) ( 1 + t c 0 ) − 2 d H / ∫ t ( 1 + t c 0 ) − 2 d H v_0=c_0\int t(t-1)(1+tc_0)^{-2}\mathrm{d}H/\int t(1+tc_0)^{-2}\mathrm{d}H v 0 = c 0 ∫ t ( t − 1 ) ( 1 + t c 0 ) − 2 d H / ∫ t ( 1 + t c 0 ) − 2 d H . Then
F 0 = α [ ∫ t − 1 t 2 t c 0 1 + t c 0 d ν ( λ ) + ϕ c 0 ] , G 0 = ∫ ( 1 + c 0 1 + t c 0 ) 2 d ν ( λ ) + v 0 [ ϕ + ∫ t − 1 t ( 1 + t c 0 ) 2 d ν ( λ ) ] . (216) F_0=\alpha\left[\int\frac{t-1}{t^2}\frac{tc_0}{1+tc_0}\,\mathrm{d}\nu(\lambda)+\phi c_0\right],\qquad G_0=\int\left(\frac{1+c_0}{1+tc_0}\right)^2\mathrm{d}\nu(\lambda)+v_0\left[\phi+\int\frac{t-1}{t(1+tc_0)^2}\mathrm{d}\nu(\lambda)\right]. \tag*{(216)} F 0 = α [ ∫ t 2 t − 1 1 + t c 0 t c 0 d ν ( λ ) + ϕ c 0 ] , G 0 = ∫ ( 1 + t c 0 1 + c 0 ) 2 d ν ( λ ) + v 0 [ ϕ + ∫ t ( 1 + t c 0 ) 2 t − 1 d ν ( λ ) ] . (216)
Proof. Haar training-frame bounds — We first check the hypotheses for the Haar examples. For independent pure Haar states the vectors d ( d + 1 ) P 0 v ρ i \sqrt{d(d+1)}P_0v_{\rho_i} d ( d + 1 ) P 0 v ρ i are centered and isotropic on the d 2 − 1 d^2-1 d 2 − 1 -dimensional traceless space, have squared norm d 2 − 1 d^2-1 d 2 − 1 , and have bounded directional fourth moments. The fourth-moment bounds follow by integrating [ Tr ( A ρ ) ] 4 [\operatorname{Tr}(A\rho)]^4 [ Tr ( A ρ ) ] 4 for a traceless Hermitian A A A :
E ρ [ Tr ( A ρ ) 4 ] = 3 ( Tr ( A 2 ) ) 2 + 6 Tr ( A 4 ) d ( d + 1 ) ( d + 2 ) ( d + 3 ) . (217) \mathbb{E}_{\rho}[\operatorname{Tr}(A\rho)^4]=\frac{3(\operatorname{Tr}(A^2))^2+6\operatorname{Tr}(A^4)}{d(d+1)(d+2)(d+3)}. \tag*{(217)} E ρ [ Tr ( A ρ ) 4 ] = d ( d + 1 ) ( d + 2 ) ( d + 3 ) 3 ( Tr ( A 2 ) ) 2 + 6 Tr ( A 4 ) . (217)
The sample upper bound lemma G7, with independent columns appended if necessary, therefore bounds the centered empirical frame at every fixed proportional ratio. Also q d = ∥ ρ ˉ − I d / d ∥ F 2 = O P ( n t r − 1 ) q_d=\lVert\bar{\rho}-I_d/d\rVert_F^2=O_{\mathbb{P}}(n_{\mathrm{tr}}^{-1}) q d = ∥ ρ ˉ − I d / d ∥ F 2 = O P ( n tr − 1 ) , by its exact mean ( 1 − 1 / d ) / n t r (1-1/d)/n_{\mathrm{tr}} ( 1 − 1/ d ) / n tr . The normalized frame trace tends to one.
Balanced covariance and physical mean — For an independent normalized Haar rank-one POVM, lemmas B2 and G8 give asymptotically equal effect traces and a bounded rescaled traceless frame. Conditional scalar Bernstein concentration of the independent Haar probabilities gives
max a ∣ n o u t p ˉ a − n o u t p I / d , a ∣ = O P ( log n o u t n t r + d log n o u t n t r ) = o P ( 1 ) . (218) \max_a\lvert n_{\mathrm{out}}\bar{p}_a-n_{\mathrm{out}}p_{I/d,a}\rvert=O_{\mathbb{P}}\left(\sqrt{\frac{\log n_{\mathrm{out}}}{n_{\mathrm{tr}}}+\frac{d\log n_{\mathrm{out}}}{n_{\mathrm{tr}}}}\right)=o_{\mathbb{P}}(1). \tag*{(218)} a max ∣ n out p ˉ a − n out p I / d , a ∣ = O P ( n tr log n out + n tr d log n out ) = o P ( 1 ) . (218)
Here n o u t p a i ≤ K d n_{\mathrm{out}}p_{a i}\leq Kd n out p ai ≤ K d and Var ( n o u t p a i ) ≤ K \operatorname{Var}(n_{\mathrm{out}}p_{a i})\leq K Var ( n out p ai ) ≤ K on the trace event, by the Haar state moments. Equations eqs. (89) and (112) then imply asymptotically flat training and test categorical covariances. The same conclusions hold for a fixed apparatus with balanced traces and a bounded rescaled frame. Its empirical mean descriptors obey q d = O P ( n t r − 1 ) q_d=O_{\mathbb{P}}(n_{\mathrm{tr}}^{-1}) q d = O P ( n tr − 1 ) and t d = o ( 1 ) t_d=o(1) t d = o ( 1 ) . Consequently lemmas D6 and D8 make all normalized mean and identity corrections vanish at every fixed η > 0 \eta> 0 η > 0 , including bounded ∣ C O ∣ / d Δ O 2 |\mathcal{C}_O|/\sqrt{d\Delta_O^2} ∣ C O ∣/ d Δ O 2 . This argument does not remove the separate inverse-tail requirement at zero penalty.
Joint feature and response covariance — Let B = M ~ μ B = \widetilde{M}_{\mu} B = M μ , T = I i n o u t − 1 + B T B T = I_{\mathrm{inout}-1} + B^{\mathsf{T}}B T = I inout − 1 + B T B , and C = P 0 − B T − 1 B T C = P_0 - BT^{-1}B^{\mathsf{T}} C = P 0 − B T − 1 B T . The eigenvalues of B B T BB^{\mathsf{T}} B B T have limiting law ( λ ↦ α λ ) ∗ ν (\lambda\mapsto\alpha\lambda)_*\nu ( λ ↦ α λ ) ∗ ν , so the eigenvalues of T T T have law H H H and ( d 2 − 1 ) − 1 Tr ( C ) → ϕ (d^2 - 1)^{-1}\operatorname{Tr}(C) \to\phi ( d 2 − 1 ) − 1 Tr ( C ) → ϕ . Before empirical centering, a training column and its operator response have the form x i = B T h i + g i x_i = B^{\mathsf{T}}h_i + g_i x i = B T h i + g i and h i = d ( d + 1 ) P 0 v ρ i h_i = \sqrt{d(d+1)}P_0v_{\rho_i} h i = d ( d + 1 ) P 0 v ρ i , where g i g_i g i is an independent standard real Gaussian vector. Their joint covariance is
E ( x i h i ) ( x i T h i T ) = ( T B T B P 0 ) . (219) \mathbb{E}\begin{pmatrix}x_i\\h_i\end{pmatrix}\begin{pmatrix}x_i^{\mathsf{T}} & h_i^{\mathsf{T}}\end{pmatrix}
=
\begin{pmatrix}T & B^{\mathsf{T}}\\B& P_0\end{pmatrix}. \tag*{(219)} E ( x i h i ) ( x i T h i T ) = ( T B B T P 0 ) . (219)
Haar spherical concentration gives Var ( h i T A h i ) ≤ K ( d 2 − 1 ) 2 ∥ A ∥ o p 2 / d \operatorname{Var}(h_i^{\mathsf{T}}Ah_i) \le K(d^2 - 1)^2\lVert A\rVert_{\mathrm{op}}^2/d Var ( h i T A h i ) ≤ K ( d 2 − 1 ) 2 ∥ A ∥ op 2 / d : the map from a unit state vector to this quadratic form has Lipschitz constant O ( ( d 2 − 1 ) ∥ A ∥ o p ) O((d^2 - 1)\lVert A\rVert_{\mathrm{op}}) O (( d 2 − 1 ) ∥ A ∥ op ) . Bounded transformations by B B B , together with the Gaussian quadratic and cross-term moment bounds, give the same vanishing normalized quadratic-form variance for the joint vector. Together with the sample upper bounds just verified, these estimates establish the hypotheses of lemma G10. The lemma permits evaluating the feature inverse, mixed response trace, and minimized response loss using Gaussian pairs with the same joint covariance. The original Haar regression residual is not assumed independent.
Loss from a scalar residual — For a commuting outcome penalty ℓ z ( t ) > 0 \ell_z(t) > 0 ℓ z ( t ) > 0 , let r z > 0 r_z > 0 r z > 0 solve the scalar balance below. The feature inverse has deterministic diagonal [ ℓ z ( t ) + t r z ] − 1 [\ell_z(t) + tr_z]^{-1} [ ℓ z ( t ) + t r z ] − 1 , while r z r_z r z is the normalized trace of the training residual filter. Completing the square in the joint Gaussian covariance gives the normalized loss
1 = r z + γ ∫ t r z ℓ z ( t ) + t r z d H ( t ) , 1 = r_z + \gamma\int\frac{tr_z}{\ell_z(t) + tr_z}\,dH(t), 1 = r z + γ ∫ ℓ z ( t ) + t r z t r z d H ( t ) ,
L z = ϕ r z + ∫ t − 1 t ℓ z ( t ) r z ℓ z ( t ) + t r z d ν ( λ ) . (220) \mathcal{L}_z = \phi r_z + \int\frac{t - 1}{t}\frac{\ell_z(t)r_z}{\ell_z(t) + tr_z}\,d\nu(\lambda). \tag*{(220)} L z = ϕ r z + ∫ t t − 1 ℓ z ( t ) + t r z ℓ z ( t ) r z d ν ( λ ) . (220)
The first term is the response covariance C C C left after its linear prediction from the features. The second term is the residual of that linear prediction. In integrals over ν \nu ν , t = 1 + α λ t = 1 + \alpha\lambda t = 1 + α λ ; zero apparatus modes are included. At ℓ 0 ( t ) = η \ell_0(t) = \eta ℓ 0 ( t ) = η , put r 0 = η c r_0 = \eta c r 0 = η c . The first balance becomes eq. (212) , and the loss is η c [ ϕ + ∫ ( t − 1 ) / ( t ( 1 + t c ) ) d ν ] \eta c[\phi+ \int(t - 1)/(t(1 + tc))\,d\nu] η c [ ϕ + ∫ ( t − 1 ) / ( t ( 1 + t c )) d ν ] . Its derivative with respect to a uniform penalty is F η / α F_\eta/\alpha F η / α by the envelope identity; direct differentiation gives precisely eq. (213) , including the term ϕ ( c + η c ′ ) \phi(c + \eta c') ϕ ( c + η c ′ ) .
Traceless reconstruction cost — For the Born metric choose ℓ z ( t ) = η + z ( t − 1 ) \ell_z(t) = \eta+ z(t - 1) ℓ z ( t ) = η + z ( t − 1 ) . Equivalently, writing r z = η c z r_z = \eta c_z r z = η c z , its deformed scalar equation is 1 = η c z + γ ∫ t c z 1 + t c z + z ( t − 1 ) / η d H 1 = \eta c_z + \gamma\int\frac{tc_z}{1 + tc_z + z(t - 1)/\eta}\,dH 1 = η c z + γ ∫ 1 + t c z + z ( t − 1 ) / η t c z d H . Differentiation at zero gives ∂ z r z ∣ 0 = − γ c ′ ∫ t ( t − 1 ) ( 1 + t c ) − 2 d H = v \left.\partial_z r_z\right|_0 = -\gamma c'\int t(t - 1)(1 + tc)^{-2}\,dH = v ∂ z r z ∣ 0 = − γ c ′ ∫ t ( t − 1 ) ( 1 + t c ) − 2 d H = v . The mixed prediction trace and the Born-metric quadratic trace are consequently
1 d 2 − 1 Tr ( B K ^ ) ⟶ ∫ ( t − 1 ) c 1 + t c d ν , \frac{1}{d^2 - 1}\operatorname{Tr}(B\widehat{K}) \longrightarrow\int\frac{(t - 1)c}{1 + tc}\,d\nu, d 2 − 1 1 Tr ( B K ) ⟶ ∫ 1 + t c ( t − 1 ) c d ν ,
∂ z L z ∣ 0 = ∫ ( ( t − 1 ) c 1 + t c ) 2 d ν + v [ ϕ + ∫ t − 1 t ( 1 + t c ) d ν ] . (221) \left.\partial_z\mathcal{L}_z\right|_0 = \int\left(\frac{(t - 1)c}{1 + tc}\right)^2d\nu+ v\left[\phi+ \int\frac{t - 1}{t(1 + tc)}\,d\nu\right]. \tag*{(221)} ∂ z L z ∣ 0 = ∫ ( 1 + t c ( t − 1 ) c ) 2 d ν + v [ ϕ + ∫ t ( 1 + t c ) t − 1 d ν ] . (221)
Combining the mixed and quadratic terms in eq. (123) leaves [ 1 − ( t − 1 ) c / ( 1 + t c ) ] 2 = [ ( 1 + c ) / ( 1 + t c ) ] 2 [1 - (t - 1)c/(1 + tc)]^2 = [(1 + c)/(1 + tc)]^2 [ 1 − ( t − 1 ) c / ( 1 + t c ) ] 2 = [( 1 + c ) / ( 1 + t c ) ] 2 , proving eq. (214) . The formulas include the regular background as well as the critical singularity. Their singular coefficients agree with theorem E1 for κ < 1 \kappa< 1 κ < 1 and with theorem E3 under its positive-root hypothesis for κ > 1 \kappa> 1 κ > 1 .
Zero-penalty limits on either side — For γ < 1 \gamma< 1 γ < 1 , the ridge equation gives c ∼ ( 1 − γ ) / η c \sim(1 - \gamma)/\eta c ∼ ( 1 − γ ) / η , and the limiting finite terms after the cancellation of the leading divergences yield eq. (215) . For γ > 1 \gamma> 1 γ > 1 , it admits the finite limit c 0 c_0 c 0 determined by the equation stated before eq. (216) , and direct substitution yields that formula. Passing from these positive-ridge limits to the actual centered minimum-norm costs requires eq. (167) , as proved in section E11b.
Finite resources and fixed training shots
The divergent proportional peak does not imply infinite error at fixed resources. Proposition F2 proves that finite multinomial records have finite error moments and that keeping N N N fixed while dimension grows leaves a positive fraction of outcomes unobserved. Unobserved outcomes leave zero rows in the measured matrix, so the fixed-shot behavior discussed in section IV C requires a separate limit in either measurement regime.
Combining the two shot budgets — For M M M independent test shots the physical costs always combine as MSE N , M , τ = E N , τ + V N , τ / M \operatorname{MSE}_{N,M,\tau} = \mathcal{E}_{N,\tau} + V_{N,\tau}/M MSE N , M , τ = E N , τ + V N , τ / M . Both costs include the physical empirical-mean contribution. The proposition distinguishes a fixed finite record, the limit with fixed N N N and n o u t , n t r ≍ d 2 n_{\rm out}, n_{\rm tr} \asymp d^2 n out , n tr ≍ d 2 , and a separate Haar absence calculation with d , N d, N d , N fixed.
Proposition F2 (Finite resources and fixed training shots). At fixed d , n o u t , n t r , N d, n_{\rm out}, n_{\rm tr}, N d , n out , n tr , N , bounded labels give finite prediction-error moments for the multinomial minimum-norm readout. If N N N is fixed, n o u t , n t r ≍ d 2 n_{\rm out}, n_{\rm tr} \asymp d^2 n out , n tr ≍ d 2 , n o u t / n t r → γ > 0 n_{\rm out}/n_{\rm tr} \to\gamma> 0 n out / n tr → γ > 0 , the frame bounds hold and n o u t − 1 ∑ a ∣ n o u t p ˉ a − 1 ∣ 2 → 0 n_{\rm out}^{-1}\sum_a\lvert n_{\rm out}\bar p_a-1\rvert^2\to0 n out − 1 ∑ a ∣ n out p ˉ a − 1 ∣ 2 → 0 , the number Z 0 Z_0 Z 0 of outcome rows absent from all training records satisfies
Z 0 / n o u t → P e − N / γ , rank P ^ N / n o u t ≤ 1 − e − N / γ + o P ( 1 ) . (222) Z_0/n_{\rm out} \xrightarrow{\mathbb{P}} e^{-N/\gamma}, \qquad\operatorname{rank}\widehat P_N/n_{\rm out}\le1-e^{-N/\gamma}+o_{\mathbb{P}}(1). \tag*{(222)} Z 0 / n out P e − N / γ , rank P N / n out ≤ 1 − e − N / γ + o P ( 1 ) . (222) For N = 1 N=1 N = 1 and Tr ( O 2 ) = 1 \operatorname{Tr}(O^2)=1 Tr ( O 2 ) = 1 , every record has MSE 1 , M , 0 ( O ) ≤ 4 \operatorname{MSE}_{1,M,0}(O)\le4 MSE 1 , M , 0 ( O ) ≤ 4 and V 1 , 0 ( O ) ≤ 1 V_{1,0}(O)\le1 V 1 , 0 ( O ) ≤ 1 .
For an independent Haar pure-state training list and a normalized rank-one Haar POVM, the expected fraction of unobserved rows can also be evaluated exactly at finite d , n o u t , n t r , N d,n_{\rm out},n_{\rm tr},N d , n out , n tr , N :
E Z 0 n o u t = E W [ { E U ( 1 − W U ) N } n t r ] . (223) \mathbb{E}\frac{Z_0}{n_{\rm out}}=\mathbb{E}_W\left[\left\{\mathbb{E}_U(1-WU)^N\right\}^{n_{\rm tr}}\right]. \tag*{(223)} E n out Z 0 = E W [ { E U ( 1 − W U ) N } n tr ] . (223) Here W ∼ Beta ( d , n o u t − d ) W\sim\operatorname{Beta}(d,n_{\rm out}-d) W ∼ Beta ( d , n out − d ) is an effect trace and, independently, U ∼ Beta ( 1 , d − 1 ) U\sim\operatorname{Beta}(1,d-1) U ∼ Beta ( 1 , d − 1 ) is its overlap with a Haar state; W U WU W U is the outcome probability. Writing u ˉ N = E [ Z 0 / n o u t ] \bar u_N=\mathbb{E}[Z_0/n_{\rm out}] u ˉ N = E [ Z 0 / n out ] , one finds in the separate limit n o u t , n t r → ∞ n_{\rm out},n_{\rm tr}\to\infty n out , n tr → ∞ at fixed d , N d,N d , N and n o u t / n t r → γ n_{\rm out}/n_{\rm tr}\to\gamma n out / n tr → γ ,
u ˉ N ⟶ ( 1 + N d γ ) − d . (224) \bar u_N\longrightarrow\left(1+\frac{N}{d\gamma}\right)^{-d}. \tag*{(224)} u ˉ N ⟶ ( 1 + d γ N ) − d . (224)
Proof. Finite records and unobserved outcomes — At fixed resources the count matrix has finite support and its pseudoinverse takes finitely many values. For the fixed-shot limit, the probability row a a a is unobserved is u a = ∏ i ( 1 − p a i ) N u_a=\prod_i(1-p_{ai})^N u a = ∏ i ( 1 − p ai ) N . The frame bounds and the balanced empirical mean imply n o u t − 1 ∑ a , i p a i 2 = O ( n o u t ) n_{\rm out}^{-1}\sum_{a,i}p_{ai}^2=O(n_{\rm out}) n out − 1 ∑ a , i p ai 2 = O ( n out ) . Discard the vanishing fraction of rows where the squared-probability sum or mean-probability imbalance is large. On the remaining rows, expanding log ( 1 − p a i ) \log(1-p_{ai}) log ( 1 − p ai ) gives log u a = − N ∑ i p a i + o ( 1 ) = − N n t r p ˉ a + o ( 1 ) → − N / γ \log u_a=-N\sum_i p_{ai}+o(1)=-Nn_{\rm tr}\bar p_a+o(1)\to-N/\gamma log u a = − N ∑ i p ai + o ( 1 ) = − N n tr p ˉ a + o ( 1 ) → − N / γ . Hence n o u t − 1 ∑ a u a → e − N / γ n_{\rm out}^{-1}\sum_a u_a\to e^{-N/\gamma} n out − 1 ∑ a u a → e − N / γ . Distinct absence indicators have nonpositive covariance, since 1 − p a i − p b i ≤ ( 1 − p a i ) ( 1 − p b i ) 1-p_{ai}-p_{bi}\le(1-p_{ai})(1-p_{bi}) 1 − p ai − p bi ≤ ( 1 − p ai ) ( 1 − p bi ) in every independent record. Thus Var Z 0 ≤ n o u t \operatorname{Var} Z_0\le n_{\rm out} Var Z 0 ≤ n out and eq. (222) follows. At N = 1 N=1 N = 1 , each observed outcome weight is the average of its assigned labels, and each unseen outcome receives zero. Targets with Tr ( O 2 ) = 1 \operatorname{Tr}(O^2)=1 Tr ( O 2 ) = 1 have ∥ O ∥ o p ≤ 1 \lVert O\rVert_{\rm op}\le1 ∥ O ∥ op ≤ 1 , so all these values lie in [ − 1 , 1 ] [-1,1] [ − 1 , 1 ] , giving the stated bounds.
Exact Haar absence probabilities — A row of a normalized Haar isometry has squared norm W ∼ Beta ( d , n o u t − d ) W\sim\operatorname{Beta}(d,n_{\rm out}-d) W ∼ Beta ( d , n out − d ) . Conditional on that row, a Haar pure training state has overlap U ∼ Beta ( 1 , d − 1 ) U\sim\operatorname{Beta}(1,d-1) U ∼ Beta ( 1 , d − 1 ) with its normalized direction, independently of W W W . Hence its outcome probability is W U WU W U . Conditional on W W W , the training states are independent, so the probability that none of the n t r n_{\rm tr} n tr records with N N N shots visits the row is [ E U ( 1 − W U ) N ] n t r \left[\mathbb{E}_U(1-WU)^N\right]^{n_{\rm tr}} [ E U ( 1 − W U ) N ] n tr . Taking the expectation over W W W and using exchangeability of the n o u t n_{\rm out} n out POVM rows proves eq. (223) .
Fixed-dimension absence limit — In the limit n o u t , n t r → ∞ n_{\rm out},n_{\rm tr}\to\infty n out , n tr → ∞ at fixed d , N d,N d , N , X = n o u t W / d X=n_{\rm out}W/d X = n out W / d converges to Gamma ( d , rate d ) \operatorname{Gamma}(d,\text{rate }d) Gamma ( d , rate d ) . Because E U = 1 / d \mathbb{E}U=1/d E U = 1/ d and n t r / n o u t → 1 / γ n_{\rm tr}/n_{\rm out}\to1/\gamma n tr / n out → 1/ γ , the conditional absence probability converges to e − N X / γ e^{-NX/\gamma} e − N X / γ . Its expectation is the Gamma Laplace transform ( 1 + N / ( d γ ) ) − d (1+N/(d\gamma))^{-d} ( 1 + N / ( d γ ) ) − d , proving eq. (224) . □
Effect imbalance slows outcome discovery — Taking logarithms of eq. (224) gives the absence rate − N − 1 log u ˉ N ≃ ( d / N ) log [ 1 + N / ( d γ ) ] -N^{-1}\log\bar u_N\simeq(d/N)\log[1+N/(d\gamma)] − N − 1 log u ˉ N ≃ ( d / N ) log [ 1 + N / ( d γ )] . For N / ( d γ ) ≪ 1 N/(d\gamma)\ll1 N / ( d γ ) ≪ 1 , the rate is 1 / γ − N / ( 2 d γ 2 ) + O ( N 2 / ( d 2 γ 3 ) ) 1/\gamma-N/(2d\gamma^2)+O(N^2/(d^2\gamma^3)) 1/ γ − N / ( 2 d γ 2 ) + O ( N 2 / ( d 2 γ 3 )) . Weaker effects remain unseen longer, reducing the decay rate by N / ( 2 d γ 2 ) N/(2d\gamma^2) N / ( 2 d γ 2 ) at first order. For a small relative error in u ˉ N \bar u_N u ˉ N , truncating log u ˉ N \log\bar u_N log u ˉ N after its correction + N 2 / ( 2 d γ 2 ) +N^2/(2d\gamma^2) + N 2 / ( 2 d γ 2 ) also requires N 3 / ( d 2 γ 3 ) ≪ 1 N^3/(d^2\gamma^3)\ll1 N 3 / ( d 2 γ 3 ) ≪ 1 . The unexpanded expression eq. (224) retains all orders in N / ( d γ ) N/(d\gamma) N / ( d γ ) ; eq. (223) additionally retains finite-n o u t n_{\rm out} n out corrections.
Shared matrix and covariance estimates
The shared estimates justify three distinct steps in the physical argument: transferring Gaussian spectra to exact Haar frames, controlling the inverse weights that amplify classical test noise, and evaluating finite-shot regression at positive penalty. The spectral comparisons in section G1, lift and frame estimates in section G2, and covariance formulas in section G3 provide these steps. Norms, compressions and vectorization follow Appendix A; matrix and sample dimensions below are generic unless the physical POVM is specified.
Spectral comparisons and Gaussian normalization
The spectrum theorem theorem B1 starts from independent Gaussian lifts, then restores Haar normalization and removes the identity direction. Near-identity congruence controls each positive eigenvalue, while interlacing controls the empirical spectrum after compression or a finite-rank change. The same multiplicative comparison transfers the inverse spectral weight in the classical variance proof eq. (72) .
Lemma G1 (Spectral comparisons). Let A ⪰ 0 A \succeq0 A ⪰ 0 have rank r r r , and let T T T be invertible. The ordered positive eigenvalues of A A A and T A T † TAT^{\dagger} T A T † satisfy
s min ( T ) 2 λ i ≤ λ ~ i ≤ ∥ T ∥ o p 2 λ i . s_{\min}(T)^2\lambda_i \leq\widetilde{\lambda}_i \leq\lVert T\rVert_{\mathrm{op}}^2\lambda_i. s m i n ( T ) 2 λ i ≤ λ i ≤ ∥ T ∥ op 2 λ i . In particular, if ∥ T − I ∥ o p ≤ δ < 1 \lVert T-I\rVert_{\mathrm{op}}\leq\delta<1 ∥ T − I ∥ op ≤ δ < 1 , then
( 1 − δ ) 2 λ i ≤ λ ~ i ≤ ( 1 + δ ) 2 λ i , 1 ≤ i ≤ r . (225) (1-\delta)^2\lambda_i \leq\widetilde{\lambda}_i \leq(1+\delta)^2\lambda_i,\qquad1\leq i\leq r. \tag*{(225)} ( 1 − δ ) 2 λ i ≤ λ i ≤ ( 1 + δ ) 2 λ i , 1 ≤ i ≤ r . (225) For a Hermitian ( p + 1 ) × ( p + 1 ) (p+1)\times(p+1) ( p + 1 ) × ( p + 1 ) matrix, compression to a p p p -dimensional subspace gives λ j + 1 ( A ) ≤ λ ~ j ≤ λ j ( A ) \lambda_{j+1}(A)\leq\widetilde{\lambda}_j\leq\lambda_j(A) λ j + 1 ( A ) ≤ λ j ≤ λ j ( A ) , 1 ≤ j ≤ p 1\leq j\leq p 1 ≤ j ≤ p . More generally, for Hermitian p × p p\times p p × p matrices with rank ( A − B ) ≤ k \operatorname{rank}(A-B)\leq k rank ( A − B ) ≤ k ,
λ j + k ( A ) ≤ λ j ( B ) ≤ λ j − k ( A ) , (226) \lambda_{j+k}(A)\leq\lambda_j(B)\leq\lambda_{j-k}(A), \tag*{(226)} λ j + k ( A ) ≤ λ j ( B ) ≤ λ j − k ( A ) , (226) where missing end indices are ignored. Their empirical distribution functions differ by at most k / p k/p k / p .
Proof. Congruence bounds — The positive eigenvalues of T A T † TAT^{\dagger} T A T † are the squared nonzero singular values of T A 1 / 2 TA^{1/2} T A 1/2 . Singular-value inequalities give the first claim, and 1 − δ ≤ s min ( T ) ≤ ∥ T ∥ o p ≤ 1 + δ 1-\delta\leq s_{\min}(T)\leq\lVert T\rVert_{\mathrm{op}}\leq1+\delta 1 − δ ≤ s m i n ( T ) ≤ ∥ T ∥ op ≤ 1 + δ gives eq. (225) .
Compression and finite-rank interlacing — The compression is a principal submatrix in a basis adapted to the subspace, so Cauchy interlacing applies. For the finite-rank claim, intersect the subspaces in the Courant–Fischer principle with ker ( A − B ) \ker(A-B) ker ( A − B ) , whose codimension is at most k k k . The dimension shift gives eq. (226) ; counting eigenvalues above each threshold gives the distribution-function bound.
Inverse weight from column distances — Below informational completeness, the independent lift columns have full column rank. The identity below expresses their inverse spectral weight as a sum of inverse squared distances from each column to the others; concentration of those distances gives the undercomplete branch of the classical peak in eq. (75) .
Lemma G2 (Negative second moment identity). Let Y ∈ C P × n Y\in\mathbb{C}^{P\times n} Y ∈ C P × n with n ≤ P n\leq P n ≤ P have linearly independent columns y 1 , … , y n y_1,\ldots,y_n y 1 , … , y n and let H a ≡ span { y b : b ≠ a } H_a\equiv\operatorname{span}\{y_b:b\ne a\} H a ≡ span { y b : b = a } . Then
∑ a = 1 n 1 s a ( Y ) 2 = Tr ( ( Y † Y ) − 1 ) = ∑ a = 1 n 1 dist ( y a , H a ) 2 . (227) \sum_{a=1}^{n}\frac{1}{s_a(Y)^2}
=\operatorname{Tr}\left((Y^{\dagger}Y)^{-1}\right)
=\sum_{a=1}^{n}\frac{1}{\operatorname{dist}(y_a,H_a)^2}. \tag*{(227)} a = 1 ∑ n s a ( Y ) 2 1 = Tr ( ( Y † Y ) − 1 ) = a = 1 ∑ n dist ( y a , H a ) 2 1 . (227) where s 1 , … , s n s_1,\ldots,s_n s 1 , … , s n are the nonzero singular values of Y Y Y .
Proof. Column-distance identity — The singular-value equality is immediate. Let G = Y † Y G=Y^{\dagger}Y G = Y † Y and let Y − a Y_{-a} Y − a omit column a a a . Its Schur complement gives
( G − 1 ) a a = [ ∥ y a ∥ 2 − y a † Y − a ( Y − a † Y − a ) − 1 Y − a † y a ] − 1 = dist ( y a , H a ) − 2 , (G^{-1})_{aa}
=\left[\lVert y_a\rVert^2-y_a^{\dagger}Y_{-a}(Y_{-a}^{\dagger}Y_{-a})^{-1}Y_{-a}^{\dagger}y_a\right]^{-1}
=\operatorname{dist}(y_a,H_a)^{-2}, ( G − 1 ) aa = [ ∥ y a ∥ 2 − y a † Y − a ( Y − a † Y − a ) − 1 Y − a † y a ] − 1 = dist ( y a , H a ) − 2 ,
since the matrix between y a † y_a^{\dagger} y a † and y a y_a y a is the projector onto H a H_a H a . Sum over a a a .
Haar normalization — The exact Gaussian construction lemma B1 multiplies the lifted columns by a map induced by S − 1 / 2 S^{-1/2} S − 1/2 . The bounds below make that map close to the identity when n ≫ d n\gg d n ≫ d , allowing lemma G1 to transfer the Gaussian spectrum to the normalized POVM.
Lemma G3 (Gaussian singular values). Let G ^ ∈ C n × d \widehat{G}\in\mathbb{C}^{n\times d} G ∈ C n × d have i.i.d. C N ( 0 , 1 ) \mathcal{CN}(0,1) C N ( 0 , 1 ) entries. Assume n ≥ d n\geq d n ≥ d . Let s min ( G ^ ) s_{\min}(\widehat{G}) s m i n ( G ) and s max ( G ^ ) s_{\max}(\widehat{G}) s m a x ( G ) be respectively the smallest and largest nonzero singular values. Then for every t ≥ 0 t\geq0 t ≥ 0 ,
P ( n − d − t ≤ s min ( G ^ ) ≤ s max ( G ^ ) ≤ n + d + t ) ≥ 1 − 2 e − t 2 / 2 . (228) \mathbb{P}\left(\sqrt{n}-\sqrt{d}-t\leq s_{\min}(\widehat{G})\leq s_{\max}(\widehat{G})\leq\sqrt{n}+\sqrt{d}+t\right)\geq1-2e^{-t^2/2}. \tag*{(228)} P ( n − d − t ≤ s m i n ( G ) ≤ s m a x ( G ) ≤ n + d + t ) ≥ 1 − 2 e − t 2 /2 . (228) For S = n − 1 G ^ † G ^ S=n^{-1}\widehat{G}^{\dagger}\widehat{G} S = n − 1 G † G , the same event gives, when d / n + t / n ≤ 1 \sqrt{d/n}+t/\sqrt{n}\leq1 d / n + t / n ≤ 1 ,
λ min ( S ) ≥ ( 1 − d / n − t n ) 2 , λ max ( S ) ≤ ( 1 + d / n + t n ) 2 . (229) \lambda_{\min}(S)\geq\left(1-\sqrt{d/n}-\frac{t}{\sqrt{n}}\right)^2,\qquad
\lambda_{\max}(S)\leq\left(1+\sqrt{d/n}+\frac{t}{\sqrt{n}}\right)^2. \tag*{(229)} λ m i n ( S ) ≥ ( 1 − d / n − n t ) 2 , λ m a x ( S ) ≤ ( 1 + d / n + n t ) 2 . (229)
In particular, if n ≫ d n \gg d n ≫ d then ∥ S − I ∥ op = O P ( d / n ) \lVert S-I\rVert_{\operatorname{op}}=O_{\mathrm{P}}(\sqrt{d/n}) ∥ S − I ∥ op = O P ( d / n ) .
If the eigenvalues of S S S lie in [ 1 − ε , 1 + ε ] [1-\varepsilon,1+\varepsilon] [ 1 − ε , 1 + ε ] with ε ∈ ( 0 , 1 ) \varepsilon\in(0,1) ε ∈ ( 0 , 1 ) , then
∥ S − 1 / 2 − I ∥ op ≤ max { 1 1 − ε − 1 , 1 − 1 1 + ε } ≤ ε 1 − ε . (230) \left\lVert S^{-1/2}-I\right\rVert_{\operatorname{op}}\leq\max\left\{\frac{1}{\sqrt{1-\varepsilon}}-1,1-\frac{1}{\sqrt{1+\varepsilon}}\right\}\leq\frac{\varepsilon}{1-\varepsilon}. \tag*{(230)} S − 1/2 − I op ≤ max { 1 − ε 1 − 1 , 1 − 1 + ε 1 } ≤ 1 − ε ε . (230)
Proof. Concentration and spectral calculus — The singular-value estimate is Gaussian concentration [24 ] . Square the singular values of n − 1 / 2 G ^ n^{-1/2}\widehat{G} n − 1/2 G under the stated nonnegativity condition to obtain the eigenvalue bounds. Spectral calculus gives the inverse-square-root estimate.
Gaussian lifts and empirical frame bounds
The MP criterion below, verified for Gaussian rank-one lifts in lemma G4, yields the bulk spectrum in theorem B1 despite dependence among coordinates of each lift. The distance and small-ball estimates then control inverse weights in theorem C1, which the bulk law alone does not determine. Separate fourth-moment bounds control the largest eigenvalues of the centered training frame and traceless-compressed POVM frame, verifying the empirical geometry assumptions eq. (93) for the finite-shot Haar examples.
Theorem G1 (MP law under quadratic-form concentration [45 ] ). Let x 1 , … , x n ∈ C p x_1,\ldots,x_n\in\mathbb{C}^p x 1 , … , x n ∈ C p be i.i.d. with E x i = 0 \mathbb{E}x_i=0 E x i = 0 and E [ x i x i † ] = I p \mathbb{E}[x_i x_i^\dagger]=I_p E [ x i x i † ] = I p . Assume that for every deterministic Hermitian A A A with ∥ A ∥ op ≤ 1 \lVert A\rVert_{\operatorname{op}}\leq1 ∥ A ∥ op ≤ 1 , p − 1 ( x 1 † A x 1 − Tr ( A ) ) ⟶ P 0 p^{-1}(x_1^\dagger A x_1-\operatorname{Tr}(A))\mathrel{\overset{\mathrm{P}}{\longrightarrow}}0 p − 1 ( x 1 † A x 1 − Tr ( A )) ⟶ P 0 . If p , n → ∞ p,n\to\infty p , n → ∞ with p / n → γ ∞ ∈ ( 0 , ∞ ) p/n\to\gamma_\infty\in(0,\infty) p / n → γ ∞ ∈ ( 0 , ∞ ) , the empirical spectrum of W = n − 1 ∑ a = 1 n x a x a † W=n^{-1}\sum_{a=1}^n x_a x_a^\dagger W = n − 1 ∑ a = 1 n x a x a † converges almost surely to μ M P , γ ∞ \mu_{\mathrm{MP},\gamma_\infty} μ MP , γ ∞ .
Lemma G4 (Quadratic-form concentration for Gaussian rank-one lifts). For g ∼ C N ( 0 , I d ) g\sim\mathcal{CN}(0,I_d) g ∼ C N ( 0 , I d ) and m = vec ( g g † − I d ) m=\operatorname{vec}(gg^\dagger-I_d) m = vec ( g g † − I d ) , every deterministic Hermitian H H H with ∥ H ∥ op ≤ 1 \lVert H\rVert_{\operatorname{op}}\leq1 ∥ H ∥ op ≤ 1 satisfies d − 2 ( m † H m − Tr ( H ) ) ⟶ P 0 d^{-2}(m^\dagger Hm-\operatorname{Tr}(H))\mathrel{\overset{\mathrm{P}}{\longrightarrow}}0 d − 2 ( m † H m − Tr ( H )) ⟶ P 0 as d → ∞ d\to\infty d → ∞ .
Proof. Variance of the lifted quadratic form — The coordinate map is an isometry, so H H H induces a self-adjoint operator Φ H \Phi_H Φ H on matrices with ∥ Φ H ∥ op ≤ 1 \lVert\Phi_H\rVert_{\operatorname{op}}\leq1 ∥ Φ H ∥ op ≤ 1 . Set F ( g ) = ⟨ g g † − I d , Φ H ( g g † − I d ) ⟩ F(g)=\langle gg^\dagger-I_d,\Phi_H(gg^\dagger-I_d)\rangle F ( g ) = ⟨ g g † − I d , Φ H ( g g † − I d )⟩ . Wick’s identity gives E F = Tr ( H ) \mathbb{E}F=\operatorname{Tr}(H) E F = Tr ( H ) . Differentiating along h ∈ C d h\in\mathbb{C}^d h ∈ C d gives D F ( g ) [ h ] = 2 Re ⟨ g h † + h g † , Φ H ( g g † − I d ) ⟩ DF(g)[h]=2\operatorname{Re}\langle gh^\dagger+hg^\dagger,\Phi_H(gg^\dagger-I_d)\rangle D F ( g ) [ h ] = 2 Re ⟨ g h † + h g † , Φ H ( g g † − I d )⟩ . Consequently, Gaussian Poincaré in the 2 d 2d 2 d real coordinates yields
∥ ∇ F ( g ) ∥ 2 ≤ 4 ∥ g ∥ 2 ∥ g g † − I d ∥ F , Var F ≤ C E [ ∥ g ∥ 2 2 ∥ g g † − I d ∥ F 2 ] = O ( d 3 ) . (231) \lVert\nabla F(g)\rVert_2\leq4\lVert g\rVert_2\lVert gg^\dagger-I_d\rVert_F,\qquad\operatorname{Var}F\leq C\mathbb{E}\left[\lVert g\rVert_2^2\lVert gg^\dagger-I_d\rVert_F^2\right]=O(d^3). \tag*{(231)} ∥ ∇ F ( g ) ∥ 2 ≤ 4 ∥ g ∥ 2 ∥ g g † − I d ∥ F , Var F ≤ C E [ ∥ g ∥ 2 2 ∥ g g † − I d ∥ F 2 ] = O ( d 3 ) . (231)
The last estimate uses ∥ g g † − I d ∥ F 2 = ∥ g ∥ 4 − 2 ∥ g ∥ 2 + d \lVert gg^\dagger-I_d\rVert_F^2=\lVert g\rVert^4-2\lVert g\rVert^2+d ∥ g g † − I d ∥ F 2 = ∥ g ∥ 4 − 2 ∥ g ∥ 2 + d and E ∥ g ∥ k = O ( d k / 2 ) \mathbb{E}\lVert g\rVert^k=O(d^{k/2}) E ∥ g ∥ k = O ( d k /2 ) for each fixed k k k . Chebyshev’s inequality now bounds the probability of a normalized deviation exceeding ε \varepsilon ε by O ( ε − 2 d − 1 ) O(\varepsilon^{-2}d^{-1}) O ( ε − 2 d − 1 ) .
Distances for undercomplete measurements — Taking Q Q Q to project onto the orthogonal complement of the other lift columns turns x † Q x x^\dagger Qx x † Q x into the squared distance in lemma G2. The uniform tail below permits a union bound over the columns in eq. (74) ; the resulting squared distances stay of order d 2 − n o u t d^2-n_{\mathrm{out}} d 2 − n out at fixed γ o u t > 1 \gamma_{\mathrm{out}}>1 γ out > 1 .
Lemma G5 (Uniform concentration of the lifted distances). Let g ^ ∼ C N ( 0 , I d ) \hat{g}\sim\mathcal{CN}(0,I_d) g ^ ∼ C N ( 0 , I d ) , let x = vec ( g ^ g ^ † ) x=\operatorname{vec}(\hat{g}\hat{g}^\dagger) x = vec ( g ^ g ^ † ) , and let Q Q Q be an orthogonal projector on C d 2 \mathbb{C}^{d^2} C d 2 of rank R R R , independent of g ^ \hat{g} g ^ . Then
E [ x † Q x ∣ Q ] = R + ∥ Q v I d ∥ 2 ∈ [ R , R + d ] , (232) \mathbb{E}\left[x^\dagger Qx\mid Q\right]=R+\lVert Qv_{I_d}\rVert^2\in[R,R+d], \tag*{(232)} E [ x † Q x ∣ Q ] = R + ∥ Q v I d ∥ 2 ∈ [ R , R + d ] , (232) and there are universal constants c , C > 0 c,C>0 c , C > 0 such that, for every t ∈ ( 0 , 1 / 2 ) t\in(0,1/2) t ∈ ( 0 , 1/2 ) ,
P ( ∣ x † Q x d 2 − R d 2 ∣ ≥ C ( t + 1 d ) ∣ Q ) ≤ C exp ( − c d t 2 ) . (233) \mathbb{P}\left(\left.\left|\frac{x^\dagger Qx}{d^2}-\frac{R}{d^2}\right|\geq C\left(t+\frac{1}{\sqrt{d}}\right)\right|Q\right)\leq C\exp(-cdt^2). \tag*{(233)} P ( d 2 x † Q x − d 2 R ≥ C ( t + d 1 ) Q ) ≤ C exp ( − c d t 2 ) . (233)
Proof. Conditional mean — Write g ^ = u h \hat{g}=\sqrt{u}\,h g ^ = u h with u = ∥ g ^ ∥ 2 ∼ Γ ( d , 1 ) u=\lVert\hat{g}\rVert^2\sim\Gamma(d,1) u = ∥ g ^ ∥ 2 ∼ Γ ( d , 1 ) independent of the uniform unit vector h ∈ C d h\in\mathbb{C}^d h ∈ C d . Then x † Q x = u 2 φ ( h ) x^\dagger Qx=u^2\varphi(h) x † Q x = u 2 φ ( h ) , where φ ( h ) = ∥ Q vec ( h h † ) ∥ 2 ∈ [ 0 , 1 ] \varphi(h)=\lVert Q\operatorname{vec}(hh^\dagger)\rVert^2\in[0,1] φ ( h ) = ∥ Q vec ( h h † ) ∥ 2 ∈ [ 0 , 1 ] . By eq. (33) , E [ φ ∣ Q ] = ( R + ∥ Q v I d ∥ 2 ) / [ d ( d + 1 ) ] \mathbb{E}[\varphi\mid Q]=(R+\lVert Qv_{I_d}\rVert^2)/[d(d+1)] E [ φ ∣ Q ] = ( R + ∥ Q v I d ∥ 2 ) / [ d ( d + 1 )] . Since E u 2 = d ( d + 1 ) \mathbb{E}u^2=d(d+1) E u 2 = d ( d + 1 ) and ∥ Q v I d ∥ 2 ≤ d \lVert Qv_{I_d}\rVert^2\leq d ∥ Q v I d ∥ 2 ≤ d , the conditional mean is eq. (232) .
Angular and radial concentration — The estimate ∥ h h † − h ′ h ′ † ∥ F ≤ 2 ∥ h − h ′ ∥ \lVert hh^\dagger-h'h'^\dagger\rVert_F\leq2\lVert h-h'\rVert ∥ h h † − h ′ h ′ † ∥ F ≤ 2 ∥ h − h ′ ∥ makes φ \varphi φ 4 4 4 -Lipschitz on S 2 d − 1 S^{2d-1} S 2 d − 1 . Lévy’s inequality therefore gives, uniformly in Q Q Q ,
P ( ∣ φ − E φ ∣ ≥ t + C d − 1 / 2 ∣ Q ) ≤ 2 e − c d t 2 . (234) \mathbb{P}\left(\left|\varphi-\mathbb{E}\varphi\right|\geq t+Cd^{-1/2}\mid Q\right)\leq2e^{-cdt^2}. \tag*{(234)} P ( ∣ φ − E φ ∣ ≥ t + C d − 1/2 ∣ Q ) ≤ 2 e − c d t 2 . (234)
The O ( d − 1 / 2 ) O(d^{-1/2}) O ( d − 1/2 ) mean–median gap follows by integrating the concentration tail. Meanwhile eq. (44) gives P ( ∣ u − d ∣ ≥ t d ) ≤ 2 e − t 2 d / 3 \mathbb{P}(|u-d|\geq td)\leq2e^{-t^{2}d/3} P ( ∣ u − d ∣ ≥ t d ) ≤ 2 e − t 2 d /3 . On the intersection of these events, x † Q x = d 2 ( 1 + O ( t ) ) [ R / d 2 + O ( t ) + O ( d − 1 / 2 ) ] x^{\dagger}Qx=d^{2}(1+O(t))[R/d^{2}+O(t)+O(d^{-1/2})] x † Q x = d 2 ( 1 + O ( t )) [ R / d 2 + O ( t ) + O ( d − 1/2 )] , using R ≤ d 2 R\leq d^{2} R ≤ d 2 and ∥ Q v I d ∥ 2 / [ d ( d + 1 ) ] ≤ ( d + 1 ) − 1 \lVert Qv_{I_d}\rVert^{2}/[d(d+1)]\leq(d+1)^{-1} ∥ Q v I d ∥ 2 / [ d ( d + 1 )] ≤ ( d + 1 ) − 1 . A union bound proves eq. (233) .
Inverse weights for overcomplete measurements — Above informational completeness, the lift rows are dependent, so the column-distance argument cannot be reused for the inverse frame. The small-ball estimate below instead applies to independent columns and leave-one-column inverse matrices, regardless of their conditioning. It supplies the inverse-moment tail bound lemma C1 needed for the overcomplete branch of theorem C1.
Lemma G6 (Anticoncentration for the rank-one lift). Let g ^ ∼ C N ( 0 , I d ) \hat{g}\sim\mathcal{CN}(0,I_d) g ^ ∼ C N ( 0 , I d ) and x = vec ( g ^ g ^ † ) x=\operatorname{vec}(\hat{g}\hat{g}^{\dagger}) x = vec ( g ^ g ^ † ) . For every nonzero B ⪰ 0 \mathbf{B}\succeq0 B ⪰ 0 independent of g ^ \hat{g} g ^ and ϵ ∈ ( 0 , 1 ) \epsilon\in(0,1) ϵ ∈ ( 0 , 1 ) , a universal constant C C C gives P ( x † B x ≤ ϵ Tr ( B ) ∣ B ) ≤ C ϵ 1 / 4 \mathbb{P}(x^{\dagger}\mathbf{B}x\leq\epsilon\operatorname{Tr}(\mathbf{B})\mid\mathbf{B})\leq C\epsilon^{1/4} P ( x † B x ≤ ϵ Tr ( B ) ∣ B ) ≤ C ϵ 1/4 .
Proof. Polynomial small-ball estimate — Condition on B = ∑ l β l w l w l † \mathbf{B}=\sum_l\beta_l\mathbf{w}_l\mathbf{w}_l^{\dagger} B = ∑ l β l w l w l † and define W l W_l W l by vec ( W l ) = w l \operatorname{vec}(W_l)=w_l vec ( W l ) = w l . The nonnegative polynomial Q ( g ^ ) = x † B x = ∑ l β l ∣ g ^ † W l † g ^ ∣ 2 Q(\hat{g})=x^{\dagger}\mathbf{B}x=\sum_l\beta_l|\hat{g}^{\dagger}W_l^{\dagger}\hat{g}|^2 Q ( g ^ ) = x † B x = ∑ l β l ∣ g ^ † W l † g ^ ∣ 2 has degree at most four in the 2 d 2d 2 d real Gaussian coordinates. Wick’s identity eq. (41) gives E [ Q ∣ B ] = Tr ( B ) + v I d † B v I d ≥ Tr ( B ) \mathbb{E}[Q\mid\mathbf{B}]=\operatorname{Tr}(\mathbf{B})+v_{I_d}^{\dagger}Bv_{I_d}\geq\operatorname{Tr}(\mathbf{B}) E [ Q ∣ B ] = Tr ( B ) + v I d † B v I d ≥ Tr ( B ) , hence ∥ Q ∥ L 2 ≥ Tr ( B ) > 0 \lVert Q\rVert_{L^2}\geq\operatorname{Tr}(\mathbf{B})>0 ∥ Q ∥ L 2 ≥ Tr ( B ) > 0 . The Carbery–Wright inequality [46 ] , P ( ∣ Q ∣ ≤ ϵ ∥ Q ∥ L 2 ) ≤ C ϵ 1 / k \mathbb{P}(|Q|\leq\epsilon\lVert Q\rVert_{L^2})\leq C\epsilon^{1/k} P ( ∣ Q ∣ ≤ ϵ ∥ Q ∥ L 2 ) ≤ C ϵ 1/ k for a degree-k k k polynomial under a log-concave law, which includes the Gaussian law here, gives the claim with k = 4 k=4 k = 4 .
Upper frame bounds beyond the bulk law — Weak spectral convergence permits a small number of large eigenvalues and therefore does not verify eq. (93) . The fourth-moment estimate below supplies the upper training-frame bound used in proposition F1 and, after Haar normalization, the measurement-frame bound in lemma G8. The fixed-rank examples of lemma B3 inherit these upper bounds.
Lemma G7 (Upper sample covariance from fourth moments). Let v i ∈ R k v_i\in\mathbb{R}^k v i ∈ R k be iid centered isotropic vectors with E ∣ a T v i ∣ 4 ≤ C ∥ a ∥ 4 \mathbb{E}|a^{\mathsf{T}}v_i|^4\leq C\lVert a\rVert^4 E ∣ a T v i ∣ 4 ≤ C ∥ a ∥ 4 uniformly in dimension, and 2 k ≤ t ≍ k 2k\leq t\asymp k 2 k ≤ t ≍ k . Then, with failure probability tending to zero,
∥ t − 1 ∑ i = 1 t v i v i T ∥ o p ≤ C ′ ( 1 + t − 1 max i ∥ v i ∥ 2 ) . (235) \left\lVert t^{-1}\sum_{i=1}^{t}v_iv_i^{\mathsf{T}}\right\rVert_{\mathrm{op}}\leq C'\left(1+t^{-1}\max_i\lVert v_i\rVert^2\right). \tag*{(235)} t − 1 i = 1 ∑ t v i v i T op ≤ C ′ ( 1 + t − 1 i max ∥ v i ∥ 2 ) . (235)
For a sample size comparable to k k k but below 2 k 2k 2 k , the same conclusion follows by appending independent columns and removing their positive outer products, provided the same maximum-norm bound holds for the appended sample. The constants depend only on the moment bound and the fixed sample-to-dimension ratios.
Proof. Fourth moments and sample enlargement — Apply [47 Theorem 1] with moment exponent four. At fixed t / k t/k t / k , its logarithmic ratio factor is bounded and its failure probability tends to zero. This gives eq. (235) . Adding independent vectors to reach 2 k 2k 2 k changes normalization by a bounded factor. Removing their positive outer products cannot increase the operator norm.
Upper bound after Haar normalization — Haar normalization couples all effects through the same inverse covariance. The following estimate carries the independent-lift upper bound through that normalization and verifies the measurement part of eq. (93) on either side of informational completeness, as required by the Haar finite-shot profiles proposition F1.
Lemma G8 (Upper frame bound for the random POVM). For a normalized Haar rank-one POVM independent of the data, with ( d 2 − 1 ) / ( n o u t − 1 ) → κ ∈ ( 0 , ∞ ) (d^2-1)/(n_{\mathrm{out}}-1)\to\kappa\in(0,\infty) ( d 2 − 1 ) / ( n out − 1 ) → κ ∈ ( 0 , ∞ ) , ∥ n o u t P 0 F μ P 0 ∥ o p ≤ C \lVert n_{\mathrm{out}}P_0\mathcal{F}_\mu P_0\rVert_{\mathrm{op}}\leq C ∥ n out P 0 F μ P 0 ∥ op ≤ C with probability tending to one for a dimension-independent constant, which may depend on the fixed limiting ratio κ \kappa κ .
Proof. Independent-lift upper bound — Use the exact Gaussian representation of Appendix § 5.6 : V = n o u t − 1 / 2 G C − 1 / 2 V=n_{\mathrm{out}}^{-1/2}GC^{-1/2} V = n out − 1/2 G C − 1/2 , C = G † G / n o u t C=G^{\dagger}G/n_{\mathrm{out}} C = G † G / n out , with independent standard complex Gaussian rows g a g_a g a . The centered real Hermitian-coordinate lifts z a = vec ( g a g a † − I d ) z_a=\operatorname{vec}(g_ag_a^{\dagger}-I_d) z a = vec ( g a g a † − I d ) are isotropic in dimension d 2 d^2 d 2 . Their coordinates are quadratic Gaussian polynomials, so every directional fourth moment is bounded by a dimension-independent constant times the squared second moment (Gaussian hypercontractivity). Gaussian radial tails also give max a ∥ z a ∥ 2 ≤ C d 2 \max_a\lVert z_a\rVert^2\leq Cd^2 max a ∥ z a ∥ 2 ≤ C d 2 with probability tending to one. The sample bound lemma G7 consequently bounds n o u t − 1 ∑ a z a z a T n_{\mathrm{out}}^{-1}\sum_a z_az_a^{\mathsf{T}} n out − 1 ∑ a z a z a T uniformly. If n o u t < 2 d 2 n_{\mathrm{out}}<2d^2 n out < 2 d 2 , append independent lifts to reach that sample size and then remove their positive outer products. The normalization changes by at most a fixed factor depending on κ \kappa κ ; the Gaussian radial-tail bound holds for the appended list as well. At every such fixed ratio, ∥ C − I ∥ o p = O P ( d / n o u t ) = O P ( d − 1 / 2 ) \lVert C-I\rVert_{\mathrm{op}}=O_{\mathbb{P}}(\sqrt{d/n_{\mathrm{out}}})=O_{\mathbb{P}}(d^{-1/2}) ∥ C − I ∥ op = O P ( d / n out ) = O P ( d − 1/2 ) , so the common-shift bound d ∥ C − 1 − I ∥ o p 2 = O P ( d 2 / n o u t ) d\lVert C^{-1}-I\rVert_{\mathrm{op}}^{2}=O_{\mathbb{P}}(d^{2}/n_{\mathrm{out}}) d ∥ C − 1 − I ∥ op 2 = O P ( d 2 / n out ) remains bounded.
Normalization and common shift — Let L C L_C L C denote the coordinate map induced by A ↦ C − 1 / 2 A C − 1 / 2 A\mapsto C^{-1/2}AC^{-1/2} A ↦ C − 1/2 A C − 1/2 on Hermitian operators. The normalized traceless lift is P 0 L C z a + P 0 vec ( C − 1 ) P_0L_Cz_a+P_0\operatorname{vec}(C^{-1}) P 0 L C z a + P 0 vec ( C − 1 ) . Its sample second moment is bounded by twice the transformed centered second moment plus twice the common-shift outer product. The Wishart estimate lemma G3 gives ∥ C − I ∥ o p ≤ C d − 1 / 2 \lVert C-I\rVert_{\mathrm{op}}\le Cd^{-1/2} ∥ C − I ∥ op ≤ C d − 1/2 with probability tending to one. Thus ∥ L C ∥ o p \lVert L_C\rVert_{\mathrm{op}} ∥ L C ∥ op is bounded and ∥ P 0 vec ( C − 1 ) ∥ 2 ≤ d ∥ C − 1 − I ∥ o p 2 ≤ C \lVert P_0\operatorname{vec}(C^{-1})\rVert^2\le d\lVert C^{-1}-I\rVert_{\mathrm{op}}^2\le C ∥ P 0 vec ( C − 1 ) ∥ 2 ≤ d ∥ C − 1 − I ∥ op 2 ≤ C . These estimates bound n o u t P 0 F μ P 0 n_{\mathrm{out}}P_0F_\mu P_0 n out P 0 F μ P 0 with probability tending to one. The argument uses no lower frame bound and holds on both sides of informational completeness.
Covariance resolvents at positive penalty
Positive penalty keeps the inverse covariance bounded, so quadratic-form concentration can determine its normalized weighted traces without controlling the smallest sample eigenvalue. The population covariance is the second moment before drawing a finite training list; its eigenvalues need not equal those of that list’s sample covariance. The integral below converts the population spectrum into weighted inverse-covariance averages. It supplies the Haar-apparatus peak coefficients in eq. (176) and the spectrum of exact training features in eq. (183) . The joint extension lemma G10 supplies the response traces needed for the complete Haar-training profiles proposition F1; the argument uses the joint feature–response covariance without assuming independence of the original Haar residual and the features.
Lemma G9 (Population covariance integrals). Let x 1 , … , x n x_1,\ldots,x_n x 1 , … , x n be independent copies of a centered real vector in dimension s s s , with covariance T ⪰ 0 T\succeq0 T ⪰ 0 and ∥ T ∥ o p ≤ K \lVert T\rVert_{\mathrm{op}}\le K ∥ T ∥ op ≤ K . Assume s / n → y ∈ ( 0 , ∞ ) s/n\to y\in(0,\infty) s / n → y ∈ ( 0 , ∞ ) and, uniformly over deterministic symmetric A A A ,
E ∣ x i T A x i − Tr ( T A ) ∣ 2 ≤ ϵ s s 2 ∥ A ∥ o p 2 , ϵ s → 0. (236) \mathbb{E}\lvert x_i^{T}Ax_i-\operatorname{Tr}(TA)\rvert^2\le\epsilon_s s^2\lVert A\rVert_{\mathrm{op}}^2,\qquad\epsilon_s\to0. \tag*{(236)} E ∣ x i T A x i − Tr ( T A ) ∣ 2 ≤ ϵ s s 2 ∥ A ∥ op 2 , ϵ s → 0. (236) If the spectrum of T T T converges to H H H , then, for ξ > 0 \xi>0 ξ > 0 and bounded continuous f f f , with W = n − 1 ∑ i x i x i T W=n^{-1}\sum_i x_i x_i^T W = n − 1 ∑ i x i x i T ,
1 s Tr ( f ( T ) ( W + ξ I s ) − 1 ) → P ∫ f ( t ) ξ + w t d H ( t ) , w = [ 1 + y ∫ t ξ + w t d H ( t ) ] − 1 . (237) \frac{1}{s}\operatorname{Tr}\bigl(f(T)(W+\xi I_s)^{-1}\bigr)\xrightarrow{\mathbb{P}}\int\frac{f(t)}{\xi+wt}\,dH(t),\qquad w=\left[1+y\int\frac{t}{\xi+wt}\,dH(t)\right]^{-1}. \tag*{(237)} s 1 Tr ( f ( T ) ( W + ξ I s ) − 1 ) P ∫ ξ + w t f ( t ) d H ( t ) , w = [ 1 + y ∫ ξ + w t t d H ( t ) ] − 1 . (237) The scalar w > 0 w>0 w > 0 is unique. The statement also holds with the finite empirical measure of T T T in the integral, as a deterministic approximation. Locally at positive ξ \xi ξ , derivatives of the normalized traces converge.
Proof. Leave-one-column reduction — Let Q = ( W + ξ I ) − 1 Q=(W+\xi I)^{-1} Q = ( W + ξ I ) − 1 and Q i Q_i Q i be the same inverse with column i i i deleted, retaining normalization by n n n . Condition eq. (236) , conditional on the other columns, gives n − 1 ∑ i ∣ x i T Q i x i / n − Tr ( T Q i ) / n ∣ = O P ( ϵ s ) n^{-1}\sum_i\lvert x_i^TQ_i x_i/n-\operatorname{Tr}(TQ_i)/n\rvert=O_{\mathbb{P}}(\sqrt{\epsilon_s}) n − 1 ∑ i ∣ x i T Q i x i / n − Tr ( T Q i ) / n ∣ = O P ( ϵ s ) . A rank-one update changes Tr ( T Q i ) \operatorname{Tr}(TQ_i) Tr ( T Q i ) by O P ( 1 ) O_{\mathbb{P}}(1) O P ( 1 ) . Thus the denominators in Sherman–Morrison’s identity can be replaced in normalized traces by 1 + Tr ( T Q ) / n 1+\operatorname{Tr}(TQ)/n 1 + Tr ( T Q ) / n .
Weighted covariance integral — Denote the inverse of the common denominator by w s w_s w s . For a spectral projector Π \Pi Π of T T T , the traced normal equation then gives Tr ( Π ) / s = ξ Tr ( Π Q ) / s + w s Tr ( Π T Q ) / s + o P ( 1 ) \operatorname{Tr}(\Pi)/s=\xi\operatorname{Tr}(\Pi Q)/s+w_s\operatorname{Tr}(\Pi TQ)/s+o_{\mathbb{P}}(1) Tr ( Π ) / s = ξ Tr ( Π Q ) / s + w s Tr ( Π T Q ) / s + o P ( 1 ) . The numerator uses the symmetric part of Q i Π Q_i\Pi Q i Π in eq. (236) . The error tends to zero in mean absolute value; the same second-moment bound controls the products with leverage errors by Cauchy–Schwarz. In particular, E i ∣ x i T Q i Π x i / n ∣ 2 ≤ K ξ \mathbb{E}_i\lvert x_i^TQ_i\Pi x_i/n\rvert^2\le K_\xi E i ∣ x i T Q i Π x i / n ∣ 2 ≤ K ξ uniformly in the exposed column and spectral projector, since ∥ Q i Π ∥ o p ≤ ξ − 1 \lVert Q_i\Pi\rVert_{\mathrm{op}}\le\xi^{-1} ∥ Q i Π ∥ op ≤ ξ − 1 and s / n s/n s / n stays bounded. On a spectral interval of width δ \delta δ about t t t , positivity gives ∣ Tr ( Π ( T − t I ) Q ) ∣ ≤ δ Tr ( Π Q ) \lvert\operatorname{Tr}(\Pi(T-tI)Q)\rvert\le\delta\operatorname{Tr}(\Pi Q) ∣ Tr ( Π ( T − t I ) Q )∣ ≤ δ Tr ( Π Q ) . Partition the bounded spectrum into finitely many such intervals, use this trace identity, and let δ ↓ 0 \delta\downarrow0 δ ↓ 0 . This yields the weighted integral with denominator ξ + w t \xi+wt ξ + w t .
Scalar uniqueness and penalty derivatives — The defining trace for w s w_s w s gives the displayed equation for w w w . Equivalently, 1 = w + y ∫ w t / ( ξ + w t ) d H ( t ) 1=w+y\int wt/(\xi+wt)\,dH(t) 1 = w + y ∫ w t / ( ξ + w t ) d H ( t ) ; its right side is strictly increasing from zero to infinity, giving existence and uniqueness. The same argument retains the finite empirical measure. Resolvent derivatives are uniformly bounded on compact positive ξ \xi ξ intervals. Difference quotients with positive weights, and decomposition into positive weights for general f f f , prove derivative convergence. All assertions are local in the strictly positive penalty.
Response traces from the joint covariance — The feature spectrum alone does not determine reconstruction error: the fitted labels and operator response share the same training states. For the joint covariance eq. (219) , the result below transfers the feature inverse, mixed prediction, and minimized loss to Gaussian pairs with that covariance. In the Haar-training application, p = n o u t − 1 p=n_{\mathrm{out}}-1 p = n out − 1 , s = d 2 − 1 s=d^2-1 s = d 2 − 1 , and n = n t r n=n_{\mathrm{tr}} n = n tr : x i x_i x i is a feature column in the Gaussian-noise comparison and h i h_i h i its scaled traceless state response. Those three traces yield the scalar loss and complete centered profiles in eqs. (213) , (214) and (220) without assuming an independent Haar regression residual.
Lemma G10 (Joint feature–response traces at positive penalty). Let ( x i , h i ) ∈ R p × R s (x_i,h_i) \in\mathbb{R}^p \times\mathbb{R}^s ( x i , h i ) ∈ R p × R s be independent copies of a centered pair, with p / n p/n p / n and s / n s/n s / n bounded above and below by positive constants. Write z i = ( x i T , h i T ) T z_i = (x_i^{T},h_i^{T})^{T} z i = ( x i T , h i T ) T , assume ∥ E z i z i T ∥ o p ≤ K \lVert\mathbb{E}z_i z_i^{T}\rVert_{\mathrm{op}} \le K ∥ E z i z i T ∥ op ≤ K , and suppose E ∣ z i T A z i − Tr ( ( E z i z i T ) A ) ∣ 2 ≤ ϵ d ( p + s ) 2 ∥ A ∥ o p 2 \mathbb{E}|z_i^{T}Az_i-\operatorname{Tr}((\mathbb{E}z_i z_i^{T})A)|^2 \le\epsilon_d(p+s)^2\lVert A\rVert_{\mathrm{op}}^2 E ∣ z i T A z i − Tr (( E z i z i T ) A ) ∣ 2 ≤ ϵ d ( p + s ) 2 ∥ A ∥ op 2 , with ϵ d → 0 \epsilon_d \to0 ϵ d → 0 , uniformly over deterministic symmetric A A A . Set X = [ x i ] / n X = [x_i]/\sqrt{n} X = [ x i ] / n and R = [ h i ] / n R = [h_i]/\sqrt{n} R = [ h i ] / n , and assume ∥ [ X T R T ] T ∥ o p = O P ( 1 ) \lVert[X^{T}\ R^{T}]^{T}\rVert_{\mathrm{op}} = O_{\mathrm{P}}(1) ∥[ X T R T ] T ∥ op = O P ( 1 ) . For deterministic η I p ⪯ Λ ⪯ K I p \eta I_p \preceq\Lambda\preceq K I_p η I p ⪯ Λ ⪯ K I p , with fixed η > 0 \eta> 0 η > 0 , put Q = ( X X T + Λ ) − 1 Q = (XX^{T}+\Lambda)^{-1} Q = ( X X T + Λ ) − 1 . The normalized feature inverse p − 1 Tr ( W Q ) p^{-1}\operatorname{Tr}(WQ) p − 1 Tr ( W Q ) , mixed response s − 1 Tr ( B Q X R T ) s^{-1}\operatorname{Tr}(BQXR^{T}) s − 1 Tr ( B QX R T ) , and minimized response loss s − 1 Tr ( R ( I n − X T Q X ) R T ) s^{-1}\operatorname{Tr}(R(I_n-X^{T}QX)R^{T}) s − 1 Tr ( R ( I n − X T QX ) R T ) differ by o P ( 1 ) o_{\mathrm{P}}(1) o P ( 1 ) from those of Gaussian pairs with the same joint covariance. Here W W W and B B B are arbitrary deterministic matrices of compatible dimensions and uniformly bounded norms. The claim concerns fixed positive penalty, not pseudoinverses.
Proof. Weighted joint resolvents — The leave-one-column argument of lemma G9 also gives bounded deterministic weights that need not commute with the population covariance. To see this, whiten a positive deterministic penalty and let Q i Q_i Q i be the whitened inverse with column i i i deleted. In the traced resolvent identity, the numerator is a quadratic form with the symmetric part of Q i A R w Q_i A R_w Q i A R w , where R w = ( I + w T ) − 1 R_w = (I+wT)^{-1} R w = ( I + w T ) − 1 and T T T is the whitened covariance. The stated concentration bound replaces it by its conditional trace, just as for the scalar denominator. The rank-one change in n − 1 Tr ( T Q i ) n^{-1}\operatorname{Tr}(TQ_i) n − 1 Tr ( T Q i ) is O ( n − 1 ) O(n^{-1}) O ( n − 1 ) . A finite grid in the bounded scalar w w w , followed by the uniform positive-penalty bound, handles its dependence on the exposed column. The resulting identity is Tr ( A ( Q − R w ) ) / ( p + s ) = o P ( 1 ) \operatorname{Tr}(A(Q-R_w))/(p+s)=o_{\mathrm{P}}(1) Tr ( A ( Q − R w )) / ( p + s ) = o P ( 1 ) ; taking A = T A=T A = T identifies the same unique scalar equation as in eq. (237) . It depends only on the covariance. This proves equality of the weighted joint resolvent limits for the two pair ensembles.
Recovering the three regression traces — An auxiliary large penalty suppresses the response block, so expanding the joint inverse recovers the three regression traces. Apply the argument to the joint sample covariance with penalty diag ( Λ , t I s ) \operatorname{diag}(\Lambda,tI_s) diag ( Λ , t I s ) , initially at fixed t > 0 t>0 t > 0 . With A = X X T A=XX^{T} A = X X T , E = X R T E=XR^{T} E = X R T , and C = R R T C=RR^{T} C = R R T , write Q t = ( A + Λ E E T C + t I s ) − 1 Q_t=\begin{pmatrix} A+\Lambda& E \\ E^{T} & C+tI_s \end{pmatrix}^{-1} Q t = ( A + Λ E T E C + t I s ) − 1 . Schur complements give, as t → ∞ t\to\infty t → ∞ ,
( Q t ) x x = Q + O P ( t − 1 ) , − t ( Q t ) x h = Q E + O P ( t − 1 ) , ( Q t ) h h = t − 1 I s − t − 2 ( C − E T Q E ) + O P ( t − 3 ) . (238) (Q_t)_{xx}=Q+O_{\mathrm{P}}(t^{-1}),\qquad-t(Q_t)_{xh}=QE+O_{\mathrm{P}}(t^{-1}),\qquad(Q_t)_{hh}=t^{-1}I_s-t^{-2}(C-E^{T}QE)+O_{\mathrm{P}}(t^{-3}). \tag*{(238)} ( Q t ) xx = Q + O P ( t − 1 ) , − t ( Q t ) x h = QE + O P ( t − 1 ) , ( Q t ) hh = t − 1 I s − t − 2 ( C − E T QE ) + O P ( t − 3 ) . (238)
The errors are in operator norm, uniformly in dimension on events where the joint sample norm is bounded. Indeed, 0 ⪯ C − E T Q E ⪯ C 0\preceq C-E^{T}QE\preceq C 0 ⪯ C − E T QE ⪯ C , and ∥ Q ∥ o p ≤ η − 1 \lVert Q\rVert_{\mathrm{op}}\le\eta^{-1} ∥ Q ∥ op ≤ η − 1 ; the Gaussian comparison has the same sample-norm bound. The first two block limits recover the feature inverse and mixed trace. The third gives the minimized response loss as t 2 Tr ( ( Q t ) h h ) / s + O P ( t − 1 ) t^{2}\operatorname{Tr}((Q_t)_{hh})/s+O_{\mathrm{P}}(t^{-1}) t 2 Tr (( Q t ) hh ) / s + O P ( t − 1 ) . Take the dimensional limit at fixed t t t , then t → ∞ t\to\infty t → ∞ . The uniform errors transfer all three traces without assuming independence of the non-Gaussian regression residual.
References