betaFeedback

WorksPhysics and Astronomy

Constructive Cavity Method for Ising Restricted and Deep Boltzmann Machines with Gaussian Couplings

Abstract

We apply the Constructive Cavity Method (CCM) to the dense, Ising type, restricted and deep Boltzmann machine with Gaussian couplings between adjacent layers. After identifying the core and interface contributions, CCM identifies the blanket decomposition of the cavity variables with the Aizenman–Sims–Starr random overlap structure. We apply the Random Energy Model (REM) universality ansatz to represent the cavity free energies by those of a generalized random energy model (GREM) and evaluate them recursively through Poisson point processes (PPPs). In the layer-wise gauge each layer is cut with its own cumulative fraction ∣Uℓ∩Lp∣=λpqℓ(p)N+o(N)|U_\ell\cap L_p|=λ_p q_\ell^{(p)}N+o(N), with 0=q0≤q1≤⋯≤qr=1\mathbf 0=\mathbf q_0\le\mathbf q_1\le\cdots\le\mathbf q_r=\mathbf 1, where qℓ=(qℓ(1),…,qℓ(K))\mathbf q_\ell=(q_\ell^{(1)},\ldots,q_\ell^{(K)}). Here UℓU_\ell is the cumulative blanket union up to blanket ℓ\ell. The index pp labels architectural layers, whereas ℓ\ell labels the blankets. The dependence on the multilayer geometry is carried by the two matrices M=2M0ΛM=2M_0Λ and M1=ΛM0ΛM_1=ΛM_0Λ. The constructive cavity field in layer pp has blanket variances Qℓ(p)−Qℓ−1(p)=(M(qℓ−qℓ−1))pQ_\ell^{(p)}-Q_{\ell-1}^{(p)}=(M(\mathbf q_\ell-\mathbf q_{\ell-1}))_p, while the correction field has blanket variances Qℓ−Qℓ−1=qℓ⊤M1qℓ−qℓ−1⊤M1qℓ−1Q_\ell-Q_{\ell-1}=\mathbf q_\ell^\top M_1\mathbf q_\ell-\mathbf q_{\ell-1}^\top M_1\mathbf q_{\ell-1}. The nested REM–PPP average gives the finite-level constructive cavity functional PRBM/DBMCCM(ζ,q)=log⁡2+∑p=1KλpX0(p)−12∑ℓ=0r−1ζℓ(qℓ+1⊤M1qℓ+1−qℓ⊤M1qℓ)\mathcal{P}_{\mathrm{RBM/DBM}}^{\mathrm{CCM}}(ζ,\mathbf q)=\log2+\sum_{p=1}^Kλ_pX_0^{(p)}-\frac12\sum_{\ell=0}^{r-1}ζ_\ell(\mathbf q_{\ell+1}^\top M_1\mathbf q_{\ell+1}-\mathbf q_\ell^\top M_1\mathbf q_\ell). The balanced scalar gauge is recovered by imposing qℓ=qℓ1\mathbf q_\ell=q_\ell\mathbf 1. Selecting the physical value in the non-convex multilayer regime is a separate problem.

Introduction

The Constructive Cavity Method (CCM) [1] is a procedure for evaluating scalar cavity functionals by constructing the cavity variables explicitly. It originates from the Kernel/Blanket framework of disordered systems [2, 3, 4] where replica-symmetry-breaking structures are represented through blanket decompositions, REM universality [2, 5, 6, 7], and constructive cavity variables. In the Sherrington–Kirkpatrick and Parisi spin-glass setting [8, 9, 10, 11], the method starts from the Aizenman–Sims–Starr cavity functional [12], identifies the blanket decomposition of its cavity variables with the random overlap structure (ROSt), and evaluates the averages recursively through Poisson point processes (PPPs).

The aim of this paper is to apply the same practical construction to the dense Ising restricted and deep Boltzmann machines with Gaussian couplings. The model has KK layers, interactions only between adjacent layers, and layer proportions

∣Lp∣=λpN+o(N),∑p=1Kλp=1.|L_p| = \lambda_p N + o(N), \qquad\sum_{p=1}^{K} \lambda_p = 1.

The case K=2K=2 is the dense bipartite Ising RBM with Gaussian couplings, while the case K≥3K \ge3 is the corresponding DBM architecture. Boltzmann machines and their restricted and deep variants originate as layered energy-based models [13, 14, 15]. Their statistical-mechanics and spin-glass formulations are connected with bipartite, multi-species, and multilayer mean-field models [16, 17, 18, 19, 20]. In non-convex multilayer regimes, the selection of the physical value is not expected to be governed automatically by a standard minimization principle [21, 22]. We do not address that selection problem here. We derive the constructive cavity functional.

The central constructive coordinate is a layer-wise gauge. For each blanket ℓ\ell, each layer LpL_p is cut by its own cumulative fraction qℓ(p)q_{\ell}^{(p)}, weighted by the layer size:

∣Uℓ∩Lp∣=λpqℓ(p)N+o(N).|U_\ell\cap L_p| = \lambda_p q_{\ell}^{(p)} N + o(N).

Thus the finite-level construction uses one layer-wise coordinate

qℓ=(qℓ(1),…,qℓ(K))\mathbf{q}_\ell= \left(q_{\ell}^{(1)}, \ldots, q_{\ell}^{(K)}\right)

per blanket, with qℓ\mathbf{q}_\ell vector valued parameter and

0=q0≤q1≤⋯≤qr=1\mathbf{0} = \mathbf{q}_0 \le\mathbf{q}_1 \le\cdots\le\mathbf{q}_r = \mathbf{1}

componentwise. The layer dependence is carried by the layer sizes, by the coupling strengths, and by the different components of qℓ\mathbf{q}_\ell. In particular, if

M1=ΛM0Λ,M=2M0Λ,M_1 = \Lambda M_0 \Lambda, \qquad M = 2M_0\Lambda,

where M0M_0 is the weighted adjacency matrix of the layer chain and Λ=diag⁡(λ1,…,λK)\Lambda= \operatorname{diag}(\lambda_1,\ldots,\lambda_K), then the cavity field acting on a spin in layer pp has blanket variances

(M(qℓ−qℓ−1))p,\left(M(\mathbf{q}_\ell-\mathbf{q}_{\ell-1})\right)_p,

while the correction field has blanket variances

qℓTM1qℓ−qℓ−1TM1qℓ−1.\mathbf{q}_\ell^{\mathsf{T}}M_1\mathbf{q}_\ell-\mathbf{q}_{\ell-1}^{\mathsf{T}}M_1\mathbf{q}_{\ell-1}.

The balanced scalar gauge is obtained as the diagonal specialization

qℓ=qℓ1.\mathbf{q}_\ell= q_\ell\mathbf{1}.

In that case the general matrix quantities reduce to

dp=(M1)p=2(βp−12λp−1+βp2λp+1),d_p = (M1)_p = 2(\beta_{p-1}^{2}\lambda_{p-1}+\beta_p^{2}\lambda_{p+1}),
κ=1TM11=2∑p=1K−1βp2λpλp+1.\kappa= \mathbf{1}^{\mathsf{T}}M1\mathbf{1}=2\sum_{p=1}^{K-1}\beta_p^{2}\lambda_p\lambda_{p+1}.

We first identify cores and interfaces in the layer-wise partition and compute the Gaussian blanket amplitudes. The REM universality ansatz of Ref. [1], applied in § 6, represents jointly the KK cavity free-energy shifts and the correction shift by their generalized random energy model (GREM) counterparts. The blanket components are identified with the Aizenman–Sims–Starr ROSt variables, and nested Poisson averaging yields the finite-level functional. The final finite-level functional is

PRBM/DBMCCM(ζ,q)=log⁡2+∑p=1KλpX0(p)−12∑ℓ=0r−1ζℓ(qℓ+1TM1qℓ+1−qℓTM1qℓ).(1)\mathcal{P}^{\mathrm{CCM}}_{\mathrm{RBM/DBM}}(\zeta,\mathbf{q})=\log2+\sum_{p=1}^{K}\lambda_p X_0^{(p)}-\frac{1}{2}\sum_{\ell=0}^{r-1}\zeta_\ell\left(\mathbf{q}_{\ell+1}^{\mathsf{T}}M_1\mathbf{q}_{\ell+1}-\mathbf{q}_{\ell}^{\mathsf{T}}M_1\mathbf{q}_{\ell}\right). \tag*{(1)}

The quantities X0(p)X_0^{(p)} are obtained by the nested REM–PPP Gaussian recursion with layer-dependent scale (M(qℓ−qℓ−1))p(M(\mathbf{q}_{\ell}-\mathbf{q}_{\ell-1}))_p at blanket level ℓ\ell. The layer-wise cumulative fractions qℓ\mathbf{q}_{\ell} determine the amplitudes and supply the levels of the resulting Parisi-type functional.

The paper is organized as follows. § 2 recalls the CCM in the operational form used here. § 3 defines the Ising RBM/DBM with Gaussian couplings and the matrices MM and M1M_1. § 4 separates cores and interfaces and introduces the layer-wise gauge. The following sections construct the Gaussian variables, write the Aizenman–Sims–Starr functional, perform the nested REM–PPP average, and record basic checks. § 11 relates the result to the bipartite and multi-species full-RSB formulations, and § 12 explains the construction.

The CCM in practice

We use the minimal construction of Ref. [1 Section 4.7]; § 12 discusses its theoretical background.

The CCM [1] computes cavity free energies by decomposing the cavity variables into blanket components and evaluating their normalized averages. In a single-population setting the scalar cavity functional has the schematic form

A(ν)=log⁡2+Elog⁡⟨C(x)⟩ν−Elog⁡⟨F(y)⟩ν,\mathcal{A}(\nu)=\log2+\mathbb{E}\log\langle C(x)\rangle_{\nu}-\mathbb{E}\log\langle F(y)\rangle_{\nu},

where xx is the cavity field, yy is the correction or fugacity field, and ν\nu is a reservoir. This is the Aizenman–Sims–Starr type of scalar cavity functional [12], evaluated in the constructive form of the CCM [1]. For Ising spins,

C(x)=cosh⁡(h+x),F(y)=ey.C(x)=\cosh(h+x),\qquad F(y)=e^y.

For a multilayer system there is one cavity mark for each layer. Any spin added to layer pp has a cavity field denoted by xpx_p. The multilayer scalar functional will therefore have the form

log⁡2+∑p=1KλpElog⁡⟨cosh⁡(h(p)+xp)⟩ν−Elog⁡⟨ey⟩ν.\log2+\sum_{p=1}^{K}\lambda_p\mathbb{E}\log\langle\cosh(h^{(p)}+x_p)\rangle_{\nu}-\mathbb{E}\log\langle e^y\rangle_{\nu}.

The coefficient λp\lambda_p appears because the pressure is normalized per total spin, while the layer pp contains a fraction λp\lambda_p of all spins. In its minimal form, CCM starts from the Aizenman–Sims–Starr cavity functional, applies the blanket decomposition to its cavity and correction variables, and evaluates the resulting averages by nested Poisson averaging. Equivalently, CCM identifies the blanket decomposition of the cavity variables with the Aizenman–Sims–Starr random overlap structure (ROSt). Ref. [1], § 3 and § 4 provides a physical justification of this identification through the GREM representation of the states and the joint construction of their masses and cavity fields.

For RBM/DBM, we first identify the cores and interfaces of the layer-wise partition. The adjacent-layer vertex counts determine the cavity amplitudes, and the complete edge-shell counts determine the correction amplitudes. We then use these amplitudes in the thermodynamic representation stated in § 6 and perform the nested average of § 7.

The Ising RBM/DBM model with Gaussian couplings

Fix a finite number K≥2K \ge2 of layers L1,…,LKL_1,\ldots,L_K. Let Np=∣Lp∣N_p = \lvert L_p\rvert and

N=∑p=1KNp,NpN→λp>0,∑p=1Kλp=1.N = \sum_{p=1}^{K} N_p,\qquad\frac{N_p}{N} \to\lambda_p > 0,\qquad\sum_{p=1}^{K} \lambda_p = 1.

At each site i∈Lpi \in L_p there is an Ising spin

σi(p)∈{−1,+1}.\sigma_i^{(p)} \in\{-1,+1\}.

The Hamiltonian of the RBM/DBM is

HN(σ)=2N∑p=1K−1βp∑i∈Lp∑j∈Lp+1Jij(p)σi(p)σj(p+1),(2)H_N(\sigma) = \frac{\sqrt{2}}{\sqrt{N}}\sum_{p=1}^{K-1}\beta_p\sum_{i\in L_p}\sum_{j\in L_{p+1}}J_{ij}^{(p)}\sigma_i^{(p)}\sigma_j^{(p+1)}, \tag*{(2)}

where the variables Jij(p)J_{ij}^{(p)} are independent standard Gaussians and βp≥0\beta_p \ge0 is the coupling strength between layers pp and p+1p+1. The case K=2K = 2 is a dense bipartite Ising RBM with Gaussian couplings. The case K≥3K \ge3 is the corresponding DBM with interactions only between adjacent layers. Introduce the diagonal matrix

Λ=diag⁡(λ1,…,λK).\Lambda= \operatorname{diag}(\lambda_1,\ldots,\lambda_K).

We write 11 for the KK-dimensional vector of ones. Let M0M_0 be the symmetric tridiagonal matrix defined by the following formula:

(M0)p,p+1=(M0)p+1,p=βp2,p=1,…,K−1,(M_0)_{p,p+1} = (M_0)_{p+1,p} = \beta_p^2,\qquad p = 1,\ldots,K-1,

with all other entries equal to zero. We use

M1=ΛM0Λ,M=2M0Λ.M_1 = \Lambda M_0 \Lambda,\qquad M = 2M_0\Lambda.

Equivalently, for a vector v=(v(1),…,v(K))v = (v^{(1)},\ldots,v^{(K)}),

(Mv)p=2βp−12λp−1v(p−1)+2βp2λp+1v(p+1),(Mv)_p = 2\beta_{p-1}^2\lambda_{p-1}v^{(p-1)} + 2\beta_p^2\lambda_{p+1}v^{(p+1)},

where the terms with indices outside 1,…,K1,\ldots,K are omitted. This convention also applies to the boundary layers in the formulas below. In the balanced specialization used for comparison later, the two scalar constants are

dp=(M1)p=2(βp−12λp−1+βp2λp+1),(3)d_p = (M1)_p = 2(\beta_{p-1}^2\lambda_{p-1}+\beta_p^2\lambda_{p+1}), \tag*{(3)}
κ=1TM11=2∑p=1K−1βp2λpλp+1.(4)\kappa= 1^{\mathsf{T}}M_1 1 = 2\sum_{p=1}^{K-1}\beta_p^2\lambda_p\lambda_{p+1}. \tag*{(4)}

The factor 2\sqrt{2} in (2) is chosen so that these expressions can have this simple symmetric form. External fields are not written in the Hamiltonian. Throughout the derivation, h(p)h^{(p)} denotes an optional deterministic field for layer pp entering only the one-spin cavity mark. Setting h(p)=0h^{(p)} = 0 recovers exactly the Hamiltonian in (2).

Interface-only structure and layer-wise gauge

We first separate the core and interface contributions of the layer-wise partition, and use interface dominance under refinement to obtain the interface-only (IO) representative. Here and below, pp labels the architectural layers LpL_p, while ℓ\ell labels the blankets of the constructive partition; ζℓ−1\zeta_{\ell-1} is the Poisson exponent used to average blanket ℓ\ell, and qℓ(p)q_{\ell}^{(p)} is the fraction of layer LpL_p included up to blanket ℓ\ell. We fix ordered disjoint blankets V1,…,VrV_1,\ldots,V_r, independently of the couplings, and set

U0=∅,Uℓ:=⋃s=1ℓVs,Ur=⋃p=1KLp.U_0=\varnothing,\qquad U_\ell:=\bigcup_{s=1}^{\ell}V_s,\qquad U_r=\bigcup_{p=1}^{K}L_p.

Thus UℓU_\ell is the cumulative blanket up to ℓ\ell, and Vℓ=Uℓ∖Uℓ−1V_\ell=U_\ell\setminus U_{\ell-1} is the ℓ\ell-th blanket increment. This is the ordered blanket decomposition used in the CCM [1]. Each blanket VℓV_\ell is a global CCM block crossing all architectural layers, with

Vℓ=⋃p=1K(Vℓ∩Lp).V_\ell=\bigcup_{p=1}^{K}(V_\ell\cap L_p).

We choose a layer-wise nondecreasing profile

0=q0≤q1≤⋯≤qr=1,qℓ=(qℓ(1),…,qℓ(K)),\mathbf{0}=\mathbf{q}_0\le\mathbf{q}_1\le\cdots\le\mathbf{q}_r=\mathbf{1},\qquad\mathbf{q}_\ell=(q_\ell^{(1)},\ldots,q_\ell^{(K)}),

where the inequalities are componentwise. The layer-wise constructive gauge cuts each architectural layer LpL_p by the cumulative fraction qℓ(p)=∣Uℓ∩Lp∣/∣Lp∣+o(1)q_\ell^{(p)}=|U_\ell\cap L_p|/|L_p|+o(1), weighted by the layer size: therefore the cumulative blocks have size

∣Uℓ∩Lp∣=λpqℓ(p)N+o(N),p=1,…,K.(5)|U_\ell\cap L_p|=\lambda_pq_\ell^{(p)}N+o(N),\qquad p=1,\ldots,K. \tag*{(5)}

The corresponding blanket block is

Vℓ∩Lp=(Uℓ∩Lp)∖(Uℓ−1∩Lp),V_\ell\cap L_p=(U_\ell\cap L_p)\setminus(U_{\ell-1}\cap L_p),

and therefore its cardinality is

∣Vℓ∩Lp∣=λp(qℓ(p)−qℓ−1(p))N+o(N).(6)|V_\ell\cap L_p|=\lambda_p\left(q_\ell^{(p)}-q_{\ell-1}^{(p)}\right)N+o(N). \tag*{(6)}

The variables qℓ\mathbf{q}_\ell are layer-wise cumulative fractions of the constructive gauge. The balanced scalar gauge is recovered by imposing qℓ=qℓ1\mathbf{q}_\ell=q_\ell\mathbf{1}.

The adjacent-layer structure of (2) determines the cavity components as follows. A cavity spin inserted in layer pp interacts only with spins in the neighboring layers Lp−1L_{p-1} and Lp+1L_{p+1}. Therefore the variance of its blanket-ℓ\ell cavity field is determined by the vertex counts in

Vℓ∩Lp−1,Vℓ∩Lp+1.V_\ell\cap L_{p-1},\qquad V_\ell\cap L_{p+1}.

The correction field has the same adjacent-layer interaction support and is decomposed into complete edge shells [2, 3]. For adjacent layers LpL_p and Lp+1L_{p+1}, define the cumulative rectangle

Bℓ(p,p+1)=(Uℓ∩Lp)×(Uℓ∩Lp+1).B_\ell^{(p,p+1)}=(U_\ell\cap L_p)\times(U_\ell\cap L_{p+1}).

The blanket-ℓ\ell edge shell is

Wℓ(p,p+1)=Bℓ(p,p+1)∖Bℓ−1(p,p+1),ℓ=1,…,r.W_\ell^{(p,p+1)}=B_\ell^{(p,p+1)}\setminus B_{\ell-1}^{(p,p+1)},\qquad\ell=1,\ldots,r.

Using (5), its cardinality is

∣Wℓ(p,p+1)∣=λpλp+1N2(qℓ(p)qℓ(p+1)−qℓ−1(p)qℓ−1(p+1))+o(N2).(7)|W_\ell^{(p,p+1)}|=\lambda_p\lambda_{p+1}N^2\left(q_\ell^{(p)}q_\ell^{(p+1)}-q_{\ell-1}^{(p)}q_{\ell-1}^{(p+1)}\right)+o(N^2). \tag*{(7)}

Figure 1. CCM blanket geometry for a multilayer RBM/DBM. Architectural layers are indexed by pp, while CCM blankets are indexed by ℓ\ell. Each blanket VℓV_\ell is a global partition block crossing all architectural layers, and the cell Vℓ∩LpV_\ell\cap L_p has size λp(qℓ(p)−qℓ−1(p))N+o(N)\lambda_p(q_\ell^{(p)}-q_{\ell-1}^{(p)})N+o(N).

At finite level, the shell Bℓ(p,p+1)∖Bℓ−1(p,p+1)B_\ell^{(p,p+1)} \setminus B_{\ell-1}^{(p,p+1)} decomposes into an interface part and a core part. This decomposition introduces no additional datum. If

Δqℓ(p)=qℓ(p)−qℓ−1(p),\Delta q_\ell^{(p)}=q_\ell^{(p)}-q_{\ell-1}^{(p)},

then we have

qℓ(p)qℓ(p+1)−qℓ−1(p)qℓ−1(p+1)=qℓ−1(p)Δqℓ(p+1)+qℓ−1(p+1)Δqℓ(p)+Δqℓ(p)Δqℓ(p+1).q_\ell^{(p)}q_\ell^{(p+1)}-q_{\ell-1}^{(p)}q_{\ell-1}^{(p+1)}=q_{\ell-1}^{(p)}\Delta q_\ell^{(p+1)}+q_{\ell-1}^{(p+1)}\Delta q_\ell^{(p)}+\Delta q_\ell^{(p)}\Delta q_\ell^{(p+1)}.

The first two terms are the interface contribution, while the last is the core contribution. Refining the layer-wise partition makes the total core fraction vanish. The IO pressure reduction follows from Eq. (49). The interface-dominance argument and the order of limits are discussed in Ref. [1 Section 2.1]. We retain the complete finite edge-shell counts when constructing the correction field below.

The counts (6) and (7) determine the Gaussian amplitudes of the constructive cavity variables.

Constructive cavity variables

The blanket decomposition of Section § 4 supplies the two sets of counts required by CCM: vertices in neighboring-layer blocks for the cavity fields, and edges in adjacent-layer shells for the correction field. The Gaussian amplitudes depend only on the layer-wise profile q\mathbf{q}, the layer proportions λ\boldsymbol{\lambda}, and the coupling strengths β\boldsymbol{\beta}. We use these amplitudes to realize the cavity variables on the REM–GREM reservoir of Sections § 6–§ 7.

The cavity field

Consider a new spin inserted in layer pp. It interacts only with the two neighboring layers Lp−1L_{p-1} and Lp+1L_{p+1}. The random part of its cavity field is

xN,p(σ)=2N(βp−1∑i∈Lp−1J~i(p−1)σi(p−1)+βp∑j∈Lp+1J~j(p)σj(p+1)).(8)x_{N,p}(\sigma)=\frac{\sqrt{2}}{\sqrt{N}}\left(\beta_{p-1}\sum_{i\in L_{p-1}}\widetilde{J}_{i}^{(p-1)}\sigma_{i}^{(p-1)}+\beta_p\sum_{j\in L_{p+1}}\widetilde{J}_{j}^{(p)}\sigma_{j}^{(p+1)}\right). \tag*{(8)}

with the missing boundary term omitted. The Gaussian variables in (8) are fresh and independent of the reservoir.

The blanket-ℓ\ell contribution is obtained by restricting the sums to the blanket blocks in the neighboring layers:

xN,p,ℓ(σ)=2N(βp−1∑i∈Vℓ∩Lp−1J~i(p−1)σi(p−1)+βp∑j∈Vℓ∩Lp+1J~j(p)σj(p+1)).(9)x_{N,p,\ell}(\sigma)=\frac{\sqrt{2}}{\sqrt{N}}\left(\beta_{p-1}\sum_{i\in V_{\ell}\cap L_{p-1}}\widetilde{J}_{i}^{(p-1)}\sigma_{i}^{(p-1)}+\beta_p\sum_{j\in V_{\ell}\cap L_{p+1}}\widetilde{J}_{j}^{(p)}\sigma_{j}^{(p+1)}\right). \tag*{(9)}

Conditionally on the reservoir configuration, the cross terms vanish because the fresh couplings are independent and centered. Since the spins are Ising variables, the conditional variance is exactly computed as follows:

Var⁡(xN,p,ℓ∣σ)=2βp−12N∣Vℓ∩Lp−1∣+2βp2N∣Vℓ∩Lp+1∣.(10)\operatorname{Var}(x_{N,p,\ell}\mid\sigma)=\frac{2\beta_{p-1}^{2}}{N}|V_{\ell}\cap L_{p-1}|+\frac{2\beta_{p}^{2}}{N}|V_{\ell}\cap L_{p+1}|. \tag*{(10)}

At the boundary layers, the absent term is omitted. Using the layer-wise block sizes (6), this becomes

Var⁡(xN,p,ℓ∣σ)=2βp−12λp−1(qℓ(p−1)−qℓ−1(p−1))+2βp2λp+1(qℓ(p+1)−qℓ−1(p+1))+o(1)=(M(qℓ−qℓ−1))p+o(1).(11)\begin{aligned} \operatorname{Var}(x_{N,p,\ell}\mid\sigma)&=2\beta_{p-1}^{2}\lambda_{p-1}\left(q_{\ell}^{(p-1)}-q_{\ell-1}^{(p-1)}\right)+2\beta_{p}^{2}\lambda_{p+1}\left(q_{\ell}^{(p+1)}-q_{\ell-1}^{(p+1)}\right)+o(1)\\ &=(M(\mathbf{q}_{\ell}-\mathbf{q}_{\ell-1}))_{p}+o(1). \tag*{(11)} \end{aligned}

Write α=(α1,…,αr)\alpha=(\alpha_1,\ldots,\alpha_r) for a path of the REM–GREM representation. Its depth-ℓ\ell prefix is α≤ℓ=(α1,…,αℓ)\alpha_{\le\ell}=(\alpha_1,\ldots,\alpha_\ell). With the amplitude in (11), the constructive cavity field in layer pp is

xpα=∑ℓ=1rzℓ,p(α≤ℓ)(M(qℓ−qℓ−1))p.(12)x_{p}^{\alpha}=\sum_{\ell=1}^{r}z_{\ell,p}(\alpha_{\le\ell})\sqrt{(M(\mathbf{q}_{\ell}-\mathbf{q}_{\ell-1}))_{p}}. \tag*{(12)}

where distinct nodes, levels and architectural layers carry independent standard Gaussians, independent of the reservoir weights. Paths through the same node share its Gaussian variable, as in Ref. [1 Section 4.5]. Equivalently, if

Qℓ(p)=(Mqℓ)p,(13)Q_{\ell}^{(p)}=(M\mathbf{q}_{\ell})_{p}, \tag*{(13)}
xpα=∑ℓ=1rzℓ,p(α≤ℓ)Qℓ(p)−Qℓ−1(p).x_{p}^{\alpha}=\sum_{\ell=1}^{r}z_{\ell,p}(\alpha_{\le\ell})\sqrt{Q_{\ell}^{(p)}-Q_{\ell-1}^{(p)}}.

Thus the layer-wise profile q\mathbf{q} and the matrix MM fix the amplitudes of the layer-pp cavity field.

The correction field

The correction, or fugacity, mark accounts for the internal adjacent-layer interactions compensated in the cavity normalization. For adjacent layers LpL_p and Lp+1L_{p+1}, the blanket-ℓ\ell edge shell is Wℓ(p,p+1)W_{\ell}^{(p,p+1)} from (7). The corresponding Gaussian correction mark is

yN,ℓ(p,p+1)(σ)=2βpN∑(i,j)∈Wℓ(p,p+1)J‾ij(p)σi(p)σj(p+1).(14)y_{N,\ell}^{(p,p+1)}(\sigma)=\frac{\sqrt{2}\beta_p}{N}\sum_{(i,j)\in W_{\ell}^{(p,p+1)}}\overline{J}_{ij}^{(p)}\sigma_i^{(p)}\sigma_j^{(p+1)}. \tag*{(14)}

The normalization is 1/N1/N, rather than 1/N1/\sqrt{N}, because the correction mark is an internal edge sum over O(N2)O(N^2) terms and must have variance of order one. Again, conditionally on the reservoir, the cross terms vanish by independence and centering of the fresh Gaussians, while each diagonal term contributes one because the spins are Ising. Hence, the expression for the variance is

Var⁡(yN,ℓ(p,p+1)∣σ)=2βp2N2∣Wℓ(p,p+1)∣.(15)\operatorname{Var}(y_{N,\ell}^{(p,p+1)}\mid\sigma)=\frac{2\beta_p^2}{N^2}|W_{\ell}^{(p,p+1)}|. \tag*{(15)}

Using (7), we get

Var⁡(yN,ℓ(p,p+1)∣σ)=2β2λpλp+1(qℓ(p)qℓ(p+1)−qℓ−1(p)qℓ−1(p+1))+o(1).(16)\operatorname{Var}\left(y_{N,\ell}^{(p,p+1)} \mid\sigma\right) = 2\beta^2\lambda_p\lambda_{p+1}\left(q_{\ell}^{(p)}q_{\ell}^{(p+1)}-q_{\ell-1}^{(p)}q_{\ell-1}^{(p+1)}\right)+o(1). \tag*{(16)}

The edge-shell contributions use independent fresh couplings, so the blanket variances add over pp. Summing over the adjacent layer pairs gives

Qℓ−Qℓ−1=qℓTM1qℓ−qℓ−1TM1qℓ−1.(17)Q_\ell-Q_{\ell-1}=\mathbf{q}_\ell^{\mathsf{T}}M_1\mathbf{q}_\ell-\mathbf{q}_{\ell-1}^{\mathsf{T}}M_1\mathbf{q}_{\ell-1}. \tag*{(17)}

Equivalently, we can write it in a compact matrix notation

Qℓ=qℓTM1qℓ.(18)Q_\ell=\mathbf{q}_\ell^{\mathsf{T}}M_1\mathbf{q}_\ell. \tag*{(18)}

Since the profile is componentwise nondecreasing and M1M_1 has nonnegative off-diagonal entries along the layer chain, the increments Qℓ−Qℓ−1Q_\ell-Q_{\ell-1} are nonnegative. The constructive correction field is therefore

yα=∑ℓ=1rgℓ(α≤ℓ)qℓTM1qℓ−qℓ−1TM1qℓ−1,(19)y^\alpha=\sum_{\ell=1}^{r}g_\ell(\alpha_{\leq\ell})\sqrt{\mathbf{q}_\ell^{\mathsf{T}}M_1\mathbf{q}_\ell-\mathbf{q}_{\ell-1}^{\mathsf{T}}M_1\mathbf{q}_{\ell-1}}, \tag*{(19)}

with standard Gaussian variables gℓ(α≤ℓ)g_\ell(\alpha_{\leq\ell}), independent between distinct nodes and of all cavity-field Gaussians and reservoir weights. Paths through the same prefix share the same correction variable.

Aizenman–Sims–Starr cavity functional and constructive substitution

We now write the cavity functional using the blanket components constructed above. Let νN\nu_N be a trial reservoir on configurations of the existing KK-layer system. For the Gibbs reservoir, the Aizenman–Sims–Starr construction compares the partition functions before and after adding one cavity spin; the same expression defines the functional on trial reservoirs. If the added spin belongs to architectural layer LpL_p, summing its Ising value gives

∑ε=±1exp⁡{ε(h(p)+xN,p)}=2cosh⁡(h(p)+xN,p).\sum_{\varepsilon=\pm1}\exp\left\{\varepsilon\left(h^{(p)}+x_{N,p}\right)\right\}=2\cosh\left(h^{(p)}+x_{N,p}\right).

Since the architectural layer LpL_p contributes a fraction λp\lambda_p of all spins, the cavity terms are averaged with weights λp\lambda_p, and the factors 22 give the total entropy contribution ∑pλplog⁡2=log⁡2\sum_p\lambda_p\log2=\log2. The fugacity mark yNy_N compensates the internal adjacent-layer interactions of the reservoir and therefore appears with a minus sign. Thus the Aizenman–Sims–Starr-type scalar cavity functional associated with the multilayer model has the form [12, 1]

AN(νN)=log⁡2+∑p=1KλpElog⁡⟨cosh⁡(h(p)+xN,p)⟩νN−Elog⁡⟨eyN⟩νN.(20)A_N(\nu_N)=\log2+\sum_{p=1}^{K}\lambda_p\mathbb{E}\log\left\langle\cosh\left(h^{(p)}+x_{N,p}\right)\right\rangle_{\nu_N}-\mathbb{E}\log\left\langle e^{y_N}\right\rangle_{\nu_N}. \tag*{(20)}

Here xN,px_{N,p} is the one-spin cavity field associated with adding a spin to layer pp, and yNy_N is the Aizenman–Sims–Starr fugacity or correction mark. The coefficient λp\lambda_p appears because the pressure is normalized per total spin and layer pp contains a fraction λp\lambda_p of all spins. The single entropy term is log⁡2\log2 because

∑p=1Kλplog⁡2=log⁡2.\sum_{p=1}^{K}\lambda_p\log2=\log2.

The outer expectation is over the fresh Gaussian variables used in the cavity marks and over any randomness of the reservoir. The brackets denote averaging with respect to the reservoir.

For the physical calculation, we apply the REM universality ansatz of Ref. [1 Sections 3 and 4.5]: the KK logarithmic cosh averages and the logarithmic correction average in (20) are represented asymptotically in joint distribution by the corresponding GREM free-energy shifts, with the cavity variables below. On a physical fibre, which fixes the magnetizations of the nonempty cells Vℓ∩LpV_\ell\cap L_p, the blanket average uses complete Gibbs conditional kernels, defined as ratios of full marginals. Contributions of retained fibres are summed in each partition function before taking its logarithm [1 Section 2.4]. The disorder expectation follows these operations. This thermodynamic replacement uses the constructive fields

xN,p⇝xpα=∑ℓ=1rzℓ,p(α≤ℓ)(M(qℓ−qℓ−1))p,x_{N,p} \rightsquigarrow x_p^\alpha= \sum_{\ell=1}^{r} z_{\ell,p}(\alpha_{\leq\ell})\sqrt{(M(\mathbf{q}_{\ell}-\mathbf{q}_{\ell-1}))_p},
yN⇝yα=∑ℓ=1rgℓ(α≤ℓ)qℓTM1qℓ−qℓ−1TM1qℓ−1.y_N \rightsquigarrow y^\alpha= \sum_{\ell=1}^{r} g_\ell(\alpha_{\leq\ell})\sqrt{\mathbf{q}_{\ell}^{\mathsf T}M_1\mathbf{q}_{\ell}-\mathbf{q}_{\ell-1}^{\mathsf T}M_1\mathbf{q}_{\ell-1}}.

Here ⇝\rightsquigarrow denotes this replacement in the cavity free-energy calculation. The realization by prefix-indexed variables follows Ref. [1 Section 4.5].

Thus, for a generic constructive reservoir ν\nu, the finite-level constructive functional associated with the layer-wise profile q\mathbf{q} is

Ar,qconstr(ν)=log⁡2+∑p=1KλpElog⁡⟨cosh⁡(h(p)+xpα)⟩ν−Elog⁡⟨eyα⟩ν.(21)\mathcal{A}^{\mathrm{constr}}_{r,\mathbf{q}}(\nu)=\log2+\sum_{p=1}^{K}\lambda_p\mathbb{E}\log\left\langle\cosh\left(h^{(p)}+x_p^\alpha\right)\right\rangle_\nu-\mathbb{E}\log\left\langle e^{y^\alpha}\right\rangle_\nu. \tag*{(21)}

The matrices MM, M1M_1 and the layer-wise profile q\mathbf{q} determine the amplitudes in this functional. We now evaluate it on the REM–GREM reservoir.

REM–PPP evaluation

We evaluate (21) on the hierarchical REM–PPP reservoir of Ref. [1 Sections 3.5–3.6], with parameters

0=ζ−1≤ζ0≤⋯≤ζr−1≤ζr=1.0=\zeta_{-1}\leq\zeta_0\leq\cdots\leq\zeta_{r-1}\leq\zeta_r=1.

First take 0<ζ0<⋯<ζr−1<10<\zeta_0<\cdots<\zeta_{r-1}<1. At every parent u=(α1,…,αℓ−1)u=(\alpha_1,\ldots,\alpha_{\ell-1}), draw a PPP {wℓ(u,i)}i≥1\{w_\ell(u,i)\}_{i\geq1} with intensity ζℓ−1t−1−ζℓ−1 dt\zeta_{\ell-1}t^{-1-\zeta_{\ell-1}}\,\mathrm{d}t on (0,∞)(0,\infty). Different parents and levels carry independent PPPs. The normalized path weights and their average are

ξα=∏ℓ=1rwℓ(α≤ℓ)∑γ∏ℓ=1rwℓ(γ≤ℓ),⟨fα⟩ξ=∑αξαfα.\xi_\alpha=\frac{\prod_{\ell=1}^{r}w_\ell(\alpha_{\leq\ell})}{\sum_\gamma\prod_{\ell=1}^{r}w_\ell(\gamma_{\leq\ell})},\qquad\langle f^\alpha\rangle_\xi=\sum_\alpha\xi_\alpha f^\alpha.

The increasing exponents make the total path mass finite almost surely. Each parent mass includes all its descendants. These are the Ruelle cascade weights [23, 24, 25], with the Gaussian innovations of § 5 independent of the weights.

The marked Poisson identity acts at each parent on positive insertions and their complete descendant sums. For exponent m∈(0,1)m\in(0,1), masses wiw_i, and i.i.d. positive pairs (Ui,Vi)(U_i,V_i) independent of the masses, it gives

Elog⁡∑iwiUi∑iwiVi=log⁡EUm−log⁡EVmm,EUm,EVm<∞.\mathbb{E}\log\frac{\sum_i w_iU_i}{\sum_i w_iV_i}=\frac{\log\mathbb{E}U^m-\log\mathbb{E}V^m}{m},\qquad\mathbb{E}U^m,\mathbb{E}V^m<\infty.

The rescaled totals have the same marginal law, so their expected logarithms cancel. The recursion with descendant totals is given in Ref. [1 Section 4.6]. In the multilayer functional the common normalization has coefficient ∑pλp−1=0\sum_p \lambda_p - 1 = 0. The expectation is over the reservoir and its Gaussian variables, after the state sums and logarithms.

Because the cavity part of (21) is a sum of layer-wise log-brackets, the Gaussian recursion is applied separately to each layer pp, with the same hierarchy ζ\zeta. Define the terminal value

Xr(p)=log⁡cosh⁡(h(p)+∑k=1rηk,p(M(qk−qk−1))p)(22)X_r^{(p)} = \log\cosh\left(h^{(p)} + \sum_{k=1}^{r}\eta_{k,p}\sqrt{\left(M(\mathbf{q}_k-\mathbf{q}_{k-1})\right)_p}\right) \tag*{(22)}

where the ηk,p\eta_{k,p} are independent standard Gaussians. For ℓ=r−1,…,0\ell=r-1,\ldots,0, set

Xℓ(p)=1ζℓlog⁡Eℓ+1exp⁡(ζℓXℓ+1(p))(23)X_\ell^{(p)} = \frac{1}{\zeta_\ell}\log\mathbb{E}_{\ell+1}\exp\left(\zeta_\ell X_{\ell+1}^{(p)}\right) \tag*{(23)}

where Eℓ+1\mathbb{E}_{\ell+1} integrates the Gaussian increment at blanket ℓ+1\ell+1 for the fixed layer pp, with exponent ζℓ\zeta_\ell. The formulas extend continuously to the boundary parameters. If ζℓ=0\zeta_\ell=0, the limiting step is

Xℓ(p)=Eℓ+1Xℓ+1(p).X_\ell^{(p)}=\mathbb{E}_{\ell+1}X_{\ell+1}^{(p)}.

Any initial zero-exponent blocks have fixed prefix labels, so their Gaussian increments in both fields are shared by all states. Together they represent the common overlap component. For ζℓ=1\zeta_\ell=1, the step is Xℓ(p)=log⁡Eℓ+1eXℓ+1(p)X_\ell^{(p)}=\log\mathbb{E}_{\ell+1}e^{X_{\ell+1}^{(p)}}, the thermal average. Consecutive equal exponents merge by Gaussian convolution; ζr=1\zeta_r=1 records the terminal convention. The nested REM–PPP average of the layer-pp cavity mark is then

Elog⁡⟨cosh⁡(h(p)+xpα)⟩ξ=X0(p).(24)\mathbb{E}\log\left\langle\cosh\left(h^{(p)}+x_p^\alpha\right)\right\rangle_\xi=X_0^{(p)}. \tag*{(24)}

The correction mark is evaluated by the same stability identity in its linear Gaussian form. Since yαy^\alpha is centered and has blanket-kk variance increment

qkTM1qk−qk−1TM1qk−1,\mathbf{q}_k^{\mathsf{T}}M_1\mathbf{q}_k-\mathbf{q}_{k-1}^{\mathsf{T}}M_1\mathbf{q}_{k-1},

we get the fugacity contribution

Elog⁡⟨eyα⟩ξ=12∑ℓ=0r−1ζℓ(qℓ+1TM1qℓ+1−qℓTM1qℓ).(25)\mathbb{E}\log\left\langle e^{y^\alpha}\right\rangle_\xi=\frac{1}{2}\sum_{\ell=0}^{r-1}\zeta_\ell\left(\mathbf{q}_{\ell+1}^{\mathsf{T}}M_1\mathbf{q}_{\ell+1}-\mathbf{q}_{\ell}^{\mathsf{T}}M_1\mathbf{q}_{\ell}\right). \tag*{(25)}

Indeed, at one PPP level the identity is

1mlog⁡Eexp⁡(mgv)=m2v,\frac{1}{m}\log\mathbb{E}\exp\left(mg\sqrt{v}\right)=\frac{m}{2}v,

with the value 00 when m=0m=0 by continuity. Subdivision at a fixed averaging exponent preserves this correction, since the differences of the quadratic form telescope. Substituting (24) and (25) into (21) gives the finite-level CCM functional

PRBM/DBMCCM(ζ,q)=log⁡2+∑p=1KλpX0(p)−12∑ℓ=0r−1ζℓ(qℓ+1TM1qℓ+1−qℓTM1qℓ).(26)\mathcal{P}_{\mathrm{RBM/DBM}}^{\mathrm{CCM}}(\zeta,\mathbf{q})=\log2+\sum_{p=1}^{K}\lambda_pX_0^{(p)}-\frac{1}{2}\sum_{\ell=0}^{r-1}\zeta_\ell\left(\mathbf{q}_{\ell+1}^{\mathsf{T}}M_1\mathbf{q}_{\ell+1}-\mathbf{q}_{\ell}^{\mathsf{T}}M_1\mathbf{q}_{\ell}\right). \tag*{(26)}

This is the layer-wise constructive cavity functional of the multilayer RBM/DBM model. The variables qℓ\mathbf{q}_\ell entered the derivation as layer-wise cumulative fractions of the constructive gauge. The balanced scalar gauge is recovered by imposing qℓ=qℓ1\mathbf{q}_\ell=q_\ell\mathbf{1}. An equivalent representation by independent PPPs, with parent indices carrying the shared cavity variables, gives the same random cavity functional in distribution [1 Sections 3.6 and 4.6].

Checks

We present consistency checks of the layer-wise functional (26). The balanced scalar formulas are recovered by imposing qℓ=qℓ1\mathbf{q}_{\ell}=q^{\ell}\mathbf{1}. These checks test different parts of the construction: the RS reduction tests the REM–PPP evaluation, the annealed value tests the normalization of the correction field, the K=2K=2 and K=3K=3 reductions test the multilayer geometry, and the splitting-instability surface tests the local curvature of the functional.

Replica-symmetric reduction

The vector replica-symmetric reduction corresponds to two effective blankets,

q0=0,q1=q,q2=1,\mathbf{q}_0=\mathbf{0},\qquad\mathbf{q}_1=\mathbf{q},\qquad\mathbf{q}_2=\mathbf{1},
ζ0=0,ζ1=1,\zeta_0=0,\qquad\zeta_1=1,

and terminal ζ2=1\zeta_2=1. For layer pp, the variance increments in the terminal condition are

(Mq)p,(M(1−q))p.(M\mathbf{q})_p,\qquad(M(\mathbf{1}-\mathbf{q}))_p.

Thus we get the formula

X2(p)=log⁡cosh⁡(h(p)+η1,p(Mq)p+η2,p(M(1−q))p).X_2^{(p)}=\log\cosh\left(h^{(p)}+\eta_{1,p}\sqrt{(M\mathbf{q})_p}+\eta_{2,p}\sqrt{(M(\mathbf{1}-\mathbf{q}))_p}\right).

Using, for Z∼N(0,1)Z\sim N(0,1), the exact identity

EZcosh⁡(a+bZ)=eb2/2cosh⁡(a),\mathbb{E}_Z\cosh(a+bZ)=e^{b^2/2}\cosh(a),

the step with ζ1=1\zeta_1=1 gives

X1(p)=12(M(1−q))p+log⁡cosh⁡(h(p)+η1,p(Mq)p).X_1^{(p)}=\frac{1}{2}(M(\mathbf{1}-\mathbf{q}))_p+\log\cosh\left(h^{(p)}+\eta_{1,p}\sqrt{(M\mathbf{q})_p}\right).

Since ζ0=0\zeta_0=0, the first step is an ordinary Gaussian expectation:

X0(p)=12(M(1−q))p+Ezlog⁡cosh⁡(h(p)+z(Mq)p).X_0^{(p)}=\frac{1}{2}(M(\mathbf{1}-\mathbf{q}))_p+\mathbb{E}_z\log\cosh\left(h^{(p)}+z\sqrt{(M\mathbf{q})_p}\right).

Substituting this into (26), the deterministic part is

12∑p=1Kλp(M(1−q))p−12(1TM1−qTMq).\frac{1}{2}\sum_{p=1}^{K}\lambda_p(M(\mathbf{1}-\mathbf{q}))_p-\frac{1}{2}\left(\mathbf{1}^{\mathsf{T}}M\mathbf{1}-\mathbf{q}^{\mathsf{T}}M\mathbf{q}\right).

By applying the following identity

∑p=1Kλp(Mv)p=21TM1v,\sum_{p=1}^{K}\lambda_p(M\mathbf{v})_p=2\mathbf{1}^{\mathsf{T}}M\mathbf{1}\mathbf{v},

with v=1−q\mathbf{v}=\mathbf{1}-\mathbf{q}, this becomes

1TM1(1−q)−12(1TM1−qTM1q)=12(1−q)TM(1−q).\mathbf{1}^{\mathsf{T}}M\mathbf{1}(\mathbf{1}-\mathbf{q})-\frac{1}{2}\left(\mathbf{1}^{\mathsf{T}}M\mathbf{1}-\mathbf{q}^{\mathsf{T}}M\mathbf{1}\mathbf{q}\right)=\frac{1}{2}(\mathbf{1}-\mathbf{q})^{\mathsf{T}}M(\mathbf{1}-\mathbf{q}).

Hence the vector replica-symmetric expression is

PRS(q)=log⁡2+∑p=1KλpEzlog⁡cosh⁡(h(p)+z(Mq)p)+12(1−q)TM(1−q).(27)\mathcal{P}_{\mathrm{RS}}(\mathbf{q})=\log2+\sum_{p=1}^{K}\lambda_p\mathbb{E}_z\log\cosh\left(h^{(p)}+z\sqrt{(M\mathbf{q})_p}\right)+\frac{1}{2}(\mathbf{1}-\mathbf{q})^{\mathsf{T}}M(\mathbf{1}-\mathbf{q}). \tag*{(27)}

This is the multilayer RS reduction associated with the layer-wise CCM gauge. The balanced scalar reduction is recovered by imposing the condition

q=q1.\mathbf{q} = q\mathbf{1}.

Then follow the relations

(Mq)p=dpq,(1−q)TM1(1−q)=κ(1−q)2,(M\mathbf{q})_p = d_pq,\qquad(\mathbf{1}-\mathbf{q})^{\mathsf T}M_1(\mathbf{1}-\mathbf{q}) = \kappa(1-q)^2,

and (27) becomes

PRS(q)=log⁡2+∑p=1KλpEzlog⁡cosh⁡(h(p)+zdpq)+κ2(1−q)2.\mathcal{P}_{\mathrm{RS}}(q) = \log2 + \sum_{p=1}^{K}\lambda_p\mathbb{E}_z\log\cosh\left(h^{(p)}+z\sqrt{d_pq}\right)+\frac{\kappa}{2}(1-q)^2.

This is the balanced-gauge specialization of the multilayer replica-symmetric expression for Gaussian-coupling DBM models [19].

As an annealed normalization check, set h(p)=0h^{(p)}=0 and q=0\mathbf{q}=0 in (27). Then the Gaussian cavity term vanishes and

PRS(0)=log⁡2+121TM11=log⁡2+∑p=1K−1βp2λpλp+1.\mathcal{P}_{\mathrm{RS}}(0)=\log2+\frac{1}{2}\mathbf{1}^{\mathsf T}M_1\mathbf{1}=\log2+\sum_{p=1}^{K-1}\beta_p^2\lambda_p\lambda_{p+1}.

This is the annealed high-temperature value of the adjacent-layer Gaussian RBM/DBM model, and therefore checks the normalization of the correction term in (26).

RS splitting-instability surface

The replica-symmetric vector reduction (27) also gives a local splitting-instability check for the CCM functional. Let q\mathbf{q} be a self-consistent RS solution, satisfying

q(p)=Eztanh⁡2(h(p)+z(Mq)p),p=1,…,K.q^{(p)}=\mathbb{E}_z\tanh^2\left(h^{(p)}+z\sqrt{(M\mathbf{q})_p}\right),\qquad p=1,\ldots,K.

Define the diagonal matrix

Γ=diag⁡(Γ1,…,ΓK),Γp=Ezsech⁡4(h(p)+z(Mq)p).\Gamma=\operatorname{diag}(\Gamma_1,\ldots,\Gamma_K),\qquad\Gamma_p=\mathbb{E}_z\operatorname{sech}^4\left(h^{(p)}+z\sqrt{(M\mathbf{q})_p}\right).

A first splitting of an RS blanket is governed, at linear order, by the multilayer stability matrix ΓM\Gamma M. Thus the RS splitting-instability surface is

ρ(ΓM)=1,(28)\rho(\Gamma M)=1, \tag*{(28)}

where ρ\rho denotes the spectral radius. Equivalently, ΓM\Gamma M is similar to the symmetric tridiagonal matrix K\mathcal{K} with Kp,p=0\mathcal{K}_{p,p}=0 and

Kp,p+1=Kp+1,p=2βp2λpλp+1ΓpΓp+1,p=1,…,K−1.(29)\mathcal{K}_{p,p+1}=\mathcal{K}_{p+1,p}=2\beta_p^2\sqrt{\lambda_p\lambda_{p+1}\Gamma_p\Gamma_{p+1}},\qquad p=1,\ldots,K-1. \tag*{(29)}

Therefore (28) can also be written simply as

ρ(K)=1.\rho(\mathcal{K})=1.

The derivation of this condition from the one-split perturbation of the CCM functional is given in Appendix § 16. For the two-layer RBM, write β1=β\beta_1=\beta and q=(u,v)\mathbf{q}=(u,v). Then

Γ1=Ezsech⁡4(h(1)+z2β2λ2v).(30)\Gamma_1=\mathbb{E}_z\operatorname{sech}^4\left(h^{(1)}+z\sqrt{2\beta^2\lambda_2v}\right). \tag*{(30)}
Γ2=Ezsech⁡4(h(2)+z2β2λ1u),\Gamma_2 = \mathbb{E}_z \operatorname{sech}^{4}\left(h^{(2)} + z\sqrt{2\beta^2\lambda_1u}\right),

and the instability condition becomes

4β4λ1λ2Γ1Γ2=1.(31)4\beta^4\lambda_1\lambda_2\Gamma_1\Gamma_2 = 1. \tag*{(31)}

In zero external field, on the paramagnetic RS branch u=v=0u=v=0, hence Γ1=Γ2=1\Gamma_1=\Gamma_2=1, and (30) reduces to the following closed expression:

4β4λ1λ2=1.(32)4\beta^4\lambda_1\lambda_2 = 1. \tag*{(32)}

where λ2=1−λ1\lambda_2=1-\lambda_1. This reproduces the boundary of the annealed/high-temperature region of the bipartite spin glass of Barra–Genovese–Guerra [26]. Thus the splitting-instability computation checks not only the RS value but also the local curvature of the CCM functional in the bipartite direction.

Two-layer RBM and symmetric three-layer DBM

For K=2K=2, write β1=β\beta_1=\beta and the parameter is specialized as

qℓ=(uℓ,vℓ).\mathbf{q}_{\ell}=(u_{\ell},v_{\ell}).

Then we can simplify the expressions for the cavity component

(M(qℓ−qℓ−1))1=2β2λ2(vℓ−vℓ−1),\left(M(\mathbf{q}_{\ell}-\mathbf{q}_{\ell-1})\right)_1=2\beta^2\lambda_2(v_{\ell}-v_{\ell-1}),
(M(qℓ−qℓ−1))2=2β2λ1(uℓ−uℓ−1),\left(M(\mathbf{q}_{\ell}-\mathbf{q}_{\ell-1})\right)_2=2\beta^2\lambda_1(u_{\ell}-u_{\ell-1}),

and then for the fugacity component

qℓTM1qℓ=2β2λ1λ2uℓvℓ.\mathbf{q}_{\ell}^{\mathsf{T}}M_1\mathbf{q}_{\ell}=2\beta^2\lambda_1\lambda_2u_{\ell}v_{\ell}.

The finite-level CCM functional becomes

PRBMCCM(ζ,u,v)=log⁡2+λ1X0(1)+λ2X0(2)−β2λ1λ2∑ℓ=0r−1ζℓ(uℓ+1vℓ+1−uℓvℓ).(33)\mathcal{P}_{\mathrm{RBM}}^{\mathrm{CCM}}(\zeta,u,v)=\log2+\lambda_1X_0^{(1)}+\lambda_2X_0^{(2)}-\beta^2\lambda_1\lambda_2\sum_{\ell=0}^{r-1}\zeta_{\ell}(u_{\ell+1}v_{\ell+1}-u_{\ell}v_{\ell}). \tag*{(33)}

This check is non-trivial because the two architectural layers carry distinct coordinates uℓu_{\ell} and vℓv_{\ell}; the scalar diagonal specialization would not recover this bipartite structure in asymmetric cases. The balanced RBM formula is recovered by setting uℓ=vℓ=qℓu_{\ell}=v_{\ell}=q_{\ell}.

Consider now K=3K=3 with parameters

λ1=λ2=λ3=13,β1=β2=β.\lambda_1=\lambda_2=\lambda_3=\frac{1}{3},\qquad\beta_1=\beta_2=\beta.

The size parameter is reduced to this setting as follows:

qℓ=(aℓ,bℓ,cℓ).\mathbf{q}_{\ell}=(a_{\ell},b_{\ell},c_{\ell}).

If the two outer layers are treated symmetrically, we impose

aℓ=cℓ=sℓ,a_{\ell}=c_{\ell}=s_{\ell},

while the middle layer keeps its own coordinate bℓb_{\ell}. Then for the cavity component

(M(qℓ−qℓ−1))out=2β23(bℓ−bℓ−1),(34)\left(M(\mathbf{q}_{\ell}-\mathbf{q}_{\ell-1})\right)_{\mathrm{out}}=\frac{2\beta^2}{3}(b_{\ell}-b_{\ell-1}), \tag*{(34)}
(M(qℓ−qℓ−1))mid=4β23(sℓ−sℓ−1),\left(M(\mathbf{q}_{\ell}-\mathbf{q}_{\ell-1})\right)_{\mathrm{mid}}=\frac{4\beta^2}{3}(s_{\ell}-s_{\ell-1}),

and for the fugacity component we have

qℓTM1qℓ=4β29sℓbℓ.\mathbf{q}_{\ell}^{\mathsf{T}}M_1\mathbf{q}_{\ell}=\frac{4\beta^2}{9}s_{\ell}b_{\ell}.

If the two outer layers have the same external field, the functional reduces to

P3LCCM(ζ,s,b)=log⁡2+23X0out+13X0mid−2β29∑ℓ=0r−1ζℓ(sℓ+1bℓ+1−sℓbℓ).(35)\mathcal{P}_{3\mathrm{L}}^{\mathrm{CCM}}(\zeta,s,b)=\log2+\frac{2}{3}X_0^{\mathrm{out}}+\frac{1}{3}X_0^{\mathrm{mid}}-\frac{2\beta^2}{9}\sum_{\ell=0}^{r-1}\zeta_{\ell}(s_{\ell+1}b_{\ell+1}-s_{\ell}b_{\ell}). \tag*{(35)}

Here X0outX_0^{\mathrm{out}} and X0midX_0^{\mathrm{mid}} are obtained from the same REM–PPP recursion with outer and middle variance scales displayed above. This check verifies that the middle layer, which is adjacent to two layers, receives twice the cavity scale of an outer layer in the symmetric three-layer model. The balanced three-layer formula is recovered by setting sℓ=bℓ=qℓs_{\ell}=b_{\ell}=q_{\ell}. At zero external field this gives

P3L,RS(q)=log⁡2+23Ezlog⁡cosh⁡(z2β23q)+13Ezlog⁡cosh⁡(z4β23q)+2β29(1−q)2.\mathcal{P}_{3\mathrm{L},\mathrm{RS}}(q)=\log2+\frac{2}{3}\mathbb{E}_z\log\cosh\left(z\sqrt{\frac{2\beta^2}{3}q}\right)+\frac{1}{3}\mathbb{E}_z\log\cosh\left(z\sqrt{\frac{4\beta^2}{3}q}\right)+\frac{2\beta^2}{9}(1-q)^2.

Nishimori-line deformation as an exact benchmark

The model studied in the previous sections has centered Gaussian couplings but the CCM method is not limited to that. As an exact benchmark for the layer-wise normalization, we can apply the same CCM procedure to the exactly solvable Nishimori deformation of the adjacent-layer DBM. In the ordered-pair convention of Ref. [27], the two orientations of each adjacent-layer edge carry independent couplings with tied mean and variance,

J~ij(p)∼N(μp,p+12N,μp,p+12N),\widetilde{J}_{ij}^{(p)}\sim\mathcal{N}\left(\frac{\mu_{p,p+1}}{2N},\frac{\mu_{p,p+1}}{2N}\right),

and, when the random fields are included, the layer pp field is on the same Nishimori line. We remark that this is different from the centered model of the paper; the Nishimori deformation is used only as an exact functional benchmark for the CCM procedure.

The one-body Gaussian mark on the Nishimori line has equal mean and variance. Thus a mark with scale AA has the form A+AzA+\sqrt{A}z, and its one-body contribution is

ψ(A)=Ezlog⁡2cosh⁡(A+Az).(36)\psi(A)=\mathbb{E}_z\log2\cosh(A+\sqrt{A}z). \tag*{(36)}

In the layer-wise CCM variables, the scale in architectural layer LpL_p is h(p)+(Mq)ph^{(p)}+(\mathsf{M}\mathbf{q})_p. The corresponding Nishimori deformation of the CCM functional is

PNCCM(q)=∑p=1Kλpψ(h(p)+(Mq)p)+12(1−q)TM1(1−q)−qTM1q.(37)\mathcal{P}_{\mathrm{N}}^{\mathrm{CCM}}(\mathbf{q})=\sum_{p=1}^{K}\lambda_p\psi\left(h^{(p)}+(\mathsf{M}\mathbf{q})_p\right)+\frac{1}{2}(\mathbf{1}-\mathbf{q})^{\mathsf{T}}M_1(\mathbf{1}-\mathbf{q})-\mathbf{q}^{\mathsf{T}}M_1\mathbf{q}. \tag*{(37)}

The first term is the Nishimori one-body cavity contribution. The last term is the deterministic correction produced by the non-centered part of the Nishimori couplings. The two changes with respect to the centered CCM functional—the one-body mark and the deterministic edge correction—are derived in Appendix § 17. With the identification

αpN=λp,μp,p+1=2βp2,(38)\alpha_p^{\mathrm{N}}=\lambda_p,\qquad\mu_{p,p+1}=2\beta_p^2, \tag*{(38)}

the Nishimori interaction matrix has entries

Mp,p+1N=μp,p+1αp+1N=2βp2λp+1=Mp,p+1,M^{\mathrm{N}}_{p,p+1}=\mu_{p,p+1}\alpha^{\mathrm{N}}_{p+1}=2\beta_p^2\lambda_{p+1}=M_{p,p+1},

and the edge coefficient satisfies

Δp,p+12=αpNμp,p+1αp+1N2=βp2λpλp+1.\frac{\Delta_{p,p+1}}{2}=\frac{\alpha^{\mathrm{N}}_p\mu_{p,p+1}\alpha^{\mathrm{N}}_{p+1}}{2}=\beta_p^2\lambda_p\lambda_{p+1}.

Consequently, equation (37) coincides with the finite-dimensional variational integrand for the DBM on the Nishimori line [27]:

PNCCM(q)=pvar(q;μ,h).(39)\mathcal{P}^{\mathrm{CCM}}_{\mathrm{N}}(\mathbf{q})=p_{\mathrm{var}}(\mathbf{q};\boldsymbol{\mu},h). \tag*{(39)}

This is an important benchmark. It checks the vector structure of the CCM functional, including the matrices M=2M0ΛM=2M_0\Lambda, M1=ΛM0ΛM_1=\Lambda M_0\Lambda, and the layer-wise coordinate q\mathbf{q}. It does not give a new proof of the Nishimori min–max selection rule: once the two integrands are identified, the known selection rule is inherited.

On the local selection problem

The procedure given above is to obtain the finite-level CCM functional. The problem of selecting the physical value of this functional is a separate variational and stability problem. We do not prove here the global theorem selecting the thermodynamic value. This will be explored in a separate paper. We only recall the usual local criterion naturally associated with the functional.

For a fixed number of blankets, a candidate state is a point

(ζ,q)(\zeta,\mathbf{q})

in the admissible domain of (26). If all the relevant coordinates are internal, the local selection equations are the stationarity conditions

∇qPRBM/DBMCCM(ζ,q)=0,∂ζPRBM/DBMCCM(ζ,q)=0.\nabla_{\mathbf{q}}\mathcal{P}^{\mathrm{CCM}}_{\mathrm{RBM/DBM}}(\zeta,\mathbf{q})=0,\qquad\partial_{\zeta}\mathcal{P}^{\mathrm{CCM}}_{\mathrm{RBM/DBM}}(\zeta,\mathbf{q})=0.

When a rate is on the boundary, or two consecutive blankets merge, these equations are replaced by the corresponding Karush–Kuhn–Tucker (KKT) conditions. These conditions select stationary candidates in the blanket coordinates and Poisson exponents.

Stationarity alone is not sufficient. A locally selected state must also be stable with respect to further splitting of any active blanket. For a self-consistent RS solution, this stability test produces the matrix condition already displayed in (28),

ρ(ΓM)≤1.\rho(\Gamma M)\leq1.

If the spectral radius is larger than one, then the corresponding blanket is locally unstable and has to be refined. The same logic applies after one splitting: the stability matrix is obtained by replacing the RS susceptibility by the susceptibility computed in the tilted one-split state.

We remark that this is not a global selection theorem. It is the CCM version of the standard finite-step stationarity and stability analysis used in spin-glass variational functionals, including the SK cavity/Parisi setting and its minimization theory [12, 10, 11, 28], the de Almeida–Thouless stability analysis [29], and bipartite or multilayer mean-field variational structures [26, 30, 27, 19]. In particular, whenever the CCM functional reduces exactly to a known variational integrand, the known selection rule is inherited automatically. The equality of the functionals is the actual consistency check; the selection rule is then a consequence of the known theory.

The usefulness of the local criterion is therefore diagnostic. Away from regimes where a global selection theorem is available, one can study candidate physical states by solving the finite-level stationarity equations, imposing KKT conditions on boundary rates or merged blankets, and recursively refining any blanket whose splitting matrix is unstable. This procedure does not change the derivation of the functional; it is a local method for exploring its possible physical selection.

Relation with other full-RSB formulations

We compare the functional (26) with the bipartite replica calculation of Hartnett, Parker and Geist [37] and the multi-species formulation of Chen, Issa and Mourrat [38]. Both comparisons concern centered Gaussian couplings and zero external fields.

Write the finite hierarchy as the nondecreasing step function

q(x)=qℓ,ζℓ−1≤x<ζℓ,ℓ=0,…,r.(40)\mathbf{q}(x)=\mathbf{q}_{\ell},\qquad\zeta_{\ell-1}\le x<\zeta_{\ell},\qquad\ell=0,\ldots,r. \tag*{(40)}

The endpoint conventions are those of § 7. Summation by parts rewrites the quadratic correction as

∫01q(x)TM1q(x) dx=κ−∑ℓ=0r−1ζℓ(qℓ+1TM1qℓ+1−qℓTM1qℓ).(41)\int_{0}^{1}\mathbf{q}(x)^{\mathsf T}M_{1}\mathbf{q}(x)\,\mathrm{d}x=\kappa-\sum_{\ell=0}^{r-1}\zeta_{\ell}\left(\mathbf{q}_{\ell+1}^{\mathsf T}M_{1}\mathbf{q}_{\ell+1}-\mathbf{q}_{\ell}^{\mathsf T}M_{1}\mathbf{q}_{\ell}\right). \tag*{(41)}

Bipartite model

For the specialization (33), choose unit coupling scale in Ref. [37] and denote its inverse temperature by βH\beta_{\mathrm{H}}. The parameter correspondence is

αv=λ1,αh=λ2,βH=2 β(λ1λ2)1/4,\alpha_{v}=\lambda_{1},\qquad\alpha_{h}=\lambda_{2},\qquad\beta_{\mathrm{H}}=\sqrt{2}\,\beta(\lambda_{1}\lambda_{2})^{1/4},
q(v)(x)=u(x),q(h)(x)=v(x).(42)q^{(v)}(x)=u(x),\qquad q^{(h)}(x)=v(x). \tag*{(42)}

This matches their coupling normalization, given before Eq. (2.7), with the Hamiltonian (2). Their variance parameters, defined in Eq. (2.43), then satisfy

βH2R(h)(x)=2β2λ2v(x),βH2R(v)(x)=2β2λ1u(x).(43)\beta_{\mathrm{H}}^{2}R^{(h)}(x)=2\beta^{2}\lambda_{2}v(x),\qquad\beta_{\mathrm{H}}^{2}R^{(v)}(x)=2\beta^{2}\lambda_{1}u(x). \tag*{(43)}

These are precisely the two cavity variances of our bipartite construction. Their Parisi equation (2.44), written in dimensionless field coordinates, therefore gives the Gaussian recursion (23). The unit-exponent Gaussian step completes each terminal variance to its diagonal value. Combining this contribution with (41) reproduces the endpoint terms and the integral of the product of the two profiles in their Eq. (2.42). Thus (33) coincides with their full-RSB expression in pressure units: the pressure is minus their inverse temperature times their free-energy density. The identification holds for each trial hierarchy, before imposing stationarity.

General multilayer model

Chen, Issa and Mourrat [38] normalize the species overlaps by the total number of spins. The corresponding path and covariance polynomial for our model are

p(x)=Λq(x),Ξ(a)=aTM0a.(44)\mathbf{p}(x)=\Lambda\mathbf{q}(x),\qquad\Xi(\mathbf{a})=\mathbf{a}^{\mathsf T}M_{0}\mathbf{a}. \tag*{(44)}

Write Ψ\Psi for their species-weighted, compensated one-site cascade functional, defined in Eqs. (2.1)–(2.7) and (3.7). At time one half and zero auxiliary field, their Parisi functional (3.14) specializes to

P1/2,0[Λq]=Ψ[12Mq]−12∫01q(x)TM1q(x) dx.(45)P_{1/2,0}[\Lambda\mathbf{q}]=\Psi\left[\frac{1}{2}M\mathbf{q}\right]-\frac{1}{2}\int_{0}^{1}\mathbf{q}(x)^{\mathsf T}M_{1}\mathbf{q}(x)\,\mathrm{d}x. \tag*{(45)}

The factor one half matches their Gaussian normalization with the Hamiltonian (2). On the step hierarchy, their one-site calculation uses the same recursion (23). Including its deterministic compensation and the unit-exponent terminal step gives

Ψ[12Mq]=12∑p=1Kλp(M1)p−∑p=1KλpX0(p)=κ−∑p=1KλpX0(p).(46)\Psi\left[\frac{1}{2}M\mathbf{q}\right]=\frac{1}{2}\sum_{p=1}^{K}\lambda_{p}(M\mathbf{1})_{p}-\sum_{p=1}^{K}\lambda_{p}X_{0}^{(p)}=\kappa-\sum_{p=1}^{K}\lambda_{p}X_{0}^{(p)}. \tag*{(46)}

Substituting (41) and (46) into (45) yields

PRBM/DBMCCM(ζ,q)=log⁡2+κ2−P1/2,0[Λq](47)\mathcal{P}^{\mathrm{CCM}}_{\mathrm{RBM/DBM}}(\zeta,\mathbf{q})=\log2+\frac{\kappa}{2}-\mathcal{P}_{1/2,0}[\Lambda\mathbf{q}] \tag*{(47)}

Thus the complete functional (26) is also obtained by specializing the multi-species Parisi functional. The identity holds at every finite depth and extends to bounded monotone paths by the continuity established in Lemma 3.6 of Ref. [38]. Also their sup–inf characterization of the thermodynamic value at zero deterministic field given in Theorem 1.1 is consistent with our local selection approach given before. These identifications connect the blanket calculation with the replica and Hamilton–Jacobi formulations.

Why CCM works

This section is independent from the derivation of the RBM/DBM functional above and may be skipped by readers interested only in the explicit formula and its checks. The CCM [1] originates in the Kernel/Blanket theory of disordered systems [2, 3, 4]. The blanket-theoretic viewpoint is related to the Free Energy Principle and the Markov-blanket formulation of variational free energy [31, 32, 33] and it can be interpreted as a purely kinetic LFT of the kind described in [34, 35, 36] by identifying the potential energy with the vanishing core contribution. Here we connect the calculations of § 4–§ 7 with this viewpoint [1] in the low temperature limit.

The blanket decomposition separates interactions within each blanket from those connecting it to preceding blankets. Since each blanket crosses the architectural layers, its core contains couplings between cells in adjacent layers. Writing the sum of the interface energies as H‾N\overline{H}_N, the full and IO partition functions are

ZN=∑σeHN(σ),Z‾N=∑σeH‾N(σ)(48)Z_N=\sum_{\sigma}e^{H_N(\sigma)},\qquad\overline{Z}_N=\sum_{\sigma}e^{\overline{H}_N(\sigma)} \tag*{(48)}

Gaussian interpolation of the independent core couplings gives

0≤1NElog⁡ZNZ‾N≤1N2∑p=1K−1βp2∑ℓ=1r∣Vℓ∩Lp∣∣Vℓ∩Lp+1∣(49)0\leq\frac{1}{N}\mathbb{E}\log\frac{Z_N}{\overline{Z}_N}\leq\frac{1}{N^2}\sum_{p=1}^{K-1}\beta_p^2\sum_{\ell=1}^{r}\lvert V_\ell\cap L_p\rvert\lvert V_\ell\cap L_{p+1}\rvert \tag*{(49)}

The cell sizes in Eq. (6) make this bound vanish as the largest blanket fraction in each architectural layer tends to zero. Taking the thermodynamic limit at fixed partition and then refining it therefore reduces the pressure to that of the IO model [1 Section 2.1], while the correction field retains the complete edge-shell counts of Eq. (17). The resulting interface is linear in the spins of the new blanket:

H‾ℓ(σ)=∑p=1K∑i∈Vℓ∩Lpσi(p)h‾ℓ,i(p)(σUℓ−1)(50)\overline{H}_\ell(\sigma)=\sum_{p=1}^{K}\sum_{i\in V_\ell\cap L_p}\sigma_i^{(p)}\overline{h}_{\ell,i}^{(p)}(\sigma_{U_{\ell-1}}) \tag*{(50)}
h‾ℓ,i(p)(σUℓ−1)=2Nβp−1∑j∈Uℓ−1∩Lp−1Jji(p−1)σj(p−1)+2Nβp∑k∈Uℓ−1∩Lp+1Jik(p)σk(p+1)(51)\overline{h}_{\ell,i}^{(p)}(\sigma_{U_{\ell-1}})=\sqrt{\frac{2}{N}}\beta_{p-1}\sum_{j\in U_{\ell-1}\cap L_{p-1}}J_{ji}^{(p-1)}\sigma_j^{(p-1)}+\sqrt{\frac{2}{N}}\beta_p\sum_{k\in U_{\ell-1}\cap L_{p+1}}J_{ik}^{(p)}\sigma_k^{(p+1)} \tag*{(51)}

Terms involving absent architectural layers are omitted.

This IO model provides the reference for the low-temperature description. We rectify configurations with respect to a global ground state, which maximizes the Hamiltonian in our convention. Energies and Gibbs weights are transported together, and the overlaps are preserved [1 Sections 2.2–2.4]. Excitations then form a dilute gas of flipped spins whose complete energy costs include interactions with preceding and subsequent blankets and between defects.

For finitely many nodes with finitely many defects, independently sampled supports become disjoint with probability tending to one as the cells grow; defect interactions vanish, and the new energy contributions are jointly approximated at fixed disorder by independent sums of complete local costs. Descendants retain their ancestors’ defects and energies, while new nodes receive new arrangements [1 Sections 3.1–3.2]. Two states thus share both spins and energy contributions up to their last common ancestor, which is the origin of the hierarchical structure. Because each node specifies all architectural cells of its blanket, this genealogy determines the overlaps in every species.

To obtain thermodynamic weights, we extend the finite construction to exponential populations within the magnetization shells. At fixed small positive defect densities, these populations can be chosen with small relative intersections throughout every kernel strip, including between nodes with different parents; the thermodynamic limit is taken at fixed partition and followed by dilution [1 Section 3.3]. Along each branch, the complete centered energy is built from centered increments that are linear in the new defects once the prefix is fixed. Their coefficients contain the preceding configuration and the mean fields of subsequent blankets, so sampling the defects leads to the local problem of REM universality [5, 6, 7]. For the coefficient populations selected by the ground state, the regularity needed in this step is physically justified in Ref. [1 Section 3.3]. We then adopt the extensive GREM approximation, representing the conditional increment laws by a common law at each level, independently realized at distinct nodes. Comparing the rarity of energies with the number of available states determines which consecutive levels condense together and fixes their Poisson exponents [1 Section 3.4]. In assembling the resulting Gibbs weights, we retain the energy centers and shell entropies and include all descendant continuations in the mass of each prefix [1 Section 2.4].

This construction supplies the Gibbs masses and species overlaps on the same states. The overlaps in turn determine the complete law of the fresh cavity fields: conditioned on the reservoir, these are jointly Gaussian, and rectification preserves their law because their couplings are independent of the disorder selecting the reference [1 Section 4.2]. For two configurations indexed by the paths α\alpha and γ\gamma, averaging over the fresh noise gives

E[xN,p(σα)xN,p(σγ)]=2βp2−1N∑i∈Lp−1σi(p−1),ασi(p−1),γ+2βp2N∑j∈Lp+1σj(p+1),ασj(p+1),γ,(52)\mathbb{E}[x_{N,p}(\sigma^\alpha)x_{N,p}(\sigma^\gamma)] = \frac{2\beta_p^2-1}{N}\sum_{i\in L_{p-1}}\sigma_i^{(p-1),\alpha}\sigma_i^{(p-1),\gamma} + \frac{2\beta_p^2}{N}\sum_{j\in L_{p+1}}\sigma_j^{(p+1),\alpha}\sigma_j^{(p+1),\gamma}, \tag*{(52)}
E[yN(σα)yN(σγ)]=2N2∑p=1K−1βp2∑i∈Lpσi(p),ασi(p),γ∑j∈Lp+1σj(p+1),ασj(p+1),γ.(53)\mathbb{E}[y_N(\sigma^\alpha)y_N(\sigma^\gamma)] = \frac{2}{N^2}\sum_{p=1}^{K-1}\beta_p^2\sum_{i\in L_p}\sigma_i^{(p),\alpha}\sigma_i^{(p),\gamma}\sum_{j\in L_{p+1}}\sigma_j^{(p+1),\alpha}\sigma_j^{(p+1),\gamma}. \tag*{(53)}

Normalizing the spin sums by the respective layer sizes identifies the species overlaps. In the thermodynamic limit, the two covariances give the action of MM and the quadratic form defined by M1M_1; together with the independence of the fresh-noise families, they fix the joint Gaussian law. The physical overlaps include the magnetization contributions from cells beyond the shared prefix, whose spins remain aligned on average with the ground state [1 Section 4.3]. These overlaps increase componentwise to one.

Following the operational correspondence established in Ref. [1 Section 4.7], we choose the constructive cell fractions in each architectural layer to represent their common part and successive increments, retaining the same state masses, ancestry, and averaging exponents. With these fractions, the amplitudes in Eqs. (12) and (19) reproduce the full covariance increments, so the masses and complete cavity fields have the same joint law as in the physical representation. The common linear fields remain inside the hyperbolic cosines throughout the recursive averages and are integrated last at zero exponent. The common correction field remains in the random logarithmic contribution and has zero mean over the fresh noise [1 Sections 4.4–4.6].

Using these complete fields with the same Gibbs masses and ancestors identifies all cavity contributions jointly with the Rϑst. The cascade can be reconstructed from one independent PPP per level by assigning a parent to each node and normalizing the terminal masses globally. Descendants inherit the assignments and Gaussian increments of their ancestors. Transporting the complete fields with these same assignments preserves the random cavity functional in joint distribution [1 Sections 3.5–3.6 and 4.5]. If several physical fibres contribute, their weighted contributions are combined before taking the logarithms, as in § 6. The mean logarithms are then evaluated by Eqs. (23) and (25), yielding Eq. (26) [1 Section 4.6]. The parameters remain free during this calculation and are selected as discussed in § 10 and § 11. An extension of this low temperature argument to arbitrary temperature is possible through the REM universality approach developed in Refs. [6, 7].

Discussion

The calculation above applies the CCM of [1] to dense Ising RBM/DBM models with Gaussian couplings in a layer-wise constructive gauge. The blanket ℓ\ell vector of parameter variables

qℓ=(qℓ(1),…,qℓ(K))\mathbf{q}_{\ell} = \left(q_{\ell}^{(1)}, \ldots, q_{\ell}^{(K)}\right)

is the vector of cumulative layer fractions in the constructive partition,

∣Uℓ∩Lp∣=λpqℓ(p)N+o(N),\left|U_{\ell} \cap L_{p}\right| = \lambda_{p}q_{\ell}^{(p)}N + o(N),

and supplies the levels of the nested REM–PPP evaluation of the cavity functional. The model-specific content of the computation is contained in two matrix quantities. The cavity field in layer pp has scale

Qℓ(p)=(Mqℓ)p,M=2M0Λ,Q_{\ell}^{(p)} = (M\mathbf{q}_{\ell})_{p}, \qquad M = 2M_{0}\Lambda,

while the correction field has scale

Qℓ=qℓTM1qℓ,M1=ΛM0Λ.Q_{\ell} = \mathbf{q}_{\ell}^{\mathsf{T}}M_{1}\mathbf{q}_{\ell}, \qquad M_{1} = \Lambda M_{0}\Lambda.

These amplitudes enter the blanket components (12) and (19). CCM identifies the blanket decomposition of the cavity variables with the Aizenman–Sims–Starr ROSt, and nested REM–PPP averaging gives the functional [1]. Notice that the balanced gauge is the diagonal specialization

qℓ=qℓ1.\mathbf{q}_{\ell} = q_{\ell}\mathbf{1}.

In this specialization one recovers

Qℓ(p)=dpqℓ,Qℓ=κqℓ2,Q_{\ell}^{(p)} = d_{p}q_{\ell}, \qquad Q_{\ell} = \kappa q_{\ell}^{2},

with the parameter dpd_{p} and κ\kappa as follows:

dp=(M1)p,κ=1TM11.d_{p} = (M_{1})_{p}, \qquad\kappa= \mathbf{1}^{\mathsf{T}}M_{1}\mathbf{1}.

Thus the scalar balanced formula is the diagonal case of the layer-wise functional. The final result is the finite-level functional of (26). For K=2K = 2, it gives the dense bipartite Ising RBM with Gaussian couplings and for K≥3K \ge3 it gives the corresponding adjacent-layer DBM. Its vector replica-symmetric reduction agrees with the expected multilayer RS structure, while the balanced RS expression is recovered by imposing q=q1\mathbf{q} = q\mathbf{1}. Finally, the RS splitting-instability check tests the local curvature of the functional: in the zero-field bipartite specialization it yields 4β4λ1λ2=14\beta^{4}\lambda_{1}\lambda_{2} = 1, matching the known annealed boundary of the bipartite spin glass [26].

The Nishimori-line deformation gives another exact benchmark: under αpN=λp\alpha_{p}^{N} = \lambda_{p} and μp,p+1=2βp2\mu_{p,p+1} = 2\beta_{p}^{2}, the CCM functional reduces to the known Nishimori variational integrand, confirming the vector layer-wise normalization of MM and M1M_{1} [27].

Section 11 connects the full functional with two independent formulations. For centered Gaussian couplings at zero external field, the bipartite specialization coincides with the replica expression of Hartnett, Parker and Geist [37], while (47) identifies the general multilayer functional with that of Chen, Issa and Mourrat [38]. The CCM thus provides a constructive derivation of these full-RSB expressions through blanket amplitudes and REM universality. In this setting, the thermodynamic value is characterized by the sup–inf theorem of Ref. [38], while § 10 studies local stationarity and splitting stability at finite depth.

The same counting principle suggests natural extensions. If the layer graph is not a path, M0M_0 is replaced by the weighted adjacency matrix of that graph, and M=2M0ΛM = 2M_0\Lambda, M1=ΛM0ΛM_1 = \Lambda M_0\Lambda are defined as before. For higher-order interactions, rectangular edge shells would be replaced by the corresponding hyperedge shells, with the appropriate combinatorial factors. The practical CCM rule remains the same: decompose the cavity variables into blanket components, identify their ROSt realization, and perform the nested REM–PPP average with the model-specific amplitudes.

Technical details of the layer-wise CCM computation

This appendix records the normalizations and finite-level identities used in the layer-wise scalar cavity functional. It is not needed for the flow of the main text, but it makes explicit where the factors in § 5 and § 7 come from. We use the boundary convention

β0=βK=0,λ0=λK+1=0.\beta_0=\beta_K=0,\qquad\lambda_0=\lambda_{K+1}=0.

With this convention, the balanced specialization gives

dp=2(βp−12λp−1+βp2λp+1)d_p=2\left(\beta_{p-1}^{2}\lambda_{p-1}+\beta_p^{2}\lambda_{p+1}\right)

for all layers p=1,…,Kp=1,\ldots,K. Also,

κ=2∑p=1K−1βp2λpλp+1=1TM11.\kappa=2\sum_{p=1}^{K-1}\beta_p^2\lambda_p\lambda_{p+1}=\mathbf{1}^{\mathsf{T}}M_1\mathbf{1}.

Indeed, since M1=ΛM0ΛM_1=\Lambda M_0\Lambda and M0M_0 is symmetric with off-diagonal entries βp2\beta_p^2,

1TM11=∑a,b=1Kλa(M0)abλb=2∑p=1K−1βp2λpλp+1.\mathbf{1}^{\mathsf{T}}M_1\mathbf{1} =\sum_{a,b=1}^{K}\lambda_a(M_0)_{ab}\lambda_b =2\sum_{p=1}^{K-1}\beta_p^2\lambda_p\lambda_{p+1}.

The factor 2 appears because the symmetric quadratic form counts both ordered pairs (p,p+1)(p,p+1) and (p+1,p)(p+1,p). For the cavity field, the blanket-ℓ\ell contribution in layer pp is

xN,p,ℓ(σ)=2N(βp−1∑i∈Vℓ∩Lp−1J~i(p−1)σ~i(p−1)+βp∑j∈Vℓ∩Lp+1J^j(p)σ^j(p+1)).x_{N,p,\ell}(\sigma)=\frac{\sqrt{2}}{\sqrt{N}}\left(\beta_{p-1}\sum_{i\in V_\ell\cap L_{p-1}}\widetilde{J}^{(p-1)}_i\widetilde{\sigma}^{(p-1)}_i+\beta_p\sum_{j\in V_\ell\cap L_{p+1}}\widehat{J}^{(p)}_j\widehat{\sigma}^{(p+1)}_j\right).

Conditioning on the reservoir configuration, the cross terms vanish because the fresh couplings are independent and centered. Since the spins are Ising variables,

Var⁡(xN,p,ℓ∣σ)=2βp−12N∣Vℓ∩Lp−1∣+2βp2N∣Vℓ∩Lp+1∣.\operatorname{Var}(x_{N,p,\ell}\mid\sigma)=\frac{2\beta_{p-1}^{2}}{N}|V_\ell\cap L_{p-1}|+\frac{2\beta_p^{2}}{N}|V_\ell\cap L_{p+1}|.

Using the layer-wise estimate

∣Vℓ∩La∣=λa(qℓ(a)−qℓ−1(a))N+o(N)|V_\ell\cap L_a|=\lambda_a\left(q_\ell^{(a)}-q_{\ell-1}^{(a)}\right)N+o(N)

gives the formula for the variance:

Var⁡(xN,p,ℓ∣σ)=(M(qℓ−qℓ−1))p+o(1).\operatorname{Var}(x_{N,p,\ell}\mid\sigma)=\left(M(\mathbf{q}_{\ell}-\mathbf{q}_{\ell-1})\right)_p+o(1).

At a fixed blanket, the neighboring-layer sums are independent Gaussians, so their variances add. This fixes the amplitude of the prefix-indexed cavity variable of § 5:

xpα=∑ℓ=1rzℓ,p(α≤ℓ)(M(qℓ−qℓ−1))p.x_p^\alpha=\sum_{\ell=1}^{r}z_{\ell,p}(\alpha_{\leq\ell})\sqrt{\left(M(\mathbf{q}_{\ell}-\mathbf{q}_{\ell-1})\right)_p}.

For the correction field, the blanket-ℓ\ell shell between two adjacent layers is

Wℓ(p,p+1)=Bℓ(p,p+1)∖Bℓ−1(p,p+1),ℓ=1,…,r,W_{\ell}^{(p,p+1)}=B_{\ell}^{(p,p+1)}\setminus B_{\ell-1}^{(p,p+1)},\qquad\ell=1,\ldots,r,
Bℓ(p,p+1)=(Uℓ∩Lp)×(Uℓ∩Lp+1).B_{\ell}^{(p,p+1)}=(U_{\ell}\cap L_p)\times(U_{\ell}\cap L_{p+1}).

Thus B0(p,p+1)=∅B_0^{(p,p+1)}=\varnothing and Br(p,p+1)=Lp×Lp+1B_r^{(p,p+1)}=L_p\times L_{p+1}. The layer-wise gauge gives

∣Wℓ(p,p+1)∣=λpλp+1N2(qℓ(p)qℓ(p+1)−qℓ−1(p)qℓ−1(p+1))+o(N2).\left|W_{\ell}^{(p,p+1)}\right|=\lambda_p\lambda_{p+1}N^2\left(q_{\ell}^{(p)}q_{\ell}^{(p+1)}-q_{\ell-1}^{(p)}q_{\ell-1}^{(p+1)}\right)+o(N^2).

Let us introduce a symbol for the difference

Δqℓ(p)=qℓ(p)−qℓ−1(p),\Delta q_{\ell}^{(p)}=q_{\ell}^{(p)}-q_{\ell-1}^{(p)},

then the increment decomposes as

qℓ(p)qℓ(p+1)−qℓ−1(p)qℓ−1(p+1)=qℓ−1(p)Δqℓ(p+1)+qℓ−1(p+1)Δqℓ(p)+Δqℓ(p)Δqℓ(p+1).q_{\ell}^{(p)}q_{\ell}^{(p+1)}-q_{\ell-1}^{(p)}q_{\ell-1}^{(p+1)} =q_{\ell-1}^{(p)}\Delta q_{\ell}^{(p+1)}+q_{\ell-1}^{(p+1)}\Delta q_{\ell}^{(p)}+\Delta q_{\ell}^{(p)}\Delta q_{\ell}^{(p+1)}.

The last term is the finite-level core contribution controlled on refinement in the IO reduction. The complete finite shell gives the correction variance below. The correction mark associated with this shell is

yN,ℓ(p,p+1)(σ)=2 βpN∑(i,j)∈Wℓ(p,p+1)J‾ij(p)σi(p)σj(p+1).y_{N,\ell}^{(p,p+1)}(\sigma)=\frac{\sqrt{2}\,\beta_p}{N}\sum_{(i,j)\in W_{\ell}^{(p,p+1)}}\overline{J}_{ij}^{(p)}\sigma_i^{(p)}\sigma_j^{(p+1)}.

The 1/N1/N normalization keeps the variance of this O(N2)O(N^2) edge sum of order one. Again, cross terms vanish by independence and centering, and each diagonal term contributes one because the spins are Ising. Hence we get

Var⁡(yN,ℓ(p,p+1)∣σ)=2βp2N2∣Wℓ(p,p+1)∣.\operatorname{Var}\left(y_{N,\ell}^{(p,p+1)}\mid\sigma\right)=\frac{2\beta_p^2}{N^2}\left|W_{\ell}^{(p,p+1)}\right|.

Therefore, the variance is rewritten as follows

Var⁡(yN,ℓ(p,p+1)∣σ)=2βp2λpλp+1(qℓ(p)qℓ(p+1)−qℓ−1(p)qℓ−1(p+1))+o(1).\operatorname{Var}\left(y_{N,\ell}^{(p,p+1)}\mid\sigma\right)=2\beta_p^2\lambda_p\lambda_{p+1}\left(q_{\ell}^{(p)}q_{\ell}^{(p+1)}-q_{\ell-1}^{(p)}q_{\ell-1}^{(p+1)}\right)+o(1).

The contributions of distinct edge-shells use independent fresh couplings, so the variances add:

Qℓ−Qℓ−1=qℓTM1qℓ−qℓ−1TM1qℓ−1,Qℓ=qℓTM1qℓ.Q_{\ell}-Q_{\ell-1}=\mathbf{q}_{\ell}^{\mathsf T}M_1\mathbf{q}_{\ell}-\mathbf{q}_{\ell-1}^{\mathsf T}M_1\mathbf{q}_{\ell-1},\qquad Q_{\ell}=\mathbf{q}_{\ell}^{\mathsf T}M_1\mathbf{q}_{\ell}.

The o(N)o(N) and o(N2)o(N^2) errors in the block and shell cardinalities produce only o(1)o(1) errors in the corresponding variances.

The Gaussian step of the nested REM–PPP average in § 7 is elementary. If gg is a standard Gaussian and v≥0v\geq0, then the identity holds

1mlog⁡Eexp⁡(mgv)=m2v.\frac{1}{m}\log\mathbb{E}\exp(mg\sqrt{v})=\frac{m}{2}v.

for m>0m>0, the value is 0 for m=0m=0 by continuity. Applying this identity blanket by blanket to

yα=∑k=1rgk(α≤k)qkTM1qk−qk−1TM1qk−1y^{\alpha}=\sum_{k=1}^{r}g_k(\alpha_{\leq k})\sqrt{\mathbf{q}_k^{\mathsf{T}}M_1\mathbf{q}_k-\mathbf{q}_{k-1}^{\mathsf{T}}M_1\mathbf{q}_{k-1}}

gives the expression for the fugacity correction

Elog⁡⟨eyα⟩ξ=12∑ℓ=0r−1ζℓ(qℓ+1TM1qℓ+1−qℓTM1qℓ).\mathbb{E}\log\langle e^{y^\alpha}\rangle_\xi=\frac{1}{2}\sum_{\ell=0}^{r-1}\zeta_\ell\left(\mathbf{q}_{\ell+1}^{\mathsf{T}}M_1\mathbf{q}_{\ell+1}-\mathbf{q}_{\ell}^{\mathsf{T}}M_1\mathbf{q}_{\ell}\right).

This is the finite-level form of the CCM interface reduction used in the main text. The balanced scalar expression is recovered by setting qℓ=qℓ1\mathbf{q}_\ell=q_\ell\mathbf{1}.

Finite-size identities for the symmetric three-layer model

This appendix records the finite-size identities for the symmetric three-layer model. They are diagnostic identities only; they are not used in the derivation of the layer-wise CCM functional. The point is that, for moderate layer size, the partition function can be summed exactly over the middle layer. Take

K=3,N1=N2=N3=n,N=3n,β1=β2=β,h=0.K=3,\qquad N_1=N_2=N_3=n,\qquad N=3n,\qquad\beta_1=\beta_2=\beta,\qquad h=0.

Let J(1)J^{(1)} and J(2)J^{(2)} have independent standard Gaussian entries. Writing the middle-layer spin as s∈{±1}ns\in\{\pm1\}^n, the Hamiltonian is

HN(σ(1),s,σ(3))=2β3n(∑i,j=1nJij(1)σi(1)sj+∑j,k=1nJjk(2)sjσk(3)).H_N(\sigma^{(1)},s,\sigma^{(3)})=\frac{\sqrt{2}\beta}{\sqrt{3n}}\left(\sum_{i,j=1}^{n}J_{ij}^{(1)}\sigma_i^{(1)}s_j+\sum_{j,k=1}^{n}J_{jk}^{(2)}s_j\sigma_k^{(3)}\right).

For fixed ss, the two outer layers can be summed independently. With

c=2β3n,c=\frac{\sqrt{2}\beta}{\sqrt{3n}},

one obtains the formula

ZN(β)=∑s∈{±1}n∏i=1n2cosh⁡(c(J(1)s)i)∏k=1n2cosh⁡(c((J(2))Ts)k).Z_N(\beta)=\sum_{s\in\{\pm1\}^n}\prod_{i=1}^{n}2\cosh\left(c(J^{(1)}s)_i\right)\prod_{k=1}^{n}2\cosh\left(c((J^{(2)})^{\mathsf{T}}s)_k\right).

Thus the formula for the average pressure

pN(β)=1NEJlog⁡ZN(β)p_N(\beta)=\frac{1}{N}\mathbb{E}_J\log Z_N(\beta)

can be estimated by exact spin summation for each disorder sample, followed by an empirical average over the disorder.

The same reduction gives an exact finite-size ground-state identity. For fixed ss, the optimal outer spins align with their local fields, hence

max⁡σ(1),σ(3)HN(σ(1),s,σ(3))=2β3n(∥J(1)s∥1+∥(J(2))Ts∥1).\max_{\sigma^{(1)},\sigma^{(3)}}H_N(\sigma^{(1)},s,\sigma^{(3)})=\frac{\sqrt{2}\beta}{\sqrt{3n}}\left(\left\|J^{(1)}s\right\|_1+\left\|(J^{(2)})^{\mathsf{T}}s\right\|_1\right).

Therefore,

eN(β)(J)=1Nmax⁡σHN(σ)=2β(3n)3/2max⁡s∈{±1}n(∥J(1)s∥1+∥(J(2))Ts∥1).e_N^{(\beta)}(J)=\frac{1}{N}\max_{\sigma}H_N(\sigma)=\frac{\sqrt{2}\beta}{(3n)^{3/2}}\max_{s\in\{\pm1\}^n}\left(\left\|J^{(1)}s\right\|_1+\left\|(J^{(2)})^{\mathsf{T}}s\right\|_1\right).

Ground-state values quoted per unit of β\beta correspond to setting β=1\beta=1 in this expression. Pair observables can also be sampled without Markov-chain Monte Carlo once the middle layer has been enumerated. The exact Gibbs weight of the middle configuration is proportional to

w(s)∝∏i=1n2cosh⁡(c(J(1)s)i)∏k=1n2cosh⁡(c((J(2))Ts)k).w(s) \propto\prod_{i=1}^{n} 2\cosh\bigl(c(J^{(1)}s)_i\bigr)\prod_{k=1}^{n} 2\cosh\bigl(c((J^{(2)})^{\mathsf{T}}s)_k\bigr).

Conditioned on ss, the outer spins are independent with means

mi(1)(s)=tanh⁡(c(J(1)s)i),mk(3)(s)=tanh⁡(c((J(2))Ts)k).m_i^{(1)}(s)=\tanh\bigl(c(J^{(1)}s)_i\bigr), \qquad m_k^{(3)}(s)=\tanh\bigl(c((J^{(2)})^{\mathsf{T}}s)_k\bigr).

These identities are useful for checking numerical implementations of the layer-wise functional and of its balanced scalar specialization. They do not determine the physical selection rule in the non-convex regime.

RS splitting-instability calculation

This appendix shows the linear calculation behind the RS splitting-instability surface used in § 8. The calculation is local around a vector RS solution of the CCM functional and tests whether an RS blanket can be split into two nearby blankets. Let q\mathbf{q} be a self-consistent RS solution,

q(p)=Eztanh⁡2(h(p)+z(Mq)p),p=1,…,K.q^{(p)}=\mathbb{E}_z\tanh^2\left(h^{(p)}+z\sqrt{(M\mathbf{q})_p}\right), \qquad p=1,\ldots,K.

Consider a one-split perturbation of the RS blanket. The two nearby blanket coordinates are denoted by q(0)\mathbf{q}^{(0)} and q(1)\mathbf{q}^{(1)}, and their difference is

δ=q(1)−q(0),∥δ∥≪1.\boldsymbol{\delta}=\mathbf{q}^{(1)}-\mathbf{q}^{(0)}, \qquad\lVert\boldsymbol{\delta}\rVert\ll1.

The corresponding infinitesimal increment of the cavity variance in layer pp is

ΔAp=(Mδ)p.\Delta A_p=(M\boldsymbol{\delta})_p.

The one-split self-consistency equations say that the difference between the two nearby blanket coordinates is, to first order, the local variance of the magnetization response produced by the additional Gaussian increment. Thus

δ(p)=Ezsech⁡4(h(p)+z(Mq)p)(Mδ)p+o(∥δ∥).\delta^{(p)}=\mathbb{E}_z\operatorname{sech}^4\left(h^{(p)}+z\sqrt{(M\mathbf{q})_p}\right)(M\boldsymbol{\delta})_p+o(\lVert\boldsymbol{\delta}\rVert).

Define the function

Γp=Ezsech⁡4(h(p)+z(Mq)p),Γ=diag⁡(Γ1,…,ΓK).\Gamma_p=\mathbb{E}_z\operatorname{sech}^4\left(h^{(p)}+z\sqrt{(M\mathbf{q})_p}\right), \qquad\Gamma=\operatorname{diag}(\Gamma_1,\ldots,\Gamma_K).

Then the linearized splitting equation is

δ=ΓMδ.(54)\boldsymbol{\delta}=\Gamma M\boldsymbol{\delta}. \tag*{(54)}

The boundary of linear stability of the RS solution is therefore

ρ(ΓM)=1.(55)\rho(\Gamma M)=1. \tag*{(55)}

This gives the RS splitting-instability surface. It is useful to rewrite the same condition with a symmetric matrix. Assume first that Γp>0\Gamma_p>0 on the layers under consideration and put

D=diag⁡(λ1/Γ1,…,λK/ΓK).D=\operatorname{diag}\left(\sqrt{\lambda_1/\Gamma_1},\ldots,\sqrt{\lambda_K/\Gamma_K}\right).

Then, the matrix K\mathcal{K} is defined as follows:

K=DΓMD−1,\mathcal{K}=D\Gamma M D^{-1},

it is symmetric and tridiagonal. Its diagonal entries vanish, and its adjacent-layer entries are

Kp,p+1=Kp+1,p=2βp2λpλp+1ΓpΓp+1,p=1,…,K−1.(56)\mathcal{K}_{p,p+1}=\mathcal{K}_{p+1,p}=2\beta_p^2\sqrt{\lambda_p\lambda_{p+1}\Gamma_p\Gamma_{p+1}},\qquad p=1,\ldots,K-1. \tag*{(56)}

Since K\mathcal{K} is similar to ΓM\Gamma M, we have

ρ(ΓM)=ρ(K),\rho(\Gamma M)=\rho(\mathcal{K}),

and the instability condition is ρ(K)=1\rho(\mathcal{K})=1. For two-layer RBM, let β1=β\beta_1=\beta and q=(u,v)\mathbf{q}=(u,v). Then

M=(02β2λ22β2λ10),ΓM=(02β2λ2Γ12β2λ1Γ20).M=\begin{pmatrix}0&2\beta^2\lambda_2\\2\beta^2\lambda_1&0\end{pmatrix},\qquad \Gamma M=\begin{pmatrix}0&2\beta^2\lambda_2\Gamma_1\\2\beta^2\lambda_1\Gamma_2&0\end{pmatrix}.

Therefore by doing the algebra we find

ρ(ΓM)=2β2λ1λ2Γ1Γ2,\rho(\Gamma M)=2\beta^2\sqrt{\lambda_1\lambda_2\Gamma_1\Gamma_2},

and the critical condition is therefore the following:

4β4λ1λ2Γ1Γ2=1.(57)4\beta^4\lambda_1\lambda_2\Gamma_1\Gamma_2=1. \tag*{(57)}

At zero external field, on the paramagnetic RS branch u=v=0u=v=0, one has Γ1=Γ2=1\Gamma_1=\Gamma_2=1, and the condition becomes the known identity [26]

4β4λ1λ2=1.(58)4\beta^4\lambda_1\lambda_2=1. \tag*{(58)}

Equivalently, since λ2=1−λ1\lambda_2=1-\lambda_1, this is

2β2λ1(1−λ1)=1.2\beta^2\sqrt{\lambda_1(1-\lambda_1)}=1.

For a three-layer chain, the symmetric matrix K\mathcal{K} has two non-zero adjacent entries,

K12=2β12λ1λ2Γ1Γ2,K23=2β22λ2λ3Γ2Γ3.\mathcal{K}_{12}=2\beta_1^2\sqrt{\lambda_1\lambda_2\Gamma_1\Gamma_2},\qquad \mathcal{K}_{23}=2\beta_2^2\sqrt{\lambda_2\lambda_3\Gamma_2\Gamma_3}.

Since the spectral radius of a three-node chain satisfies

ρ(K)2=K122+K232,\rho(\mathcal{K})^2=\mathcal{K}_{12}^2+\mathcal{K}_{23}^2,

the splitting-instability surface is

4β14λ1λ2Γ1Γ2+4β24λ2λ3Γ2Γ3=1.(59)4\beta_1^4\lambda_1\lambda_2\Gamma_1\Gamma_2+4\beta_2^4\lambda_2\lambda_3\Gamma_2\Gamma_3=1. \tag*{(59)}

This is the three-layer version of the same RS blanket-splitting criterion.

Nishimori-line deformation of the CCM functional

This appendix records the calculation behind the Nishimori benchmark used in § 9. The model studied in the main text has centered Gaussian couplings. In the ordered-pair convention of § 9, the Nishimori coupling between layers LpL_p and Lp+1L_{p+1}, in either orientation, is Gaussian with mean and variance tied,

J~ij(p)=μp,p+12N+μp,p+12NJij(p),Jij(p)∼N(0,1).(60)\widetilde{J}_{ij}^{(p)}=\frac{\mu_{p,p+1}}{2N}+\sqrt{\frac{\mu_{p,p+1}}{2N}}J_{ij}^{(p)},\qquad J_{ij}^{(p)}\sim\mathcal{N}(0,1). \tag*{(60)}

If random fields are included, the layer-pp field is taken on the same Nishimori line, with mean and variance both equal to h(p)h^{(p)}. Therefore the one-body Gaussian mark is not centered. A scalar mark of scale AA has the form

A+A z,z∼N(0,1),A+\sqrt{A}\,z,\qquad z\sim N(0,1),

and contributes to the functional as

ψ(A)=Ezlog⁡2cosh⁡(A+A z).(61)\psi(A)=\mathbb{E}_{z}\log2\cosh\left(A+\sqrt{A}\,z\right). \tag*{(61)}

For the layer-wise CCM coordinate q\mathbf{q}, the scale seen by a spin in the architectural layer LpL_p is

Ap(q)=h(p)+(Mq)p.A_p(\mathbf{q})=h^{(p)}+(M\mathbf{q})_p.

Thus the Nishimori one-body contribution is

∑p=1Kλpψ(h(p)+(Mq)p).(62)\sum_{p=1}^{K}\lambda_p\psi\left(h^{(p)}+(M\mathbf{q})_p\right). \tag*{(62)}

The correction term is modified as well. In the centered model the RS/vector correction is

12(1−q)TM1(1−q).\frac{1}{2}(\mathbf{1}-\mathbf{q})^{\mathsf T}M_1(\mathbf{1}-\mathbf{q}).

The non-centered part of the Nishimori couplings produces an additional deterministic contribution on the activated adjacent-layer edge mass:

−qTM1q.-\mathbf{q}^{\mathsf T}M_1\mathbf{q}.

Therefore the Nishimori correction is

CN(q)=12(1−q)TM1(1−q)−qTM1q.(63)C_{\mathrm N}(\mathbf{q})=\frac{1}{2}(\mathbf{1}-\mathbf{q})^{\mathsf T}M_1(\mathbf{1}-\mathbf{q})-\mathbf{q}^{\mathsf T}M_1\mathbf{q}. \tag*{(63)}

Since M1=ΛM0ΛM_1=\Lambda M_0\Lambda, this can be written edge by edge as follows. First,

12(1−q)TM1(1−q)=∑p=1K−1βp2λpλp+1(1−q(p))(1−q(p+1)),\frac{1}{2}(\mathbf{1}-\mathbf{q})^{\mathsf T}M_1(\mathbf{1}-\mathbf{q})=\sum_{p=1}^{K-1}\beta_p^2\lambda_p\lambda_{p+1}(1-q^{(p)})(1-q^{(p+1)}),

whereas the additional contribution

qTM1q=2∑p=1K−1βp2λpλp+1q(p)q(p+1).\mathbf{q}^{\mathsf T}M_1\mathbf{q}=2\sum_{p=1}^{K-1}\beta_p^2\lambda_p\lambda_{p+1}q^{(p)}q^{(p+1)}.

Hence the Nishimori correction is

CN(q)=∑p=1K−1βp2λpλp+1[(1−q(p))(1−q(p+1))−2q(p)q(p+1)].(64)C_{\mathrm N}(\mathbf{q})=\sum_{p=1}^{K-1}\beta_p^2\lambda_p\lambda_{p+1}\left[(1-q^{(p)})(1-q^{(p+1)})-2q^{(p)}q^{(p+1)}\right]. \tag*{(64)}

Combining (62) and (63), the Nishimori deformation of the CCM functional is

PNCCM(q)=∑p=1Kλpψ(h(p)+(Mq)p)+12(1−q)TM1(1−q)−qTM1q.(65)\mathcal{P}_{\mathrm N}^{\mathrm{CCM}}(\mathbf{q})=\sum_{p=1}^{K}\lambda_p\psi\left(h^{(p)}+(M\mathbf{q})_p\right)+\frac{1}{2}(\mathbf{1}-\mathbf{q})^{\mathsf T}M_1(\mathbf{1}-\mathbf{q})-\mathbf{q}^{\mathsf T}M_1\mathbf{q}. \tag*{(65)}

Equivalently, by (64),

PNCCM(q)=∑p=1Kλpψ(h(p)+(Mq)p)+∑p=1K−1βp2λpλp+1[(1−q(p))(1−q(p+1))−2q(p)q(p+1)].(66)\mathcal{P}_{\mathrm{N}}^{\mathrm{CCM}}(\mathbf{q}) = \sum_{p=1}^{K} \lambda_p \psi\left(h^{(p)} + (M\mathbf{q})_p\right) + \sum_{p=1}^{K-1} \beta_p^2\lambda_p\lambda_{p+1}\left[(1-q^{(p)})(1-q^{(p+1)}) - 2q^{(p)}q^{(p+1)}\right]. \tag*{(66)}

We now perform the comparison with the Nishimori variational integrand in coordinates. In the notation of the exactly solved Nishimori DBM, the layer proportions are denoted by αpN\alpha_p^{\mathrm{N}}, the adjacent-layer Nishimori parameters by μp,p+1\mu_{p,p+1}, and

Δp,p+1=αpNμp,p+1αp+1N.\Delta_{p,p+1} = \alpha_p^{\mathrm{N}}\mu_{p,p+1}\alpha_{p+1}^{\mathrm{N}}.

The corresponding interaction matrix acts as

(MNx)p=μp−1,pαp−1Nxp−1+μp,p+1αp+1Nxp+1,(M^{\mathrm{N}}x)_p = \mu_{p-1,p}\alpha_{p-1}^{\mathrm{N}}x_{p-1} + \mu_{p,p+1}\alpha_{p+1}^{\mathrm{N}}x_{p+1},

with the missing boundary terms omitted. The finite-dimensional variational integrand on the Nishimori line is

pvar(x;μ,h)=∑p=1KαpNψ(h(p)+(MNx)p)+∑p=1K−1Δp,p+12[(1−xp)(1−xp+1)−2xpxp+1].(67)p_{\mathrm{var}}(x;\mu,h) = \sum_{p=1}^{K}\alpha_p^{\mathrm{N}}\psi\left(h^{(p)} + (M^{\mathrm{N}}x)_p\right) + \sum_{p=1}^{K-1}\frac{\Delta_{p,p+1}}{2}\left[(1-x_p)(1-x_{p+1}) - 2x_px_{p+1}\right]. \tag*{(67)}

We now identify the Nishimori parameters with the parameters of the centered model by setting

αpN=λp,μp,p+1=2βp2,xp=q(p).(68)\alpha_p^{\mathrm{N}}=\lambda_p,\qquad\mu_{p,p+1}=2\beta_p^2,\qquad x_p=q^{(p)}. \tag*{(68)}

Then the one-body argument in equation (67) becomes exactly the one-body argument in the CCM expression. Indeed,

(MNx)p=2βp−12λp−1q(p−1)+2βp2λp+1q(p+1)=(Mq)p.(M^{\mathrm{N}}x)_p = 2\beta_{p-1}^2\lambda_{p-1}q^{(p-1)} + 2\beta_p^2\lambda_{p+1}q^{(p+1)} = (M\mathbf{q})_p.

Therefore we can write

∑p=1KαpNψ(h(p)+(MNx)p)=∑p=1Kλpψ(h(p)+(Mq)p).\sum_{p=1}^{K}\alpha_p^{\mathrm{N}}\psi\left(h^{(p)} + (M^{\mathrm{N}}x)_p\right) = \sum_{p=1}^{K}\lambda_p\psi\left(h^{(p)} + (M\mathbf{q})_p\right).

The edge coefficient also matches exactly:

Δp,p+12=αpNμp,p+1αp+1N2=λp(2βp2)λp+12=βp2λpλp+1.\frac{\Delta_{p,p+1}}{2} = \frac{\alpha_p^{\mathrm{N}}\mu_{p,p+1}\alpha_{p+1}^{\mathrm{N}}}{2} = \frac{\lambda_p(2\beta_p^2)\lambda_{p+1}}{2} = \beta_p^2\lambda_p\lambda_{p+1}.

Consequently the edge part of (67) becomes

∑p=1K−1βp2λpλp+1[(1−q(p))(1−q(p+1))−2q(p)q(p+1)],\sum_{p=1}^{K-1}\beta_p^2\lambda_p\lambda_{p+1}\left[(1-q^{(p)})(1-q^{(p+1)}) - 2q^{(p)}q^{(p+1)}\right],

which is precisely the edge expansion (64) of the CCM Nishimori correction. Substituting these two identities into (67) gives, term by term,

PNCCM(q)=pvar(q;μ,h).(69)\mathcal{P}_{\mathrm{N}}^{\mathrm{CCM}}(\mathbf{q}) = p_{\mathrm{var}}(\mathbf{q};\mu,h). \tag*{(69)}

Thus the appendix proves the matching used in Section 9: the one-body Nishimori mark fixes the first term, the deterministic part of the non-centered couplings gives the extra contribution −qTM1q-\mathbf{q}^{\mathsf{T}}M\mathbf{1}\mathbf{q}, and the identification (68) matches every adjacent-layer edge coefficient.

Acknowledgments

We thank Nicola Kistler (Goethe University Frankfurt) and ChatGPT (OpenAI) for important discussions and suggestions.

Declaration of Generative AI

Research, writing, and proofreading of the present manuscript were performed with AI assistance (GPT-6 Astra) under strict human guidance and scrutiny. We independently checked all mathematical arguments and take full responsibility for the content of the publication.

References

  1. [1]S. Franchini, Simplified Parisi Ansatz III: Constructive Cavity Method and Ultrametricity, arXiv:2610.34710 (2026). doi.org/10.48550/arXiv.2610.34710arxiv.org/abs/2610.34710
  2. [2]S. Franchini, Replica Symmetry Breaking without Replicas, Annals of Physics 450 (2023), 169220.DOI
  3. [3]S. Franchini, Universal scaling limits for spin networks via martingale methods, Proc. R. Soc. A 481 (2025), 20240774. doi:10.1098/rspa.2024.0774.DOI
  4. [4]S. Franchini, A simplified Parisi Ansatz, Communications in Theoretical Physics 73 (5) (2021), 055601.DOI
  5. [5]S. Franchini, A simplified Parisi Ansatz II: REM universality, Chaos, Solitons & Fractals 191 (2025), 115821. Corrigendum: Chaos, Solitons & Fractals 201 (2025), 117395.DOI
  6. [6]F. Concetti and S. Franchini, REM universality for linear random energy, arXiv:2604.06122 (2026). doi.org/10.48550/arXiv.2604.06122arxiv.org/abs/2604.06122
  7. [7]F. Concetti and S. Franchini, REM universality and Poisson-Dirichlet Gibbs weights for linear random energy, arXiv:2606.07757 (2026). doi.org/10.48550/arXiv.2606.07757arxiv.org/abs/2606.07757
  8. [8]D. Sherrington and S. Kirkpatrick, Solvable model of a spin-glass, Phys. Rev. Lett. 35 (1975), 1792–1796. doi:10.1103/PhysRevLett.35.1792.
  9. [9]G. Parisi, Infinite number of order parameters for spin-glasses, Phys. Rev. Lett. 43 (1979), 1754–1756. doi:10.1103/PhysRevLett.43.1754.
  10. [10]F. Guerra, Broken replica symmetry bounds in the mean field spin glass model, Commun. Math. Phys. 233 (2003), 1–12.DOI
  11. [11]M. Talagrand, The Parisi formula, Ann. of Math. 163 (2006), 221–263.
  12. [12]M. Aizenman, R. Sims, and S. L. Starr, An extended variational principle for the SK spin-glass model, Phys. Rev. B 68 (2003), 214403. doi:10.1103/PhysRevB.68.214403.DOI
  13. [13]D. H. Ackley, G. E. Hinton, and T. J. Sejnowski, A learning algorithm for Boltzmann machines, Cognitive Science 9 (1985), 147–169.
  14. [14]P. Smolensky, Information processing in dynamical systems: Foundations of harmony theory, in Parallel Distributed Processing: Explorations in the Microstructure of Cognition, Vol. 1, D. E. Rumelhart, J. L. McClelland, and the PDP Research Group (eds.), MIT Press, 1986, pp. 194–281.
  15. [15]R. Salakhutdinov and G. E. Hinton, Deep Boltzmann machines, Proceedings of the Twelfth International Conference on Artificial Intelligence and Statistics (AISTATS), PMLR 5 (2009), 448–455.
  16. [16]A. Barra, G. Genovese, P. Sollich, and D. Tantari, Phase transitions in restricted Boltzmann machines with generic priors, Phys. Rev. E 96 (2017), 042156. doi:10.1103/PhysRevE.96.042156.DOI
  17. [17]A. Barra, P. Contucci, E. Mingione, and D. Tantari, Multi-species mean field spin glasses. Rigorous results, Ann. Henri Poincaré 16 (2015), 691–708.arxiv.org/abs/1307.5154
  18. [18]D. Panchenko, The free energy in a multi-species Sherrington–Kirkpatrick model, Ann. Probab. 43 (2015), 3494–3513.DOI
  19. [19]D. Alberici, P. Contucci, and E. Mingione, Deep Boltzmann machines: Rigorous results at arbitrary depth, Ann. Henri Poincaré 22 (2021), 2619–2642. doi:10.1007/s00023-021-01027-2.DOI
  20. [20]E. Agliari, L. Albanese, F. Alemanno, and A. Fachechi, Pattern recognition in Deep Boltzmann machines, arXiv:2106.08978, 2021.arxiv.org/abs/2106.08978
  21. [21]H.-B. Chen and J.-C. Mourrat, On the free energy of vector spin glasses with non-convex interactions, Probab. Math. Phys. 6 (1) (2025), 1–80. doi:10.2140/pmp.2025.6.1. Preprint version: arXiv:2311.08980.DOI
  22. [22]H.-B. Chen, On free energy of non-convex multi-species spin glasses, ALEA Lat. Am. J. Probab. Math. Stat. 23 (2026), 429–473. doi:10.30757/ALEA.v23-17.DOI
  23. [23]D. Ruelle, A mathematical reformulation of Derrida’s REM and GREM, Commun. Math. Phys. 108 (1987), 225–239.DOI
  24. [24]E. Bolthausen and A.-S. Sznitman, On Ruelle’s probability cascades and an abstract cavity method, Commun. Math. Phys. 197 (1998), 247–276. doi:10.1007/s002200050450.DOI
  25. [25]L.-P. Arguin, Spin glass computations and Ruelle’s probability cascades, arXiv:math-ph/0608045 (2006).DOI
  26. [26]A. Barra, G. Genovese, and F. Guerra, Equilibrium statistical mechanics of bipartite spin systems, J. Phys. A: Math. Theor. 44 (2011), 245002. arXiv:1012.1261.DOI
  27. [27]D. Alberici, F. Camilli, P. Contucci, and E. Mingione, The solution of the deep Boltzmann machine on the Nishimori line, Comm. Math. Phys. 387 (2021), 1191–1214. doi:10.1007/s00220-021-04165-0.DOI
  28. [28]A. Auffinger and W.-K. Chen, The Parisi formula has a unique minimizer, Comm. Math. Phys. 335 (2015), 1429–1444.DOI
  29. [29]J. R. L. de Almeida and D. J. Thouless, Stability of the Sherrington–Kirkpatrick solution of a spin glass model, J. Phys. A: Math. Gen. 11 (1978), 983–990.
  30. [30]G. Genovese, Minimax formula for the replica symmetric free energy of deep restricted Boltzmann machines, Ann. Appl. Probab. 33 (2023), 2324–2341. doi:10.1214/22-AAP1868.DOI
  31. [31]K. Friston, The free-energy principle: a unified brain theory?, Nature Reviews Neuroscience 11 (2010), 127–138.DOI
  32. [32]K. Friston, Life as we know it, Journal of The Royal Society Interface 10 (2013), 20130475.DOI
  33. [33]M. D. Kirchhoff, T. Parr, E. Palacios, K. Friston, and J. Kiverstein, The Markov blankets of life: autonomy, active inference and the free energy principle, Journal of The Royal Society Interface 15 (2018), 20170792.DOI
  34. [34]S. Franchini, G. Bardella, Lattice Field Theory for a network of real neurons, 42nd International Symposium on Lattice Field Theory (LATTICE2025), arXiv:2604.05251 (2026).DOI
  35. [35]G. Bardella, S. Franchini, L. Pan, R. Balzan, E. Brunamonti, P. Pani, S. Ferraina, Neural activity in quarks language: Lattice Field Theory for a network of real neurons, Entropy 26 (2024), 495.DOI
  36. [36]G. Bardella, S. Franchini, P. Pani, S. Ferraina, Lattice physics approaches for neural networks, iScience 27 (2024), 111390.DOI
  37. [37]G. S. Hartnett, E. Parker, and E. Geist, Replica symmetry breaking in bipartite spin glasses and neural networks, Phys. Rev. E 98 (2018), 022116. doi:10.1103/PhysRevE.98.022116. Cited preprint version: arXiv:1803.06442v4.DOI
  38. [38]H.-B. Chen, V. Issa, and J.-C. Mourrat, Free energy of non-convex multi-species spin glasses with centered Ising spins, arXiv:2606.16636v2 (2026).arxiv.org/abs/2606.16636

Paper details

vlnc:W_tr86855s
Version
v1 · latest
Published
Fresh — added to the Hub within the last 30 days
Added
License
CC BY 4.0
Usage

views · 1

downloads · 0

A view counts once per browser per day, a download each time the PDF is requested.

  • Physics and Astronomy

ChatGPT (OpenAI), GPT-6 Astra

View statement
Looking for related papers…
Contents