Introduction
The random-access problem in DNA-based storage asks how coding can reduce the number of random reads needed to recover a prescribed information symbol [1 ] . In the noiseless uniform model, k k k information symbols are encoded into n n n symbols, which are sampled independently and uniformly with replacement. The objective is to minimize the expected number of samples needed for recovery, typically taking the maximum over the requested information symbols.
Related work considers several retrieval goals, including reconstructing the entire message [2 ] , [3 ] , recovering requested files [4 ] or sets of information symbols [5 ] , characterizing tradeoffs between individual file retrieval times [6 ] , [7 ] , and recovering a fraction of the message using LT codes [8 ] . Other studies address errors and nonuniform sampling [9 ] –[11 ] , repair of failed storage containers [12 ] , and parallel sampling from multiple containers [13 ] . Further coverage models consider draws that reveal subsets or windows [14 ] , and repeated observations of composite symbols or motif combinations [15 ] –[17 ] .
Here, we focus on recovering a single information symbol under noiseless uniform sampling. For a linear encoding, the requested symbol x i x_i x i is recoverable when the standard basis vector e i e_i e i belongs to the span of the sampled generator-matrix columns. Uncoded storage requires k k k samples in expectation, whereas suitable encodings achieve smaller expectations [1 ] , [18 ] . Work on this problem includes combinatorial expressions for recovery expectations [18 ] , geometric constructions [19 ] , asymptotic and distributional analyses [20 ] , and algorithms for evaluating expectations together with improved constructions and bounds [21 ] . Recent work also establishes identities relating coordinate recovery times in a code and its dual [22 ] .
Particularly relevant are the constructions of Boruchovsky et al. [23 ] , which combine repeated systematic columns with columns supported on pairs of information coordinates. Their analysis uses a graph whose edges represent these pair observations. Besides solving the dimension-two problem, they obtained an asymptotic normalized upper bound of π 2 / 12 ≈ 0.8225 \pi^2/12 \approx0.8225 π 2 /12 ≈ 0.8225 using constructions over sufficiently large finite fields.
Hofmeister, Bitar, and Yaakobi [24 ] studied binary fully symmetric generator matrices, in which all columns of a given weight occur equally often. They connected sampling from these matrices to LT encoding and proved that, for bounded column weights, the asymptotic expected recovery time divided by k k k is at least π / 4 \pi/4 π /4 under peeling decoding. Their optimized degree distributions achieve approximately 0.7869, while restricting the weights to one and two gives approximately 0.7939. An optimal decoder can exploit linear dependencies that peeling does not resolve, so this lower bound does not immediately apply under optimal decoding.
In this work, we prove that the lower bound of π / 4 \pi/4 π /4 holds under optimal decoding for ensembles with uniformly random supports and independently sampled nonzero coefficients over finite or infinite fields. The degree distribution may vary with k k k , provided that the column weights have a common finite bound. The proof relates coordinate recovery to rank increments and combines the sparse random matrix rank formula of Coja-Oghlan et al. [25 ] with an integral inequality. For singleton–pair observations, we determine the exact limiting expectation and show that optimal and peeling decoding have the same limit. We also give explicit constructions over every fixed finite field attaining the optimized limit of approximately 0.793933445, and positive-rate block constructions that approximate it arbitrarily closely.
Notation and Problem Formulation
For a positive integer k k k , let [ k ] = { 1 , … , k } [k]=\{1,\ldots,k\} [ k ] = { 1 , … , k } . Throughout, F \mathbb{F} F is a field equipped with a σ \sigma σ -algebra that makes it a standard Borel space and with respect to which addition and multiplication are measurable, F ∗ = F ∖ { 0 } \mathbb{F}^{*}=\mathbb{F}\setminus\{0\} F ∗ = F ∖ { 0 } , e i ∈ F k e_i\in\mathbb{F}^{k} e i ∈ F k denotes the i i i -th standard basis vector, and all logarithms are natural. The support of a vector v ∈ F k \mathbf{v}\in\mathbb{F}^{k} v ∈ F k is supp ( v ) = { i ∈ [ k ] : v i ≠ 0 } \operatorname{supp}(\mathbf{v})=\{i\in[k]:v_i\ne0\} supp ( v ) = { i ∈ [ k ] : v i = 0 } , and its weight is ∣ supp ( v ) ∣ |\operatorname{supp}(\mathbf{v})| ∣ supp ( v ) ∣ . For vectors v 1 , … , v n \mathbf{v}_1,\ldots,\mathbf{v}_n v 1 , … , v n , we write ⟨ v 1 , … , v n ⟩ \langle\mathbf{v}_1,\ldots,\mathbf{v}_n\rangle ⟨ v 1 , … , v n ⟩ for their span, and for a matrix M M M , ⟨ M ⟩ \langle M\rangle ⟨ M ⟩ denotes its column span.
The observations are generated by independent random columns v 1 , v 2 , … ∈ F k \mathbf{v}_1,\mathbf{v}_2,\ldots\in\mathbb{F}^{k} v 1 , v 2 , … ∈ F k . Their distribution is determined by a probability distribution P k P_k P k on [ k ] [k] [ k ] , called the degree distribution , and a probability distribution μ \mu μ on F ∗ \mathbb{F}^{*} F ∗ , called the coefficient distribution. To generate v j \mathbf{v}_j v j , a weight w w w is drawn according to P k P_k P k , a support S ⊆ [ k ] S \subseteq[k] S ⊆ [ k ] is chosen uniformly at random among all subsets of size w w w , and the entries of v j \mathbf{v}_j v j indexed by S S S are drawn independently according to μ \mu μ . All other entries are zero. For ∣ F ∣ > 2 |\mathbb{F}|>2 ∣ F ∣ > 2 , the support alone does not determine the coefficients, as distinct columns of a fixed generator matrix may share a support.
For F = F 2 \mathbb{F}=\mathbb{F}_2 F = F 2 , every nonzero entry equals 1 1 1 , so v j \mathbf{v}_j v j is determined by its support. This case describes sampling from a fixed binary generator matrix. Following [24 ] , a binary k × n k\times n k × n matrix G G G is called fully symmetric if, for every w ∈ [ k ] w\in[k] w ∈ [ k ] , all vectors of weight w w w appear as columns of G G G equally often. As observed in [24 ] , a uniformly sampled column of such a matrix has weight w w w with probability equal to the fraction of columns of G G G of weight w w w , and, given its weight, it is uniform among all vectors of that weight. Hence, sampling the columns of G G G uniformly with replacement is the case F = F 2 \mathbb{F}=\mathbb{F}_2 F = F 2 of our model, with P k P_k P k equal to the column-weight distribution of G G G .
Let x ∈ F k \mathbf{x}\in\mathbb{F}^k x ∈ F k denote the information vector. The j j j -th observation is x T v j \mathbf{x}^{\mathsf{T}}\mathbf{v}_j x T v j , so after n n n observations the decoder knows x T M k ( n ) \mathbf{x}^{\mathsf{T}}M_k(n) x T M k ( n ) , where M k ( n ) = [ v 1 ⋯ v n ] M_k(n)=[\mathbf{v}_1\ \cdots\ \mathbf{v}_n] M k ( n ) = [ v 1 ⋯ v n ] is the k × n k\times n k × n matrix formed by the first n n n columns, and ⟨ M k ( 0 ) ⟩ = { 0 } \langle M_k(0)\rangle=\{\mathbf{0}\} ⟨ M k ( 0 )⟩ = { 0 } . The symbol x i x_i x i is determined by x T M k ( n ) \mathbf{x}^{\mathsf{T}}M_k(n) x T M k ( n ) for every x ∈ F k \mathbf{x}\in\mathbb{F}^k x ∈ F k if and only if e i ∈ ⟨ M k ( n ) ⟩ \mathbf{e}_i\in\langle M_k(n)\rangle e i ∈ ⟨ M k ( n )⟩ . Indeed, if e i = M k ( n ) ⋅ a \mathbf{e}_i=M_k(n)\cdot\mathbf{a} e i = M k ( n ) ⋅ a , then x i = x T ⋅ M k ( n ) ⋅ a x_i=\mathbf{x}^{\mathsf{T}}\cdot M_k(n)\cdot\mathbf{a} x i = x T ⋅ M k ( n ) ⋅ a . Otherwise, there exists z ∈ F k \mathbf{z}\in\mathbb{F}^k z ∈ F k with z i ≠ 0 z_i\ne0 z i = 0 and z T ⋅ M k ( n ) = 0 \mathbf{z}^{\mathsf{T}}\cdot M_k(n)=\mathbf{0} z T ⋅ M k ( n ) = 0 . Then x \mathbf{x} x and x + z \mathbf{x}+\mathbf{z} x + z give the same observations, while ( x + z ) i = x i + z i ≠ x i (\mathbf{x}+\mathbf{z})_i=x_i+z_i\ne x_i ( x + z ) i = x i + z i = x i . Accordingly, the recovery time of the i i i -th information symbol is
τ i = min { n ≥ 0 : e i ∈ ⟨ M k ( n ) ⟩ } , (1) \tau_i=\min\{n\ge0:\mathbf{e}_i\in\langle M_k(n)\rangle\}, \tag*{(1)} τ i = min { n ≥ 0 : e i ∈ ⟨ M k ( n )⟩} , (1)
with min ∅ = ∞ \min\varnothing=\infty min ∅ = ∞ . This is the number of observations required by an optimal decoder, without any restriction on the decoding procedure.
Since the distribution of each column is invariant under permutations of the coordinates, the distribution of τ i \tau_i τ i does not depend on i i i . We study the normalized expected recovery time E [ τ i ] / k \mathbb{E}[\tau_i]/k E [ τ i ] / k . For α ≥ 0 \alpha\ge0 α ≥ 0 , let
U k ( α ) = P { e i ∉ ⟨ M k ( ⌊ α k ⌋ ) ⟩ } U_k(\alpha)=\mathbb{P}\{\mathbf{e}_i\notin\langle M_k(\lfloor\alpha k\rfloor)\rangle\} U k ( α ) = P { e i ∈ / ⟨ M k (⌊ α k ⌋)⟩}
be the probability that the i i i -th symbol is not recovered after ⌊ α k ⌋ \lfloor\alpha k\rfloor ⌊ α k ⌋ observations. Its dependence on P k P_k P k and μ \mu μ is suppressed from the notation. Since τ i \tau_i τ i is integer valued, P { τ i > α k } = P { τ i > ⌊ α k ⌋ } = U k ( α ) \mathbb{P}\{\tau_i>\alpha k\}=\mathbb{P}\{\tau_i>\lfloor\alpha k\rfloor\}=U_k(\alpha) P { τ i > α k } = P { τ i > ⌊ α k ⌋} = U k ( α ) , and therefore
E [ τ i ] k = ∫ 0 ∞ P { τ i > α k } d α = ∫ 0 ∞ U k ( α ) d α . (2) \frac{\mathbb{E}[\tau_i]}{k}=\int_0^\infty\mathbb{P}\{\tau_i>\alpha k\}\,d\alpha=\int_0^\infty U_k(\alpha)\,d\alpha. \tag*{(2)} k E [ τ i ] = ∫ 0 ∞ P { τ i > α k } d α = ∫ 0 ∞ U k ( α ) d α . (2)
Theorem 1. Let F \mathbb{F} F be a field, let μ \mu μ be a probability distribution on F \mathbb{F} F , and let W W W be a positive integer. For every sequence ( P k ) (P_k) ( P k ) of degree distributions such that every column has weight at most W W W , that is, P k ( w ) = 0 P_k(w)=0 P k ( w ) = 0 for all w > W w>W w > W ,
lim inf k → ∞ E [ τ i ] k ≥ π 4 . (3) \liminf_{k\to\infty}\frac{\mathbb{E}[\tau_i]}{k}\ge\frac{\pi}{4}. \tag*{(3)} k → ∞ lim inf k E [ τ i ] ≥ 4 π . (3)
For F = F 2 \mathbb{F}=\mathbb{F}_2 F = F 2 , Theorem 1 applies to every sequence of binary fully symmetric generator matrices whose columns have weight at most W W W . Since an optimal decoder recovers x i x_i x i no later than any other decoder, the theorem strengthens the bound of [24 ] , which was proved for the peeling decoder.
The proof has two parts. In Section III, we bound U k ( α ) U_k(\alpha) U k ( α ) from below, as k → ∞ k\to\infty k → ∞ , by an explicit function obtained from the rank of a sparse random matrix. In Section IV, we show that the integral of this function is at least π / 4 \pi/4 π /4 . Both parts are first carried out for a fixed degree distribution P = ( p 1 , … , p W ) P=(p_1,\ldots,p_W) P = ( p 1 , … , p W ) on [ W ] [W] [ W ] , which we identify with its probability generating polynomial P ( z ) P(z) P ( z ) . The extension to sequences ( P k ) (P_k) ( P k ) is given at the end of Section IV.
A Lower Bound on the Probability of Non-Recovery
Throughout this section and Section IV, except in the proof of Theorem 1, the degree distribution is fixed. That is, P k = P P_k=P P k = P for all k ≥ W k\ge W k ≥ W , where P = ( p 1 , … , p W ) P=(p_1,\ldots,p_W) P = ( p 1 , … , p W ) is a probability distribution on [ W ] [W] [ W ] . We identify P P P with its probability generating polynomial
P ( z ) = ∑ w = 1 W p w z w , z ∈ [ 0 , 1 ] , P(z)=\sum_{w=1}^{W}p_w z^w,\qquad z\in[0,1], P ( z ) = w = 1 ∑ W p w z w , z ∈ [ 0 , 1 ] ,
and denote its derivative by P ′ ( z ) = ∑ w = 1 W w p w z w − 1 P'(z)=\sum_{w=1}^{W}wp_wz^{w-1} P ′ ( z ) = ∑ w = 1 W w p w z w − 1 . Note that P ( 0 ) = 0 P(0)=0 P ( 0 ) = 0 and P ′ ( 1 ) = 1 P'(1)=1 P ′ ( 1 ) = 1 .
Our lower bound on U k ( α ) U_k(\alpha) U k ( α ) compares the rank of M k ( ⌊ α k ⌋ ) M_k(\lfloor\alpha k\rfloor) M k (⌊ α k ⌋) with the rank of an augmented matrix. Fix α , β ≥ 0 \alpha,\beta\ge0 α , β ≥ 0 , and let N 1 , … , N k N_1,\ldots,N_k N 1 , … , N k be Poisson random variables with mean β \beta β , independent of each other and of M k ( ⌊ α k ⌋ ) M_k(\lfloor\alpha k\rfloor) M k (⌊ α k ⌋) . Let S k ( β ) S_k(\beta) S k ( β ) be the k × ( N 1 + ⋯ + N k ) k\times(N_1+\cdots+N_k) k × ( N 1 + ⋯ + N k ) matrix that contains N j N_j N j copies of e j \mathbf{e}_j e j for every j ∈ [ k ] j\in[k] j ∈ [ k ] . We refer to its columns as singleton columns , and to M ~ k ( α , β ) = [ M k ( ⌊ α k ⌋ ) S k ( β ) ] \widetilde{M}_k(\alpha,\beta)=[M_k(\lfloor\alpha k\rfloor)\ \ S_k(\beta)] M k ( α , β ) = [ M k (⌊ α k ⌋) S k ( β )] as the augmented matrix . Define
R k ( α , β ) = 1 k E [ rank M ~ k ( α , β ) ] . R_k(\alpha,\beta)=\frac{1}{k}\mathbb{E}[\operatorname{rank}\widetilde{M}_k(\alpha,\beta)]. R k ( α , β ) = k 1 E [ rank M k ( α , β )] .
In particular, R k ( α , 0 ) = 1 k E [ rank M k ( ⌊ α k ⌋ ) ] R_k(\alpha,0)=\frac{1}{k}\mathbb{E}[\operatorname{rank}M_k(\lfloor\alpha k\rfloor)] R k ( α , 0 ) = k 1 E [ rank M k (⌊ α k ⌋)] . Repeated copies of e j \mathbf{e}_j e j do not change the column span, so only the event { N j ≥ 1 } \{N_j\ge1\} { N j ≥ 1 } , which has probability 1 − e − β 1-e^{-\beta} 1 − e − β , matters for the rank.
Lemma 2. For every α ≥ 0 \alpha\ge0 α ≥ 0 and β > 0 \beta>0 β > 0 ,
U k ( α ) ≥ R k ( α , β ) − R k ( α , 0 ) 1 − e − β . (4) U_k(\alpha)\ge\frac{R_k(\alpha,\beta)-R_k(\alpha,0)}{1-e^{-\beta}}. \tag*{(4)} U k ( α ) ≥ 1 − e − β R k ( α , β ) − R k ( α , 0 ) . (4)
Proof. Write M = M k ( ⌊ α k ⌋ ) M=M_k(\lfloor\alpha k\rfloor) M = M k (⌊ α k ⌋) , and let J = { j ∈ [ k ] : N j ≥ 1 } J=\{j\in[k]:N_j\ge1\} J = { j ∈ [ k ] : N j ≥ 1 } be the set of coordinates that receive at least one singleton column. Appending a column e j \mathbf{e}_j e j increases the rank by at most one, and by zero if e j ∈ ⟨ M ⟩ \mathbf{e}_j\in\langle M\rangle e j ∈ ⟨ M ⟩ . Hence, appending the singleton columns increases the rank of M M M by at most ∣ { j ∈ J : e j ∉ ⟨ M ⟩ } ∣ |\{j\in J:\mathbf{e}_j\notin\langle M\rangle\}| ∣ { j ∈ J : e j ∈ / ⟨ M ⟩} ∣ . Since J J J is independent of M M M , and each j ∈ [ k ] j\in[k] j ∈ [ k ] belongs to J J J with probability 1 − e − β 1-e^{-\beta} 1 − e − β , taking expectations gives
k ( R k ( α , β ) − R k ( α , 0 ) ) = E [ rank M ~ k ( α , β ) − rank M ] ≤ E [ ∑ j = 1 k 1 { j ∈ J } ⋅ 1 { e j ∉ ⟨ M ⟩ } ] = ∑ j = 1 k P { j ∈ J } ⋅ P { e j ∉ ⟨ M ⟩ } = ( 1 − e − β ) k U k ( α ) . \begin{aligned}
k\bigl(R_k(\alpha,\beta)-R_k(\alpha,0)\bigr)
=\mathbb{E}\bigl[\operatorname{rank}\widetilde{M}_k(\alpha,\beta)-\operatorname{rank}M\bigr] \\
&\le\mathbb{E}\left[\sum_{j=1}^{k}\mathbf{1}_{\{j\in J\}}\cdot\mathbf{1}_{\{\mathbf{e}_j\notin\langle M\rangle\}}\right] \\
&=\sum_{j=1}^{k}\mathbb{P}\{j\in J\}\cdot\mathbb{P}\{\mathbf{e}_j\notin\langle M\rangle\} \\
&=(1-e^{-\beta})\,kU_k(\alpha).
\end{aligned} k ( R k ( α , β ) − R k ( α , 0 ) ) = E [ rank M k ( α , β ) − rank M ] ≤ E [ j = 1 ∑ k 1 { j ∈ J } ⋅ 1 { e j ∈ / ⟨ M ⟩} ] = j = 1 ∑ k P { j ∈ J } ⋅ P { e j ∈ / ⟨ M ⟩} = ( 1 − e − β ) k U k ( α ) .
♀♀♀♀♀♀ For z ∈ [ 0 , 1 ] z \in[0,1] z ∈ [ 0 , 1 ] and α , β ≥ 0 \alpha,\beta\ge0 α , β ≥ 0 , let
H ( z ) = 1 − P ( z ) − ( 1 − z ) P ′ ( z ) , (5) H(z)=1-P(z)-(1-z)P'(z), \tag*{(5)} H ( z ) = 1 − P ( z ) − ( 1 − z ) P ′ ( z ) , (5)
Φ α , β ( z ) = e − β − α P ′ ( z ) − α H ( z ) , (6) \Phi_{\alpha,\beta}(z)=e^{-\beta-\alpha P'(z)}-\alpha H(z), \tag*{(6)} Φ α , β ( z ) = e − β − α P ′ ( z ) − α H ( z ) , (6)
R P ( α , β ) = 1 − max 0 ≤ z ≤ 1 Φ α , β ( z ) . (7) R_P(\alpha,\beta)=1-\max_{0\le z\le1}\Phi_{\alpha,\beta}(z). \tag*{(7)} R P ( α , β ) = 1 − 0 ≤ z ≤ 1 max Φ α , β ( z ) . (7)
We show that R k ( α , β ) → R P ( α , β ) R_k(\alpha,\beta)\to R_P(\alpha,\beta) R k ( α , β ) → R P ( α , β ) using a rank formula of Coja-Oghlan et al. [25 ] , which holds over every field and for every distribution of the nonzero entries. This formula applies to random sparse matrices whose support is generated differently from our model. In our model, each column chooses its support independently, and the number of nonzero entries in each row is determined by these choices. In [25 ] , one first fixes the number of nonzero entries in every row and every column, and then chooses the support uniformly at random among all patterns with these row and column counts.
Specifically, for α ≥ 0 \alpha\ge0 α ≥ 0 and β > 0 \beta>0 β > 0 , let B k B_k B k be the random k × N k\times N k × N matrix over F \mathbb{F} F generated as follows. The number of columns is N ∼ Poisson ( ( α + β ) k ) N\sim\operatorname{Poisson}((\alpha+\beta)k) N ∼ Poisson (( α + β ) k ) . For each column j ∈ [ N ] j\in[N] j ∈ [ N ] , the number w j w_j w j of its nonzero entries is drawn according to
P { w j = 1 } = β + α p 1 α + β and P { w j = w } = α p w α + β , (8) \mathbb{P}\{w_j=1\}=\frac{\beta+\alpha p_1}{\alpha+\beta}
\quad\text{and}\quad
\mathbb{P}\{w_j=w\}=\frac{\alpha p_w}{\alpha+\beta}, \tag*{(8)} P { w j = 1 } = α + β β + α p 1 and P { w j = w } = α + β α p w , (8)
for any 2 ≤ w ≤ W 2\le w\le W 2 ≤ w ≤ W . For each row i ∈ [ k ] i\in[k] i ∈ [ k ] , the number of its nonzero entries d i d_i d i is drawn according to Poisson ( α P ′ ( 1 ) + β ) \operatorname{Poisson}(\alpha P'(1)+\beta) Poisson ( α P ′ ( 1 ) + β ) . All these numbers are drawn independently. If d 1 + ⋯ + d k ≠ w 1 + ⋯ + w N d_1+\cdots+d_k\ne w_1+\cdots+w_N d 1 + ⋯ + d k = w 1 + ⋯ + w N , or if no k × N k\times N k × N zero-one pattern has d i d_i d i ones in row i i i and w j w_j w j ones in column j j j for all i , j i,j i , j , the numbers are drawn again. Otherwise, the support of B k B_k B k is chosen uniformly at random among all such patterns, and the entries on the support are drawn independently according to μ \mu μ .
Claim 3. For fixed α ≥ 0 \alpha\ge0 α ≥ 0 and β > 0 \beta>0 β > 0 , as k → ∞ k\to\infty k → ∞ , the column-weight proportions of M k ( α , β ) M_k(\alpha,\beta) M k ( α , β ) converge in probability to the probabilities in (8). The number of nonzero entries in any fixed row converges in distribution to Poisson ( α P ′ ( 1 ) + β ) \operatorname{Poisson}(\alpha P'(1)+\beta) Poisson ( α P ′ ( 1 ) + β ) .
Proof. The number of original columns of weight w w w , divided by k k k , converges in probability to α p w \alpha p_w α p w . The number of appended singleton columns, divided by k k k , converges in probability to β \beta β . Since the total number of columns divided by k k k converges to α + β > 0 \alpha+\beta>0 α + β > 0 , their proportions give (8).
Each original column independently has a nonzero entry in a fixed row with probability ∑ w p w w / k = P ′ ( 1 ) / k \sum_w p_w w/k=P'(1)/k ∑ w p w w / k = P ′ ( 1 ) / k . Thus its row count is binomial with parameters ⌊ α k ⌋ \lfloor\alpha k\rfloor ⌊ α k ⌋ and P ′ ( 1 ) / k P'(1)/k P ′ ( 1 ) / k , and converges to Poisson ( α P ′ ( 1 ) ) \operatorname{Poisson}(\alpha P'(1)) Poisson ( α P ′ ( 1 )) . Adding the independent Poisson ( β ) \operatorname{Poisson}(\beta) Poisson ( β ) singleton count gives the asserted limit.
The dependence between row counts and the conditioning in B k B_k B k are handled in the proof of Lemma 5.
Theorem 4 ([25 Theorem 1.1] ). For every field F \mathbb{F} F defined as in Section II, every distribution μ \mu μ on F ∗ \mathbb{F}^{*} F ∗ , and all α ≥ 0 \alpha\ge0 α ≥ 0 and β > 0 \beta>0 β > 0 ,
rank B k k ⟶ R P ( α , β ) in probability as k → ∞ . \frac{\operatorname{rank} B_k}{k}\longrightarrow R_P(\alpha,\beta)\quad\text{in probability as }k\to\infty. k rank B k ⟶ R P ( α , β ) in probability as k → ∞.
Theorem 4 is [25 Theorem 1.1] applied to the transpose of B k B_k B k , after simplifying the limit. The assumption β > 0 \beta>0 β > 0 ensures the divisibility condition required there, and independent nonzero entries are covered by [25 Section 1.2, footnote 2] .
Lemma 5. For every fixed α , β ≥ 0 \alpha,\beta\ge0 α , β ≥ 0 ,
lim k → ∞ R k ( α , β ) = R P ( α , β ) . (9) \lim_{k\to\infty}R_k(\alpha,\beta)=R_P(\alpha,\beta). \tag*{(9)} k → ∞ lim R k ( α , β ) = R P ( α , β ) . (9) Proof. Assume first that β > 0 \beta>0 β > 0 . The augmented matrix differs from B k B_k B k in two ways. First, the number of columns taken from M k M_k M k is fixed rather than Poisson. Second, its support is generated column by column whereas the support of B k B_k B k is chosen uniformly given all row and column counts. We remove the first difference by passing to a Poisson number of columns, and then show that the second difference does not affect the limit. The case β = 0 \beta=0 β = 0 is treated at the end.
First, let M k ′ ( α , β ) M'_k(\alpha,\beta) M k ′ ( α , β ) be defined as M k ( α , β ) M_k(\alpha,\beta) M k ( α , β ) , except that the number of M k M_k M k columns taken from M k M_k M k is an independent Poisson ( α k ) \operatorname{Poisson}(\alpha k) Poisson ( α k ) random variable instead of ⌊ α k ⌋ \lfloor\alpha k\rfloor ⌊ α k ⌋ . Since adding or removing a column changes the rank by at most one, the expected ranks of M k ( α , β ) M_k(\alpha,\beta) M k ( α , β ) and M k ′ ( α , β ) M'_k(\alpha,\beta) M k ′ ( α , β ) differ by at most
E ∣ X − ⌊ α k ⌋ ∣ ≤ E ∣ X − α k ∣ + 1 ≤ α k + 1 , (10) \mathbb{E}|X-\lfloor\alpha k\rfloor|\le\mathbb{E}|X-\alpha k|+1\le\sqrt{\alpha k}+1, \tag*{(10)} E ∣ X − ⌊ α k ⌋ ∣ ≤ E ∣ X − α k ∣ + 1 ≤ α k + 1 , (10) where the last step follows from Cauchy–Schwarz and Var ( X ) = α k \operatorname{Var}(X)=\alpha k Var ( X ) = α k .
Now let A k A_k A k be the random matrix of Section II with a Poisson ( ( α + β ) k ) \operatorname{Poisson}((\alpha+\beta)k) Poisson (( α + β ) k ) number of columns, coefficient distribution μ \mu μ , and column weights distributed according to (8). A column of A k A_k A k can be generated by choosing, with probability α / ( α + β ) \alpha/(\alpha+\beta) α / ( α + β ) , a column whose weight is distributed according to P P P , and otherwise a weight-one column. Indeed, this gives the weight one with probability ( β + α p 1 ) / ( α + β ) (\beta+\alpha p_1)/(\alpha+\beta) ( β + α p 1 ) / ( α + β ) and weight w ≥ 2 w\ge2 w ≥ 2 with probability α p w / ( α + β ) \alpha p_w/(\alpha+\beta) α p w / ( α + β ) . Note that A k A_k A k can equivalently be obtained from M k ′ ( α , β ) M'_k(\alpha,\beta) M k ′ ( α , β ) by independently rescaling the added singleton columns by samples from μ \mu μ and uniformly permuting all columns, so the two matrices have the same rank distribution.
By the splitting property of the Poisson distribution if a Poisson ( λ ) \operatorname{Poisson}(\lambda) Poisson ( λ ) number of items are independently assigned types, where each item has type t t t with probability π t \pi_t π t , then the numbers of items of the different types are independent, and the number of items of type t t t is Poisson ( λ π t ) \operatorname{Poisson}(\lambda\pi_t) Poisson ( λ π t ) . In A k A_k A k , the number of columns is Poisson ( ( α + β ) k ) \operatorname{Poisson}((\alpha+\beta)k) Poisson (( α + β ) k ) , and each column independently is of the first type with probability α / ( α + β ) \alpha/(\alpha+\beta) α / ( α + β ) , or is a weight-one column with its nonzero entry at coordinate j j j with probability β / ( ( α + β ) k ) \beta/((\alpha+\beta)k) β / (( α + β ) k ) , for each j ∈ [ k ] j\in[k] j ∈ [ k ] . Applying the splitting property with these k + 1 k+1 k + 1 types, the number of columns of the first type is Poisson ( α k ) \operatorname{Poisson}(\alpha k) Poisson ( α k ) , the numbers of weight-one columns at the coordinates j ∈ [ k ] j\in[k] j ∈ [ k ] are Poisson ( β ) \operatorname{Poisson}(\beta) Poisson ( β ) , and all these numbers are independent. Hence, A k A_k A k and M k ′ ( α , β ) M'_k(\alpha,\beta) M k ′ ( α , β ) have the same distribution of columns, up to the order of the columns and the values of the nonzero entries of the weight-one columns of the second type, neither of which affects the rank. Combining this with (10) gives
∣ R k ( α , β ) − 1 k E [ rank A k ] ∣ ≤ α k + 1 k ⟶ 0. \left|R_k(\alpha,\beta)-\frac{1}{k}\mathbb{E}[\operatorname{rank} A_k]\right|
\le\frac{\sqrt{\alpha k}+1}{k}\longrightarrow0. R k ( α , β ) − k 1 E [ rank A k ] ≤ k α k + 1 ⟶ 0.
Therefore, it suffices to show that 1 k E [ rank A k ] → R P ( α , β ) \frac{1}{k}\mathbb{E}[\operatorname{rank} A_k]\to R_P(\alpha,\beta) k 1 E [ rank A k ] → R P ( α , β ) . Since 0 ≤ rank A k / k ≤ 1 0\le\operatorname{rank} A_k/k\le1 0 ≤ rank A k / k ≤ 1 , this follows, by the bounded convergence theorem, once we show that rank A k / k → R P ( α , β ) \operatorname{rank} A_k/k\to R_P(\alpha,\beta) rank A k / k → R P ( α , β ) in probability.
Second, A k A_k A k differs from B k B_k B k only in how the support is generated. More precisely, in A k A_k A k each column chooses its support independently, whereas in B k B_k B k the support is chosen uniformly given all row and column counts. We show that this does not affect the limit. We refer to number of columns, the column weights, and the row weights of a matrix together as the degree data . Given the degree data, A k A_k A k and B k B_k B k have the same distribution. For B k B_k B k , this holds by definition. For A k A_k A k , given the column weights, every zero-one pattern with these column weights is the support with the same probability ∏ j = 1 N ( k w j ) − 1 \prod_{j=1}^{N}\binom{k}{w_j}^{-1} ∏ j = 1 N ( w j k ) − 1 , so given also the row weights, the support is uniform among all patterns with these weights. In both matrices, the entries on the support are independent samples from μ \mu μ . Hence, the two matrices differ only in the distribution of their degree data. Corollary 16 in the Appendix shows that this difference does not affect the convergence in Theorem 4, that is, rank A k / k → R P ( α , β ) \operatorname{rank} A_k/k\to R_P(\alpha,\beta) rank A k / k → R P ( α , β ) in probability.
Finally, let β = 0 \beta=0 β = 0 . The idea is to approximate β = 0 \beta=0 β = 0 by a small β ′ > 0 \beta'>0 β ′ > 0 , for which the lemma is already proved, using that a few singleton columns change both R k R_k R k and R P R_P R P only slightly. Fix β ′ > 0 \beta'>0 β ′ > 0 .
First, appending the singleton columns does not decrease the rank, and increases it by at most the number of coordinates j j j with N j ≥ 1 N_j\ge1 N j ≥ 1 , whose expectation is k ( 1 − e − β ′ ) k(1-e^{-\beta'}) k ( 1 − e − β ′ ) . Hence,
0 ≤ R k ( α , β ′ ) − R k ( α , 0 ) ≤ 1 − e − β ′ . 0\le R_k(\alpha,\beta')-R_k(\alpha,0)\le1-e^{-\beta'}. 0 ≤ R k ( α , β ′ ) − R k ( α , 0 ) ≤ 1 − e − β ′ .
Second, for every z ∈ [ 0 , 1 ] z\in[0,1] z ∈ [ 0 , 1 ] ,
Φ α , 0 ( z ) − Φ α , β ′ ( z ) = ( 1 − e − β ′ ) e − α P ′ ( z ) , \Phi_{\alpha,0}(z)-\Phi_{\alpha,\beta'}(z)=(1-e^{-\beta'})e^{-\alpha P'(z)}, Φ α , 0 ( z ) − Φ α , β ′ ( z ) = ( 1 − e − β ′ ) e − α P ′ ( z ) ,
which lies in [ 0 , 1 − e − β ′ ] [0,1-e^{-\beta'}] [ 0 , 1 − e − β ′ ] . Hence, we obtain
0 ≤ R P ( α , β ′ ) − R P ( α , 0 ) ≤ 1 − e − β ′ . 0\le R_P(\alpha,\beta')-R_P(\alpha,0)\le1-e^{-\beta'}. 0 ≤ R P ( α , β ′ ) − R P ( α , 0 ) ≤ 1 − e − β ′ .
Combining these two bounds with the triangle inequality,
∣ R k ( α , 0 ) − R P ( α , 0 ) ∣ ≤ ∣ R k ( α , 0 ) − R k ( α , β ′ ) ∣ + ∣ R k ( α , β ′ ) − R P ( α , β ′ ) ∣ + ∣ R P ( α , β ′ ) − R P ( α , 0 ) ∣ ≤ ∣ R k ( α , β ′ ) − R P ( α , β ′ ) ∣ + 2 ( 1 − e − β ′ ) . \begin{aligned}
|R_k(\alpha,0)-R_P(\alpha,0)|
&\le|R_k(\alpha,0)-R_k(\alpha,\beta')|\\
&\quad+|R_k(\alpha,\beta')-R_P(\alpha,\beta')|\\
&\quad+|R_P(\alpha,\beta')-R_P(\alpha,0)|\\
&\le|R_k(\alpha,\beta')-R_P(\alpha,\beta')|+2(1-e^{-\beta'}).
\end{aligned} ∣ R k ( α , 0 ) − R P ( α , 0 ) ∣ ≤ ∣ R k ( α , 0 ) − R k ( α , β ′ ) ∣ + ∣ R k ( α , β ′ ) − R P ( α , β ′ ) ∣ + ∣ R P ( α , β ′ ) − R P ( α , 0 ) ∣ ≤ ∣ R k ( α , β ′ ) − R P ( α , β ′ ) ∣ + 2 ( 1 − e − β ′ ) .
By the case β > 0 \beta>0 β > 0 , the first term on the right tends to zero as k → ∞ k\to\infty k → ∞ . Hence, lim sup k → ∞ ∣ R k ( α , 0 ) − R P ( α , 0 ) ∣ ≤ 2 ( 1 − e − β ′ ) \limsup_{k\to\infty}|R_k(\alpha,0)-R_P(\alpha,0)|\le2(1-e^{-\beta'}) lim sup k → ∞ ∣ R k ( α , 0 ) − R P ( α , 0 ) ∣ ≤ 2 ( 1 − e − β ′ ) , and letting β ′ ↓ 0 \beta'\downarrow0 β ′ ↓ 0 completes the proof. □
Let Φ α = Φ α , 0 \Phi_\alpha=\Phi_{\alpha,0} Φ α = Φ α , 0 , and define
A P ( α ) = a r g m a x z ∈ [ 0 , 1 ] Φ α ( z ) , \mathcal{A}_P(\alpha)=\mathop{\rm arg\,max}_{z\in[0,1]}\Phi_\alpha(z), A P ( α ) = arg max z ∈ [ 0 , 1 ] Φ α ( z ) ,
U P ( α ) = min z ∈ A P ( α ) e − α P ′ ( z ) . (11) \mathcal{U}_P(\alpha)=\min_{z\in\mathcal{A}_P(\alpha)}e^{-\alpha P'(z)}. \tag*{(11)} U P ( α ) = z ∈ A P ( α ) min e − α P ′ ( z ) . (11)
Lemma 6. For every fixed α ≥ 0 \alpha\ge0 α ≥ 0 ,
lim inf k → ∞ U k ( α ) ≥ U P ( α ) . (12) \liminf_{k\to\infty}U_k(\alpha)\ge\mathcal{U}_P(\alpha). \tag*{(12)} k → ∞ lim inf U k ( α ) ≥ U P ( α ) . (12) The proof is given in Appendix A. It applies Lemmas 2 and 5 for a fixed β > 0 \beta>0 β > 0 , and then lets β ↓ 0 \beta\downarrow0 β ↓ 0 , so that maximizers of Φ α , β \Phi_{\alpha,\beta} Φ α , β approach a maximizer of Φ α \Phi_\alpha Φ α .
The Integral Inequality
By Lemma 6, the limit inferior of U k ( α ) U_k(\alpha) U k ( α ) is at least U P ( α ) . \mathcal{U}_P(\alpha). U P ( α ) . In this section, we show that the integral of U P \mathcal{U}_P U P is at least π / 4 \pi/4 π /4 , which, together with (2), proves Theorem 1.
Proposition 7. For every degree distribution P P P with column weights at most W W W ,
∫ 0 ∞ U P ( α ) d α ≥ π 4 . (13) \int_{0}^{\infty}\mathcal{U}_P(\alpha)\,d\alpha\ge\frac{\pi}{4}. \tag*{(13)} ∫ 0 ∞ U P ( α ) d α ≥ 4 π . (13)
If p 1 = 1 p_1=1 p 1 = 1 , the integral equals one, as shown in the proof below. For p 1 < 1 p_1<1 p 1 < 1 , the proof has three steps. First, we show that U P ( α ) \mathcal{U}_P(\alpha) U P ( α ) is determined by the largest maximizer of Φ α \Phi_\alpha Φ α . Second, we rewrite the integral of U P \mathcal{U}_P U P in terms of the inverse of this maximizer as a function of α \alpha α . Third, we prove an identity for this inverse, from which the bound follows by the Cauchy–Schwarz inequality. The main difficulty is that the largest maximizer may jump as α \alpha α increases, and the identity must remain valid across such jumps. Throughout the following lemmas, we assume that p 1 < 1 p_1<1 p 1 < 1 .
For α > 0 \alpha>0 α > 0 , let
ζ ( α ) = max A P ( α ) \zeta(\alpha)=\max\mathcal{A}_P(\alpha) ζ ( α ) = max A P ( α )
be the largest maximizer of Φ α \Phi_\alpha Φ α on [ 0 , 1 ] [0,1] [ 0 , 1 ] , which exists since A P ( α ) \mathcal{A}_P(\alpha) A P ( α ) is compact. The first lemma characterizes the maximizers of Φ α \Phi_\alpha Φ α . In particular, it shows that U P ( α ) \mathcal{U}_P(\alpha) U P ( α ) is determined by ζ ( α ) \zeta(\alpha) ζ ( α ) .
Lemma 8. Let p 1 < 1 p_1<1 p 1 < 1 and α > 0 \alpha>0 α > 0 . Every maximizer z z z of Φ α \Phi_\alpha Φ α satisfies z < 1 z<1 z < 1 and α P ′ ( z ) = − log ( 1 − z ) \alpha P'(z)=-\log(1-z) α P ′ ( z ) = − log ( 1 − z ) . Moreover,
U P ( α ) = 1 − ζ ( α ) . (14) \mathcal{U}_P(\alpha)=1-\zeta(\alpha). \tag*{(14)} U P ( α ) = 1 − ζ ( α ) . (14)
Proof sketch. Assume for this sketch that the maximizers lie in ( 0 , 1 ) (0,1) ( 0 , 1 ) ; the endpoint cases are checked in Appendix B. Since H ′ ( z ) = − ( 1 − z ) P ′ ′ ( z ) H'(z)=-(1-z)P''(z) H ′ ( z ) = − ( 1 − z ) P ′′ ( z ) , differentiation gives
Φ α ′ ( z ) = α P ′ ′ ( z ) ( 1 − z − e − α P ′ ( z ) ) . \Phi_\alpha'(z)=\alpha P''(z)(1-z-e^{-\alpha P'(z)}). Φ α ′ ( z ) = α P ′′ ( z ) ( 1 − z − e − α P ′ ( z ) ) .
Because p 1 < 1 p_1<1 p 1 < 1 , we have P ′ ′ ( z ) > 0 P''(z)>0 P ′′ ( z ) > 0 for 0 < z < 1 0<z<1 0 < z < 1 . Hence, at any interior maximizer z ∗ z^* z ∗ , the condition Φ α ′ ( z ∗ ) = 0 \Phi_\alpha'(z^*)=0 Φ α ′ ( z ∗ ) = 0 implies
1 − z ∗ = e − α P ′ ( z ∗ ) , α P ′ ( z ∗ ) = − log ( 1 − z ∗ ) . 1-z^*=e^{-\alpha P'(z^*)},\qquad\alpha P'(z^*)=-\log(1-z^*). 1 − z ∗ = e − α P ′ ( z ∗ ) , α P ′ ( z ∗ ) = − log ( 1 − z ∗ ) .
Substituting this identity into the definition of U P ( α ) \mathcal{U}_P(\alpha) U P ( α ) gives
U P ( α ) = min z ∈ A P ( α ) e − α P ′ ( z ) = min z ∈ A P ( α ) ( 1 − z ) = 1 − ζ ( α ) , \begin{aligned}
\mathcal{U}_P(\alpha)
&=\min_{z\in\mathcal{A}_P(\alpha)}e^{-\alpha P'(z)}\\
&=\min_{z\in\mathcal{A}_P(\alpha)}(1-z)=1-\zeta(\alpha),
\end{aligned} U P ( α ) = z ∈ A P ( α ) min e − α P ′ ( z ) = z ∈ A P ( α ) min ( 1 − z ) = 1 − ζ ( α ) ,
since ζ ( α ) \zeta(\alpha) ζ ( α ) is the largest maximizer. □
By (14), the integral in (13) depends only on the function ζ \zeta ζ . The next lemma collects the properties of ζ \zeta ζ that we need. The proofs of both lemmas are given in the Appendix.
Lemma 9. Let p 1 < 1 p_1 < 1 p 1 < 1 . The function ζ \zeta ζ is nondecreasing and right-continuous on ( 0 , ∞ ) (0,\infty) ( 0 , ∞ ) , and ζ ( α ) → 0 \zeta(\alpha) \to0 ζ ( α ) → 0 as α ↓ 0 \alpha\downarrow0 α ↓ 0 and ζ ( α ) → 1 \zeta(\alpha) \to1 ζ ( α ) → 1 as α → ∞ \alpha\to\infty α → ∞ .
By Lemma 9, ζ \zeta ζ increases from 0 to 1, possibly with jumps. This allows us to describe ζ \zeta ζ through its inverse. For 0 < z < 1 0 < z < 1 0 < z < 1 , let
σ ( z ) = inf { α > 0 : ζ ( α ) ≥ z } \sigma(z) = \inf\{\alpha> 0 : \zeta(\alpha) \ge z\} σ ( z ) = inf { α > 0 : ζ ( α ) ≥ z }
be the generalized inverse of ζ \zeta ζ , that is, the first value of α \alpha α at which ζ \zeta ζ reaches the level z z z . By Lemma 9, σ ( z ) \sigma(z) σ ( z ) is finite and positive for every z ∈ ( 0 , 1 ) z \in(0,1) z ∈ ( 0 , 1 ) . In the proof of Proposition 7, we show that the integral of U P U_P U P equals the integral of σ \sigma σ . The key step is the following identity. At levels where ζ \zeta ζ is continuous, it follows from the condition α P ′ ( z ) = − log ( 1 − z ) \alpha P'(z) = -\log(1-z) α P ′ ( z ) = − log ( 1 − z ) in Lemma 8. Across a jump of ζ \zeta ζ , it follows from the fact that both endpoints of the jump maximize Φ α \Phi_\alpha Φ α at the time of the jump.
Lemma 10. Let p 1 < 1 p_1 < 1 p 1 < 1 . Then
∫ 0 1 − log ( 1 − z ) σ ( z ) d z = 1. (15) \int_0^1 \frac{-\log(1-z)}{\sigma(z)}\,\mathrm{d}z = 1. \tag*{(15)} ∫ 0 1 σ ( z ) − log ( 1 − z ) d z = 1. (15)
The proof of Lemma 10 is given in Appendix B. We can now prove Proposition 7.
Proof of Proposition 7. If p 1 = 1 p_1 = 1 p 1 = 1 , i.e., P ( z ) = z P(z) = z P ( z ) = z , then U P ( α ) = e − α U_P(\alpha) = e^{-\alpha} U P ( α ) = e − α , and
∫ 0 ∞ U P ( α ) d α = ∫ 0 ∞ e − α d α = 1 > π 4 . \int_0^\infty U_P(\alpha)\,\mathrm{d}\alpha= \int_0^\infty e^{-\alpha}\,\mathrm{d}\alpha= 1 > \frac{\pi}{4}. ∫ 0 ∞ U P ( α ) d α = ∫ 0 ∞ e − α d α = 1 > 4 π .
Now assume p 1 < 1 p_1 < 1 p 1 < 1 . We first express the integral of U P U_P U P through σ \sigma σ . For every x ∈ [ 0 , 1 ] x \in[0,1] x ∈ [ 0 , 1 ] , the indicator 1 { x < z } \mathbf{1}\{x < z\} 1 { x < z } equals one exactly for z ∈ ( x , 1 ] z \in(x,1] z ∈ ( x , 1 ] , so
∫ 0 1 1 { x < z } d z = 1 − x . \int_0^1 \mathbf{1}\{x < z\}\,\mathrm{d}z = 1-x. ∫ 0 1 1 { x < z } d z = 1 − x .
We apply this with x = ζ ( α ) x = \zeta(\alpha) x = ζ ( α ) and use (14). Since ζ \zeta ζ is nondecreasing and right-continuous by Lemma 9, we have { α > 0 : ζ ( α ) < z } = ( 0 , σ ( z ) ) \{\alpha> 0 : \zeta(\alpha) < z\} = (0,\sigma(z)) { α > 0 : ζ ( α ) < z } = ( 0 , σ ( z )) for every z ∈ ( 0 , 1 ) z \in(0,1) z ∈ ( 0 , 1 ) . Hence, by Tonelli’s theorem,
∫ 0 ∞ U P ( α ) d α = ∫ 0 1 ∫ 0 ∞ 1 { ζ ( α ) < z } d α d z = ∫ 0 1 σ ( z ) d z . (16) \int_0^\infty U_P(\alpha)\,\mathrm{d}\alpha
= \int_0^1 \int_0^\infty\mathbf{1}\{\zeta(\alpha) < z\}\,\mathrm{d}\alpha\,\mathrm{d}z
= \int_0^1 \sigma(z)\,\mathrm{d}z. \tag*{(16)} ∫ 0 ∞ U P ( α ) d α = ∫ 0 1 ∫ 0 ∞ 1 { ζ ( α ) < z } d α d z = ∫ 0 1 σ ( z ) d z . (16)
If ∫ 0 1 σ ( z ) d z = ∞ \int_0^1 \sigma(z)\,\mathrm{d}z = \infty ∫ 0 1 σ ( z ) d z = ∞ , then (13) holds by (16). Otherwise, we write
− log ( 1 − z ) = σ ( z ) ⋅ − log ( 1 − z ) σ ( z ) \sqrt{-\log(1-z)} = \sqrt{\sigma(z)}\cdot\sqrt{\frac{-\log(1-z)}{\sigma(z)}} − log ( 1 − z ) = σ ( z ) ⋅ σ ( z ) − log ( 1 − z )
and apply the Cauchy–Schwarz inequality together with Lemma 10:
( ∫ 0 1 − log ( 1 − z ) d z ) 2 ≤ ( ∫ 0 1 σ ( z ) d z ) ( ∫ 0 1 − log ( 1 − z ) σ ( z ) d z ) = ∫ 0 1 σ ( z ) d z . \left(\int_0^1 \sqrt{-\log(1-z)}\,\mathrm{d}z\right)^2
\le\left(\int_0^1 \sigma(z)\,\mathrm{d}z\right)
\left(\int_0^1 \frac{-\log(1-z)}{\sigma(z)}\,\mathrm{d}z\right)
= \int_0^1 \sigma(z)\,\mathrm{d}z. ( ∫ 0 1 − log ( 1 − z ) d z ) 2 ≤ ( ∫ 0 1 σ ( z ) d z ) ( ∫ 0 1 σ ( z ) − log ( 1 − z ) d z ) = ∫ 0 1 σ ( z ) d z .
Finally, the substitution t = − log ( 1 − z ) t=-\log(1-z) t = − log ( 1 − z ) , under which d z = e − t d t \mathrm{d}z=e^{-t}\,\mathrm{d}t d z = e − t d t and z ∈ ( 0 , 1 ) z\in(0,1) z ∈ ( 0 , 1 ) corresponds to t ∈ ( 0 , ∞ ) t\in(0,\infty) t ∈ ( 0 , ∞ ) , gives
∫ 0 1 − log ( 1 − z ) d z = ∫ 0 ∞ t e − t d t = Γ ( 3 2 ) = π 2 , \int_0^1 \sqrt{-\log(1-z)}\,\mathrm{d}z
= \int_0^\infty\sqrt{t}e^{-t}\,\mathrm{d}t
= \Gamma\left(\frac{3}{2}\right)
= \frac{\sqrt{\pi}}{2}, ∫ 0 1 − log ( 1 − z ) d z = ∫ 0 ∞ t e − t d t = Γ ( 2 3 ) = 2 π ,
where Γ ( s ) = ∫ 0 ∞ t s − 1 e − t d t \Gamma(s)=\int_0^\infty t^{s-1}e^{-t}\,\mathrm{d}t Γ ( s ) = ∫ 0 ∞ t s − 1 e − t d t is the Gamma function. Hence, by (16), ∫ 0 ∞ U P ( α ) d α = ∫ 0 1 σ ( z ) d z ≥ π / 4 \int_0^\infty U_P(\alpha)\,\mathrm{d}\alpha=\int_0^1 \sigma(z)\,\mathrm{d}z\ge\pi/4 ∫ 0 ∞ U P ( α ) d α = ∫ 0 1 σ ( z ) d z ≥ π /4 , which proves (13).
Proof of Theorem 1. We first prove the theorem when the degree distribution does not depend on k k k , and then reduce the general case to this one.
Let P k = P P_k=P P k = P for all k k k . By (2),
E [ τ i ] k = ∫ 0 ∞ U k ( α ) d α . \frac{\mathbb{E}[\tau_i]}{k} = \int_0^\infty U_k(\alpha)\,\mathrm{d}\alpha. k E [ τ i ] = ∫ 0 ∞ U k ( α ) d α .
Since U k ≥ 0 U_k \ge0 U k ≥ 0 , Fatou’s lemma, Lemma 6, and Proposition 7 give
lim inf k → ∞ E [ τ i ] k ≥ ∫ 0 ∞ lim inf k → ∞ U k ( α ) d α ≥ ∫ 0 ∞ U P ( α ) d α ≥ π 4 . \liminf_{k\to\infty}\frac{\mathbb{E}[\tau_i]}{k}
\ge\int_0^\infty\liminf_{k\to\infty}U_k(\alpha)\,\mathrm{d}\alpha
\ge\int_0^\infty U_P(\alpha)\,\mathrm{d}\alpha
\ge\frac{\pi}{4}. k → ∞ lim inf k E [ τ i ] ≥ ∫ 0 ∞ k → ∞ lim inf U k ( α ) d α ≥ ∫ 0 ∞ U P ( α ) d α ≥ 4 π .
Now let ( P k ) (P_k) ( P k ) be any sequence of degree distributions with column weights at most W W W , and let L = lim inf k → ∞ E [ τ i ] / k L=\liminf_{k\to\infty}\mathbb{E}[\tau_i]/k L = lim inf k → ∞ E [ τ i ] / k . As L = ∞ L=\infty L = ∞ is trivial, we assume L < ∞ L<\infty L < ∞ . Choose indices k 1 < k 2 < ⋯ k_1<k_2<\cdots k 1 < k 2 < ⋯ with E [ τ i ] / k j → L \mathbb{E}[\tau_i]/k_j\to L E [ τ i ] / k j → L . Each P k P_k P k is a vector in [ 0 , 1 ] W [0,1]^W [ 0 , 1 ] W , so by the Bolzano–Weierstrass theorem, a further subsequence satisfies P k j → P P_{k_j}\to P P k j → P coordinatewise, where P P P is again a probability distribution on [ W ] [W] [ W ] . Along this further subsequence, E [ τ i ] / k \mathbb{E}[\tau_i]/k E [ τ i ] / k still converges to L L L . Hence, it suffices to show that lim inf U k ( α ) ≥ U P ( α ) \liminf U_k(\alpha)\ge U_P(\alpha) lim inf U k ( α ) ≥ U P ( α ) along it for every α ≥ 0 \alpha\ge0 α ≥ 0 , since Fatou’s lemma and Proposition 7 then give L ≥ π / 4 L\ge\pi/4 L ≥ π /4 as in the case of a fixed P P P .
For a degree distribution Q Q Q , write R k ( Q ) ( α , β ) R_k^{(Q)}(\alpha,\beta) R k ( Q ) ( α , β ) for R k ( α , β ) R_k(\alpha,\beta) R k ( α , β ) computed with degree distribution Q k Q_k Q k . We couple the augmented matrices for P k P_k P k and P P P as follows. The weights of each pair of corresponding columns are drawn so that they differ with probability d T V ( P k , P ) \mathrm{d}_{\mathrm{TV}}(P_k,P) d TV ( P k , P ) , which is possible by the definition of the total variation distance. Whenever the weights agree, the two columns have the same support and the same entries, and the two matrices have the same singleton columns. Then the two augmented matrices differ in at most ∣ α k ∣ |\alpha k| ∣ α k ∣ columns, each with probability d T V ( P k , P ) \mathrm{d}_{\mathrm{TV}}(P_k,P) d TV ( P k , P ) . Since replacing one column changes the rank by at most one,
∣ R k ( P k ) ( α , β ) − R k ( P ) ( α , β ) ∣ ≤ ∣ α k ∣ k d T V ( P k , P ) ≤ α d T V ( P k , P ) ⟶ 0. \left|R_k^{(P_k)}(\alpha,\beta)-R_k^{(P)}(\alpha,\beta)\right|
\le\frac{|\alpha k|}{k}\,\mathrm{d}_{\mathrm{TV}}(P_k,P)
\le\alpha\,\mathrm{d}_{\mathrm{TV}}(P_k,P)\longrightarrow0. R k ( P k ) ( α , β ) − R k ( P ) ( α , β ) ≤ k ∣ α k ∣ d TV ( P k , P ) ≤ α d TV ( P k , P ) ⟶ 0.
Together with Lemma 5, applied to the fixed distribution P P P , this gives R k ( P k ) ( α , β ) → R P ( α , β ) R_k^{(P_k)}(\alpha,\beta)\to R_P(\alpha,\beta) R k ( P k ) ( α , β ) → R P ( α , β ) along the subsequence, for all α , β ≥ 0 \alpha,\beta\ge0 α , β ≥ 0 . Lemma 2 holds for every k k k and every degree distribution, and the proof of Lemma 2 uses only Lemma 2 and this convergence. Hence, lim inf U k ( α ) ≥ U P ( α ) \liminf U_k(\alpha)\ge U_P(\alpha) lim inf U k ( α ) ≥ U P ( α ) along the subsequence, which completes the proof.
The last Cauchy–Schwarz step in the proof of Proposition 7 is the same integral estimate used in [24 Lemma 5] . Here, the additional identity (27) ensures that (15) remains valid across levels skipped by jumps.
A Singleton–Pair Code Construction
Theorem 1 shows that no ensemble with bounded column weights has normalized expected recovery time asymptotically below π / 4 \pi/4 π /4 . In this section, we show that this bound is nearly attained by explicit generator matrices. We consider the degree distribution with p 1 = s p_1=s p 1 = s and p 2 = 1 − s p_2=1-s p 2 = 1 − s for some 0 < s < 1 0<s<1 0 < s < 1 , that is, P ( z ) = s z + ( 1 − s ) z 2 P(z)=sz+(1-s)z^2 P ( z ) = sz + ( 1 − s ) z 2 , so that every column has one or two nonzero entries. For the peeling decoder and binary matrices, this distribution was analyzed in [24 ] , where the best choice of s s s gives a normalized expected recovery time of approximately 0.7939. Here, we extend this result in two directions. First, we show that an optimal decoder achieves the same value, over every field and for every coefficient distribution, so that optimal decoding gives no first-order improvement for this distribution. Second, we construct explicit generator matrices over every fixed finite field that achieve this value, including a block construction of positive rate.
Asymptotic analysis
Throughout this subsection, P ( z ) = s z + ( 1 − s ) z 2 P(z)=sz+(1-s)z^2 P ( z ) = sz + ( 1 − s ) z 2 for a fixed 0 < s < 1 0<s<1 0 < s < 1 , and the field F \mathbb{F} F , as in § 2 , and the coefficient distribution μ \mu μ are arbitrary. To analyze the recovery time, we represent the supports of the columns by a graph G \mathcal{G} G with vertex set [ k ] [k] [ k ] . Every column with two nonzero entries, in positions u u u and v v v , is an edge between u u u and v v v , and columns with the same support give parallel edges. Every column with one nonzero entry, in position u u u , marks the vertex u u u . Marks do not affect connectivity, and a vertex without edges forms a component by itself.
Columns supported in different components of G \mathcal{G} G have disjoint supports. Hence, the column span is the direct sum of the spans of the columns supported in the individual components, and whether x i x_i x i can be recovered depends only on the columns supported in the component of i i i , including the values of their nonzero entries. The next lemma shows that in two cases this is determined by G \mathcal{G} G alone. In the remaining case of an unmarked component containing a cycle, recovery depends on the coefficients. For example, the columns ( 1 , 2 , 0 , … , 0 ) T (1,2,0,\ldots,0)^{\mathsf T} ( 1 , 2 , 0 , … , 0 ) T and ( 1 , 1 , 0 , … , 0 ) T (1,1,0,\ldots,0)^{\mathsf T} ( 1 , 1 , 0 , … , 0 ) T form a double edge and span e 1 \mathbf e_1 e 1 and e 2 \mathbf e_2 e 2 , whereas two copies of ( 1 , 1 , 0 , … , 0 ) T (1,1,0,\ldots,0)^{\mathsf T} ( 1 , 1 , 0 , … , 0 ) T span neither. We show below that this case has vanishing probability.
Lemma 11. Let H \mathcal H H be a component of G \mathcal G G .
(i) If H \mathcal H H contains a marked vertex, then x i x_i x i can be recovered for every i ∈ H i\in\mathcal H i ∈ H .
(ii) If H \mathcal H H is an unmarked tree, then x i x_i x i cannot be recovered for any i ∈ H i\in\mathcal H i ∈ H .
Proof. For (i), let u ∈ H u\in\mathcal H u ∈ H be marked. A weight-one column at u u u is a nonzero multiple of e u \mathbf e_u e u , so e u \mathbf e_u e u lies in the column span. If e w \mathbf e_w e w lies in the span and an edge between w w w and v v v corresponds to the column a e w + b e v a\mathbf e_w+b\mathbf e_v a e w + b e v with a , b ≠ 0 a,b\ne0 a , b = 0 , then e v = b − 1 ( a e w − ( a e w + b e v ) ) \mathbf e_v=b^{-1}(a\mathbf e_w-(a\mathbf e_w+b\mathbf e_v)) e v = b − 1 ( a e w − ( a e w + b e v )) also lies in the span. Since H \mathcal H H is connected, repeating this along paths from u u u shows that e v \mathbf e_v e v lies in the span for every v ∈ H v\in\mathcal H v ∈ H .
For (ii), it suffices to find y ∈ F k \mathbf y\in\mathbb F^k y ∈ F k with y T v j = 0 \mathbf y^{\mathsf T}\mathbf v_j=0 y T v j = 0 for every observed column v j \mathbf v_j v j and y i ≠ 0 y_i\ne0 y i = 0 for every i ∈ H i\in\mathcal H i ∈ H . Indeed, every vector u \mathbf u u in the column span then satisfies y T u = 0 \mathbf y^{\mathsf T}\mathbf u=0 y T u = 0 , whereas y T e i = y i ≠ 0 \mathbf y^{\mathsf T}\mathbf e_i=y_i\ne0 y T e i = y i = 0 , so e i \mathbf e_i e i is not in the span.
Choose a root r ∈ H r\in\mathcal H r ∈ H , set y r = 1 y_r=1 y r = 1 , and set y v = 0 y_v=0 y v = 0 for v ∉ H v\notin\mathcal H v ∈ / H . For the remaining vertices v ∈ H v\in\mathcal H v ∈ H , in order of increasing distance from r r r , let w w w be the parent of v v v , let a e w + b e v a\mathbf e_w+b\mathbf e_v a e w + b e v be the column of the edge between them, and set y v = − a y w / b y_v=-ay_w/b y v = − a y w / b . Since a , b ≠ 0 a,b\ne0 a , b = 0 , all y v y_v y v with v ∈ H v\in\mathcal H v ∈ H are nonzero. We check that y T v j = 0 \mathbf y^{\mathsf T}\mathbf v_j=0 y T v j = 0 for every column v j \mathbf v_j v j . If the support of v j \mathbf v_j v j is disjoint from H \mathcal H H , this holds since y \mathbf y y vanishes outside H \mathcal H H . Otherwise, v j \mathbf v_j v j is supported in H \mathcal H H . Since H \mathcal H H is unmarked, v j \mathbf v_j v j is not a weight-one column, so it corresponds to an edge of H \mathcal H H , that is, v j = a e w + b e v \mathbf v_j=a\mathbf e_w+b\mathbf e_v v j = a e w + b e v , where w w w is the parent of v v v . Then
y T v j = a y w + b y v = a y w − a y w = 0. \mathbf y^{\mathsf T}\mathbf v_j=ay_w+by_v=ay_w-ay_w=0. y T v j = a y w + b y v = a y w − a y w = 0.
Proposition 12. Let P ( z ) = s z + ( 1 − s ) z 2 P(z)=sz+(1-s)z^2 P ( z ) = sz + ( 1 − s ) z 2 with 0 < s < 1 0<s<1 0 < s < 1 . For every field F \mathbb F F as in § 2 and every distribution μ \mu μ on F ∗ \mathbb F^* F ∗ ,
lim k → ∞ E [ τ i ] k = ∫ 0 1 − log u s + 2 ( 1 − s ) ( 1 − u ) d u . (17) \lim_{k\to\infty}\frac{\mathbb E[\tau_i]}{k}=\int_0^1\frac{-\log u}{s+2(1-s)(1-u)}\,du. \tag*{(17)} k → ∞ lim k E [ τ i ] = ∫ 0 1 s + 2 ( 1 − s ) ( 1 − u ) − log u d u . (17)
Proof. Let α > 0 \alpha>0 α > 0 , and let z z z be a maximizer of Φ α \Phi_\alpha Φ α . By Lemma 8, z < 1 z<1 z < 1 and 1 − z = e − α P ′ ( z ) 1-z=e^{-\alpha P'(z)} 1 − z = e − α P ′ ( z ) . Since
P ′ ( z ) = s + 2 ( 1 − s ) z , P'(z)=s+2(1-s)z, P ′ ( z ) = s + 2 ( 1 − s ) z ,
the number u = 1 − z u=1-z u = 1 − z therefore satisfies
u = exp ( − α P ′ ( 1 − u ) ) = exp ( − α ( s + 2 ( 1 − s ) ( 1 − u ) ) ) . (18) u=\exp(-\alpha P'(1-u))=\exp(-\alpha(s+2(1-s)(1-u))). \tag*{(18)} u = exp ( − α P ′ ( 1 − u )) = exp ( − α ( s + 2 ( 1 − s ) ( 1 − u ))) . (18)
Moreover, z ≠ 0 z\ne0 z = 0 , since z = 0 z=0 z = 0 would give 1 = e − α P ′ ( 0 ) = e − α s < 1 1=e^{-\alpha P'(0)}=e^{-\alpha s}<1 1 = e − α P ′ ( 0 ) = e − α s < 1 , and hence, u ∈ ( 0 , 1 ) u\in(0,1) u ∈ ( 0 , 1 ) .
Taking logarithms, a number u ∈ ( 0 , 1 ) u\in(0,1) u ∈ ( 0 , 1 ) satisfies (18) if and only if log u + α ( s + 2 ( 1 − s ) ( 1 − u ) ) = 0 \log u+\alpha(s+2(1-s)(1-u))=0 log u + α ( s + 2 ( 1 − s ) ( 1 − u )) = 0 . The left side of this equation is a strictly concave function of u u u , since log u \log u log u is strictly concave and the remaining term is linear in u u u . It tends to − ∞ -\infty − ∞ as u ↓ 0 u\downarrow0 u ↓ 0 and equals α s > 0 \alpha s>0 α s > 0 at u = 1 u=1 u = 1 . By the intermediate value theorem, it therefore vanishes at some u ∈ ( 0 , 1 ) u\in(0,1) u ∈ ( 0 , 1 ) . It vanishes at only one such u u u , since a strictly concave function that is positive at u = 1 u=1 u = 1 cannot vanish at two points of ( 0 , 1 ) (0,1) ( 0 , 1 ) . Hence, (18) has exactly one solution in ( 0 , 1 ) (0,1) ( 0 , 1 ) , which we denote by u s ( α ) u_s(\alpha) u s ( α ) . Since every maximizer z z z of Φ α \Phi_\alpha Φ α gives a solution u = 1 − z u=1-z u = 1 − z of (18) in ( 0 , 1 ) , (0,1), ( 0 , 1 ) , the function Φ α \Phi_\alpha Φ α has the unique maximizer 1 − u s ( α ) 1-u_s(\alpha) 1 − u s ( α ) . In particular, ζ ( α ) = 1 − u s ( α ) \zeta(\alpha)=1-u_s(\alpha) ζ ( α ) = 1 − u s ( α ) , and Lemma 8 gives U P ( α ) = 1 − ζ ( α ) = u s ( α ) U_P(\alpha)=1-\zeta(\alpha)=u_s(\alpha) U P ( α ) = 1 − ζ ( α ) = u s ( α ) .
By (2), E [ τ i ] / k = ∫ 0 ∞ U k ( α ) d α \mathbb E[\tau_i]/k=\int_0^\infty U_k(\alpha)\,d\alpha E [ τ i ] / k = ∫ 0 ∞ U k ( α ) d α . Since U k ≥ 0 U_k\ge0 U k ≥ 0 , Fatou’s lemma and Lemma 6 give
lim inf k → ∞ E [ τ i ] k ≥ ∫ 0 ∞ lim inf k → ∞ U k ( α ) d α ≥ ∫ 0 ∞ u s ( α ) d α . \liminf_{k\to\infty}\frac{\mathbb E[\tau_i]}{k}\ge\int_0^\infty\liminf_{k\to\infty}U_k(\alpha)\,d\alpha\ge\int_0^\infty u_s(\alpha)\,d\alpha. k → ∞ lim inf k E [ τ i ] ≥ ∫ 0 ∞ k → ∞ lim inf U k ( α ) d α ≥ ∫ 0 ∞ u s ( α ) d α .
For the upper bound, we use a different representation of the expectation. For a fixed number of observations, the numbers of columns supported on different coordinates or pairs of coordinates are dependent, since they sum to the number of observations. To make them independent, we consider a Poisson number of observations. For α > 0 \alpha>0 α > 0 , let N α N_\alpha N α be a Poisson( α k ) (\alpha k) ( α k ) random variable, independent of the columns, and let U ~ k ( α ) \widetilde U_k(\alpha) U k ( α ) be the probability that x i x_i x i cannot be recovered from the first N α N_\alpha N α observations, that is, U ~ k ( α ) = ∑ n ≥ 0 P { N α = n } P { τ i > n } \widetilde{U}_k(\alpha)=\sum_{n\ge0}\mathbb{P}\{N_\alpha=n\}\mathbb{P}\{\tau_i>n\} U k ( α ) = ∑ n ≥ 0 P { N α = n } P { τ i > n } . Integrating over α \alpha α , we obtain
∫ 0 ∞ U ~ k ( α ) d α = ∑ n ≥ 0 P { τ i > n } ∫ 0 ∞ P { N α = n } d α = ∑ n ≥ 0 P { τ i > n } ∫ 0 ∞ e − α k ( α k ) n n ! d α = 1 k ∑ n ≥ 0 P { τ i > n } = E [ τ i ] k . \begin{aligned}
\int_0^\infty\widetilde{U}_k(\alpha)\,d\alpha
&=\sum_{n\ge0}\mathbb{P}\{\tau_i>n\}\int_0^\infty\mathbb{P}\{N_\alpha=n\}\,d\alpha\\
&=\sum_{n\ge0}\mathbb{P}\{\tau_i>n\}\int_0^\infty e^{-\alpha k}\frac{(\alpha k)^n}{n!}\,d\alpha\\
&=\frac{1}{k}\sum_{n\ge0}\mathbb{P}\{\tau_i>n\}
=\frac{\mathbb{E}[\tau_i]}{k}.
\end{aligned} ∫ 0 ∞ U k ( α ) d α = n ≥ 0 ∑ P { τ i > n } ∫ 0 ∞ P { N α = n } d α = n ≥ 0 ∑ P { τ i > n } ∫ 0 ∞ e − α k n ! ( α k ) n d α = k 1 n ≥ 0 ∑ P { τ i > n } = k E [ τ i ] .
In the first step, we exchanged the sum and the integral, which is allowed since all terms are nonnegative, and used that P { τ i > n } \mathbb{P}\{\tau_i>n\} P { τ i > n } does not depend on α \alpha α . In the third step, we substituted x = α k x=\alpha k x = α k and used ∫ 0 ∞ x n e − x d x = n ! \int_0^\infty x^n e^{-x}\,dx=n! ∫ 0 ∞ x n e − x d x = n ! . The last step is the tail-sum formula.
Fix α > 0 \alpha>0 α > 0 , and consider the graph G G G formed by the observations made by time α \alpha α . Each observed column has one of k + ( k 2 ) k+\binom{k}{2} k + ( 2 k ) types: a weight-one column at coordinate u u u , which has probability s / k s/k s / k , or a weight-two column supported on the pair { u , v } \{u,v\} { u , v } , which has probability ( 1 − s ) / ( k 2 ) (1-s)/\binom{k}{2} ( 1 − s ) / ( 2 k ) . Since the number of observed columns is Poisson( α k ) (\alpha k) ( α k ) , the splitting property of the Poisson distribution implies that the numbers of columns of the different types are independent, with distributions Poisson( s α ) (s\alpha) ( s α ) and Poisson( 2 ( 1 − s ) α / ( k − 1 ) ) (2(1-s)\alpha/(k-1)) ( 2 ( 1 − s ) α / ( k − 1 )) , respectively. Consequently, every vertex is marked independently with probability 1 − e − s α 1-e^{-s\alpha} 1 − e − s α , every pair of vertices is joined by at least one edge independently with probability 1 − e − 2 ( 1 − s ) α / ( k − 1 ) 1-e^{-2(1-s)\alpha/(k-1)} 1 − e − 2 ( 1 − s ) α / ( k − 1 ) , and the marks are independent of the edges.
By Lemma 11(i), if x i x_i x i cannot be recovered, then the component H i H_i H i of i i i in G G G is unmarked. Given the edges, H i H_i H i is fixed, and each of its vertices is unmarked independently with probability e − s α e^{-s\alpha} e − s α . Hence, for every integer L ≥ 1 L\ge1 L ≥ 1 ,
U ~ k ( α ) ≤ E [ e − s α ∣ H i ∣ ] \widetilde{U}_k(\alpha)\le\mathbb{E}\left[e^{-s\alpha|H_i|}\right] U k ( α ) ≤ E [ e − s α ∣ H i ∣ ]
= ∑ r = 1 L e − s α r P { ∣ H i ∣ = r } + ∑ r > L e − s α r P { ∣ H i ∣ = r } ≤ ∑ r = 1 L e − s α r P { ∣ H i ∣ = r } + e − s α ( L + 1 ) P { ∣ H i ∣ > L } ≤ ∑ r = 1 L e − s α r P { ∣ H i ∣ = r } + e − s α ( L + 1 ) . \begin{aligned}
&=\sum_{r=1}^{L}e^{-s\alpha r}\mathbb{P}\{|H_i|=r\}+\sum_{r>L}e^{-s\alpha r}\mathbb{P}\{|H_i|=r\}\\
&\le\sum_{r=1}^{L}e^{-s\alpha r}\mathbb{P}\{|H_i|=r\}+e^{-s\alpha(L+1)}\mathbb{P}\{|H_i|>L\}\\
&\le\sum_{r=1}^{L}e^{-s\alpha r}\mathbb{P}\{|H_i|=r\}+e^{-s\alpha(L+1)}.
\end{aligned} = r = 1 ∑ L e − s α r P { ∣ H i ∣ = r } + r > L ∑ e − s α r P { ∣ H i ∣ = r } ≤ r = 1 ∑ L e − s α r P { ∣ H i ∣ = r } + e − s α ( L + 1 ) P { ∣ H i ∣ > L } ≤ r = 1 ∑ L e − s α r P { ∣ H i ∣ = r } + e − s α ( L + 1 ) .
If ∣ H i ∣ = r |H_i|=r ∣ H i ∣ = r , then for some size-r r r set of vertices S S S , such that i ∈ S i\in S i ∈ S , the edges within S S S contain a spanning tree of S S S and no edge joins S S S to the other vertices. There are ( k − 1 r − 1 ) \binom{k-1}{r-1} ( r − 1 k − 1 ) such sets and, by Cayley’s formula, r r − 2 r^{r-2} r r − 2 spanning trees of each. The edges of a tree and the excluded edges lie on disjoint pairs of vertices and are therefore independent, so a union bound gives
P { ∣ H i ∣ = r } ≤ ( k − 1 r − 1 ) r r − 2 ( 1 − e − 2 ( 1 − s ) α k − 1 ) r − 1 e − 2 ( 1 − s ) α r ( k − r ) k − 1 \mathbb{P}\{|H_i|=r\}\le\binom{k-1}{r-1}r^{r-2}\left(1-e^{-\frac{2(1-s)\alpha}{k-1}}\right)^{r-1}e^{-\frac{2(1-s)\alpha r(k-r)}{k-1}} P { ∣ H i ∣ = r } ≤ ( r − 1 k − 1 ) r r − 2 ( 1 − e − k − 1 2 ( 1 − s ) α ) r − 1 e − k − 1 2 ( 1 − s ) α r ( k − r )
⟶ r r − 1 r ! ( 2 ( 1 − s ) α ) r − 1 e − 2 ( 1 − s ) α r \longrightarrow\frac{r^{r-1}}{r!}\left(2(1-s)\alpha\right)^{r-1}e^{-2(1-s)\alpha r} ⟶ r ! r r − 1 ( 2 ( 1 − s ) α ) r − 1 e − 2 ( 1 − s ) α r
as k → ∞ k\to\infty k → ∞ . Letting k → ∞ k\to\infty k → ∞ and then L → ∞ L\to\infty L → ∞ , we obtain lim sup k → ∞ U ~ k ( α ) ≤ v \limsup_{k\to\infty}\widetilde{U}_k(\alpha)\le v lim sup k → ∞ U k ( α ) ≤ v , where
v = ∑ r ≥ 1 r r − 1 r ! ( 2 ( 1 − s ) α ) r − 1 e − ( 2 − s ) α r . v=\sum_{r\ge1}\frac{r^{r-1}}{r!}\left(2(1-s)\alpha\right)^{r-1}e^{-(2-s)\alpha r}. v = r ≥ 1 ∑ r ! r r − 1 ( 2 ( 1 − s ) α ) r − 1 e − ( 2 − s ) α r .
It remains to show that v = u s ( α ) v=u_s(\alpha) v = u s ( α ) . The power series y ( w ) = ∑ r ≥ 1 r r − 1 w r / r ! y(w)=\sum_{r\ge1}r^{r-1}w^r/r! y ( w ) = ∑ r ≥ 1 r r − 1 w r / r ! satisfies y ( w ) = w e y ( w ) y(w)=we^{y(w)} y ( w ) = w e y ( w ) and 0 ≤ y ( w ) < 1 0\le y(w)<1 0 ≤ y ( w ) < 1 for 0 ≤ w < 1 / e 0\le w<1/e 0 ≤ w < 1/ e , by Lagrange inversion. Since 2 ( 1 − s ) α v = y ( w ) 2(1-s)\alpha v=y(w) 2 ( 1 − s ) α v = y ( w ) with w = 2 ( 1 − s ) α e − ( 2 − s ) α < 1 / e w=2(1-s)\alpha e^{-(2-s)\alpha}<1/e w = 2 ( 1 − s ) α e − ( 2 − s ) α < 1/ e , this gives v = exp ( − α ( s + 2 ( 1 − s ) ( 1 − v ) ) ) v=\exp(-\alpha(s+2(1-s)(1-v))) v = exp ( − α ( s + 2 ( 1 − s ) ( 1 − v ))) , that is, v v v satisfies (18). Moreover, 0 < v < 1 0<v<1 0 < v < 1 , since y ( w ) < 1 y(w)<1 y ( w ) < 1 and y ( w ) e − y ( w ) = w < 2 ( 1 − s ) α e − 2 ( 1 − s ) α y(w)e^{-y(w)}=w<2(1-s)\alpha e^{-2(1-s)\alpha} y ( w ) e − y ( w ) = w < 2 ( 1 − s ) α e − 2 ( 1 − s ) α . By uniqueness, v = u s ( α ) v=u_s(\alpha) v = u s ( α ) . Since U ~ k ( α ) ≤ e − s α \widetilde{U}_k(\alpha)\le e^{-s\alpha} U k ( α ) ≤ e − s α , Fatou’s lemma applied to e − s α − U ~ k ( α ) e^{-s\alpha}-\widetilde{U}_k(\alpha) e − s α − U k ( α ) gives lim sup k → ∞ E [ τ i ] / k ≤ ∫ 0 ∞ u s ( α ) d α \limsup_{k\to\infty}\mathbb{E}[\tau_i]/k\le\int_0^\infty u_s(\alpha)\,d\alpha lim sup k → ∞ E [ τ i ] / k ≤ ∫ 0 ∞ u s ( α ) d α , which matches the lower bound.
Finally, solving (18) for α \alpha α gives the strictly decreasing inverse α ( u ) = − log u / ( s + 2 ( 1 − s ) ( 1 − u ) ) \alpha(u)=-\log u/(s+2(1-s)(1-u)) α ( u ) = − log u / ( s + 2 ( 1 − s ) ( 1 − u )) on ( 0 , 1 ) (0,1) ( 0 , 1 ) , with α ( u ) → ∞ \alpha(u)\to\infty α ( u ) → ∞ as u ↓ 0 u\downarrow0 u ↓ 0 and α ( u ) → 0 \alpha(u)\to0 α ( u ) → 0 as u ↑ 1 u\uparrow1 u ↑ 1 . Hence, ∫ 0 ∞ u s ( α ) d α = ∫ 0 1 α ( u ) d u \int_0^\infty u_s(\alpha)\,d\alpha=\int_0^1\alpha(u)\,du ∫ 0 ∞ u s ( α ) d α = ∫ 0 1 α ( u ) d u , which is the right side of (17). □ \square □
The right side of (17) is minimized at s ≈ 0.1554737 s\approx0.1554737 s ≈ 0.1554737 , where numerical integration gives the value 0.793933445 0.793933445 0.793933445 . This agrees with the optimal value for this distribution under the peeling decoder reported in [24 ] . In fact, the peeling decoder recovers exactly the coordinates in marked components, so the upper bound in the proof of Proposition 12 also applies to it. Hence, for this distribution, an optimal decoder has the same asymptotic normalized expected recovery time as the peeling decoder, for every s s s , over every field, and for every coefficient distribution.
Finite-field generator matrices
The degree distribution P ( z ) = s z + ( 1 − s ) z 2 P(z)=sz+(1-s)z^2 P ( z ) = sz + ( 1 − s ) z 2 of the previous subsection can be realized by sampling a fixed generator matrix. Fix a prime power q q q and an integer a ≥ 1 a\ge1 a ≥ 1 . Over F q \mathbb{F}_q F q , let
G k , q ( a ) = [ I k ⋯ I k | D k , q ] , G_{k,q}(a)=\left[I_k\ \cdots\ I_k\ \middle|\ D_{k,q}\right], G k , q ( a ) = [ I k ⋯ I k ∣ D k , q ] ,
where there are a a a copies of I k I_k I k . \hfill (19)
where I k I_k I k is the k × k k\times k k × k identity matrix and D k , q D_{k,q} D k , q contains the column e u + λ e v e_u+\lambda e_v e u + λ e v , once for every 1 ≤ u < v ≤ k 1\le u<v\le k 1 ≤ u < v ≤ k and every λ ∈ F q ∗ \lambda\in\mathbb{F}_q^* λ ∈ F q ∗ . This is a dimension-k k k code of length
a k + ( q − 1 ) ( k 2 ) . ak+(q-1)\binom{k}{2}. ak + ( q − 1 ) ( 2 k ) .
Uniform sampling of its columns with replacement produces a weight-one column with probability
s k = a k a k + ( q − 1 ) ( k 2 ) . s_k=\frac{ak}{ak+(q-1)\binom{k}{2}}. s k = ak + ( q − 1 ) ( 2 k ) ak .
Otherwise, it produces a column e u + λ e v \mathbf{e}_u+\lambda\mathbf{e}_v e u + λ e v , where { u , v } \{u,v\} { u , v } is a uniformly random pair and λ \lambda λ is uniform on F q ∗ \mathbb{F}_q^* F q ∗ , independently. Unlike the random columns of Section II, the matrix is fixed before sampling, so no new coefficients are generated during retrieval. For any prescribed 0 < s < 1 0<s<1 0 < s < 1 , we choose the number of copies of I k I_k I k in G k , q ( a ) G_{k,q}(a) G k , q ( a ) as
a = a k : = ⌈ s ( q − 1 ) ( k − 1 ) 2 ( 1 − s ) ⌉ , (19) a=a_k:=\left\lceil\frac{s(q-1)(k-1)}{2(1-s)}\right\rceil, \tag*{(19)} a = a k := ⌈ 2 ( 1 − s ) s ( q − 1 ) ( k − 1 ) ⌉ , (19)
which gives s k → s s_k\to s s k → s as k → ∞ k\to\infty k → ∞ . Hence, for q = 2 q=2 q = 2 , sampling the columns of G k , 2 ( a k ) G_{k,2}(a_k) G k , 2 ( a k ) is the setting analyzed in [24 ] for the peeling decoder with column weights one and two. For larger q q q , the matrices G k , q ( a ) G_{k,q}(a) G k , q ( a ) are closely related to the construction of [23 ] , which also combines copies of I k I_k I k with weight-two columns, but uses x x x weight-two columns per pair, with distinct coefficient ratios, over a field whose size grows with k k k . For that construction, it was conjectured in [24 ] that, with the ratio of weight-one to weight-two columns optimized, the normalized expected recovery time tends to ≈ 0.7939 \approx0.7939 ≈ 0.7939 , the minimal value obtained in [24 ] for binary fully symmetric codes with column weights one and two under the peeling decoder. Proposition 14 below establishes this limit for G k , q ( a k ) G_{k,q}(a_k) G k , q ( a k ) over every fixed finite field.
Lemma 13. Let v 1 , … , v n \mathbf{v}_1,\ldots,\mathbf{v}_n v 1 , … , v n be sampled from G k , q ( a ) G_{k,q}(a) G k , q ( a ) , and let H i \mathcal{H}_i H i be the component of i i i in G G G . If H i \mathcal{H}_i H i is marked, then e i ∈ ⟨ M k ( n ) ⟩ \mathbf{e}_i\in\langle M_k(n)\rangle e i ∈ ⟨ M k ( n )⟩ . If H i \mathcal{H}_i H i is unmarked and has m m m edges, counted with multiplicity, then
Pr { e i ∉ ⟨ M k ( n ) ⟩ ∣ supports } = ( q − 1 ) − ( m − ∣ H i ∣ + 1 ) . (20) \Pr\{\mathbf{e}_i\notin\langle M_k(n)\rangle\mid\text{supports}\}=(q-1)^{-(m-|\mathcal{H}_i|+1)}. \tag*{(20)} Pr { e i ∈ / ⟨ M k ( n )⟩ ∣ supports } = ( q − 1 ) − ( m − ∣ H i ∣ + 1 ) . (20)
Proof. If H i \mathcal{H}_i H i is marked, then e i ∈ ⟨ M k ( n ) ⟩ \mathbf{e}_i\in\langle M_k(n)\rangle e i ∈ ⟨ M k ( n )⟩ by Lemma 11(i). Otherwise, let r = ∣ H i ∣ r=|\mathcal{H}_i| r = ∣ H i ∣ and fix a spanning tree of H i \mathcal{H}_i H i . Its r − 1 r-1 r − 1 columns are linearly independent, so they span a subspace T T T of dimension r − 1 r-1 r − 1 of the r r r -dimensional space of vectors supported in H i \mathcal{H}_i H i . Since the tree is unmarked, T T T contains no weight-one vector by Lemma 11(ii). Each of the other m − r + 1 m-r+1 m − r + 1 columns e u + λ e v \mathbf{e}_u+\lambda\mathbf{e}_v e u + λ e v of H i \mathcal{H}_i H i either lies in T T T , or extends T T T to the whole r r r -dimensional space, which contains e i \mathbf{e}_i e i . Hence, e i ∉ ⟨ M k ( n ) ⟩ \mathbf{e}_i\notin\langle M_k(n)\rangle e i ∈ / ⟨ M k ( n )⟩ if and only if all of them lie in T T T . For given u , v u,v u , v , exactly one λ ∈ F q ∗ \lambda\in\mathbb{F}_q^* λ ∈ F q ∗ puts e u + λ e v \mathbf{e}_u+\lambda\mathbf{e}_v e u + λ e v in T T T . At least one does, since combining the tree columns along the path from u u u to v v v gives such a vector. At most one does, since otherwise subtracting two of them would put a weight-one vector in T T T . Since the λ \lambda λ ’s are independent and uniform on F q ∗ \mathbb{F}_q^* F q ∗ , all of them take this value with probability ( q − 1 ) − ( m − r + 1 ) (q-1)^{-(m-r+1)} ( q − 1 ) − ( m − r + 1 ) . ∎
Proposition 14. For every prime power q q q and 0 < s < 1 0<s<1 0 < s < 1 , sampling the columns of G k , q ( a k ) G_{k,q}(a_k) G k , q ( a k ) , with a k a_k a k as in (20), gives the same limit as in (17), that is,
lim k → ∞ E [ τ i ] k = ∫ 0 1 − log u s + 2 ( 1 − s ) ( 1 − u ) d u . (21) \lim_{k\to\infty}\frac{\mathbb{E}[\tau_i]}{k}=\int_0^1\frac{-\log u}{s+2(1-s)(1-u)}\,du. \tag*{(21)} k → ∞ lim k E [ τ i ] = ∫ 0 1 s + 2 ( 1 − s ) ( 1 − u ) − log u d u . (21)
Proof. Multiplying a column by a nonzero scalar does not change the span, so it does not change τ i \tau_i τ i . Up to such scalars, a sampled column of G k , q ( a k ) G_{k,q}(a_k) G k , q ( a k ) is a column of the model of Section II over F q \mathbb{F}_q F q with degree distribution P k ( z ) = s k z 2 + ( 1 − s k ) z P_k(z)=s_k z^2+(1-s_k)z P k ( z ) = s k z 2 + ( 1 − s k ) z and μ \mu μ uniform on F q ∗ \mathbb{F}_q^* F q ∗ . Indeed, in that model a weight-one column is a multiple of some e u \mathbf{e}_u e u , and a weight-two column on a uniformly random pair u < v u<v u < v equals a e u + b e v = a ( e u + ( b / a ) e v ) a\mathbf{e}_u+b\mathbf{e}_v=a(\mathbf{e}_u+(b/a)\mathbf{e}_v) a e u + b e v = a ( e u + ( b / a ) e v ) , where b / a b/a b / a is uniform on F q ∗ \mathbb{F}_q^* F q ∗ . Thus, it suffices to show that Proposition 12 still holds when s s s is replaced by s k → s s_k\to s s k → s . For the lower bound, the proof of Theorem 1 shows that Lemma 6 holds whenever P k → P P_k\to P P k → P . For the upper bound, the proof of Proposition 12 uses s s s only through the probabilities that a vertex is marked and that a pair is joined by an edge, and the same limits are obtained with s k s_k s k in place of s s s . □
Taking s = 0.1554737 s=0.1554737 s = 0.1554737 gives the value 0.793933445 … 0.793933445\ldots 0.793933445 … over every fixed field. This realizes the known asymptotic constant with an explicit code; increasing q q q improves recovery on individual cyclic components but does not change this limit. The length of G k , q ( a k ) G_{k,q}(a_k) G k , q ( a k ) satisfies
a k k + ( q − 1 ) ( k 2 ) ∼ ( q − 1 ) k 2 2 ( 1 − s ) , a_k k+(q-1)\binom{k}{2}\sim\frac{(q-1)k^2}{2(1-s)}, a k k + ( q − 1 ) ( 2 k ) ∼ 2 ( 1 − s ) ( q − 1 ) k 2 ,
so the rate tends to zero. One may instead fix a block dimension ℓ \ell ℓ and take a direct sum of t t t copies of G ℓ , q ( a ℓ ) G_{\ell,q}(a_\ell) G ℓ , q ( a ℓ ) . Sampling enters the requested block with probability 1 / t 1/t 1/ t , and columns of other blocks do not help to recover x i x_i x i . Therefore, for i ∈ [ ℓ ] i\in[\ell] i ∈ [ ℓ ] ,
E [ τ i ( ⨁ j = 1 t G ℓ , q ( a ℓ ) ) ] t ℓ = E [ τ i ( G ℓ , q ( a ℓ ) ) ] ℓ . \frac{\mathbb{E}\left[\tau_i\left(\bigoplus_{j=1}^{t}G_{\ell,q}(a_\ell)\right)\right]}{t\ell}
=\frac{\mathbb{E}\left[\tau_i\left(G_{\ell,q}(a_\ell)\right)\right]}{\ell}. t ℓ E [ τ i ( ⨁ j = 1 t G ℓ , q ( a ℓ ) ) ] = ℓ E [ τ i ( G ℓ , q ( a ℓ ) ) ] .
This gives a positive rate for fixed ℓ \ell ℓ , and a normalized expectation arbitrarily close to the right side of (17) by choosing ℓ \ell ℓ sufficiently large. The block construction is not an instance of the model of Section II, since its weight-two columns only join coordinates in the same block.
Conclusion
We proved that lim inf k → ∞ E [ τ i ] / k ≥ π / 4 \liminf_{k\to\infty}\mathbb{E}[\tau_i]/k\ge\pi/4 lim inf k → ∞ E [ τ i ] / k ≥ π /4 for symmetric linear ensembles with uniformly bounded column weights. This bound holds under optimal decoding.
For degree distributions with support size in 1 , 2 1,2 1 , 2 , we determined the limiting normalized expected recovery time. The limit is the same under optimal and peeling decoding, and its minimum over these distributions is approximately 0.793933445 0.793933445 0.793933445 . We gave explicit code families that attain this limit over every fixed finite field. We also showed that positive-rate block constructions can achieve normalized expected recovery times arbitrarily close to this value.
We have also obtained several results for columns with growing support over infinite fields, which we plan to include in an extended version.
AI Statement
OpenAI ChatGPT and Anthropic Claude were used as writing assistants for editing and rephrasing the text, including the presentation of some proofs, and for checking related literature. All results and proofs are due to the authors, who directed and verified all changes
References
Proofs for Section III
Let α ≥ 0 \alpha\ge0 α ≥ 0 and β > 0 \beta> 0 β > 0 , and let A k A_k A k and B k B_k B k be as in the proof of Lemma 5. For a matrix with N N N columns, column weights w 1 , … , w N w_1,\ldots,w_N w 1 , … , w N , and row weights d 1 , … , d k d_1,\ldots,d_k d 1 , … , d k , write
a = ( N , w 1 , … , w N , d 1 , … , d k ) a=(N,w_1,\ldots,w_N,d_1,\ldots,d_k) a = ( N , w 1 , … , w N , d 1 , … , d k )
for its degree data and T = w 1 + ⋯ + w N T=w_1+\cdots+w_N T = w 1 + ⋯ + w N for its number of nonzero entries.
Lemma 15. For every δ > 0 \delta>0 δ > 0 there are constants C δ C_\delta C δ and k δ k_\delta k δ such that, for all k ≥ k δ k\ge k_\delta k ≥ k δ and every set B \mathcal{B} B of matrices,
P { A k ∈ B } ≤ C δ P { B k ∈ B } + δ . \mathbb{P}\{A_k\in\mathcal{B}\}\le C_\delta\mathbb{P}\{B_k\in\mathcal{B}\}+\delta. P { A k ∈ B } ≤ C δ P { B k ∈ B } + δ .
Proof. Since A k A_k A k and B k B_k B k have the same distribution given their degree data, it suffices to compare the probabilities p A ( a ) p_A(a) p A ( a ) and p B ( a ) p_B(a) p B ( a ) of the degree data. Let λ = α P ′ ( 1 ) + β \lambda=\alpha\mathbb{P}'(1)+\beta λ = α P ′ ( 1 ) + β and π k ( T ) = P ( Poisson ( λ k ) = T ) \pi_k(T)=\mathbb{P}(\operatorname{Poisson}(\lambda k)=T) π k ( T ) = P ( Poisson ( λk ) = T ) . Let q ( a ) q(a) q ( a ) be the probability of a a a when all numbers in the definition of B k B_k B k are drawn once, without redrawing, and let Z k Z_k Z k be the probability that they are not redrawn. Then p B ( a ) = q ( a ) / Z k p_B(a)=q(a)/Z_k p B ( a ) = q ( a ) / Z k whenever p B ( a ) > 0 p_B(a)>0 p B ( a ) > 0 . Since a sum of k k k independent Poisson( λ ) (\lambda) ( λ ) random variables is a Poisson( λ k ) (\lambda k) ( λk ) random variable,
Z k ≤ P { d 1 + ⋯ + d k = w 1 + ⋯ + w N } = ∑ T P { w 1 + ⋯ + w N = T } π k ( T ) ≤ max T π k ( T ) . Z_k\le\mathbb{P}\{d_1+\cdots+d_k=w_1+\cdots+w_N\}
=\sum_T\mathbb{P}\{w_1+\cdots+w_N=T\}\pi_k(T)
\le\max_T\pi_k(T). Z k ≤ P { d 1 + ⋯ + d k = w 1 + ⋯ + w N } = T ∑ P { w 1 + ⋯ + w N = T } π k ( T ) ≤ T max π k ( T ) .
To compute p A ( a ) p_A(a) p A ( a ) , suppose first that each column draws its w j w_j w j positions independently and uniformly with replacement. Then, given N N N and the column weights, the row counts are multinomial, and
T ! d 1 ! ⋯ d k ! k − T = 1 π k ( T ) ∏ i = 1 k e − λ λ d i d i ! . \frac{T!}{d_1!\cdots d_k!}k^{-T}=\frac{1}{\pi_k(T)}\prod_{i=1}^k e^{-\lambda}\frac{\lambda^{d_i}}{d_i!}. d 1 ! ⋯ d k ! T ! k − T = π k ( T ) 1 i = 1 ∏ k e − λ d i ! λ d i .
The support of A k A_k A k is obtained from such draws by conditioning on the event that no column draws a position twice. Given N N N and the column weights, this event has probability at least ∏ j ( 1 − w j 2 / ( 2 k ) ) ≥ e − W 2 N / k \prod_j(1-w_j^2/(2k))\ge e^{-W^2N/k} ∏ j ( 1 − w j 2 / ( 2 k )) ≥ e − W 2 N / k for k ≥ W 2 k\ge W^2 k ≥ W 2 . Therefore, for every a a a with p A ( a ) > 0 p_A(a)>0 p A ( a ) > 0 ,
p A ( a ) ≤ e W 2 N / k q ( a ) π k ( T ) = e W 2 N / k Z k π k ( T ) p B ( a ) ≤ e W 2 N / k max T ′ π k ( T ′ ) π k ( T ) p B ( a ) . p_A(a)\le e^{W^2N/k}\frac{q(a)}{\pi_k(T)}
=e^{W^2N/k}\frac{Z_k}{\pi_k(T)}p_B(a)
\le e^{W^2N/k}\frac{\max_{T'}\pi_k(T')}{\pi_k(T)}p_B(a). p A ( a ) ≤ e W 2 N / k π k ( T ) q ( a ) = e W 2 N / k π k ( T ) Z k p B ( a ) ≤ e W 2 N / k π k ( T ) max T ′ π k ( T ′ ) p B ( a ) .
By Stirling’s formula, there is a constant C t ′ C'_t C t ′ such that max T ′ π k ( T ′ ) ≤ C t ′ π k ( T ) \max_{T'}\pi_k(T')\le C'_t\pi_k(T) max T ′ π k ( T ′ ) ≤ C t ′ π k ( T ) whenever ∣ T − λ k ∣ ≤ t k |T-\lambda k|\le t\sqrt{k} ∣ T − λk ∣ ≤ t k and k k k is large enough. Hence, on the set of degree data with N ≤ 2 ( α + β ) k N\le2(\alpha+\beta)k N ≤ 2 ( α + β ) k and ∣ T − λ k ∣ ≤ t k |T-\lambda k|\le t\sqrt{k} ∣ T − λk ∣ ≤ t k , we have p A ( a ) ≤ C t p B ( a ) p_A(a)\le C_t p_B(a) p A ( a ) ≤ C t p B ( a ) with C t = C t ′ e 2 ( α + β ) W 2 C_t=C'_t e^{2(\alpha+\beta)W^2} C t = C t ′ e 2 ( α + β ) W 2 , and therefore
P { A k ∈ B } ≤ C t P { B k ∈ B } + P { N > 2 ( α + β ) k } + P { ∣ T − λ k ∣ > t k } , (22) \mathbb{P}\{A_k\in\mathcal{B}\}\le C_t\mathbb{P}\{B_k\in\mathcal{B}\}+\mathbb{P}\{N>2(\alpha+\beta)k\}
+\mathbb{P}\{|T-\lambda k|>t\sqrt{k}\}, \tag*{(22)} P { A k ∈ B } ≤ C t P { B k ∈ B } + P { N > 2 ( α + β ) k } + P { ∣ T − λk ∣ > t k } , (22)
where the last two probabilities refer to A k A_k A k . In A k A_k A k , the number of columns N N N is Poisson ( ( α + β ) k ) \operatorname{Poisson}((\alpha+\beta)k) Poisson (( α + β ) k ) , and T T T is the sum of N N N independent column weights, so T T T has mean λ k \lambda k λk and variance ( α + β ) k E [ w 2 ] (\alpha+\beta)k\mathbb{E}[w^2] ( α + β ) k E [ w 2 ] . Chebyshev’s inequality bounds the last two probabilities by 1 / ( ( α + β ) k ) 1/((\alpha+\beta)k) 1/ (( α + β ) k ) and ( α + β ) E [ w 2 ] / t 2 (\alpha+\beta)\mathbb{E}[w^2]/t^2 ( α + β ) E [ w 2 ] / t 2 , respectively. Choosing t t t with ( α + β ) E [ w 2 ] / t 2 ≤ δ / 2 (\alpha+\beta)\mathbb{E}[w^2]/t^2\leq\delta/2 ( α + β ) E [ w 2 ] / t 2 ≤ δ /2 , and k k k so large that 1 / ( ( α + β ) k ) ≤ δ / 2 1/((\alpha+\beta)k)\leq\delta/2 1/ (( α + β ) k ) ≤ δ /2 , proves the lemma with C δ = C t C_\delta=C_t C δ = C t .
Corollary 16. For all α ≥ 0 \alpha\geq0 α ≥ 0 and β > 0 \beta>0 β > 0 , rank A k / k → R P ( α , β ) \operatorname{rank} A_k/k\to R_P(\alpha,\beta) rank A k / k → R P ( α , β ) in probability as k → ∞ k\to\infty k → ∞ .
Proof. Fix ε > 0 \varepsilon>0 ε > 0 , and let B \mathcal{B} B be the set of matrices M M M with
∣ rank M k − R P ( α , β ) ∣ > ε . \left|\frac{\operatorname{rank}M}{k}-R_P(\alpha,\beta)\right|>\varepsilon. k rank M − R P ( α , β ) > ε .
By Theorem 4, P { B k ∈ B } → 0 \mathbb{P}\{B_k\in\mathcal{B}\}\to0 P { B k ∈ B } → 0 . Let δ > 0 \delta>0 δ > 0 . By Lemma 15, for all k ≥ k δ k\geq k_\delta k ≥ k δ ,
P { A k ∈ B } ≤ C δ P { B k ∈ B } + δ , \mathbb{P}\{A_k\in\mathcal{B}\}\leq C_\delta\mathbb{P}\{B_k\in\mathcal{B}\}+\delta, P { A k ∈ B } ≤ C δ P { B k ∈ B } + δ ,
and since C δ C_\delta C δ does not depend on k k k , lim sup k → ∞ P { A k ∈ B } ≤ δ \limsup_{k\to\infty}\mathbb{P}\{A_k\in\mathcal{B}\}\leq\delta lim sup k → ∞ P { A k ∈ B } ≤ δ . As δ > 0 \delta>0 δ > 0 is arbitrary, P { A k ∈ B } → 0 \mathbb{P}\{A_k\in\mathcal{B}\}\to0 P { A k ∈ B } → 0 , and as ε > 0 \varepsilon>0 ε > 0 is arbitrary, rank A k / k → R P ( α , β ) \operatorname{rank} A_k/k\to R_P(\alpha,\beta) rank A k / k → R P ( α , β ) in probability.
Proof of Lemma 6. Let β > 0 \beta>0 β > 0 . By Lemma 2, for every k k k ,
U k ( α ) ≥ R k ( α , β ) − R k ( α , 0 ) 1 − e − β . U_k(\alpha)\geq\frac{R_k(\alpha,\beta)-R_k(\alpha,0)}{1-e^{-\beta}}. U k ( α ) ≥ 1 − e − β R k ( α , β ) − R k ( α , 0 ) .
By Lemma 5, the right side converges to ( R P ( α , β ) − R P ( α , 0 ) ) / ( 1 − e − β ) (R_P(\alpha,\beta)-R_P(\alpha,0))/(1-e^{-\beta}) ( R P ( α , β ) − R P ( α , 0 )) / ( 1 − e − β ) as k → ∞ k\to\infty k → ∞ . Hence, by (7) ,
lim inf k → ∞ U k ( α ) ≥ R P ( α , β ) − R P ( α , 0 ) 1 − e − β = max z ∈ [ 0 , 1 ] Φ α ( z ) − max z ∈ [ 0 , 1 ] Φ α , β ( z ) 1 − e − β . \liminf_{k\to\infty}U_k(\alpha)\geq\frac{R_P(\alpha,\beta)-R_P(\alpha,0)}{1-e^{-\beta}}
=\frac{\max_{z\in[0,1]}\Phi_\alpha(z)-\max_{z\in[0,1]}\Phi_{\alpha,\beta}(z)}{1-e^{-\beta}}. k → ∞ lim inf U k ( α ) ≥ 1 − e − β R P ( α , β ) − R P ( α , 0 ) = 1 − e − β max z ∈ [ 0 , 1 ] Φ α ( z ) − max z ∈ [ 0 , 1 ] Φ α , β ( z ) .
By (6) , Φ α , β ( z ) = Φ α ( z ) − ( 1 − e − β ) e − α P ′ ( z ) \Phi_{\alpha,\beta}(z)=\Phi_\alpha(z)-(1-e^{-\beta})e^{-\alpha P'(z)} Φ α , β ( z ) = Φ α ( z ) − ( 1 − e − β ) e − α P ′ ( z ) . Let z β z_\beta z β be a maximizer of Φ α , β \Phi_{\alpha,\beta} Φ α , β on [ 0 , 1 ] [0,1] [ 0 , 1 ] . Then
max z ∈ [ 0 , 1 ] Φ α , β ( z ) = Φ α ( z β ) − ( 1 − e − β ) e − α P ′ ( z β ) ≤ max z ∈ [ 0 , 1 ] Φ α ( z ) − ( 1 − e − β ) e − α P ′ ( z β ) . \max_{z\in[0,1]}\Phi_{\alpha,\beta}(z)=\Phi_\alpha(z_\beta)-(1-e^{-\beta})e^{-\alpha P'(z_\beta)}
\leq\max_{z\in[0,1]}\Phi_\alpha(z)-(1-e^{-\beta})e^{-\alpha P'(z_\beta)}. z ∈ [ 0 , 1 ] max Φ α , β ( z ) = Φ α ( z β ) − ( 1 − e − β ) e − α P ′ ( z β ) ≤ z ∈ [ 0 , 1 ] max Φ α ( z ) − ( 1 − e − β ) e − α P ′ ( z β ) .
Consequently, for every β > 0 \beta>0 β > 0 and every choice of z β ∈ arg max z ∈ [ 0 , 1 ] Φ α , β ( z ) z_\beta\in\arg\max_{z\in[0,1]}\Phi_{\alpha,\beta}(z) z β ∈ arg max z ∈ [ 0 , 1 ] Φ α , β ( z ) , we have
lim inf k → ∞ U k ( α ) ≥ e − α P ′ ( z β ) . \liminf_{k\to\infty}U_k(\alpha)\geq e^{-\alpha P'(z_\beta)}. k → ∞ lim inf U k ( α ) ≥ e − α P ′ ( z β ) .
Here z β z_\beta z β maximizes the perturbed function Φ α , β \Phi_{\alpha,\beta} Φ α , β , whereas the desired bound in the lemma statement is defined using the maximizers of Φ α = Φ α , 0 \Phi_\alpha=\Phi_{\alpha,0} Φ α = Φ α , 0 . It suffices to establish the same inequality for at least one point z ∗ ∈ A P ( α ) z^*\in A_P(\alpha) z ∗ ∈ A P ( α ) , since then
lim inf k → ∞ U k ( α ) ≥ e − α P ′ ( z ∗ ) ≥ min z ∈ A P ( α ) e − α P ′ ( z ) = U P ( α ) . \liminf_{k\to\infty}U_k(\alpha)\geq e^{-\alpha P'(z^*)}
\geq\min_{z\in A_P(\alpha)}e^{-\alpha P'(z)}=U_P(\alpha). k → ∞ lim inf U k ( α ) ≥ e − α P ′ ( z ∗ ) ≥ z ∈ A P ( α ) min e − α P ′ ( z ) = U P ( α ) .
We obtain such a point by letting the perturbation vanish. Set β h = 1 / h \beta_h=1/h β h = 1/ h , and for each h h h , choose one maximizer z h z_h z h of Φ α , β h \Phi_{\alpha,\beta_h} Φ α , β h . These points need not converge, but compactness of [ 0 , 1 ] [0,1] [ 0 , 1 ] guarantees a subsequence z h i → z ∗ z_{h_i}\to z^* z h i → z ∗ . We next show that this limiting point maximizes Φ α \Phi_\alpha Φ α . Continuity of z ↦ e − α P ′ ( z ) z\mapsto e^{-\alpha P'(z)} z ↦ e − α P ′ ( z ) will then allow us to pass the preceding inequality to the limit.
Since 0 ≤ Φ α ( z ) − Φ α , β h ( z ) ≤ 1 − e − β h 0\leq\Phi_\alpha(z)-\Phi_{\alpha,\beta_h}(z)\leq1-e^{-\beta_h} 0 ≤ Φ α ( z ) − Φ α , β h ( z ) ≤ 1 − e − β h for all z ∈ [ 0 , 1 ] z\in[0,1] z ∈ [ 0 , 1 ] , the maximal value of the two functions differ by at most 1 − e − β h 1-e^{-\beta_h} 1 − e − β h , and
Φ α ( z h ) ≥ Φ α , β h ( z h ) = max z ∈ [ 0 , 1 ] Φ α , β h ( z ) ≥ max z ∈ [ 0 , 1 ] Φ α ( z ) − ( 1 − e − β h ) . \Phi_\alpha(z_h)\geq\Phi_{\alpha,\beta_h}(z_h)=\max_{z\in[0,1]}\Phi_{\alpha,\beta_h}(z)
\geq\max_{z\in[0,1]}\Phi_\alpha(z)-(1-e^{-\beta_h}). Φ α ( z h ) ≥ Φ α , β h ( z h ) = z ∈ [ 0 , 1 ] max Φ α , β h ( z ) ≥ z ∈ [ 0 , 1 ] max Φ α ( z ) − ( 1 − e − β h ) .
Letting i → ∞ i\to\infty i → ∞ along h = h i h=h_i h = h i and using the continuity of Φ α \Phi_\alpha Φ α gives Φ α ( z ∗ ) ≥ max z ∈ [ 0 , 1 ] Φ α ( z ) \Phi_\alpha(z^*)\geq\max_{z\in[0,1]}\Phi_\alpha(z) Φ α ( z ∗ ) ≥ max z ∈ [ 0 , 1 ] Φ α ( z ) , so z ∗ ∈ A P ( α ) z^*\in A_P(\alpha) z ∗ ∈ A P ( α ) . Finally, since lim inf k → ∞ U k ( α ) ≥ e − α P ′ ( z h ) \liminf_{k\to\infty}U_k(\alpha)\geq e^{-\alpha P'(z_h)} lim inf k → ∞ U k ( α ) ≥ e − α P ′ ( z h ) for every h h h , and z ↦ e − α P ′ ( z ) z\mapsto e^{-\alpha P'(z)} z ↦ e − α P ′ ( z ) is continuous,
lim inf k → ∞ U k ( α ) ≥ lim i → ∞ e − α P ′ ( z h i ) = e − α P ′ ( z ∗ ) ≥ min z ∈ A P ( α ) e − α P ′ ( z ) = U P ( α ) , \liminf_{k\to\infty}U_k(\alpha)\geq\lim_{i\to\infty}e^{-\alpha P'(z_{h_i})}
=e^{-\alpha P'(z^*)}
\geq\min_{z\in A_P(\alpha)}e^{-\alpha P'(z)}
=U_P(\alpha), k → ∞ lim inf U k ( α ) ≥ i → ∞ lim e − α P ′ ( z h i ) = e − α P ′ ( z ∗ ) ≥ z ∈ A P ( α ) min e − α P ′ ( z ) = U P ( α ) ,
which proves (12) .
Appendix B: Proofs for Section IV
Throughout this subsection, p 1 < 1 p_1<1 p 1 < 1 . since ∑ w = 1 W p w = 1 \sum_{w=1}^{W}p_w=1 ∑ w = 1 W p w = 1 , there exists w ′ ≥ 2 w'\geq2 w ′ ≥ 2 such that p w ′ > 0 p_{w'}>0 p w ′ > 0 and hence
P ′ ′ ( z ) = ∑ w = 2 W w ( w − 1 ) p w z w − 2 ≥ w ′ ( w ′ − 1 ) p w ′ z w ′ − 2 > 0 P''(z)=\sum_{w=2}^{W}w(w-1)p_w z^{w-2}\geq w'(w'-1)p_{w'}z^{w'-2}>0 P ′′ ( z ) = w = 2 ∑ W w ( w − 1 ) p w z w − 2 ≥ w ′ ( w ′ − 1 ) p w ′ z w ′ − 2 > 0
for 0 < z ≤ 1 0<z\leq1 0 < z ≤ 1 .
Proof of Lemma 8. Since P ′ ′ ( z ) > 0 P''(z)>0 P ′′ ( z ) > 0 for 0 < z ≤ 1 0<z\leq1 0 < z ≤ 1 , the derivative P ′ ( z ) P'(z) P ′ ( z ) is strictly increasing on [ 0 , 1 ] [0,1] [ 0 , 1 ] , so z ↦ e − α P ′ ( z ) z\mapsto e^{-\alpha P'(z)} z ↦ e − α P ′ ( z ) is strictly decreasing for α > 0 \alpha>0 α > 0 . Hence, the minimum in the definition of U P ( α ) U_P(\alpha) U P ( α ) is attained at the largest element of A P ( α ) A_P(\alpha) A P ( α ) , that is, U P ( α ) = e − α P ′ ( ζ ( α ) ) U_P(\alpha)=e^{-\alpha P'(\zeta(\alpha))} U P ( α ) = e − α P ′ ( ζ ( α )) .
Let Φ α ′ \Phi'_\alpha Φ α ′ denote the derivative of Φ α \Phi_\alpha Φ α with respect to z z z , then
Φ α ′ ( z ) = α P ′ ′ ( z ) ( 1 − z − e − α P ′ ( z ) ) . (23) \Phi'_\alpha(z)=\alpha P''(z)(1-z-e^{-\alpha P'(z)}). \tag*{(23)} Φ α ′ ( z ) = α P ′′ ( z ) ( 1 − z − e − α P ′ ( z ) ) . (23)
Next, we show that an interior maximizer satisfies α P ′ ( z ) = − log ( 1 − z ) \alpha P'(z)=-\log(1-z) α P ′ ( z ) = − log ( 1 − z ) . Indeed, for any α > 0 \alpha>0 α > 0 , let z ∗ ∈ ( 0 , 1 ) z^*\in(0,1) z ∗ ∈ ( 0 , 1 ) be an interior maximizer of Φ α \Phi_\alpha Φ α . As Φ α \Phi_\alpha Φ α is differentiable, Φ α ′ ( z ∗ ) = 0 \Phi'_\alpha(z^*)=0 Φ α ′ ( z ∗ ) = 0 . Since α P ′ ′ ( z ∗ ) > 0 \alpha P''(z^*)>0 α P ′′ ( z ∗ ) > 0 , (23) gives 1 − z ∗ = e − α P ′ ( z ∗ ) 1-z^*=e^{-\alpha P'(z^*)} 1 − z ∗ = e − α P ′ ( z ∗ ) , and taking logarithms, which is possible since 1 − z ∗ > 0 1-z^*>0 1 − z ∗ > 0 ,
α P ′ ( z ∗ ) = − log ( 1 − z ∗ ) . \alpha P'(z^*)=-\log(1-z^*). α P ′ ( z ∗ ) = − log ( 1 − z ∗ ) .
The endpoint z = 1 z=1 z = 1 does not maximize Φ α \Phi_\alpha Φ α . To see this, note that by (23) , Φ α ′ ( 1 ) = − α P ′ ′ ( 1 ) e − α P ′ ( 1 ) < 0 \Phi'_\alpha(1)=-\alpha P''(1)e^{-\alpha P'(1)}<0 Φ α ′ ( 1 ) = − α P ′′ ( 1 ) e − α P ′ ( 1 ) < 0 . Since Φ α ′ \Phi'_\alpha Φ α ′ is continuous, there is δ > 0 \delta>0 δ > 0 such that Φ α ′ < 0 \Phi'_\alpha<0 Φ α ′ < 0 on ( 1 − δ , 1 ] (1-\delta,1] ( 1 − δ , 1 ] . For z ∈ ( 1 − δ , 1 ) z\in(1-\delta,1) z ∈ ( 1 − δ , 1 ) , the mean value theorem gives some ξ ∈ ( z , 1 ) \xi\in(z,1) ξ ∈ ( z , 1 ) with
Φ α ( 1 ) − Φ α ( z ) = Φ α ′ ( ξ ) ( 1 − z ) < 0 , \Phi_\alpha(1)-\Phi_\alpha(z)=\Phi'_\alpha(\xi)(1-z)<0, Φ α ( 1 ) − Φ α ( z ) = Φ α ′ ( ξ ) ( 1 − z ) < 0 ,
since Φ α ′ ( ξ ) < 0 \Phi'_\alpha(\xi)<0 Φ α ′ ( ξ ) < 0 and 1 − z > 0 1-z>0 1 − z > 0 . Hence, Φ α ( z ) > Φ α ( 1 ) \Phi_\alpha(z)>\Phi_\alpha(1) Φ α ( z ) > Φ α ( 1 ) , that is, Φ α \Phi_\alpha Φ α is strictly decreasing on ( 1 − δ , 1 ] (1-\delta,1] ( 1 − δ , 1 ] .
Next, suppose that the endpoint z = 0 z=0 z = 0 maximizes Φ α \Phi_\alpha Φ α . We show that then P ′ ( 0 ) = p 1 = 0 P'(0)=p_1=0 P ′ ( 0 ) = p 1 = 0 . Otherwise,
lim z ↓ 0 1 − z − e − α P ′ ( z ) = 1 − e − α p 1 > 0 \lim_{z\downarrow0}1-z-e^{-\alpha P'(z)}=1-e^{-\alpha p_1}>0 z ↓ 0 lim 1 − z − e − α P ′ ( z ) = 1 − e − α p 1 > 0
so this factor is positive on [ 0 , δ ) [0,\delta) [ 0 , δ ) for some δ > 0 \delta>0 δ > 0 . Since also P ′ ′ ( z ) > 0 P''(z)>0 P ′′ ( z ) > 0 for z > 0 z>0 z > 0 , (23) gives Φ α ′ > 0 \Phi'_\alpha>0 Φ α ′ > 0 on ( 0 , δ ) (0,\delta) ( 0 , δ ) . Take z ∈ ( 0 , δ ) z\in(0,\delta) z ∈ ( 0 , δ ) , by the mean value theorem there exists ξ ∈ ( 0 , z ) \xi\in(0,z) ξ ∈ ( 0 , z ) with
Φ α ( z ) − Φ α ( 0 ) = z Φ α ′ ( ξ ) > 0 , \Phi_\alpha(z)-\Phi_\alpha(0)=z\Phi'_\alpha(\xi)>0, Φ α ( z ) − Φ α ( 0 ) = z Φ α ′ ( ξ ) > 0 ,
and thus Φ α ( z ) > Φ α ( 0 ) \Phi_\alpha(z)>\Phi_\alpha(0) Φ α ( z ) > Φ α ( 0 ) for z ∈ ( 0 , δ ) z\in(0,\delta) z ∈ ( 0 , δ ) , a contradiction. Hence, P ′ ( 0 ) = 0 P'(0)=0 P ′ ( 0 ) = 0 , and so 1 − z = e − α P ′ ( z ) 1-z=e^{-\alpha P'(z)} 1 − z = e − α P ′ ( z ) holds also at z = 0 z=0 z = 0 .
Consequently, every maximizer z ∗ z^* z ∗ of Φ α \Phi_\alpha Φ α satisfies
1 − z ∗ = e − α P ′ ( z ∗ ) . 1-z^*=e^{-\alpha P'(z^*)}. 1 − z ∗ = e − α P ′ ( z ∗ ) .
Applying this to z = ζ ( α ) z=\zeta(\alpha) z = ζ ( α ) and using U P ( α ) = e − α P ′ ( ζ ( α ) ) U_P(\alpha)=e^{-\alpha P'(\zeta(\alpha))} U P ( α ) = e − α P ′ ( ζ ( α )) , we obtain
U P ( α ) = 1 − ζ ( α ) . U_P(\alpha)=1-\zeta(\alpha). U P ( α ) = 1 − ζ ( α ) .
Proof of Lemma 9. We first show that ζ \zeta ζ is nondecreasing. To this end, we compare the values of Φ α \Phi_\alpha Φ α at two points 0 ≤ z 1 < z 2 ≤ 1 0\le z_1<z_2\le1 0 ≤ z 1 < z 2 ≤ 1 :
Φ α ( z 2 ) − Φ α ( z 1 ) α = H ( z 1 ) − H ( z 2 ) − ∫ P ′ ( z 1 ) P ′ ( z 2 ) e − α u d u . (24) \frac{\Phi_\alpha(z_2)-\Phi_\alpha(z_1)}{\alpha}
=H(z_1)-H(z_2)-\int_{P'(z_1)}^{P'(z_2)}e^{-\alpha u}\,du. \tag*{(24)} α Φ α ( z 2 ) − Φ α ( z 1 ) = H ( z 1 ) − H ( z 2 ) − ∫ P ′ ( z 1 ) P ′ ( z 2 ) e − α u d u . (24)
The right side is strictly increasing in α \alpha α . Hence, if Φ α ( z 2 ) ≥ Φ α ( z 1 ) \Phi_\alpha(z_2)\ge\Phi_\alpha(z_1) Φ α ( z 2 ) ≥ Φ α ( z 1 ) for some α > 0 \alpha>0 α > 0 , then Φ α ′ ( z 2 ) > Φ α ′ ( z 1 ) \Phi_{\alpha'}(z_2)>\Phi_{\alpha'}(z_1) Φ α ′ ( z 2 ) > Φ α ′ ( z 1 ) for all α ′ > α \alpha'>\alpha α ′ > α .
We now use this to show that ζ \zeta ζ is nondecreasing. Assume, to the contrary, that ζ ( α ′ ) < ζ ( α ) \zeta(\alpha')<\zeta(\alpha) ζ ( α ′ ) < ζ ( α ) for some 0 < α < α ′ 0<\alpha<\alpha' 0 < α < α ′ , and put z 1 = ζ ( α ′ ) z_1=\zeta(\alpha') z 1 = ζ ( α ′ ) and z 2 = ζ ( α ) z_2=\zeta(\alpha) z 2 = ζ ( α ) . Since z 2 z_2 z 2 maximizes Φ α \Phi_\alpha Φ α , we have Φ α ( z 2 ) ≥ Φ α ( z 1 ) \Phi_\alpha(z_2)\ge\Phi_\alpha(z_1) Φ α ( z 2 ) ≥ Φ α ( z 1 ) , and therefore Φ α ′ ( z 2 ) > Φ α ′ ( z 1 ) \Phi_{\alpha'}(z_2)>\Phi_{\alpha'}(z_1) Φ α ′ ( z 2 ) > Φ α ′ ( z 1 ) . This contradicts the fact that z 1 z_1 z 1 maximizes Φ α ′ \Phi_{\alpha'} Φ α ′ . Therefore, ζ \zeta ζ is nondecreasing.
Next, we show that ζ \zeta ζ is right-continuous. Let α 0 > 0 \alpha_0>0 α 0 > 0 . Since ζ \zeta ζ is nondecreasing, the limit z + = lim α ↓ α 0 ζ ( α ) z^+=\lim_{\alpha\downarrow\alpha_0}\zeta(\alpha) z + = lim α ↓ α 0 ζ ( α ) exists and satisfies z + ≥ ζ ( α 0 ) z^+\ge\zeta(\alpha_0) z + ≥ ζ ( α 0 ) . It remains to show that z + ≤ ζ ( α 0 ) z^+\le\zeta(\alpha_0) z + ≤ ζ ( α 0 ) . To this end, we show that z + z^+ z + maximizes Φ α 0 \Phi_{\alpha_0} Φ α 0 . Fix y ∈ [ 0 , 1 ] y\in[0,1] y ∈ [ 0 , 1 ] . For every α > α 0 \alpha>\alpha_0 α > α 0 , since ζ ( α ) \zeta(\alpha) ζ ( α ) maximizes Φ α \Phi_\alpha Φ α ,
Φ α ( ζ ( α ) ) ≥ Φ α ( y ) . \Phi_\alpha(\zeta(\alpha))\ge\Phi_\alpha(y). Φ α ( ζ ( α )) ≥ Φ α ( y ) .
Let α ↓ α 0 \alpha\downarrow\alpha_0 α ↓ α 0 on both sides. On the right side, the point y y y is fixed, and Φ α ( y ) = e − α P ′ ( y ) − α H ( y ) \Phi_\alpha(y)=e^{-\alpha P'(y)}-\alpha H(y) Φ α ( y ) = e − α P ′ ( y ) − α H ( y ) is a continuous function of α \alpha α , so Φ α ( y ) → Φ α 0 ( y ) \Phi_\alpha(y)\to\Phi_{\alpha_0}(y) Φ α ( y ) → Φ α 0 ( y ) . On the left side, both the parameter α \alpha α and the point ζ ( α ) \zeta(\alpha) ζ ( α ) change, with ( α , ζ ( α ) ) → ( α 0 , z + ) (\alpha,\zeta(\alpha))\to(\alpha_0,z^+) ( α , ζ ( α )) → ( α 0 , z + ) . Since P ′ P' P ′ and H H H are polynomials, the function ( α , z ) ↦ e − α P ′ ( z ) − α H ( z ) (\alpha,z)\mapsto e^{-\alpha P'(z)}-\alpha H(z) ( α , z ) ↦ e − α P ′ ( z ) − α H ( z ) is continuous in both variables jointly, and therefore Φ α ( ζ ( α ) ) → Φ α 0 ( z + ) \Phi_\alpha(\zeta(\alpha))\to\Phi_{\alpha_0}(z^+) Φ α ( ζ ( α )) → Φ α 0 ( z + ) . Since the inequality holds for every α > α 0 \alpha>\alpha_0 α > α 0 , it is preserved in the limit, and Φ α 0 ( z + ) ≥ Φ α 0 ( y ) \Phi_{\alpha_0}(z^+)\ge\Phi_{\alpha_0}(y) Φ α 0 ( z + ) ≥ Φ α 0 ( y ) . Since y ∈ [ 0 , 1 ] y\in[0,1] y ∈ [ 0 , 1 ] is arbitrary, z + z^+ z + maximizes Φ α 0 \Phi_{\alpha_0} Φ α 0 . Every maximizer of Φ α 0 \Phi_{\alpha_0} Φ α 0 is at most its largest maximizer ζ ( α 0 ) \zeta(\alpha_0) ζ ( α 0 ) , so z + ≤ ζ ( α 0 ) z^+\le\zeta(\alpha_0) z + ≤ ζ ( α 0 ) . Together with z + ≥ ζ ( α 0 ) z^+\ge\zeta(\alpha_0) z + ≥ ζ ( α 0 ) , this gives lim α ↓ α 0 ζ ( α ) = ζ ( α 0 ) \lim_{\alpha\downarrow\alpha_0}\zeta(\alpha)=\zeta(\alpha_0) lim α ↓ α 0 ζ ( α ) = ζ ( α 0 ) .
We now show that ζ ( α ) → 0 \zeta(\alpha)\to0 ζ ( α ) → 0 as α ↓ 0 \alpha\downarrow0 α ↓ 0 . For x ≥ 0 x\ge0 x ≥ 0 , we have 1 − x ≤ e − x ≤ 1 − x + x 2 / 2 1-x\le e^{-x}\le1-x+x^2/2 1 − x ≤ e − x ≤ 1 − x + x 2 /2 . Applying this with x = α P ′ ( z ) ∈ [ 0 , α P ′ ( 1 ) ] x=\alpha P'(z)\in[0,\alpha P'(1)] x = α P ′ ( z ) ∈ [ 0 , α P ′ ( 1 )] gives
e − α P ′ ( z ) = 1 − α P ′ ( z ) + r α ( z ) e^{-\alpha P'(z)}=1-\alpha P'(z)+r_\alpha(z) e − α P ′ ( z ) = 1 − α P ′ ( z ) + r α ( z )
with
0 ≤ r α ( z ) ≤ α 2 ( P ′ ( z ) ) 2 2 ≤ α 2 ( P ′ ( 1 ) ) 2 2 0\le r_\alpha(z)\le\frac{\alpha^2(P'(z))^2}{2}\le\frac{\alpha^2(P'(1))^2}{2} 0 ≤ r α ( z ) ≤ 2 α 2 ( P ′ ( z ) ) 2 ≤ 2 α 2 ( P ′ ( 1 ) ) 2
for all z ∈ [ 0 , 1 ] z\in[0,1] z ∈ [ 0 , 1 ] . Since P ′ ( z ) + H ( z ) = 1 − P ( z ) + z P ′ ( z ) P'(z)+H(z)=1-P(z)+zP'(z) P ′ ( z ) + H ( z ) = 1 − P ( z ) + z P ′ ( z ) , it follows that
Φ α ( z ) = 1 − α g ( z ) + r α ( z ) , \Phi_\alpha(z)=1-\alpha g(z)+r_\alpha(z), Φ α ( z ) = 1 − α g ( z ) + r α ( z ) ,
with
g ( z ) = 1 − P ( z ) + z P ′ ( z ) . g(z)=1-P(z)+zP'(z). g ( z ) = 1 − P ( z ) + z P ′ ( z ) .
The function g g g is strictly increasing on [ 0 , 1 ] [0,1] [ 0 , 1 ] , since g ′ ( z ) = z P ′ ′ ( z ) > 0 g'(z)=zP''(z)>0 g ′ ( z ) = z P ′′ ( z ) > 0 for 0 < z ≤ 1 0<z\le1 0 < z ≤ 1 . Now fix ϵ ∈ ( 0 , 1 ) \epsilon\in(0,1) ϵ ∈ ( 0 , 1 ) , and let z ≥ ϵ z\ge\epsilon z ≥ ϵ . Then
Φ α ( z ) − Φ α ( 0 ) = − α ( g ( z ) − g ( 0 ) ) + r α ( z ) − r α ( 0 ) ≤ − α ( g ( ϵ ) − g ( 0 ) ) + α 2 ( P ′ ( 1 ) ) 2 2 , \begin{aligned}
\Phi_\alpha(z)-\Phi_\alpha(0)=-\alpha(g(z)-g(0))+r_\alpha(z)-r_\alpha(0) \\
&\le-\alpha(g(\epsilon)-g(0))+\frac{\alpha^2(P'(1))^2}{2},
\end{aligned} Φ α ( z ) − Φ α ( 0 ) = − α ( g ( z ) − g ( 0 )) + r α ( z ) − r α ( 0 ) ≤ − α ( g ( ϵ ) − g ( 0 )) + 2 α 2 ( P ′ ( 1 ) ) 2 ,
where the inequality uses g ( z ) ≥ g ( ϵ ) g(z)\ge g(\epsilon) g ( z ) ≥ g ( ϵ ) , together with r α ( z ) ≤ α 2 ( P ′ ( 1 ) ) 2 / 2 r_\alpha(z)\le\alpha^2(P'(1))^2/2 r α ( z ) ≤ α 2 ( P ′ ( 1 ) ) 2 /2 and r α ( 0 ) ≥ 0 r_\alpha(0)\ge0 r α ( 0 ) ≥ 0 . Since g ( ϵ ) > g ( 0 ) g(\epsilon)>g(0) g ( ϵ ) > g ( 0 ) , the right side is negative whenever
0 < α < 2 ( g ( ϵ ) − g ( 0 ) ) ( P ′ ( 1 ) ) 2 . 0<\alpha<\frac{2(g(\epsilon)-g(0))}{(P'(1))^2}. 0 < α < ( P ′ ( 1 ) ) 2 2 ( g ( ϵ ) − g ( 0 )) .
For such α \alpha α , every z ≥ ϵ z\ge\epsilon z ≥ ϵ satisfies Φ α ( z ) < Φ α ( 0 ) \Phi_\alpha(z)<\Phi_\alpha(0) Φ α ( z ) < Φ α ( 0 ) , so no z ≥ ϵ z\ge\epsilon z ≥ ϵ maximizes Φ α \Phi_\alpha Φ α , that is, ζ ( α ) < ϵ \zeta(\alpha)<\epsilon ζ ( α ) < ϵ . Since ϵ \epsilon ϵ is arbitrary, ζ ( α ) → 0 \zeta(\alpha)\to0 ζ ( α ) → 0 as α ↓ 0 \alpha\downarrow0 α ↓ 0 .
Finally, we show that ζ ( α ) → 1 \zeta(\alpha)\to1 ζ ( α ) → 1 as α → ∞ \alpha\to\infty α → ∞ . For every z ∈ [ 0 , 1 ] z\in[0,1] z ∈ [ 0 , 1 ] ,
Φ α ( z ) α = e − α P ′ ( z ) α − H ( z ) , \frac{\Phi_\alpha(z)}{\alpha}=\frac{e^{-\alpha P'(z)}}{\alpha}-H(z), α Φ α ( z ) = α e − α P ′ ( z ) − H ( z ) ,
where
0 < e − α P ′ ( z ) α ≤ 1 α , 0<\frac{e^{-\alpha P'(z)}}{\alpha}\le\frac{1}{\alpha}, 0 < α e − α P ′ ( z ) ≤ α 1 ,
since P ′ ( z ) ≥ 0 P'(z)\ge0 P ′ ( z ) ≥ 0 . Since H ′ ( z ) = − ( 1 − z ) P ′ ′ ( z ) < 0 H'(z)=-(1-z)P''(z)<0 H ′ ( z ) = − ( 1 − z ) P ′′ ( z ) < 0 for 0 < z < 1 0<z<1 0 < z < 1 , the function H H H is strictly decreasing on [ 0 , 1 ] [0,1] [ 0 , 1 ] , and H ( 1 ) = 1 − P ( 1 ) = 0 H(1)=1-P(1)=0 H ( 1 ) = 1 − P ( 1 ) = 0 . Now fix ϵ ∈ ( 0 , 1 ) \epsilon\in(0,1) ϵ ∈ ( 0 , 1 ) , and let z ≤ 1 − ϵ z\le1-\epsilon z ≤ 1 − ϵ . Then H ( z ) ≥ H ( 1 − ϵ ) H(z)\ge H(1-\epsilon) H ( z ) ≥ H ( 1 − ϵ ) , and therefore
Φ α ( z ) α − Φ α ( 1 ) α = e − α P ′ ( z ) α − H ( z ) − e − α P ′ ( 1 ) α + H ( 1 ) < 1 α − H ( 1 − ϵ ) , \begin{aligned}
\frac{\Phi_\alpha(z)}{\alpha}-\frac{\Phi_\alpha(1)}{\alpha}
=\frac{e^{-\alpha P'(z)}}{\alpha}-H(z)-\frac{e^{-\alpha P'(1)}}{\alpha}+H(1) \\
&<\frac{1}{\alpha}-H(1-\epsilon),
\end{aligned} α Φ α ( z ) − α Φ α ( 1 ) = α e − α P ′ ( z ) − H ( z ) − α e − α P ′ ( 1 ) + H ( 1 ) < α 1 − H ( 1 − ϵ ) ,
where the inequality uses e − α P ′ ( 1 ) / α > 0 e^{-\alpha P'(1)}/\alpha>0 e − α P ′ ( 1 ) / α > 0 , and H ( 1 ) = 0 H(1)=0 H ( 1 ) = 0 . Since H ( 1 − ϵ ) > H ( 1 ) = 0 H(1-\epsilon)>H(1)=0 H ( 1 − ϵ ) > H ( 1 ) = 0 , the right side is at most zero whenever α ≥ 1 / H ( 1 − ϵ ) \alpha\ge1/H(1-\epsilon) α ≥ 1/ H ( 1 − ϵ ) . For such α \alpha α , every z ≤ 1 − ϵ z\le1-\epsilon z ≤ 1 − ϵ satisfies Φ α ( z ) < Φ α ( 1 ) \Phi_\alpha(z)<\Phi_\alpha(1) Φ α ( z ) < Φ α ( 1 ) , so no z ≤ 1 − ϵ z\le1-\epsilon z ≤ 1 − ϵ maximizes Φ α \Phi_\alpha Φ α , that is, ζ ( α ) > 1 − ϵ \zeta(\alpha)>1-\epsilon ζ ( α ) > 1 − ϵ . Since ϵ \epsilon ϵ is arbitrary, ζ ( α ) → 1 \zeta(\alpha)\to1 ζ ( α ) → 1 as α → ∞ \alpha\to\infty α → ∞ . □ \square □
Proof of Lemma 10. To prove (15), we split the levels z ∈ ( 0 , 1 ) z \in(0,1) z ∈ ( 0 , 1 ) into two kinds, according to how ζ \zeta ζ reaches them. Since ζ \zeta ζ is nondecreasing, it has at most countably many discontinuity points. At a discontinuity point α 0 \alpha_0 α 0 , let z − = lim α ↑ α 0 ζ ( α ) z^- = \lim_{\alpha\uparrow\alpha_0} \zeta(\alpha) z − = lim α ↑ α 0 ζ ( α ) , which exists since ζ \zeta ζ is nondecreasing, and z + = ζ ( α 0 ) z^+ = \zeta(\alpha_0) z + = ζ ( α 0 ) , so that z − < z + z^- < z^+ z − < z + by right-continuity. We call ( z − , z + ) (z^-,z^+) ( z − , z + ) a jump interval (note that distinct jump intervals are disjoint since ζ \zeta ζ is nondecreasing). Let C C C be the set of levels z ∈ ( 0 , 1 ) z \in(0,1) z ∈ ( 0 , 1 ) that ζ \zeta ζ attains. For z ∈ C z \in C z ∈ C , we have ζ ( σ ( z ) ) = z \zeta(\sigma(z)) = z ζ ( σ ( z )) = z . Indeed, if z = ζ ( α 1 ) z = \zeta(\alpha_1) z = ζ ( α 1 ) for some α 1 > 0 \alpha_1 > 0 α 1 > 0 , then σ ( z ) ≤ α 1 \sigma(z) \le\alpha_1 σ ( z ) ≤ α 1 by the definition of σ ( z ) \sigma(z) σ ( z ) , so ζ ( σ ( z ) ) ≤ ζ ( α 1 ) = z \zeta(\sigma(z)) \le\zeta(\alpha_1) = z ζ ( σ ( z )) ≤ ζ ( α 1 ) = z since ζ \zeta ζ is nondecreasing, while ζ ( σ ( z ) ) ≥ z \zeta(\sigma(z)) \ge z ζ ( σ ( z )) ≥ z by right-continuity. Every z ∈ ( 0 , 1 ) ∖ C z \in(0,1) \setminus C z ∈ ( 0 , 1 ) ∖ C lies in a jump interval or is the left endpoint of one. To see this, note that ζ ( σ ( z ) ) ≥ z \zeta(\sigma(z)) \ge z ζ ( σ ( z )) ≥ z as shown above, and ζ ( σ ( z ) ) ≠ z \zeta(\sigma(z)) \ne z ζ ( σ ( z )) = z since z z z is not attained, so ζ ( σ ( z ) ) > z \zeta(\sigma(z)) > z ζ ( σ ( z )) > z . On the other hand, ζ ( α ) < z \zeta(\alpha) < z ζ ( α ) < z for all α < σ ( z ) \alpha< \sigma(z) α < σ ( z ) , so lim α ↑ σ ( z ) ζ ( α ) ≤ z \lim_{\alpha\uparrow\sigma(z)} \zeta(\alpha) \le z lim α ↑ σ ( z ) ζ ( α ) ≤ z . Hence, σ ( z ) \sigma(z) σ ( z ) is a discontinuity point, and z z z lies in [ z − , z + ) [z^-,z^+) [ z − , z + ) for its jump interval ( z − , z + ) (z^-,z^+) ( z − , z + ) .
Since there are at most countably many discontinuity points, the set of endpoints of jump intervals is countable, so it has measure zero and does not affect the integrals over z z z below. Moreover, the levels in a jump interval are not attained by ζ \zeta ζ , so C C C is disjoint from all jump intervals. Hence, up to a set of measure zero, ( 0 , 1 ) (0,1) ( 0 , 1 ) is the disjoint union of C C C and the jump intervals.
Let z ∈ C z \in C z ∈ C . Since ζ ( α ) \zeta(\alpha) ζ ( α ) maximizes Φ α \Phi_\alpha Φ α for every α > 0 \alpha> 0 α > 0 , the level z = ζ ( σ ( z ) ) z = \zeta(\sigma(z)) z = ζ ( σ ( z )) maximizes Φ σ ( z ) \Phi_{\sigma(z)} Φ σ ( z ) , and since 0 < z < 1 0 < z < 1 0 < z < 1 , it is an interior maximizer. Applying the condition α P ′ ( z ) = − log ( 1 − z ) \alpha P'(z) = -\log(1-z) α P ′ ( z ) = − log ( 1 − z ) for interior maximizers with α = σ ( z ) > 0 \alpha= \sigma(z) > 0 α = σ ( z ) > 0 gives
σ ( z ) P ′ ( z ) = − log ( 1 − z ) . (25) \sigma(z)P'(z) = -\log(1-z). \tag*{(25)} σ ( z ) P ′ ( z ) = − log ( 1 − z ) . (25)
Now consider a jump interval ( z − , z + ) (z^-,z^+) ( z − , z + ) at a discontinuity point α 0 \alpha_0 α 0 . We first show that σ ( z ) = α 0 \sigma(z) = \alpha_0 σ ( z ) = α 0 for every z ∈ ( z − , z + ) z \in(z^-,z^+) z ∈ ( z − , z + ) . For α < α 0 \alpha< \alpha_0 α < α 0 , monotonicity gives ζ ( α ) ≤ z − < z \zeta(\alpha) \le z^- < z ζ ( α ) ≤ z − < z , while ζ ( α 0 ) = z + > z \zeta(\alpha_0) = z^+ > z ζ ( α 0 ) = z + > z . Hence, α 0 \alpha_0 α 0 is the smallest α \alpha α with ζ ( α ) ≥ z \zeta(\alpha) \ge z ζ ( α ) ≥ z , that is, σ ( z ) = α 0 \sigma(z) = \alpha_0 σ ( z ) = α 0 .
Next, we show that both endpoints maximize Φ α 0 \Phi_{\alpha_0} Φ α 0 . By definition, z + = ζ ( α 0 ) z^+ = \zeta(\alpha_0) z + = ζ ( α 0 ) maximizes Φ α 0 \Phi_{\alpha_0} Φ α 0 . For z − z^- z − , fix y ∈ [ 0 , 1 ] y \in[0,1] y ∈ [ 0 , 1 ] . For every α < α 0 \alpha< \alpha_0 α < α 0 , we have Φ α ( ζ ( α ) ) ≥ Φ α ( y ) \Phi_\alpha(\zeta(\alpha)) \ge\Phi_\alpha(y) Φ α ( ζ ( α )) ≥ Φ α ( y ) since ζ ( α ) \zeta(\alpha) ζ ( α ) maximizes Φ α \Phi_\alpha Φ α . Letting α ↑ α 0 \alpha\uparrow\alpha_0 α ↑ α 0 and using the joint continuity of Φ α ( z ) \Phi_\alpha(z) Φ α ( z ) in ( α , z ) (\alpha,z) ( α , z ) , as in the proof of Lemma 9, gives Φ α 0 ( z − ) ≥ Φ α 0 ( y ) \Phi_{\alpha_0}(z^-) \ge\Phi_{\alpha_0}(y) Φ α 0 ( z − ) ≥ Φ α 0 ( y ) . Since every maximizer z z z of Φ α 0 \Phi_{\alpha_0} Φ α 0 satisfies z < 1 z < 1 z < 1 and 1 − z = e − α 0 P ′ ( z ) 1-z = e^{-\alpha_0P'(z)} 1 − z = e − α 0 P ′ ( z ) , both endpoints satisfy
α 0 P ′ ( z ) = − log ( 1 − z ) , z ∈ { z − , z + } . (26) \alpha_0P'(z) = -\log(1-z), \qquad z \in\{z^-,z^+\}. \tag*{(26)} α 0 P ′ ( z ) = − log ( 1 − z ) , z ∈ { z − , z + } . (26)
Finally, we compare the values of Φ α 0 \Phi_{\alpha_0} Φ α 0 at the two endpoints. For z ∈ [ 0 , 1 ) z \in[0,1) z ∈ [ 0 , 1 ) , let
Ψ ( z ) = z + ( 1 − z ) log ( 1 − z ) − α 0 P ( z ) . \Psi(z) = z + (1-z)\log(1-z) - \alpha_0P(z). Ψ ( z ) = z + ( 1 − z ) log ( 1 − z ) − α 0 P ( z ) .
At each z ∈ { z − , z + } z \in\{z^-,z^+\} z ∈ { z − , z + } , substituting e − α 0 P ′ ( z ) = 1 − z e^{-\alpha_0P'(z)} = 1-z e − α 0 P ′ ( z ) = 1 − z and α 0 P ′ ( z ) = − log ( 1 − z ) \alpha_0P'(z) = -\log(1-z) α 0 P ′ ( z ) = − log ( 1 − z ) into the definition of Φ α 0 \Phi_{\alpha_0} Φ α 0 gives
Φ α 0 ( z ) = e − α 0 P ′ ( z ) − α 0 ( 1 − P ( z ) − ( 1 − z ) P ′ ( z ) ) = ( 1 − z ) − α 0 + α 0 P ( z ) − ( 1 − z ) log ( 1 − z ) = 1 − α 0 − Ψ ( z ) . \begin{aligned}
\Phi_{\alpha_0}(z) &= e^{-\alpha_0P'(z)}-\alpha_0\bigl(1-P(z)-(1-z)P'(z)\bigr)\\
&=(1-z)-\alpha_0+\alpha_0P(z)-(1-z)\log(1-z)\\
&=1-\alpha_0-\Psi(z).
\end{aligned} Φ α 0 ( z ) = e − α 0 P ′ ( z ) − α 0 ( 1 − P ( z ) − ( 1 − z ) P ′ ( z ) ) = ( 1 − z ) − α 0 + α 0 P ( z ) − ( 1 − z ) log ( 1 − z ) = 1 − α 0 − Ψ ( z ) .
Since both endpoints maximize Φ α 0 \Phi_{\alpha_0} Φ α 0 , we have Φ α 0 ( z − ) = Φ α 0 ( z + ) \Phi_{\alpha_0}(z^-) = \Phi_{\alpha_0}(z^+) Φ α 0 ( z − ) = Φ α 0 ( z + ) , and therefore Ψ ( z − ) = Ψ ( z + ) \Psi(z^-) = \Psi(z^+) Ψ ( z − ) = Ψ ( z + ) .
Moreover,
Ψ ′ ( z ) = − log ( 1 − z ) − α 0 P ′ ( z ) , \Psi'(z)=-\log(1-z)-\alpha_0P'(z), Ψ ′ ( z ) = − log ( 1 − z ) − α 0 P ′ ( z ) ,
and Ψ \Psi Ψ is continuously differentiable on [ z − , z + ] ⊂ [ 0 , 1 ) [z^-,z^+] \subset[0,1) [ z − , z + ] ⊂ [ 0 , 1 ) . Hence, by the fundamental theorem of calculus,
0 = Ψ ( z + ) − Ψ ( z − ) = ∫ z − z + Ψ ′ ( z ) d z , 0=\Psi(z^+)-\Psi(z^-)=\int_{z^-}^{z^+}\Psi'(z)\,dz, 0 = Ψ ( z + ) − Ψ ( z − ) = ∫ z − z + Ψ ′ ( z ) d z ,
that is,
∫ z − z + − log ( 1 − z ) d z = α 0 ∫ z − z + P ′ ( z ) d z . (27) \int_{z^-}^{z^+}-\log(1-z)\,dz=\alpha_0\int_{z^-}^{z^+}P'(z)\,dz. \tag*{(27)} ∫ z − z + − log ( 1 − z ) d z = α 0 ∫ z − z + P ′ ( z ) d z . (27)
We now combine (25) and (27). For z ∈ C z \in C z ∈ C , (25) gives − log ( 1 − z ) / σ ( z ) = P ′ ( z ) -\log(1-z)/\sigma(z)=P'(z) − log ( 1 − z ) / σ ( z ) = P ′ ( z ) . On a jump interval ( z − , z + ) (z^-,z^+) ( z − , z + ) at α 0 \alpha_0 α 0 , we have σ ( z ) = α 0 \sigma(z)=\alpha_0 σ ( z ) = α 0 , so dividing (27) by α 0 \alpha_0 α 0 gives ∫ z − z + − log ( 1 − z ) / σ ( z ) d z = ∫ z − z + P ′ ( z ) d z \int_{z^-}^{z^+}-\log(1-z)/\sigma(z)\,dz=\int_{z^-}^{z^+}P'(z)\,dz ∫ z − z + − log ( 1 − z ) / σ ( z ) d z = ∫ z − z + P ′ ( z ) d z . Adding the contributions of C C C and of all jump intervals, which is justified since the integrands are nonnegative, and using P ( 0 ) = 0 P(0)=0 P ( 0 ) = 0 and P ( 1 ) = 1 P(1)=1 P ( 1 ) = 1 , we obtain
∫ 0 1 − log ( 1 − z ) σ ( z ) d z = ∫ 0 1 P ′ ( z ) d z = P ( 1 ) − P ( 0 ) = 1. \int_0^1\frac{-\log(1-z)}{\sigma(z)}\,dz=\int_0^1P'(z)\,dz=P(1)-P(0)=1. ∫ 0 1 σ ( z ) − log ( 1 − z ) d z = ∫ 0 1 P ′ ( z ) d z = P ( 1 ) − P ( 0 ) = 1.