alphaFeedback

WorksComputer Science

A π/4π/ 4 lower bound for random access in symmetric linear ensembles under optimal decoding

AI contributions
  • OpenAI ChatGPT
  • Anthropic Claude
View details

Abstract

We study the expected number of random linear observations required to recover a prescribed information symbol. For ensembles with uniformly random supports, independently sampled nonzero coefficients, and uniformly bounded column weights, we prove that the asymptotic normalized expected recovery time is at least π/4π/4 under optimal decoding. The result holds over finite or infinite fields and extends the lower bound previously established for binary fully symmetric codes under peeling decoding. For singleton - pair observations, we determine the exact limiting expectation and show that optimal and peeling decoding have the same limit, independently of the field and coefficient distribution. The minimum within this family is approximately 0.7939334450.793933445, which explicit constructions attain asymptotically over every fixed finite field.

Introduction

The random-access problem in DNA-based storage asks how coding can reduce the number of random reads needed to recover a prescribed information symbol [1]. In the noiseless uniform model, kk information symbols are encoded into nn symbols, which are sampled independently and uniformly with replacement. The objective is to minimize the expected number of samples needed for recovery, typically taking the maximum over the requested information symbols.

Related work considers several retrieval goals, including reconstructing the entire message [2], [3], recovering requested files [4] or sets of information symbols [5], characterizing tradeoffs between individual file retrieval times [6], [7], and recovering a fraction of the message using LT codes [8]. Other studies address errors and nonuniform sampling [9]–[11], repair of failed storage containers [12], and parallel sampling from multiple containers [13]. Further coverage models consider draws that reveal subsets or windows [14], and repeated observations of composite symbols or motif combinations [15]–[17].

Here, we focus on recovering a single information symbol under noiseless uniform sampling. For a linear encoding, the requested symbol xix_i is recoverable when the standard basis vector eie_i belongs to the span of the sampled generator-matrix columns. Uncoded storage requires kk samples in expectation, whereas suitable encodings achieve smaller expectations [1], [18]. Work on this problem includes combinatorial expressions for recovery expectations [18], geometric constructions [19], asymptotic and distributional analyses [20], and algorithms for evaluating expectations together with improved constructions and bounds [21]. Recent work also establishes identities relating coordinate recovery times in a code and its dual [22].

Particularly relevant are the constructions of Boruchovsky et al. [23], which combine repeated systematic columns with columns supported on pairs of information coordinates. Their analysis uses a graph whose edges represent these pair observations. Besides solving the dimension-two problem, they obtained an asymptotic normalized upper bound of π2/12≈0.8225\pi^2/12 \approx0.8225 using constructions over sufficiently large finite fields.

Hofmeister, Bitar, and Yaakobi [24] studied binary fully symmetric generator matrices, in which all columns of a given weight occur equally often. They connected sampling from these matrices to LT encoding and proved that, for bounded column weights, the asymptotic expected recovery time divided by kk is at least π/4\pi/4 under peeling decoding. Their optimized degree distributions achieve approximately 0.7869, while restricting the weights to one and two gives approximately 0.7939. An optimal decoder can exploit linear dependencies that peeling does not resolve, so this lower bound does not immediately apply under optimal decoding.

In this work, we prove that the lower bound of π/4\pi/4 holds under optimal decoding for ensembles with uniformly random supports and independently sampled nonzero coefficients over finite or infinite fields. The degree distribution may vary with kk, provided that the column weights have a common finite bound. The proof relates coordinate recovery to rank increments and combines the sparse random matrix rank formula of Coja-Oghlan et al. [25] with an integral inequality. For singleton–pair observations, we determine the exact limiting expectation and show that optimal and peeling decoding have the same limit. We also give explicit constructions over every fixed finite field attaining the optimized limit of approximately 0.793933445, and positive-rate block constructions that approximate it arbitrarily closely.

Notation and Problem Formulation

For a positive integer kk, let [k]={1,…,k}[k]=\{1,\ldots,k\}. Throughout, F\mathbb{F} is a field equipped with a σ\sigma-algebra that makes it a standard Borel space and with respect to which addition and multiplication are measurable, F∗=F∖{0}\mathbb{F}^{*}=\mathbb{F}\setminus\{0\}, ei∈Fke_i\in\mathbb{F}^{k} denotes the ii-th standard basis vector, and all logarithms are natural. The support of a vector v∈Fk\mathbf{v}\in\mathbb{F}^{k} is supp⁡(v)={i∈[k]:vi≠0}\operatorname{supp}(\mathbf{v})=\{i\in[k]:v_i\ne0\}, and its weight is ∣supp⁡(v)∣|\operatorname{supp}(\mathbf{v})|. For vectors v1,…,vn\mathbf{v}_1,\ldots,\mathbf{v}_n, we write ⟨v1,…,vn⟩\langle\mathbf{v}_1,\ldots,\mathbf{v}_n\rangle for their span, and for a matrix MM, ⟨M⟩\langle M\rangle denotes its column span.

The observations are generated by independent random columns v1,v2,…∈Fk\mathbf{v}_1,\mathbf{v}_2,\ldots\in\mathbb{F}^{k}. Their distribution is determined by a probability distribution PkP_k on [k][k], called the degree distribution, and a probability distribution μ\mu on F∗\mathbb{F}^{*}, called the coefficient distribution. To generate vj\mathbf{v}_j, a weight ww is drawn according to PkP_k, a support S⊆[k]S \subseteq[k] is chosen uniformly at random among all subsets of size ww, and the entries of vj\mathbf{v}_j indexed by SS are drawn independently according to μ\mu. All other entries are zero. For ∣F∣>2|\mathbb{F}|>2, the support alone does not determine the coefficients, as distinct columns of a fixed generator matrix may share a support.

For F=F2\mathbb{F}=\mathbb{F}_2, every nonzero entry equals 11, so vj\mathbf{v}_j is determined by its support. This case describes sampling from a fixed binary generator matrix. Following [24], a binary k×nk\times n matrix GG is called fully symmetric if, for every w∈[k]w\in[k], all vectors of weight ww appear as columns of GG equally often. As observed in [24], a uniformly sampled column of such a matrix has weight ww with probability equal to the fraction of columns of GG of weight ww, and, given its weight, it is uniform among all vectors of that weight. Hence, sampling the columns of GG uniformly with replacement is the case F=F2\mathbb{F}=\mathbb{F}_2 of our model, with PkP_k equal to the column-weight distribution of GG.

Let x∈Fk\mathbf{x}\in\mathbb{F}^k denote the information vector. The jj-th observation is xTvj\mathbf{x}^{\mathsf{T}}\mathbf{v}_j, so after nn observations the decoder knows xTMk(n)\mathbf{x}^{\mathsf{T}}M_k(n), where Mk(n)=[v1 ⋯ vn]M_k(n)=[\mathbf{v}_1\ \cdots\ \mathbf{v}_n] is the k×nk\times n matrix formed by the first nn columns, and ⟨Mk(0)⟩={0}\langle M_k(0)\rangle=\{\mathbf{0}\}. The symbol xix_i is determined by xTMk(n)\mathbf{x}^{\mathsf{T}}M_k(n) for every x∈Fk\mathbf{x}\in\mathbb{F}^k if and only if ei∈⟨Mk(n)⟩\mathbf{e}_i\in\langle M_k(n)\rangle. Indeed, if ei=Mk(n)⋅a\mathbf{e}_i=M_k(n)\cdot\mathbf{a}, then xi=xT⋅Mk(n)⋅ax_i=\mathbf{x}^{\mathsf{T}}\cdot M_k(n)\cdot\mathbf{a}. Otherwise, there exists z∈Fk\mathbf{z}\in\mathbb{F}^k with zi≠0z_i\ne0 and zT⋅Mk(n)=0\mathbf{z}^{\mathsf{T}}\cdot M_k(n)=\mathbf{0}. Then x\mathbf{x} and x+z\mathbf{x}+\mathbf{z} give the same observations, while (x+z)i=xi+zi≠xi(\mathbf{x}+\mathbf{z})_i=x_i+z_i\ne x_i. Accordingly, the recovery time of the ii-th information symbol is

τi=min⁡{n≥0:ei∈⟨Mk(n)⟩},(1)\tau_i=\min\{n\ge0:\mathbf{e}_i\in\langle M_k(n)\rangle\}, \tag*{(1)}

with min⁡∅=∞\min\varnothing=\infty. This is the number of observations required by an optimal decoder, without any restriction on the decoding procedure.

Since the distribution of each column is invariant under permutations of the coordinates, the distribution of τi\tau_i does not depend on ii. We study the normalized expected recovery time E[τi]/k\mathbb{E}[\tau_i]/k. For α≥0\alpha\ge0, let

Uk(α)=P{ei∉⟨Mk(⌊αk⌋)⟩}U_k(\alpha)=\mathbb{P}\{\mathbf{e}_i\notin\langle M_k(\lfloor\alpha k\rfloor)\rangle\}

be the probability that the ii-th symbol is not recovered after ⌊αk⌋\lfloor\alpha k\rfloor observations. Its dependence on PkP_k and μ\mu is suppressed from the notation. Since τi\tau_i is integer valued, P{τi>αk}=P{τi>⌊αk⌋}=Uk(α)\mathbb{P}\{\tau_i>\alpha k\}=\mathbb{P}\{\tau_i>\lfloor\alpha k\rfloor\}=U_k(\alpha), and therefore

E[τi]k=∫0∞P{τi>αk} dα=∫0∞Uk(α) dα.(2)\frac{\mathbb{E}[\tau_i]}{k}=\int_0^\infty\mathbb{P}\{\tau_i>\alpha k\}\,d\alpha=\int_0^\infty U_k(\alpha)\,d\alpha. \tag*{(2)}

Theorem 1. Let F\mathbb{F} be a field, let μ\mu be a probability distribution on F\mathbb{F}, and let WW be a positive integer. For every sequence (Pk)(P_k) of degree distributions such that every column has weight at most WW, that is, Pk(w)=0P_k(w)=0 for all w>Ww>W,

lim inf⁡k→∞E[τi]k≥π4.(3)\liminf_{k\to\infty}\frac{\mathbb{E}[\tau_i]}{k}\ge\frac{\pi}{4}. \tag*{(3)}

For F=F2\mathbb{F}=\mathbb{F}_2, Theorem 1 applies to every sequence of binary fully symmetric generator matrices whose columns have weight at most WW. Since an optimal decoder recovers xix_i no later than any other decoder, the theorem strengthens the bound of [24], which was proved for the peeling decoder.

The proof has two parts. In Section III, we bound Uk(α)U_k(\alpha) from below, as k→∞k\to\infty, by an explicit function obtained from the rank of a sparse random matrix. In Section IV, we show that the integral of this function is at least π/4\pi/4. Both parts are first carried out for a fixed degree distribution P=(p1,…,pW)P=(p_1,\ldots,p_W) on [W][W], which we identify with its probability generating polynomial P(z)P(z). The extension to sequences (Pk)(P_k) is given at the end of Section IV.

A Lower Bound on the Probability of Non-Recovery

Throughout this section and Section IV, except in the proof of Theorem 1, the degree distribution is fixed. That is, Pk=PP_k=P for all k≥Wk\ge W, where P=(p1,…,pW)P=(p_1,\ldots,p_W) is a probability distribution on [W][W]. We identify PP with its probability generating polynomial

P(z)=∑w=1Wpwzw,z∈[0,1],P(z)=\sum_{w=1}^{W}p_w z^w,\qquad z\in[0,1],

and denote its derivative by P′(z)=∑w=1Wwpwzw−1P'(z)=\sum_{w=1}^{W}wp_wz^{w-1}. Note that P(0)=0P(0)=0 and P′(1)=1P'(1)=1.

References

  1. [1]D. Bar-Lev, O. Sabary, R. Gabrys, and E. Yaakobi, “Cover your bases: How to minimize the sequencing coverage in DNA storage systems,” IEEE Trans. Inf. Theory, vol. 71, no. 1, pp. 192–218, 2025.
  2. [2]M. Bertuzzo, A. Ravagnani, and E. Yaakobi, “The DNA coverage depth problem: Duality, weight distributions, and applications,” arXiv:2603.06489, 2026.arxiv.org/abs/2603.06489
  3. [3]R. Gross, Y. Grunbaum, M. Bertuzzo, E. Yaakobi, and A. Ravagnani, “Optimal codes for the coverage depth problem and the performance of random codes,” arXiv:2610.07370, 2026.arxiv.org/abs/2610.07370
  4. [4]H. Abraham, R. Gabrys, and E. Yaakobi, “Covering all bases: The next inning in DNA sequencing efficiency,” in Proc. IEEE Int. Symp. Inf. Theory (ISIT), 2024, pp. 464–469.arxiv.org/abs/2401.17649
  5. [5]A. Gruica, A. Petrillo, and F. Zullo, “The generalized random access problem for linear codes,” arXiv:2608.20152, 2026.arxiv.org/abs/2608.20152
  6. [6]D. Bar-Lev, “Coded information retrieval for block-structured DNA-based data storage,” arXiv:2603.17154, 2026.
  7. [7]C. V. A. Vlachos and D. Bar-Lev, “A hyperbolic bound for file retrieval in DNA-based data storage,” arXiv:2609.36067, 2026.arxiv.org/abs/2609.36067
  8. [8]N. Akkaya and E. Haytaoğlu, “Dupleth: DNA depolama sistemlerinde LT kodları kullanıldığında kesik kapsama derinliği problemi,” Osmaniye Korkut Ata Üniversitesi Fen Bilimleri Enstitüsü Dergisi, vol. 9, no. 4, pp. 2301–2321, 2026.DOI
  9. [9]S. K. Hanna, “On the reliability of information retrieval from MDS coded data in DNA storage,” IEEE Trans. Mol. Biol. Multi-Scale Commun., 2026.
  10. [11]H. Abraham, I. Feldman, and E. Yaakobi, “Coverage depth analysis: Random access for DNA storage over noisy channels,” in Proc. IEEE Int. Symp. Inf. Theory (ISIT), 2026, pp. 1–6.DOI
  11. [12]A. Levy, R. Con, E. Yaakobi, and H. M. Riah, “Expected recovery time in DNA-based distributed storage systems,” arXiv:2602.07601, 2026.arxiv.org/abs/2602.07601
  12. [13]X. Kong, O. Elishco, C. Wang, and T. M. Duman, “The coverage depth problem in distributed DNA data storage,” arXiv:2610.02931, 2026.arxiv.org/abs/2610.02931
  13. [14]Y. Grunbaum and E. Yaakobi, “General coverage models: Structure, monotonicity, and shotgun sequencing,” in Proc. IEEE Int. Symp. Inf. Theory (ISIT), 2026, pp. 1–6.arxiv.org/abs/2510.25305
  14. [15]I. Preuss, B. Galili, Z. Yakhini, and L. Anavy, “Sequencing coverage analysis for combinatorial DNA-based storage systems,” IEEE Trans. Mol. Biol. Multi-Scale Commun., vol. 10, no. 2, pp. 297–316, 2024.DOI
  15. [17]R. Sokolovskii, P. Agarwal, L. A. Croquevielle, Z. Zhou, and T. Heinis, “Coding over coupon collector channels for combinatorial motif-based DNA storage,” IEEE Trans. Commun., vol. 73, no. 6, pp. 3750–3760, 2025.DOI
  16. [18]A. Gruica, D. Bar-Lev, A. Ravagnani, and E. Yaakobi, “A combinatorial perspective on random access efficiency for DNA storage,” IEEE Trans. Inf. Theory, vol. 71, no. 12, pp. 9395–9412, 2025.
  17. [19]A. Gruica, M. Montanucci, and F. Zullo, “The geometry of codes for random access in DNA storage,” Des. Codes Cryptogr., vol. 94, no. 5, Art. no. 114, 2026.arxiv.org/abs/2411.08924
  18. [20]Ş. Bodur, S. Lia, H. H. López, R. Ludhani, A. Ravagnani, and L. Seccia, “The random variables of the DNA coverage depth problem,” IEEE Trans. Inf. Theory, 2026, doi: 10.1109/TIT.2026.3711141.DOI
  19. [21]C. Wang and E. Yaakobi, “Random access in DNA storage: Algorithms, constructions, and bounds,” arXiv:2601.07053, 2026.arxiv.org/abs/2601.07053
  20. [22]D. Bar-Lev, H. H. López, G. L. Matthews, and F. Salizzoni, “A matroidal framework for random access in linear codes,” arXiv:2610.28820, 2026.
  21. [23]A. Borouchovsky, O. Elishco, R. Gabrys, A. Gruica, I. Tamo, and E. Yaakobi, “Making it to first: The random access problem in DNA storage,” arXiv:2501.12274, 2025.
  22. [24]C. Hofmeister, R. Bitar, and E. Yaakobi, “Random access expectation in DNA storage and fountain codes,” arXiv:2605.10919v2, 2026.arxiv.org/abs/2605.10919
  23. [25]A. Coja-Oghlan, A. A. Ergür, P. Gao, S. Hetterich, and M. Rolvien, “The rank of sparse random matrices,” Random Struct. Algorithms, vol. 62, no. 1, pp. 68–130, 2023.

Paper details

vlnc:W_9993f76k
v1 · latestHistory (1)

published · Fresh — added to the Hub within the last 30 days

added ·

Usage

views · 0

downloads · 0

A view counts once per browser per day, a download each time the PDF is requested.

CC BY 4.0

Original source

  • Computer Science

OpenAI ChatGPT, Anthropic Claude · View statement →

Looking for related papers…
Contents