alphaFeedback

WorksComputer Science

Bourgain's Theorem for a Union of Euclidean Metric Spaces

AI contributions
Not recorded for this paper
View details

Abstract

We study the distortion of embedding a union of kk Euclidean sets into Euclidean space. We show that a union of kk Euclidean sets can be embedded with distortion at most O(k1.128log⁡k)O(k^{1.128} \log k), independent of the number of points. This is an exponential improvement over the previous best known upper bound of 2O(k)2^{O(k)} obtained by iterating the result of Makarychev and Makarychev (2016) for the special case k=2k = 2. Surprisingly, with the additional assumption that each Euclidean set remains Euclidean when we adjoin any other two points, we can obtain an asymptotically tight distortion of O(log⁡k)O(\log k), thus, providing a generalization of Bourgain's Theorem (1985). Along the way, we also show that the distortion of the union can be upper bounded by O(log⁡k)O(\log k) times the maximum of the Lipschitz extension constants of individual Euclidean sets.

Introduction

We consider the problem of embedding a union of Euclidean metric spaces into Euclidean space with low distortion. Formally, let (X,d)(X,d) be a metric space, such that XX is a union of kk sets U1,…,UkU_1,\ldots,U_k and each UiU_i can be embedded isometrically into Euclidean space. Our goal is to find the smallest distortion DkD_k, such that the union U1∪⋯∪UkU_1\cup\cdots\cup U_k embeds into ℓ2\ell_2 with distortion DkD_k. When every UiU_i is a single point this is exactly the setting of Bourgain’s Theorem [4], which states that every nn-point metric space can be embedded into Euclidean space with distortion O(log⁡n)O(\log n). More generally, our question belongs to the study of local-global properties of metric embeddings initiated by Arora, Lovasz, Newman, Rabani, Rabinovich, and Vempala [1] (see also [6]), and asks whether the distortion of XX is governed only by kk.

The special case k=2k=2 was asked by Assaf Naor and settled by Makarychev and Makarychev [21], who showed that a union of two Euclidean sets embeds into ℓ2\ell_2 with distortion at most 8.93. They then posed the problem for general kk as an open question [21 Question 6]. On one hand, iterating their result gives an upper bound of Dk≤2O(k)D_k\le2^{O(k)}. On the other hand, when each UiU_i is a single point we have the classical lower bound of Dk=Ω(log⁡k)D_k=\Omega(\log k) for Bourgain’s Theorem [19, 2].

In this work, we show that a union of kk Euclidean sets can be embedded into Euclidean space with distortion Dk=O(k1.128log⁡k)D_k=O(k^{1.128}\log k), an exponential improvement over the previous bound, with no dependence on the number of points in XX or any UiU_i. Given the additional property that every UiU_i stays Euclidean after adjoining any other two points from XX, we can further establish that the distortion of embedding XX is O(log⁡k)O(\log k), thus, matching the lower bound. Finally, if each UiU_i remains Euclidean after adjoining any one other point from XX, then we can obtain distortion of O(k0.895log⁡k)O(k^{0.895}\log k).

Our approach contains two reductions that may be of independent interest. First, the distortion of a union of Euclidean sets is determined, up to an O(log⁡k)O(\log k) factor, by how well Lipschitz maps on the individual sets extend to the whole space. Second, bounding these Lipschitz extension constants is equivalent to constructing good Euclidean metric sparsifiers.

Model and Main Results

Distortion. We say that a metric space (X,d)(X,d) embeds in ℓ2\ell_2 with distortion DD if there is a function f:X→ℓ2f:X\to\ell_2, such that for every x,y∈Xx,y\in X:

d(x,y)≤∥f(x)−f(y)∥2≤D⋅d(x,y).(1)d(x,y) \le\lVert f(x)-f(y)\rVert_2 \le D\cdot d(x,y). \tag*{(1)}

Then, the distortion c2(X)c_2(X) of (X,d)(X,d) is the smallest such scalar DD.

Euclidean Classes. In a metric space (X,d)(X,d), a subset V⊆XV\subseteq X is Euclidean in XX if it embeds isometrically into ℓ2\ell_2. Moreover, we say a subset V⊆XV\subseteq X is hh-strongly Euclidean in XX if, for every hh-element subset S⊆XS\subseteq X, the set V∪SV\cup S embeds isometrically into ℓ2\ell_2. That is, an hh-strongly Euclidean set is a Euclidean set that remains Euclidean if we add hh arbitrarily chosen points.

The parameter hh interpolates between the condition that each UiU_i is Euclidean (h=0h=0) and that XX is Euclidean itself (h=∣X∣h=|X|). In the spirit of local-to-global phenomena [1, 6], one can ask how large hh has to be before the distortion of XX becomes the optimal Θ(log⁡k)\Theta(\log k). Our first main result shows that h=2h=2 is already sufficient.

Theorem 1.1. Let (X,d)(X,d) be a metric space, such that X=U1∪⋯∪UkX=U_1\cup\cdots\cup U_k and each UiU_i is 2-strongly Euclidean in XX. Then XX embeds into ℓ2\ell_2 with distortion O(log⁡k)O(\log k).

Observe that when each UiU_i consists of a single point, Theorem 1.1 recovers Bourgain’s Theorem [4]. Because an hh-strongly Euclidean set is 2-strongly Euclidean for every h≥2h\ge2, the same bound holds for unions of hh-strongly Euclidean sets with h≥3h\ge3. Therefore, what remains are, indeed, only unions of Euclidean sets and unions of 1-strongly Euclidean sets. In the sections that follow we first develop the proof of Theorem 1.1, and later adapt what is useful to the Euclidean and 1-strongly Euclidean settings.

In the general case of a union of kk Euclidean sets we obtain the following subquadratic upper bound on the distortion.

Theorem 1.2. Let (X,d)(X,d) be a metric space, such that X=U1∪⋯∪UkX=U_1\cup\cdots\cup U_k and each UiU_i is Euclidean in XX. Then XX embeds into ℓ2\ell_2 with distortion O(k1.128log⁡k)O(k^{1.128}\log k). Moreover, for the special case k=2k=2 we get an improved upper bound of c2(X)<3.997c_2(X)<3.997.

For the case of 1-strongly Euclidean sets, we get the following sublinear distortion.

Theorem 1.3. Let (X,d)(X,d) be a metric space, such that X=U1∪⋯∪UkX=U_1\cup\cdots\cup U_k and each UiU_i is 1-strongly Euclidean in XX. Then XX embeds into ℓ2\ell_2 with distortion O(k0.895log⁡k)O(k^{0.895}\log k).

Technical Overview

Union of 2-strongly Euclidean sets. In § 2, we prove Theorem 1.1 in two steps:

  1. For each UiU_i we construct a DD-terminal embedding, a 1-Lipschitz map φi:X→ℓ2\varphi_i:X\to\ell_2 that contracts distances between UiU_i and every point of XX by at most a factor of DD. This is where we use the 2-strongly Euclidean property of the sets UiU_i.

  1. We combine the kk terminal embeddings into a single embedding for XX. In the combined embedding, each point uses only the terminal embedding of the set closest to it, and we sample subcollections of the sets as in the algorithmic proof of Bourgain’s Theorem [19].

Overall, this yields an embedding of XX into ℓ2\ell_2 with distortion O(log⁡k)O(\log k). We note that our notion of terminal embedding is slightly different from the one considered by [8] because they do not require the maps to be Lipschitz on the whole space, as we do here.

From distortion to Lipschitz extension constants. Only the first step above depends on the sets being 2-strongly Euclidean, while combining terminal embeddings works for any union of Euclidean sets as long as each set admits a terminal embedding. In § 3, we show that any LL-Lipschitz map X→ℓ2X\to\ell_2 that does not contract distances on UiU_i can be augmented into an O(L)O(L)-terminal embedding for UiU_i (Lemma 3.1). So now the question becomes how well an isometry of UiU_i extends to a Lipschitz map on all of XX. This is captured by the Lipschitz extension constant e(Ui)e(U_i), the least Λ≥1\Lambda\ge1 such that every Lipschitz map f:(Ui,d)→ℓ2f:(U_i,d)\to\ell_2 extends to a Lipschitz map F:(X,d)→ℓ2F:(X,d)\to\ell_2 with Lip⁡(F)≤ΛLip⁡(f)\operatorname{Lip}(F)\le\Lambda\operatorname{Lip}(f). Indeed, since UiU_i is Euclidean, by Kirszbraun’s Theorem [14] it suffices to extend an isometry of UiU_i in order to bound e(Ui)e(U_i). The formal result connecting distortion to Lipschitz extension constants is the following.

Theorem 1.4. Let X=U1∪⋯∪UkX=U_1\cup\cdots\cup U_k with each UiU_i Euclidean in XX, and let emax⁡=max⁡ie(Ui)e_{\max}=\max_i e(U_i). Then

emax⁡≤c2(X)≤O(emax⁡log⁡(k+1)).e_{\max}\le c_2(X)\le O(e_{\max}\log(k+1)).

For instance, for a union of 2-strongly Euclidean sets, we can interpret the analysis of Theorem 1.1 as showing that emax⁡=Θ(1)e_{\max}=\Theta(1).

Lipschitz extension constants for Euclidean and 1-strongly Euclidean sets. In § 4, we bound the Lipschitz extension constants using metric sparsifiers [20]. Given a weighted graph GG on XX and a set of terminals A⊆XA\subseteq X, a metric sparsifier of GG is a weighted graph HH on AA alone, such that for every metric ρ\rho on AA the cost of HH on ρ\rho approximates, up to a factor QQ called the quality, the least cost of GG over all extensions of ρ\rho to XX. We take A=UiA=U_i and measure cost by the quadratic energy EG(d2)=∑x<ygxyd(x,y)2E_G(d^2)=\sum_{x<y}g_{xy}d(x,y)^2, while only allowing extensions that are Euclidean on every UjU_j. In § 4.1, we show that in this setting the best sparsifier quality for every GG is exactly the square of the Lipschitz extension constant, where both quantities are taken uniformly over all metrics on XX that are Euclidean on every UjU_j (Theorem 4.2). Bounding emax⁡e_{\max} thus reduces to constructing a good metric sparsifier.

The following upper bounds, combined with Theorem 1.4, give Theorems 1.2 and 1.3 for finite XX. We take care of the finiteness assumption in Section C.

Lemma 1.5. Let (X,d)(X,d) be a finite metric space, such that X=U1∪⋯∪UkX=U_1\cup\cdots\cup U_k. If each UiU_i is Euclidean in XX, then emax⁡=O(k1.128)e_{\max}=O(k^{1.128}). If each UiU_i is 1-strongly Euclidean in XX, then emax⁡=O(k0.895)e_{\max}=O(k^{0.895}).

In the construction for Lemma 1.5 we bound the quality of the canonical sparsifier for UiU_i by adding the other sets back one at a time. We show that adding one Euclidean set costs a constant factor in the Lipschitz constant, and averaging the extensions over the set added last decreases the factor at the step with rr sets down to 1+η/r1+\eta/r (Lemma 4.8). The product of these factors is O(kη)O(k^\eta), where the exponent η\eta is determined by the best trade-off between the growth on pairs of points inside the added set and on pairs crossing it, giving η0=1.1275…<1.128\eta_0=1.1275\ldots<1.128 for Euclidean sets and η1=0.8941…<0.895\eta_1 = 0.8941\ldots< 0.895 for 1-strongly Euclidean sets (§ 4.5). We leave the improved upper bound for the case k=2k = 2 to Section B.

Lower bounds on Lipschitz extension constants. Theorem 1.4 bounds the distortion with the maximal Lipschitz extension constant emax⁡e_{\max} up to a factor of O(log⁡k)O(\log k). Meanwhile, the analysis of Theorem 1.1 shows that emax⁡e_{\max} is an absolute constant for unions of 2-strongly Euclidean sets. What happens for unions of Euclidean sets, or of 1-strongly Euclidean sets? We find that the extension constant can be Ω(log⁡k)\Omega(\sqrt{\log k}) for some unions of Euclidean sets, and Ω(log⁡k4)\Omega(\sqrt[4]{\log k}) for 1-strongly Euclidean. The lower bounds we obtain here do not improve on the general Ω(log⁡k)\Omega(\log k) lower bound for distortion. They do show, however, that the reduction to Lipschitz extensions cannot by itself give O(log⁡k)O(\log k) for unions of Euclidean sets.

References

  1. [1][ALN+12] Sanjeev Arora, László Lovász, Ilan Newman, Yuval Rabani, Yuri Rabinovich, and Santosh Vempala. Local versus global properties of metric spaces. SIAM Journal on Computing, 41(1):250–271, 2012. 1, 2
  2. [2][AR98] Yonatan Aumann and Yuval Rabani. An O(log k) approximate min-cut max-flow theorem and approximation algorithm. SIAM J. Comput., 27(1):291–301, 1998. 1, 4
  3. [3][BMMM21] Arturs Backurs, Sepideh Mahabadi, Konstantin Makarychev, and Yury Makarychev. Two-sided Kirszbraun theorem. In the Proceedings of SoCG, pages 13:1–13:14, 2021. 5DOI
  4. [4][Bou85] Jean Bourgain. On Lipschitz embedding of finite metric spaces in Hilbert space. Israel J. Math., 52(1–2):46–52, 1985. 1, 2, 4DOI
  5. [5][CKR01] Gruia Călinescu, Howard Karloff, and Yuval Rabani. Approximation algorithms for the 0-extension problem. In Proceedings of the Twelfth Annual ACM–SIAM Symposium on Discrete Algorithms, pages 8–16, 2001. 13
  6. [6][CMM10] Moses Charikar, Konstantin Makarychev, and Yury Makarychev. Local global tradeoffs in metric embeddings. SIAM Journal on Computing, 39(6):2487–2512, 2010. 1, 2
  7. [7][CN24] Yeshwanth Cherapanamjeri and Jelani Nelson. Terminal embeddings in sublinear time. TheoretiCS, 3:6:1–6:32, 2024. Preliminary version in FOCS 2021. 5
  8. [8][EFN17] Michael Elkin, Arnold Filtser, and Ofer Neiman. Terminal embeddings. Theoretical Computer Science, 697:1–36, 2017. 3, 4, 6arxiv.org/abs/1603.02321
  9. [9][ES63] Paul Erdős and Horst Sachs. Reguläre Graphen gegebener Teilweite mit minimaler Knotenzahl. Wiss. Z. Martin-Luther-Univ. Halle-Wittenberg Math.-Natur. Reihe, 12:251–257, 1963. 25
  10. [10][Fei00] Uriel Feige. Approximating the bandwidth via volume respecting embeddings. Journal of Computer and System Sciences, 60(3):510–539, 2000. 4DOI
  11. [11][HR14] Zhiyi Huang and Aaron Roth. Exploiting metric structure for efficient private query release. In Proceedings of the 2014 Annual ACM–SIAM Symposium on Discrete Algorithms (SODA), pages 523–534, 2014. 4
  12. [12][Ind01] Piotr Indyk. Algorithmic applications of low-distortion geometric embeddings. In Proceedings 42nd IEEE Symposium on Foundations of Computer Science, pages 10–33, 2001. 4DOI
  13. [13][Kar98] Alexander V. Karzanov. Minimum 0-extensions of graph metrics. European Journal of Combinatorics, 19(1):71–101, 1998. 13DOI
  14. [14][Kir34] Mojzesz Kirszbraun. Über die zusammenziehende und lipschitzsche transformationen. Fundamenta Mathematicae, 22:77–108, 1934. 3, 11, 12, 33DOI
  15. [15][KSW09] Jon Kleinberg, Aleksandrs Slivkins, and Tom Wexler. Triangulation and embedding using small sets of beacons. Journal of the ACM, 56(6):32:1–32:37, 2009. 4
  16. [16][KT02] Jon Kleinberg and Éva Tardos. Approximation algorithms for classification problems with pairwise relationships: Metric labeling and Markov random fields. Journal of the ACM, 49(5):616–639, 2002. 13
  17. [17][Lin64] Joram Lindenstrauss. On nonlinear projections in Banach spaces. Michigan Mathematical Journal, 11(3):263–287, 1964. 4, 23DOI
  18. [18][Lin02] Nathan Linial. Finite metric spaces—combinatorics, geometry and algorithms. In Proceedings of the International Congress of Mathematicians, Vol. III (Beijing, 2002), pages 573–586. Higher Education Press, 2002. 4DOI
  19. [19][LLR95] Nathan Linial, Eran London, and Yuval Rabinovich. The geometry of graphs and some of its algorithmic applications. Combinatorica, 15(2):215–245, 1995. 1, 3, 4
  20. [20][MM16a] Konstantin Makarychev and Yury Makarychev. Metric extension operators, vertex sparsifiers and Lipschitz extendability. Israel Journal of Mathematics, 212(2):913–959, 2016. 3, 13, 14
  21. [21][MM16b] Konstantin Makarychev and Yury Makarychev. Union of euclidean metric spaces is euclidean. Discrete Analysis, pages 1–14, August 2016. 1, 4, 5, 27, 31, 32DOI
  22. [22][MMMR18] Sepideh Mahabadi, Konstantin Makarychev, Yury Makarychev, and Ilya Razenshteyn. Nonlinear dimension reduction via outer bi-Lipschitz extensions. In Proceedings of the 50th Annual ACM SIGACT Symposium on Theory of Computing, pages 1088–1101, 2018. 5arxiv.org/abs/1811.03591
  23. [23][NN19] Shyam Narayanan and Jelani Nelson. Optimal terminal dimensionality reduction in Euclidean space. In Proceedings of the 51st Annual ACM SIGACT Symposium on Theory of Computing, pages 1064–1069, 2019. 5arxiv.org/abs/1810.09250
  24. [24][NR17] Assaf Naor and Yuval Rabani. On Lipschitz extension from finite subsets. Israel Journal of Mathematics, 219(1):115–161, 2017. 4, 25arxiv.org/abs/1506.04398
  25. [25][YYL19] Jiaxuan You, Rex Ying, and Jure Leskovec. Position-aware graph neural networks. In Proceedings of the 36th International Conference on Machine Learning, volume 97 of Proceedings of Machine Learning Research, pages 7134–7143. PMLR, 2019. 4arxiv.org/abs/1906.04817

Paper details

vlnc:W_tqmdmzu3
v1 · latestHistory (1)

published · Fresh — added to the Hub within the last 30 days

added ·

Usage

views · 0

downloads · 0

A view counts once per browser per day, a download each time the PDF is requested.

CC BY 4.0

Original source

  • Computer Science

Not recorded for this paper · View statement →

Looking for related papers…
Contents