alphaFeedback

WorksComputer Science

Differentially Private Synthetic Data from Sliced Chebyshev Moments

AI contributions
Not recorded for this paper
View details
Ancillary data
1 code link
View

Abstract

Research on practical differentially private (DP) synthetic data has largely focused on methods that approximately preserve low-dimensional marginals of a target distribution, and can thus only hope to preserve higher-dimensional, global structure as a lucky by-product. At the same time, existing methods that target global accuracy guarantees pay a price exponential in the data dimension, dd. In this work, we address this ``curse of dimensionality'' by presenting a new DP synthetic data algorithm, SPLICE, that comes with a compelling global distributional guarantee, even in high-dimensions, and moreover, is practically state-of-the-art. Our algorithm is based on measuring noisy sliced Chebyshev polynomial moments of the target distribution and fitting a distribution to match, a twist on recent polynomial methods for 1-D synthetic data. We prove that, given a dataset of nn examples, SPLICE returns a private distribution with Sliced Wasserstein-1 distance O~(1/n)\tilde{O}(1/\sqrt{n}) from the target, for constant privacy parameters. Notably, this bound is independent of the data dimension, dd. Along the way, we prove a moment matching result of independent interest: for a distribution on the unit ball, matching the first O(1/α)O(1/α) Chebyshev moments along O~(d/α2)\tilde{O}(d/α^2) random directions guarantees αα Sliced Wasserstein error. Finally, we provide a practical implementation of the algorithm that borrows tools from the tensor decomposition literature and achieves state-of-the-art performance compared to prior DP synthetic data methods on an extensive benchmark.

Introduction

The generation of high-utility differentially private (DP) synthetic data has become a focal point of research into DP data release Cummings et al., 2024. In the basic setup, we are given a dataset X={x1,…,xn}⊂Rd\mathcal{X} = \{x_1,\ldots,x_n\} \subset\mathbb{R}^d and wish to privately compute a distribution qq that well-approximates the empirical distribution of X\mathcal{X}, which we denote by pp (i.e., pp is uniform over x1,…,xnx_1,\ldots,x_n). The hope is that qq, or samples from qq, can be used as a drop-in replacement for X\mathcal{X} in downstream machine learning and data analysis tasks, without the need for any further differential privacy mechanisms.

To guarantee strong performance on downstream tasks, a natural goal is to develop algorithms that ensure qq is close to pp with respect to some meaningful statistical distance, like Wasserstein distance or some other integral probability metric. There has been significant theoretical work targeting such guarantees (He et al., 2023; Boedihardjo et al., 2024; Feldman et al., 2024; Musco et al., 2025; Ding et al., 2026). However, all of this work obtains bounds that suffer exponentially in the data dimension, dd, so it has yielded few practically competitive algorithms.

Indeed, empirically oriented synthetic data methods give up on strong distribution guarantees, focusing on achieving practical utility on realistic downstream tasks (Zhang et al., 2017; Liu et al., 2021b; McKenna et al., 2022; Liu et al., 2023). Many of the best practical methods are based on noisily measuring only low-order marginals of pp (involving at most 2 or 3 variables (McKenna et al., 2022)) and returning a synthetic distribution that matches these marginals (the “Select-Measure-Estimate” paradigm (Ponomareva et al., 2026)). While they sometimes come with workload-specific error guarantees, it is not surprising that higher-dimensional correlations and structure are missed.

Our Contributions

This work seeks to address this “curse of dimensionality” in synthetic data generation. In short, we introduce a new algorithm, SPLICE, that enjoys a strong distributional error guarantee, even in high dimensions, and moreover, offers state-of-the-art practical performance on downstream tasks.

SPLICE is inspired by a recent approach for low-dimensional synthetic data generation based on matching polynomial moments (specifically, noisy Chebyshev polynomial moments) (Wang et al., 2016). This approach yields near-optimal bounds in terms of Wasserstein-1 (W1W_1) distance: Musco et al. (2025) show that, for a dataset with nn 1-d points, moment matching yields an (ϵ,δ)(\epsilon, \delta)-DP distribution qq such that

W1(p,q)≤O~(log⁡(1/δ)ϵn)W_1(p,q) \le\widetilde{O}\left(\frac{\sqrt{\log(1/\delta)}}{\epsilon n}\right)

At the same time, Chebyshev moment matching falls under the “Select-Measure-Estimate” paradigm, so is easy to implement efficiently.

Unfortunately, however, like other approaches listed above, Chebyshev moment matching does not readily scale to high dimensions. For dd-dimensional data, the bound of Musco et al. (2025) degrades to O~(1/n1/d)\widetilde{O}(1/n^{1/d}) for constant ϵ,δ\epsilon,\delta. This is vacuous for d≳log⁡nd \gtrsim\log n and weak even for small constant dd. Moreover, the bound cannot be improved: Boedihardjo et al. (2024) show that no method can privately achieve Wasserstein-1 error below O(1/n1/d)O(1/n^{1/d}).

Algorithmic Contribution. The key issue with prior work is that obtaining small Wasserstein-1 error requires matching multivariate products of Chebyshev polynomials, the number of which grows exponentially in the number of data variables. In SPLICE, we propose to instead measure sliced Chebyshev polynomial moments, which for any unit vector θ∈Rd\theta\in\mathbb{R}^{d}, take the form:

Ex∼Unif⁡(X)[Tj(θTx)]\mathbb{E}_{x \sim\operatorname{Unif}(\mathcal{X})}\left[T_j(\theta^{\mathsf{T}}x)\right]

where TjT_j is a Chebyshev polynomial of degree jj. The method computes moments of this form for LL different random vectors θ1,…,θL\theta_1, \ldots, \theta_L, where LL scales polynomially in dd. It then adds noise to those moments to ensure differential privacy, and finally fits a distribution qq that matches the noisy moments. In other words, the method again fits into the popular “Select-Measure-Estimate” paradigm, but replaces low-degree marginal measurements with sliced moment measurements.

Our main theoretical result is to prove that, while Wasserstein distance is out of reach, SPLICE yields a strong bound on the sliced Wasserstein-1 distance between our private distribution qq and target pp. Letting W1W_1 denote the one-dimensional Wasserstein-1 distance and Sd−1\mathbb{S}^{d-1} denotes the unit sphere in dd dimensional Euclidean space, sliced Wasserstein-1 distance is defined as:

SW⁡1(p,q):=Eθ∼Unif⁡(Sd−1)[W1(pˉθ,qˉθ)],(1)\operatorname{SW}_1(p,q) := \mathbb{E}_{\theta\sim\operatorname{Unif}(\mathbb{S}^{d-1})}\left[W_1(\bar{p}_{\theta},\bar{q}_{\theta})\right], \tag*{(1)}

where pˉθ\bar{p}_{\theta} (analogously, qˉθ\bar{q}_{\theta}) is the pushforward distribution obtained by projecting pp onto θ∈Sd−1\theta\in\mathbb{S}^{d-1}:

pˉθ(A)=p({x:θTx∈A})(2)\bar{p}_{\theta}(A) = p(\{x : \theta^{\mathsf{T}}x \in A\}) \tag*{(2)}

for any measurable set A⊆RA \subseteq\mathbb{R}. In other words, SW⁡1(p,q)\operatorname{SW}_1(p,q) is the average Wasserstein-1 distance between one-dimensional projections of pp and qq. Originally introduced as a tractable approximation for the standard Wasserstein-1 distance [9] (Rabin et al. 2011), sliced Wasserstein distance has been widely adopted across machine learning, especially in the generative model literature, as a valuable measure in its own right (Deshpande et al., 2018; 2019; Kolouri et al., 2018; 2019a; Liutkus et al., 2019; Nadjahi et al., 2020; Sebag et al., 2025; Gu et al., 2025).

Concretely, we prove the following bound, which is stated more formally in § 3 and proven in Section C:

Theorem 5. Let BdB^{d} denote the unit ball in Rd\mathbb{R}^{d}. There is an (ϵ,δ)(\epsilon,\delta)-differentially private algorithm (SPLICE) that, given a dataset X={x1,…,xn}⊂Bd\mathcal{X} = \{x_1, \ldots, x_n\} \subset B^{d} with p=Unif⁡(X)p = \operatorname{Unif}(\mathcal{X}), returns qq such that

SW⁡1(p,q)≤O~(1nϵ),(3)\operatorname{SW}_1(p,q) \le\widetilde{O}\left(\frac{1}{\sqrt{n\epsilon}}\right), \tag*{(3)}

with probability at least 99/10099/100.

Critically, the bound in Theorem 5 is independent of the data dimension dd: sliced Wasserstein error α\alpha requires only n=O~(1/(ϵα2))n = \widetilde{O}(1/(\epsilon\alpha^2)) data examples, though we allow the number of sampled directions to still depend on dd. In contrast, as discussed above, obtaining even constant Wasserstein-1 error requires n=2Ω(d)n = 2^{\Omega(d)} examples (Boedihardjo et al., 2024). The lack of dimension dependence in Theorem 5 mirrors existing dimension-free bounds on the convergence of an empirical measure to the true distribution under sliced Wasserstein distance (Nadjahi et al., 2020; Manole et al., 2022; Xi & Niles-Weed, 2022; Boedihardjo, 2024).

Key to the proof of Theorem 5 is a moment matching result of potentially independent interest. We show that, if two high-dimensional distributions, pp and qq, match on their first 1/α1/\alpha moments along L=O~(d/α2)L = \widetilde{O}(d/\alpha^2) random slices, then SW⁡1(p,q)≤O(α)\operatorname{SW}_1(p,q) \le O(\alpha). This generalizes the well-known fact that, in one dimension, matching the first 1/α1/\alpha moments of two distributions guarantees W1(p,q)≤αW_1(p,q) \le\alpha [10] (Kong & Valiant 2017). The key technical challenge in establishing this result is to show that a polynomial bound on the required number of slices, LL, suffices. A naive analysis suggests that LL needs to scale exponentially in dd to cover the dd dimensional sphere.

Empirical Contribution. Theorem 5 tells us how many data examples, nn, suffice to build an accurate synthetic distribution, qq, but does not say anything about the complexity of representing or learning that distribution from noisy moment measurements. To make our results practical, we choose to represent qq as a mixture of KK product distributions: in each component of the mixture, discrete random variables follow independent distributions, and continuous random variables are drawn from a single joint Gaussian distribution with low-rank-plus-diagonal covariance. Dependencies between discrete variables are introduced by mixing multiple such distributions.

The class of distributions we consider thus involves O(d)O(d) parameters per component, so O(Kd)O(Kd) in total. We fit these parameters using gradient descent, relying on the key fact that the distribution’s sliced Chebyshev moments have an exact, differentiable closed form. Empirically, using datasets from the extensive TALENT tabular data benchmark (Liu et al., 2025), we evaluate SPLICE with this chosen representation for qq. Our empirical results are quite striking.

Concretely, we find that the mechanism gives the best regression utility of any method among a large set of state-of-the-art benchmarks, at every privacy budget. It also offers the best error on 2-way and 3-way marginal fidelity for ϵ≥1\epsilon\ge1, despite not targeting marginals directly, and achieves the best causal structure recovery by a significant margin. These results are summarized in Figure 1 at ϵ=1\epsilon= 1, where SPLICE outperforms strong marginal-based baselines on both composite axes simultaneously, distributional fidelity and downstream utility, with detailed experiments contained in § 5. Finally, we note that the runtime of SPLICE is competitive with the fastest baselines and dramatically faster than the slowest for typical dataset sizes.

Comparison of state-of-the-art DP synthetic data algorithms

Figure 1. This plot summarizes a comparison of state-of-the-art DP synthetic data algorithms. Each method is evaluated on the 48 downstream train-on-synthetic, test-on-real tasks and ranked according to accuracy. The distribution returned by each method was also ranked using five fidelity metrics (1-way, 2-way, and 3-way marginal TVD, kernel MMD, and sliced W1W_1). The average rank determines the xx and yy coordinates. Lower is better on both axes.

Roadmap. § 2 provides our key technical result, that sliced moments along a small number of random directions suffice to control SW1\mathrm{SW}_1. § 3 leverages this result to obtain the DP guarantee of Theorem 5. § 4 instantiates the algorithm with a practical learned representation, and § 5 empirically tests it. Section A surveys related work in additional depth.

Sliced Chebyshev Moment Matching

We begin with basic preliminaries on the Wasserstein distance and moment matching. Throughout, our goal will be to approximate a distribution pp, which in the case of differentially private synthetic data, will be taken to be the uniform distribution over some dataset X={x1,…,xn}⊂Rd\mathcal{X} = \{x_1,\ldots,x_n\} \subset\mathbb{R}^d.

Let qq be some other distribution. The Wasserstein-1 distance between pp and qq is defined as follows:

W1(p,q):=inf⁡Z∈Z(p,q)E(x,y)∼Z[∥x−y∥2],W_1(p,q) := \inf_{Z \in\mathcal{Z}(p,q)} \mathbb{E}_{(x,y)\sim Z}\left[\lVert x-y\rVert_2\right],

where ∥⋅∥2\lVert\cdot\rVert_2 is the Euclidean distance and Z(p,q)\mathcal{Z}(p,q) is the set of all couplings between pp and qq.

A powerful fact is that, if two 1-dimensional distributions pp and qq supported on [−1,1][-1,1] match on their first kk polynomial moments (i.e., Ex∼p[xj]=Ex∼q[xj]\mathbb{E}_{x\sim p}[x^j] = \mathbb{E}_{x\sim q}[x^j] for all j∈1,…,kj \in1,\ldots,k), then W1(p,q)≤O(1/k)W_1(p,q) \le O(1/k) [10] (Kong & Valiant 2017). This claim follows from combining Jackson’s theorem (Jackson, 1912), which says that any 1-Lipschitz function on [−1,1][-1,1] can be approximated to error O(1/k)O(1/k) by a degree kk polynomial, with the Kantorovich-Rubinstein dual view of Wasserstein distance, which states that W1(p,q)=max⁡1-Lipschitz fEx∼p[f(x)]−Ex∼q[f(x)]W_1(p,q) = \max_{1\text{-Lipschitz } f} \mathbb{E}_{x\sim p}[f(x)] - \mathbb{E}_{x\sim q}[f(x)].

Importantly, this moment matching claim can be made robust when using a basis of polynomial moments besides the standard basis (which is ill-conditioned). For example, let TjT_j denote the jjth Chebyshev polynomial of the first kind:

T0(x)=1,T1(x)=x,Tj+1(x)=2x⋅Tj(x)−Tj−1(x) for j≥1.T_0(x)=1,\qquad T_1(x)=x,\qquad T_{j+1}(x)=2x\cdot T_j(x)-T_{j-1}(x)\text{ for }j\ge1.

Let mj(p)=Ex∼p[Tj(x)]m_j(p)=\mathbb{E}_{x\sim p}[T_j(x)] denote the jjth Chebyshev moment. A recent result shows the following.

Theorem 1 (Musco et al., 2025, Theorem 1). Let p,qp,q be probability measures on [−1,1][-1,1]. For any positive integer kk,

W1(p,q)≤36k+Γk(p,q),whereΓk(p,q)=(∑j=1k1j2(mj(p)−mj(q))2)1/2.(4)W_1(p,q)\le\frac{36}{k}+\Gamma_k(p,q),\qquad\text{where}\qquad\Gamma_k(p,q)=\left(\sum_{j=1}^{k}\frac{1}{j^2}\left(m_j(p)-m_j(q)\right)^2\right)^{1/2}. \tag*{(4)}

Theorem 1 is useful when we wish to recover a distribution pp from noisy approximations to its moments. In particular, suppose we know the first kk Chebyshev moments up to cumulative error Δk\Delta_k (in the sense of equation (4)) and find qq matching them to error Δk\Delta_k (such a qq always exists, since pp is a valid choice). Because Γk\Gamma_k is a norm satisfying triangle inequality, any such qq satisfies W1(p,q)≤36/k+2ΔkW_1(p,q)\le36/k+2\Delta_k. This argument was used by Musco et al. (2025) to obtain a near-optimal algorithm for 1-dimensional DP synthetic data based on noising Chebyshev moments with the Gaussian mechanism (Dwork & Roth, 2014). They show that, for a dataset with nn 1-dimensional points, it is possible to return an (ϵ,δ)(\epsilon,\delta)-differentially private distribution qq satisfying W1(p,q)≤O~(log⁡(1/δ)/ϵn)W_1(p,q)\le\widetilde{O}(\sqrt{\log(1/\delta)}/\epsilon n).

Sliced Moment Matching

As discussed, extending Theorem 1 to dd dimensions requires matching a number of moments exponential in dd, resulting in Wasserstein error scaling as O(1/n1/d)O(1/n^{1/d}) (Musco et al., 2025). Our goal is to avoid this poor dependence on dd by focusing on the relaxed sliced Wasserstein-1 distance defined in equation (1), noting that we always have SW1(p,q)≤W1(p,q)\mathrm{SW}_1(p,q)\le W_1(p,q) (Carlier et al., 2025).

Towards this goal, we can immediately obtain the following corollary of Theorem 1 for high dimensional distributions. In particular, let p,qp,q be probability measures on the unit ball Bd={x∈Rd:∥x∥2≤1}\mathbb{B}^d=\{x\in\mathbb{R}^d:\|x\|_2\le1\} and define mj(θ,p)=Ex∼p[Tj(x⊤θ)]m_j(\theta,p)=\mathbb{E}_{x\sim p}[T_j(x^\top\theta)] to be the jjth Chebyshev moment of the one-dimensional projection of pp as defined in equation (2). Define mj(θ,q)m_j(\theta,q) analogously. For any probability measure qq on Bd\mathbb{B}^d, define its weighted moment error in direction θ\theta by

Γk(θ,p,q):=(∑j=1k1j2(mj(θ,p)−mj(θ,q))2)1/2.(5)\Gamma_k(\theta,p,q):=\left(\sum_{j=1}^{k}\frac{1}{j^2}\left(m_j(\theta,p)-m_j(\theta,q)\right)^2\right)^{1/2}. \tag*{(5)}

Applying Theorem 1 to the one-dimensional projections and averaging over directions gives:

Corollary 1. Let p,qp,q be probability measures on Bd\mathbb{B}^d. For any positive integer kk,

SW1(p,q)≤36k+Γ‾k(p,q),whereΓ‾k(p,q)=Eθ∼Unif⁡(Sd−1)[Γk(θ,p,q)].(6)\mathrm{SW}_1(p,q)\le\frac{36}{k}+\overline{\Gamma}_k(p,q),\qquad\text{where}\qquad\overline{\Gamma}_k(p,q)=\mathbb{E}_{\theta\sim\operatorname{Unif}(\mathbb{S}^{d-1})}[\Gamma_k(\theta,p,q)]. \tag*{(6)}

Corollary 1 is not immediately algorithmically useful, as it requires us to control (on average) how closely qq matches the first kk Chebyshev moments of pp in every direction θ∈Sd−1\theta\in\mathbb{S}^{d-1}. Our main technical tool is a proof that it suffices to instead only match moments for a small random sample of directions θ1,…,θL\theta_1,\ldots,\theta_L drawn uniformly from Sd−1\mathbb{S}^{d-1}. In particular, we show:

Theorem 2. Let pp be a probability measure on Bd\mathcal{B}^d, let LL be a positive integer, let β∈(0,1)\beta\in(0,1), and let θ1,…,θL\theta_1,\ldots,\theta_L be independent draws from Unif⁡(Sd−1)\operatorname{Unif}(\mathbb{S}^{d-1}). For any positive integer kk, with probability at least 1−β1-\beta over the choice of θ1,…,θL\theta_1,\ldots,\theta_L, simultaneously for all probability measures qq on Bd\mathcal{B}^d,

SW⁡1(p,q)≤36k+Γ~k,L(p,q)+32βdlog⁡(6Lk2)L,where Γ~k,L(p,q)=1L∑ℓ=1LΓk(θℓ,p,q).(7)\operatorname{SW}_1(p,q) \le\frac{36}{k}+\widetilde{\Gamma}_{k,L}(p,q)+\frac{32}{\beta}\sqrt{\frac{d\log(6Lk^2)}{L}}, \qquad\text{where } \widetilde{\Gamma}_{k,L}(p,q)=\frac{1}{L}\sum_{\ell=1}^{L}\Gamma_k(\theta_\ell,p,q). \tag*{(7)}

A consequence of this theorem is that, if we compute the first kk moments of pp along L=O~(dk2)L=\widetilde{O}(dk^2) random directions, the resulting information suffices to find a distribution that is O(1/k)O(1/k) close to pp in sliced Wasserstein distance. In particular, we return any distribution that matches all of the resulting kLkL moments (so Γ~k,L(p,q)=0\widetilde{\Gamma}_{k,L}(p,q)=0). Plugging into Theorem 2, we obtain SW⁡1(p,q)=O(1/k)\operatorname{SW}_1(p,q)=O(1/k).

However, the theorem is even more flexible in that, like Theorem 1, it allows us to return a qq that only approximately matches pp’s sliced moments. Approximation will be necessary in our application to differentially private data generation in § 3, since we only have access to noised moments.

Theorem 2 is proven by establishing that Γ‾k(p,q)=Eθ∼Unif⁡(Sd−1)[Γk(θ,p,q)]\overline{\Gamma}_k(p,q)=\mathbb{E}_{\theta\sim\operatorname{Unif}(\mathbb{S}^{d-1})}[\Gamma_k(\theta,p,q)] is well approximated by Γ~k,L(p,q)=1L∑ℓ=1LΓk(θℓ,p,q)\widetilde{\Gamma}_{k,L}(p,q)=\frac{1}{L}\sum_{\ell=1}^{L}\Gamma_k(\theta_\ell,p,q) for all qq. In particular, we show:

Lemma 3. Fix any positive integer kk and any probability measure pp on Bd\mathcal{B}^d. Let LL be a positive integer, let β∈(0,1)\beta\in(0,1), and let θ1,…,θL\theta_1,\ldots,\theta_L be independent draws from Unif⁡(Sd−1)\operatorname{Unif}(\mathbb{S}^{d-1}). With probability at least 1−β1-\beta over the choice of θ1,…,θL\theta_1,\ldots,\theta_L, simultaneously for all probability measures qq on Bd\mathcal{B}^d,

∣1L∑ℓ=1LΓk(θℓ,p,q)−Eθ∼Unif⁡(Sd−1)[Γk(θ,p,q)]∣≤32βdlog⁡(6Lk2)L.(8)\left|\frac{1}{L}\sum_{\ell=1}^{L}\Gamma_k(\theta_\ell,p,q)-\mathbb{E}_{\theta\sim\operatorname{Unif}(\mathbb{S}^{d-1})}\left[\Gamma_k(\theta,p,q)\right]\right| \le\frac{32}{\beta}\sqrt{\frac{d\log(6Lk^2)}{L}}. \tag*{(8)}

Proof of Theorem 2. By Corollary 1, SW⁡1(p,q)≤36/k+Γ‾k(p,q)\operatorname{SW}_1(p,q)\le36/k+\overline{\Gamma}_k(p,q). By Lemma 3, Γ‾k(p,q)≤Γ~k,L(p,q)+32βdlog⁡(6Lk2)L\overline{\Gamma}_k(p,q)\le\widetilde{\Gamma}_{k,L}(p,q)+\frac{32}{\beta}\sqrt{\frac{d\log(6Lk^2)}{L}} for all qq, which immediately gives the theorem.

Theorem 3 is proven in Section B. A natural proof approach would be to apply a concentration bound for each fixed distribution qq, then extend to all distributions using an ϵ\epsilon-net argument. However, directly discretizing the space of distributions introduces an exponential dependence on dd, since representing a distribution on the dd-dimensional ball requires roughly 2O(d)2^{O(d)} parameters. We avoid this issue by using symmetrization and Gaussian comparison arguments to reduce the problem to bounding a random linear combination of empirical moments. Since moments are linear in qq, the resulting expression is maximized by a distribution that places all its mass at a single point. We can thus union bound over the dd-dimensional ball, which has log-covering number just O(d)O(d), leading to a linear dependence in the required number of direction samples, LL.

The SPLICE Algorithm for DP Synthetic Data

Theorem 2 suggests a route to differentially private synthetic data that mirrors the one-dimensional mechanism of Musco et al. (2025): compute sliced moments of the target dataset, intentionally add noise to those moments to ensure privacy, and construct a distribution qq that matches the noised moments. We present this approach formally in Algorithm 1 below, showing how to calibrate the noise, and we then analyze the resulting accuracy of the method for any given privacy parameters.

We remark that, as in Musco et al. (2025), more noise is added to higher-degree polynomial moments, since these moments play a diminishing role in capturing global structure in pp. Additionally, we highlight that we intentionally do not specify the details of the final “Match” step of the algorithm. Our goal in this Algorithm 1 Private Sliced Chebyshev Moment Matching

Input: Dataset X=(x1,…,xn)∈(Bd)n\mathcal{X} = (x_1,\ldots,x_n) \in(\mathbb{B}^d)^n; privacy parameters ϵ,δ∈(0,1)\epsilon,\delta\in(0,1); integers k,L≥1k,L \ge1.

Output: (ϵ,δ)(\epsilon,\delta)-differentially private distribution qq approximating p=Unif⁡(x1,…,xn)p = \operatorname{Unif}(x_1,\ldots,x_n).

  1. Sample directions. Sample θ1,…,θL∼i.i.d.Unif⁡(Sd−1)\theta_1,\ldots,\theta_L \mathrel{\overset{\mathrm{i.i.d.}}{\sim}} \operatorname{Unif}(\mathbb{S}^{d-1}).

  2. Compute noisy moments. For all ℓ∈1,…,L\ell\in1,\ldots,L and j∈1,…,kj \in1,\ldots,k, compute m~j,ℓ=Ex∼p[Tj(x⊤θℓ)]+ηj,ℓ\widetilde{m}_{j,\ell} = \mathbb{E}_{x\sim p}[T_j(x^\top\theta_\ell)] + \eta_{j,\ell}, where ηj,ℓ∼N(0,jσ2)\eta_{j,\ell} \sim\mathcal{N}(0,j\sigma^2) with σ2=8L(1+log⁡k)log⁡(1.25/δ)/(n2ϵ2)\sigma^2 = 8L(1+\log k)\log(1.25/\delta)/(n^2\epsilon^2).

  3. Match. Using the sampled directions and noisy moments, return a distribution

q∈arg min⁡r a probability measure on Bd 1L∑ℓ=1L∑j=1k(m~j,ℓ−mj(θℓ,r))2j2.q \in\underset{r\text{ a probability measure on }\mathbb{B}^d}{\operatorname{arg\,min}}\ \frac{1}{L}\sum_{\ell=1}^{L}\sum_{j=1}^{k}\frac{(\widetilde{m}_{j,\ell}-m_j(\theta_\ell,r))^2}{j^2}.

section is to show that, if we solve the minimization problem shown, then qq will be close to pp in sliced Wasserstein distance with high probability. This is our main utility result. In the subsequent section, we describe an efficient heuristic for solving the problem in practice.

We first establish the privacy of Algorithm 1. Doing so is straight-forward, as qq only depends on pp through the noisy moments, m~j,ℓ\widetilde{m}_{j,\ell}. These moments, in turn, are obtained by adding N(0,σ2)\mathcal{N}(0,\sigma^2) noise (i.e., applying the standard Gaussian mechanism) to the vector valued function:

f(X)(ℓ,j)=1j⋅1n∑i=1nTj(θℓ⊤xi)for ℓ∈1,…,L and j∈1,…,k.(9)f(\mathcal{X})_{(\ell,j)} = \frac{1}{\sqrt{j}}\cdot\frac{1}{n}\sum_{i=1}^{n}T_j(\theta_\ell^\top x_i)\qquad\text{for }\ell\in1,\ldots,L\text{ and }j\in1,\ldots,k. \tag*{(9)}

Note the scaling by 1/j1/\sqrt{j}: this ensures that the addition of N(0,jσ2)\mathcal{N}(0,j\sigma^2) noise in Algorithm 1 is equivalent to adding N(0,σ2)\mathcal{N}(0,\sigma^2) noise to each coordinate of f(X)f(\mathcal{X}).

Proving privacy thus amounts to bounding the ℓ2\ell_2 sensitivity of f(X)f(\mathcal{X}). We do so under the standard replacement adjacency model, meaning that neighboring datasets differ in one record. Using that ∣Tj(z)∣≤1\lvert T_j(z)\rvert\le1 for all z∈[−1,1]z\in[-1,1], we can bound the ℓ2\ell_2 sensitivity of this function as:

Δ2,f2=max⁡neighboring datasets X,X′∥f(X)−f(X′)∥22≤∑ℓ=1L∑j=1k4jn2≤4Ln2(1+log⁡k).\Delta_{2,f}^{2}=\max_{\text{neighboring datasets }X,X'}\lVert f(X)-f(X')\rVert_2^2\le\sum_{\ell=1}^{L}\sum_{j=1}^{k}\frac{4}{jn^2}\le\frac{4L}{n^2}(1+\log k).

where we used ∑j=1k1/j≤1+log⁡k\sum_{j=1}^{k}1/j\le1+\log k. Dwork & Roth (2014, Theorem 3.22) show that (ϵ,δ)(\epsilon,\delta)-differential privacy can be achieved by adding Gaussian noise with variance Δ2,f2⋅2log⁡(1.25/δ)/ϵ2\Delta_{2,f}^{2}\cdot2\log(1.25/\delta)/\epsilon^2, which equals σ2\sigma^2. We thus conclude:

Proposition 4 (Privacy). For ϵ,δ∈(0,1)\epsilon,\delta\in(0,1), Algorithm 1 is (ϵ,δ)(\epsilon,\delta)-differentially private.

Next, we leverage the results of the previous section to show that Algorithm 1 also achieves a strong utility guarantee. I.e., that qq is close to pp in the sliced Wasserstein-1 distance. Formally we have:

Theorem 5. Let qq be the output of Algorithm 1. For any β∈(0,1)\beta\in(0,1), with probability at least 1−β1-\beta over the directions and Gaussian noise,

SW⁡1(p,q)≤36k+4β[σ2(1+log⁡k)log⁡(6Lk2)L]1/4+64βdlog⁡(6Lk2)L.(10)\operatorname{SW}_1(p,q)\le\frac{36}{k}+\frac{4}{\sqrt{\beta}}\left[\frac{\sigma^2(1+\log k)\log(6Lk^2)}{L}\right]^{1/4}+\frac{64}{\beta}\sqrt{\frac{d\log(6Lk^2)}{L}}. \tag*{(10)}

The proof is given in Section C. For nϵ≥1n\epsilon\ge1 and d<nϵd<n\epsilon, choose

k=⌈nϵ⌉,L=⌈dnϵ(1+log⁡(nϵ))⌉.k=\lceil\sqrt{n\epsilon}\rceil,\qquad L=\lceil dn\epsilon(1+\log(n\epsilon))\rceil.

Then 1+log⁡k=O(1+log⁡(nϵ))1+\log k=O(1+\log(n\epsilon)) and, since d<nϵd<n\epsilon, log⁡(6Lk2)=O(1+log⁡(nϵ))\log(6Lk^2)=O(1+\log(n\epsilon)). Substituting these choices and σ2=8L(1+log⁡k)log⁡(1.25/δ)/(nϵ)2\sigma^2=8L(1+\log k)\log(1.25/\delta)/(n\epsilon)^2 in equation 9 gives

SW⁡1(p,q)≤Oβ((1+log⁡(nϵ))3/4log⁡1/4(1.25/δ)nϵ)(11)\operatorname{SW}_1(p,q)\le O_\beta\left(\frac{(1+\log(n\epsilon))^{3/4}\log^{1/4}(1.25/\delta)}{\sqrt{n\epsilon}}\right) \tag*{(11)}

where the constant depends only on β\beta. In particular, the bound does not depend on dd. In the remaining regimes, equation 10 holds for any k,L≥1k,L\ge1: if d≥nϵ≥1d\ge n\epsilon\ge1, Theorem 7 gives SW⁡1(p,q)≤2/d≤2/nϵ\operatorname{SW}_1(p,q)\le2/\sqrt{d}\le2/\sqrt{n\epsilon}, and if nϵ<1n\epsilon<1, then 2/nϵ>2≥SW⁡1(p,q)2/\sqrt{n\epsilon}>2\ge\operatorname{SW}_1(p,q), so equation 10 holds with log⁡(nϵ)\log(n\epsilon) read as max⁡{0,log⁡(nϵ)}\max\{0,\log(n\epsilon)\}. This proves the O~(1/nϵ)\widetilde{O}(1/\sqrt{n\epsilon}) guarantee stated in § 1.

A Tractable Representation

Our main result from the previous section, Theorem 5, says that it is information theoretically possible to return a private distribution qq such that SW⁡1(p,q)≤O~(1/nϵ)\operatorname{SW}_1(p,q)\le\widetilde{O}(1/\sqrt{n\epsilon}). Indeed, qq can be obtained by postprocessing a set of sliced Chebyshev moments noised using the Gaussian mechanism. However, the theorem does not say anything about how to implement the postprocessing step efficiently, i.e. how to find qq that minimizes or approximately minimizes the moment error in Algorithm 1. We address that gap in this section, providing an effective heuristic for fitting a distribution qq.

Mixture of product distributions. Importantly, our approach requires a more efficient representation for qq than, for example, a naive dd dimensional histogram, which would require 2O(d)2^{O(d)} parameters to even represent. We choose to instead optimize over a parameter-efficient mixture of product distributions. I.e., we consider distributions of the form q^=∑h=1Kπhq^h\hat{q}=\sum_{h=1}^{K}\pi_h\hat{q}_h, where KK is an integer parameter, π\pi is a vector in the probability simplex, ΔK\Delta_K, and each q^h\hat{q}_h is a product distribution.

Concretely, for every index aa corresponding to a categorical variable with rar_a levels, the distribution of q^h\hat{q}_h at index aa is represented by a probability vector ϕ(h,a)∈Δra\phi^{(h,a)}\in\Delta_{r_a}. Each level is associated with a point on an equispaced grid of rar_a values on [−1,1][-1,1]. On the other hand, all continuous variables are modeled as a single joint Gaussian distribution with mean μh∈RdN\mu_h\in\mathbb{R}^{d_N} and covariance Σh∈RdN×dN\Sigma_h\in\mathbb{R}^{d_N\times d_N}, where dNd_N (respectively, dCd_C) counts the continuous (respectively, categorical) variables. We assume that Σh\Sigma_h is low-rank-plus-diagonal for some rank RR, i.e. Σh=UhUhT+diag⁡(Dh)\Sigma_h=U_hU_h^{\mathsf T}+\operatorname{diag}(D_h) with Uh∈RdN×RU_h\in\mathbb{R}^{d_N\times R} and Dh∈R>0dND_h\in\mathbb{R}^{d_N}_{>0}. The product of this single continuous distribution with the dCd_C categorical distributions defines q^h\hat{q}_h. Overall, we have:

q^(xC,xN)=∑h=1Kπh(∏a∈Cϕ(h,a)(xa))N(xN;μh,Σh).(12)\hat{q}(x_C,x_N)=\sum_{h=1}^{K}\pi_h\left(\prod_{a\in C}\phi^{(h,a)}(x_a)\right)\mathcal{N}(x_N;\mu_h,\Sigma_h). \tag*{(12)}

Any distribution of this form requires O(K(dCrmax⁡+dNR))O(K(d_Cr_{\max}+d_NR)) parameters to represent, where rmax⁡r_{\max} is an upper bound on the number of levels for any categorical variable.2 We note that, for each component distribution, q^h\hat{q}_h, categorical and continuous variables are independent, but by mixing KK distributions, we can capture categorical-categorical and categorical-continuous dependence.

Optimization. With the model above in place, our goal becomes to fit a distribution that minimizes the moment error in Algorithm 1, i.e., to minimize the following expression over parameters of q^\hat{q}:

1L∑ℓ=1L∑j=1k(m~j,ℓ−mj(θℓ,q^))2j2.(13)\frac{1}{L}\sum_{\ell=1}^{L}\sum_{j=1}^{k}\frac{\left(\tilde{m}_{j,\ell}-m_j(\theta_\ell,\hat{q})\right)^2}{j^2}. \tag*{(13)}

While we cannot ensure that doing so obtains near-minimal error over all possible distributions, as will be shown in the next section, empirically we find that our mixture model is rich enough to accurately match many practical datasets from noisy sliced moments, even with K=5K = 5 and R=2R = 2.

We minimize equation (13) using gradient descent. We enforce simplex constraints on π\pi and each ϕ(h,a)\phi^{(h,a)} using a softmax reparameterization and we ensure the covariance diagonal is positive through a logarithmic reparameterization. To compute gradients, we take advantage of the fact that there is an efficient, differentiable procedure for computing mj(θℓ,q^)m_j(\theta_\ell,\hat{q}), which we describe in Section D.

Experiments

Data and Baselines. We evaluate on 209 datasets from the TALENT benchmark (Liu et al., 2025), spanning binary classification (75), multiclass classification (47), and regression (87), at privacy budgets ϵ∈{0.5,1,3,10}\epsilon\in\{0.5, 1, 3, 10\} with δ=10−9\delta= 10^{-9} and five seeds per cell. Appendix § 15 lists every dataset with its size, feature composition, and task. We consider a number of state-of-the-art baselines: AIM (McKenna et al., 2022) (with 2-way and 3-way marginal workloads), PrivBayes (Zhang et al., 2017), GEM (Liu et al., 2021b) (with 2-way and 3-way marginal workloads), and Private-GSD (Liu et al., 2023), all under the public-schema convention described in Section F for fairness. Our downstream utility for classification/regression measurements use the train-on-synthetic, test-on-real (TSTR) protocol, scoring each generated dataset by the best of four learners (logistic regression or ridge, random forest, XGBoost, TabPFN) and aggregating by rank. Despite checking 209 TALENT datasets, we only report aggregate comparisons on what we call “well-formed prediction tasks” i.e. tasks where the train-on-real ceiling of AUC at least 0.7 for classification and R2R^2 at least 0.3 for regression. This means that “unlearnable” datasets do not contribute noisy wins; still, the vast majority of datasets are kept (184 of 209). Note that, unless otherwise specified, results for SPLICE use the mixture of categorical-Gaussian product distributions of Algorithm 2; a comparison among the SPLICE model variants is in Section F.1.

Overall comparison. Figure 1 summarizes the benchmark at ϵ=1\epsilon= 1 by two composite ranks: distributional fidelity (1-way, 2-way, and 3-way marginal TVD, kernel MMD2^2, and sliced Wasserstein-1) and downstream

TSTR utility, macro-averaged over the classification and regression families with equal weight. SPLICE is ranked first on four of the five fidelity metrics, third on 1-way TVD behind only AIM (which measures those exact marginals directly), and outperforms every baseline on both composite axes simultaneously. On utility, SPLICE dominates regression and is competitive on classification tasks. Per-metric values appear in Section G.

Downstream predictive utility. Figure 2 shows mean TSTR rank by privacy budget. On regression, SPLICE has the best mean rank at every budget (2.58, 2.19, 1.72, and 1.73 at ϵ=0.5,1,3,10\epsilon= 0.5, 1, 3, 10 over 67 datasets). On classification, SPLICE is in the top 3 performers at each privacy budget. Classification is a more difficult setting for SPLICE, as the target is discrete and the datasets have more categorical features on average; the strength of sliced Chebyshev moment projections is in natively handling continuous or ordinal values, while categorical values without order are not faithfully represented by the projection into continuous space. See Figure 6 in the Appendix for the data type stratum breakdown.

Mean TSTR rank across datasets by privacy budget for classification and regression

Figure 2. Mean TSTR rank across datasets (lower is better) by privacy budget, best downstream learner per dataset. Classification (AUC), n=94n = 94 datasets, regression (MSE), n=67n = 67.

Mean TSTR rank by privacy budget, task family, and feature type

Figure 6. Mean TSTR rank (lower is better) by privacy budget, split by task family (top: regression, bottom: classification) and by feature type (columns: all numerical, mixed, all categorical). Each panel uses a fixed set of well-formed datasets on which every plotted method has a value at every budget: n=45n = 45 (numerical) and 22 (mixed) for regression; n=50n = 50, 31, and 10 for classification. Error bars are ±1\pm1 SEM across datasets. The benchmark has no well-formed all-categorical regression datasets.

Marginal fidelity. Despite never explicitly measuring a marginal, SPLICE is the best 3-way method at every budget, as well as the best 2-way method from ϵ=1\epsilon= 1 (Figure 3); AIM, which matches noisy 1-way marginals directly, is best on that metric, but even there its margin shrinks as ϵ\epsilon increases. SPLICE’s advantage grows with the interaction order, which is the main benefit of the method; matching higher-order Chebyshev moment measurements across random projections leads to distributional recovery containing higher-order interactions.

Mean k-way marginal total variation distance plots for 1-way, 2-way, and 3-way marginals

Figure 3. Mean kk-way marginal total variation distance (lower is better) on a fixed set of n=43n = 43 datasets where every method has a value at every budget. Left to right: 1-way, 2-way, 3-way marginals. SPLICE never targets marginals yet leads 2-way and 3-way fidelity from ϵ≥1\epsilon\ge1.

Distributional distance and causal structure. SPLICE is theoretically motivated by the sliced Wasserstein-1 metric (SW1_1), which is distributional and sensitive to higher order relationships in data. Perhaps unsurprisingly, our method is then best at every budget for SW1_1 (Figure 4), and the method using a mixture of categorical-Gaussian product distributions matches the theoretical rate almost exactly (the worst-case rate is scaled by a large constant factor, to match the practical SW1_1 error scale, but the decreasing rate across ϵ\epsilon appears faithful). Additionally, the commonly used Kernel MMD distributional distance (Gretton et al., 2012) gives the same ordering (Figure 7 in the appendix).

Sliced Wasserstein-1 distance plots

Figure 4. Sliced Wasserstein-1 distance (lower is better), 256 Monte Carlo directions on the unit ball, n=36n = 36 datasets, with the bound of Theorem 5 parameterized at each dataset’s (n,d)(n, d), minimized over kk and LL, and divided through by a constant; the overlay compares rates in ϵ\epsilon, and baselines are faded.

Unbiased RBF-kernel MMD$^{2}$ plot with mean MMD$^{2}$ (lower = better) on a log scale, comparing PrivBayes, AIM (2-way), AIM (3-way), GEM (2-way), GEM (3-way), Private-GSD, and SPLICE across $\varepsilon = 0.5$, $1.0$, $3.0$, and $10.0$

Figure 7. Unbiased RBF-kernel MMD2^{2} between real and synthetic data (lower is better, log scale), median-heuristic bandwidth, n=36n = 36 datasets. Error bars are ±1\pm1 SEM across datasets.

It has been noted that causal path analysis would be an impactful area for advances in DP synthetic data (Rosenblatt et al., 2024a; Ponomareva et al., 2026). Thus, we run GRaSP, a standard causal discovery method (Lam et al., 2022), on real and synthetic data and compare the recovered graphs (Figure 5). At tight and moderate budgets SPLICE roughly doubles edge recovery (measured F1) of the best marginal baseline (0.42 to 0.49 at ϵ≤3\epsilon\le3 against 0.00 to 0.37).

Jaccard similarity of undirected edge sets

Figure 5. Jaccard similarity of undirected edge sets between the real-data and synthetic-data causal graphs (higher is better), n=11n = 11 datasets. Error bars are ±1\pm1 SEM across datasets.

Compute and reliability. Thanks to its near-independence from sample size and dimensionality by construction, SPLICE runs in almost constant time and memory across three orders of magnitude of dataset size (30 to 120 seconds over a controlled grid from 12,500 to 400,000 rows and 6 to 24 columns, while e.g. Private-GSD times out beyond 25,000 rows, AIM struggles in higher dimensions and PrivBayes scales computationally with nn (§ 16)). Additionally, across the full generations of the benchmark, SPLICE completed all 16,800 of its generations with zero failures, while every other baseline failed somewhere due to each method’s structural constraints.

Conclusion

We introduced SPLICE, a differentially private synthetic data mechanism built on noisy sliced Chebyshev moments. Our analysis shows that matching moments along a number of random directions that is linear in the dimension controls the sliced Wasserstein-1 distance. Our mixture of categorical-Gaussian product distributions makes the mechanism practical, reliable and competitive: it outperforms strong marginal-based baselines on both composite axes simultaneously, distributional fidelity and downstream utility, across a 209-dataset benchmark, and in particular leads on regression, higher-order marginal fidelity and causal edge recovery.

Reproducibility

Section E states the full practical algorithm (Algorithm 2) together with every default hyperparameter (Table 1), and Section F documents the experimental protocol, the public metadata convention, and the baseline implementations with their sources. Section H lists all benchmark datasets, and Section G reports the per-metric values behind the figures.

symboldefaultrole
KK5mixture components
RR2rank of each continuous covariance factor
LLmin⁡(theory,300)\min(\mathit{theory},300)number of directions
kkmin⁡(theory,30)\min(\mathit{theory},30)Chebyshev degree per direction
optimizerAdam, cosine schedule2000 iterations, learning rate 0.02
robustnessHuber loss (δ=0.5\delta= 0.5), EMA, restartsstabilizes the non-convex fit

Table 1. Implementation defaults for Algorithm 2, as used in all experiments.

An implementation of SPLICE is available at https://github.com/llurosenb/splice. Please contact the authors for additional benchmark scripts and the complete results files.

Acknowledgements

We thank Apoorv Vikram Singh for helpful discussions at the beginning of this project. This work was partially supported under the NSF AF program under award #2427363. The work was also partially supported by a Google TPU Builders Award.

Extended Related Work

Here we expand the discussions of § 2 in the context of the surrounding literature.

Practical DP synthetic data. Most practical mechanisms for private tabular synthesis follow the Select-Measure-Estimate paradigm (Ponomareva et al., 2026): choose a workload of low-dimensional statistics, measure them with calibrated noise, and fit a distribution to the noisy answers. Model lineage is extensive, from early approaches like MWEM (Hardt & Rothblum, 2010; Hardt et al., 2012) to more recent graphical-model estimators (McKenna et al., 2019; 2021a; 2022), Bayesian networks (Zhang et al., 2017), relaxed projection and generative estimators [3] (Liu et al. 2021b; McKenna et al. 2021b), marginal-selection refinements [11] (Zhang et al. 2021; Liu et al. 2021a; Fuentes et al. 2024; Mullins et al. 2024), and genetic search over discretized domains (Liu et al., 2023). These build on a long line of work on accurate query answering under DP, including consistency and matrix mechanism techniques [4] (Hay et al. 2010; Li et al. 2015; McKenna et al. 2018; Lee et al. 2015; Nikolov et al. 2013), and they have led to real deployments [1, 2] (Ghazi et al. 2023). Because these mechanisms measure discrete marginals, they must discretize numerical features, a step the survey of Ponomareva et al. (2026) identifies as a central difficulty for tabular data; SPLICE sidesteps it by measuring moments of continuous projections directly. A parallel line of work trains neural generative models under DP, from GANs (Jordon et al., 2019) to recent end-to-end approaches built on foundation models (Ponomareva et al., 2026), although marginal-based methods still dominate tabular benchmarks (Rosenblatt et al., 2024b; 2020).

Closest to our release-once-then-fit structure within this line are private feature-sketch generators, which release a fixed noisy feature sketch and fit a generator to it: noisy sliced projections of records trained against smoothed-sliced ff-divergences (Greenewald et al., 2024), random Fourier features for kernel MMD (Harder et al., 2021), Hermite polynomial features approximating a Gaussian kernel (Vinaroz et al., 2022), and compressive learning sketches (Chatalic et al., 2022). SPLICE shares the release-once-then-fit structure, but differs in two ways: its sliced Chebyshev sketch provably controls the distributional metric SW1\mathrm{SW}_1, whereas these methods match kernel or feature discrepancies without a guarantee on a standard distributional metric; and these feature-matching generators have not demonstrated utility competitive with the marginal-based state of the art on realistic tabular workloads, which is the comparison our experiments target.

Hardness of private synthetic data. Answering all low-order statistics accurately is possible information-theoretically [5], but generating synthetic data that does so is computationally hard in the worst case (Dwork et al., 2009; Ullman & Vadhan, 2011; Vadhan, 2017), with sharp sample complexity transitions between pure and approximate DP (Steinke & Ullman, 2017). This explains the field’s split between practical heuristics and guarantee-first mechanisms, which can ignore these real-world constraints.

Distributional guarantees. A theoretical stream targets explicit statistical distance guarantees between the synthetic and true distributions. For Wasserstein distance, private measures and random walks achieve the optimal rate, which unfortunately degrades as n−1/dn^{-1/d} in dimension dd [6] (He et al. 2023), motivating work on low-dimensional structure (He et al., 2025; Donhauser et al., 2024), online generation (He et al., 2024), instance optimality (Feldman et al., 2024), and streaming moment estimation (Epasto et al., 2023). Weakening the metric helps: targeting smooth query classes improves the rates, although the sample complexity still depends exponentially on dimension (Wang et al., 2016; Ding et al., 2026). Relative error guarantees also refine worst-case bounds (Ghazi et al., 2025; 2021; Dagan & Kur, 2022). Our approach descends from moment matching, where matching kk (Chebyshev) moments controls one-dimensional Wasserstein distance [10] (Kong & Valiant 2017; Musco et al. 2025); in this paper, we escape the dimension-exponential cost of the multivariate extension by matching moments only along random slices.

Sliced Wasserstein distance. Sliced Wasserstein distance was introduced as a tractable surrogate for Wasserstein distance ([9] (Rabin et al. 2011)) and is now a standard training objective and evaluation metric for generative models ((Deshpande et al., 2018; 2019; Kolouri et al., 2018; 2019b; a; Liutkus et al., 2019)). Its statistical and geometric properties are an active topic, including sharp comparisons to the unsliced distance ((Carlier et al., 2025; Niles-Weed & Shkrob, 2026)), kernel and intrinsic variants ([8] (Meunier et al. 2022; Rustamov & Majumdar 2023)), and its role as an integral probability metric ((Müller, 1997; Villani, 2008)). In private learning, sliced Wasserstein distance drives gradient flow generators ((Sebag et al., 2025)) and trajectory synthesis ((Gu et al., 2025)). To our knowledge, SPLICE is the first to pair a sliced Wasserstein guarantee with a practical, state-of-the-art differentially private algorithm.

Proof of the Moment Error Approximation Lemma

Here we provide the deferred proof of Theorem 3, which we restate below:

Lemma 3. Fix any positive integer kk and any probability measure pp on Bd\mathbb{B}^{d}. Let LL be a positive integer, let β∈(0,1)\beta\in(0,1), and let θ1,…,θL\theta_{1},\ldots,\theta_{L} be independent draws from Unif⁡(Sd−1)\operatorname{Unif}(\mathbb{S}^{d-1}). With probability at least 1−β1-\beta over the choice of θ1,…,θL\theta_{1},\ldots,\theta_{L}, simultaneously for all probability measures qq on Bd\mathbb{B}^{d},

∣1L∑ℓ=1LΓk(θℓ,p,q)−Eθ∼Unif⁡(Sd−1)[Γk(θ,p,q)]∣≤32βdlog⁡(6Lk2)L.(14)\left\lvert\frac{1}{L}\sum_{\ell=1}^{L}\Gamma_{k}(\theta_{\ell},p,q)-\mathbb{E}_{\theta\sim\operatorname{Unif}(\mathbb{S}^{d-1})}\left[\Gamma_{k}(\theta,p,q)\right]\right\rvert\leq\frac{32}{\beta}\sqrt{\frac{d\log(6Lk^{2})}{L}}. \tag*{(14)}

Proof of Theorem 3. Define

Z≔sup⁡q∣1L∑ℓ=1LΓk(θℓ,p,q)−Eθ∼Unif⁡(Sd−1)[Γk(θ,p,q)]∣,Z \coloneqq\sup_{q}\left\lvert\frac{1}{L}\sum_{\ell=1}^{L}\Gamma_{k}(\theta_{\ell},p,q)-\mathbb{E}_{\theta\sim\operatorname{Unif}(\mathbb{S}^{d-1})}\left[\Gamma_{k}(\theta,p,q)\right]\right\rvert,

where the supremum is over all probability measures on Bd\mathbb{B}^{d}. We bound EθZ\mathbb{E}_{\theta}Z and apply Markov’s inequality. Expectation subscripts indicate the random family being averaged over; all other random variables are held fixed.

Symmetrization and Gaussian Comparison. Let σ1,…,σL\sigma_{1},\ldots,\sigma_{L} be independent Rademacher random variables, independent of the directions. A standard symmetrization inequality (see e.g. (van der Vaart & Wellner, 1996, Lemma 2.3.1)) gives

Eθ[Z]≤2LEθ,σ[sup⁡q∣∑ℓ=1LσℓΓk(θℓ,p,q)∣].(15)\mathbb{E}_{\theta}[Z]\leq\frac{2}{L}\mathbb{E}_{\theta,\sigma}\left[\sup_{q}\left\lvert\sum_{\ell=1}^{L}\sigma_{\ell}\Gamma_{k}(\theta_{\ell},p,q)\right\rvert\right]. \tag*{(15)}

Fix the directions θ1,…,θL\theta_{1},\ldots,\theta_{L} and define

vℓ(q)≔(m1(θℓ,p)−m1(θℓ,q)1,…,mk(θℓ,p)−mk(θℓ,q)k)∈Rk,(16)v_{\ell}(q)\coloneqq\left(\frac{m_{1}(\theta_{\ell},p)-m_{1}(\theta_{\ell},q)}{1},\ldots,\frac{m_{k}(\theta_{\ell},p)-m_{k}(\theta_{\ell},q)}{k}\right)\in\mathbb{R}^{k}, \tag*{(16)}

so Γk(θℓ,p,q)=∥vℓ(q)∥2\Gamma_{k}(\theta_{\ell},p,q)=\lVert v_{\ell}(q)\rVert_{2}.

Symmetry of the signs gives:

Eσ[sup⁡q∣∑ℓ=1Lσℓ∥vℓ(q)∥2∣]≤2Eσ[sup⁡q∑ℓ=1Lσℓ∥vℓ(q)∥2].(17)\mathbb{E}_{\sigma}\left[\sup_q\left\lvert\sum_{\ell=1}^{L}\sigma_\ell\lVert v_\ell(q)\rVert_2\right\rvert\right]\le2\mathbb{E}_{\sigma}\left[\sup_q\sum_{\ell=1}^{L}\sigma_\ell\lVert v_\ell(q)\rVert_2\right]. \tag*{(17)}

For any realization of σ1,…,σL\sigma_1,\ldots,\sigma_L,

sup⁡q∣∑ℓ=1Lσℓ∥vℓ(q)∥2∣≤sup⁡q∑ℓ=1Lσℓ∥vℓ(q)∥2+sup⁡q∑ℓ=1L(−σℓ)∥vℓ(q)∥2.\sup_q\left\lvert\sum_{\ell=1}^{L}\sigma_\ell\lVert v_\ell(q)\rVert_2\right\rvert\le\sup_q\sum_{\ell=1}^{L}\sigma_\ell\lVert v_\ell(q)\rVert_2+\sup_q\sum_{\ell=1}^{L}(-\sigma_\ell)\lVert v_\ell(q)\rVert_2.

Both suprema on the right are nonnegative, since we can always choose q=pq=p, in which case vℓ(q)=0v_\ell(q)=0. Taking expectations and using the symmetry of the random signs gives equation (17).

Gaussian comparison removes the ℓ2\ell_2 norms:

Eσsup⁡q∑ℓ=1Lσℓ∥vℓ(q)∥2≤π2Egsup⁡q∑ℓ=1L⟨gℓ,vℓ(q)⟩,(18)\mathbb{E}_{\sigma}\sup_q\sum_{\ell=1}^{L}\sigma_\ell\lVert v_\ell(q)\rVert_2\le\sqrt{\frac{\pi}{2}}\mathbb{E}_{g}\sup_q\sum_{\ell=1}^{L}\langle g_\ell,v_\ell(q)\rangle, \tag*{(18)}

Here gℓ=(gℓ1,…,gℓk)g_\ell=(g_{\ell1},\ldots,g_{\ell k}) are independent standard Gaussian vectors. We apply the following lemma to each sign:

Lemma 6. Fix ℓ∈{1,…,L}\ell\in\{1,\ldots,L\} and let vℓ(q)v_\ell(q) be as in equation (16). Let a(q)a(q) be a function over probability measures with sup⁡q∣a(q)∣<∞\sup_q\lvert a(q)\rvert<\infty. Let σ\sigma be a Rademacher random variable and let g∼N(0,Ik)g\sim\mathcal{N}(0,I_k). Then

Eσsup⁡q{a(q)+σ∥vℓ(q)∥2}≤Egsup⁡q{a(q)+π/2⟨g,vℓ(q)⟩},\mathbb{E}_{\sigma}\sup_q\{a(q)+\sigma\lVert v_\ell(q)\rVert_2\}\le\mathbb{E}_{g}\sup_q\{a(q)+\sqrt{\pi/2}\langle g,v_\ell(q)\rangle\},

where both suprema range over all probability measures qq on Bd\mathcal{B}^d.

Proof. Fix any two probability measures q+q_+ and q−q_- on Bd\mathcal{B}^d. We restrict the Gaussian supremum to these two measures and use that, for two quantities aa and bb, max⁡{a,b}=a+b2+∣a−b∣2\max\{a,b\}=\frac{a+b}{2}+\frac{\lvert a-b\rvert}{2} to obtain

Egsup⁡q{a(q)+π/2⟨g,vℓ(q)⟩}\mathbb{E}_{g}\sup_q\{a(q)+\sqrt{\pi/2}\langle g,v_\ell(q)\rangle\}
≥Egmax⁡q∈{q+,q−}{a(q)+π/2⟨g,vℓ(q)⟩}\ge\mathbb{E}_{g}\max_{q\in\{q_+,q_-\}}\{a(q)+\sqrt{\pi/2}\langle g,v_\ell(q)\rangle\}
=a(q+)+a(q−)2+12Eg∣a(q+)−a(q−)+π/2⟨g,vℓ(q+)−vℓ(q−)⟩∣=\frac{a(q_+)+a(q_-)}{2}+\frac{1}{2}\mathbb{E}_{g}\left\lvert a(q_+)-a(q_-)+\sqrt{\pi/2}\langle g,v_\ell(q_+)-v_\ell(q_-)\rangle\right\rvert
≥a(q+)+a(q−)2+12∥vℓ(q+)−vℓ(q−)∥2\ge\frac{a(q_+)+a(q_-)}{2}+\frac{1}{2}\lVert v_\ell(q_+)-v_\ell(q_-)\rVert_2
≥a(q+)+a(q−)2+∥vℓ(q+)∥2−∥vℓ(q−)∥22.\ge\frac{a(q_+)+a(q_-)}{2}+\frac{\lVert v_\ell(q_+)\rVert_2-\lVert v_\ell(q_-)\rVert_2}{2}.

For the second inequality we use that, if XX is symmetric about zero, then E∣b+X∣≥E∣X∣\mathbb{E}\lvert b+X\rvert\ge\mathbb{E}\lvert X\rvert. Also, E∣⟨g,u⟩∣=2/π∥u∥2\mathbb{E}\lvert\langle g,u\rangle\rvert=\sqrt{2/\pi}\lVert u\rVert_2 for every uu. The last inequality follows from triangle inequality. Taking the supremum over q+q_+ and q−q_- separately on the right-hand side yields

12sup⁡q{a(q)+∥vℓ(q)∥2}+12sup⁡q{a(q)−∥vℓ(q)∥2}=Eσsup⁡q{a(q)+σ∥vℓ(q)∥2},\frac{1}{2}\sup_q\{a(q)+\lVert v_\ell(q)\rVert_2\}+\frac{1}{2}\sup_q\{a(q)-\lVert v_\ell(q)\rVert_2\}=\mathbb{E}_{\sigma}\sup_q\{a(q)+\sigma\lVert v_\ell(q)\rVert_2\},

which proves the claim.

equation (18) is obtained by applying Theorem 6 inductively to each σℓ\sigma_\ell, conditioning on all other random variables and treating their contributions as the offsets a(q)a(q).

Concentration and Net Argument. Combining equation 15 and equation 16 gives:

Eσ[sup⁡q∣∑ℓ=1LσℓΓk(θℓ,p,q)∣]≤2πEg[sup⁡q∑ℓ=1L∑j=1kgℓjmj(θℓ,p)−mj(θℓ,q)j](19)\mathbb{E}_{\sigma}\left[\sup_q\left|\sum_{\ell=1}^{L}\sigma_{\ell}\Gamma_k(\theta_{\ell},p,q)\right|\right]\le\sqrt{2\pi}\mathbb{E}_{g}\left[\sup_q\sum_{\ell=1}^{L}\sum_{j=1}^{k}g_{\ell j}\frac{m_j(\theta_{\ell},p)-m_j(\theta_{\ell},q)}{j}\right] \tag*{(19)}

where the gℓjg_{\ell j} are independent standard normal random variables.

For fixed directions and fixed gℓjg_{\ell j}, define

h(x):=∑ℓ=1L∑j=1kgℓjjTj(θℓTx),x∈Bd.(20)h(x):=\sum_{\ell=1}^{L}\sum_{j=1}^{k}\frac{g_{\ell j}}{j}T_j(\theta_{\ell}^{\mathsf{T}}x),\qquad x\in\mathcal{B}^{d}. \tag*{(20)}

By linearity of expectation, the expression inside the supremum on the right-hand side of equation 17 is

Ex∼p[h(x)]−Ex∼q[h(x)].\mathbb{E}_{x\sim p}[h(x)]-\mathbb{E}_{x\sim q}[h(x)].

Since qq ranges over all probability measures on Bd\mathcal{B}^{d}, we have:

sup⁡q{Ex∼p[h(x)]−Ex∼q[h(x)]}=Ex∼p[h(x)]−inf⁡x∈Bdh(x)≤sup⁡x∈Bdh(x)−inf⁡x∈Bdh(x).(21)\sup_q\{\mathbb{E}_{x\sim p}[h(x)]-\mathbb{E}_{x\sim q}[h(x)]\}=\mathbb{E}_{x\sim p}[h(x)]-\inf_{x\in\mathcal{B}^{d}}h(x)\le\sup_{x\in\mathcal{B}^{d}}h(x)-\inf_{x\in\mathcal{B}^{d}}h(x). \tag*{(21)}

It remains to bound the expected range of hh on Bd\mathcal{B}^{d}. A net of this ball has log-cardinality linear in dd. Concretely, set ρ=1/(Lk2)\rho=1/(Lk^2). By the standard volumetric covering bound for the Euclidean ball (see, e.g., Vershynin (2018)), there is a ρ\rho-net Nρ⊆Bd\mathcal{N}_{\rho}\subseteq\mathcal{B}^{d} that satisfies

∣Nρ∣≤(6Lk2)dand∀x∈Bd, ∃x′∈Nρ such that ∥x−x′∥2≤ρ.(22)|\mathcal{N}_{\rho}|\le(6Lk^2)^d\qquad\text{and}\qquad\forall x\in\mathcal{B}^{d},\ \exists x'\in\mathcal{N}_{\rho}\text{ such that }\lVert x-x'\rVert_2\le\rho. \tag*{(22)}

For every fixed x′∈Nρx'\in\mathcal{N}_{\rho}, the random variable h(x′)h(x') is a centered Gaussian conditional on θ1,…,θL\theta_1,\ldots,\theta_L. Since ∣Tj(t)∣≤1|T_j(t)|\le1 for t∈[−1,1]t\in[-1,1], its variance satisfies

Var⁡g(h(x′))=∑ℓ=1L∑j=1kTj(θℓTx′)2j2≤L∑j=1k1j2≤π2L6.\operatorname{Var}_{g}(h(x'))=\sum_{\ell=1}^{L}\sum_{j=1}^{k}\frac{T_j(\theta_{\ell}^{\mathsf{T}}x')^2}{j^2}\le L\sum_{j=1}^{k}\frac{1}{j^2}\le\frac{\pi^2L}{6}.

A standard bound on the expected maximum of a collection of Gaussian variables (Vershynin, 2018) gives

Eg[max⁡x′∈Nρh(x′)]≤π3Ldlog⁡(6Lk2).(23)\mathbb{E}_{g}\left[\max_{x'\in\mathcal{N}_{\rho}}h(x')\right]\le\frac{\pi}{\sqrt{3}}\sqrt{Ld\log(6Lk^2)}. \tag*{(23)}

It remains to extend this bound to the entire ball. Let x∈Bdx\in\mathcal{B}^{d} be some point in the ball and let x′∈Nρx'\in\mathcal{N}_{\rho} be the nearest point in our ρ\rho-net. For t∈[−1,1]t\in[-1,1], we have ∣Tj′(t)∣≤j2|T'_j(t)|\le j^2 (Trefethen, 2013). It follows that:

∣h(x)−h(x′)∣=∣∑ℓ=1L∑j=1kgℓjj(Tj(θℓTx)−Tj(θℓTx′))∣≤∑ℓ=1L∑j=1k∣gℓj∣j∣Tj(θℓTx)−Tj(θℓTx′)∣≤∑ℓ=1L∑j=1k∣gℓj∣jj2∣θℓT(x−x′)∣≤ρ∑ℓ=1L∑j=1kj∣gℓj∣.\begin{aligned} |h(x)-h(x')| &=\left|\sum_{\ell=1}^{L}\sum_{j=1}^{k}\frac{g_{\ell j}}{j}\left(T_j(\theta_{\ell}^{\mathsf{T}}x)-T_j(\theta_{\ell}^{\mathsf{T}}x')\right)\right|\\ &\le\sum_{\ell=1}^{L}\sum_{j=1}^{k}\frac{|g_{\ell j}|}{j}\left|T_j(\theta_{\ell}^{\mathsf{T}}x)-T_j(\theta_{\ell}^{\mathsf{T}}x')\right|\\ &\le\sum_{\ell=1}^{L}\sum_{j=1}^{k}\frac{|g_{\ell j}|}{j}j^2|\theta_{\ell}^{\mathsf{T}}(x-x')|\\ &\le\rho\sum_{\ell=1}^{L}\sum_{j=1}^{k}j|g_{\ell j}|. \end{aligned}

In the last step, we used Cauchy–Schwarz and the fact that ∥θℓ∥2=1\lVert\theta_\ell\rVert_2=1 and ∥x−x′∥2≤ρ\lVert x-x'\rVert_2\le\rho. It follows that:

Egsup⁡x∈Bdh(x)≤Egmax⁡x′∈Nρh(x′)+ρEg[∑ℓ=1L∑j=1k∣gℓj∣]≤Egmax⁡x′∈Nρh(x′)+ρ2πLk(k+1)2≤Egmax⁡x′∈Nρh(x′)+ρLk2.\begin{aligned} \mathbb{E}_g\sup_{x\in B^d}h(x)\le\mathbb{E}_g\max_{x'\in\mathcal{N}_\rho}h(x')+\rho\mathbb{E}_g\left[\sum_{\ell=1}^{L}\sum_{j=1}^{k}|g_{\ell j}|\right]\le\mathbb{E}_g\max_{x'\in\mathcal{N}_\rho}h(x')+\rho\sqrt{\frac{2}{\pi}}L\frac{k(k+1)}{2} \\ &\le\mathbb{E}_g\max_{x'\in\mathcal{N}_\rho}h(x')+\rho Lk^2. \end{aligned}

Recalling that ρ=1/(Lk2)\rho=1/(Lk^2), combining with equation (23) yields

Eg[sup⁡x∈Bdh(x)]≤π3Ldlog⁡(6Lk2)+1.(24)\mathbb{E}_g\left[\sup_{x\in B^d}h(x)\right]\le\frac{\pi}{\sqrt{3}}\sqrt{Ld\log(6Lk^2)}+1. \tag*{(24)}

The distribution of the gℓjg_{\ell j} variables is unchanged when all signs are negated, so Eg[sup⁡x∈Bdh(x)]=−Eg[inf⁡x∈Bdh(x)]\mathbb{E}_g\left[\sup_{x\in B^d}h(x)\right]=-\mathbb{E}_g\left[\inf_{x\in B^d}h(x)\right]. It follows that the right hand side of equation (21) can be bounded by twice the right-hand side of equation (24). Combining equation (15), equation (19), equation (21), and equation (24), we obtain

Eθ[Z]≤8ππ6dlog⁡(6Lk2)L+8π/2L≤32dlog⁡(6Lk2)L.(25)\mathbb{E}_{\theta}[Z]\le8\pi\sqrt{\frac{\pi}{6}}\sqrt{\frac{d\log(6Lk^2)}{L}}+\frac{8\sqrt{\pi/2}}{L}\le32\sqrt{\frac{d\log(6Lk^2)}{L}}. \tag*{(25)}

The last inequality uses d,k,L≥1d,k,L\ge1, so that 1/L≤dlog⁡(6Lk2)/L1/L\le\sqrt{d\log(6Lk^2)/L}.

Markov’s inequality completes the proof.

Proof of the Private Utility Theorem

Here we bound the sliced Wasserstein-1 distance between the output of Algorithm 1, qq, and a target distribution pp. We could, by a direct analysis, bound the moment error of the differentially private, synthetic distribution qq by the norm of the added noise, which would grow with the number of directions LL (since σ2\sigma^2 scales linearly in LL). This, however, would force a trade-off against the direction-sampling error of Theorem 2, which decreases with LL, and balancing the two leaves a d1/4d^{1/4} factor in the rate. As an alternate strategy, we use the fact that qq minimizes the fitting objective to analyze how the noise correlates with the moment error of the distribution we fit for qq. This correlation is controlled by a noise-weighted sum of re-centered Chebyshev polynomials Tj(θℓ⊤x)−Tj(0)T_j(\theta_\ell^\top x)-T_j(0), where re-centering is free (the constant term cancels in the correlation) and ensures each summand is bounded by O(j∣θℓ⊤x∣)O(j|\theta_\ell^\top x|). Examining this sum, we see it has variance proportional to λmax⁡(1L∑ℓθℓθℓ⊤)≈1/d\lambda_{\max}\left(\frac{1}{L}\sum_\ell\theta_\ell\theta_\ell^\top\right)\approx1/d, which cleanly cancels out the factor of dd in the numerator from the net argument given in the proof of Theorem 3.

We first record a bound that handles small LL and the regime d≥nϵd\ge n\epsilon.

Lemma 7. For any probability measures p,qp,q on Bd\mathcal{B}^d, SW⁡1(p,q)≤2/d\operatorname{SW}_1(p,q)\le2/\sqrt{d}.

Proof. Fix any coupling (x,y)(x,y) of pp and qq. Its projected pushforward under z↦θ⊤zz\mapsto\theta^\top z is a coupling of pˉθ\bar p_\theta and qˉθ\bar q_\theta, so SW⁡1(p,q)≤Ex,yEθ∣θ⊤(x−y)∣\operatorname{SW}_1(p,q)\le\mathbb{E}_{x,y}\mathbb{E}_\theta|\theta^\top(x-y)|. By rotational invariance of Unif⁡(Sd−1)\operatorname{Unif}(\mathbb{S}^{d-1}) and Jensen’s inequality, for any u∈Rdu\in\mathbb{R}^d, Eθ∣θ⊤u∣=∥u∥2Eθ∣θ1∣≤∥u∥2Eθθ12=∥u∥2/d\mathbb{E}_\theta|\theta^\top u|=\|u\|_2\mathbb{E}_\theta|\theta_1|\le\|u\|_2\sqrt{\mathbb{E}_\theta\theta_1^2}=\|u\|_2/\sqrt{d}. Since ∥x−y∥2≤2\|x-y\|_2\le2 for x,y∈Bdx,y\in\mathcal{B}^d, we recover the claim. □

We restate Theorem 5 before proving it.

Theorem 5. Let qq be the output of Algorithm 1. For any β∈(0,1)\beta\in(0,1), with probability at least 1−β1-\beta over the directions and Gaussian noise,

SW⁡1(p,q)≤36k+4β[σ2(1+log⁡k)log⁡(6Lk2)L]1/4+64βdlog⁡(6Lk2)L.(26)\operatorname{SW}_1(p,q)\le\frac{36}{k}+\frac{4}{\sqrt{\beta}}\left[\frac{\sigma^2(1+\log k)\log(6Lk^2)}{L}\right]^{1/4}+\frac{64}{\beta}\sqrt{\frac{d\log(6Lk^2)}{L}}. \tag*{(26)}

Proof. Fix the dataset and its empirical distribution pp. We first deal with the case L<4dlog⁡dL<4d\log d, which requires d≥2d\ge2. In that case the last term of equation (9) alone satisfies

64βdlog⁡(6Lk2)L≥64dlog⁡64dlog⁡d=32log⁡6log⁡d≥2d.\frac{64}{\beta}\sqrt{\frac{d\log(6Lk^2)}{L}}\ge64\sqrt{\frac{d\log6}{4d\log d}}=32\sqrt{\frac{\log6}{\log d}}\ge\frac{2}{\sqrt{d}}.

By Theorem 7, SW⁡1(p,q)≤2/d\operatorname{SW}_1(p,q)\le2/\sqrt{d}, so equation (9) holds with probability one. For the rest of the proof, assume L≥4dlog⁡dL\ge4d\log d. Let Φ\Phi denote the least-squares objective in Algorithm 1; a minimizer exists since probability measures on Bd\mathcal{B}^d are weakly compact and Φ\Phi is weakly continuous. Since pp is feasible and qq minimizes this objective, Φ(q)≤Φ(p)\Phi(q)\le\Phi(p). Use the noise ηj,ℓ∼N(0,jσ2)\eta_{j,\ell}\sim\mathcal{N}(0,j\sigma^2) from Algorithm 1. Here and below ∑ℓ,j\sum_{\ell,j} ranges over 1≤ℓ≤L1\le\ell\le L, 1≤j≤k1\le j\le k. Jensen’s inequality gives

Γ~k,L(p,q)≤(1L∑ℓ,j(mj(θℓ,q)−mj(θℓ,p))2j2)1/2.\widetilde{\Gamma}_{k,L}(p,q)\le\left(\frac{1}{L}\sum_{\ell,j}\frac{\left(m_j(\theta_\ell,q)-m_j(\theta_\ell,p)\right)^2}{j^2}\right)^{1/2}.

Expanding Φ(q)≤Φ(p)\Phi(q)\le\Phi(p) gives:

1L∑ℓ,j(mj(θℓ,q)−mj(θℓ,p)−ηj,ℓ)2j2≤1L∑ℓ,jηj,ℓ2j2⟹1L∑ℓ,j(mj(θℓ,q)−mj(θℓ,p))2j2≤2L∑ℓ,jηj,ℓ(mj(θℓ,q)−mj(θℓ,p))j2.(27)\begin{aligned} \frac{1}{L}\sum_{\ell,j}\frac{\left(m_j(\theta_\ell,q)-m_j(\theta_\ell,p)-\eta_{j,\ell}\right)^2}{j^2} &\le\frac{1}{L}\sum_{\ell,j}\frac{\eta_{j,\ell}^2}{j^2}\\ \Longrightarrow\quad\frac{1}{L}\sum_{\ell,j}\frac{\left(m_j(\theta_\ell,q)-m_j(\theta_\ell,p)\right)^2}{j^2} &\le\frac{2}{L}\sum_{\ell,j}\frac{\eta_{j,\ell}\left(m_j(\theta_\ell,q)-m_j(\theta_\ell,p)\right)}{j^2}. \tag*{(27)} \end{aligned}

Define the noise weighted sum of re-centered Chebyshev polynomials, for x∈Bdx \in\mathcal{B}^d, as,

G(x):=1L∑ℓ,jηj,ℓj2[Tj(θℓ⊤x)−Tj(0)].(28)G(x) := \frac{1}{L}\sum_{\ell,j}\frac{\eta_{j,\ell}}{j^2}\left[T_j(\theta_\ell^\top x)-T_j(0)\right]. \tag*{(28)}

The right side of equation 24 equals 2(EqG−EpG)2(\mathbb{E}_qG-\mathbb{E}_pG). Bounding EqG\mathbb{E}_qG by sup⁡x∈BdG(x)\sup_{x \in\mathcal{B}^d}G(x) and using EηEpG=0\mathbb{E}_\eta\mathbb{E}_pG=0 therefore gives, conditional on the directions,

Eη[1L∑ℓ,j(mj(θℓ,q)−mj(θℓ,p))2j2]≤2Eηsup⁡x∈BdG(x).(29)\mathbb{E}_\eta\left[\frac{1}{L}\sum_{\ell,j}\frac{(m_j(\theta_\ell,q)-m_j(\theta_\ell,p))^2}{j^2}\right]\leq2\mathbb{E}_\eta\sup_{x\in\mathcal{B}^d}G(x). \tag*{(29)}

This remains valid even though qq depends on the noise.

Let S=L−1∑ℓ=1Lθℓθℓ⊤S=L^{-1}\sum_{\ell=1}^L\theta_\ell\theta_\ell^\top be the empirical second-moment matrix of the directions. Since cosine is 1-Lipschitz, the identity Tj(u)=cos⁡(jarccos⁡u)T_j(u)=\cos(j\arccos u) gives ∣Tj(u)−Tj(0)∣≤j∣arccos⁡u−π/2∣=j∣arcsin⁡u∣|T_j(u)-T_j(0)|\leq j|\arccos u-\pi/2|=j|\arcsin u|, where we used arccos⁡u−π/2=−arcsin⁡u\arccos u-\pi/2=-\arcsin u. The elementary bound ∣arcsin⁡u∣≤(π/2)∣u∣|\arcsin u|\leq(\pi/2)|u| then gives ∣Tj(u)−Tj(0)∣≤(π/2)j∣u∣|T_j(u)-T_j(0)|\leq(\pi/2)j|u| for u∈[−1,1]u\in[-1,1]. Fix x∈Bdx\in\mathcal{B}^d and condition on the directions, so that the coefficients of the noises in G(x)G(x) are deterministic. Using Var⁡(ηj,ℓ)=jσ2\operatorname{Var}(\eta_{j,\ell})=j\sigma^2, we obtain,

Var⁡ηG(x)=1L2∑ℓ=1L∑j=1kjσ2j4[Tj(θℓ⊤x)−Tj(0)]2=σ2L2∑ℓ=1L∑j=1k[Tj(θℓ⊤x)−Tj(0)]2j3≤π2σ24L2∑ℓ=1L∑j=1k(θℓ⊤x)2j≤π2σ2(1+log⁡k)4L(1L∑ℓ=1L(θℓ⊤x)2)=π2σ2(1+log⁡k)4Lx⊤Sx.\begin{aligned} \operatorname{Var}_\eta G(x)=\frac{1}{L^2}\sum_{\ell=1}^L\sum_{j=1}^k\frac{j\sigma^2}{j^4}[T_j(\theta_\ell^\top x)-T_j(0)]^2 =\frac{\sigma^2}{L^2}\sum_{\ell=1}^L\sum_{j=1}^k\frac{[T_j(\theta_\ell^\top x)-T_j(0)]^2}{j^3} \\ &\leq\frac{\pi^2\sigma^2}{4L^2}\sum_{\ell=1}^L\sum_{j=1}^k\frac{(\theta_\ell^\top x)^2}{j} \leq\frac{\pi^2\sigma^2(1+\log k)}{4L}\left(\frac{1}{L}\sum_{\ell=1}^L(\theta_\ell^\top x)^2\right) \\ &=\frac{\pi^2\sigma^2(1+\log k)}{4L}x^\top Sx. \end{aligned}

The first inequality uses the Chebyshev bound above; the last line uses ∑j=1k1/j≤1+log⁡k\sum_{j=1}^k1/j\leq1+\log k and the definition of SS. Since SS is positive semidefinite and ∥x∥2≤1\|x\|_2\leq1, x⊤Sx≤λmax⁡(S)∥x∥22≤λmax⁡(S)x^\top Sx\leq\lambda_{\max}(S)\|x\|_2^2\leq\lambda_{\max}(S). Thus the conditional variance is at most π2σ2(1+log⁡k)λmax⁡(S)/(4L)\pi^2\sigma^2(1+\log k)\lambda_{\max}(S)/(4L), uniformly over x∈Bdx\in\mathcal{B}^d. For d≥2d\geq2, apply the matrix Bernstein expectation bound (Tropp, 2015, Theorem 6.6.1, Eq. (6.6.2)) to the independent, centered matrices Xℓ=θℓθℓ⊤−Id/dX_\ell=\theta_\ell\theta_\ell^\top-I_d/d. Isotropy gives EθXℓ2=(d−1)Id/d2\mathbb{E}_\theta X_\ell^2=(d-1)I_d/d^2, and λmax⁡(Xℓ)≤1\lambda_{\max}(X_\ell)\leq1, so

Eθλmax⁡(S)≤1d+2log⁡ddL+log⁡d3L≤2d.\mathbb{E}_\theta\lambda_{\max}(S)\leq\frac{1}{d}+\sqrt{\frac{2\log d}{dL}+\frac{\log d}{3L}}\leq\frac{2}{d}.

The last inequality uses L≥4dlog⁡dL\geq4d\log d; for d=1d=1, S=1S=1 deterministically. This supplies the factor 1/d1/d needed to cancel the dimension dependence in the logarithm of the net size below. Take a net Nρ\mathcal{N}_\rho as in equation (22), with mesh ρ=(Lk2)−1\rho=(Lk^2)^{-1} and size at most (6Lk2)d(6Lk^2)^d. The Gaussian maximum bound, first conditional on the directions and then averaged using Jensen’s inequality, gives

Eθ,η[1L∑ℓ,j(mj(θℓ,q)−mj(θℓ,p))2j2]≤πσ2L(1+log⁡k)dlog⁡(6Lk2)Eθλmax⁡(S)≤πσ(1+log⁡k)log⁡(6Lk2)L.\begin{aligned} \mathbb{E}_{\theta,\eta}\left[\frac{1}{L}\sum_{\ell,j}\frac{(m_j(\theta_\ell,q)-m_j(\theta_\ell,p))^2}{j^2}\right] \leq\frac{\pi\sigma}{\sqrt{2L}}\sqrt{(1+\log k)d\log(6Lk^2)\mathbb{E}_\theta\sqrt{\lambda_{\max}(S)}} \\ &\leq\pi\sigma\sqrt{\frac{(1+\log k)\log(6Lk^2)}{L}}. \end{aligned}

To extend this bound from the net to the ball, use ∣Tj′∣≤j2|T_j'| \le j^2 and the argument leading to equation (24). The resulting error is at most ρL−1∑ℓ,jE∣ηj,ℓ∣≤σL2πκ\rho L^{-1}\sum_{\ell,j}\mathbb{E}|\eta_{j,\ell}| \le\frac{\sigma}{L}\sqrt{\frac{2}{\pi\kappa}}. Thus equation (29) yields

Eθ,η[1L∑ℓ,j(mj(θℓ,q)−mj(θℓ,p))2j2]≤2πσ(1+log⁡k)log⁡(6Lk2)L+2σL2πκ\mathbb{E}_{\theta,\eta}\left[\frac{1}{L}\sum_{\ell,j}\frac{\left(m_j(\theta_\ell,q)-m_j(\theta_\ell,p)\right)^2}{j^2}\right] \le2\pi\sigma\sqrt{\frac{(1+\log k)\log(6Lk^2)}{L}}+\frac{2\sigma}{L}\sqrt{\frac{2}{\pi\kappa}}
≤8σ(1+log⁡k)log⁡(6Lk2)L.(30)\le8\sigma\sqrt{\frac{(1+\log k)\log(6Lk^2)}{L}}. \tag*{(30)}

Markov’s inequality therefore gives, with probability at least 1−β/21-\beta/2,

(1L∑ℓ,j(mj(θℓ,q)−mj(θℓ,p))2j2)1/2≤4β[σ2(1+log⁡k)log⁡(6Lk2)L]1/4.\left(\frac{1}{L}\sum_{\ell,j}\frac{\left(m_j(\theta_\ell,q)-m_j(\theta_\ell,p)\right)^2}{j^2}\right)^{1/2}\le\frac{4}{\sqrt{\beta}}\left[\frac{\sigma^2(1+\log k)\log(6Lk^2)}{L}\right]^{1/4}.

Combining this with Theorem 2, also at failure probability β/2\beta/2, proves that with probability at least 1−β1-\beta,

SW⁡1(p,q)≤36k+4β[σ2(1+log⁡k)log⁡(6Lk2)L]1/4+64βdlog⁡(6Lk2)L.\operatorname{SW}_1(p,q)\le\frac{36}{k}+\frac{4}{\sqrt{\beta}}\left[\frac{\sigma^2(1+\log k)\log(6Lk^2)}{L}\right]^{1/4}+\frac{64}{\beta}\sqrt{\frac{d\log(6Lk^2)}{L}}.

The simultaneous guarantee in Theorem 2 applies to the fitted qq, even though it depends on the directions and noise. This proves equation 9.

Chebyshev Moments for a Mixture of Categorical-Gaussian Product Distributions

In this section we describe how to efficiently compute the sliced Chebyshev moment, mj(θ,q^)=Ex∼q^[Tj(θTx)]m_j(\theta,\hat{q}) = \mathbb{E}_{x\sim\hat{q}}[T_j(\theta^T x)], for any direction θ∈Sd−1\theta\in S^{d-1} and any distribution q^\hat{q} that fits our mixture of categorical-Gaussian product distributions from § 4.

The computation is first simplified by passing to the standard moments. In particular, we can write the Chebyshev polynomial in the monomial basis as Tj(y)=∑t=0jcj,tytT_j(y) = \sum_{t=0}^{j} c_{j,t}y^t and then use that:

Ex∼q^[Tj(θTx)]=∑t=0jcj,tEx∼q^[(θTx)t].\mathbb{E}_{x\sim\hat{q}}[T_j(\theta^T x)] = \sum_{t=0}^{j} c_{j,t}\mathbb{E}_{x\sim\hat{q}}[(\theta^T x)^t].

We can further simplify the computation by splitting along the mixture components:

Ex∼q^[Tj(θTx)]=∑h=1Kπh∑t=0jcj,tEx∼q^h[(θTx)t].(31)\mathbb{E}_{x\sim\hat{q}}[T_j(\theta^T x)] = \sum_{h=1}^{K}\pi_h\sum_{t=0}^{j}c_{j,t}\mathbb{E}_{x\sim\hat{q}_h}[(\theta^T x)^t]. \tag*{(31)}

As in § 4, let C⊂{1,…,d}C \subset\{1,\ldots,d\} contain the indices of all categorical variables in our data vectors. Let N={1,…,d}∖CN = \{1,\ldots,d\}\setminus C contain the indices of all continuous variables. Let θN\theta_N and xNx_N denote the vectors θ\theta and xx restricted to the continuous indices. We have that:

θTx=∑a∈Cθaxa+θNTxN.\theta^T x = \sum_{a\in C}\theta_a x_a+\theta_N^T x_N.

We can thus compute Ex∼q^h[(θTx)t]\mathbb{E}_{x\sim\hat{q}_h}[(\theta^T x)^t] by iteratively applying the following standard expression, which holds for any independent random variables AA and BB:

E[(A+B)t]=∑s=0t(ts)E[As]E[Bt−s],(32)\mathbb{E}[(A+B)^t] = \sum_{s=0}^{t}\binom{t}{s}\mathbb{E}[A^s]\mathbb{E}[B^{t-s}], \tag*{(32)}

In this case, the variables {xa}a∈C\{x_a\}_{a\in C} and xNx_N are jointly independent. We have thus reduced our task to evaluating:

Ex∼q^h[(θaxa)t](a∈C)andEx∼q^h[(θNTxN)t](33)\mathbb{E}_{x\sim\hat{q}_h}[(\theta_a x_a)^t]\quad(a\in C) \qquad\text{and}\qquad \mathbb{E}_{x\sim\hat{q}_h}[(\theta_N^T x_N)^t] \tag*{(33)}

for all tt less than the maximum moment degree considered.

Since xax_a is a finite categorical variable, the first expectation reduces to a simple sum over the possible values of xax_a. For Ex∼q^h[(θNTxN)t]\mathbb{E}_{x\sim\hat{q}_h}[(\theta_N^T x_N)^t], we use that, when x∼q^hx\sim\hat{q}_h, θNTxN\theta_N^T x_N is a univariate Gaussian random variable with mean and variance:

νh=θNTμhandσh2=∥UhTθN∥22+∑i∈NDh,iθi2.\nu_h = \theta_N^T\mu_h \qquad\text{and}\qquad \sigma_h^2 = \lVert U_h^T\theta_N\rVert_2^2+\sum_{i\in N}D_{h,i}\theta_i^2.

We can then just apply standard closed form expressions for the raw moments of a univariate Gaussian (see (see Winkelbauer (2012)).

We implemented the procedure described above in Torch, then used Autograd to compute gradients when optimizing over the parameters of q^\hat{q}.

The SPLICE Algorithm with a Mixture of Categorical-Gaussian Product Distributions

Algorithm 2 restates the mechanism of § 4 as we actually run it. The private release is exactly that of Algorithm 1; the “Match” step is carried out by fitting the mixture of categorical-Gaussian product distributions Equation (12) using the exact, differentiable moment computation of Section D. Table 1 lists the implementation defaults used in every experiment.

Algorithm 2 SPLICE: Sliced Moment Matching with a Mixture of Categorical-Gaussian Product Distributions

Input: Dataset x1,…,xnx_1,\ldots,x_n; privacy parameters ε,δ>0\varepsilon,\delta> 0; components KK; covariance rank RR; column split into blocks C,NC,N.

Output: Synthetic distribution q^\hat{q} of the form Equation (12).

  1. Encode. Normalize each continuous column to [−1,1][-1,1] and map each categorical column’s levels to equally spaced grid values in [−1,1][-1,1], giving a design matrix X∈[−1,1]n×dX \in[-1,1]^{n \times d}.

  2. Hyperparameters. Set the maximum degree kk and number of directions LL (Table 1).

  3. Release. Sample public directions θ1,…,θL∼Unif⁡(Sd−1)\theta_1,\ldots,\theta_L \sim\operatorname{Unif}(S^{d-1}), compute the scaled sliced Chebyshev moments of the projections θℓTxi/d\theta_\ell^\mathsf{T}x_i/\sqrt{d}, and add Gaussian noise calibrated to the ℓ2\ell_2 sensitivity of the scaled moment vector via the analytic Gaussian mechanism.

  4. Fit. Minimize the weighted squared moment error between the noisy targets and the exact model moments by gradient descent, with the softmax and logarithmic parameterizations, warm start, restarts, averaging, and loss from main body.

  5. Sample. Draw components h∼πh \sim\pi, categorical levels from ϕ(h,a)\phi^{(h,a)}, continuous blocks from N(μh,Σh)\mathcal{N}(\mu_h,\Sigma_h), and de-normalize each column to its original range.

More implementation details Algorithm 2 inherits (ε,δ)(\varepsilon,\delta)-privacy by post-processing, with the scaled-moment sensitivity Δ2=4Ln2∑j=1k1j\Delta_2 = \sqrt{\frac{4L}{n^2}\sum_{j=1}^{k}\frac{1}{j}} of § 3 (we use the equivalent normalized basis Tˉj=2/πTj\bar{T}_j=\sqrt{2/\pi}T_j, with sensitivity 8Lπn2∑j=1k1j\sqrt{\frac{8L}{\pi n^2}\sum_{j=1}^{k}\frac{1}{j}}). Continuous columns are not rounded to a grid; a grid defines categorical values only. We calibrate σ\sigma with the analytic Gaussian mechanism (as do all baselines, where appropriate, for fairness).

For our objective minimization we use gradient descent on the model parameters, enforcing the simplex constraints on π\pi and on each ϕ(h,a)\phi^{(h,a)} by a softmax reparameterization and keeping the covariance diagonal positive through a logarithmic parameterization. We warm start the continuous-block means from the degree-one moments by least squares, since m1(θ,q^)m_1(\theta,\hat{q}) is linear in the means, and we stabilize the non-convex fit with random restarts (our experiments use one), an exponential moving average of the parameters (Polyak & Juditsky, 1992), a Huber loss that caps the influence of the noisiest high-degree residuals (Huber, 1992), and light entropy and ridge regularization. Note that all of these are standard moves, and additionally are post-processing with respect to the release of the noisy sliced Chebyshev moments.

Sampling. To draw a synthetic record we sample a component h∼πh \sim\pi, draw each categorical column independently from ϕ(h,a)\phi^{(h,a)}, draw the continuous block from N(μh,Σh)\mathcal{N}(\mu_h, \Sigma_h), clip it to the encoded range, and de-normalize. We note that clipping is also what squares the model with Theorem 5: the Gaussian block in Equation (12) has unbounded support, whereas the theorem is stated for distributions on Bd\mathcal{B}^{d}, so it is the clipped samples, rather than q^\hat{q} itself, that satisfy the support assumption. Since fitting q^\hat{q} and sampling from it are both post-processing of the noisy moments, privacy is unaffected either way. Finally, because the continuous block is Gaussian, samples are smooth and do not show the quantization artifacts of grid-based mechanisms.

Additional Setup, Experiments and Ablations

Public metadata convention. For a fair comparison, all methods are given the same kind of side information: column schema metadata is read off the training set and treated as public, so estimating it does not consume privacy budget. What each method reads differs. SPLICE uses only per-column bounds (minimum and maximum) and the level set of each categorical column. Private-GSD takes an explicit dictionary of bounds; AIM treats every column as categorical and reads the categories from the data; GEM uses quantile bin edges; and PrivBayes builds its support from the observed values. Treating this metadata as public is a small idealization, but it is the standard one in the literature. We note that two of the baselines are given strictly more than bounds: GEM’s quantile edges reveal the shape of each marginal, and AIM’s category lists reveal exactly which values occur. SPLICE has the smallest metadata footprint of the methods we compare.

Computational limits of baseline methods. Our comprehensive evaluation attempts 210×4×5=4200210 \times4 \times5 = 4200 generation tasks per algorithm (incorporating the 209 benchmark datasets along with one synthetic smoketest dataset excluded from the final metrics). We enforce a strict two-hour timeout per task (all methods were GPU accelerated, except for PrivBayes which has a fast C implementation). PrivBayes fails on 34 tasks due to the most massive datasets (its runtime scales as ≈n2\approx n^2, and our estimated runtime for these larger datasets was multiple days for the method). AIM with 2-way workloads fails on 34 tasks due to timeouts and GPU memory exhaustion, primarily at ϵ=10\epsilon= 10, where it allocates larger budgets across more measurement iterations; its 3-way variant drops 153 tasks across ten high-dimensional datasets, seven of which fail across all budgets regardless of row count. GEM utilizing 3-way workloads drops 50 tasks on wide datasets with high cardinality, whereas its 2-way version successfully completes all tasks. Private-GSD runs out of host memory on larger tables and is thus evaluated solely on the subsets in general (this is despite being run on an NVIDIA RTX PRO 6000 Blackwell GPU with 96 GB of VRAM). Conversely, SPLICE successfully executed all 16,800 of its generations, with no timeouts or out-of-memory errors. This reliability is a result of the method architecture: the sliced release compresses the data into fixed-size moment sketches, scaling linearly with nn and avoiding the combinatorial explosion associated with width, cardinality, or privacy budget.

Baseline implementations and parameter settings. We use the maintained or author-released implementation of every baseline. AIM runs through the OpenDP Library (https://github.com/opendp/opendp, version 0.1.4.2), whose implementation builds on the graphical-model inference of private-pgm (https://github.com/ryan112358/private-pgm, mbri 1.1.0). GEM uses the authors’ dp-query-release codebase (https://github.com/terranceliu/dp-query-release, consolidated into our harness without algorithmic changes. PrivBayes runs the authors’ reference C++ implementation through a wrapper following SDGym (https://github.com/sdv-dev/SDGym). Private-GSD uses the authors’ implementation (https://github.com/giusevtr/private_gsd). Causal discovery uses the GRaSP implementation in causal-learn (https://github.com/py-why/causal-learn). Every method runs with the settings recommended by its source implementation, and no method (including SPLICE, whose kk and LL follow the fixed formulas of Table 1) receives per-dataset hyperparameter tuning. The only per-baseline variation we report is the workload degree (2-way and 3-way marginals for AIM and GEM), shown as separate baselines, and all methods share the privacy accounting conventions and public metadata described above.

SPLICE Model Variants

The mixture of categorical-Gaussian product distributions from § 4 generalizes two simpler models: a CP-style mixture of categorical product distributions, and a low-rank Gaussian mixture. (Figure legends in this appendix abbreviate the full model as “mixed block”.) We also ran both of these special cases as SPLICE variants, fit to the exact same noisy moments. Figure 8 ranks the three on roughly 97 datasets, stratified by the fraction of discrete columns. The results are what the model classes suggest: the Gaussian mixture is best on continuous data, the CP model is best on discrete data (where the Gaussian mixture does poorly), and the full mixed model is best on mixed data.

Mean rank (lower = better) for continuous data, mixed data, and discrete data across $\varepsilon = 0.5$, $1.0$, $3.0$, and $10.0$, comparing SPLICE (CP), SPLICE (GMM), and SPLICE (mixed block)

Figure 8. Mean rank (lower is better) of the three SPLICE variants (CP, GMM, and the mixture of categorical-Gaussian product distributions, labeled “mixed block”), split by the fraction of discrete columns: continuous (≤0.3\le0.3), mixed, and discrete (≥0.7\ge0.7). Left to right, the strata contain n=50n = 50 to 51, 27, and 20 datasets per budget.

Figure 9 compares slicing to the multivariate Chebyshev mechanism of Musco et al. (2025) on 4-dimensional datasets, the only regime where the latter is computationally feasible. A sliced SPLICE variant is ranked first for every task type and budget. The multivariate variants are behind on regression at every ϵ\epsilon; multivariate CP reaches second on classification at the looser budgets but is never first. Against the full set of baselines, the multivariate variants rank at or near the bottom. In other words, slicing helps even when dd is small enough that the curse of dimensionality is not binding.

Mean rank (lower = better) for classification (AUC) and regression (MSE) across $\varepsilon = 0.5$, $1.0$, $3.0$, and $10.0$, comparing SPLICE (CP), SPLICE (GMM), SPLICE (mixed block), Multivar (CP), and Multivar (GMM)

Figure 9. Mean rank (lower is better) on 4-dimensional datasets (each restricted to its top 3 features), where the multivariate Chebyshev mechanism is still computationally feasible: the two multivariate variants against the sliced SPLICE variants. Left: classification, n=4n = 4 datasets. Right: regression, n=5n = 5.

Result Tables

This section gives the numbers behind the figures in the main text. Table 2 reports the five fidelity metrics at ε=1\varepsilon= 1, i.e., the components of the fidelity axis of Figure 1. Table 3 gives the mean fidelity rank at every budget. Table 4 gives mean TSTR rank by budget and task family on a fixed set of datasets, and Table 5 breaks the ε=1\varepsilon= 1 column down by downstream learner. Every table is computed from the same saved results and the same dataset filters as the figure it supports.

Method1-way TVD (n=58n = 58)2-way TVD (n=58n = 58)3-way TVD (n=58n = 58)MMD2^{2} (n=40n = 40)SW1_{1} (n=40n = 40)
PrivBayes0.214±0.0270.214 \pm0.0270.442±0.0370.442 \pm0.0370.642±0.0410.642 \pm0.0410.057±0.0160.057 \pm0.0160.032±0.0020.032 \pm0.002
AIM (2-way)0.143±0.0280.143 \pm0.0280.412±0.0380.412 \pm0.0380.638±0.0420.638 \pm0.0420.058±0.0120.058 \pm0.0120.036±0.0040.036 \pm0.004
AIM (3-way)0.143±0.0280.143 \pm0.0280.420±0.0380.420 \pm0.0380.650±0.0400.650 \pm0.0400.061±0.0120.061 \pm0.0120.039±0.0040.039 \pm0.004
GEM (2-way)0.189±0.0260.189 \pm0.0260.438±0.0360.438 \pm0.0360.658±0.0390.658 \pm0.0390.065±0.0160.065 \pm0.0160.036±0.0020.036 \pm0.002
GEM (3-way)0.243±0.0250.243 \pm0.0250.462±0.0360.462 \pm0.0360.662±0.0390.662 \pm0.0390.088±0.0180.088 \pm0.0180.045±0.0030.045 \pm0.003
Private-GSD0.270±0.0270.270 \pm0.0270.486±0.0350.486 \pm0.0350.668±0.0380.668 \pm0.0380.077±0.0130.077 \pm0.0130.047±0.0040.047 \pm0.004
Sliced (mixed block, ours)0.187±0.0130.187 \pm0.0130.388±0.0230.388 \pm0.0230.586±0.0300.586 \pm0.0300.043±0.0060.043 \pm0.0060.026±0.0030.026 \pm0.003

Table 2. Distributional fidelity at ε=1\varepsilon= 1, the five components of the Figure 1 fidelity axis. Each entry is the mean ±1\pm1 SEM over the datasets (nn per column) where every method has a value; lower is better and the best value per column is bold.

Methodε=0.5\varepsilon= 0.5ε=1.0\varepsilon= 1.0ε=3.0\varepsilon= 3.0ε=10.0\varepsilon= 10.0
PrivBayes5.003.403.003.20
AIM (2-way)1.402.403.003.40
AIM (3-way)2.603.604.605.00
GEM (2-way)2.804.205.605.60
GEM (3-way)5.406.207.006.80
Private-GSD7.006.803.402.40
Sliced (mixed block, ours)3.801.401.401.60

Table 3. Mean fidelity rank (over the five distributional metrics of Table 2) at every privacy budget. Rank 1 is best out of 7; the best value per column is bold.

Classification (n=91n = 91)Regression (n=67n = 67)
Methodε=0.5\varepsilon= 0.5ε=1.0\varepsilon= 1.0ε=3.0\varepsilon= 3.0ε=10.0\varepsilon= 10.0ε=0.5\varepsilon= 0.5ε=1.0\varepsilon= 1.0ε=3.0\varepsilon= 3.0ε=10.0\varepsilon= 10.0
PrivBayes3.13 ±0.162.95 ±0.172.32 ±0.151.71 ±0.114.07 ±0.193.36 ±0.193.06 ±0.212.27 ±0.18
AIM (2-way)4.52 ±0.154.22 ±0.173.68 ±0.163.27 ±0.173.37 ±0.163.45 ±0.173.49 ±0.183.78 ±0.18
AIM (3-way)4.98 ±0.125.11 ±0.115.14 ±0.124.93 ±0.133.54 ±0.193.91 ±0.184.21 ±0.154.30 ±0.15
GEM (2-way)2.64 ±0.162.71 ±0.153.35 ±0.163.90 ±0.153.64 ±0.213.73 ±0.204.12 ±0.194.27 ±0.18
GEM (3-way)2.79 ±0.173.12 ±0.163.44 ±0.173.98 ±0.153.79 ±0.204.36 ±0.194.40 ±0.184.66 ±0.16
Sliced (mixed block, ours)2.95 ±0.162.89 ±0.163.07 ±0.173.20 ±0.172.58 ±0.252.19 ±0.221.72 ±0.131.73 ±0.10

Table 4. Downstream TSTR mean rank (±1 SEM across datasets) by privacy budget and task family, best downstream learner per dataset. Datasets are the fixed sets of well-formed tasks covered by every shown method at every budget, so the composition is identical across columns; rank 1 is best out of 6 and the best value per column is bold. Private-GSD is excluded because it covers only 10 of the 73 well-formed regression datasets.

ClassificationRegression
MethodLogReg/RidgeRFXGBTabPFNLogReg/RidgeRFXGBTabPFN
PrivBayes3.022.562.712.853.273.043.183.40
AIM (2-way)4.244.084.034.143.433.963.973.34
AIM (3-way)4.924.814.804.923.703.964.033.76
GEM (2-way)3.153.313.193.164.163.913.943.75
GEM (3-way)3.133.413.363.104.334.104.064.43
Sliced (mixed block, ours)2.532.842.902.832.102.031.822.31

Table 5. Downstream TSTR mean rank at ε=1\varepsilon= 1 broken out by downstream learner (the linear column is logistic regression on classification and ridge on regression). Same fixed dataset sets and rank convention as Table 4; the headline figures use the best learner per dataset.

Dataset details

DatasetTaskntrainn_{\mathrm{train}}ntestn_{\mathrm{test}}num.cat.WF
1000-Cameras-Datasetregression830208100✓
2dplanesregression32,6148,154100✓
3D_Estimation_using_RSSI_of_WLAN_datasetregression4,6081,15260✓
3D_Estimation_using_RSSI_of_WLAN_dataset_c...regression11,5202,880120✓
abalonemulticlass3,34183671✓
Abalone_regregression3,34183671✓
accelerometermulticlass122,40330,60131✓
ada_priorbinary3,64991368✓
airfoil_self_noiseregression1,20230150✓
airlines_seed_0_nrows_2000_nclasses_10_nco...binary1,60040034
Amazon_employee_accessbinary26,2156,55407✓
analcatdata_supremeregression3,24181170✓
Another-Dataset-on-used-Fiat-500-(1538-rows)regression1,23030860✓
archive2regression914229111✓
artificial-charactersmulticlass8,1742,04470✓
auction_verificationregression1,63440961✓
autoUniv-au7-1100multiclass88022084
avocado_salesregression14,5993,650112✓
bankbinary36,1689,04379✓
bank8FMregression6,5531,63980✓
Bank_Customer_Churn_Datasetbinary8,0002,00064✓
banknote_authenticationbinary1,09727540
baseballmulticlass1,072268151✓
Basketball_cbinary1,072268110✓
Bias_correction_rregression6,1801,545210✓
Bias_correction_r_2regression6,1801,545210✓
BLE_RSSI_dataset_for_Indoor_localizationmulticlass7,9871,99730✓
BNG(breast-w)binary31,4927,87490✓
BNG(cmc)multiclass44,23611,06027✓
BNG(echoMonths)regression13,9963,50053✓
BNG(lowbwt)regression24,8836,22127✓
BNG(mv)regression62,98515,74773✓
BNG(stock)regression47,23911,81090✓
BNG(tic-tac-toe)binary31,4927,87409✓
Brazilian_houses_reproducedregression8,5532,13980✓
California-Housing-Classificationbinary16,5124,12880✓
car-evaluationmulticlass1,382346021✓
Cardiovascular-Disease-datasetbinary56,00014,00056✓
CDC_Diabetes_Health_Indicatorsbinary202,94450,736714✓
churnbinary4,0001,000164✓
Click_prediction_smallbinary31,9587,99030
cmcmulticlass1,17829527✓
combined_cycle_power_plantregression7,6541,91440✓
compassbinary13,3153,32989✓
compass_regregression13,3153,329170✓
concrete_compressive_strengthregression82420680✓
contraceptive_method_choicemulticlass1,17829554✓
CookbookReviewsregression14,5453,63770
CPMP-2015-runtime-regressionregression1,686422221✓
DatasetTaskntrainn_{\mathrm{train}}ntestn_{\mathrm{test}}num.cat.WF
CPS1988regression22,5245,63124
cpu_actregression6,5531,639210✓
cpu_smallregression6,5531,639120✓
creditbinary13,3713,343100✓
Credit_cmulticlass80,00020,000175✓
credit_regregression13,3713,343100✓
Customer_Personality_Analysisbinary1,792448222✓
customer_satisfaction_in_airlinebinary103,90425,976417✓
diabetes_130-us_hospitalsbinary81,41220,354812
Data_Science_for_Good_Kiva_Crowdfundingmulticlass536,964134,24174✓
Data_Science_Salariesregression3,00475114
dataset_salesregression8,5902,148100✓
debutanizerregression1,91547970✓
default_of_credit_card_clientsbinary24,0006,000149✓
delta_aileronsbinary5,7031,42650✓
delta_elevatorsregression7,6131,90460✓
Diabetic_Retinopathy_Debrecenbinary920231163✓
Diamondsregression43,15210,78863✓
drug_consumptionmulticlass1,507377120
dry_bean_datasetmulticlass10,8882,723160✓
E-CommereShippingDatabinary8,7992,20064✓
eeg-eye-statebinary11,9842,996140✓
electricitybinary36,2499,06371✓
elevatorsregression13,2793,320180✓
Employeebinary3,72293135✓
estimation_of_obesity_levelsmulticlass1,68842388✓
eye_movements_binbinary6,0861,522200✓
FICO-HELOC-cleanedbinary7,8961,975212✓
fifaregression14,4503,61350✓
Firm-Teacher Clave-Direction Classificationmulticlass8,6402,160016✓
Fitness_Club_cbinary1,20030033✓
Food_Delivery_Timeregression36,4749,11962✓
FOREX_audcad-day-Highbinary1,467367100✓
FOREX_audcad-hour-Highbinary35,0608,765100✓
FOREX_audchf-day-Highbinary1,466367100✓
FOREX_audjpy-day-Highbinary1,465367100✓
FOREX_audjpy-hour-Highbinary35,0608,765100✓
FOREX_audsgd-hour-Highbinary35,0608,765100✓
FOREX_audusd-hour-Highbinary35,0608,765100✓
FOREX_cadjpy-day-Highbinary1,467367100✓
FOREX_cadjpy-hour-Highbinary35,0608,765100✓
friedregression32,6148,154100✓
GAMETES_Epistasis_2-Way_20atts_0.1H_EDM-1_1binary1,280320020
GAMETES_Heterogeneity_20atts_1600_Het_0.4_...binary1,280320020✓
garments_worker_productivityregression95724085✓
gas_turbine_CO_and_NOx_emissionregression29,3867,347100✓
Gender_Gap_in_Spanish_WPmulticlass3,796950130
golf_play_dataset_extendedbinary87621936✓
Goodreads-Computer-Booksregression98724750
healthcare_insurance_expensesregression1,07026833✓
Heart-Disease-Dataset-(Comprehensive)regression952238110✓
helocbinary8,0002,000220✓
house_16Hbinary10,7902,698160✓
house_16H_regregression18,2274,557160✓
house_8Lregression18,2274,55780✓
house_sales_reducedregression17,2904,323180✓
DatasetTaskntrainn_{\mathrm{train}}ntestn_{\mathrm{test}}num.cat.WF
housesregression16,5124,12880✓
housing_price_predictionregression43610957✓
HR_Analytics_Job_Change_of_Data_Scientistsbinary15,3263,832310✓
htrubinary14,3183,58080✓
in_vehicle_coupon_recommendationbinary10,1472,537021✓
INNHotelsGroupbinary29,0207,255116✓
Insuranceregression18,8384,71037
internet_firewallmulticlass52,42513,10770✓
Intersectional-Bias-Assessmentregression8,8002,200145✓
Is-this-a-good-customerregression1,37834594
JapaneseVowelsmulticlass7,9681,993140✓
jm1binary8,7082,177210✓
jungle_chess_2pcs_raw_endgame_completemulticlass35,8558,96460✓
Kaggle_bike_sharing_demand_challangeregression8,7082,17836✓
kc1binary1,687422210✓
kdd_ipums_la_97-smallbinary4,1501,038200✓
kin8nmregression6,5531,63980✓
kr-vs-kmulticlass22,4445,61233✓
kroptmulticlass22,4445,61206✓
Laptop_Prices_Datasetregression3,55288980✓
law-school-admission-bianryregression16,6404,16074✓
led24multiclass2,560640024✓
led7multiclass2,56064007✓
lettermulticlass16,0004,000150✓
Longregression3,581896190✓
MagicTelescopebinary15,2163,80490✓
mammographybinary8,9462,23760✓
maternal_health_riskmulticlass81120360✓
mauna-loa-atmospheric-co2regression1,78044551✓
mfeat-morphologicalmulticlass1,60040060✓
MiamiHousing2016regression11,1452,787160✓
microaggregation2multiclass16,0004,000200✓
mobile_c36_oversamplingbinary41,40810,35260✓
Mobile_Phone_Market_in_Ghanaregression2,880720410✓
Mobile_Price_Classificationmulticlass1,600400146✓
mozilla4binary12,4363,10940✓
mvregression32,6148,15473✓
NASA_PHM2008regression36,7349,184210✓
national-longitudinal-survey-binarybinary3,92698297✓
National_Health_and_Nutrition_Health_Surveybinary1,82245670✓
NHANES_age_predictionregression1,82145643✓
okcupid_stemmulticlass21,3415,336211✓
online_shoppersbinary9,8642,46659✓
page-blocksmulticlass4,3781,095100✓
Parkinsons_Telemonitoringregression4,7001,175181✓
pc1binary887222210✓
pendigitsmulticlass8,7932,199160✓
Performance-Predictionregression1,072268190
phonemebinary4,3231,08150✓
Physicochemical_rregression36,5849,14690✓
Pima_Indians_Diabetes_Databasebinary61415480✓
puma8NHregression6,5531,63980✓
Pumpkin_Seedsbinary2,000500120✓
qsar_aquatic_toxicityregression43611080✓
qsar_fish_toxicityregression72618242✓
Rain_in_Australiamulticlass116,36829,092126✓
DatasetTaskntrainn_{\mathrm{train}}ntestn_{\mathrm{test}}num.cat.WF
rice_camemeo_and_osmancikbinary3,04876270✓
ringnormbinary5,9201,480200✓
rlbinary3,97699457✓
SDSS17multiclass80,00020,00084✓
segmentmulticlass1,848462170✓
seismic+bumpsbinary2,067517144
sensoryregression460116011
shill-biddingregression5,0561,26530
Shippingregression8,7992,20054
Shop_Customer_Dataregression1,60040042
shrutimeregression8,0002,00046✓
shuttlemulticlass46,40011,60090
Smoking_and_Drinking_Dataset_with_body_signalbinary793,076198,270221✓
socmobregression92423214✓
space_garegression2,48562260✓
statlogbinary800200713✓
steel_industry_energy_consumptionregression28,0327,00873✓
stockregression76019090✓
stock_fardamento02regression5,0211,25651
sulfurregression8,0642,01760✓
svmguide3regression994249220✓
sylvinebinary4,0991,025200✓
telco-customer-churnbinary5,6341,409315✓
Telecom_Churn_Datasetbinary2,666667143✓
thyroidmulticlass5,7601,440210✓
thyroid-annmulticlass3,017755210✓
treasuryregression839210150✓
twonormbinary5,9201,480200✓
vehiclemulticlass676170180✓
VulNoneVulregression4,5531,139160
walking-activitymulticlass119,46529,86740✓
wall-robot-navigationmulticlass4,3641,092240✓
water-qualitybinary6,3961,600200✓
Water_Quality_and_Potabilitybinary2,62065680
Waterstressregression950238220
waveform_database_generatormulticlass3,9991,000210
waveform_database_generator_version_1multiclass4,0001,000210✓
weather_izmirregression1,16829390✓
website_phishingmulticlass1,08227109✓
Wiltbinary3,85696550✓
windregression5,2591,315140✓
winebinary2,04351140✓
wine+qualityregression5,1971,300110✓
wine-quality-redmulticlass1,27932040✓
wine-quality-whitemulticlass3,918980110✓
Wine_Quality_redregression1,279320110✓
Wine_Quality_whiteregression3,918980110✓
yeastmulticlass1,18729780✓

Table 6. The 209 TALENT datasets in the benchmark: task type, training and test rows, numerical and categorical feature counts, and whether the dataset enters the well-formed aggregate set (WF; real-data ceiling AUC ≥0.7\ge0.7 or R2≥0.3R^2 \ge0.3). A few long dataset names are truncated.

Resource Scaling and Compute

The real-world viability of a synthetic data algorithm hinges heavily on its resource consumption alongside its statistical utility, so we document the measured wall-clock time and memory usage for each method using a standardized protocol. All benchmarks process a single task per GPU at ϵ=1\epsilon= 1, timing the fitting and sampling phases together, with peak resident memory recorded from the operating system and peak GPU memory tracked via NVML.

Cross-method comparison. On benchmark datasets ranging from 760 to 63,000 training rows, SPLICE’s cost is nearly flat: fit plus sampling takes 20 to 60 seconds, about 2 GB of resident memory, and under 1 GB of GPU memory. The reason is simple. The release is a single O(n)O(n) pass over the data, and the fit only ever touches the LkLk released moments. On this range only PrivBayes (2 to 12 seconds, CPU only) and GEM are faster. Private-GSD goes from 52 seconds to a timeout at 63,000 rows, and 3-way AIM spikes on wide datasets. All numbers are averages over three seeds.

Cost of generation across methods and training-row counts

Figure 10. Cost of generation at ϵ=1\epsilon= 1: total wall time (log scale; open triangles are timeouts), peak resident memory, and peak GPU memory. Datasets, left to right: stock, phoneme, telco-customer-churn, California-Housing-Classification, BNG(mv). Markers are means over three seeds with ±1\pm1 SEM error bars; a timed-out cell is a single run stopped at the limit.

Per-method scaling laws. We repeat the measurement on a controlled grid built from one large mixed dataset: a row sweep from 12,500 to 400,000 rows at d=12d = 12, and a column sweep from 6 to 24 columns at n=50,000n = 50,000. Fitting t∝nαcdt \propto n^{\alpha}c^{d}, where α\alpha is the row exponent and cc the per-column multiplier, the SPLICE variants are essentially flat in both (α≤0.09\alpha\le0.09, c≤1.05c \le1.05) and finish in 30 to 120 seconds everywhere on the grid. GEM is similarly flat because it runs a fixed number of epochs. 2-way AIM grows moderately with nn (α≈0.55\alpha\approx0.55); 3-way AIM does not depend on nn but pays a factor of about 1.16 per column, going from 61 seconds at 6 columns to 960 seconds at 24. PrivBayes depends on both through its parent-set search, and scales as n2.2n^{2.2} on wide tables. Private-GSD is the most expensive by far: 659 to 1,470 seconds across seeds at only 12,500 rows, the 2,400-second limit on two of three seeds at 25,000 rows, and a timeout beyond that even at 6 columns. So, among the methods we test, only the SPLICE variants are both accurate on continuous features and insensitive to growth in either nn or dd.

Compute. All experiments ran on a single server with two AMD EPYC 9354 processors (64 cores, 128 threads), 512 GB of RAM, and six NVIDIA RTX PRO 6000 Blackwell GPUs with 96 GB of memory each. Every generation task fits comfortably on one GPU; the resource measurements of § 16 run one task at a time per GPU, while the sweeps schedule independent tasks across GPUs in parallel. SPLICE itself is light: a single fit-plus-sample cell takes 20 to 120 seconds and under 1 GB of GPU memory, so its full 16,800-cell sweep totals roughly 200 GPU-hours and would run on one consumer-grade GPU in about a week. The overall benchmark cost is dominated by the baselines.

Controlled scaling plots of wall time against training rows and columns

Figure 11. Controlled scaling at ϵ=1\epsilon= 1: wall time against number of training rows at d=12d = 12 (left, log-log) and against number of columns at n=50,000n = 50{,}000 (right). Markers are means over three seeds with ±1\pm1 SEM error bars; open triangles are runs that hit the time limit.

References

  1. [1]John Abowd, Robert Ashmead, Simson Garfinkel, Daniel Kifer, Philip Leclerc, Ashwin Machanavajjhala, Brett Moran, and William Sexton. Census TopDown: Differentially private data, incremental schemas, and consistency with public knowledge. Draft working paper, U.S. Census Bureau, July 2019. URL https://systems.cs.columbia.edu/private-systems-class/papers/Abowd2019Census.pdf.
  2. [2]John M. Abowd, Robert Ashmead, Ryan Cumings-Menon, Simson Garfinkel, Micah Heineck, Christine Heiss, Robert Johns, Daniel Kifer, Philip Leclerc, Ashwin Machanavajjhala, Brett Moran, William Sexton, Matthew Spence, and Pavel Zhuravlev. The 2020 census disclosure avoidance system TopDown algorithm. Harvard Data Science Review, 2022. URL https://hdsr.mitpress.mit.edu/pub/7evz361i. Special Issue 2.arxiv.org/abs/2204.08986
  3. [3]Sergul Aydore, William Brown, Michael Kearns, Krishnaram Kenthapadi, Luca Melis, Aaron Roth, and Ankit A. Siva. Differentially private query release through adaptive projection. In Marina Meila and Tong Zhang (eds.), Proceedings of the 38th International Conference on Machine Learning (ICML), pp. 457–467, 18–24 Jul 2021. URL https://proceedings.mlr.press/v139/aydore21a.html.arxiv.org/abs/2103.06641
  4. [4]Boaz Barak, Kamalika Chaudhuri, Cynthia Dwork, Satyen Kale, Frank McSherry, and Kunal Talwar. Privacy, accuracy, and consistency too: a holistic solution to contingency table release. In Proceedings of the 26th Symposium on Principles of Database Systems (PODS), pp. 273–282, 2007.
  5. [5]Avrim Blum, Katrina Ligett, and Aaron Roth. A learning theory approach to noninteractive database privacy. J. ACM, 60(2):12:1–12:25, 2013.DOI
  6. [6]March Boedihardjo, Thomas Strohmer, and Roman Vershynin. Private measures, random walks, and synthetic data. Probability theory and related fields, 189(1–2):569–611, 2024.DOI
  7. [8]Clément Bonet, Paul Berg, Nicolas Courty, François Septier, Lucas Drumetz, and Minh-Tan Pham. Spherical sliced-Wasserstein. In Proceedings of the 11th International Conference on Learning Representations (ICLR), 2023. URL https://openreview.net/forum?id=jXQ0ipgMdU.arxiv.org/abs/2206.08780
  8. [9]Nicolas Bonneel, Julien Rabin, Gabriel Peyré, and Hanspeter Pfister. Sliced and Radon Wasserstein barycenters of measures. Journal of Mathematical Imaging and Vision, 51(1):22–45, 2015.
  9. [10]Vladimir Braverman, Aditya Krishnan, and Christopher Musco. Sublinear time spectral density estimation. In Proceedings of the 54th Annual ACM Symposium on Theory of Computing (STOC), pp. 1144–1157, 2022.DOI
  10. [11]Kuntai Cai, Xiaoyu Lei, Jianxin Wei, and Xiaokui Xiao. Data synthesis via differentially private Markov random fields. Proceedings of the VLDB Endowment, 14(11):2190–2202, 2021.DOI

Paper details

vlnc:W_attpd8u6
v1 · latestHistory (1)

published · Fresh — added to the Hub within the last 30 days

added ·

Usage

views · 8

downloads · 0

A view counts once per browser per day, a download each time the PDF is requested.

CC BY 4.0

Original source

  • Computer Science

Not recorded for this paper · View statement →

Looking for related papers…
Contents