Introduction
Context and motivations
Property testing In this era of big data, even just reading the input in its entirety can be prohibitively costly. However, from a practical perspective, we can often tolerate some sort of approximation. The field of property testing focuses on such a setting: here the goal is to distinguish whether the input object (in this work a function or a graph) satisfies some property of interest, or is far from all such objects under some suitable distance measure, by accessing the input as few times as possible. The tester can either accept or reject when the distance of the input from the property does not satisfy the condition. Perhaps surprisingly, it is often possible to design testers whose complexity scales sublinearly with the size of the input. Over the last two and a half decades, property testing has become a vast and active area of research, see [25 , 13 Ron09, 19 RS11, 15 , 16 ] for more details.
Property testing has naturally also been explored in the quantum setting [24 , 10 ] . For several important problems such as junta testing, graph isomorphism, bipartiteness and expansion testing, polynomial quantum speedups are known [2 , 1 , 3 , 14 ] , see the survey [31 ] for a detailed discussion. Naturally, understanding the limit of quantum advantage has been a prime focus in the community.
Our starting point is a function f : [ N ] → [ N ] f : [N] \to[N] f : [ N ] → [ N ] , where [ N ] = { 1 , … , N } [N] = \{1,\ldots,N\} [ N ] = { 1 , … , N } . For a property (aka. collection) P \mathcal{P} P of such functions, the input is ε \varepsilon ε -far from P \mathcal{P} P if at least ε N \varepsilon N εN values must be changed to obtain a function in P \mathcal{P} P . Given oracle access to an unknown function f f f , an ε \varepsilon ε -tester must distinguish whether f ∈ P f \in\mathcal{P} f ∈ P , or ε \varepsilon ε -far from P \mathcal{P} P with success probability at least 2 / 3 2/3 2/3 , by performing as few queries as possible to the oracle of f f f . A classical query reveals f ( i ) f(i) f ( i ) at a chosen index i ∈ [ N ] i \in[N] i ∈ [ N ] , while a quantum algorithm has coherent access to f f f , and can query several indices in quantum superposition.
Many natural properties of interest, such as injectivity, the absence of k k k -collisions, or having an image of at least a given size, depend only on how many times each output value occurs, i.e., on their frequencies (aka. multiplicities). Writing
c y = ∣ { i ∈ [ N ] : f ( i ) = y } ∣ , c_y = |\{i \in[N] : f(i) = y\}|, c y = ∣ { i ∈ [ N ] : f ( i ) = y } ∣ ,
the image size of f f f is the number of y y y with c y > 0 c_y > 0 c y > 0 , and f f f has a k k k -collision precisely when some c y ≥ k c_y \ge k c y ≥ k . The vector c = ( c 1 , c 2 , … ) \mathbf{c} = (c_1,c_2,\ldots) c = ( c 1 , c 2 , … ) is called the frequency vector of f f f . Indeed, these properties remain invariant under permutations of the input indices and the output labels. Such properties are called symmetric or label-invariant properties and play an important role in both classical and quantum property testing, and have been extensively studied in the literature, see [Val11, VV11, VV17, WY19, CFG+25] and the references therein.
Since these symmetric properties only depend on the multiplicities of the output labels, a natural approach to prove lower bounds for such properties is to consider hard instances based on frequencies and then randomize the positions and labels. Thus the task is to construct two hard input instances (or distributions of instances), one in the property P \mathcal{P} P , and another far from P \mathcal{P} P , and prove that any algorithm performing only a few queries cannot reliably distinguish them.
Moment-matching method Moment-matching method is a powerful classical framework that is used to achieve this dichotomy. In general, for some symmetric property P \mathcal{P} P , a pair of input instances with one instance in the property P \mathcal{P} P and the other being far from P \mathcal{P} P , and whose moments match up to ( r − 1 ) (r-1) ( r − 1 ) moments for some integer r r r , would require Ω ( N 1 − 1 / r ) \Omega(N^{1-1/r}) Ω ( N 1 − 1/ r ) queries to distinguish them with probability at least 2/3. To build its intuition, let us consider the example of distinguishing a uniformly random 1-to-1 function f 0 : [ N ] → [ N ] f_0 : [N] \to[N] f 0 : [ N ] → [ N ] from a uniformly random 2-to-1 function f 1 : [ N ] → [ N ] f_1 : [N] \to[N] f 1 : [ N ] → [ N ] . Let us choose a label Y Y Y uniformly from [ N ] [N] [ N ] , and let Z b = ∣ f b − 1 ( Y ) ∣ Z_b = |f_b^{-1}(Y)| Z b = ∣ f b − 1 ( Y ) ∣ for b ∈ { 0 , 1 } b \in\{0,1\} b ∈ { 0 , 1 } . Note that Z 0 = 1 Z_0 = 1 Z 0 = 1 with probability 1 and Z 1 Z_1 Z 1 is either 0 or 2, each with probability 1/2. Then the moment-matching method proves that distinguishing between these two cases with probability at least 2/3 requires Ω ( N 1 − 1 / 2 ) \Omega(N^{1-1/2}) Ω ( N 1 − 1/2 ) queries.
The intuition for this framework stems from the fact that since P \mathcal{P} P is symmetric, moments are all that matter . One can alternatively define X 0 X_0 X 0 and X 1 X_1 X 1 for the non-zero frequencies. In that case, Y Y Y is uniformly sampled from f ( [ N ] ) f([N]) f ([ N ]) . Then Y 0 = 1 Y_0 = 1 Y 0 = 1 and Y 1 = 2 Y_1 = 2 Y 1 = 2 with probability 1 for our example. One can show that exact moment matching for Z 0 , Z 1 Z_0, Z_1 Z 0 , Z 1 can be translated to proportional moment matching for X 0 , X 1 X_0, X_1 X 0 , X 1 , and this is usually the expression that is used in the literature.
The classical moment matching framework was introduced in the seminal work of [RRSS09], where the authors used this framework to prove lower bounds on estimating the support size and the entropy of a distribution, and the number of distinct elements in a sequence. Then [VV11] extended this framework to approximately matching moments and proved lower bounds on various distribution testing problems such as distance estimation. Later, Wu and Yang [WY19] connected the matching moments framework to polynomial approximation and obtained sharp bounds for entropy and support-size estimation. Since then, there have been a flurry of results in the context of proving distribution testing lower bounds that employ this framework [4 , 18 , 21 , 26 , 20 ] . The same framework was used to prove a k k k -collision-freeness lower bound by Hellweg and Sohler [28 ] for k = 3 k = 3 k = 3 , which was later extended to arbitrary k k k by Peng and Wang [33 ] , which they transfer to directed subgraph-freeness via a reduction.
Notably, there are two important ingredients of this framework: (i) when using it, one has to construct suitable random variables so that the framework can be applied; and (ii) the proof of the framework provides that no algorithm can reliably distinguish them by performing only a few queries. While these series of works use different input instance constructions and moment conditions, all of these proofs use the Poissonization trick : instead of considering a fixed number of samples, taking a set of samples distributed according to the Poisson distribution makes the frequencies of different symbols independent, thereby greatly simplifying the proofs.
Toward a quantum analogue Due to the wide success of this framework and its simplicity to use in practice for proving new lower bounds, it was naturally considered whether a similar lower bound framework exists for the quantum query model. Ambainis, Belovs, Regev, and de Wolf [1 ] were the first to propose whether combining the construction of [RRSS09] with quantum lower-bound techniques could be used to obtain stronger bounds for junta testing [1 ] . Without answering directly to this question, several problems, for which the moment matching frameworks can be applied classically, were studied in the quantum setting using mostly the dual polynomial method and quite involved mathematical constructions. First, improved lower bounds for junta testing and several other important problems, like image size testing, were achieved in a subsequent work [11 ] . Later on, [AMS25] establishes lower bounds for collision-freeness and directed subgraph-freeness testing, which was later extended by [PW27]. Thus, quantum lower bounds of some specific problems were tackled, but not directly the general matching moments method. We now briefly discuss the bottleneck.
Recall that the second ingredient of matching-moments-based lower bound proofs is to prove indistinguishability : a classical algorithm that performs too few queries cannot reliably distinguish between the two hard distributions. Since the use of Poissonization makes the number of occurrences of every label independent, it allows to compare the histogram distributions based on the input distributions. Since the property is symmetric, the algorithm’s decision depends only on this histogram. Consequently, if two histogram distributions are close in total variation distance, no algorithm making only a few queries can distinguish them with high probability.
However, a quantum algorithm can query several indices of the input in superposition, without measuring the answer register after each query. In fact, measuring the outcome of each query can remove coherence used by subsequent queries and thereby change the algorithm’s acceptance probability. Thus, even for symmetric properties, a quantum query algorithm cannot be analyzed by merely processing a classical histogram constructed from its samples. A quantum moment-matching argument must therefore control what coherent queries can distinguish, which has not been studied in the literature. Thus, despite a long series of works, the following question remained wide open:
Does there exist a quantum moment matching framework for proving quantum query lower bounds?
Our results
In this work, we answer the above question in the affirmative:
There exists a quantum moment matching framework for proving quantum query lower bounds.
We prove that indeed such a general lower bound framework exists in the quantum query realm, transferring each corresponding classical bound Ω ( N 1 − 1 / r ) \Omega(N^{1-1/r}) Ω ( N 1 − 1/ r ) to the quantum bound O ( N 1 / 2 − 1 / ( 2 r ) ) O(N^{1/2-1/(2r))} O ( N 1/2 − 1/ ( 2 r )) , and even sometimes to the higher bound Ω ( N 1 / 2 − 1 / ( 2 ( 2 r − 1 ) ) ) \Omega(N^{1/2-1/(2(2^{r-1}))}) Ω ( N 1/2 − 1/ ( 2 ( 2 r − 1 )) ) .
Quantum analogue of classical moment matching framework We provide two variants of the moment matching theorem: the first one works for a large range of parameters, useful for broader applicability, whereas the second one, while restricted to smaller parameter ranges, yields better bounds on several problems of interest. Let us start with the first variant of our quantum moment matching framework.
In both theorems, we start as in the classical setting. Fix an integer A ≥ 1 A \ge1 A ≥ 1 . Suppose X 0 , X 1 X_0, X_1 X 0 , X 1 are two random variables supported on [ A ] [A] [ A ] such that for an integer r ≥ 2 r \ge2 r ≥ 2 ,
E [ X 1 ] E [ X 0 ] = E [ X 1 2 ] E [ X 0 2 ] = ⋯ = E [ X 1 r − 1 ] E [ X 0 r − 1 ] . (1) \frac{\mathbb{E}[X_1]}{\mathbb{E}[X_0]} = \frac{\mathbb{E}[X_1^2]}{\mathbb{E}[X_0^2]} = \cdots= \frac{\mathbb{E}[X_1^{r-1}]}{\mathbb{E}[X_0^{r-1}]}. \tag*{(1)} E [ X 0 ] E [ X 1 ] = E [ X 0 2 ] E [ X 1 2 ] = ⋯ = E [ X 0 r − 1 ] E [ X 1 r − 1 ] . (1)
These random variables refer to the statistics of the frequency vector of any candidate function in the hard distributions. Indeed from them, and any given integer N ≥ 1 N \ge1 N ≥ 1 , one can construct a pair of hard distributions Π 0 , N \Pi_{0,N} Π 0 , N and Π 1 , N \Pi_{1,N} Π 1 , N (constructed from X 0 X_0 X 0 and X 1 X_1 X 1 , respectively) of functions f : [ N ] → [ N ] f : [N] \to[N] f : [ N ] → [ N ] .
Theorem 1.1 (Informal statement of Theorem 2.5 ). *Assume that X 0 , X 1 X_0, X_1 X 0 , X 1 satisfy Equation (1) . When A = O ( r 2 ) A = O(r^2) A = O ( r 2 ) and A = o ( N / log N ) A = o(\sqrt{N/\log N}) A = o ( N / log N ) , any T T T -query quantum algorithm can only distinguish between Π 0 , N \Pi_{0,N} Π 0 , N and Π 1 , N \Pi_{1,N} Π 1 , N with probability at least 2 / 3 2/3 2/3 whenever T = Ω ( N 1 / 2 − 1 / ( 2 r ) ) T = \Omega(N^{1/2-1/(2r)}) T = Ω ( N 1/2 − 1/ ( 2 r ) ) .
Note that the above result gives a quadratic decrease in the lower bound compared to the classical setting, reflecting the possibility of quantum speedups. The above theorem is similar to the matching moment theorem of [RRS509], and it holds for a large range of parameters A A A and r r r (see Theorem 2.5 for the exact ranges of the parameters). We employ this theorem to prove optimal quantum query lower bounds on image size testing and junta testing.
However, for several properties like k k k -distinctness and subgraph-freeness testing, the bound obtained from the above theorem remains sub-optimal. To achieve the optimal lower bounds for these properties, we further improve the above theorem to give tighter bounds, albeit for more restricted parameter ranges.
Theorem 1.2 (Informal statement of Theorem 2.6 ). Assume that X 0 , X 1 X_0,X_1 X 0 , X 1 satisfy Equation (1) . For fixed A , r A,r A , r , any T T T -query quantum algorithm can only distinguish between Π 0 , N \Pi_{0,N} Π 0 , N and Π 1 , N \Pi_{1,N} Π 1 , N with probability at least 2 / 3 2/3 2/3 whenever T = Ω ( N 1 / 2 − 1 / ( 2 ( 2 r − 1 ) ) ) T=\Omega(N^{1/2-1/(2(2r-1))}) T = Ω ( N 1/2 − 1/ ( 2 ( 2 r − 1 )) ) .
A crucial appeal of this framework lies in its simplicity for proving new quantum query lower bounds. These theorems can be used as black-box : all it needs is input instances that satisfy the conditions of the theorems, and we directly obtain a new quantum query lower bound! This is indeed the case of various applications. In fact, in many cases, it is sufficient to consider the classical moment-matching lower bound construction, and even designing new hard instances is not required.
Applications of the quantum moment matching framework As applications of our two moment matching theorems, we obtain several new quantum query lower bounds, even optimal ones, with either polynomial or logarithmic improvements. Moreover, all these lower bounds are now proven in a more direct and streamlined fashion. Our results are summarized in Table 1 .
Table 1. Query bounds for our applications, with explicit logarithmic factors, a k = ( 2 k − 1 − 1 ) / ( 2 k − 1 ) a_k=(2^{k-1}-1)/(2^k-1) a k = ( 2 k − 1 − 1 ) / ( 2 k − 1 ) . For each problem, the previous bounds occupy two rows: lower bounds above, upper bounds below. This work gives the lower bounds in the last column. The k k k -distinctness and directed subgraph-freeness entries are for k ≥ 3 k\geq3 k ≥ 3 . In the image-size testing row, δ > 0 \delta>0 δ > 0 is an arbitrary constant.
While Theorem 1.2 proves a sharper lower bound compared to Theorem 1.1 , as we mentioned, Theorem 1.2 holds for smaller parameter ranges. For our applications of image size testing and junta testing, applying Theorem 1.2 would not yield optimal lower bounds and Theorem 1.1 needs to be applied. On the other hand, for k k k -distinctness, directed k k k -star-freeness and directed planarity and outerplanarity testing, Theorem 1.2 is required for proving the optimal bounds. Thus, Theorem 1.1 and Theorem 1.2 are incomparable from an application standpoint.
We start with the k k k -distinctness testing problem. Here, given access to a function f : [ N ] → [ M ] f:[N]\to[M] f : [ N ] → [ M ] , the goal is to distinguish whether every output value of f f f occurs fewer than k k k times or one needs to change the value of at least ε N \varepsilon N εN positions to make it so. This is also often called k k k -collision-freeness testing. Next we consider four problems in directed bounded-degree graphs in the unidirectional model , where the algorithm can only query the outgoing neighbors of each vertex. The first two problems are testing k k k -star-freeness and k k k -source-subgraph-freeness: whether a k k k -star or any given subgraph with k k k source components appear as subgraphs in the graph (see § 5.2.2 for the definition). Then, we consider planarity and outerplanarity testing: given query access to a graph in the unidirectional model, the algorithm has to distinguish whether the underlying undirected graph is planar or outerplanar , or far from being so. Our results for these problems are summarized in the following theorem, see Table 1 for the best prior classical and quantum bounds.
Theorem 1.3 (Informal statement of Corollary 5.1 and Corollary 5.2 ). The quantum query complexity of property testing:
(i) k k k -distinctness for strings of length N N N is Ω ( N ( 2 k − 1 ) / ( 2 k − 1 ) ) \Omega(N^{(2^{k-1})/(2^k-1)}) Ω ( N ( 2 k − 1 ) / ( 2 k − 1 ) ) ;
(ii) k k k -star-freeness and k k k -source-subgraph-freeness for N N N -vertex graphs in the unidirectional model is Ω ( N ( 2 k − 1 − 1 ) / ( 2 k − 1 ) ) \Omega(N^{(2^{k-1}-1)/(2^k-1)}) Ω ( N ( 2 k − 1 − 1 ) / ( 2 k − 1 ) ) ;
(iii) planarity and outerplanarity of N N N -vertex graphs in the unidirectional model is Ω ( N 3 / 7 ) \Omega(N^{3/7}) Ω ( N 3/7 ) .
Suppose we are given query access to a function f : [ N ] → [ M ] f:[N]\to[M] f : [ N ] → [ M ] . In the image size testing problem, our goal is to distinguish whether f f f takes at most a prescribed number of distinct values, or is far from all such functions. Similarly, in K K K -junta testing, our goal is to test if f f f depends on at most K K K input coordinates among its N N N coordinates. Such a function admits a low-dimensional representation and has been widely studied in the literature. Our results are stated as follows:
Theorem 1.4 (Informal statements of Corollaries 5.5 and 5.7 ). The quantum query complexity of
(i) Image size testing for strings of length N N N is Ω ( N ) \Omega(\sqrt{N}) Ω ( N ) ,
(ii) K K K -junta testing is Ω ( K ) \Omega(\sqrt{K}) Ω ( K ) .
The best known prior classical and quantum bounds on these problems are presented in Table 1 . A detailed discussion of techniques and prior works on these applications is presented in § 5 .
Technical overview
We first give an overview of the proof of Theorem 1.1 , then move to Theorem 1.2 . Our proofs combine the polynomial method with a continuous hybrid argument. We express acceptance probabilities as polynomials and use the hybrid argument to compare their expectations under the hard input distributions.
Polynomial and discrete hybrid arguments have previously been combined, for instance in Zhandry’s construction of quantum-secure pseudorandom functions [Zha21], but not so often applied since. Here, continuous interpolation preserves the i.i.d. structure of our multiple samples, while moment matching cancels the low-degree contributions at each stage.
First step: input distributions
We start with two random variables X 0 , X 1 X_0, X_1 X 0 , X 1 supported on [ A ] = { 1 , … , A } [A] = \{1, \ldots, A\} [ A ] = { 1 , … , A } that correspond to positive frequency statistics and have proportional moments up to order r − 1 r - 1 r − 1 . Let μ b = E [ X b ] \mu_b = \mathbb{E}[X_b] μ b = E [ X b ] for b ∈ { 0 , 1 } b \in\{0, 1\} b ∈ { 0 , 1 } . From X b X_b X b we define a related mean-one frequency statistics Z b Z_b Z b as follows: keep a sample from X b X_b X b with probability 1 / μ b 1/\mu_b 1/ μ b and replace it by zero otherwise. The resulting random variable Z b Z_b Z b includes zero frequencies and has support on S = { 0 } ∪ [ A ] S = \{0\} \cup[A] S = { 0 } ∪ [ A ] . It also satisfies
E [ Z b ] = 1 , E [ Z b j ] = E [ X b j ] μ b , E [ Z 0 j ] = E [ Z 1 j ] ( 1 ≤ j < r ) . \mathbb{E}[Z_b] = 1,\qquad\mathbb{E}[Z_b^j] = \frac{\mathbb{E}[X_b^j]}{\mu_b},\qquad\mathbb{E}[Z_0^j] = \mathbb{E}[Z_1^j]\quad(1 \le j < r). E [ Z b ] = 1 , E [ Z b j ] = μ b E [ X b j ] , E [ Z 0 j ] = E [ Z 1 j ] ( 1 ≤ j < r ) .
The additional zero value is crucial, it lets us obtain mean one while converting proportional moments into matching moments.
For b ∈ { 0 , 1 } b \in\{0,1\} b ∈ { 0 , 1 } , we now construct a random function from prescribed positive frequency statistics X b X_b X b , or equivalently, its associated mean-one frequency statistics Z b Z_b Z b . Let π b \pi_b π b be the underlying distribution of Z b Z_b Z b . This is not as easy as defining statistics from a given function f f f . The main difficulty is that we would like a sampling process that samples f f f with as many i.i.d. samples from π b \pi_b π b as possible. However, for an input f : [ N ] → [ N ] f : [N] \to[N] f : [ N ] → [ N ] , the sum of the frequencies has to be exactly N N N , and because of the randomness of the samples we cannot be sure to achieve this after any number of samples from π b \pi_b π b .
To overcome this issue, we will use a randomized variant of the frequency construction of [RRSS09] to define Π b , N \Pi_{b,N} Π b , N from m = ⌊ N / 2 ⌋ m = \lfloor N/2 \rfloor m = ⌊ N /2 ⌋ i.i.d. samples of π b \pi_b π b .
We sample m = ⌊ N / 2 ⌋ m = \lfloor N/2 \rfloor m = ⌊ N /2 ⌋ independent multiplicities z = ( z 1 , … , z m ) \mathbf{z} = (z_1, \ldots, z_m) z = ( z 1 , … , z m ) according to the distribution π b \pi_b π b of Z b Z_b Z b ; each nonzero draw specifying the multiplicity of a distinct output label. Set z = ∑ i z i z = \sum_i z_i z = ∑ i z i .
If z ≤ N z \le N z ≤ N , we add N − z N - z N − z new output values that occur once each (aka. singletons ) yielding multiplicity vector c \mathbf{c} c , and assign output labels and input positions uniformly at random.
If z > N z > N z > N , c \mathbf{c} c is set to be the all-1 vector, thus after taking uniformly random labels we obtain a uniformly random bijection.
This gives a function on exactly N N N inputs. The construction ensures that the original multiplicity samples are independent. For this construction, we say that we draw f ∼ D c f \sim\mathcal{D}_{\mathbf{c}} f ∼ D c where D c \mathcal{D}_{\mathbf{c}} D c is the uniform distribution over functions with the prescribed output multiplicities c \mathbf{c} c , up to relabeling. This complete randomized procedure defines the distribution Π b , N \Pi_{b,N} Π b , N over functions. After sampling f ∼ Π b , N f \sim\Pi_{b,N} f ∼ Π b , N , we provide the quantum algorithm A \mathcal{A} A with oracle access to that fixed function. Therefore, its average acceptance probability is Pr f ∼ Π b , N [ A f = 1 ] \Pr_{f\sim\Pi_{b,N}}[\mathcal{A}^f = 1] Pr f ∼ Π b , N [ A f = 1 ] .
It is important to note that our construction differs slightly from the original one of [RRSS09]. Indeed, [RRSS09] obtains independence of the frequency statistics of the observed values, rather than of the input multiplicities. For this, they use a Poissonization argument: instead of taking T T T samples to answer T T T queries, they consider a Poisson ( T ) \operatorname{Poisson}(T) Poisson ( T ) number of such samples.
Second step: forming the acceptance probability polynomial
Our main goal is to show that any quantum algorithm that performs few queries has almost the same acceptance probability under the two input distributions whose moments match up to r − 1 r-1 r − 1 moments. We will use the polynomial method , i.e., the fact that the acceptance probability of a T T T -query quantum algorithm is a polynomial of degree at most 2 T 2T 2 T in the indicators of the oracle values [8 ] .
Averaging over the random assignments of positions and labels gives a symmetric polynomial P P P of degree at most 2 T 2T 2 T in the label multiplicities. More precisely, Lemma 3.1 gives
P ( c ) = Pr f ∼ D c [ A f = 1 ] ∈ [ 0 , 1 ] (2) P(\mathbf{c})=\Pr_{f\sim\mathcal{D}_{\mathbf{c}}}\left[\mathcal{A}^{f}=1\right]\in[0,1] \tag*{(2)} P ( c ) = f ∼ D c Pr [ A f = 1 ] ∈ [ 0 , 1 ] (2)
for every feasible frequency vector c \mathbf{c} c . Writing c ( z ) \mathbf{c}(\mathbf{z}) c ( z ) for the frequency vector produced by our construction from the sampled multiplicities z \mathbf{z} z , including the fallback case, we obtain
Pr f ∼ Π b , N [ A f = 1 ] = E z ∼ π b ⊗ m [ P ( c ( z ) ) ] . \Pr_{f\sim\Pi_{b,N}}\left[\mathcal{A}^{f}=1\right]=\mathbb{E}_{\mathbf{z}\sim\pi_b^{\otimes m}}\left[P(\mathbf{c}(\mathbf{z}))\right]. f ∼ Π b , N Pr [ A f = 1 ] = E z ∼ π b ⊗ m [ P ( c ( z )) ] .
Symmetry means that permuting the entries of c \mathbf{c} c leaves P ( c ) P(\mathbf{c}) P ( c ) unchanged. It also allows us to express P P P in terms of the power sums p j ( c ) = ∑ a = 1 N c a j p_j(\mathbf{c})=\sum_{a=1}^{N}c_a^j p j ( c ) = ∑ a = 1 N c a j , connecting the acceptance probability to the frequency moments. However, the critical point is that it is not yet necessarily a polynomial in z \mathbf{z} z .
However, we assume that Z 0 Z_0 Z 0 and Z 1 Z_1 Z 1 match only their first r − 1 r-1 r − 1 moments, while P P P may have degree as large as 2 T 2T 2 T , with T T T much larger than r r r . Thus, moment matching does not directly bound the difference between the two acceptance probabilities.
The main idea is therefore to use a hybrid argument, changing the distribution of one sampled multiplicity at a time, and approximate the acceptance probability, as a function of that multiplicity with the others fixed, by a polynomial of degree below r r r . The expectations of this approximation under π 0 \pi_0 π 0 and π 1 \pi_1 π 1 agree exactly by moment-matching, and we show that the remaining error is small.
Third step: using the hybrid argument
We now describe the hybrid argument to analyze the success probability of any given algorithm against two different input distributions. Recall that c ( z ) \mathbf{c}(\mathbf{z}) c ( z ) is the frequency vector obtained from the sampled multiplicities z \mathbf{z} z by our input construction, including singleton completion and the fallback when ∑ i z i > N \sum_i z_i>N ∑ i z i > N . For S = { 0 } ∪ [ A ] S=\{0\}\cup[A] S = { 0 } ∪ [ A ] , define h : S m → [ 0 , 1 ] h:S^m\to[0,1] h : S m → [ 0 , 1 ] by
h ( z ) = P ( c ( z ) ) = Pr f ∼ D c ( z ) [ A f = 1 ] . h(\mathbf{z})=P(\mathbf{c}(\mathbf{z}))=\Pr_{f\sim\mathcal{D}_{\mathbf{c}(\mathbf{z})}}\left[\mathcal{A}^{f}=1\right]. h ( z ) = P ( c ( z )) = f ∼ D c ( z ) Pr [ A f = 1 ] .
Thus h ( z ) h(\mathbf{z}) h ( z ) is the average acceptance probability for fixed sampled multiplicities z \mathbf{z} z . Since permuting z \mathbf{z} z only permutes the entries of c ( z ) \mathbf{c}(\mathbf{z}) c ( z ) , the symmetry of P P P implies that h h h is invariant under permutations of its coordinates. Moreover,
Pr f ∼ Π b , N [ A f = 1 ] = E z ∼ π b ⊗ m [ h ( z ) ] . \Pr_{f\sim\Pi_{b,N}}\left[\mathcal{A}^{f}=1\right]=\mathbb{E}_{\mathbf{z}\sim\pi_b^{\otimes m}}\left[h(\mathbf{z})\right]. f ∼ Π b , N Pr [ A f = 1 ] = E z ∼ π b ⊗ m [ h ( z ) ] .
For two probability distributions π 0 \pi_0 π 0 , π 1 \pi_1 π 1 on S S S , define the usual hybrids
H i = E z ∼ π 1 ⊗ i ⊗ π 0 ⊗ ( m − i ) [ h ( z ) ] ( 0 ≤ i ≤ m ) . H_i = \mathbb{E}_{z\sim\pi_1^{\otimes i}\otimes\pi_0^{\otimes(m-i)}}[h(z)] \quad(0\le i\le m). H i = E z ∼ π 1 ⊗ i ⊗ π 0 ⊗ ( m − i ) [ h ( z )] ( 0 ≤ i ≤ m ) .
Define q w ( s ) = h ( w , s ) q_{\mathbf{w}}(s)=h(\mathbf{w},s) q w ( s ) = h ( w , s ) , for w ∈ S m − 1 \mathbf{w}\in S^{m-1} w ∈ S m − 1 and s ∈ S s\in S s ∈ S . We are interested in the quantity H m − H 0 H_m-H_0 H m − H 0 , i.e., the difference of the expected acceptance probabilities when the whole input is sampled according to π 0 \pi_0 π 0 or π 1 \pi_1 π 1 .
The usual hybrid changes one coordinate at each step and telescopes H m − H 0 = ∑ i = 0 m − 1 ( H i + 1 − H i ) H_m-H_0=\sum_{i=0}^{m-1}(H_{i+1}-H_i) H m − H 0 = ∑ i = 0 m − 1 ( H i + 1 − H i ) . By symmetry, each increment is
H i + 1 − H i = E w ∼ π 1 ⊗ i ⊗ π 0 ⊗ ( m − 1 − i ) [ ∑ s ∈ S ( π 1 ( s ) − π 0 ( s ) ) q w ( s ) ] . H_{i+1}-H_i=\mathbb{E}_{\mathbf{w}\sim\pi_1^{\otimes i}\otimes\pi_0^{\otimes(m-1-i)}}\left[\sum_{s\in S}(\pi_1(s)-\pi_0(s))q_{\mathbf{w}}(s)\right]. H i + 1 − H i = E w ∼ π 1 ⊗ i ⊗ π 0 ⊗ ( m − 1 − i ) [ s ∈ S ∑ ( π 1 ( s ) − π 0 ( s )) q w ( s ) ] .
For the formal proof we use a continuous version of this argument in Lemma 3.7 , where ( π u ) 0 ≤ u ≤ 1 (\pi_u)_{0\le u\le1} ( π u ) 0 ≤ u ≤ 1 is a continuous, piecewise continuously differentiable path from π 0 \pi_0 π 0 to π 1 \pi_1 π 1 . Setting F ( u ) = E z ∼ π u ⊗ m [ h ( z ) ] F(u)=\mathbb{E}_{z\sim\pi_u^{\otimes m}}[h(z)] F ( u ) = E z ∼ π u ⊗ m [ h ( z )] and π ˙ u ( s ) = d d u π u ( s ) \dot{\pi}_u(s)=\frac{d}{du}\pi_u(s) π ˙ u ( s ) = d u d π u ( s ) , we get
∣ H m − H 0 ∣ = ∣ F ( 1 ) − F ( 0 ) ∣ ≤ ∫ 0 1 ∣ F ′ ( u ) ∣ d u = m ∫ 0 1 E w ∼ π u ⊗ ( m − 1 ) [ ∣ ∑ s ∈ S π ˙ u ( s ) q w ( s ) ∣ ] d u . (3) \lvert H_m-H_0\rvert=\lvert F(1)-F(0)\rvert\le\int_0^1\lvert F'(u)\rvert\,du=m\int_0^1\mathbb{E}_{\mathbf{w}\sim\pi_u^{\otimes(m-1)}}\left[\left\lvert\sum_{s\in S}\dot{\pi}_u(s)q_{\mathbf{w}}(s)\right\rvert\right]\,du. \tag*{(3)} ∣ H m − H 0 ∣ = ∣ F ( 1 ) − F ( 0 )∣ ≤ ∫ 0 1 ∣ F ′ ( u )∣ d u = m ∫ 0 1 E w ∼ π u ⊗ ( m − 1 ) [ s ∈ S ∑ π ˙ u ( s ) q w ( s ) ] d u . (3)
Then the RHS is upper bounded by ∑ i = 0 m − 1 ∣ H i + 1 − H i ∣ \sum_{i=0}^{m-1}\lvert H_{i+1}-H_i\rvert ∑ i = 0 m − 1 ∣ H i + 1 − H i ∣ , for the linear path π u = ( 1 − u ) π 0 + u π 1 \pi_u=(1-u)\pi_0+u\pi_1 π u = ( 1 − u ) π 0 + u π 1 .
The advantage of the continuous formulation is that the remaining multiplicities w \mathbf{w} w are i.i.d. with common distribution π u \pi_u π u at every intermediate step. For each s ∈ S s\in S s ∈ S , the number of coordinates of w \mathbf{w} w equal to s s s therefore follows Bin ( m − 1 , π u ( s ) ) \operatorname{Bin}(m-1,\pi_u(s)) Bin ( m − 1 , π u ( s )) , so standard binomial estimates apply directly. In the discrete increment H i + 1 − H i H_{i+1}-H_i H i + 1 − H i , these multiplicities remain independent but have two different distributions, π 1 \pi_1 π 1 and π 0 \pi_0 π 0 . The corresponding number is then a sum of two binomial variables. Preserving the i.i.d. structure thus simplifies the averaging of estimates involving q w q_{\mathbf{w}} q w .
Fourth step: using the matching moments
Bringing back the degree bound In the rest of this overview, we only consider samples w ∈ S m − 1 \mathbf{w}\in S^{m-1} w ∈ S m − 1 such that w = ∑ i = 1 m − 1 w i ≤ 3 N 4 w=\sum_{i=1}^{m-1}w_i\le\frac{3N}{4} w = ∑ i = 1 m − 1 w i ≤ 4 3 N . The opposite event has exponentially small probability to happen and can be bounded separately using Hoeffding’s inequality.
For every integer 0 ≤ s ≤ H = ⌊ N / 4 ⌋ 0\le s\le H=\lfloor N/4\rfloor 0 ≤ s ≤ H = ⌊ N /4 ⌋ , we have w + s ≤ N w+s\le N w + s ≤ N . Hence the completion procedure discussed in § 1.3.1 does not overflow and the resulting frequency vector c ( w , s ) \mathbf{c}(\mathbf{w},s) c ( w , s ) contains one s s s -tuple and ( N − w − s ) (N-w-s) ( N − w − s ) singletons added to w \mathbf{w} w . Therefore, each j j j -th power sum of it satisfies
p j ( c ( w , s ) ) = p j ( w ) + ( N − w − s ) + s j . p_j(\mathbf{c}(\mathbf{w},s))=p_j(\mathbf{w})+(N-w-s)+s^j. p j ( c ( w , s )) = p j ( w ) + ( N − w − s ) + s j .
Since we start with a polynomial P P P in c \mathbf{c} c in Equation (2) , the function q w ( s ) q_{\mathbf{w}}(s) q w ( s ) is also a polynomial in s s s with the same degree bound as P P P . It takes values in [ 0 , 1 ] [0,1] [ 0 , 1 ] for every integer 0 ≤ s ≤ H 0\le s\le H 0 ≤ s ≤ H .
Matching moments Since q w ( s ) q_{\mathbf{w}}(s) q w ( s ) is a degree-2 T 2T 2 T polynomial in s s s , let Q w ( s ) Q_{\mathbf{w}}(s) Q w ( s ) be its Taylor-truncation up to degree r − 1 r-1 r − 1 . The moment-matching assumption can be used to cancel the contribution of Q w Q_{\mathbf{w}} Q w in Equation (3) . Indeed, since π 0 \pi_0 π 0 and π 1 \pi_1 π 1 have matching moments below order r r r , so do have π u \pi_u π u and π v \pi_v π v , for any u , v ∈ [ 0 , 1 ] u,v\in[0,1] u , v ∈ [ 0 , 1 ] . As a consequence ∑ s ∈ S π u ( s ) Q w ( s ) \sum_{s\in S}\pi_u(s)Q_{\mathbf{w}}(s) ∑ s ∈ S π u ( s ) Q w ( s ) in fact does not depend on u u u (specific case of Lemma 3.4 ). Therefore ∑ s ∈ S π ˙ u ( s ) Q w ( s ) = 0 \sum_{s\in S}\dot{\pi}_u(s)Q_{\mathbf{w}}(s)=0 ∑ s ∈ S π ˙ u ( s ) Q w ( s ) = 0 and
∑ s ∈ S π ˙ u ( s ) q w ( s ) = ∑ s ∈ S π ˙ u ( s ) ( q w ( s ) − Q w ( s ) ) . \sum_{s\in S}\dot{\pi}_u(s)q_{\mathbf{w}}(s)=\sum_{s\in S}\dot{\pi}_u(s)\bigl(q_{\mathbf{w}}(s)-Q_{\mathbf{w}}(s)\bigr). s ∈ S ∑ π ˙ u ( s ) q w ( s ) = s ∈ S ∑ π ˙ u ( s ) ( q w ( s ) − Q w ( s ) ) .
As a consequence we get this special case of Lemma 3.8 :
∣ F ( 1 ) − F ( 0 ) ∣ ≤ m ∫ 0 1 E w ∼ π u ⊗ ( m − 1 ) [ ∣ ∑ s ∈ S π ˙ u ( s ) ( q w ( s ) − Q w ( s ) ) ∣ ] d u . |F(1)-F(0)| \le m \int_{0}^{1} \mathbb{E}_{\mathbf{w}\sim\pi_u^{\otimes(m-1)}}\left[\left|\sum_{s\in S}\dot{\pi}_u(s)(q_{\mathbf{w}}(s)-Q_{\mathbf{w}}(s))\right|\right]\,du. ∣ F ( 1 ) − F ( 0 ) ∣ ≤ m ∫ 0 1 E w ∼ π u ⊗ ( m − 1 ) [ s ∈ S ∑ π ˙ u ( s ) ( q w ( s ) − Q w ( s )) ] d u .
Combining small degree and matching moments In the regime N ≥ max { 8 , 4 A } N \ge\max\{8,4A\} N ≥ max { 8 , 4 A } and T 2 ≤ N / 64 T^2 \le N/64 T 2 ≤ N /64 , Taylor approximation (Lemma 3.2) provides the approximation of the tail of ∣ q w ( s ) − Q w ( s ) ∣ |q_{\mathbf{w}}(s)-Q_{\mathbf{w}}(s)| ∣ q w ( s ) − Q w ( s ) ∣ , using that q w ( s ) ∈ [ 0 , 1 ] q_{\mathbf{w}}(s)\in[0,1] q w ( s ) ∈ [ 0 , 1 ] for every integer 0 ≤ s ≤ H 0\le s\le H 0 ≤ s ≤ H . After taking its expectation over π b \pi_b π b , this leads to
E Z b ∼ π b [ ∣ q w ( Z b ) − Q w ( Z b ) ∣ ] ≤ 2 A r − 1 ( 2 r ) ! ( 128 T 2 N ) r . \mathbb{E}_{Z_b\sim\pi_b}\left[|q_{\mathbf{w}}(Z_b)-Q_{\mathbf{w}}(Z_b)|\right]\le\frac{2A^{r-1}}{(2r)!}\left(\frac{128T^2}{N}\right)^r. E Z b ∼ π b [ ∣ q w ( Z b ) − Q w ( Z b ) ∣ ] ≤ ( 2 r )! 2 A r − 1 ( N 128 T 2 ) r .
Therefore
∣ ∑ s ∈ S π ˙ u ( s ) ( q w ( s ) − Q w ( s ) ) ∣ ≤ ∑ s ∈ S ( π 0 ( s ) + π 1 ( s ) ) ∣ q w ( s ) − Q w ( s ) ∣ = ∑ b = 0 1 ∑ s ∈ S Pr [ Z b = s ] ∣ q w ( s ) − Q w ( s ) ∣ = ∑ b = 0 1 E [ ∣ q w ( Z b ) − Q w ( Z b ) ∣ ] ≤ 4 A r − 1 ( 2 r ) ! ( 128 T 2 N ) r . \begin{aligned}
\left|\sum_{s\in S}\dot{\pi}_u(s)(q_{\mathbf{w}}(s)-Q_{\mathbf{w}}(s))\right|
\le\sum_{s\in S}(\pi_0(s)+\pi_1(s))|q_{\mathbf{w}}(s)-Q_{\mathbf{w}}(s)| \\
&= \sum_{b=0}^{1}\sum_{s\in S}\Pr[Z_b=s]|q_{\mathbf{w}}(s)-Q_{\mathbf{w}}(s)| \\
&= \sum_{b=0}^{1}\mathbb{E}[|q_{\mathbf{w}}(Z_b)-Q_{\mathbf{w}}(Z_b)|] \\
&\le\frac{4A^{r-1}}{(2r)!}\left(\frac{128T^2}{N}\right)^r.
\end{aligned} s ∈ S ∑ π ˙ u ( s ) ( q w ( s ) − Q w ( s )) ≤ s ∈ S ∑ ( π 0 ( s ) + π 1 ( s )) ∣ q w ( s ) − Q w ( s ) ∣ = b = 0 ∑ 1 s ∈ S ∑ Pr [ Z b = s ] ∣ q w ( s ) − Q w ( s ) ∣ = b = 0 ∑ 1 E [ ∣ q w ( Z b ) − Q w ( Z b ) ∣ ] ≤ ( 2 r )! 4 A r − 1 ( N 128 T 2 ) r .
So finally
∣ Pr f ∼ Π 1 , N [ A f = 1 ] − Pr f ∼ Π 0 , N [ A f = 1 ] ∣ = ∣ F ( 1 ) − F ( 0 ) ∣ ≤ N 2 [ 4 A r − 1 ( 2 r ) ! ( 128 T 2 N ) r ] , \left|\Pr_{f\sim\Pi_{1,N}}[\mathcal{A}^f=1]-\Pr_{f\sim\Pi_{0,N}}[\mathcal{A}^f=1]\right|=|F(1)-F(0)|\le\frac{N}{2}\left[\frac{4A^{r-1}}{(2r)!}\left(\frac{128T^2}{N}\right)^r\right], f ∼ Π 1 , N Pr [ A f = 1 ] − f ∼ Π 0 , N Pr [ A f = 1 ] = ∣ F ( 1 ) − F ( 0 ) ∣ ≤ 2 N [ ( 2 r )! 4 A r − 1 ( N 128 T 2 ) r ] ,
up to an additional exponential small term (bounded by 2 e − N / ( 4 A 2 ) 2e^{-N/(4A^2)} 2 e − N / ( 4 A 2 ) ) due to our original assumption that w ≤ 3 N / 4 w\le3N/4 w ≤ 3 N /4 . Thus, when A = O ( r 2 ) A=O(r^2) A = O ( r 2 ) and A = o ( N / log N ) A=o(\sqrt{N/\log N}) A = o ( N / log N ) , this quantity can only be large when the number of queries T = Ω ( N 1 / 2 − 1 / ( 2 r ) ) T=\Omega(N^{1/2-1/(2r)}) T = Ω ( N 1/2 − 1/ ( 2 r ) ) .
A better bound for some regimes
For proving the second theorem, we use two main lemmas: Lemma 4.2 and Lemma 4.1 . First we discuss how to prove the theorem using these lemmas and then continue with the lemmas.
As before, let π b \pi_b π b be the distribution of Z b Z_b Z b for b ∈ { 0 , 1 } b\in\{0,1\} b ∈ { 0 , 1 } over [ A ] ∪ { 0 } [A]\cup\{0\} [ A ] ∪ { 0 } and denote ∥ π 1 − π 0 ∥ 1 = δ \|\pi_1-\pi_0\|_1=\delta ∥ π 1 − π 0 ∥ 1 = δ . Lemma 4.2 provides a distribution ω \omega ω that has the same first r − 1 r-1 r − 1 moments as π 0 \pi_0 π 0 and π 1 \pi_1 π 1 , is δ \delta δ -close to both π 0 \pi_0 π 0 and π 1 \pi_1 π 1 , and satisfies ω ( s ) ≥ 32 − A δ \omega(s)\ge32^{-A}\delta ω ( s ) ≥ 3 2 − A δ for every s ∈ [ A ] ∪ { 0 } s\in[A]\cup\{0\} s ∈ [ A ] ∪ { 0 } . The distribution ω \omega ω is used for the continuous hybrid approach: we will combine two paths π b , u = ( 1 − u ) π b + u ω \pi_{b,u}=(1-u)\pi_b+u\omega π b , u = ( 1 − u ) π b + u ω for b ∈ { 0 , 1 } b\in\{0,1\} b ∈ { 0 , 1 } that have the same moments up to order r − 1 r-1 r − 1 as π b \pi_b π b and ω \omega ω .
Denoting F b ( u ) = E z ∼ π b , u ⊗ m [ h ( z ) ] F_b(u)=\mathbb{E}_{z\sim\pi_{b,u}^{\otimes m}}[h(z)] F b ( u ) = E z ∼ π b , u ⊗ m [ h ( z )] , the goal is to bound ∣ F 1 ( 0 ) − F 0 ( 0 ) ∣ ≤ ∣ F 0 ( 1 ) − F 0 ( 0 ) ∣ + ∣ F 1 ( 1 ) − F 1 ( 0 ) ∣ |F_1(0)-F_0(0)|\le|F_0(1)-F_0(0)|+|F_1(1)-F_1(0)| ∣ F 1 ( 0 ) − F 0 ( 0 ) ∣ ≤ ∣ F 0 ( 1 ) − F 0 ( 0 ) ∣ + ∣ F 1 ( 1 ) − F 1 ( 0 ) ∣ . Similar to the previous theorem’s proof, we can use Lemma 3.8 to bound each term ∣ F b ( 1 ) − F b ( 0 ) ∣ |F_b(1)-F_b(0)| ∣ F b ( 1 ) − F b ( 0 ) ∣ for b ∈ { 0 , 1 } b\in\{0,1\} b ∈ { 0 , 1 } . The second term of the bound obtained this way corresponds to the exceptional event w > 3 N / 4 w>3N/4 w > 3 N /4 , which can again be bounded using Hoeffding’s inequality. For the first term, instead of using the Taylor bound as before, we now use the Newton bound from Lemma 3.3 to bound the inside expression as follows:
∣ ∑ s ∈ S π ˉ b , u ( s ) ( q w ( s ) − P w ( s ) ) ∣ ≤ δ ∑ ℓ = r A ( A ℓ ) ∣ d ℓ ( w ) ∣ . \left|\sum_{s\in S}\bar{\pi}_{b,u}(s)\left(q_w(s)-P_w(s)\right)\right|\leq\delta\sum_{\ell=r}^{A}\binom{A}{\ell}\left|d_{\ell}(w)\right|. s ∈ S ∑ π ˉ b , u ( s ) ( q w ( s ) − P w ( s ) ) ≤ δ ℓ = r ∑ A ( ℓ A ) ∣ d ℓ ( w ) ∣ .
Now we use the other main lemma of this proof: Lemma 4.1 provides an upper bound of c ℓ T 1 + α ℓ N ( m a ) − α ℓ \frac{c^{\ell}T^{1+\alpha_{\ell}}}{N}(ma)^{-\alpha_{\ell}} N c ℓ T 1 + α ℓ ( ma ) − α ℓ on the expectation of ∣ d ℓ ( w ) ∣ \left|d_{\ell}(w)\right| ∣ d ℓ ( w ) ∣ where α j = 1 − 2 1 − j \alpha_j=1-2^{1-j} α j = 1 − 2 1 − j and a a a is a lower bound on the probabilities in π b , u \pi_{b,u} π b , u : this is why the lower bound on the probabilities in ω \omega ω is crucial. Then, with little calculation (explained in full detail in § 4 ), one can obtain the required upper bound
∣ Pr f ∼ Π 0 , N [ A f = 1 ] − Pr f ∼ Π 1 , N [ A f = 1 ] ∣ ≤ C A 2 T 2 − 2 1 − r N 1 − 2 1 − r . \left|\underset{f\sim\Pi_{0,N}}{\Pr}\left[\mathcal{A}^{f}=1\right]-\underset{f\sim\Pi_{1,N}}{\Pr}\left[\mathcal{A}^{f}=1\right]\right|\leq C A^{2}\frac{T^{2-2^{1-r}}}{N^{1-2^{1-r}}}. f ∼ Π 0 , N Pr [ A f = 1 ] − f ∼ Π 1 , N Pr [ A f = 1 ] ≤ C A 2 N 1 − 2 1 − r T 2 − 2 1 − r .
up to a small additive term bounded by N exp ( − c N A 2 ) N\exp\left(-\frac{cN}{A^{2}}\right) N exp ( − A 2 c N ) due to the assumption w ≤ 3 N / 4 w\leq3N/4 w ≤ 3 N /4 . Thus, when A A A and r r r are fixed, this quantity can only be large when the number of queries T = Ω ( N 1 / 2 − 1 / ( 2 ( 2 r − 1 ) ) ) T=\Omega\left(N^{1/2-1/(2(2r-1))}\right) T = Ω ( N 1/2 − 1/ ( 2 ( 2 r − 1 )) ) .
Obtaining the distribution ω \omega ω The proof of Lemma 4.2 first starts from ( π 0 + π 1 ) / 2 (\pi_0+\pi_1)/2 ( π 0 + π 1 ) /2 and adds a small amount of mass uniformly, ensuring that every point receives positive mass. However, this changes the total mass and the first r − 1 r-1 r − 1 moments. Then, using Lagrange interpolation (Lemma 3.5), we adjust the masses at r r r suitably chosen points to restore them. The interpolation bound controls this correction, preserving the required lower bound on every probability and the closeness to π 0 \pi_0 π 0 and π 1 \pi_1 π 1 .
Newton coefficients of q w q_w q w Now we turn to proving Lemma 4.1 , and introduce some notation. First, we write the input function f : [ N ] → [ N ] f:[N]\to[N] f : [ N ] → [ N ] as a string f ∈ [ N ] N f\in[N]^N f ∈ [ N ] N , i.e., f = ( f ( 1 ) , … , f ( N ) ) f=(f(1),\ldots,f(N)) f = ( f ( 1 ) , … , f ( N )) . We partition the set of indices [ N ] [N] [ N ] according to the value f f f takes there, leading to “blocks” of indices, one for each value. The size of each block is the frequency of the corresponding value. Let us take an ℓ ≥ r \ell\geq r ℓ ≥ r such that f f f contains at least one block of size ℓ \ell ℓ , and let ρ \rho ρ denote the number of blocks of size ℓ \ell ℓ . Moreover, let n j n_j n j denote one plus the number of blocks of size j j j (for j < ℓ j<\ell j < ℓ ), and n ∗ = min 1 ≤ j < ℓ n j n_*=\min_{1\leq j<\ell}n_j n ∗ = min 1 ≤ j < ℓ n j . Also, let p ( f ) = Pr [ A f = 1 ] p(f)=\Pr\left[\mathcal{A}^{f}=1\right] p ( f ) = Pr [ A f = 1 ] be the algorithm’s acceptance probability on input f f f .
We define the following distribution ν j \nu_j ν j for each j ≤ ℓ j\leq\ell j ≤ ℓ . We first take a uniformly random partition of [ N ] [N] [ N ] to block sizes prescribed by the frequency vector c \mathbf{c} c (coming from the original input distribution), and mark a uniformly random block of size ℓ \ell ℓ . Now let us choose a size-j j j subset of the marked block uniformly at random, call this subset B B B , and split the other ℓ − j \ell-j ℓ − j positions into singletons. We assign distinct labels uniformly at random to the blocks, and define f ( i ) f(i) f ( i ) as the label of the block containing i i i . Then we choose a = ( a i ) i ∈ B \mathbf{a}=(a_i)_{i\in B} a = ( a i ) i ∈ B uniformly among all j j j -tuples of distinct labels from [ N ] ∖ f ( [ N ] ) [N]\setminus f([N]) [ N ] ∖ f ([ N ]) . So ν j \nu_j ν j is a distribution of tuples ( f , B , a ) (f,B,\mathbf{a}) ( f , B , a ) . One can see that the marginal distribution of f f f according to ν j \nu_j ν j is the same as D c ( w , j ) \mathcal{D}_{\mathbf{c}}(\mathbf{w},j) D c ( w , j ) , thus E ν j [ p ( f ) ] = q w ( j ) \mathbb{E}_{\nu_j}[p(f)]=q_w(j) E ν j [ p ( f )] = q w ( j ) .
For a subset U ⊆ B U\subseteq B U ⊆ B , define f U , a f^{U,\mathbf{a}} f U , a as the input one obtains from f f f by turning f ( i ) f(i) f ( i ) into a i a_i a i for each i ∈ U i\in U i ∈ U . Based on this, let us define the block difference operator as
D B G a ( f ) = ∑ U ⊆ B ( − 1 ) ∣ U ∣ g ( f U , a ) , D_{B\mathcal{G}}^{\mathbf{a}}(f)=\sum_{U\subseteq B}(-1)^{|U|}g\left(f^{U,\mathbf{a}}\right), D B G a ( f ) = U ⊆ B ∑ ( − 1 ) ∣ U ∣ g ( f U , a ) ,
where g g g is any (scalar or vector-valued) function on [ N ] N [N]^N [ N ] N . We usually omit a a a from the notation. Take j = ℓ j=\ell j = ℓ and g = p g=p g = p (i.e., the acceptance probability). For each U ⊆ B U\subseteq B U ⊆ B , splitting it off leaves an ( ℓ − ∣ U ∣ ) (\ell-|U|) ( ℓ − ∣ U ∣ ) -block (and ∣ U ∣ |U| ∣ U ∣ new singletons). Because of uniformity, the expected acceptance probability for this term is q w ( ℓ − ∣ U ∣ ) q_{\mathbf{w}}(\ell-|U|) q w ( ℓ − ∣ U ∣ ) . Thus, using the definition of the Newton coefficients d ℓ ( w ) = ∑ s = 0 ℓ ( − 1 ) ℓ − s ( ℓ s ) q w ( s ) d_{\ell}(\mathbf{w})=\sum_{s=0}^{\ell}(-1)^{\ell-s}\binom{\ell}{s}q_{\mathbf{w}}(s) d ℓ ( w ) = ∑ s = 0 ℓ ( − 1 ) ℓ − s ( s ℓ ) q w ( s ) (for 0 ≤ ℓ ≤ A 0\leq\ell\leq A 0 ≤ ℓ ≤ A ), we obtain that (Proposition 4.3 )
E ν ℓ [ ( D B p ) ( f ) ] = ∑ s = 0 ℓ ( − 1 ) ℓ − s ( ℓ s ) q w ( s ) = d ℓ ( w ) . \mathbb{E}_{\nu_\ell}[(D_Bp)(f)]=\sum_{s=0}^{\ell}(-1)^{\ell-s}\binom{\ell}{s}q_{\mathbf{w}}(s)=d_\ell(\mathbf{w}). E ν ℓ [( D B p ) ( f )] = s = 0 ∑ ℓ ( − 1 ) ℓ − s ( s ℓ ) q w ( s ) = d ℓ ( w ) .
Bounding expected block differences As we mentioned, Lemma 4.1 gives an upper bound of C ℓ T 1 + α ℓ N ( m a ) − α ℓ \frac{C^\ell T^{1+\alpha_\ell}}{N}(ma)^{-\alpha_\ell} N C ℓ T 1 + α ℓ ( ma ) − α ℓ on the expectation of ∣ d ℓ ( w ) ∣ |d_\ell(\mathbf{w})| ∣ d ℓ ( w ) ∣ . This is done by bounding each ∣ d ℓ ( w ) ∣ |d_\ell(\mathbf{w})| ∣ d ℓ ( w ) ∣ and then averaging over w \mathbf{w} w using the binomial bounds of Lemma 3.6. For bounding each ∣ d ℓ ( w ) ∣ |d_\ell(\mathbf{w})| ∣ d ℓ ( w ) ∣ , the special case when w ∈ { 0 , 1 } m − 1 \mathbf{w}\in\{0,1\}^{m-1} w ∈ { 0 , 1 } m − 1 (which we call the singleton case) is handled separately in Lemma 4.8 simply by using the Newton bound (Lemma 3.3). The other cases are treated in Lemma 4.9 by combining the last equation of the previous paragraph and the bound on the expected block differences ∣ E ν ℓ [ ( D B p ) ( f ) ] ∣ ≤ C ℓ T 1 + α ℓ ρ n 1 n ∗ α ℓ − 1 / 2 |\mathbb{E}_{\nu_\ell}[(D_Bp)(f)]|\leq\frac{C^\ell T^{1+\alpha_\ell}}{\sqrt{\rho}n_1n_*^{\alpha_\ell-1/2}} ∣ E ν ℓ [( D B p ) ( f )] ∣ ≤ ρ n 1 n ∗ α ℓ − 1/2 C ℓ T 1 + α ℓ (remember that α j = 1 − 2 1 − j \alpha_j=1-2^{1-j} α j = 1 − 2 1 − j ) provided by Lemma 4.6 . Finally, the bounds on the inverse binomial moments of Lemma 3.6 turn the dependence on ρ \rho ρ and n ∗ n_* n ∗ to the required ( m a ) − α ℓ (ma)^{-\alpha_\ell} ( ma ) − α ℓ factor.
Query-gain argument Now we turn to proving Lemma 4.6 , which is the core of the proof of Theorem 2.6 . Our argument is similar to the query-gain argument in [9 ] , for which we only present here a high-level intuition. Recall that the goal is to prove an upper bound on ∣ E ν ℓ [ ( D B p ) ( f ) ] ∣ |\mathbb{E}_{\nu_\ell}[(D_Bp)(f)]| ∣ E ν ℓ [( D B p ) ( f )] ∣ . Similarly to the standard adversary bound, the proof analyzes how the state of the T T T -query algorithm on input f f f changes query by query. Let ∣ ψ t ⟩ |\psi_t\rangle ∣ ψ t ⟩ be the state after query t t t and ∣ ψ t ′ ⟩ |\psi'_t\rangle ∣ ψ t ′ ⟩ the state before query t + 1 t+1 t + 1 . We apply D B D_B D B on the vector-valued function f ↦ ∣ ψ t ( f ) ⟩ f\mapsto|\psi_t(f)\rangle f ↦ ∣ ψ t ( f )⟩ . Clearly, ∣ ψ 0 ⟩ |\psi_0\rangle ∣ ψ 0 ⟩ is independent of the input, and ∣ ψ T ⟩ |\psi_T\rangle ∣ ψ T ⟩ is closely related to the acceptance probability p ( f ) p(f) p ( f ) . For instance, if the accepting state is only ∣ 0 ⟩ |0\rangle ∣0 ⟩ , then ⟨ 0 ∣ ψ T ( f ) ⟩ = 1 − 2 p ( f ) \langle0|\psi_T(f)\rangle=1-2p(f) ⟨ 0∣ ψ T ( f )⟩ = 1 − 2 p ( f ) . We deal with the general case in the main proof in § 4 .
Let us define difference vector ∣ e B , t ⟩ = D B ∣ ψ t + 1 ⟩ − O f D B ∣ ψ t ′ ⟩ |e_{B,t}\rangle=D_B|\psi_{t+1}\rangle-O_fD_B|\psi'_t\rangle ∣ e B , t ⟩ = D B ∣ ψ t + 1 ⟩ − O f D B ∣ ψ t ′ ⟩ . One can telescope these differences to write D B ∣ ψ T ⟩ D_B|\psi_T\rangle D B ∣ ψ T ⟩ (which is a linear function of D B p D_Bp D B p ) as a rather simple combination of the ∣ e B , t ⟩ |e_{B,t}\rangle ∣ e B , t ⟩ vectors. Lemma 4.5 combined with Claim 4.7 provides bound ∥ ∣ e B , t ⟩ ∥ ν j 2 ≤ 4 j n 1 4 2 j T 2 α j n 1 n ∗ 2 α j \lVert|e_{B,t}\rangle\rVert_{\nu_j}^2\leq\frac{4j}{n_1}\frac{4^{2j}T^{2\alpha_j}}{n_1n_*^{2\alpha_j}} ∥ ∣ e B , t ⟩ ∥ ν j 2 ≤ n 1 4 j n 1 n ∗ 2 α j 4 2 j T 2 α j . Combining these facts, one can obtain that ∣ E ν ℓ [ ( D B p ) ( f ) ] ∣ |\mathbb{E}_{\nu_\ell}[(D_Bp)(f)]| ∣ E ν ℓ [( D B p ) ( f )] ∣ can be upper bounded by the expression ∑ t = 0 T − 1 ∥ ∣ e B , t ⟩ ∥ ν ℓ ρ ≤ C ℓ T 1 + α ℓ ρ n 1 n ∗ α ℓ − 1 / 2 \sum_{t=0}^{T-1}\lVert|e_{B,t}\rangle\rVert_{\nu_\ell}\sqrt{\rho}\leq\frac{C^\ell T^{1+\alpha_\ell}}{\sqrt{\rho}n_1n_*^{\alpha_\ell-1/2}} ∑ t = 0 T − 1 ∥ ∣ e B , t ⟩ ∥ ν ℓ ρ ≤ ρ n 1 n ∗ α ℓ − 1/2 C ℓ T 1 + α ℓ , thus finishing the proof.
Problem setting and main results
Construction of the input distributions
For an integer N ≥ 1 N\geq1 N ≥ 1 , let [ N ] = { 1 , … , N } [N]=\{1,\ldots,N\} [ N ] = { 1 , … , N } . We also usually write finite real vectors in bold face and their coordinates in normal font, such as x = ( x 1 , … , x m ) \mathbf{x}=(x_1,\ldots,x_m) x = ( x 1 , … , x m ) .
Frequency vector The frequency vector of any given function f : [ N ] → [ N ] f:[N]\to[N] f : [ N ] → [ N ] is c ( f ) = ( ∣ f − 1 ( 1 ) ∣ , … , ∣ f − 1 ( N ) ∣ ) \mathbf{c}(f)=(|f^{-1}(1)|,\ldots,|f^{-1}(N)|) c ( f ) = ( ∣ f − 1 ( 1 ) ∣ , … , ∣ f − 1 ( N ) ∣ ) . A vector c = ( c 1 , c 2 , … , c N ) ∈ Z ≥ 0 N \mathbf{c}=(c_1,c_2,\ldots,c_N)\in\mathbb{Z}_{\geq0}^N c = ( c 1 , c 2 , … , c N ) ∈ Z ≥ 0 N is feasible if ∑ j ∈ [ N ] c j = N \sum_{j\in[N]}c_j=N ∑ j ∈ [ N ] c j = N , equivalently if c = c ( f ) \mathbf{c}=\mathbf{c}(f) c = c ( f ) for some f : [ N ] → [ N ] f:[N]\to[N] f : [ N ] → [ N ] . We call any such vector a feasible frequency vector , or simply a feasible c \mathbf{c} c .
For a feasible (frequency vector) c \mathbf{c} c , let D c \mathcal{D}_{\mathbf{c}} D c be the uniform distribution on functions whose frequency vector is a permutation of c \mathbf{c} c . To sample from D c \mathcal{D}_{\mathbf{c}} D c , one can first uniformly permute the entries of c \mathbf{c} c to obtain c ′ \mathbf{c}' c ′ , then choose ( f ( 1 ) , … , f ( N ) ) (f(1),\ldots,f(N)) ( f ( 1 ) , … , f ( N )) uniformly among all sequences in which each output label j j j occurs exactly c j ′ c'_j c j ′ times.
The following random variable describes the frequency of a uniformly chosen output label. For a function f f f drawn from D c \mathcal{D}_{\mathbf{c}} D c , define its positive frequency statistics X = ∣ f − 1 ( Y ) ∣ X=\lvert f^{-1}(Y)\rvert X = ∣ f − 1 ( Y )∣ , where Y Y Y is uniformly chosen from f ( [ N ] ) f([N]) f ([ N ]) . Equivalently,
Pr [ X = a ] = ∣ { j : c j = a } ∣ ∣ { j : c j ≠ 0 } ∣ ( a ≥ 1 ) . \Pr[X=a]=\frac{\lvert\{j:c_j=a\}\rvert}{\lvert\{j:c_j\ne0\}\rvert}\qquad(a\ge1). Pr [ X = a ] = ∣{ j : c j = 0 }∣ ∣{ j : c j = a }∣ ( a ≥ 1 ) .
Choosing instead Y ′ Y' Y ′ uniformly from [ N ] [N] [ N ] gives another random variable, the mean-one frequency statistics Z = ∣ f − 1 ( Y ′ ) ∣ Z=\lvert f^{-1}(Y')\rvert Z = ∣ f − 1 ( Y ′ )∣ . Since E [ X ] = N / ∣ f ( [ N ] ) ∣ \mathbb{E}[X]=N/\lvert f([N])\rvert E [ X ] = N / ∣ f ([ N ])∣ , we have
Pr [ Z = a ] = Pr [ X = a ] E [ X ] ( a ≥ 1 ) , Pr [ Z = 0 ] = 1 − 1 E [ X ] . (4) \Pr[Z=a]=\frac{\Pr[X=a]}{\mathbb{E}[X]}\quad(a\ge1),\qquad\Pr[Z=0]=1-\frac{1}{\mathbb{E}[X]}. \tag*{(4)} Pr [ Z = a ] = E [ X ] Pr [ X = a ] ( a ≥ 1 ) , Pr [ Z = 0 ] = 1 − E [ X ] 1 . (4)
So the normalization simply corresponds to including unused output labels. When it is clear from the context, we will refer to any of these statistics simply as frequency statistics.
From frequency statistics to functions We now construct a random function from prescribed positive frequency statistics X X X , or equivalently its associated mean-one frequency statistics Z Z Z as in Equation (4) . We use a randomized variant of the frequency construction of [RRSS09, Definition 5.4]. We sample m m m multiplicities z = ( z 1 , … , z m ) \mathbf{z}=(z_1,\ldots,z_m) z = ( z 1 , … , z m ) i.i.d. according to Z Z Z , each nonzero draw specifying the multiplicity of a distinct output label. If their sum is z ≤ N z\le N z ≤ N , we add N − z N-z N − z additional output labels, each occurring exactly once. Note that adding singleton labels changes the final frequency statistics.
Definition 2.1 (Induced input distribution). Fix an integer A ≥ 1 A\ge1 A ≥ 1 and positive frequency statistics X X X supported on [ A ] [A] [ A ] . Denote μ = E [ X ] \mu=\mathbb{E}[X] μ = E [ X ] , and define its associated mean-one frequency statistics Z Z Z by (4) . For N ≥ 1 N\ge1 N ≥ 1 , let Π N \Pi_N Π N be the distribution of f : [ N ] → [ N ] f:[N]\to[N] f : [ N ] → [ N ] obtained as follows:
Draw m = ⌊ N / 2 ⌋ m=\lfloor N/2\rfloor m = ⌊ N /2 ⌋ independent multiplicities z = ( z 1 , … , z m ) \mathbf{z}=(z_1,\ldots,z_m) z = ( z 1 , … , z m ) according to the distribution of Z Z Z ; put z = ∑ i z i z=\sum_i z_i z = ∑ i z i .
If z ≤ N z\le N z ≤ N , form c = c ( z ) \mathbf{c}=\mathbf{c}(\mathbf{z}) c = c ( z ) by taking the non-zero entries of z \mathbf{z} z , then adding N − z N-z N − z entries equal to 1 1 1 , and finally zeros to length N N N . If z > N z>N z > N , set c = ( 1 , … , 1 ) \mathbf{c}=(1,\ldots,1) c = ( 1 , … , 1 ) .
Draw f ∼ D c f\sim\mathcal{D}_{\mathbf{c}} f ∼ D c .
Observe that the vector c \mathbf{c} c in step 2 is always feasible: its non-zero entries sum to N N N .
Remark 2.2. Let S = { 0 } ∪ [ A ] S=\{0\}\cup[A] S = { 0 } ∪ [ A ] , m = ⌊ N / 2 ⌋ m=\lfloor N/2\rfloor m = ⌊ N /2 ⌋ . Let π \pi π be the probability distribution of Z Z Z , that is π ( s ) = Pr [ Z = s ] \pi(s)=\Pr[Z=s] π ( s ) = Pr [ Z = s ] for s ∈ S s\in S s ∈ S . Then Π N \Pi_N Π N is directly connected to π ⊗ m \pi^{\otimes m} π ⊗ m as follows. For z ∈ S m \mathbf{z}\in S^m z ∈ S m , let c ( z ) \mathbf{c}(\mathbf{z}) c ( z ) be the frequency vector obtained in step 2 of Definition 2.1 . Then generating f f f according to Π N \Pi_N Π N is equivalent to generating z \mathbf{z} z according to π ⊗ m \pi^{\otimes m} π ⊗ m and then f f f according to D c ( z ) \mathcal{D}_{\mathbf{c}(\mathbf{z})} D c ( z ) .
In particular, for every algorithm A \mathcal{A} A with query access to f f f , we have
Pr f ∼ Π N [ A f = 1 ] = E z ∼ π ⊗ m [ h ( z ) ] , with h ( z ) = Pr f ∼ D c ( z ) [ A f = 1 ] . (5) \Pr_{f\sim\Pi_N}[\mathcal{A}^f=1]=\mathbb{E}_{\mathbf{z}\sim\pi^{\otimes m}}[h(\mathbf{z})],\qquad\text{with }h(\mathbf{z})=\Pr_{f\sim\mathcal{D}_{\mathbf{c}(\mathbf{z})}}[\mathcal{A}^f=1]. \tag*{(5)} f ∼ Π N Pr [ A f = 1 ] = E z ∼ π ⊗ m [ h ( z )] , with h ( z ) = f ∼ D c ( z ) Pr [ A f = 1 ] . (5)
Example 2.3. Consider A = 3 A=3 A = 3 and N = 8 N=8 N = 8 , and let X X X equal 1 1 1 or 3 3 3 , each with probability 1 / 2 1/2 1/2 . Then μ = 2 \mu=2 μ = 2 and
Pr [ Z = 0 ] = 1 2 , Pr [ Z = 1 ] = Pr [ Z = 3 ] = 1 4 . \Pr[Z=0]=\frac{1}{2},\qquad\Pr[Z=1]=\Pr[Z=3]=\frac{1}{4}. Pr [ Z = 0 ] = 2 1 , Pr [ Z = 1 ] = Pr [ Z = 3 ] = 4 1 . To sample f ∼ Π 8 f\sim\Pi_8 f ∼ Π 8 , draw four independent multiplicities from this distribution. If the draws are ( 3 , 1 , 0 , 0 ) (3,1,0,0) ( 3 , 1 , 0 , 0 ) , their sum is s = 4 s=4 s = 4 , so we add four output values of multiplicity one and obtain
c = ( 3 , 1 , 1 , 1 , 1 , 1 , 0 , 0 ) . \mathbf{c}=(3,1,1,1,1,1,0,0). c = ( 3 , 1 , 1 , 1 , 1 , 1 , 0 , 0 ) . Thus there is one output value of multiplicity three and five of multiplicity one. One possible outcome after assigning labels and positions is
( f ( 1 ) , … , f ( 8 ) ) = ( 7 , 2 , 7 , 5 , 8 , 3 , 6 , 7 ) . (f(1),\ldots,f(8))=(7,2,7,5,8,3,6,7). ( f ( 1 ) , … , f ( 8 )) = ( 7 , 2 , 7 , 5 , 8 , 3 , 6 , 7 ) . For comparison, the draw ( 3 , 3 , 3 , 0 ) (3,3,3,0) ( 3 , 3 , 3 , 0 ) has s = 9 > N s=9>N s = 9 > N and triggers the fallback c = ( 1 , … , 1 ) \mathbf{c}=(1,\ldots,1) c = ( 1 , … , 1 ) , producing a uniformly random bijection.
The number K K K of draws equal to 3 3 3 has distribution Bin ( 4 , 1 / 4 ) \operatorname{Bin}(4,1/4) Bin ( 4 , 1/4 ) . Values K = 0 K=0 K = 0 or K ≥ 3 K\geq3 K ≥ 3 produce a bijection, while K = 1 , 2 K=1,2 K = 1 , 2 produce one or two output values of multiplicity three, respectively. Hence the full input distribution is
Π 8 = 47 128 D ( 1 , 1 , 1 , 1 , 1 , 1 , 1 , 1 ) + 27 64 D ( 3 , 1 , 1 , 1 , 1 , 1 , 0 , 0 ) + 27 128 D ( 3 , 3 , 1 , 1 , 0 , 0 , 0 , 0 ) . \Pi_8=\frac{47}{128}\mathcal{D}_{(1,1,1,1,1,1,1,1)}+\frac{27}{64}\mathcal{D}_{(3,1,1,1,1,1,0,0)}+\frac{27}{128}\mathcal{D}_{(3,3,1,1,0,0,0,0)}. Π 8 = 128 47 D ( 1 , 1 , 1 , 1 , 1 , 1 , 1 , 1 ) + 64 27 D ( 3 , 1 , 1 , 1 , 1 , 1 , 0 , 0 ) + 128 27 D ( 3 , 3 , 1 , 1 , 0 , 0 , 0 , 0 ) .
Main theorems
Fix an integer A ≥ 1 A\geq1 A ≥ 1 , and two positive frequency statistics X 0 , X 1 X_0,X_1 X 0 , X 1 supported on [ A ] [A] [ A ] . We define their respective induced input distributions Π 0 , N \Pi_{0,N} Π 0 , N and Π 1 , N \Pi_{1,N} Π 1 , N according to Definition 2.1 , and consider the following distinguishability problem.
A single function f ∼ Π b , N f\sim\Pi_{b,N} f ∼ Π b , N is drawn before the algorithm starts. The (quantum) algorithm receives standard (quantum) query access to this fixed function f f f , with b b b hidden. Our goal is to bound the difference between its acceptance probabilities under Π 0 , N \Pi_{0,N} Π 0 , N and Π 1 , N \Pi_{1,N} Π 1 , N in terms of the moments and the number of queries it makes.
The following proposition expresses exact moment matching of the mean-one frequency statistics as proportional moments of the positive frequency statistics.
Recall that, for b ∈ { 0 , 1 } b\in\{0,1\} b ∈ { 0 , 1 } and μ b = E [ X b ] \mu_b=\mathbb{E}[X_b] μ b = E [ X b ] , we define Z b ∈ { 0 } ∪ [ A ] Z_b\in\{0\}\cup[A] Z b ∈ { 0 } ∪ [ A ] by
Pr [ Z b = a ] = Pr [ X b = a ] μ b (for a ∈ [ A ] ) , Pr [ Z b = 0 ] = 1 − 1 μ b . \Pr[Z_b=a]=\frac{\Pr[X_b=a]}{\mu_b}\quad\text{(for }a\in[A]\text{)},\qquad\Pr[Z_b=0]=1-\frac{1}{\mu_b}. Pr [ Z b = a ] = μ b Pr [ X b = a ] (for a ∈ [ A ] ) , Pr [ Z b = 0 ] = 1 − μ b 1 .
Since μ b ≥ 1 \mu_b\geq1 μ b ≥ 1 , these probabilities are nonnegative and sum to one. Equivalently, we keep an independent draw from X b X_b X b with probability 1 / μ b 1/\mu_b 1/ μ b and replace it by zero otherwise.
Proposition 2.4 (Normalization of moments). For b ∈ { 0 , 1 } b\in\{0,1\} b ∈ { 0 , 1 } and every integer $j\geq 1,
E [ Z b j ] = E [ X b j ] μ b , E [ Z b ] = 1. (6) \mathbb{E}[Z_b^j]=\frac{\mathbb{E}[X_b^j]}{\mu_b},\qquad\mathbb{E}[Z_b]=1. \tag*{(6)} E [ Z b j ] = μ b E [ X b j ] , E [ Z b ] = 1. (6) Consequently, for every integer $j\geq 1,
E [ Z 0 j ] = E [ Z 1 j ] ⟺ E [ X 1 j ] E [ X 0 j ] = μ 1 μ 0 . \mathbb{E}[Z_0^j]=\mathbb{E}[Z_1^j]\quad\Longleftrightarrow\quad\frac{\mathbb{E}[X_1^j]}{\mathbb{E}[X_0^j]}=\frac{\mu_1}{\mu_0}. E [ Z 0 j ] = E [ Z 1 j ] ⟺ E [ X 0 j ] E [ X 1 j ] = μ 0 μ 1 .
Proof. The proof is direct using, for j ≥ 1 j \ge1 j ≥ 1 .
E [ Z b j ] = ∑ a = 1 A a j Pr [ X b = a ] μ b = E [ X b j ] μ b . \mathbb{E}[Z_b^j] = \sum_{a=1}^{A} a^j \frac{\Pr[X_b=a]}{\mu_b} = \frac{\mathbb{E}[X_b^j]}{\mu_b}. E [ Z b j ] = a = 1 ∑ A a j μ b Pr [ X b = a ] = μ b E [ X b j ] .
In particular, all denominators are non-zero since X b ≥ 1 X_b \ge1 X b ≥ 1 , so cross-multiplication proves the equivalence. The case j = 1 j=1 j = 1 provides E [ Z b ] = 1 \mathbb{E}[Z_b]=1 E [ Z b ] = 1 .
We now introduce our two main theorems, which share the same moment hypothesis. Theorem 2.5 remains useful when the support bound A A A and the number ( r − 1 ) (r-1) ( r − 1 ) of matched moments grow with N N N . For fixed A , r A,r A , r , Theorem 2.6 gives a stronger quantum query lower bound for constant distinguishing bias, at the cost of an exponential factor C A C^A C A .
Theorem 2.5 is proved in § 3 and Theorem 2.6 in § 4 . The constants c , C c,C c , C can be chosen the same in both theorems.
Theorem 2.5. Fix an integer A ≥ 1 A \ge1 A ≥ 1 and positive frequency statistics X 0 , X 1 X_0,X_1 X 0 , X 1 supported on [ A ] [A] [ A ] . Define Π 0 , N , Π 1 , N \Pi_{0,N},\Pi_{1,N} Π 0 , N , Π 1 , N according to Definition 2.1 applied to X 0 X_0 X 0 and X 1 X_1 X 1 . Suppose that they satisfy the following, for an integer r ≥ 2 r \ge2 r ≥ 2 :
E [ X 1 ] E [ X 0 ] = E [ X 1 2 ] E [ X 0 2 ] = ⋯ = E [ X 1 r − 1 ] E [ X 0 r − 1 ] . (7) \frac{\mathbb{E}[X_1]}{\mathbb{E}[X_0]}=\frac{\mathbb{E}[X_1^2]}{\mathbb{E}[X_0^2]}=\cdots=\frac{\mathbb{E}[X_1^{r-1}]}{\mathbb{E}[X_0^{r-1}]}. \tag*{(7)} E [ X 0 ] E [ X 1 ] = E [ X 0 2 ] E [ X 1 2 ] = ⋯ = E [ X 0 r − 1 ] E [ X 1 r − 1 ] . (7) There are absolute constants c , C > 0 c,C>0 c , C > 0 such that, for integers N ≥ C A N \ge CA N ≥ C A and 0 ≤ T ≤ c N 0 \le T \le c\sqrt{N} 0 ≤ T ≤ c N , every T T T -query quantum algorithm A \mathcal{A} A satisfies
∣ Pr f ∼ Π 0 , N [ A f = 1 ] − Pr f ∼ Π 1 , N [ A f = 1 ] ∣ ≤ N A ( C A T 2 r 2 N ) r + N exp ( − c N A 2 ) . (8) \left|\Pr_{f\sim\Pi_{0,N}}[\mathcal{A}^f=1]-\Pr_{f\sim\Pi_{1,N}}[\mathcal{A}^f=1]\right|
\le\frac{N}{A}\left(\frac{CAT^2}{r^2N}\right)^r+N\exp\left(-\frac{cN}{A^2}\right). \tag*{(8)} f ∼ Π 0 , N Pr [ A f = 1 ] − f ∼ Π 1 , N Pr [ A f = 1 ] ≤ A N ( r 2 N C A T 2 ) r + N exp ( − A 2 c N ) . (8) In particular, if A = O ( r 2 ) A=O(r^2) A = O ( r 2 ) and A = o ( N / log N ) A=o(\sqrt{N}/\log N) A = o ( N / log N ) , this difference is o ( 1 ) o(1) o ( 1 ) whenever T = o ( N 1 / 2 − 1 / ( 2 r ) ) T=o(N^{1/2-1/(2r)}) T = o ( N 1/2 − 1/ ( 2 r ) ) as N → ∞ N\to\infty N → ∞ . Each probability includes the initial draw of f f f and the algorithm’s measurement outcomes.
Theorem 2.6. Fix an integer A ≥ 1 A \ge1 A ≥ 1 and positive frequency statistics X 0 , X 1 X_0,X_1 X 0 , X 1 supported on [ A ] [A] [ A ] . Define Π 0 , N , Π 1 , N \Pi_{0,N},\Pi_{1,N} Π 0 , N , Π 1 , N according to Definition 2.1 applied to X 0 X_0 X 0 and X 1 X_1 X 1 . Suppose that they satisfy the following, for an integer r ≥ 2 r \ge2 r ≥ 2 :
E [ X 1 ] E [ X 0 ] = E [ X 1 2 ] E [ X 0 2 ] = ⋯ = E [ X 1 r − 1 ] E [ X 0 r − 1 ] . \frac{\mathbb{E}[X_1]}{\mathbb{E}[X_0]}=\frac{\mathbb{E}[X_1^2]}{\mathbb{E}[X_0^2]}=\cdots=\frac{\mathbb{E}[X_1^{r-1}]}{\mathbb{E}[X_0^{r-1}]}. E [ X 0 ] E [ X 1 ] = E [ X 0 2 ] E [ X 1 2 ] = ⋯ = E [ X 0 r − 1 ] E [ X 1 r − 1 ] . There are absolute constants c , C > 0 c,C>0 c , C > 0 such that, for integers N ≥ C A N \ge CA N ≥ C A and 0 ≤ T ≤ c N 0 \le T \le c\sqrt{N} 0 ≤ T ≤ c N , every T T T -query quantum algorithm A \mathcal{A} A satisfies
∣ Pr f ∼ Π 0 , N [ A f = 1 ] − Pr f ∼ Π 1 , N [ A f = 1 ] ∣ ≤ C A r T 2 − 2 1 − r N 1 − 2 1 − r + N exp ( − c N A 2 ) . (9) \left|\Pr_{f\sim\Pi_{0,N}}[\mathcal{A}^f=1]-\Pr_{f\sim\Pi_{1,N}}[\mathcal{A}^f=1]\right|
\le CA^r\frac{T^{2-2^{1-r}}}{N^{1-2^{1-r}}}+N\exp\left(-\frac{cN}{A^2}\right). \tag*{(9)} f ∼ Π 0 , N Pr [ A f = 1 ] − f ∼ Π 1 , N Pr [ A f = 1 ] ≤ C A r N 1 − 2 1 − r T 2 − 2 1 − r + N exp ( − A 2 c N ) . (9) In particular, for fixed A , r A,r A , r , this difference is o ( 1 ) o(1) o ( 1 ) whenever T = o ( N 1 / 2 − 1 / ( 2 ( 2 r − 1 ) ) ) T=o(N^{1/2-1/(2(2^r-1))}) T = o ( N 1/2 − 1/ ( 2 ( 2 r − 1 )) ) as N → ∞ N\to\infty N → ∞ . Each probability includes the initial draw of f f f and the algorithm’s measurement outcomes.
Remark on the case r = 2 r = 2 r = 2 . This base case also appears in [RRSS09, Definition 5.4, Theorem 5.6 and Corollary 5.7]. When r = 2 r = 2 r = 2 , the proportional-moment condition is vacuous, so both theorems apply directly. Consider A = 2 A = 2 A = 2 , X 0 ≡ 1 X_0 \equiv1 X 0 ≡ 1 , and X 1 ≡ 2 X_1 \equiv2 X 1 ≡ 2 . Then Π 0 , N \Pi_{0,N} Π 0 , N is uniform on bijections, whereas Π 1 , N \Pi_{1,N} Π 1 , N has K ∼ Bin ( ⌊ N / 2 ⌋ , 1 / 2 ) K \sim\operatorname{Bin}(\lfloor N/2 \rfloor, 1/2) K ∼ Bin (⌊ N /2 ⌋ , 1/2 ) output values of multiplicity 2 2 2 , completed with singletons. With probability 1 − e − Ω ( N ) 1 - e^{-\Omega(N)} 1 − e − Ω ( N ) , at least N / 8 N/8 N /8 such values occur, so the function is at distance at least 1 / 8 1/8 1/8 from injectivity. This is element distinctness testing: injective versus far from injective; the second distribution need not be two-to-one. Theorem 2.5 gives an Ω ( N 1 / 4 ) \Omega(N^{1/4}) Ω ( N 1/4 ) quantum query lower bound, while Theorem 2.6 recovers the known Ω ( N 1 / 3 ) \Omega(N^{1/3}) Ω ( N 1/3 ) bound for testing injectivity. The latter follows from the lower bound on the collision problem [5 ] by noticing that a two-to-one function is a special case of a far from injective function.
Moment matching: framework and first bound
We begin by introducing the general tools that will be used in the proofs of our two main theorems, and then prove the first one, namely Theorem 2.5 .
Polynomial and probabilistic tools
Symmetrization
We use the frequency-vector notation of Subsection 2.1. The following lemma establishes the connection between quantum query complexity and the moment-matching technique used in our proof. It shows that, after averaging over random permutations of the domain and range, the acceptance probability of any quantum algorithm making at most T T T queries can be expressed as a symmetric polynomial of degree at most 2 T 2T 2 T in the output frequencies.
Moreover, its representation in terms of power sums, together with the weighted-degree restriction, allows us to obtain a low-degree univariate polynomial when varying a single multiplicity while keeping others fixed. This polynomial structure is crucial for applying moment matching to cancel the lower-order terms and using polynomial inequalities to bound the remaining contribution.
Lemma 3.1 (Symmetrization). For every quantum algorithm A A A making at most T T T queries, there is a symmetric polynomial P ∈ R [ x 1 , … , x N ] P \in\mathbb{R}[x_1, \ldots, x_N] P ∈ R [ x 1 , … , x N ] of degree at most d = 2 T d = 2T d = 2 T such that, for every feasible c \mathbf{c} c ,
P ( c ) = Pr f ∼ D c [ A f = 1 ] ∈ [ 0 , 1 ] . P(\mathbf{c}) = \Pr_{f \sim\mathcal{D}_{\mathbf{c}}}\left[A^f = 1\right] \in[0,1]. P ( c ) = f ∼ D c Pr [ A f = 1 ] ∈ [ 0 , 1 ] . If d ≥ 1 d \ge1 d ≥ 1 , one can write P ( x ) = F ( p 1 ( x ) , … , p d ( x ) ) P(\mathbf{x}) = F(p_1(\mathbf{x}), \ldots, p_d(\mathbf{x})) P ( x ) = F ( p 1 ( x ) , … , p d ( x )) , where p j ( x ) = ∑ i = 1 N x i j p_j(\mathbf{x}) = \sum_{i=1}^{N} x_i^j p j ( x ) = ∑ i = 1 N x i j is the j j j -th power-sum symmetric polynomial, F ∈ R [ y 1 , … , y d ] F \in\mathbb{R}[y_1, \ldots, y_d] F ∈ R [ y 1 , … , y d ] and every monomial y 1 α 1 ⋯ y d α d y_1^{\alpha_1} \cdots y_d^{\alpha_d} y 1 α 1 ⋯ y d α d of F F F satisfies ∑ j = 1 d j α j ≤ d \sum_{j=1}^{d} j\alpha_j \le d ∑ j = 1 d j α j ≤ d .
Proof. First, following [8 ] , the acceptance probability Pr [ A f = 1 ] \Pr\left[A^f = 1\right] Pr [ A f = 1 ] is a polynomial of degree at most d d d in the indicators δ i , a ( f ) = 1 [ f ( i ) = a ] \delta_{i,a}(f) = \mathbf{1}[f(i) = a] δ i , a ( f ) = 1 [ f ( i ) = a ] .
For an input with frequency vector c \mathbf{c} c , averaging over independent uniform domain and range permutations induces D c \mathcal{D}_{\mathbf{c}} D c . On valid encodings of f f f , each monomial either vanishes or is the indicator of a partial function. If it fixes q ≤ d q \le d q ≤ d domain points and uses ℓ \ell ℓ distinct output values a 1 , … , a ℓ a_1,\ldots,a_\ell a 1 , … , a ℓ with multiplicities q 1 , … , q ℓ q_1,\ldots,q_\ell q 1 , … , q ℓ , its average is
1 ( N ) q ( N ) ℓ ∑ a 1 , … , a ℓ ∈ [ N ] d i s t i n c t ∏ s = 1 ℓ ( c a s ) q s , where ( x ) k = x ( x − 1 ) ⋯ ( x − k + 1 ) , and ( x ) 0 = 1. \frac{1}{(N)_q(N)_\ell}\sum_{\substack{a_1,\ldots,a_\ell\in[N]\\ \mathrm{distinct}}}\prod_{s=1}^{\ell}(c_{a_s})_{q_s},
\qquad\text{where }(x)_k=x(x-1)\cdots(x-k+1),\text{ and }(x)_0=1. ( N ) q ( N ) ℓ 1 a 1 , … , a ℓ ∈ [ N ] distinct ∑ s = 1 ∏ ℓ ( c a s ) q s , where ( x ) k = x ( x − 1 ) ⋯ ( x − k + 1 ) , and ( x ) 0 = 1.
This is a symmetric polynomial of degree at most ∑ s q s = q ≤ d \sum_s q_s=q\le d ∑ s q s = q ≤ d , proving the assertion about P P P . The fundamental theorem of symmetric polynomials and Newton’s identities express each homogeneous component of P P P in power sums of the same weighted degree [30 ] , giving F F F . □
Approximation and moment bounds
We begin by stating some polynomial tools that will be used in the proofs of Theorems 2.5 and 2.6 . The first provides a bound on the Taylor remainder of a low-degree polynomial whose values are bounded on an integer interval, while the second gives a Newton expansion and a corresponding remainder estimate. These results will allow us to control the higher-order terms that remain after moment matching. For completeness, we provide their proofs in Appendix § 8 .
Lemma 3.2 (Taylor bound). Let H ≥ 1 H\ge1 H ≥ 1 and d ≥ 0 d\ge0 d ≥ 0 be integers with d 2 ≤ H / 2 d^2\le H/2 d 2 ≤ H /2 . Let q ( z ) = ∑ ℓ = 0 d a ℓ z ℓ q(z)=\sum_{\ell=0}^{d}a_\ell z^\ell q ( z ) = ∑ ℓ = 0 d a ℓ z ℓ be any polynomial of degree at most d d d such that ∣ q ( z ) ∣ ≤ 1 |q(z)|\le1 ∣ q ( z ) ∣ ≤ 1 for z ∈ { 0 } ∪ [ H ] = { 0 , 1 , … , H } z\in\{0\}\cup[H]=\{0,1,\ldots,H\} z ∈ { 0 } ∪ [ H ] = { 0 , 1 , … , H } . For an integer r ≥ 1 r\ge1 r ≥ 1 , let Q r = ∑ ℓ = 0 min ( r − 1 , r ) a ℓ z ℓ Q_r=\sum_{\ell=0}^{\min(r-1,r)}a_\ell z^\ell Q r = ∑ ℓ = 0 m i n ( r − 1 , r ) a ℓ z ℓ . Then for every real z ∈ [ 0 , H ] z\in[0,H] z ∈ [ 0 , H ] ,
∣ q ( z ) − Q r ( z ) ∣ ≤ 2 ( 2 r ) ! ( 4 d 2 H ) r z r . (10) |q(z)-Q_r(z)|\le\frac{2}{(2r)!}\left(\frac{4d^2}{H}\right)^r z^r. \tag*{(10)} ∣ q ( z ) − Q r ( z ) ∣ ≤ ( 2 r )! 2 ( H 4 d 2 ) r z r . (10)
Lemma 3.3 (Newton bound). Let H ≥ 1 H\ge1 H ≥ 1 and d ≥ 0 d\ge0 d ≥ 0 be integers, and let q ( z ) q(z) q ( z ) be any polynomial of degree at most d d d such that ∣ q ( z ) ∣ ≤ 1 |q(z)|\le1 ∣ q ( z ) ∣ ≤ 1 for z ∈ { 0 } ∪ [ H ] z\in\{0\}\cup[H] z ∈ { 0 } ∪ [ H ] . Its Newton coefficients are
d ℓ = ∑ s = 0 ℓ ( − 1 ) ℓ − s ( ℓ s ) q ( s ) ( 0 ≤ ℓ ≤ H ) . d_\ell=\sum_{s=0}^{\ell}(-1)^{\ell-s}\binom{\ell}{s}q(s)\qquad(0\le\ell\le H). d ℓ = s = 0 ∑ ℓ ( − 1 ) ℓ − s ( s ℓ ) q ( s ) ( 0 ≤ ℓ ≤ H ) . For an integer 1 ≤ r ≤ H + 1 1\le r\le H+1 1 ≤ r ≤ H + 1 , let Q r ( z ) = ∑ ℓ = 0 r − 1 d ℓ ( z ℓ ) Q_r(z)=\sum_{\ell=0}^{r-1}d_\ell\binom{z}{\ell} Q r ( z ) = ∑ ℓ = 0 r − 1 d ℓ ( ℓ z ) . At every z ∈ { 0 } ∪ [ H ] z\in\{0\}\cup[H] z ∈ { 0 } ∪ [ H ] ,
q ( z ) − Q r ( z ) = ∑ ℓ = r H d ℓ ( z ℓ ) = ∑ ℓ = r z d ℓ ( z ℓ ) , q(z)-Q_r(z)=\sum_{\ell=r}^{H}d_\ell\binom{z}{\ell}=\sum_{\ell=r}^{z}d_\ell\binom{z}{\ell}, q ( z ) − Q r ( z ) = ℓ = r ∑ H d ℓ ( ℓ z ) = ℓ = r ∑ z d ℓ ( ℓ z ) , where empty sums are understood to be zero. Assume moreover that d 2 ≤ H / 2 d^2\le H/2 d 2 ≤ H /2 . Then, for every integer 1 ≤ r ≤ H + 1 1\le r\le H+1 1 ≤ r ≤ H + 1 and z ∈ { 0 } ∪ [ H ] z\in\{0\}\cup[H] z ∈ { 0 } ∪ [ H ] ,
∣ q ( z ) − Q r ( z ) ∣ ≤ 2 ( 2 r ) ! ( 4 d 2 H ) r z r . (11) |q(z)-Q_r(z)|\le\frac{2}{(2r)!}\left(\frac{4d^2}{H}\right)^r z^r. \tag*{(11)} ∣ q ( z ) − Q r ( z ) ∣ ≤ ( 2 r )! 2 ( H 4 d 2 ) r z r . (11)
We first establish a basic consequence of moment matching. The following lemma shows that when two probability distributions have matching moments up to a given order, the corresponding lower-order terms vanish in the difference of expectations of a polynomial. This cancellation holds in both the monomial and Newton bases and will be used to control the differences in acceptance probabilities.
Lemma 3.4 (Moment cancellation). Let A , r ≥ 1 A,r\ge1 A , r ≥ 1 be integers, and let π , ν \pi,\nu π , ν be probability distributions on { 0 } ∪ [ A ] \{0\}\cup[A] { 0 } ∪ [ A ] with matching moments through order r − 1 r-1 r − 1 , that is,
∑ s = 0 A ν ( s ) s k = ∑ s = 0 A π ( s ) s k ( k = 1 , … , r − 1 ) . \sum_{s=0}^{A}\nu(s)s^k=\sum_{s=0}^{A}\pi(s)s^k\qquad(k=1,\ldots,r-1). s = 0 ∑ A ν ( s ) s k = s = 0 ∑ A π ( s ) s k ( k = 1 , … , r − 1 ) .
Choose one of the two bases ϕ ℓ ( z ) = z ℓ \phi_\ell(z)=z^\ell ϕ ℓ ( z ) = z ℓ , or ϕ ℓ ( z ) = ( z ℓ ) \phi_\ell(z)=\binom{z}{\ell} ϕ ℓ ( z ) = ( ℓ z ) , for ℓ ≥ 0 \ell\ge0 ℓ ≥ 0 . Suppose q ( s ) = ∑ ℓ = 0 D a ℓ ϕ ℓ ( s ) q(s)=\sum_{\ell=0}^{D}a_\ell\phi_\ell(s) q ( s ) = ∑ ℓ = 0 D a ℓ ϕ ℓ ( s ) on { 0 } ∪ [ A ] \{0\}\cup[A] { 0 } ∪ [ A ] , for an integer D ≥ 0 D\ge0 D ≥ 0 . Then
∑ s = 0 A ( ν ( s ) − π ( s ) ) q ( s ) = ∑ ℓ = r D η ℓ a ℓ , (12) \sum_{s=0}^{A}(\nu(s)-\pi(s))q(s)=\sum_{\ell=r}^{D}\eta_\ell a_\ell, \tag*{(12)} s = 0 ∑ A ( ν ( s ) − π ( s )) q ( s ) = ℓ = r ∑ D η ℓ a ℓ , (12)
where
η ℓ = ∑ s = 0 A ( ν ( s ) − π ( s ) ) ϕ ℓ ( s ) , and ∣ η ℓ ∣ ≤ ∥ ν − π ∥ 1 ϕ ℓ ( A ) . \eta_\ell=\sum_{s=0}^{A}(\nu(s)-\pi(s))\phi_\ell(s),\qquad\text{and}\qquad|\eta_\ell|\le\|\nu-\pi\|_1\phi_\ell(A). η ℓ = s = 0 ∑ A ( ν ( s ) − π ( s )) ϕ ℓ ( s ) , and ∣ η ℓ ∣ ≤ ∥ ν − π ∥ 1 ϕ ℓ ( A ) .
Proof. The moment identities also hold for k = 0 k=0 k = 0 , since both distributions have total mass 1. For either basis, ϕ ℓ \phi_\ell ϕ ℓ is a polynomial of degree ℓ \ell ℓ . Thus, for ℓ < r \ell<r ℓ < r , writing ϕ ℓ ( s ) = ∑ k = 0 ℓ b k s k \phi_\ell(s)=\sum_{k=0}^{\ell}b_ks^k ϕ ℓ ( s ) = ∑ k = 0 ℓ b k s k gives
η ℓ = ∑ k = 0 ℓ b k ∑ s = 0 A ( ν ( s ) − π ( s ) ) s k = 0. \eta_\ell=\sum_{k=0}^{\ell}b_k\sum_{s=0}^{A}(\nu(s)-\pi(s))s^k=0. η ℓ = k = 0 ∑ ℓ b k s = 0 ∑ A ( ν ( s ) − π ( s )) s k = 0.
Expanding q q q and interchanging the finite sums therefore yields
∑ s = 0 A ( ν ( s ) − π ( s ) ) q ( s ) = ∑ ℓ = 0 D a ℓ η ℓ = ∑ ℓ = r D a ℓ η ℓ . \sum_{s=0}^{A}(\nu(s)-\pi(s))q(s)=\sum_{\ell=0}^{D}a_\ell\eta_\ell=\sum_{\ell=r}^{D}a_\ell\eta_\ell. s = 0 ∑ A ( ν ( s ) − π ( s )) q ( s ) = ℓ = 0 ∑ D a ℓ η ℓ = ℓ = r ∑ D a ℓ η ℓ .
Finally, for either basis, 0 ≤ ϕ ℓ ( s ) ≤ ϕ ℓ ( A ) 0\le\phi_\ell(s)\le\phi_\ell(A) 0 ≤ ϕ ℓ ( s ) ≤ ϕ ℓ ( A ) on { 0 } ∪ [ A ] \{0\}\cup[A] { 0 } ∪ [ A ] , so
∣ η ℓ ∣ ≤ ∑ s = 0 A ∣ ν ( s ) − π ( s ) ∣ ϕ ℓ ( s ) ≤ ∥ ν − π ∥ 1 ϕ ℓ ( A ) . |\eta_\ell|\le\sum_{s=0}^{A}|\nu(s)-\pi(s)|\phi_\ell(s)\le\|\nu-\pi\|_1\phi_\ell(A). ∣ η ℓ ∣ ≤ s = 0 ∑ A ∣ ν ( s ) − π ( s ) ∣ ϕ ℓ ( s ) ≤ ∥ ν − π ∥ 1 ϕ ℓ ( A ) .
We next recall the Lagrange polynomial interpolation result on integer intervals. For completeness, we provide a proof in Appendix § 8 .
Lemma 3.5 (Lagrange interpolation). Let A ≥ 2 A\ge2 A ≥ 2 and 0 ≤ d ≤ A 0\le d\le A 0 ≤ d ≤ A be integers, and let s 0 < ⋯ < s d s_0<\cdots<s_d s 0 < ⋯ < s d belong to { 0 } ∪ [ A ] \{0\}\cup[A] { 0 } ∪ [ A ] . Define
L i ( x ) = ∏ 0 ≤ h ≤ d h ≠ i x − s h s i − s h ( 0 ≤ i ≤ d ) . L_i(x)=\prod_{\substack{0\le h\le d\\h\ne i}}\frac{x-s_h}{s_i-s_h}\qquad(0\le i\le d). L i ( x ) = 0 ≤ h ≤ d h = i ∏ s i − s h x − s h ( 0 ≤ i ≤ d ) . Every polynomial P P P of degree at most d d d satisfies P ( x ) = ∑ i = 0 d P ( s i ) L i ( x ) P(x)=\sum_{i=0}^{d}P(s_i)L_i(x) P ( x ) = ∑ i = 0 d P ( s i ) L i ( x ) . Moreover, at every integer t ∈ { 0 } ∪ [ A ] t\in\{0\}\cup[A] t ∈ { 0 } ∪ [ A ] , ∑ i = 0 d ∣ L i ( t ) ∣ ≤ 4 A − 1 \sum_{i=0}^{d}|L_i(t)|\le4^{A-1} ∑ i = 0 d ∣ L i ( t ) ∣ ≤ 4 A − 1 .
The following lemma provides bounds on inverse moments of binomial random variables. These estimates will be used to control the inverse block-count factors that arise when averaging the bounds on the Newton coefficients, required later in the proof of Theorem 2.6 . Importantly, this result does not require independence between the random variables.
Lemma 3.6 (Inverse binomial moments). Let m ≥ 1 m\ge1 m ≥ 1 be an integer, let a , b ∈ ( 0 , 1 ] a,b\in(0,1] a , b ∈ ( 0 , 1 ] , and let Y , Z Y,Z Y , Z have marginal distributions Bin ( m − 1 , a ) \operatorname{Bin}(m-1,a) Bin ( m − 1 , a ) and Bin ( m − 1 , b ) \operatorname{Bin}(m-1,b) Bin ( m − 1 , b ) . They need not be independent. Then
E [ ( 1 + Y ) − 1 ] = 1 − ( 1 − a ) m m a ≤ 1 m a . \mathbb{E}[(1+Y)^{-1}]=\frac{1-(1-a)^m}{ma}\le\frac{1}{ma}. E [( 1 + Y ) − 1 ] = ma 1 − ( 1 − a ) m ≤ ma 1 . For β , γ ≥ 0 \beta,\gamma\ge0 β , γ ≥ 0 with β + γ ≤ 1 \beta+\gamma\le1 β + γ ≤ 1 ,
E [ ( 1 + Y ) − β ( 1 + Z ) − γ ] ≤ ( m a ) − β ( m b ) − γ . \mathbb{E}\left[(1+Y)^{-\beta}(1+Z)^{-\gamma}\right]\le(ma)^{-\beta}(mb)^{-\gamma}. E [ ( 1 + Y ) − β ( 1 + Z ) − γ ] ≤ ( ma ) − β ( mb ) − γ .
Proof. Since Y ∼ Bin ( m − 1 , a ) Y \sim\operatorname{Bin}(m-1,a) Y ∼ Bin ( m − 1 , a ) , we have
E [ ( 1 + Y ) − 1 ] = ∫ 0 1 E [ t Y ] d t = ∫ 0 1 ( 1 − a + a t ) m − 1 d t = 1 − ( 1 − a ) m m a ≤ 1 m a . \mathbb{E}[(1+Y)^{-1}] = \int_0^1 \mathbb{E}[t^Y]\,\mathrm{d}t = \int_0^1 (1-a+at)^{m-1}\,\mathrm{d}t = \frac{1-(1-a)^m}{ma} \le\frac{1}{ma}. E [( 1 + Y ) − 1 ] = ∫ 0 1 E [ t Y ] d t = ∫ 0 1 ( 1 − a + a t ) m − 1 d t = ma 1 − ( 1 − a ) m ≤ ma 1 .
The same bound holds for Z Z Z with b b b in place of a a a . Hölder’s inequality with weights β , γ , 1 − β − γ \beta,\gamma,1-\beta-\gamma β , γ , 1 − β − γ (the third factor being 1 1 1 ) then gives
E [ ( 1 + Y ) − β ( 1 + Z ) − γ ] ≤ E [ ( 1 + Y ) − 1 ] β E [ ( 1 + Z ) − 1 ] γ ≤ ( m a ) − β ( m b ) − γ . \mathbb{E}[(1+Y)^{-\beta}(1+Z)^{-\gamma}] \le\mathbb{E}[(1+Y)^{-1}]^\beta\mathbb{E}[(1+Z)^{-1}]^\gamma\le(ma)^{-\beta}(mb)^{-\gamma}. E [( 1 + Y ) − β ( 1 + Z ) − γ ] ≤ E [( 1 + Y ) − 1 ] β E [( 1 + Z ) − 1 ] γ ≤ ( ma ) − β ( mb ) − γ .
Hybrid arguments and moment matching
As discussed in the overview, interpolation between multiplicity distributions turns the global comparison into a one-coordinate calculation. This is a reminiscence of the quantum hybrid argument in [7 ] . The two lemmas of this section make this reduction explicit.
We start by defining a new notion of continuous hybrid argument. Then we explain why it is generalizing the usual one. Finally, we state a lemma that will be use to exploit the moment-matching condition.
In this full subsection, fix integers A , m ≥ 1 A,m \ge1 A , m ≥ 1 , and let S = { 0 } ∪ [ A ] S=\{0\}\cup[A] S = { 0 } ∪ [ A ] . They will be used as follows: A A A is the largest possible sampled multiplicity, m m m is the number of multiplicities we sample and S S S is the set of possible values of one multiplicity.
Continuous hybrid argument
Let h : S m → [ 0 , 1 ] h:S^m\to[0,1] h : S m → [ 0 , 1 ] be invariant under permutations of its coordinates. Symmetry lets us move any chosen coordinate to the last position. For this reason, for z = ( w , s ) ∈ S m z=(w,s)\in S^m z = ( w , s ) ∈ S m , with w ∈ S m − 1 w\in S^{m-1} w ∈ S m − 1 and s ∈ S s\in S s ∈ S , we define q w ( s ) = h ( w , s ) = h ( z ) q_w(s)=h(w,s)=h(z) q w ( s ) = h ( w , s ) = h ( z ) .
The following derivative identity in Lemma 3.7 provides a continuous version of the usual hybrid bound. We will elaborate on this after presenting its proof. Its final inequality additionally takes the absolute value inside the expectation over w w w .
Lemma 3.7 (Continuous hybrid argument). Let h : S m → [ 0 , 1 ] h:S^m\to[0,1] h : S m → [ 0 , 1 ] be invariant under permutations of its coordinates. Define q w ( s ) = h ( w , s ) q_w(s)=h(w,s) q w ( s ) = h ( w , s ) , for w ∈ S m − 1 w\in S^{m-1} w ∈ S m − 1 . Let ( π u ) 0 ≤ u ≤ 1 (\pi_u)_{0\le u\le1} ( π u ) 0 ≤ u ≤ 1 be a continuous, piecewise C 1 C^1 C 1 path of probability distributions on S S S , and denote F ( u ) = E π u ⊗ m [ h ] F(u)=\mathbb{E}_{\pi_u^{\otimes m}}[h] F ( u ) = E π u ⊗ m [ h ] . At every differentiability point of the path, with π ˙ u ( s ) = d d u π u ( s ) \dot{\pi}_u(s)=\frac{\mathrm{d}}{\mathrm{d}u}\pi_u(s) π ˙ u ( s ) = d u d π u ( s ) , the following holds:
F ′ ( u ) = m E w ∼ π u ⊗ ( m − 1 ) [ ∑ s ∈ S π ˙ u ( s ) q w ( s ) ] . (13) F'(u)=m\,\mathbb{E}_{w\sim\pi_u^{\otimes(m-1)}}\left[\sum_{s\in S}\dot{\pi}_u(s)q_w(s)\right]. \tag*{(13)} F ′ ( u ) = m E w ∼ π u ⊗ ( m − 1 ) [ s ∈ S ∑ π ˙ u ( s ) q w ( s ) ] . (13) Consequently,
∣ F ( 1 ) − F ( 0 ) ∣ ≤ m ∫ 0 1 E w ∼ π u ⊗ ( m − 1 ) [ ∣ ∑ s ∈ S π ˙ u ( s ) q w ( s ) ∣ ] d u . (14) |F(1)-F(0)|\le m\int_0^1\mathbb{E}_{w\sim\pi_u^{\otimes(m-1)}}\left[\left|\sum_{s\in S}\dot{\pi}_u(s)q_w(s)\right|\right]\,\mathrm{d}u. \tag*{(14)} ∣ F ( 1 ) − F ( 0 ) ∣ ≤ m ∫ 0 1 E w ∼ π u ⊗ ( m − 1 ) [ s ∈ S ∑ π ˙ u ( s ) q w ( s ) ] d u . (14)
Proof. Writing the expectation as a finite sum and differentiating each product term gives us
F ′ ( u ) = d d u ( ∑ z ∈ S m h ( z ) ∏ j = 1 m π u ( z j ) ) = ∑ i = 1 m ∑ z ∈ S m h ( z ) π ˙ u ( z i ) ∏ 1 ≤ j ≤ m j ≠ i π u ( z j ) . F'(u)=\frac{d}{du}\left(\sum_{\mathbf{z}\in S^m}h(\mathbf{z})\prod_{j=1}^{m}\pi_u(z_j)\right)
=\sum_{i=1}^{m}\sum_{\mathbf{z}\in S^m}h(\mathbf{z})\dot{\pi}_u(z_i)\prod_{\substack{1\leq j\leq m\\j\ne i}}\pi_u(z_j). F ′ ( u ) = d u d ( z ∈ S m ∑ h ( z ) j = 1 ∏ m π u ( z j ) ) = i = 1 ∑ m z ∈ S m ∑ h ( z ) π ˙ u ( z i ) 1 ≤ j ≤ m j = i ∏ π u ( z j ) .
For each fixed i i i , let us set s = z i s=z_i s = z i and w = ( z 1 , … , z i − 1 , z i + 1 , … , z m ) \mathbf{w}=(z_1,\ldots,z_{i-1},z_{i+1},\ldots,z_m) w = ( z 1 , … , z i − 1 , z i + 1 , … , z m ) . Symmetry gives h ( z ) = h ( w , s ) = q w ( s ) h(\mathbf{z})=h(\mathbf{w},s)=q_{\mathbf{w}}(s) h ( z ) = h ( w , s ) = q w ( s ) . Hence the inner sum is
∑ w ∈ S m − 1 ( ∏ j = 1 m − 1 π u ( w j ) ) ∑ s ∈ S π ˙ u ( s ) q w ( s ) = E w ∼ π u ⊗ ( m − 1 ) [ ∑ s ∈ S π ˙ u ( s ) q w ( s ) ] . \sum_{\mathbf{w}\in S^{m-1}}\left(\prod_{j=1}^{m-1}\pi_u(w_j)\right)\sum_{s\in S}\dot{\pi}_u(s)q_{\mathbf{w}}(s)
=\mathbb{E}_{\mathbf{w}\sim\pi_u^{\otimes(m-1)}}\left[\sum_{s\in S}\dot{\pi}_u(s)q_{\mathbf{w}}(s)\right]. w ∈ S m − 1 ∑ ( j = 1 ∏ m − 1 π u ( w j ) ) s ∈ S ∑ π ˙ u ( s ) q w ( s ) = E w ∼ π u ⊗ ( m − 1 ) [ s ∈ S ∑ π ˙ u ( s ) q w ( s ) ] .
This expression is independent of i i i , so summing over i i i proves (13) . Finally, F F F is continuous and piecewise C 1 C^1 C 1 , so ∣ F ( 1 ) − F ( 0 ) ∣ ≤ ∫ 0 1 ∣ F ′ ( u ) ∣ d u |F(1)-F(0)|\leq\int_0^1|F'(u)|\,du ∣ F ( 1 ) − F ( 0 ) ∣ ≤ ∫ 0 1 ∣ F ′ ( u ) ∣ d u . Therefore we can conclude by using ∣ E [ X ] ∣ ≤ E [ ∣ X ∣ ] |\mathbb{E}[X]|\leq\mathbb{E}[|X|] ∣ E [ X ] ∣ ≤ E [ ∣ X ∣ ] .
Connection to standard hybrid arguments
In our applications, these coordinates are multiplicity draws: s s s is the value of one draw and w \mathbf{w} w contains the other m − 1 m-1 m − 1 values. More explicitly, h ( z ) h(\mathbf{z}) h ( z ) is the mean of the algorithm’s acceptance probability after fixing the multiplicity vector z \mathbf{z} z and averaging over the subsequent random functions in D c ( z ) \mathcal{D}_{c(\mathbf{z})} D c ( z ) . So h h h is indeed symmetric. We remind that, according to Equation (5) of Remark 2.2, if each coordinate of z \mathbf{z} z is sampled i.i.d. according to the same distribution π \pi π on S S S , then
Pr f ∼ Π N [ A f = 1 ] = E z ∼ π ⊗ m [ h ( z ) ] . \Pr_{f\sim\Pi_N}[A^f=1]=\mathbb{E}_{\mathbf{z}\sim\pi^{\otimes m}}[h(\mathbf{z})]. f ∼ Π N Pr [ A f = 1 ] = E z ∼ π ⊗ m [ h ( z )] .
Standard hybrid argument We now describe the usual hybrid argument to analyze the success probability of any given algorithm against two different input distributions. For two probability distributions π 0 , π 1 \pi_0,\pi_1 π 0 , π 1 on S S S , define the standard hybrids as
H i = E z ∼ π 1 ⊗ i ⊗ π 0 ⊗ ( m − i ) [ h ( z ) ] ( 0 ≤ i ≤ m ) . H_i=\mathbb{E}_{\mathbf{z}\sim\pi_1^{\otimes i}\otimes\pi_0^{\otimes(m-i)}}[h(\mathbf{z})]\qquad(0\leq i\leq m). H i = E z ∼ π 1 ⊗ i ⊗ π 0 ⊗ ( m − i ) [ h ( z )] ( 0 ≤ i ≤ m ) .
We are interested in the quantity H m − H 0 H_m-H_0 H m − H 0 , i.e., the difference of the expected acceptance probabilities when the whole input is sampled according to π 0 \pi_0 π 0 or π 1 \pi_1 π 1 . The usual hybrid changes one coordinate at each step and telescopes H m − H 0 = ∑ i = 0 m − 1 ( H i + 1 − H i ) H_m-H_0=\sum_{i=0}^{m-1}(H_{i+1}-H_i) H m − H 0 = ∑ i = 0 m − 1 ( H i + 1 − H i ) . By symmetry, each increment is
H i + 1 − H i = E w ∼ π 1 ⊗ i ⊗ π 0 ⊗ ( m − 1 − i ) [ ∑ s ∈ S ( π 1 ( s ) − π 0 ( s ) ) q w ( s ) ] . H_{i+1}-H_i=\mathbb{E}_{\mathbf{w}\sim\pi_1^{\otimes i}\otimes\pi_0^{\otimes(m-1-i)}}\left[\sum_{s\in S}(\pi_1(s)-\pi_0(s))q_{\mathbf{w}}(s)\right]. H i + 1 − H i = E w ∼ π 1 ⊗ i ⊗ π 0 ⊗ ( m − 1 − i ) [ s ∈ S ∑ ( π 1 ( s ) − π 0 ( s )) q w ( s ) ] .
Continuous hybrid argument We now give a continuous version of this argument in Lemma 3.7 . Let ( π u ) 0 ≤ u ≤ 1 (\pi_u)_{0\leq u\leq1} ( π u ) 0 ≤ u ≤ 1 be a continuous, piecewise C 1 C^1 C 1 path of probability distributions on S S S joining π 0 \pi_0 π 0 to π 1 \pi_1 π 1 , and let
F ( u ) = E z ∼ π u ⊗ m [ h ( z ) ] , π ˙ u ( s ) = d d u π u ( s ) , ∥ π ˙ u ∥ 1 = ∑ s ∈ S ∣ π ˙ u ( s ) ∣ . F(u)=\mathbb{E}_{\mathbf{z}\sim\pi_u^{\otimes m}}[h(\mathbf{z})],\qquad\dot{\pi}_u(s)=\frac{d}{du}\pi_u(s),\qquad\|\dot{\pi}_u\|_1=\sum_{s\in S}|\dot{\pi}_u(s)|. F ( u ) = E z ∼ π u ⊗ m [ h ( z )] , π ˙ u ( s ) = d u d π u ( s ) , ∥ π ˙ u ∥ 1 = s ∈ S ∑ ∣ π ˙ u ( s ) ∣.
Here F ( 0 ) = H 0 F(0)=H_0 F ( 0 ) = H 0 and F ( 1 ) = H m F(1)=H_m F ( 1 ) = H m . To see the connection with the usual hybrid argument, consider the special case of the linear path π u = ( 1 − u ) π 0 + u π 1 \pi_u=(1-u)\pi_0+u\pi_1 π u = ( 1 − u ) π 0 + u π 1 . Then symmetry gives
F ( u ) = ∑ i = 0 m ( m i ) u i ( 1 − u ) m − i H i . F(u)=\sum_{i=0}^{m}\binom{m}{i}u^i(1-u)^{m-i}H_i. F ( u ) = i = 0 ∑ m ( i m ) u i ( 1 − u ) m − i H i .
Differentiating with respect to u u u yields
F ′ ( u ) = ∑ i = 1 m i ( m i ) u i − 1 ( 1 − u ) m − i H i − ∑ i = 0 m − 1 ( m − i ) ( m i ) u i ( 1 − u ) m − 1 − i H i = m ∑ i = 0 m − 1 ( m − 1 i ) u i ( 1 − u ) m − 1 − i ( H i + 1 − H i ) . \begin{aligned}
F'(u)&=\sum_{i=1}^{m}i\binom{m}{i}u^{i-1}(1-u)^{m-i}H_i-\sum_{i=0}^{m-1}(m-i)\binom{m}{i}u^i(1-u)^{m-1-i}H_i\\
&=m\sum_{i=0}^{m-1}\binom{m-1}{i}u^i(1-u)^{m-1-i}(H_{i+1}-H_i).
\end{aligned} F ′ ( u ) = i = 1 ∑ m i ( i m ) u i − 1 ( 1 − u ) m − i H i − i = 0 ∑ m − 1 ( m − i ) ( i m ) u i ( 1 − u ) m − 1 − i H i = m i = 0 ∑ m − 1 ( i m − 1 ) u i ( 1 − u ) m − 1 − i ( H i + 1 − H i ) .
The weights are nonnegative and each integrates to 1, so
∣ F ( 1 ) − F ( 0 ) ∣ = ∣ H m − H 0 ∣ ≤ ∫ 0 1 ∣ F ′ ( u ) ∣ d u ≤ ∑ i = 0 m − 1 ∣ H i + 1 − H i ∣ . \lvert F(1)-F(0)\rvert=\lvert H_m-H_0\rvert\le\int_0^1\lvert F'(u)\rvert\,du\le\sum_{i=0}^{m-1}\lvert H_{i+1}-H_i\rvert. ∣ F ( 1 ) − F ( 0 )∣ = ∣ H m − H 0 ∣ ≤ ∫ 0 1 ∣ F ′ ( u )∣ d u ≤ i = 0 ∑ m − 1 ∣ H i + 1 − H i ∣ .
Thus the derivative identity in Lemma 3.7 recovers the standard hybrid bound.
Final remark The continuous formulation in Lemma 3.7 is useful in § 4 because the remaining draws are independent and have the same distribution: the count Y s = ∣ { j : w j = s } ∣ Y_s=\lvert\{j:w_j=s\}\rvert Y s = ∣{ j : w j = s }∣ has distribution Bin ( m − 1 , π u ( s ) ) \operatorname{Bin}(m-1,\pi_u(s)) Bin ( m − 1 , π u ( s )) . This permits the direct use of Lemma 3.6 in Lemma 4.1 . A fixed discrete hybrid generally has two different coordinate distributions and would require corresponding count estimates. For the polynomial proof in § 3 , the standard discrete hybrid would give the same bound.
Moment matching
Moment matching allows us to replace q w q_w q w by its approximation error q w − P w q_w-P_w q w − P w in the derivative formula of Lemma 3.7 . We state this below in a lemma that will provide us a common comparison bound for Theorems 2.5 and 2.6 . It also bounds the contribution of exceptional choices of w w w for which we do not control the approximation error.
Lemma 3.8. Let h : S m → [ 0 , 1 ] h:S^m\to[0,1] h : S m → [ 0 , 1 ] be invariant under permutations of its coordinates. Define q w ( s ) = h ( w , s ) q_w(s)=h(w,s) q w ( s ) = h ( w , s ) , for w ∈ S m − 1 w\in S^{m-1} w ∈ S m − 1 . Let ( π u ) 0 ≤ u ≤ 1 (\pi_u)_{0\le u\le1} ( π u ) 0 ≤ u ≤ 1 be a continuous, piecewise C 1 C^1 C 1 path of probability distributions on S S S whose moments through order r − 1 r-1 r − 1 are constant in u u u , for an integer r ≥ 1 r\ge1 r ≥ 1 . Let us denote F ( u ) = E π u ⊗ m [ h ] F(u)=\mathbb{E}_{\pi_u^{\otimes m}}[h] F ( u ) = E π u ⊗ m [ h ] . For each w ∈ S m − 1 w\in S^{m-1} w ∈ S m − 1 , let P w P_w P w be a polynomial of degree below r r r . For every G ⊆ S m − 1 G\subseteq S^{m-1} G ⊆ S m − 1 ,
∣ F ( 1 ) − F ( 0 ) ∣ ≤ m ∫ 0 1 E w ∼ π u ⊗ ( m − 1 ) [ 1 G ∣ ∑ s ∈ S π ˙ u ( s ) ( q w ( s ) − P w ( s ) ) ∣ ] d u + m ∫ 0 1 ∥ π ˙ u ∥ 1 Pr w ∼ π u ⊗ ( m − 1 ) [ w ∉ G ] d u . (15) \begin{aligned}
\lvert F(1)-F(0)\rvert\le{}&m\int_0^1\mathbb{E}_{w\sim\pi_u^{\otimes(m-1)}}\left[\mathbf{1}_{G}\left\lvert\sum_{s\in S}\dot{\pi}_u(s)(q_w(s)-P_w(s))\right\rvert\right]\,du\\
&+m\int_0^1\lVert\dot{\pi}_u\rVert_1\Pr_{w\sim\pi_u^{\otimes(m-1)}}[w\notin G]\,du. \tag*{(15)}
\end{aligned} ∣ F ( 1 ) − F ( 0 )∣ ≤ m ∫ 0 1 E w ∼ π u ⊗ ( m − 1 ) [ 1 G s ∈ S ∑ π ˙ u ( s ) ( q w ( s ) − P w ( s )) ] d u + m ∫ 0 1 ∥ π ˙ u ∥ 1 w ∼ π u ⊗ ( m − 1 ) Pr [ w ∈ / G ] d u . (15)
Proof. Fix w \mathbf{w} w . Then for two values u , v ∈ [ 0 , 1 ] u,v \in[0,1] u , v ∈ [ 0 , 1 ] , the two distributions π u , π v \pi_u,\pi_v π u , π v have matching moments through order r − 1 r-1 r − 1 . Since deg P w < r \deg P_{\mathbf{w}} < r deg P w < r , Lemma 3.4 gives ∑ s ∈ S ( π u ( s ) − π v ( s ) ) P w ( s ) = 0 \sum_{s\in S}(\pi_u(s)-\pi_v(s))P_{\mathbf{w}}(s)=0 ∑ s ∈ S ( π u ( s ) − π v ( s )) P w ( s ) = 0 . Thus ∑ s ∈ S π u ( s ) P w ( s ) \sum_{s\in S}\pi_u(s)P_{\mathbf{w}}(s) ∑ s ∈ S π u ( s ) P w ( s ) is constant in u u u .
Therefore, at every point where it is differentiable,
0 = d d u ( ∑ s ∈ S π u ( s ) P w ( s ) ) = ∑ s ∈ S π ˙ u ( s ) P w ( s ) . 0=\frac{d}{du}\left(\sum_{s\in S}\pi_u(s)P_{\mathbf{w}}(s)\right)=\sum_{s\in S}\dot{\pi}_u(s)P_{\mathbf{w}}(s). 0 = d u d ( s ∈ S ∑ π u ( s ) P w ( s ) ) = s ∈ S ∑ π ˙ u ( s ) P w ( s ) .
Consequently,
∑ s ∈ S π ˙ u ( s ) q w ( s ) = ∑ s ∈ S π ˙ u ( s ) ( q w ( s ) − P w ( s ) ) . (16) \sum_{s\in S}\dot{\pi}_u(s)q_{\mathbf{w}}(s)=\sum_{s\in S}\dot{\pi}_u(s)\left(q_{\mathbf{w}}(s)-P_{\mathbf{w}}(s)\right). \tag*{(16)} s ∈ S ∑ π ˙ u ( s ) q w ( s ) = s ∈ S ∑ π ˙ u ( s ) ( q w ( s ) − P w ( s ) ) . (16)
Equation (14) of Lemma 3.7 , split over G \mathcal{G} G and its complement, gives
∣ F ( 1 ) − F ( 0 ) ∣ ≤ m ∫ 0 1 E w ∼ π u ⊗ ( m − 1 ) [ 1 G ∣ ∑ s ∈ S π ˙ u ( s ) q w ( s ) ∣ ] d u + m ∫ 0 1 E w ∼ π u ⊗ ( m − 1 ) [ 1 G c ∣ ∑ s ∈ S π ˙ u ( s ) q w ( s ) ∣ ] d u . \lvert F(1)-F(0)\rvert\leq m\int_0^1 \mathbb{E}_{\mathbf{w}\sim\pi_u^{\otimes(m-1)}}\left[\mathbf{1}_{\mathcal{G}}\left\lvert\sum_{s\in S}\dot{\pi}_u(s)q_{\mathbf{w}}(s)\right\rvert\right]\,du
+m\int_0^1 \mathbb{E}_{\mathbf{w}\sim\pi_u^{\otimes(m-1)}}\left[\mathbf{1}_{\mathcal{G}^{c}}\left\lvert\sum_{s\in S}\dot{\pi}_u(s)q_{\mathbf{w}}(s)\right\rvert\right]\,du. ∣ F ( 1 ) − F ( 0 )∣ ≤ m ∫ 0 1 E w ∼ π u ⊗ ( m − 1 ) [ 1 G s ∈ S ∑ π ˙ u ( s ) q w ( s ) ] d u + m ∫ 0 1 E w ∼ π u ⊗ ( m − 1 ) [ 1 G c s ∈ S ∑ π ˙ u ( s ) q w ( s ) ] d u .
We apply (16) in the first term. For the second term, 0 ≤ q w ≤ 1 0\leq q_{\mathbf{w}}\leq1 0 ≤ q w ≤ 1 gives
∣ ∑ s ∈ S π ˙ u ( s ) q w ( s ) ∣ ≤ ∑ s ∈ S ∣ π ˙ u ( s ) ∣ q w ( s ) ≤ ∥ π ˙ u ∥ 1 . \left\lvert\sum_{s\in S}\dot{\pi}_u(s)q_{\mathbf{w}}(s)\right\rvert\leq\sum_{s\in S}\lvert\dot{\pi}_u(s)\rvert q_{\mathbf{w}}(s)\leq\lVert\dot{\pi}_u\rVert_1. s ∈ S ∑ π ˙ u ( s ) q w ( s ) ≤ s ∈ S ∑ ∣ π ˙ u ( s )∣ q w ( s ) ≤ ∥ π ˙ u ∥ 1 .
These bounds prove (15) , completing the proof.
Proof of Theorem 2.5
We are now almost ready to prove our first main theorem. This full subsection is devoted to this. Let us fix the parameters of Theorem 2.5 and let A \mathcal{A} A be a quantum algorithm making at most T T T queries to f : [ N ] → [ N ] f:[N]\to[N] f : [ N ] → [ N ] . The case T = 0 T=0 T = 0 is immediate.
Assume N ≥ max { 8 , 4 A } N\geq\max\{8,4A\} N ≥ max { 8 , 4 A } and T ≥ 1 T\geq1 T ≥ 1 with T 2 ≤ N / 64 T^2\leq N/64 T 2 ≤ N /64 . Put S = { 0 } ∪ [ A ] S=\{0\}\cup[A] S = { 0 } ∪ [ A ] , m = ⌊ N / 2 ⌋ m=\lfloor N/2\rfloor m = ⌊ N /2 ⌋ , and H = ⌊ N / 4 ⌋ H=\lfloor N/4\rfloor H = ⌊ N /4 ⌋ , and let π b \pi_b π b be the distribution of Z b Z_b Z b for b ∈ { 0 , 1 } b\in\{0,1\} b ∈ { 0 , 1 } . For z ∈ S m \mathbf{z}\in S^m z ∈ S m , let c ( z ) c(\mathbf{z}) c ( z ) be the frequency vector obtained in step 2 of Definition 2.1 , and define
h ( z ) = Pr f ∼ D c ( z ) [ A f = 1 ] . h(\mathbf{z})=\Pr_{f\sim D_{c(\mathbf{z})}}[\mathcal{A}^f=1]. h ( z ) = f ∼ D c ( z ) Pr [ A f = 1 ] .
Note that with this symmetrization, h h h is not yet necessarily a polynomial in z \mathbf{z} z .
For w ∈ S m − 1 \mathbf{w}\in S^{m-1} w ∈ S m − 1 , let w = ∑ i w i w=\sum_i w_i w = ∑ i w i and q w ( s ) = h ( w , s ) q_{\mathbf{w}}(s)=h(\mathbf{w},s) q w ( s ) = h ( w , s ) . We first establish the following polynomial approximation.
Lemma 3.9 (Taylor approximation). For every w ∈ S m − 1 \mathbf{w}\in S^{m-1} w ∈ S m − 1 with w ≤ 3 N / 4 w\leq3N/4 w ≤ 3 N /4 , the function q w q_{\mathbf{w}} q w admits a 2 T 2T 2 T -degree polynomial extension, also denoted q w q_{\mathbf{w}} q w , such that
q w ( s ) = ∑ j = 0 2 T a w , j s j ( s ∈ S ) , q_{\mathbf{w}}(s)=\sum_{j=0}^{2T}a_{\mathbf{w},j}s^j \qquad(s\in S), q w ( s ) = j = 0 ∑ 2 T a w , j s j ( s ∈ S ) ,
with real coefficients and satisfying ∣ q w ( z ) ∣ ≤ 1 |q_{\mathbf{w}}(z)| \le1 ∣ q w ( z ) ∣ ≤ 1 , for every z ∈ { 0 } ∪ [ H ] z \in\{0\} \cup[H] z ∈ { 0 } ∪ [ H ] . Then every mean-one random variable Z Z Z supported on S S S satisfies
E Z [ ∣ q w ( Z ) − Q w ( Z ) ∣ ] ≤ 2 A r − 1 ( 2 r ) ! ( 128 T 2 N ) r (17) \mathbb{E}_{Z}[|q_{\mathbf{w}}(Z)-Q_{\mathbf{w}}(Z)|] \le\frac{2A^{r-1}}{(2r)!}\left(\frac{128T^2}{N}\right)^r \tag*{(17)} E Z [ ∣ q w ( Z ) − Q w ( Z ) ∣ ] ≤ ( 2 r )! 2 A r − 1 ( N 128 T 2 ) r (17)
where
Q w ( z ) = ∑ j = 0 min { r − 1 , 2 T } a w , j z j . Q_{\mathbf{w}}(z)=\sum_{j=0}^{\min\{r-1,2T\}}a_{\mathbf{w},j}z^j. Q w ( z ) = j = 0 ∑ m i n { r − 1 , 2 T } a w , j z j .
Proof. Let us fix w \mathbf{w} w with w ≤ 3 N / 4 w \le3N/4 w ≤ 3 N /4 and set d = 2 T d=2T d = 2 T . The parameter conditions give us H ≥ N / 8 H \ge N/8 H ≥ N /8 , A ≤ H A \le H A ≤ H , and d 2 ≤ H / 2 d^2 \le H/2 d 2 ≤ H /2 .
As in step 2 of Definition 2.1 , for each integer 0 ≤ z ≤ H 0 \le z \le H 0 ≤ z ≤ H , we form c ( z ) \mathbf{c}(z) c ( z ) by taking the non-zero entries of ( w , z ) (\mathbf{w},z) ( w , z ) , adding N − w − z N-w-z N − w − z entries equal to one, and padding with zeros, if required, to make it of length N N N . This vector is feasible since w + z ≤ N w+z \le N w + z ≤ N . We extend q w q_{\mathbf{w}} q w to these integers by
q w ( z ) = Pr f ∼ D c ( z ) [ A f = 1 ] ∈ [ 0 , 1 ] . q_{\mathbf{w}}(z)=\Pr_{f\sim D_{\mathbf{c}(z)}}[\mathcal{A}^f=1]\in[0,1]. q w ( z ) = f ∼ D c ( z ) Pr [ A f = 1 ] ∈ [ 0 , 1 ] .
For z ∈ S z \in S z ∈ S , we have w + z ≤ N w+z \le N w + z ≤ N , so this is exactly the completion used to define h ( w , z ) h(w,z) h ( w , z ) . By Lemma 3.1 , we know that there is a symmetric polynomial P P P of degree at most d d d such that
P ( c ) = Pr f ∼ D c [ A f = 1 ] P(\mathbf{c})=\Pr_{f\sim D_{\mathbf{c}}}[\mathcal{A}^f=1] P ( c ) = f ∼ D c Pr [ A f = 1 ]
for every feasible c \mathbf{c} c .
Let us write P ( x ) = G ( p 1 ( x ) , … , p d ( x ) ) P(\mathbf{x})=G(p_1(\mathbf{x}),\ldots,p_d(\mathbf{x})) P ( x ) = G ( p 1 ( x ) , … , p d ( x )) , where G G G has weighted degree at most d d d . For 1 ≤ j ≤ d 1\le j\le d 1 ≤ j ≤ d , we have p j ( c ( z ) ) = p j ( w ) + N − w − z + z j p_j(\mathbf{c}(z))=p_j(\mathbf{w})+N-w-z+z^j p j ( c ( z )) = p j ( w ) + N − w − z + z j , where the terms come from the fixed multiplicities, the completion singletons, and the added multiplicity z z z . Consequently q w ( z ) q_{\mathbf{w}}(z) q w ( z ) is indeed a degree-2 T 2T 2 T polynomial in z \mathbf{z} z :
q w ( z ) = G ( ( p j ( w ) + ( N − w − z ) + z j ) j = 1 d ) = ∑ j = 0 2 T a w , j z j q_{\mathbf{w}}(z)=G\left(\left(p_j(\mathbf{w})+(N-w-z)+z^j\right)_{j=1}^{d}\right)=\sum_{j=0}^{2T}a_{\mathbf{w},j}z^j q w ( z ) = G ( ( p j ( w ) + ( N − w − z ) + z j ) j = 1 d ) = j = 0 ∑ 2 T a w , j z j
extends the integer values and has degree at most d d d .
Since Q w Q_{\mathbf{w}} Q w is its truncation below degree r r r , Lemma 3.2 gives
E [ ∣ q w ( Z ) − Q w ( Z ) ∣ ] ≤ 2 ( 2 r ) ! ( 4 d 2 H ) r E [ Z r ] ≤ 2 A r − 1 ( 2 r ) ! ( 128 T 2 N ) r , \mathbb{E}[|q_{\mathbf{w}}(Z)-Q_{\mathbf{w}}(Z)|]\le\frac{2}{(2r)!}\left(\frac{4d^2}{H}\right)^r\mathbb{E}[Z^r]\le\frac{2A^{r-1}}{(2r)!}\left(\frac{128T^2}{N}\right)^r, E [ ∣ q w ( Z ) − Q w ( Z ) ∣ ] ≤ ( 2 r )! 2 ( H 4 d 2 ) r E [ Z r ] ≤ ( 2 r )! 2 A r − 1 ( N 128 T 2 ) r ,
using the fact that E [ Z r ] ≤ A r − 1 E [ Z ] = A r − 1 \mathbb{E}[Z^r]\le A^{r-1}\mathbb{E}[Z]=A^{r-1} E [ Z r ] ≤ A r − 1 E [ Z ] = A r − 1 , H ≥ N / 8 H\ge N/8 H ≥ N /8 , and d = 2 T d=2T d = 2 T .
Finally, we are ready to prove our first main theorem.
End of proof of Theorem 2.5 . By Proposition 2.4 and the moment matching condition (7) , the distributions π 0 , π 1 \pi_0,\pi_1 π 0 , π 1 of Z 0 , Z 1 Z_0,Z_1 Z 0 , Z 1 have mean one and matching moments through order r − 1 r-1 r − 1 . Let us apply on S S S the linear path of probability distributions π u = ( 1 − u ) π 0 + u π 1 \pi_u=(1-u)\pi_0+u\pi_1 π u = ( 1 − u ) π 0 + u π 1 for 0 ≤ u ≤ 1 0\le u\le1 0 ≤ u ≤ 1 . Its moments through order r − 1 r-1 r − 1 are constant, since
E s ∼ π u [ s j ] = ( 1 − u ) E [ Z 0 j ] + u E [ Z 1 j ] = E [ Z 0 j ] ( 1 ≤ j ≤ r − 1 ) . \mathbb{E}_{s\sim\pi_u}[s^j]=(1-u)\mathbb{E}[Z_0^j]+u\mathbb{E}[Z_1^j]=\mathbb{E}[Z_0^j]\qquad(1\le j\le r-1). E s ∼ π u [ s j ] = ( 1 − u ) E [ Z 0 j ] + u E [ Z 1 j ] = E [ Z 0 j ] ( 1 ≤ j ≤ r − 1 ) .
Let F ( u ) = E w ∼ π ~ u ⊗ m [ h ( z ) ] F(u)=\mathbb{E}_{\mathbf{w}\sim\tilde{\pi}_u^{\otimes m}}[h(\mathbf{z})] F ( u ) = E w ∼ π ~ u ⊗ m [ h ( z )] , so F ( b ) = Pr f ∼ Π b , N [ A f = 1 ] F(b)=\Pr_{f\sim\Pi_{b,N}}[\mathcal{A}^f=1] F ( b ) = Pr f ∼ Π b , N [ A f = 1 ] for b = 0 , 1 b=0,1 b = 0 , 1 . Apply Lemma 3.8 with
G = { w ∈ S m − 1 : w ≤ 3 N / 4 } , P w = { Q w , w ∈ G , 0 , w ∉ G . \mathcal{G}=\{\mathbf{w}\in S^{m-1}:\mathbf{w}\leq3N/4\},\qquad
P_{\mathbf{w}}=
\begin{cases}
Q_{\mathbf{w}}, & \mathbf{w}\in\mathcal{G},\\
0, & \mathbf{w}\notin\mathcal{G}.
\end{cases} G = { w ∈ S m − 1 : w ≤ 3 N /4 } , P w = { Q w , 0 , w ∈ G , w ∈ / G .
where Q w Q_{\mathbf{w}} Q w is defined as in Lemma 3.9 for the given w \mathbf{w} w and order r r r . This gives
∣ F ( 1 ) − F ( 0 ) ∣ ≤ m ∫ 0 1 E w ∼ π ~ u ⊗ ( m − 1 ) [ ∣ 1 G ∑ s ∈ S π ~ u ( s ) ( q w ( s ) − P w ( s ) ) ∣ ] d u |F(1)-F(0)|\leq m\int_0^1\mathbb{E}_{\mathbf{w}\sim\tilde{\pi}_u^{\otimes(m-1)}}\left[\left|\mathbf{1}_{\mathcal{G}}\sum_{s\in S}\tilde{\pi}_u(s)(q_{\mathbf{w}}(s)-P_{\mathbf{w}}(s))\right|\right]\,du ∣ F ( 1 ) − F ( 0 ) ∣ ≤ m ∫ 0 1 E w ∼ π ~ u ⊗ ( m − 1 ) [ 1 G s ∈ S ∑ π ~ u ( s ) ( q w ( s ) − P w ( s )) ] d u
+ m ∫ 0 1 ∥ π ~ u ∥ 1 Pr w ∼ π ~ u ⊗ ( m − 1 ) [ w ∉ G ] d u . {}+m\int_0^1\|\tilde{\pi}_u\|_1\Pr_{\mathbf{w}\sim\tilde{\pi}_u^{\otimes(m-1)}}[\mathbf{w}\notin\mathcal{G}]\,du. + m ∫ 0 1 ∥ π ~ u ∥ 1 w ∼ π ~ u ⊗ ( m − 1 ) Pr [ w ∈ / G ] d u .
On G \mathcal{G} G , Lemma 3.9 bounds the residual inside the expectation above by
∣ ∑ s ∈ S π ~ u ( s ) ( q w ( s ) − P w ( s ) ) ∣ ≤ ∑ s ∈ S ( π 0 ( s ) + π 1 ( s ) ) ∣ q w ( s ) − Q w ( s ) ∣ = ∑ b = 0 1 ∑ s ∈ S Pr [ Z b = s ] ∣ q w ( s ) − Q w ( s ) ∣ = ∑ b = 0 1 E [ ∣ q w ( Z b ) − Q w ( Z b ) ∣ ] ≤ 4 A r − 1 ( 2 r ) ! ( 128 T 2 N ) r . \begin{aligned}
\left|\sum_{s\in S}\tilde{\pi}_u(s)(q_{\mathbf{w}}(s)-P_{\mathbf{w}}(s))\right|
\leq\sum_{s\in S}(\pi_0(s)+\pi_1(s))|q_{\mathbf{w}}(s)-Q_{\mathbf{w}}(s)| \\
&=\sum_{b=0}^{1}\sum_{s\in S}\Pr[Z_b=s]|q_{\mathbf{w}}(s)-Q_{\mathbf{w}}(s)| \\
&=\sum_{b=0}^{1}\mathbb{E}[|q_{\mathbf{w}}(Z_b)-Q_{\mathbf{w}}(Z_b)|] \\
&\leq\frac{4A^{r-1}}{(2r)!}\left(\frac{128T^2}{N}\right)^r.
\end{aligned} s ∈ S ∑ π ~ u ( s ) ( q w ( s ) − P w ( s )) ≤ s ∈ S ∑ ( π 0 ( s ) + π 1 ( s )) ∣ q w ( s ) − Q w ( s ) ∣ = b = 0 ∑ 1 s ∈ S ∑ Pr [ Z b = s ] ∣ q w ( s ) − Q w ( s ) ∣ = b = 0 ∑ 1 E [ ∣ q w ( Z b ) − Q w ( Z b ) ∣ ] ≤ ( 2 r )! 4 A r − 1 ( N 128 T 2 ) r .
where the first inequality uses the fact that π ~ u = π 1 − π 0 \tilde{\pi}_u=\pi_1-\pi_0 π ~ u = π 1 − π 0 .
Under π ~ u ⊗ ( m − 1 ) \tilde{\pi}_u^{\otimes(m-1)} π ~ u ⊗ ( m − 1 ) , the remaining draws are independent, bounded by A A A , and have mean one. Thus E [ w ] = m − 1 ≤ N / 2 \mathbb{E}[\mathbf{w}]=m-1\leq N/2 E [ w ] = m − 1 ≤ N /2 , and Hoeffding’s inequality [27 ] gives, for every u u u ,
Pr w ∼ π ~ u ⊗ ( m − 1 ) [ w ∉ G ] ≤ exp ( − N 4 A 2 ) . (18) \Pr_{\mathbf{w}\sim\tilde{\pi}_u^{\otimes(m-1)}}[\mathbf{w}\notin\mathcal{G}]
\leq\exp\left(-\frac{N}{4A^2}\right). \tag*{(18)} w ∼ π ~ u ⊗ ( m − 1 ) Pr [ w ∈ / G ] ≤ exp ( − 4 A 2 N ) . (18)
Also, ∥ π ~ u ∥ 1 ≤ ∥ π 1 ∥ 1 + ∥ π 0 ∥ 1 = 2 \|\tilde{\pi}_u\|_1\leq\|\pi_1\|_1+\|\pi_0\|_1=2 ∥ π ~ u ∥ 1 ≤ ∥ π 1 ∥ 1 + ∥ π 0 ∥ 1 = 2 . Substituting these bounds into the comparison above and using m ≤ N / 2 m\leq N/2 m ≤ N /2 gives
∣ Pr f ∼ Π 0 , N [ A f = 1 ] − Pr f ∼ Π 1 , N [ A f = 1 ] ∣ = ∣ F ( 0 ) − F ( 1 ) ∣ ≤ m ∫ 0 1 ( 4 A r − 1 ( 2 r ) ! ( 128 T 2 N ) r + 2 exp ( − N 4 A 2 ) ) d u ≤ 2 × 128 r A r − 1 T 2 r ( 2 r ) ! N r − 1 + N exp ( − N 4 A 2 ) . (19) \begin{aligned}
\left|\Pr_{f\sim\Pi_{0,N}}[\mathcal{A}^f=1]-\Pr_{f\sim\Pi_{1,N}}[\mathcal{A}^f=1]\right|=|F(0)-F(1)| \\
&\leq m\int_0^1\left(\frac{4A^{r-1}}{(2r)!}\left(\frac{128T^2}{N}\right)^r+2\exp\left(-\frac{N}{4A^2}\right)\right)\,du \\
&\leq\frac{2\times128^r A^{r-1}T^{2r}}{(2r)!N^{r-1}}+N\exp\left(-\frac{N}{4A^2}\right). \tag*{(19)}
\end{aligned} f ∼ Π 0 , N Pr [ A f = 1 ] − f ∼ Π 1 , N Pr [ A f = 1 ] = ∣ F ( 0 ) − F ( 1 ) ∣ ≤ m ∫ 0 1 ( ( 2 r )! 4 A r − 1 ( N 128 T 2 ) r + 2 exp ( − 4 A 2 N ) ) d u ≤ ( 2 r )! N r − 1 2 × 12 8 r A r − 1 T 2 r + N exp ( − 4 A 2 N ) . (19)
Using ( 2 r ) ! ≥ ( 2 r / e ) 2 r (2r)!\geq(2r/e)^{2r} ( 2 r )! ≥ ( 2 r / e ) 2 r and 2 ≤ 2 r 2\leq2^r 2 ≤ 2 r , the first term is at most
N A ( 64 e 2 A T 2 r 2 N ) r . \frac{N}{A}\left(\frac{64e^2AT^2}{r^2N}\right)^r. A N ( r 2 N 64 e 2 A T 2 ) r .
This proves (8) with C = 64 e 2 C=64e^2 C = 64 e 2 and c = 1 / 8 c=1/8 c = 1/8 . This completes the proof.
Stronger bound for fixed support
We prove Theorem 2.6 by the same comparison lemma as the polynomial estimate (Lemma 3.8 ). However, instead of using the Taylor bound, we now apply a truncated Newton expansion. We first give the main proof using the coefficient bound of Lemma 4.1 and the interpolation paths of Lemma 4.2 , which are proved in Subsections 4.2 and 4.3, respectively.
Proof of Theorem 2.6
Let us fix a T T T -query quantum algorithm A \mathcal{A} A on functions f : [ N ] → [ N ] f:[N]\to[N] f : [ N ] → [ N ] , with acceptance probability p ( f ) = Pr [ A f = 1 ] p(f)=\Pr[\mathcal{A}^{f}=1] p ( f ) = Pr [ A f = 1 ] . Similarly to the previous section, let S = { 0 } ∪ [ A ] S=\{0\}\cup[A] S = { 0 } ∪ [ A ] , m = ⌊ N / 2 ⌋ m=\lfloor N/2\rfloor m = ⌊ N /2 ⌋ , and let π b \pi_b π b be the distribution of Z b Z_b Z b for b ∈ { 0 , 1 } b\in\{0,1\} b ∈ { 0 , 1 } . For z ∈ S m z\in S^m z ∈ S m , let c ( z ) \mathbf{c}(z) c ( z ) be the frequency vector constructed in Definition 2.1 , and define h ( z ) = E f ∼ D c ( z ) [ p ( f ) ] h(z)=\mathbb{E}_{f\sim D_{\mathbf{c}(z)}}[p(f)] h ( z ) = E f ∼ D c ( z ) [ p ( f )] . For w ∈ S m − 1 \mathbf{w}\in S^{m-1} w ∈ S m − 1 , let w = ∑ i w i w=\sum_i w_i w = ∑ i w i and q w ( s ) = h ( w , s ) q_{\mathbf{w}}(s)=h(\mathbf{w},s) q w ( s ) = h ( w , s ) for s ∈ S s\in S s ∈ S .
Let us write the Newton coefficients of q w q_{\mathbf{w}} q w :
d ℓ ( w ) = ∑ s = 0 ℓ ( − 1 ) ℓ − s ( ℓ s ) q w ( s ) ( 0 ≤ ℓ ≤ A ) . (20) d_\ell(\mathbf{w})=\sum_{s=0}^{\ell}(-1)^{\ell-s}\binom{\ell}{s}q_{\mathbf{w}}(s)\qquad(0\leq\ell\leq A). \tag*{(20)} d ℓ ( w ) = s = 0 ∑ ℓ ( − 1 ) ℓ − s ( s ℓ ) q w ( s ) ( 0 ≤ ℓ ≤ A ) . (20)
Let α j = 1 − 2 1 − j \alpha_j=1-2^{1-j} α j = 1 − 2 1 − j for j ≥ 1 j\geq1 j ≥ 1 and G = { w ∈ S m − 1 : ∑ i w i ≤ 3 N / 4 } \mathcal{G}=\{\mathbf{w}\in S^{m-1}:\sum_i w_i\leq3N/4\} G = { w ∈ S m − 1 : ∑ i w i ≤ 3 N /4 } . The following two lemmas provide the averaged residual bound and a path along which it is integrable. They are proved in Subsections 4.2 and 4.3, respectively.
Lemma 4.1. Assume N ≥ 8 A N\geq8A N ≥ 8 A , T ≥ 1 T\geq1 T ≥ 1 , and T 2 ≤ N / 8 T^2\leq N/8 T 2 ≤ N /8 . Let 2 ≤ ℓ ≤ A 2\leq\ell\leq A 2 ≤ ℓ ≤ A satisfy T ≤ N α ℓ / ( 1 + α ℓ ) T\leq N^{\alpha_\ell/(1+\alpha_\ell)} T ≤ N α ℓ / ( 1 + α ℓ ) . Let π \pi π be a mean-one distribution on S S S with π ( s ) ≥ a > 0 \pi(s)\geq a>0 π ( s ) ≥ a > 0 for every s ∈ S s\in S s ∈ S . There is an absolute constant C C C such that
E w ∼ π ⊗ ( m − 1 ) [ 1 G ( w ) × ∣ d ℓ ( w ) ∣ ] ≤ C ℓ T 1 + α ℓ N ( m a ) − α ℓ , Pr [ G c ] ≤ e − N / ( 4 A 2 ) . \mathbb{E}_{\mathbf{w}\sim\pi^{\otimes(m-1)}}\left[\mathbf{1}_{\mathcal{G}}(\mathbf{w})\times\lvert d_\ell(\mathbf{w})\rvert\right]\leq\frac{C^\ell T^{1+\alpha_\ell}}{N}(ma)^{-\alpha_\ell},\qquad\Pr[\mathcal{G}^{c}]\leq e^{-N/(4A^2)}. E w ∼ π ⊗ ( m − 1 ) [ 1 G ( w ) × ∣ d ℓ ( w )∣ ] ≤ N C ℓ T 1 + α ℓ ( ma ) − α ℓ , Pr [ G c ] ≤ e − N / ( 4 A 2 ) .
Lemma 4.2. Let 2 ≤ r ≤ A 2\leq r\leq A 2 ≤ r ≤ A and let π 0 , π 1 \pi_0,\pi_1 π 0 , π 1 be two distinct distributions on { 0 } ∪ [ A ] \{0\}\cup[A] { 0 } ∪ [ A ] with matching moments through order r − 1 r-1 r − 1 , and denote δ = ∥ π 1 − π 0 ∥ 1 \delta=\lVert\pi_1-\pi_0\rVert_1 δ = ∥ π 1 − π 0 ∥ 1 . There is a distribution ω \omega ω with these same moments such that
ω ( s ) ≥ 32 − A δ ( s ∈ { 0 } ∪ [ A ] ) , ∥ ω − π b ∥ 1 ≤ δ ( b = 0 , 1 ) . \omega(s)\geq32^{-A}\delta\quad(s\in\{0\}\cup[A]),\qquad\lVert\omega-\pi_b\rVert_1\leq\delta\quad(b=0,1). ω ( s ) ≥ 3 2 − A δ ( s ∈ { 0 } ∪ [ A ]) , ∥ ω − π b ∥ 1 ≤ δ ( b = 0 , 1 ) .
Using these lemmas, we now prove Theorem 2.6 .
Proof of Theorem 2.6. By Proposition 2.4 , the distributions π b \pi_b π b of Z b Z_b Z b have mean one and matching moments through order r − 1 r-1 r − 1 . We know that δ = ∥ π 1 − π 0 ∥ 1 ≤ 2 \delta=\lVert\pi_1-\pi_0\rVert_1\leq2 δ = ∥ π 1 − π 0 ∥ 1 ≤ 2 . The conclusion is immediate if π 0 = π 1 \pi_0=\pi_1 π 0 = π 1 or T = 0 T=0 T = 0 ; hence let us assume δ > 0 \delta>0 δ > 0 , and T ≥ 1 T\geq1 T ≥ 1 . If r > A r>A r > A , then it must be that π 0 = π 1 \pi_0=\pi_1 π 0 = π 1 since a distribution on a domain of size A + 1 A+1 A + 1 is uniquely determined by its first A A A moments. Hence we assume 2 ≤ r ≤ A 2\leq r\leq A 2 ≤ r ≤ A as well. We choose the constants in the theorem so that N ≥ 8 A N\geq8A N ≥ 8 A and T 2 ≤ N / 8 T^2\leq N/8 T 2 ≤ N /8 . The claim trivially follows when T 1 + α r > N α r T^{1+\alpha_r}>N^{\alpha_r} T 1 + α r > N α r . Otherwise,
T ≤ N α r / ( 1 + α r ) ≤ N α ℓ / ( 1 + α ℓ ) ( ℓ ≥ r ) , T\leq N^{\alpha_r/(1+\alpha_r)}\leq N^{\alpha_\ell/(1+\alpha_\ell)}\qquad(\ell\geq r), T ≤ N α r / ( 1 + α r ) ≤ N α ℓ / ( 1 + α ℓ ) ( ℓ ≥ r ) ,
so Lemma 4.1 applies to every remaining coefficient. Let ω \omega ω be given by Lemma 4.2 4.2 4.2 , so it has the same first r − 1 r-1 r − 1 moments as π 0 \pi_0 π 0 and π 1 \pi_1 π 1 , and define κ = 32 − A \kappa=32^{-A} κ = 3 2 − A . For each b ∈ { 0 , 1 } b\in\{0,1\} b ∈ { 0 , 1 } , we use the linear path of probability distributions on S \mathcal{S} S given by
π b , u = ( 1 − u ) π b + u ω , F b ( u ) = E z ∼ π b , u ⊗ m [ h ( z ) ] ( 0 ≤ u ≤ 1 ) . \pi_{b,u}=(1-u)\pi_b+u\omega,\qquad F_b(u)=\mathbb{E}_{\mathbf{z}\sim\pi_{b,u}^{\otimes m}}[h(\mathbf{z})]\qquad(0\leq u\leq1). π b , u = ( 1 − u ) π b + u ω , F b ( u ) = E z ∼ π b , u ⊗ m [ h ( z )] ( 0 ≤ u ≤ 1 ) .
Using the fact that the first ( r − 1 ) (r-1) ( r − 1 ) moments of π b \pi_b π b and ω \omega ω match, we get that they also match the moments of π b , u \pi_{b,u} π b , u , which are therefore independent of u u u . Also
π b , u ( s ) ≥ u ω ( s ) ≥ u κ δ ( s ∈ S ) , ∥ π ˙ b , u ∥ 1 = ∥ − π b + ω ∥ 1 ≤ δ . \pi_{b,u}(s)\geq u\omega(s)\geq u\kappa\delta\quad(s\in\mathcal{S}),\qquad\|\dot{\pi}_{b,u}\|_1=\|-\pi_b+\omega\|_1\leq\delta. π b , u ( s ) ≥ u ω ( s ) ≥ u κ δ ( s ∈ S ) , ∥ π ˙ b , u ∥ 1 = ∥ − π b + ω ∥ 1 ≤ δ .
Here F b ( 0 ) = Pr f ∼ Π b , N [ A f = 1 ] F_b(0)=\Pr_{f\sim\Pi_{b,N}}[\mathcal{A}^f=1] F b ( 0 ) = Pr f ∼ Π b , N [ A f = 1 ] , and both paths end at F b ( 1 ) = E z ∼ ω ⊗ m [ h ( z ) ] F_b(1)=\mathbb{E}_{\mathbf{z}\sim\omega^{\otimes m}}[h(\mathbf{z})] F b ( 1 ) = E z ∼ ω ⊗ m [ h ( z )] . We can bound the difference ∣ F b ( 1 ) − F b ( 0 ) ∣ |F_b(1)-F_b(0)| ∣ F b ( 1 ) − F b ( 0 ) ∣ for each b ∈ { 0 , 1 } b\in\{0,1\} b ∈ { 0 , 1 } using Lemma 3.8 3.8 3.8 . We apply the lemma with G = { w ∈ S m : ∑ i w i ≤ 3 N / 4 } \mathcal{G}=\{\mathbf{w}\in\mathcal{S}^m:\sum_i w_i\leq3N/4\} G = { w ∈ S m : ∑ i w i ≤ 3 N /4 } and P w ( s ) = ∑ ℓ = 0 r − 1 d ℓ ( w ) ( s ℓ ) P_{\mathbf{w}}(s)=\sum_{\ell=0}^{r-1}d_\ell(\mathbf{w})\binom{s}{\ell} P w ( s ) = ∑ ℓ = 0 r − 1 d ℓ ( w ) ( ℓ s ) of degree r − 1 r-1 r − 1 (where Newton coefficients d ℓ ( w ) d_\ell(\mathbf{w}) d ℓ ( w ) are defined in ( 20 ) (20) ( 20 ) ) to upper bound ∣ F b ( 1 ) − F b ( 0 ) ∣ |F_b(1)-F_b(0)| ∣ F b ( 1 ) − F b ( 0 ) ∣ by
m ∫ 0 1 E w ∼ π b , u ⊗ ( m − 1 ) [ ∣ 1 G ∑ s ∈ S π ˙ b , u ( s ) ( q w ( s ) − P w ( s ) ) ∣ ] d u + m ∫ 0 1 ∥ π ˙ b , u ∥ 1 Pr w ∼ π b , u ⊗ ( m − 1 ) [ w ∉ G ] d u . (21) m\int_0^1\mathbb{E}_{\mathbf{w}\sim\pi_{b,u}^{\otimes(m-1)}}\left[\left|\mathbf{1}_{\mathcal{G}}\sum_{s\in\mathcal{S}}\dot{\pi}_{b,u}(s)(q_{\mathbf{w}}(s)-P_{\mathbf{w}}(s))\right|\right]\,du+m\int_0^1\|\dot{\pi}_{b,u}\|_1\Pr_{\mathbf{w}\sim\pi_{b,u}^{\otimes(m-1)}}[\mathbf{w}\notin\mathcal{G}]\,du. \tag*{(21)} m ∫ 0 1 E w ∼ π b , u ⊗ ( m − 1 ) [ 1 G s ∈ S ∑ π ˙ b , u ( s ) ( q w ( s ) − P w ( s )) ] d u + m ∫ 0 1 ∥ π ˙ b , u ∥ 1 w ∼ π b , u ⊗ ( m − 1 ) Pr [ w ∈ / G ] d u . (21)
We now restrict our attention to bounding the two terms in the above equation.
We apply the Newton expansion in Lemma 3.3 3.3 3.3 to obtain
∣ ∑ s ∈ S π ˙ b , u ( s ) ( q w ( s ) − P w ( s ) ) ∣ ≤ δ ∑ ℓ = r A ( A ℓ ) ∣ d ℓ ( w ) ∣ . \left|\sum_{s\in\mathcal{S}}\dot{\pi}_{b,u}(s)(q_{\mathbf{w}}(s)-P_{\mathbf{w}}(s))\right|\leq\delta\sum_{\ell=r}^{A}\binom{A}{\ell}|d_\ell(\mathbf{w})|. s ∈ S ∑ π ˙ b , u ( s ) ( q w ( s ) − P w ( s )) ≤ δ ℓ = r ∑ A ( ℓ A ) ∣ d ℓ ( w ) ∣.
For u > 0 u>0 u > 0 , we apply Lemma 4.1 4.1 4.1 with distribution π b , u \pi_{b,u} π b , u and a = u κ δ a=u\kappa\delta a = u κ δ to get E [ 1 G ∣ d ℓ ( w ) ∣ ] ≤ C ℓ T 1 + α ℓ N ( m u κ δ ) − α ℓ \mathbb{E}[\mathbf{1}_{\mathcal{G}}|d_\ell(\mathbf{w})|]\leq\frac{C^\ell T^{1+\alpha_\ell}}{N}(mu\kappa\delta)^{-\alpha_\ell} E [ 1 G ∣ d ℓ ( w ) ∣ ] ≤ N C ℓ T 1 + α ℓ ( m u κ δ ) − α ℓ and thus
E w ∼ π b , u ⊗ ( m − 1 ) [ ∣ 1 G ∑ s ∈ S π ˙ b , u ( s ) ( q w ( s ) − P w ( s ) ) ∣ ] ≤ δ ∑ ℓ = r A ( A ℓ ) C ℓ T 1 + α ℓ N ( m u κ δ ) − α ℓ . \mathbb{E}_{\mathbf{w}\sim\pi_{b,u}^{\otimes(m-1)}}\left[\left|\mathbf{1}_{\mathcal{G}}\sum_{s\in\mathcal{S}}\dot{\pi}_{b,u}(s)(q_{\mathbf{w}}(s)-P_{\mathbf{w}}(s))\right|\right]\leq\delta\sum_{\ell=r}^{A}\binom{A}{\ell}\frac{C^\ell T^{1+\alpha_\ell}}{N}(mu\kappa\delta)^{-\alpha_\ell}. E w ∼ π b , u ⊗ ( m − 1 ) [ 1 G s ∈ S ∑ π ˙ b , u ( s ) ( q w ( s ) − P w ( s )) ] ≤ δ ℓ = r ∑ A ( ℓ A ) N C ℓ T 1 + α ℓ ( m u κ δ ) − α ℓ .
We absorb ( A ℓ ) κ − α ℓ \binom{A}{\ell}\kappa^{-\alpha_\ell} ( ℓ A ) κ − α ℓ into C A C^A C A by increasing the absolute constant. The expression inside the integral of the first term in ( 21 ) (21) ( 21 ) is then at most
C A N ∑ ℓ = r A T 1 + α ℓ δ 1 − α ℓ m α ℓ u − α ℓ . \frac{C^A}{N}\sum_{\ell=r}^{A}\frac{T^{1+\alpha_\ell}\delta^{1-\alpha_\ell}}{m^{\alpha_\ell}}u^{-\alpha_\ell}. N C A ℓ = r ∑ A m α ℓ T 1 + α ℓ δ 1 − α ℓ u − α ℓ .
The exceptional-event probability (i.e. the probability of w ∉ G \mathbf{w}\notin\mathcal{G} w ∈ / G in the second term) is at most e − N / ( 4 A 2 ) e^{-N/(4A^2)} e − N / ( 4 A 2 ) . As α ℓ < 1 \alpha_\ell<1 α ℓ < 1 , integration in ( 21 ) (21) ( 21 ) and the triangle inequality at the common endpoint give
∣ Pr f ∼ Π 1 , N [ A f = 1 ] − Pr f ∼ Π 0 , N [ A f = 1 ] ∣ ≤ ∑ b = 0 1 ∣ F b ( 1 ) − F b ( 0 ) ∣ ≤ C A m N ∑ ℓ = r A T 1 + α ℓ δ 1 − α ℓ m α ℓ ( 1 − α ℓ ) + 2 m δ e − N / ( 4 A 2 ) . \left|\Pr_{f\sim\Pi_{1,N}}[\mathcal{A}^f=1]-\Pr_{f\sim\Pi_{0,N}}[\mathcal{A}^f=1]\right|\leq\sum_{b=0}^{1}|F_b(1)-F_b(0)|\leq\frac{C^A m}{N}\sum_{\ell=r}^{A}\frac{T^{1+\alpha_\ell}\delta^{1-\alpha_\ell}}{m^{\alpha_\ell}(1-\alpha_\ell)}+2m\delta e^{-N/(4A^2)}. f ∼ Π 1 , N Pr [ A f = 1 ] − f ∼ Π 0 , N Pr [ A f = 1 ] ≤ b = 0 ∑ 1 ∣ F b ( 1 ) − F b ( 0 ) ∣ ≤ N C A m ℓ = r ∑ A m α ℓ ( 1 − α ℓ ) T 1 + α ℓ δ 1 − α ℓ + 2 m δ e − N / ( 4 A 2 ) .
Consider δ ≤ 2 \delta\leq2 δ ≤ 2 , N / 3 ≤ m ≤ N / 2 N/3\leq m\leq N/2 N /3 ≤ m ≤ N /2 , and ( 1 − α ℓ ) − 1 = 2 ℓ − 1 (1-\alpha_\ell)^{-1}=2^{\ell-1} ( 1 − α ℓ ) − 1 = 2 ℓ − 1 . Since T ≤ N T\leq N T ≤ N and α ℓ ≥ α r \alpha_\ell\geq\alpha_r α ℓ ≥ α r for ℓ ≥ r \ell\geq r ℓ ≥ r , T 1 + α ℓ N α ℓ ≤ T 1 + α r N α r \frac{T^{1+\alpha_\ell}}{N^{\alpha_\ell}}\leq\frac{T^{1+\alpha_r}}{N^{\alpha_r}} N α ℓ T 1 + α ℓ ≤ N α r T 1 + α r . Absorbing the finite sum and its exponential factors into C A C^A C A yields
∣ Pr f ∼ Π 1 , N [ A f = 1 ] − Pr f ∼ Π 0 , N [ A f = 1 ] ∣ ≤ C A T 1 + α r N α r + 2 N e − N / ( 4 A 2 ) . \left|\Pr_{f\sim\Pi_{1,N}}[\mathcal{A}^f=1]-\Pr_{f\sim\Pi_{0,N}}[\mathcal{A}^f=1]\right|\leq C^A\frac{T^{1+\alpha_r}}{N^{\alpha_r}}+2Ne^{-N/(4A^2)}. f ∼ Π 1 , N Pr [ A f = 1 ] − f ∼ Π 0 , N Pr [ A f = 1 ] ≤ C A N α r T 1 + α r + 2 N e − N / ( 4 A 2 ) .
The left-hand side is at most one, so we may replace 2 N e − N / ( 4 A 2 ) 2Ne^{-N/(4A^2)} 2 N e − N / ( 4 A 2 ) by N e − N / ( 8 A 2 ) Ne^{-N/(8A^2)} N e − N / ( 8 A 2 ) ; the latter is either at least one or dominates the former, since N ≥ 2 N\geq2 N ≥ 2 . This completes the proof. □ \square □
Proof of Lemma 4.1
Recall that we have fixed a T T T -query quantum algorithm A \mathcal{A} A on functions f : [ N ] → [ N ] f : [N] \to[N] f : [ N ] → [ N ] , with acceptance probability p ( f ) = Pr [ A f = 1 ] p(f) = \Pr[\mathcal{A}^{f} = 1] p ( f ) = Pr [ A f = 1 ] .
We prove the upper bound on the expectation of the Newton coefficients in Lemma 4.1 by first bounding each Newton coefficient d ℓ ( w ) d_{\ell}(\mathbf{w}) d ℓ ( w ) and then averaging over w \mathbf{w} w . We call the case w ∈ { 0 , 1 } m − 1 \mathbf{w} \in\{0,1\}^{m-1} w ∈ { 0 , 1 } m − 1 the singleton case . We treat the singleton case separately in Lemma 4.8 . For the other cases, we first introduce some new notation.
Newton coefficients as block differences
Assume N ≥ 8 A N \ge8A N ≥ 8 A , 2 ≤ ℓ ≤ A 2 \le\ell\le A 2 ≤ ℓ ≤ A , and fix w ∈ S m − 1 \mathbf{w} \in S^{m-1} w ∈ S m − 1 with ∑ i w i ≤ 3 N / 4 \sum_i w_i \le3N/4 ∑ i w i ≤ 3 N /4 and some w i ≥ 2 w_i \ge2 w i ≥ 2 . Let c = c ( w , ℓ ) \mathbf{c} = \mathbf{c}(\mathbf{w},\ell) c = c ( w , ℓ ) . For notational convenience, in this subsection we identify input f f f with its value vector ( f ( 1 ) , … , f ( N ) ) ∈ [ N ] N (f(1),\ldots,f(N)) \in[N]^N ( f ( 1 ) , … , f ( N )) ∈ [ N ] N , so coordinates of f f f are oracle query positions. The parts of [ N ] [N] [ N ] with the same output label are called blocks , their sizes correspond to the non-zero frequency entries.
For 0 ≤ s ≤ ℓ 0 \le s \le\ell 0 ≤ s ≤ ℓ , the sampled inputs f f f corresponding to q w ( s ) q_{\mathbf{w}}(s) q w ( s ) have the same block sizes as those of q w ( ℓ ) q_{\mathbf{w}}(\ell) q w ( ℓ ) , except that the ℓ \ell ℓ -block corresponding to the last sampled multiplicity is replaced by an s s s -block and ℓ − s \ell-s ℓ − s singletons (all singletons when s = 0 s=0 s = 0 ).
Let ρ = ∣ { a ∈ [ N ] : c a = ℓ } ∣ \rho= |\{a \in[N] : c_a = \ell\}| ρ = ∣ { a ∈ [ N ] : c a = ℓ } ∣ be the number of blocks of size ℓ \ell ℓ , and d = ∣ { a ∈ [ N ] : c a > 0 } ∣ d = |\{a \in[N] : c_a > 0\}| d = ∣ { a ∈ [ N ] : c a > 0 } ∣ the total number of blocks. The completion is feasible since ∑ i w i + ℓ ≤ 7 N / 8 \sum_i w_i+\ell\le7N/8 ∑ i w i + ℓ ≤ 7 N /8 , and ρ ≥ 1 \rho\ge1 ρ ≥ 1 and d + ℓ ≤ N d+\ell\le N d + ℓ ≤ N .
For 1 ≤ j ≤ ℓ 1 \le j \le\ell 1 ≤ j ≤ ℓ , starting from the fixed frequency vector c \mathbf{c} c , we construct a joint distribution ν j \nu_j ν j by sampling an input f f f , a marked j j j -block B B B , and fresh replacement labels a \mathbf{a} a . To sample from ν j \nu_j ν j , we first draw a uniform partition of [ N ] [N] [ N ] with block sizes given by c \mathbf{c} c , and mark a uniform ℓ \ell ℓ -block. Now let us choose a uniform j j j -subset B B B of the marked block, split its ℓ − j \ell-j ℓ − j other positions into singletons, and give all blocks distinct uniform labels in [ N ] [N] [ N ] , finally obtaining f : [ N ] → [ N ] f : [N] \to[N] f : [ N ] → [ N ] . There are d + ℓ − j ≤ N − j d+\ell-j \le N-j d + ℓ − j ≤ N − j blocks, so at least j j j labels are unused. Choose a uniform j j j -tuple a = ( a i ) i ∈ B \mathbf{a} = (a_i)_{i\in B} a = ( a i ) i ∈ B of distinct fresh labels. We write E ν j \mathbb{E}_{\nu_j} E ν j for expectation with respect to this distribution.
For U ⊆ B U \subseteq B U ⊆ B , let us define f U , a f^{U,\mathbf{a}} f U , a such that
f U , a ( i ) = { a i , i ∈ U , f ( i ) , i ∉ U . f^{U,\mathbf{a}}(i) =
\begin{cases}
a_i, & i \in U,\\
f(i), & i \notin U.
\end{cases} f U , a ( i ) = { a i , f ( i ) , i ∈ U , i ∈ / U .
The same tuple a \mathbf{a} a is used for every U ⊆ B U \subseteq B U ⊆ B , so the inputs f U , a f^{U,\mathbf{a}} f U , a are generated jointly. In particular, for j ≥ 2 j \ge2 j ≥ 2 , if ( f , B , a ) ∼ ν j (f,B,\mathbf{a}) \sim\nu_j ( f , B , a ) ∼ ν j and i i i is chosen uniformly in B B B , then ( f { i } , a , B ∖ { i } , ( a k ) k ∈ B ∖ { i } ) ∼ ν j − 1 (f^{\{i\},\mathbf{a}}, B \setminus\{i\}, (a_k)_{k\in B\setminus\{i\}}) \sim\nu_{j-1} ( f { i } , a , B ∖ { i } , ( a k ) k ∈ B ∖ { i } ) ∼ ν j − 1 , as shown in the proof of Proposition 4.4 . Together with the original triple ( f , B , a ) (f,B,\mathbf{a}) ( f , B , a ) , this gives a coupling between ν j \nu_j ν j and ν j − 1 \nu_{j-1} ν j − 1 .
The marginal distribution of f f f under ν j \nu_j ν j is D c ( w , j ) \mathcal{D}_{\mathbf{c}(\mathbf{w},j)} D c ( w , j ) . In particular, it is D c \mathcal{D}_{\mathbf{c}} D c when j = ℓ j=\ell j = ℓ . Thus
E ν j [ p ( f ) ] = q w ( j ) . \mathbb{E}_{\nu_j}[p(f)] = q_{\mathbf{w}}(j). E ν j [ p ( f )] = q w ( j ) .
For any scalar- or vector-valued function g g g of the input f : [ N ] → [ N ] f : [N] \to[N] f : [ N ] → [ N ] , let us now define the block difference operator by
D B a g ( f ) = ∑ U ⊆ B ( − 1 ) ∣ U ∣ g ( f U , a ) . D_{B}^{\mathbf{a}}g(f) = \sum_{U \subseteq B} (-1)^{|U|} g(f^{U,\mathbf{a}}). D B a g ( f ) = U ⊆ B ∑ ( − 1 ) ∣ U ∣ g ( f U , a ) .
We henceforth suppress a \mathbf{a} a from the notation for better readability.
The next lemma identifies d ℓ ( w ) d_{\ell}(\mathbf{w}) d ℓ ( w ) (the Newton coefficients of q w q_{\mathbf{w}} q w ) with the average block difference of the acceptance probability E ν ℓ [ ( D B p ) ( f ) ] \mathbb{E}_{\nu_{\ell} }[(D_{B}p)(f)] E ν ℓ [( D B p ) ( f )] . The
Proposition 4.3. For every ℓ \ell ℓ and w \mathbf{w} w satisfying the assumptions stated above, we have:
E ν ℓ [ ( D B p ) ( f ) ] = d ℓ ( w ) . (22) \mathbb{E}_{\nu_\ell}[(D_{B p})(f)] = d_\ell(\mathbf{w}). \tag*{(22)} E ν ℓ [( D B p ) ( f )] = d ℓ ( w ) . (22) Proof. In the definition of D B D_B D B , taking f U f^U f U for U ⊆ B U \subseteq B U ⊆ B leaves an ( ℓ − ∣ U ∣ ) (\ell-|U|) ( ℓ − ∣ U ∣ ) -block and ∣ U ∣ |U| ∣ U ∣ singletons in place of B B B ; when U = B U=B U = B , all ℓ \ell ℓ positions become singletons. Let us take the expectation over ν ℓ \nu_\ell ν ℓ and group the subsets U ⊆ B U \subseteq B U ⊆ B by their size. There are ( ℓ ∣ U ∣ ) \binom{\ell}{|U|} ( ∣ U ∣ ℓ ) subsets of size ∣ U ∣ |U| ∣ U ∣ , and averaging over all subsets of this size makes the split partition uniform with these block sizes by Proposition 4.4 . So the resulting mean acceptance is q w ( ℓ − ∣ U ∣ ) q_{\mathbf{w}}(\ell-|U|) q w ( ℓ − ∣ U ∣ ) . Consequently, summing over the different block sizes and denoting s = ℓ − ∣ U ∣ s=\ell-|U| s = ℓ − ∣ U ∣ we obtain the following expression:
E ν ℓ [ ( D B p ) ( f ) ] = ∑ s = 0 ℓ ( − 1 ) ℓ − s ( ℓ s ) q w ( s ) = d ℓ ( w ) . \mathbb{E}_{\nu_\ell}[(D_{B p})(f)] = \sum_{s=0}^{\ell}(-1)^{\ell-s}\binom{\ell}{s}q_{\mathbf{w}}(s)=d_\ell(\mathbf{w}). E ν ℓ [( D B p ) ( f )] = s = 0 ∑ ℓ ( − 1 ) ℓ − s ( s ℓ ) q w ( s ) = d ℓ ( w ) . Thus, for proving Lemma 4.1 , it suffices to bound the average block difference of the acceptance probability.
Bounding the block differences
Consider a feasible frequency vector c \mathbf{c} c with ρ ≥ 1 \rho\ge1 ρ ≥ 1 and d + ℓ ≤ N d+\ell\le N d + ℓ ≤ N . For the bounds below, we use notations b j = ∣ { a ∈ [ N ] : c a = j } ∣ b_j=|\{a\in[N]:c_a=j\}| b j = ∣ { a ∈ [ N ] : c a = j } ∣ is the number of blocks of size j j j for 1 ≤ j < ℓ 1\le j<\ell 1 ≤ j < ℓ . Let n j = 1 + b j n_j=1+b_j n j = 1 + b j for 1 ≤ j < ℓ 1\le j<\ell 1 ≤ j < ℓ , and n ∗ = min 1 ≤ j < ℓ n j n_*=\min_{1\le j<\ell}n_j n ∗ = min 1 ≤ j < ℓ n j .
The following identity of the block difference operator is going to be useful in our proofs. For J ⊆ B J\subseteq B J ⊆ B , D J D_J D J uses the labels a i a_i a i with i ∈ J i\in J i ∈ J , also when evaluated at f { i } f^{\{i\}} f { i } for i ∈ B ∖ J i\in B\setminus J i ∈ B ∖ J .
Proposition 4.4. Let 1 ≤ j ≤ ℓ 1\le j\le\ell 1 ≤ j ≤ ℓ and ( f , B , a ) ∼ ν j (f,B,\mathbf{a})\sim\nu_j ( f , B , a ) ∼ ν j . For a fixed U ⊆ B U\subseteq B U ⊆ B , the input f U f^U f U has distinct uniform labels on the partition obtained by splitting the positions in U U U into singletons. Moreover, for any scalar- or vector-valued function g g g and every i ∈ B i\in B i ∈ B , the following identity holds for every sampled triple ( f , B , a ) (f,B,\mathbf{a}) ( f , B , a ) , using the same replacement labels a \mathbf{a} a throughout:
D B g ( f ) = D B ∖ { i } g ( f ) − D B ∖ { i } g ( f { i } ) . (23) D_Bg(f)=D_{B\setminus\{i\}}g(f)-D_{B\setminus\{i\}}g(f^{\{i\}}). \tag*{(23)} D B g ( f ) = D B ∖ { i } g ( f ) − D B ∖ { i } g ( f { i } ) . (23) Proof. Conditional on the partition and B B B , the block labels and the replacement labels are jointly uniform and distinct. For a fixed U ⊆ B U\subseteq B U ⊆ B , the input f U f^U f U uses a subcollection of these labels, so its block labels are also uniform and distinct.
For the identity, let us fix a sampled triple ( f , B , a ) (f,B,\mathbf{a}) ( f , B , a ) and i ∈ B i\in B i ∈ B . Now we separate the subsets according to whether they contain i i i :
D B g ( f ) = ∑ U ⊆ B ∖ { i } ( − 1 ) ∣ U ∣ ( g ( f U ) − g ( f U ∪ { i } ) ) D_Bg(f)=\sum_{U\subseteq B\setminus\{i\}}(-1)^{|U|}\left(g(f^U)-g(f^{U\cup\{i\}})\right) D B g ( f ) = U ⊆ B ∖ { i } ∑ ( − 1 ) ∣ U ∣ ( g ( f U ) − g ( f U ∪ { i } ) ) = D B ∖ { i } g ( f ) − D B ∖ { i } g ( f { i } ) . =D_{B\setminus\{i\}}g(f)-D_{B\setminus\{i\}}g(f^{\{i\}}). = D B ∖ { i } g ( f ) − D B ∖ { i } g ( f { i } ) . The last equality uses ( f { i } ) U = f U ∪ { i } (f^{\{i\}})^U=f^{U\cup\{i\}} ( f { i } ) U = f U ∪ { i } , since all replacements use the same tuple a \mathbf{a} a .
In the proof of the next lemma, the main fact used is that, conditional on f f f , the marked block B B B is uniform among its blocks of size j j j . The first statement provides a way to go from a level j j j quantity to a level j − 1 j-1 j − 1 quantity. Its proof is based on a double-counting bijection between level j j j and level j − 1 j-1 j − 1 . The second statement gives an explicit bound. When applying this lemma, ∣ G ( f ) ⟩ |G(f)\rangle ∣ G ( f )⟩ is going to represent the function mapping input f f f to the corresponding state of the algorithm with query access to f f f .
Lemma 4.5. Let ∣ G ( f ) ⟩ = ∑ i ∣ i ⟩ ⊗ ∣ G i ( f ) ⟩ |G(f)\rangle= \sum_i |i\rangle\otimes|G_i(f)\rangle ∣ G ( f )⟩ = ∑ i ∣ i ⟩ ⊗ ∣ G i ( f )⟩ be a vector-valued function of the input. Then
E ν j [ ∑ i ∈ B ∥ D B ∖ { i } ∣ G i ( f { i } ) ⟩ ∥ 2 2 ] ≤ j n 1 E ν j − 1 [ ∥ D B ∣ G ( f ) ⟩ ∥ 2 2 ] ( 2 ≤ j ≤ ℓ ) . (24) \mathbb{E}_{\nu_j}\left[\sum_{i\in B}\left\|D_{B\setminus\{i\}}|G_i(f^{\{i\}})\rangle\right\|_2^2\right]\leq\frac{j}{n_1}\mathbb{E}_{\nu_{j-1}}\left[\left\|D_B|G(f)\rangle\right\|_2^2\right]
\qquad(2\leq j\leq\ell). \tag*{(24)} E ν j [ i ∈ B ∑ D B ∖ { i } ∣ G i ( f { i } )⟩ 2 2 ] ≤ n 1 j E ν j − 1 [ ∥ D B ∣ G ( f )⟩ ∥ 2 2 ] ( 2 ≤ j ≤ ℓ ) . (24) Moreover, if ∥ ∣ G ( f ) ⟩ ∥ 2 = 1 \left\||G(f)\rangle\right\|_2=1 ∥ ∣ G ( f )⟩ ∥ 2 = 1 for every f f f , then
E ν j [ ∑ i ∈ B ∥ D B ∖ { i } ∣ G i ( f ) ⟩ ∥ 2 2 ] ≤ 4 j n ∗ ( 2 ≤ j < ℓ ) . (25) \mathbb{E}_{\nu_j}\left[\sum_{i\in B}\left\|D_{B\setminus\{i\}}|G_i(f)\rangle\right\|_2^2\right]\leq\frac{4^j}{n_*}
\qquad(2\leq j<\ell). \tag*{(25)} E ν j [ i ∈ B ∑ D B ∖ { i } ∣ G i ( f )⟩ 2 2 ] ≤ n ∗ 4 j ( 2 ≤ j < ℓ ) . (25)
Proof. We provide the proofs of the two statements separately.
Proof of the first statement. Choose i i i uniformly in B B B and replace f ( i ) f(i) f ( i ) by a i a_i a i . The modified input f { i } f^{\{i\}} f { i } , the marked block B ∖ { i } B\setminus\{i\} B ∖ { i } , and the remaining fresh labels in a \mathbf{a} a correspond to the level ( j − 1 ) (j-1) ( j − 1 ) distribution. Indeed, the old block label remains in use, and the remaining fresh tuple is uniform among labels unused in the new input. Conditional on this new experiment, i i i is uniform among its s j = b 1 + ℓ − j + 1 ≥ n 1 s_j=b_1+\ell-j+1\geq n_1 s j = b 1 + ℓ − j + 1 ≥ n 1 unmarked singletons: merging any one of them back into the mark by changing its label, and then setting a i a_i a i to its former label, gives a unique preimage of the same probability. Writing S \mathcal{S} S for these singleton positions gives
E ν j [ ∑ i ∈ B ∥ D B ∖ { i } ∣ G i ( f { i } ) ⟩ ∥ 2 2 ] = j s j E ν j − 1 [ ∑ i ∈ S ∥ D B ∣ G i ( f ) ⟩ ∥ 2 2 ] ≤ j n 1 E ν j − 1 [ ∥ D B ∣ G ( f ) ⟩ ∥ 2 2 ] . \mathbb{E}_{\nu_j}\left[\sum_{i\in B}\left\|D_{B\setminus\{i\}}|G_i(f^{\{i\}})\rangle\right\|_2^2\right]
=\frac{j}{s_j}\mathbb{E}_{\nu_{j-1}}\left[\sum_{i\in\mathcal{S}}\left\|D_B|G_i(f)\rangle\right\|_2^2\right]
\leq\frac{j}{n_1}\mathbb{E}_{\nu_{j-1}}\left[\left\|D_B|G(f)\rangle\right\|_2^2\right]. E ν j [ i ∈ B ∑ D B ∖ { i } ∣ G i ( f { i } )⟩ 2 2 ] = s j j E ν j − 1 [ i ∈ S ∑ ∥ D B ∣ G i ( f )⟩ ∥ 2 2 ] ≤ n 1 j E ν j − 1 [ ∥ D B ∣ G ( f )⟩ ∥ 2 2 ] .
Proof of the second statement. Note that D B ∖ { i } ∣ G i ( f ) ⟩ D_{B\setminus\{i\}}|G_i(f)\rangle D B ∖ { i } ∣ G i ( f )⟩ is a signed sum of 2 j − 1 2^{j-1} 2 j − 1 vectors ∣ G i ( f V ) ⟩ |G_i(f^V)\rangle ∣ G i ( f V )⟩ (for each V ⊆ B ∖ { i } V\subseteq B\setminus\{i\} V ⊆ B ∖ { i } ). Thus, applying Cauchy–Schwarz for each i ∈ B i\in B i ∈ B gives
∑ i ∈ B ∥ D B ∖ { i } ∣ G i ( f ) ⟩ ∥ 2 2 ≤ 2 j − 1 ∑ U ⊆ B ∑ i ∈ B ∖ U ∥ G i ( f U ) ∥ 2 2 . \sum_{i\in B}\left\|D_{B\setminus\{i\}}|G_i(f)\rangle\right\|_2^2
\leq2^{j-1}\sum_{U\subseteq B}\sum_{i\in B\setminus U}\left\|G_i(f^U)\right\|_2^2. i ∈ B ∑ D B ∖ { i } ∣ G i ( f )⟩ 2 2 ≤ 2 j − 1 U ⊆ B ∑ i ∈ B ∖ U ∑ G i ( f U ) 2 2 .
Now let us group the terms by s = ∣ B ∖ U ∣ s=|B\setminus U| s = ∣ B ∖ U ∣ . Conditional on the resulting input f U f^U f U , the remaining marked block B ∖ U B\setminus U B ∖ U is uniform among its blocks of size s s s . Indeed, applying on the input a permutation of positions and one of labels simultaneously preserves the experiment; and if the pair of permutations does not change the input, it acts transitively on its blocks of a given size. In either case, the marked block’s expected query mass is at most 1 / n ∗ 1/n_* 1/ n ∗ , since the total query mass is one and there are at least n s ≥ n ∗ n_s\geq n_* n s ≥ n ∗ blocks of size s s s . Thus the last display has expectation at most 2 j − 1 ∑ s ∈ [ j ] ( j s ) / n ∗ = 2 j − 1 ( 2 j − 1 ) / n ∗ ≤ 4 j / n ∗ 2^{j-1}\sum_{s\in[j]}\binom{j}{s}/n_*=2^{j-1}(2^j-1)/n_*\leq4^j/n_* 2 j − 1 ∑ s ∈ [ j ] ( s j ) / n ∗ = 2 j − 1 ( 2 j − 1 ) / n ∗ ≤ 4 j / n ∗ , proving (25) . □
Now we turn to the main lemma of this part, that upper bounds the expected block difference of the acceptance probability. Our argument is an elementary form of the more involved query-gain argument in [9 ] .
Lemma 4.6. Under the preceding assumptions, the acceptance probability p ( f ) p(f) p ( f ) of every T T T -query quantum algorithm on functions f : [ N ] → [ N ] f : [N] \to[N] f : [ N ] → [ N ] satisfies
∣ E ν ℓ [ ( D B p ) ( f ) ] ∣ ≤ C ℓ T 1 + α ℓ ρ n 1 n ∗ α ℓ − 1 / 2 , (26) \left|\mathbb{E}_{\nu_\ell}[(D_Bp)(f)]\right| \leq\frac{C^\ell T^{1+\alpha_\ell}}{\sqrt{\rho}\,n_1 n_*^{\alpha_\ell-1/2}}, \tag*{(26)} ∣ E ν ℓ [( D B p ) ( f )] ∣ ≤ ρ n 1 n ∗ α ℓ − 1/2 C ℓ T 1 + α ℓ , (26) where C C C is an absolute constant.
Proof. By deferring measurements and uncomputing, we are going to make the accepting amplitude linear in the final state, which costs a factor 2 in queries. Let A f A_f A f denote the whole unitary transformation, including the queries to f f f , which is applied to the initial state, ∣ 0 ⟩ |0\rangle ∣0 ⟩ . Let P a c c P_{\mathrm{acc}} P acc denote the accepting projector. Let V f = A f † ( I − 2 P a c c ) A f V_f = A_f^\dagger(I-2P_{\mathrm{acc}})A_f V f = A f † ( I − 2 P acc ) A f . Since P a c c P_{\mathrm{acc}} P acc is a projector, V f V_f V f is unitary. Moreover
g ( f ) : = ⟨ 0 ∣ V f ∣ 0 ⟩ = 1 − 2 p ( f ) . g(f) := \langle0|V_f|0\rangle= 1-2p(f). g ( f ) := ⟨ 0∣ V f ∣0 ⟩ = 1 − 2 p ( f ) . Since V f V_f V f involves both A f A_f A f and A f † A_f^\dagger A f † , it makes 2 T 2T 2 T queries to f f f , T T T of them being reverse queries. Nonetheless, these can be rewritten as forward ones by inserting some unitary. Indeed, consider the query model O f : ∣ i , y ⟩ ↦ ∣ i , y + f ( i ) m o d N ⟩ O_f : |i,y\rangle\mapsto|i,y+f(i)\bmod N\rangle O f : ∣ i , y ⟩ ↦ ∣ i , y + f ( i ) mod N ⟩ . Then using the unitary Neg ∣ y ⟩ = ∣ − y m o d N ⟩ \operatorname{Neg}|y\rangle=|-y\bmod N\rangle Neg ∣ y ⟩ = ∣ − y mod N ⟩ , we get Neg O f Neg ∣ i , y ⟩ = ∣ i , y − f ( i ) m o d N ⟩ = O f † ∣ i , y ⟩ \operatorname{Neg}O_f\operatorname{Neg}|i,y\rangle=|i,y-f(i)\bmod N\rangle=O_f^\dagger|i,y\rangle Neg O f Neg ∣ i , y ⟩ = ∣ i , y − f ( i ) mod N ⟩ = O f † ∣ i , y ⟩ .
So we consider T ′ = 2 T T'=2T T ′ = 2 T forward queries in V f V_f V f . Since D B 1 = 0 D_B1=0 D B 1 = 0 , we get D B p = − 1 2 D B g D_Bp=-\frac{1}{2}D_Bg D B p = − 2 1 D B g , thus it suffices to bound ∣ E ν ℓ [ D B g ( f ) ] ∣ \left|\mathbb{E}_{\nu_\ell}[D_Bg(f)]\right| ∣ E ν ℓ [ D B g ( f )] ∣ for any T ′ T' T ′ -query unitary circuit. Let us write V f = W T ′ O f W T ′ − 1 ⋯ W 1 O f W 0 V_f=W_{T'}O_fW_{T'-1}\cdots W_1O_fW_0 V f = W T ′ O f W T ′ − 1 ⋯ W 1 O f W 0 . Absorb the final unitary W T ′ W_{T'} W T ′ into ⟨ u ∣ = ⟨ 0 ∣ W T ′ \langle u|=\langle0|W_{T'} ⟨ u ∣ = ⟨ 0∣ W T ′ , and use the averaged norm
∥ ∣ G ⟩ ∥ ν j = ( E ν j [ ∥ ∣ G ⟩ ∥ 2 2 ] ) 1 / 2 . \lVert|G\rangle\rVert_{\nu_j}=\left(\mathbb{E}_{\nu_j}\left[\lVert|G\rangle\lVert_2^2\right]\right)^{1/2}. ∥ ∣ G ⟩ ∥ ν j = ( E ν j [ ∥ ∣ G ⟩ ∥ 2 2 ] ) 1/2 . When there is no ambiguity, we suppress the input f f f in the notation for states; expressions involving D B D_B D B also depend on the sampled B B B and a \mathbf{a} a .
Let ∣ ψ t ⟩ |\psi_t\rangle ∣ ψ t ⟩ (or explicitly, as a vector-valued function of the input, ∣ ψ t ( f ) ⟩ |\psi_t(f)\rangle ∣ ψ t ( f )⟩ ) be the state after query t t t and ∣ ψ t ′ ⟩ |\psi'_t\rangle ∣ ψ t ′ ⟩ the state before query t + 1 t+1 t + 1 , so ∣ ψ t + 1 ⟩ = O f ∣ ψ t ′ ⟩ |\psi_{t+1}\rangle=O_f|\psi'_t\rangle ∣ ψ t + 1 ⟩ = O f ∣ ψ t ′ ⟩ . For 1 ≤ j < ℓ 1\leq j<\ell 1 ≤ j < ℓ , define
R j = max 0 ≤ t ≤ T ′ ∥ D B ∣ ψ t ⟩ ∥ ν j . R_j=\max_{0\leq t\leq T'}\lVert D_B|\psi_t\rangle\rVert_{\nu_j}. R j = 0 ≤ t ≤ T ′ max ∥ D B ∣ ψ t ⟩ ∥ ν j . Since input-independent unitaries W t W_t W t commute with D B D_B D B and preserve these norms, we have ∥ D B ∣ ψ t ⟩ ∥ ν j = ∥ D B ∣ ψ t ′ ⟩ ∥ ν j \lVert D_B|\psi_t\rangle\rVert_{\nu_j}=\lVert D_B|\psi'_t\rangle\rVert_{\nu_j} ∥ D B ∣ ψ t ⟩ ∥ ν j = ∥ D B ∣ ψ t ′ ⟩ ∥ ν j . Moreover, D B D_B D B applied to a constant function gives 0, thus D B ∣ ψ 0 ⟩ = 0 D_B|\psi_0\rangle=0 D B ∣ ψ 0 ⟩ = 0 . The following claim, which we prove by induction after completing the proof of the lemma, bounds this R j R_j R j as follows.
Claim 4.7. For every 1 ≤ j < ℓ 1\leq j<\ell 1 ≤ j < ℓ , consider R j R_j R j as defined above. Then
R j ≤ 4 j + 1 ( T ′ ) α j + 1 n 1 n ∗ α j + 1 − 1 / 2 . R_j\leq\frac{4^{j+1}(T')^{\alpha_j+1}}{\sqrt{n_1}\,n_*^{\alpha_j+1-1/2}}. R j ≤ n 1 n ∗ α j + 1 − 1/2 4 j + 1 ( T ′ ) α j + 1 . It remains to bound the expected block difference at size ℓ \ell ℓ . We first control the contribution of each query using differences on blocks of size ℓ − 1 \ell-1 ℓ − 1 . We then sum these contributions over the T ′ T' T ′ queries and average over the uniformly chosen marked ℓ \ell ℓ -block to obtain
∣ E ν ℓ [ ( D B g ) ( f ) ] ∣ ≤ 2 T ′ ρ ℓ n 1 R ℓ − 1 . \left|\mathbb{E}_{\nu_\ell}[(D_Bg)(f)]\right|\leq\frac{2T'}{\sqrt{\rho}}\sqrt{\frac{\ell}{n_1}}\,R_{\ell-1}. ∣ E ν ℓ [( D B g ) ( f )] ∣ ≤ ρ 2 T ′ n 1 ℓ R ℓ − 1 .
{ xref? } Claim 4.7 then gives the desired bound.
Contribution of one query. Let O i ( f ) O_i(f) O i ( f ) be the oracle action on the answer register when the queried position is i i i , so O i ( f ) ∣ y ⟩ = ∣ y + f ( i ) m o d N ⟩ O_i(f)|y\rangle= |y + f(i) \bmod N\rangle O i ( f ) ∣ y ⟩ = ∣ y + f ( i ) mod N ⟩ and O f = ∑ i ∣ i ⟩ ⟨ i ∣ ⊗ O i ( f ) O_f = \sum_i |i\rangle\langle i| \otimes O_i(f) O f = ∑ i ∣ i ⟩ ⟨ i ∣ ⊗ O i ( f ) . Let ∣ ψ t ′ ( f ) ⟩ = ∑ i ∣ i ⟩ ⊗ ∣ ψ t , i ′ ( f ) ⟩ |\psi'_t(f)\rangle= \sum_i |i\rangle\otimes|\psi'_{t,i}(f)\rangle ∣ ψ t ′ ( f )⟩ = ∑ i ∣ i ⟩ ⊗ ∣ ψ t , i ′ ( f )⟩ . By Proposition 4.4 , the difference vector
∣ e B , t ⟩ = D B ∣ ψ t + 1 ⟩ − O f D B ∣ ψ t ′ ⟩ (27) |e_{B,t}\rangle= D_B|\psi_{t+1}\rangle- O_fD_B|\psi'_t\rangle \tag*{(27)} ∣ e B , t ⟩ = D B ∣ ψ t + 1 ⟩ − O f D B ∣ ψ t ′ ⟩ (27)
has components
∣ e B , t , i ⟩ = { ( O i ( f ) − O i ( f { i } ) ) D B ∖ { i } ∣ ψ t , i ′ ( f { i } ) ⟩ , i ∈ B , 0 , i ∉ B . |e_{B,t,i}\rangle=
\begin{cases}
\left(O_i(f)-O_i(f^{\{i\}})\right)D_{B\setminus\{i\}}|\psi'_{t,i}(f^{\{i\}})\rangle, & i\in B,\\
0, & i\notin B.
\end{cases} ∣ e B , t , i ⟩ = { ( O i ( f ) − O i ( f { i } ) ) D B ∖ { i } ∣ ψ t , i ′ ( f { i } )⟩ , 0 , i ∈ B , i ∈ / B .
Each vector ∣ e B , t , i ⟩ |e_{B,t,i}\rangle ∣ e B , t , i ⟩ corresponds to the component of ∣ e B , t ⟩ |e_{B,t}\rangle ∣ e B , t ⟩ with query register in state ∣ i ⟩ |i\rangle ∣ i ⟩ . Thus the vectors ∣ e B , t , i ⟩ |e_{B,t,i}\rangle ∣ e B , t , i ⟩ are orthogonal and the oracle difference has norm at most two. Thus (24) gives
∥ ∣ e B , t ⟩ ∥ ν ℓ 2 ≤ 4 E ν ℓ [ ∥ ∑ i ∈ B D B ∖ { i } ∣ ψ t , i ′ ( f { i } ) ⟩ ∥ 2 2 ] ≤ 4 j n 1 R j − 1 2 ( 2 ≤ j ≤ ℓ ) . (28) \begin{aligned}
\left\| |e_{B,t}\rangle\right\|_{\nu_\ell}^{2}
\leq4\mathbb{E}_{\nu_\ell}\left[\left\|\sum_{i\in B}D_{B\setminus\{i\}}|\psi'_{t,i}(f^{\{i\}})\rangle\right\|_2^2\right] \\
&\leq\frac{4j}{n_1}R_{j-1}^{2}\qquad(2\leq j\leq\ell). \tag*{(28)}
\end{aligned} ∥ ∣ e B , t ⟩ ∥ ν ℓ 2 ≤ 4 E ν ℓ i ∈ B ∑ D B ∖ { i } ∣ ψ t , i ′ ( f { i } )⟩ 2 2 ≤ n 1 4 j R j − 1 2 ( 2 ≤ j ≤ ℓ ) . (28)
Summing over all queries. We now take j = ℓ j=\ell j = ℓ and express ( D B g ) ( f ) (D_Bg)(f) ( D B g ) ( f ) as a sum of the query contributions, using the matrix element defining g g g . The difference will be paired with the fixed vector ∣ u ⟩ |u\rangle ∣ u ⟩ , so the computation can stay linear. This allows the uniform choice of B B B among ρ \rho ρ blocks of size ℓ \ell ℓ to be exploited to gain a factor 1 / ρ 1/\sqrt{\rho} 1/ ρ .
Let Q t ( f ) = O f W T ′ − 1 ⋯ O f W t + 1 Q_t(f)=O_fW_{T'-1}\cdots O_fW_{t+1} Q t ( f ) = O f W T ′ − 1 ⋯ O f W t + 1 be the part of the circuit after query t + 1 t+1 t + 1 , with Q T ′ − 1 = I Q_{T'-1}=I Q T ′ − 1 = I , and let ∣ χ t ( f ) ⟩ = Q t ( f ) † ∣ u ⟩ |\chi_t(f)\rangle=Q_t(f)^\dagger|u\rangle ∣ χ t ( f )⟩ = Q t ( f ) † ∣ u ⟩ be the unit vector obtained by propagating ∣ u ⟩ |u\rangle ∣ u ⟩ backwards through the circuit Q t ( f ) Q_t(f) Q t ( f ) . Telescoping the query errors from (27) gives D B ∣ ψ T ′ ⟩ = ∑ t Q t ( f ) ∣ e B , t ⟩ D_B|\psi_{T'}\rangle=\sum_t Q_t(f)|e_{B,t}\rangle D B ∣ ψ T ′ ⟩ = ∑ t Q t ( f ) ∣ e B , t ⟩ . Therefore, recalling that g ( f ) = ⟨ 0 ∣ V f ∣ 0 ⟩ = ⟨ u ∣ ψ T ′ ⟩ g(f)=\langle0|V_f|0\rangle=\langle u|\psi_{T'}\rangle g ( f ) = ⟨ 0∣ V f ∣0 ⟩ = ⟨ u ∣ ψ T ′ ⟩ ,
E ν ℓ [ ( D B g ) ( f ) ] = ∑ t = 0 T ′ − 1 E ν ℓ [ ⟨ χ t ∣ e B , t ⟩ ] . \mathbb{E}_{\nu_\ell}[(D_Bg)(f)]=\sum_{t=0}^{T'-1}\mathbb{E}_{\nu_\ell}[\langle\chi_t|e_{B,t}\rangle]. E ν ℓ [( D B g ) ( f )] = t = 0 ∑ T ′ − 1 E ν ℓ [⟨ χ t ∣ e B , t ⟩] .
Since ∣ e B , t ⟩ |e_{B,t}\rangle ∣ e B , t ⟩ lives on query addresses in B B B , we have ⟨ χ t ∣ e B , t ⟩ = ⟨ P B χ t ∣ e B , t ⟩ \langle\chi_t|e_{B,t}\rangle=\langle P_B\chi_t|e_{B,t}\rangle ⟨ χ t ∣ e B , t ⟩ = ⟨ P B χ t ∣ e B , t ⟩ , where P B P_B P B projects the query address onto B B B . For a fixed input f f f with its mark forgotten, ∣ χ t ( f ) ⟩ |\chi_t(f)\rangle ∣ χ t ( f )⟩ is fixed and B B B is uniform among the ρ \rho ρ disjoint ℓ \ell ℓ -blocks of f f f . Hence ∥ P B ∣ χ t ⟩ ∥ ν ℓ 2 ≤ 1 / ρ \|P_B|\chi_t\rangle\|_{\nu_\ell}^2\leq1/\rho ∥ P B ∣ χ t ⟩ ∥ ν ℓ 2 ≤ 1/ ρ , and Cauchy-Schwarz combined with (28) and Claim 4.7 finishes the proof of the lemma:
∣ E ν ℓ [ D B g ( f ) ] ∣ ≤ ∑ t = 0 T ′ − 1 ∥ P B ∣ χ t ⟩ ∥ ν ℓ ∥ ∣ e B , t ⟩ ∥ ν ℓ ≤ 2 T ′ ρ ℓ n 1 R ℓ − 1 ≤ C ℓ ( T ′ ) 1 + α ℓ ρ n 1 n ∗ α ℓ − 1 / 2 . \left|\mathbb{E}_{\nu_\ell}[D_Bg(f)]\right|
\leq\sum_{t=0}^{T'-1}\|P_B|\chi_t\rangle\|_{\nu_\ell}\| |e_{B,t}\rangle\|_{\nu_\ell}
\leq\frac{2T'}{\sqrt{\rho}}\sqrt{\frac{\ell}{n_1}}R_{\ell-1}
\leq\frac{C^\ell(T')^{1+\alpha_\ell}}{\sqrt{\rho}n_1n_*^{\alpha_\ell-1/2}}. ∣ E ν ℓ [ D B g ( f )] ∣ ≤ t = 0 ∑ T ′ − 1 ∥ P B ∣ χ t ⟩ ∥ ν ℓ ∥∣ e B , t ⟩ ∥ ν ℓ ≤ ρ 2 T ′ n 1 ℓ R ℓ − 1 ≤ ρ n 1 n ∗ α ℓ − 1/2 C ℓ ( T ′ ) 1 + α ℓ .
Using D B p = − 1 2 D B g D_Bp=-\frac{1}{2}D_Bg D B p = − 2 1 D B g and T ′ = 2 T T'=2T T ′ = 2 T , and enlarging the absolute constant C C C , proves the lemma. □ \square □
Proof of Claim 4.7 . In the setting of the previous proof, for i ∈ B i\in B i ∈ B , let
∣ ξ i ⟩ = D B ∖ { i } ∣ ψ t , i ′ ( f ) ⟩ , ∣ ζ i ⟩ = D B ∖ { i } ∣ ψ t , i ′ ( f { i } ) ⟩ . |\xi_i\rangle=D_{B\setminus\{i\}}|\psi'_{t,i}(f)\rangle,\qquad
|\zeta_i\rangle=D_{B\setminus\{i\}}|\psi'_{t,i}(f^{\{i\}})\rangle. ∣ ξ i ⟩ = D B ∖ { i } ∣ ψ t , i ′ ( f )⟩ , ∣ ζ i ⟩ = D B ∖ { i } ∣ ψ t , i ′ ( f { i } )⟩ .
Proposition 4.4 gives D B ∣ ψ t , i ′ ( f ) ⟩ = ∣ ξ i ⟩ − ∣ ζ i ⟩ D_B|\psi'_{t,i}(f)\rangle=|\xi_i\rangle-|\zeta_i\rangle D B ∣ ψ t , i ′ ( f )⟩ = ∣ ξ i ⟩ − ∣ ζ i ⟩ and D B ∣ ψ t + 1 , i ( f ) ⟩ = D B O i ( f ) ∣ ψ t , i ′ ( f ) ⟩ = O i ( f ) ∣ ξ i ⟩ − O i ( f { i } ) ∣ ζ i ⟩ D_B|\psi_{t+1,i}(f)\rangle=D_BO_i(f)|\psi'_{t,i}(f)\rangle=O_i(f)|\xi_i\rangle-O_i(f^{\{i\}})|\zeta_i\rangle D B ∣ ψ t + 1 , i ( f )⟩ = D B O i ( f ) ∣ ψ t , i ′ ( f )⟩ = O i ( f ) ∣ ξ i ⟩ − O i ( f { i } ) ∣ ζ i ⟩ . In the last step we used that in the first term the i i i th label is always f ( i ) f(i) f ( i ) , and in the second it is always a i a_i a i . Rewrite the last expression as O i ( f ) ( ∣ ξ i ⟩ − ∣ ζ i ⟩ ) + ( O i ( f ) − O i ( f { i } ) ) ∣ ζ i ⟩ O_i(f)(|\xi_i\rangle-|\zeta_i\rangle)+(O_i(f)-O_i(f^{\{i\}}))|\zeta_i\rangle O i ( f ) ( ∣ ξ i ⟩ − ∣ ζ i ⟩) + ( O i ( f ) − O i ( f { i } )) ∣ ζ i ⟩ . For any unitaries U , V U,V U , V and vectors ∣ ξ ⟩ , ∣ ζ ⟩ |\xi\rangle,|\zeta\rangle ∣ ξ ⟩ , ∣ ζ ⟩ ,
∥ U ∣ ξ ⟩ − V ∣ ζ ⟩ ∥ 2 2 − ∥ ∣ ξ ⟩ − ∣ ζ ⟩ ∥ 2 2 = 2 Re ⟨ ξ ∣ ( I − U † V ) ∣ ζ ⟩ ≤ 4 ∥ ∣ ξ ⟩ ∥ 2 ∥ ∣ ζ ⟩ ∥ 2 . \lVert U|\xi\rangle-V|\zeta\rangle\rVert_{2}^{2}-\lVert|\xi\rangle-|\zeta\rangle\rVert_{2}^{2}=2\operatorname{Re}\langle\xi|(I-U^{\dagger}V)|\zeta\rangle\leq4\lVert|\xi\rangle\rVert_{2}\lVert|\zeta\rangle\rVert_{2}. ∥ U ∣ ξ ⟩ − V ∣ ζ ⟩ ∥ 2 2 − ∥ ∣ ξ ⟩ − ∣ ζ ⟩ ∥ 2 2 = 2 Re ⟨ ξ ∣ ( I − U † V ) ∣ ζ ⟩ ≤ 4 ∥ ∣ ξ ⟩ ∥ 2 ∥ ∣ ζ ⟩ ∥ 2 .
Apply this to compare D B ∣ ψ t + 1 ⟩ D_B|\psi_{t+1}\rangle D B ∣ ψ t + 1 ⟩ and D B ∣ ψ t ′ ⟩ D_B|\psi'_t\rangle D B ∣ ψ t ′ ⟩ address by address, i.e. use ∣ ξ ⟩ = ∣ ξ i ⟩ |\xi\rangle=|\xi_i\rangle ∣ ξ ⟩ = ∣ ξ i ⟩ , ∣ ζ ⟩ = ∣ ζ i ⟩ |\zeta\rangle=|\zeta_i\rangle ∣ ζ ⟩ = ∣ ζ i ⟩ , U = O i ( f ) U=O_i(f) U = O i ( f ) and V = O i ( f { i 0 } ) V=O_i(f^{\{i_0\}}) V = O i ( f { i 0 } ) . Sum over i ∈ B i\in B i ∈ B , since outside B B B the query leaves the difference norm unchanged. Applying Cauchy–Schwarz to the sum gives
∥ D B ∣ ψ t + 1 ⟩ ∥ ν j 2 − ∥ D B ∣ ψ t ′ ⟩ ∥ ν j 2 ≤ 4 ( E ν j [ ∑ i ∈ B ∥ ∣ ξ i ⟩ ∥ 2 2 ] ) 1 / 2 ( E ν j [ ∑ i ∈ B ∥ ∣ ζ i ⟩ ∥ 2 2 ] ) 1 / 2 . \lVert D_B|\psi_{t+1}\rangle\rVert_{\nu_j}^{2}-\lVert D_B|\psi'_t\rangle\rVert_{\nu_j}^{2}\leq4\left(\mathop{\mathbb{E}}_{\nu_j}\left[\sum_{i\in B}\lVert|\xi_i\rangle\rVert_{2}^{2}\right]\right)^{1/2}\left(\mathop{\mathbb{E}}_{\nu_j}\left[\sum_{i\in B}\lVert|\zeta_i\rangle\rVert_{2}^{2}\right]\right)^{1/2}. ∥ D B ∣ ψ t + 1 ⟩ ∥ ν j 2 − ∥ D B ∣ ψ t ′ ⟩ ∥ ν j 2 ≤ 4 ( E ν j [ i ∈ B ∑ ∥ ∣ ξ i ⟩ ∥ 2 2 ] ) 1/2 ( E ν j [ i ∈ B ∑ ∥ ∣ ζ i ⟩ ∥ 2 2 ] ) 1/2 .
We prove the claim by induction on j j j , using the two bounds in Lemma 4.5 . Summing the increments up to any query time and then taking the maximum gives a bound on R j 2 R_j^2 R j 2 .
For j = 1 j=1 j = 1 , the first expectation is the expected query mass of ∣ ψ t ′ ⟩ |\psi'_t\rangle ∣ ψ t ′ ⟩ on the marked position i 0 i_0 i 0 (i.e. B = { i 0 } B=\{i_0\} B = { i 0 } ) on input f f f , which is uniform among b 1 + ℓ b_1+\ell b 1 + ℓ singletons, so this is at most 1 / ( b 1 + ℓ ) 1/(b_1+\ell) 1/ ( b 1 + ℓ ) . The second expectation has the same interpretation, but on input f { i 0 } f^{\{i_0\}} f { i 0 } . Refreshing this label preserves the labeled input distribution, thus both expectations in the last display are at most 1 / ( b 1 + ℓ ) 1/(b_1+\ell) 1/ ( b 1 + ℓ ) . Each increment is therefore at most 4 / ( b 1 + ℓ ) ≤ 4 / n 1 4/(b_1+\ell)\leq4/n_1 4/ ( b 1 + ℓ ) ≤ 4/ n 1 . Since D B ∣ ψ 0 ⟩ = 0 D_B|\psi_0\rangle=0 D B ∣ ψ 0 ⟩ = 0 , summing over T ′ T' T ′ queries gives R 1 2 ≤ 4 T ′ / n 1 R_1^2\leq4T'/n_1 R 1 2 ≤ 4 T ′ / n 1 .
For 2 ≤ j < ℓ 2\leq j<\ell 2 ≤ j < ℓ , apply (25) to the first expectation to obtain upper bound 4 j / n ∗ 4^j/n_* 4 j / n ∗ . Then applying (24) to the second expectation gives upper bound j n 1 R j − 1 2 \frac{j}{n_1}R_{j-1}^2 n 1 j R j − 1 2 . Thus, the increment is at most 4 2 j n ∗ n 1 R j − 1 \frac{4\sqrt{2^j}}{\sqrt{n_*}\sqrt{n_1}}R_{j-1} n ∗ n 1 4 2 j R j − 1 . The initial differences vanish, so summing over at most T ′ T' T ′ queries yields
R j 2 ≤ 4 4 j 2 j T ′ n 1 n ∗ R j − 1 ( 2 ≤ j < ℓ ) . R_j^2\leq\frac{4\sqrt{4^j2^jT'}}{\sqrt{n_1n_*}}R_{j-1}\qquad(2\leq j<\ell). R j 2 ≤ n 1 n ∗ 4 4 j 2 j T ′ R j − 1 ( 2 ≤ j < ℓ ) .
Use the induction hypothesis together with α 2 = 1 / 2 \alpha_2=1/2 α 2 = 1/2 , α j + 1 = ( 1 + α j ) / 2 \alpha_{j+1}=(1+\alpha_j)/2 α j + 1 = ( 1 + α j ) /2 and j 2 j ≤ 4 j + 1 \sqrt{j}\,2^j\leq4^{j+1} j 2 j ≤ 4 j + 1 , to obtain
R j ≤ 4 j + 1 ( T ′ ) α j + 1 n 1 n ∗ α j + 1 − 1 / 2 . R_j\leq\frac{4^{j+1}(T')^{\alpha_{j+1}}}{\sqrt{n_1}\,n_*^{\alpha_{j+1}-1/2}}. R j ≤ n 1 n ∗ α j + 1 − 1/2 4 j + 1 ( T ′ ) α j + 1 .
Newton coefficient bounds
Now we return to Newton coefficients, the original goal of Lemma 4.1 . As mentioned earlier, we first consider the singleton case, i.e., w ∈ { 0 , 1 } m − 1 \mathbf{w}\in\{0,1\}^{m-1} w ∈ { 0 , 1 } m − 1 .
Lemma 4.8. Suppose N ≥ 8 A N\geq8A N ≥ 8 A , T ≥ 1 T\geq1 T ≥ 1 , and T 2 ≤ N / 8 T^2\leq N/8 T 2 ≤ N /8 . Let 2 ≤ ℓ ≤ A 2\leq\ell\leq A 2 ≤ ℓ ≤ A satisfy T ≤ N α ℓ / ( 1 + α ℓ ) T\leq N^{\alpha_\ell/(1+\alpha_\ell)} T ≤ N α ℓ / ( 1 + α ℓ ) . For every w ∈ { 0 , 1 } m − 1 \mathbf{w}\in\{0,1\}^{m-1} w ∈ { 0 , 1 } m − 1 ,
∣ d ℓ ( w ) ∣ ≤ C ℓ T 1 + α ℓ N , |d_\ell(\mathbf{w})|\leq C^\ell\frac{T^{1+\alpha_\ell}}{N}, ∣ d ℓ ( w ) ∣ ≤ C ℓ N T 1 + α ℓ , where C C C is an absolute constant.
Proof. For integer 0 ≤ s ≤ N 0\leq s\leq N 0 ≤ s ≤ N , let q ( s ) q(s) q ( s ) be mean acceptance for one s s s -block and N − s N-s N − s singletons, uniformly positioned and labeled. This function agrees with q w q_{\mathbf{w}} q w on { 0 } ∪ [ A ] \{0\}\cup[A] { 0 } ∪ [ A ] , and the cases s = 0 , 1 s=0,1 s = 0 , 1 both give the all-singleton partition. Its power sums are N − s + s j N-s+s^j N − s + s j for j ≥ 1 j\geq1 j ≥ 1 , so Lemma 3.1 extends q q q to a polynomial of degree at most 2 T 2T 2 T , bounded in [ 0 , 1 ] [0,1] [ 0 , 1 ] at the integers 0 , … , N 0,\ldots,N 0 , … , N . Since ( 2 T ) 2 ≤ N / 2 (2T)^2 \le N/2 ( 2 T ) 2 ≤ N /2 , we apply Lemma 3.3 with H = N H=N H = N , remainder order ℓ \ell ℓ , and z = ℓ z=\ell z = ℓ . The remainder at this point is exactly d ℓ ( w ) d_\ell(\mathbf{w}) d ℓ ( w ) , giving
∣ d ℓ ( w ) ∣ ≤ 2 ℓ ℓ ( 2 ℓ ) ! ( 16 T 2 N ) ℓ ≤ C ℓ ( T 2 N ) ℓ ≤ C ℓ T 1 + α ℓ N . |d_\ell(\mathbf{w})| \le\frac{2^{\ell}\ell}{(2\ell)!}\left(\frac{16T^2}{N}\right)^\ell\le C^\ell\left(\frac{T^2}{N}\right)^\ell\le C^\ell\frac{T^{1+\alpha_\ell}}{N}. ∣ d ℓ ( w ) ∣ ≤ ( 2 ℓ )! 2 ℓ ℓ ( N 16 T 2 ) ℓ ≤ C ℓ ( N T 2 ) ℓ ≤ C ℓ N T 1 + α ℓ .
The last inequality follows from T ≤ N α ℓ / ( 1 + α ℓ ) T \le N^{\alpha_\ell/(1+\alpha_\ell)} T ≤ N α ℓ / ( 1 + α ℓ ) and
( ℓ − 1 ) ( 1 + α ℓ ) − α ℓ ( 2 ℓ − 1 − α ℓ ) = ( 1 − α ℓ ) ( ℓ − 1 − α ℓ ) ≥ 0. (\ell-1)(1+\alpha_\ell)-\alpha_\ell(2\ell-1-\alpha_\ell)=(1-\alpha_\ell)(\ell-1-\alpha_\ell)\ge0. ( ℓ − 1 ) ( 1 + α ℓ ) − α ℓ ( 2 ℓ − 1 − α ℓ ) = ( 1 − α ℓ ) ( ℓ − 1 − α ℓ ) ≥ 0.
Now we continue with general w \mathbf{w} w , using the block difference bounds. We assume N ≥ 8 A N \ge8A N ≥ 8 A , T ≥ 1 T \ge1 T ≥ 1 , and T 2 ≤ N / 8 T^2 \le N/8 T 2 ≤ N /8 , and fix 2 ≤ ℓ ≤ A 2 \le\ell\le A 2 ≤ ℓ ≤ A with T ≤ N α ℓ / ( 1 + α ℓ ) T \le N^{\alpha_\ell/(1+\alpha_\ell)} T ≤ N α ℓ / ( 1 + α ℓ ) .
Lemma 4.9. Let w ∈ S m − 1 \mathbf{w}\in S^{m-1} w ∈ S m − 1 satisfy ∑ i w i ≤ 3 N / 4 \sum_i w_i \le3N/4 ∑ i w i ≤ 3 N /4 . First, let us complete ( w , ℓ ) (\mathbf{w},\ell) ( w , ℓ ) with singletons, let ρ \rho ρ count its ℓ \ell ℓ -blocks, and let b j b_j b j count its j j j -blocks for 1 ≤ j < ℓ 1\le j<\ell 1 ≤ j < ℓ . Let n j = 1 + b j n_j=1+b_j n j = 1 + b j and n ∗ = min 1 ≤ j < ℓ n j n_*=\min_{1\le j<\ell}n_j n ∗ = min 1 ≤ j < ℓ n j . Then
∣ d ℓ ( w ) ∣ ≤ C ℓ T 1 + α ℓ ρ n 1 n ∗ α ℓ − 1 / 2 , (29) |d_\ell(\mathbf{w})| \le\frac{C^\ell T^{1+\alpha_\ell}}{\sqrt{\rho}\,n_1 n_*^{\alpha_\ell-1/2}}, \tag*{(29)} ∣ d ℓ ( w ) ∣ ≤ ρ n 1 n ∗ α ℓ − 1/2 C ℓ T 1 + α ℓ , (29) where C C C is an absolute constant.
Proof. The completion is feasible since ∑ i w i + ℓ ≤ 7 N / 8 \sum_i w_i+\ell\le7N/8 ∑ i w i + ℓ ≤ 7 N /8 . If w i ≤ 1 w_i\le1 w i ≤ 1 for all i i i , Lemma 4.8 gives ∣ d ℓ ( w ) ∣ ≤ C ℓ T 1 + α ℓ / N |d_\ell(\mathbf{w})|\le C^\ell T^{1+\alpha_\ell}/N ∣ d ℓ ( w ) ∣ ≤ C ℓ T 1 + α ℓ / N , which proves (29) with ρ = 1 \rho=1 ρ = 1 , n 1 = N − ℓ + 1 ≤ N n_1=N-\ell+1\le N n 1 = N − ℓ + 1 ≤ N , and n ∗ α ℓ − 1 / 2 = 1 n_*^{\alpha_\ell-1/2}=1 n ∗ α ℓ − 1/2 = 1 : the exponent is zero for ℓ = 2 \ell=2 ℓ = 2 , and n ∗ = 1 n_*=1 n ∗ = 1 for ℓ ≥ 3 \ell\ge3 ℓ ≥ 3 . Otherwise, the completed partition has at most N − ℓ N-\ell N − ℓ blocks, thus Lemma 4.6 applies. By Proposition 4.3 , the expected block difference is d ℓ ( w ) d_\ell(\mathbf{w}) d ℓ ( w ) . Using the bound of Lemma 4.6 finishes the proof.
Now we have to average over w \mathbf{w} w to finish the proof.
Proof of Lemma 4.1 . The independent draws have mean one and is in S S S , so E [ ∑ i w i ] = m − 1 ≤ N / 2 \mathbb{E}[\sum_i w_i]=m-1\le N/2 E [ ∑ i w i ] = m − 1 ≤ N /2 . Hoeffding’s inequality [27 ] gives the stated bound on Pr [ G c ] \Pr[\mathcal{G}^c] Pr [ G c ] .
Let Y j Y_j Y j count the draws equal to j j j . Under the unconditioned product distribution, Y j ∼ Bin ( m − 1 , π ( j ) ) Y_j\sim\operatorname{Bin}(m-1,\pi(j)) Y j ∼ Bin ( m − 1 , π ( j )) . On G \mathcal{G} G , at least N − ∑ i w i − ℓ ≥ N / 8 N-\sum_i w_i-\ell\ge N/8 N − ∑ i w i − ℓ ≥ N /8 completion singletons are present, and the counts in Lemma 4.9 satisfy
ρ = 1 + Y ℓ , n 1 ≥ N / 8 , n j ≥ 1 + Y j ( 1 ≤ j < ℓ ) . \rho=1+Y_\ell,\qquad n_1\ge N/8,\qquad n_j\ge1+Y_j\quad(1\le j<\ell). ρ = 1 + Y ℓ , n 1 ≥ N /8 , n j ≥ 1 + Y j ( 1 ≤ j < ℓ ) .
For the following bound, we first apply Lemma 4.9 and we drop the event indicator. We also use the following facts: since α ℓ − 1 / 2 ≥ 0 \alpha_\ell-1/2\ge0 α ℓ − 1/2 ≥ 0 , on G \mathcal{G} G we have n ∗ − α ℓ + 1 / 2 ≤ ∑ j = 1 ℓ − 1 ( 1 + Y j ) − α ℓ + 1 / 2 n_*^{-\alpha_\ell+1/2}\le\sum_{j=1}^{\ell-1}(1+Y_j)^{-\alpha_\ell+1/2} n ∗ − α ℓ + 1/2 ≤ ∑ j = 1 ℓ − 1 ( 1 + Y j ) − α ℓ + 1/2 ; and ρ − 1 / 2 ≤ ( 1 + Y ℓ ) − 1 / 2 \rho^{-1/2}\le(1+Y_\ell)^{-1/2} ρ − 1/2 ≤ ( 1 + Y ℓ ) − 1/2 . Thus
E [ 1 G ∣ d ℓ ( w ) ∣ ] ≤ C ℓ T 1 + α ℓ N ∑ j = 1 ℓ − 1 E [ ( 1 + Y ℓ ) − 1 / 2 ( 1 + Y j ) − α ℓ + 1 / 2 ] ≤ C ℓ T 1 + α ℓ N ( m a ) − α ℓ . \mathbb{E}\left[1_{\mathcal{G}}|d_\ell(\mathbf{w})|\right]\le\frac{C^\ell T^{1+\alpha_\ell}}{N}\sum_{j=1}^{\ell-1}\mathbb{E}\left[(1+Y_\ell)^{-1/2}(1+Y_j)^{-\alpha_\ell+1/2}\right]\le\frac{C^\ell T^{1+\alpha_\ell}}{N}(ma)^{-\alpha_\ell}. E [ 1 G ∣ d ℓ ( w ) ∣ ] ≤ N C ℓ T 1 + α ℓ j = 1 ∑ ℓ − 1 E [ ( 1 + Y ℓ ) − 1/2 ( 1 + Y j ) − α ℓ + 1/2 ] ≤ N C ℓ T 1 + α ℓ ( ma ) − α ℓ .
In the last step we used Lemma 3.6 (since α ℓ < 1 \alpha_\ell<1 α ℓ < 1 ) with the fact that a ≤ π ( s ) a\le\pi(s) a ≤ π ( s ) , and absorbed factor ℓ − 1 \ell-1 ℓ − 1 into C ℓ C^\ell C ℓ .
Proof of Lemma 4.2
We prove Lemma 4.2 by adding a small uniform component and correcting its low moments on r r r suitable support points.
Proof of Lemma 4.2 . Let v = π 1 − π 0 v = \pi_1 - \pi_0 v = π 1 − π 0 , π ˉ = ( π 0 + π 1 ) / 2 \bar{\pi} = (\pi_0 + \pi_1)/2 π ˉ = ( π 0 + π 1 ) /2 , and Λ = 4 A − 1 \Lambda= 4^{A-1} Λ = 4 A − 1 . Let I ′ I' I ′ index the r − 1 r-1 r − 1 largest coordinates of ∣ v ∣ |v| ∣ v ∣ . For its Lagrange basis and i ∈ I ′ i \in I' i ∈ I ′ , moment cancellation and Lemma 3.5 give
v ( i ) = − ∑ j ∉ I ′ v ( j ) L i ( j ) , ∑ i ∈ I ′ ∣ v ( i ) ∣ ≤ Λ ∑ j ∉ I ′ ∣ v ( j ) ∣ . \begin{aligned}
v(i) &= -\sum_{j\notin I'} v(j)L_i(j), &
\sum_{i\in I'} |v(i)| &\leq\Lambda\sum_{j\notin I'} |v(j)|.
\end{aligned} v ( i ) = − j ∈ / I ′ ∑ v ( j ) L i ( j ) , i ∈ I ′ ∑ ∣ v ( i ) ∣ ≤ Λ j ∈ / I ′ ∑ ∣ v ( j ) ∣.
Thus the r r r th largest coordinate of ∣ v ∣ |v| ∣ v ∣ is at least δ / ( ( A + 1 ) ( 1 + Λ ) ) \delta/((A+1)(1+\Lambda)) δ / (( A + 1 ) ( 1 + Λ )) . On the set I I I of the r r r largest coordinates,
π ˉ ( i ) ≥ ∣ v ( i ) ∣ / 2 ≥ η : = δ 2 ( A + 1 ) ( 1 + Λ ) . \bar{\pi}(i) \geq|v(i)|/2 \geq\eta:= \frac{\delta}{2(A+1)(1+\Lambda)}. π ˉ ( i ) ≥ ∣ v ( i ) ∣/2 ≥ η := 2 ( A + 1 ) ( 1 + Λ ) δ .
Let U U U be uniform on { 0 } ∪ [ A ] \{0\} \cup[A] { 0 } ∪ [ A ] , let L i L_i L i now denote the Lagrange basis on I I I , and let e i e_i e i be unit mass at i i i . Let us set
τ = η / Λ , ω = π ˉ + τ ( U − ∑ i ∈ I E U [ L i ] e i ) . \tau= \eta/\Lambda,\qquad\omega= \bar{\pi} + \tau\left(U-\sum_{i\in I}\mathbb{E}_U[L_i]e_i\right). τ = η /Λ , ω = π ˉ + τ ( U − i ∈ I ∑ E U [ L i ] e i ) .
For every polynomial P P P of degree below r r r , interpolation gives E U [ P ] = ∑ i ∈ I P ( i ) E U [ L i ] \mathbb{E}_U[P] = \sum_{i\in I}P(i)\mathbb{E}_U[L_i] E U [ P ] = ∑ i ∈ I P ( i ) E U [ L i ] . Thus the correction has zero moments through order r − 1 r-1 r − 1 , including zero total mass. Lemma 3.5 gives ∑ i ∈ I ∣ E U [ L i ] ∣ ≤ Λ \sum_{i\in I}|\mathbb{E}_U[L_i]| \leq\Lambda ∑ i ∈ I ∣ E U [ L i ] ∣ ≤ Λ . Since τ Λ = η \tau\Lambda= \eta τ Λ = η , both on I I I and outside it, we have
ω ( s ) ≥ τ A + 1 = δ 2 ( A + 1 ) 2 Λ ( 1 + Λ ) ≥ 32 − A δ . \omega(s) \geq\frac{\tau}{A+1} = \frac{\delta}{2(A+1)^2\Lambda(1+\Lambda)} \geq32^{-A}\delta. ω ( s ) ≥ A + 1 τ = 2 ( A + 1 ) 2 Λ ( 1 + Λ ) δ ≥ 3 2 − A δ .
The last inequality uses the fact that 2 ( A + 1 ) 2 Λ ( 1 + Λ ) ≤ 4 ( A + 1 ) 2 16 A − 1 ≤ 32 A 2(A+1)^2\Lambda(1+\Lambda) \leq4(A+1)^2 16^{A-1} \leq32^A 2 ( A + 1 ) 2 Λ ( 1 + Λ ) ≤ 4 ( A + 1 ) 2 1 6 A − 1 ≤ 3 2 A for A ≥ 2 A \geq2 A ≥ 2 . Hence ω \omega ω is a probability distribution with the required moments. Finally,
∥ ω − π b ∥ 1 ≤ ∥ π ˉ − π b ∥ 1 + τ ( 1 + Λ ) ≤ δ / 2 + 2 η ≤ δ . \|\omega-\pi_b\|_1 \leq\|\bar{\pi}-\pi_b\|_1 + \tau(1+\Lambda) \leq\delta/2 + 2\eta\leq\delta. ∥ ω − π b ∥ 1 ≤ ∥ π ˉ − π b ∥ 1 + τ ( 1 + Λ ) ≤ δ /2 + 2 η ≤ δ .
Applications
In this section, we illustrate the moment matching method on various applications such as k k k -distinctness testing, testing some graph properties, image-size testing, and junta testing. For all these problems, classical frequency-moment constructions supply the hard inputs and Theorems 2.5 and 2.6 give quantum lower bounds, which we transfer to graph testing problems and junta testing by reductions. Table 1 compares the resulting bounds with previous randomized and quantum query bounds and identifies the argument used. The list of applications is not exhaustive, the purpose of this section is only to provide some interesting examples where our main theorems can be applied. Throughout, k k k and testing proximity parameter ε \varepsilon ε are considered to be constants, and we use shorthand a k = ( 2 k − 1 − 1 ) / ( 2 k − 1 ) a_k = (2^{k-1} - 1)/(2^k - 1) a k = ( 2 k − 1 − 1 ) / ( 2 k − 1 ) . Before presenting the application results, we discuss some preliminaries.
Preliminaries for applications
We denote [ R ] 0 = { 0 , 1 , … , R } [R]_0 = \{0,1,\ldots,R\} [ R ] 0 = { 0 , 1 , … , R } . In the query complexity model, we consider inputs x ∈ Σ I x \in\Sigma^I x ∈ Σ I over a finite alphabet Σ \Sigma Σ and indexed by a set I I I . When the input is a string s = ( s 1 , … , s N ) s=(s_1,\ldots,s_N) s = ( s 1 , … , s N ) of positive integers ≤ R \le R ≤ R , then I = [ N ] I=[N] I = [ N ] and Σ = [ R ] \Sigma=[R] Σ = [ R ] .
In the bounded-degree graph model , we query the adjacency lists of the vertices of the input graph. For a graph with vertex set V V V and maximum degree bound d d d , we have I = V × [ d ] I=V\times[d] I = V × [ d ] and Σ = V ∪ { ⊥ } \Sigma=V\cup\{\perp\} Σ = V ∪ { ⊥ } . Here we assume that each vertex has a fixed order of its neighbors, and a query ( v , i ) (v,i) ( v , i ) returns the i i i -th neighbor of v v v if it exists, and a special character ⊥ \perp ⊥ otherwise. For directed graphs, one can distinguish two variants of this model. In the unidirectional model , the algorithm only has access to the list of out-neighbors of the vertices. On the other hand, in the bidirectional model , there are two lists: one for the out-neighbors and one for the in-neighbors, so the algorithm has to specify if it would like to learn the i i i -th in- or out-neighbor of a vertex v v v . This can be achieved, for example, by the query containing one additional bit.
In quantum query complexity, the algorithm can use a unitary query operator, and for input x ∈ Σ I x\in\Sigma^I x ∈ Σ I one way to define it as follows: O x ∣ i ⟩ ∣ z ⟩ = ∣ i ⟩ ∣ z + x i m o d ∣ Σ ∣ ⟩ O_x\lvert i\rangle\lvert z\rangle=\lvert i\rangle\lvert z+x_i\bmod\lvert\Sigma\rvert\rangle O x ∣ i ⟩ ∣ z ⟩ = ∣ i ⟩ ∣ z + x i mod ∣ Σ ∣⟩ , for z ∈ Σ z\in\Sigma z ∈ Σ and i ∈ I i\in I i ∈ I .
A property is a predicate P : D P → { 0 , 1 } \mathcal{P}:D_{\mathcal{P}}\to\{0,1\} P : D P → { 0 , 1 } over domain D P ⊆ Σ I D_{\mathcal{P}}\subseteq\Sigma^I D P ⊆ Σ I . We say that an input x x x satisfies P \mathcal{P} P if x ∈ P x\in\mathcal{P} x ∈ P . The distance of two inputs x , y ∈ Σ I x,y\in\Sigma^I x , y ∈ Σ I is defined as
dist ( x , y ) = ∣ { i ∈ I : x i ≠ y i } ∣ ∣ I ∣ . \operatorname{dist}(x,y)=\frac{\left|\{i\in I:x_i\ne y_i\}\right|}{|I|}. dist ( x , y ) = ∣ I ∣ ∣ { i ∈ I : x i = y i } ∣ .
We say that x x x is ε \varepsilon ε -far from a property P \mathcal{P} P if dist ( x , y ) > ε \operatorname{dist}(x,y)>\varepsilon dist ( x , y ) > ε for all y ∈ P y\in\mathcal{P} y ∈ P .
In the case of graphs, a graph property is defined as a set of graphs that is closed under graph isomorphism. In the case of bounded-degree graphs with maximum degree bound d d d , the distance of two graphs is the number of edges that one needs to add or delete in order to transform one to the other (up to isomorphism) divided by ∣ V ∣ d |V|d ∣ V ∣ d .
In property testing , an algorithm, also called a ε \varepsilon ε -tester, accepts inputs in P \mathcal{P} P and rejects those ε \varepsilon ε -far from P \mathcal{P} P , each with probability at least 2 / 3 2/3 2/3 . The tester can either output accept or reject when the above two conditions do not hold.
The problem of k k k -source-subgraph-freeness testing, and its special case, k k k -star-freeness testing, were introduced in [28 ] and their quantum versions were studied in [3 ] . The former is a general directed subgraph-freeness problem where the forbidden subgraph is restricted to having k k k “source components”, where a source component is a set of vertices S S S with no edge going from vertices outside S S S to S S S . An (incoming) k k k -star consists of a center node and k k k outer nodes all having an edge to the center.
We also present directed planarity and outerplanarity testing lower bounds. Here, planarity and outerplanarity refer to the underlying undirected graph obtained by ignoring arc directions and replacing each antiparallel edge pair by a single edge, but the oracle gives only outgoing neighbors in the unidirectional model defined above. Recall that an undirected graph G G G is said to be planar if it can be drawn in the plane such that edges intersect only at common endpoints. Similarly, G G G is said to be outerplanar if it can be drawn in a planar way with every vertex on the boundary of the outer (unbounded) face.
Testing distinctness and graph properties
We apply Theorem 2.6 to the classical hard instances considered by Peng and Wang [33 ] , then transfer the distinctness bound to graph testing through a local encoding.
The classical frequencies give a quantum lower bound
The classical random variables X 0 , X 1 X_0, X_1 X 0 , X 1 on [ k ] [k] [ k ] from [33 Section 2.2, Lemma 11] have k − 1 k-1 k − 1 proportional moments. We take the classical hard distribution from [33 ] and apply Theorem 2.6 ; it remains to check that its input distributions satisfy the testing promises.
Corollary 5.1 (Testing k k k -distinctness). For any k ≥ 2 k \ge2 k ≥ 2 , let us fix ε k = 1 / ( k 2 k ) \varepsilon_k = 1/(k2^k) ε k = 1/ ( k 2 k ) . Also let M ≥ N M \ge N M ≥ N . For every 0 < ε ≤ ε k 0 < \varepsilon\le\varepsilon_k 0 < ε ≤ ε k , testing
E k , N , M = { f : [ N ] → [ M ] : ∣ f − 1 ( a ) ∣ < k for every a ∈ [ M ] } \mathcal{E}_{k,N,M} = \{f : [N] \to[M] : |f^{-1}(a)| < k \text{ for every } a \in[M]\} E k , N , M = { f : [ N ] → [ M ] : ∣ f − 1 ( a ) ∣ < k for every a ∈ [ M ]} has quantum query complexity Ω ( N a k ) \Omega(N^{a_k}) Ω ( N a k ) , even when every multiplicity is at most k k k , where a k = ( 2 k − 1 − 1 ) / ( 2 k − 1 ) a_k = (2^{k-1} - 1)/(2^k - 1) a k = ( 2 k − 1 − 1 ) / ( 2 k − 1 ) .
Proof. Let us consider X 0 , X 1 X_0, X_1 X 0 , X 1 from [33 Section 2.2] . Besides their k − 1 k-1 k − 1 proportional moments, they satisfy
Pr [ X 0 = k ] = 0 , Pr [ X 1 = k ] E [ X 1 ] = 1 k 2 k − 2 = 4 ε k . \Pr[X_0 = k] = 0,\qquad\frac{\Pr[X_1 = k]}{\mathbb{E}[X_1]} = \frac{1}{k2^{k-2}} = 4\varepsilon_k. Pr [ X 0 = k ] = 0 , E [ X 1 ] Pr [ X 1 = k ] = k 2 k − 2 1 = 4 ε k .
For M = N M=N M = N , let us use the input distribution Π b , N \Pi_{b,N} Π b , N of Definition 2.1 . Under Π 0 , N \Pi_{0,N} Π 0 , N , every input belongs to E k , N , N \mathcal{E}_{k,N,N} E k , N , N . In Definition 2.1 , each sampled multiplicity equals k k k with probability Pr [ X b = k ] / E [ X b ] \Pr[X_b = k]/\mathbb{E}[X_b] Pr [ X b = k ] / E [ X b ] . Using a concentration argument, we can say that with probability 1 − e − Ω ( N ) 1-e^{-\Omega(N)} 1 − e − Ω ( N ) , no overflow event happens and Π 1 , N \Pi_{1,N} Π 1 , N contains at least ε k N \varepsilon_kN ε k N values of multiplicity k k k . Each such value requires at least one change, so with probability 1 − o ( 1 ) 1-o(1) 1 − o ( 1 ) , such inputs are ε k \varepsilon_k ε k -far from E k , N , N \mathcal{E}_{k,N,N} E k , N , N , and thus a tester has acceptance gap 1 / 3 − o ( 1 ) 1/3-o(1) 1/3 − o ( 1 ) .
For T > c N T > c\sqrt{N} T > c N , the lower bound is immediate. Otherwise, Theorem 2.6 , with A = r = k A=r=k A = r = k , gives us
1 3 − o ( 1 ) ≤ C k T 2 − 2 1 − k N 1 − 2 1 − k + N e − c N / k 2 . \frac{1}{3}-o(1) \le C^k\frac{T^{2-2^{1-k}}}{N^{1-2^{1-k}}}+Ne^{-cN/k^2}. 3 1 − o ( 1 ) ≤ C k N 1 − 2 1 − k T 2 − 2 1 − k + N e − c N / k 2 .
Thus T = Ω ( N a k ) T=\Omega(N^{a_k}) T = Ω ( N a k ) . Embedding the outputs into [ M ] [M] [ M ] preserves the distance bound and costs only constantly many queries. This completes the proof. □ \square □
Previous quantum bounds The bound Ω ( N 1 / 2 − 1 / ( 2 k ) / log 2 N ) \Omega(N^{1/2-1/(2k)}/\log^2 N) Ω ( N 1/2 − 1/ ( 2 k ) / log 2 N ) in [3 Theorem 4.1] comes from dual polynomials, and [PW27, Theorem 7.2] obtained the same bound (with a worse logarithmic factor) even for bounded multiplicities. Corollary 5.1 improves this exponent for k ≥ 3 k \ge3 k ≥ 3 , and our new bound matches the upper bound from [3 Sections 1.3 and 1.5.1] . The optimal lower bound of Ω ( N 1 / 3 ) \Omega(N^{1/3}) Ω ( N 1/3 ) for k = 2 k=2 k = 2 was known from [5 ] (since a two-to-one function is ( 1 / 2 ) (1/2) ( 1/2 ) -far from injectivity), our result proves optimal bounds for k ≥ 3 k \ge3 k ≥ 3 . It is interesting to note that the problem of finding k k k -collisions in random functions has the same query complexity as the property testing variant [29 ] .
Graph consequences
We describe the standard local reduction that maps a k k k -collision to a k k k -star; the other consequences (planarity and outerplanarity) use the same construction. Recall that for planarity and outerplanarity testing, while the graph is directed and accessed in the unidirectional model, the property to test is whether the underlying undirected graphs are planar and outerplanar, respectively.
Let K a , b K_{a,b} K a , b denote the complete bipartite graph with the two parts having size a a a and b b b . In its directed variant, every arc is directed from the first part to the second. From a distinctness testing instance f : [ N ′ ] → [ N ′ ] f : [N'] \to[N'] f : [ N ′ ] → [ N ′ ] , we form a directed graph G q ( f ) G_q(f) G q ( f ) of size N = N ′ ( q + 1 ) N = N'(q+1) N = N ′ ( q + 1 ) with vertices u i u_i u i and v a , j v_{a,j} v a , j , for i , a ∈ [ N ′ ] i,a \in[N'] i , a ∈ [ N ′ ] , j ∈ [ q ] j \in[q] j ∈ [ q ] for some constant parameter q q q , and arcs
u i ⟶ v f ( i ) , j . (30) u_i \longrightarrow v_{f(i),j}. \tag*{(30)} u i ⟶ v f ( i ) , j . (30)
By this construction, each value of multiplicity c a c_a c a gives a directed K c a , q K_{c_a,q} K c a , q component, leading to a graph of maximum outdegree q q q . Moreover, by this reduction, k k k -distinctness testing turns into different subgraph-freeness testing problems:
For q = 1 q=1 q = 1 and any constant k k k , the reduction gives the k k k -star-freeness testing problem, which is a special case of k k k -source-subgraph-freeness testing.
For q = 3 q=3 q = 3 and k = 3 k=3 k = 3 , the reduction gives a planar graph in the 3-collision-free case and a far from planar one (containing many disjoint K 3 , 3 K_{3,3} K 3 , 3 subgraphs) in the far from 3-collision-free case.
For q = 2 q=2 q = 2 and k = 3 k=3 k = 3 , the reduction gives an outerplanar graph in the 3-collision-free case and a far from outerplanar one (containing many disjoint K 3 , 2 K_{3,2} K 3 , 2 subgraphs) in the far from 3-collision-free case.
Thus, we obtain the following corollary.
Corollary 5.2 (Graph testing problems). In the unidirectional bounded-degree model, the following quantum query lower bounds hold for N N N -vertex input graphs:
For any constant k k k and 0 < ε ≤ ε k / 4 0 < \varepsilon\le\varepsilon_k/4 0 < ε ≤ ε k /4 , testing k k k -source-subgraph-freeness has quantum query complexity Ω ( N a k ) \Omega(N^{a_k}) Ω ( N a k ) . A special case is k k k -star-freeness.
For 0 < ε ≤ 1 / 576 0 < \varepsilon\le1/576 0 < ε ≤ 1/576 , testing planarity with maximum outdegree 3 has quantum query complexity Ω ( N 3 / 7 ) \Omega(N^{3/7}) Ω ( N 3/7 ) .
For 0 < ε ≤ 1 / 288 0 < \varepsilon\le1/288 0 < ε ≤ 1/288 , testing outerplanarity with maximum outdegree 2 has quantum query complexity Ω ( N 3 / 7 ) \Omega(N^{3/7}) Ω ( N 3/7 ) .
The bounds hold already on bipartite directed acyclic graphs whose indegree and undirected degree are at most k k k in the first case, and at most 3 in the last two cases.
Proof. Under the promise that multiplicities are at most k k k , a function that is ε k \varepsilon_k ε k -far from k k k -distinctness of input length N ′ N' N ′ has at least ε k N ′ \varepsilon_kN' ε k N ′ values of multiplicity k k k : changing one occurrence of each such value to an unused label repairs the function. We form G q ( f ) G_q(f) G q ( f ) similar to Eq. (30) . Thus G q ( f ) G_q(f) G q ( f ) has that many disjoint forbidden components and each component requires an original arc to be deleted. With N ′ = ⌊ N / ( q + 1 ) ⌋ N' = \lfloor N/(q+1)\rfloor N ′ = ⌊ N / ( q + 1 )⌋ and adding isolated vertices if required, the distance is at least ε k N ′ / ( q N ) ≥ ε k / [ 2 q ( q + 1 ) ] \varepsilon_kN'/(qN) \ge\varepsilon_k/[2q(q+1)] ε k N ′ / ( q N ) ≥ ε k / [ 2 q ( q + 1 )] . Correctness follows from the underlying component graphs in the following table.
Table 2.
We finally apply Corollary 5.1, with the same k k k for the first row, and k = 3 k=3 k = 3 for the last two rows.
Previous quantum bounds For k k k -star-freeness and k k k -source-subgraph-freeness testing, the lower bound in [3 ] transfers its k k k -distinctness testing bound of Ω ( N 1 / 2 − 1 / ( 2 k ) / log 2 N ) \Omega(N^{1/2-1/(2k)}/\log^2 N) Ω ( N 1/2 − 1/ ( 2 k ) / log 2 N ) through the described local graph encoding (for q = 1 q=1 q = 1 ). The same lower bound was extended to the bounded indegree case by [PW27]. For planarity and outerplanarity testing, using the lower bound of Ω ~ ( N 1 / 2 − 1 / ( 2 k ) ) \widetilde{\Omega}(N^{1/2-1/(2k)}) Ω ( N 1/2 − 1/ ( 2 k ) ) , the same reduction gives a bound of Ω ~ ( N 1 / 3 ) \widetilde{\Omega}(N^{1/3}) Ω ( N 1/3 ) and, to the best of the authors’ knowledge, this is the current best lower bound.
Image-size and junta testing
We use r = Θ ( log N ) r=\Theta(\log N) r = Θ ( log N ) proportional moments on support A = O ( r 2 ) A=O(r^2) A = O ( r 2 ) . The polynomial estimate gives a square-root bound for image size testing, which can be transferred to junta testing by a well-known addressing reduction.
Classical moment construction
Let us first revisit the classical moment construction for this problem. In fact, [RRSS09, Theorem 4.5] presented a similar construction for the distinct elements problem, which is related to image size testing. Their construction considers A = O ( exp ( r ) ) A=O(\exp(r)) A = O ( exp ( r )) . However, for our applications, we need A = O ( r 2 ) A=O(r^2) A = O ( r 2 ) . We will prove the next lemma by using polynomial approximation and linear-programming duality, following the approach of [WY19, Appendix A]. The proof is deferred to Appendix § 9 .
Lemma 5.3. For fixed 0 < η < 1 / 2 0<\eta<1/2 0 < η < 1/2 and every r ≥ 2 r\ge2 r ≥ 2 , there exist random variables X 0 , X 1 X_0,X_1 X 0 , X 1 on [ A ] [A] [ A ] , with A ≤ C r 2 A\le Cr^2 A ≤ C r 2 , such that
E [ X 0 j ] E [ X 0 ] = E [ X 1 j ] E [ X 1 ] ( 1 ≤ j < r ) , 1 E [ X 0 ] ≥ 1 − η , 1 E [ X 1 ] ≤ η . \frac{\mathbb{E}[X_0^j]}{\mathbb{E}[X_0]}=\frac{\mathbb{E}[X_1^j]}{\mathbb{E}[X_1]}\quad(1\le j<r),\qquad\frac{1}{\mathbb{E}[X_0]}\ge1-\eta,\qquad\frac{1}{\mathbb{E}[X_1]}\le\eta. E [ X 0 ] E [ X 0 j ] = E [ X 1 ] E [ X 1 j ] ( 1 ≤ j < r ) , E [ X 0 ] 1 ≥ 1 − η , E [ X 1 ] 1 ≤ η . Here C C C depends only on η \eta η .
Remark 5.4. The quadratic bound on the largest multiplicity also improves the lower bound obtained from the classical argument of [RRSS09]. Their construction [RRSS09, Theorem 4.5] uses A = O ( exp ( r ) ) A=O(\exp(r)) A = O ( exp ( r )) and their lower bound is Ω ( N 1 − o ( 1 ) ) \Omega(N^{1-o(1)}) Ω ( N 1 − o ( 1 ) ) [RRSS09, Corollary 2.2]. Replacing that construction by Lemma 5.3, while retaining their other arguments, gives a lower bound Ω ( N ( log log N log N ) 4 ) \Omega\left(N\left(\frac{\log\log N}{\log N}\right)^4\right) Ω ( N ( l o g N l o g l o g N ) 4 ) . In particular, this gives an improved lower bound on the distinct elements and support-size estimation problems, although the optimal lower bound is Ω ( N / log N ) \Omega(N/\log N) Ω ( N / log N ) .
Image-size testing
We consider inputs f : [ N ] → [ N ] f:[N]\to[N] f : [ N ] → [ N ] . The image-size testing problem considered in [1 ] , corresponds to testing the property of having image size at most ℓ \ell ℓ where ℓ < N \ell<N ℓ < N is any parameter. Then, [11 ] considered a special case of distinguishing image size at most γ N \gamma N γ N for 0 < γ < 1 0<\gamma<1 0 < γ < 1 from image size exactly N N N . In this work, we consider a different special case of the version in [1 ] , where we distinguish image size at most ⌊ 3 N / 4 ⌋ \lfloor3N/4\rfloor ⌊ 3 N /4 ⌋ from at least ⌈ 7 N / 8 ⌉ \lceil7N/8\rceil ⌈ 7 N /8 ⌉ . This hard instance provides the same lower bound for the more general variant of image-size testing.
We apply Theorem 2.5 with the random variables provided by Lemma 5.3. Singleton completion preserves the gap in image sizes.
Corollary 5.5 (Image-size testing). Let P N = { f : [ N ] → [ N ] : ∣ f ( [ N ] ) ∣ ≤ ⌊ 3 N / 4 ⌋ } P_N = \{f : [N] \to[N] : |f([N])| \le\lfloor3N/4 \rfloor\} P N = { f : [ N ] → [ N ] : ∣ f ([ N ]) ∣ ≤ ⌊ 3 N /4 ⌋} . Testing P N P_N P N at proximity 1 / 8 1/8 1/8 has quantum query complexity Ω ( N ) \Omega(\sqrt{N}) Ω ( N ) .
Proof. Let us take r = ⌈ log N ⌉ r = \lceil\log N \rceil r = ⌈ log N ⌉ , η = 1 / 10 \eta= 1/10 η = 1/10 , and the variables X 0 X_0 X 0 , X 1 X_1 X 1 of Lemma 5.3. Now we denote μ b = E [ X b ] \mu_b = \mathbb{E}[X_b] μ b = E [ X b ] and m = ⌊ N / 2 ⌋ m = \lfloor N/2 \rfloor m = ⌊ N /2 ⌋ . Following Definition 2.1 , each sampled multiplicity has mean 1 1 1 and is nonzero with probability 1 / μ b 1/\mu_b 1/ μ b . Singleton completion therefore gives us
E f ∼ Π b , N [ ∣ f ( [ N ] ) ∣ ] = N − m ( 1 − 1 / μ b ) + o ( 1 ) , \mathbb{E}_{f\sim\Pi_{b,N}}[|f([N])|] = N - m(1 - 1/\mu_b) + o(1), E f ∼ Π b , N [ ∣ f ([ N ]) ∣ ] = N − m ( 1 − 1/ μ b ) + o ( 1 ) ,
where the correction term corresponds to the overflow event, which happens with probability o ( 1 ) o(1) o ( 1 ) . Using the properties of X 0 X_0 X 0 and X 1 X_1 X 1 , for b = 0 b = 0 b = 0 we get expected image size at least 19 N / 20 + o ( 1 ) 19N/20 + o(1) 19 N /20 + o ( 1 ) , and for b = 1 b = 1 b = 1 , it is at most 11 N / 20 + o ( 1 ) 11N/20 + o(1) 11 N /20 + o ( 1 ) . Concentration of the sampled multiplicities, together with the overflow bound, gives ∣ f ( [ N ] ) ∣ ≥ ⌊ 7 N / 8 ⌋ |f([N])| \ge\lfloor7N/8 \rfloor ∣ f ([ N ]) ∣ ≥ ⌊ 7 N /8 ⌋ with very high probability for the input coming from X 0 X_0 X 0 and ∣ f ( [ N ] ) ∣ ≤ ⌊ 3 N / 4 ⌋ |f([N])| \le\lfloor3N/4 \rfloor ∣ f ([ N ]) ∣ ≤ ⌊ 3 N /4 ⌋ for the one coming from X 1 X_1 X 1 . Removing an output value requires changing at least one position, thus f 1 ∈ P N f_1 \in P_N f 1 ∈ P N and f 0 f_0 f 0 is 1 / 8 1/8 1/8 -far, so a tester must have acceptance gap at least 1 / 3 − o ( 1 ) 1/3 - o(1) 1/3 − o ( 1 ) .
Applying Theorem 2.5 directly to X 0 X_0 X 0 , X 1 X_1 X 1 using the fact that A = O ( r 2 ) A = O(r^2) A = O ( r 2 ) , and combining the resulting acceptance gap upper bound with the previous lower bound, we obtain T ∈ Ω ( N ) T \in\Omega(\sqrt{N}) T ∈ Ω ( N ) .
Previous quantum bounds Ambainis, Belovs, Regev, and de Wolf [1 ] proved a lower bound of Ω ( N 1 / 3 ) \Omega(N^{1/3}) Ω ( N 1/3 ) on the general image-size testing problem using that the collision problem (distinguishing one-to-one and two-to-one functions) is a special case. Bun, Kothari and Thaler [11 Theorem 6.2 and Section 6.1.2] improved the lower bound to Ω ( N / log 2 N ) \Omega(\sqrt{N}/\log^2 N) Ω ( N / log 2 N ) using their special case of distinguishing image size N N N from at most γ N \gamma N γ N . Our Corollary 5.5 removes the log 2 N \log^2 N log 2 N term, via the special case of distinguishing image size at most ⌊ 3 N / 4 ⌋ \lfloor3N/4 \rfloor ⌊ 3 N /4 ⌋ and greater than ⌊ 7 N / 8 ⌋ \lfloor7N/8 \rfloor ⌊ 7 N /8 ⌋ . Our lower bound matches the quantum upper bound from [32 Theorem 2] .
Remark 5.6. Theorem 2.6 improves the lower bound from Theorem 2.5 when A A A and r r r are fixed, but its exponential dependence on A A A can make it ineffective when the multiplicities grow with the input size. Image-size testing provides a concrete example. In the proof of Corollary 5.5 , we take r = ⌈ log N ⌉ r = \lceil\log N \rceil r = ⌈ log N ⌉ , A = Θ ( r 2 ) A = \Theta(r^2) A = Θ ( r 2 ) . Applying Theorem 2.6 would yield a suboptimal lower bound of Ω ( N 1 / 2 − o ( 1 ) ) \Omega(N^{1/2-o(1)}) Ω ( N 1/2 − o ( 1 ) ) . By the reduction, the same holds for junta testing as well.
Junta testing by reduction
A Boolean K K K -junta depends on at most K K K input coordinates. We apply the addressing reduction of [1 Lemma 6.3] (already present in [6 ] ) to Corollary 5.5 . Since this reduction is standard in the literature (see e.g., [11 Section 6.2] ), we only state the result.
Corollary 5.7 (Junta testing). Testing Boolean K K K -juntas at proximity 1 / 3 1/3 1/3 has quantum query complexity Ω ( K ) \Omega(\sqrt{K}) Ω ( K ) .
Previous quantum bounds [1 ] proved a lower bound of Ω ( K 1 / 3 ) \Omega(K^{1/3}) Ω ( K 1/3 ) , which was later improved by [11 ] to Ω ( K / log 2 K ) \Omega(\sqrt{K}/\log^2 K) Ω ( K / log 2 K ) . Both results used a reduction from image size testing.
Acknowledgements
CK’s and FM’s research was supported in part by a bilateral grant between the Université Paris Cité and the National University of Singapore (2026-01-RESEARCH/UPCité-NUS and ANR-18-IDEX-0001), the French PEPR integrated projects EPIQ (ANR-22-PETQ-0007) and HQI (ANR-22-PNCQ-0002), and the ERC Advanced Grant PARQ.
SS’s research was supported by the NRF Investigatorship award (NRF-NRFI10-2024-0006) and CQT Young Researcher Career Development Grant (25-YRCDG-SS).
DS’s research was supported by the German Federal Ministry of Research, Technology and Space (QuSol, 13N17173), by the Deutsche Forschungsgemeinschaft under Germany’s Excellence Strategy – EXC-2111 – 390814868, and by the Munich Quantum Valley.
AI statement. We used GPT-6 Astra, GPT-6.1 Sol and Claude Opus 5.5 to explore proof strategies, refine mathematical arguments, search for related literature, and improve the presentation. The authors subsequently verified, simplified, and organized the argument, and rewrote its exposition. Important concepts and ideas were manually factored out and written down in an intuitive, understandable way. The authors take full responsibility for the correctness and content of the paper.
References
Deferred proofs on polynomials
We provide the missing proofs of some lemmas from § 3.1.2 . We restate these lemmas for ease of reading.
Lemma 3.2 (Taylor bound). Let H ≥ 1 H \ge1 H ≥ 1 and d ≥ 0 d \ge0 d ≥ 0 be integers with d 2 ≤ H / 2 d^2 \le H/2 d 2 ≤ H /2 . Let q ( z ) = ∑ ℓ = 0 d a ℓ z ℓ q(z) = \sum_{\ell=0}^{d} a_{\ell}z^{\ell} q ( z ) = ∑ ℓ = 0 d a ℓ z ℓ be any polynomial of degree at most d d d such that ∣ q ( z ) ∣ ≤ 1 \lvert q(z)\rvert\le1 ∣ q ( z )∣ ≤ 1 for z ∈ { 0 } ∪ [ H ] = { 0 , 1 , … , H } z \in\{0\} \cup[H] = \{0,1,\ldots,H\} z ∈ { 0 } ∪ [ H ] = { 0 , 1 , … , H } . For an integer r ≥ 1 r \ge1 r ≥ 1 , let Q r = ∑ ℓ = 0 min ( r − 1 , r ) a ℓ z ℓ Q_r = \sum_{\ell=0}^{\min(r-1,r)} a_{\ell}z^{\ell} Q r = ∑ ℓ = 0 m i n ( r − 1 , r ) a ℓ z ℓ . Then for every real z ∈ [ 0 , H ] z \in[0,H] z ∈ [ 0 , H ] ,
∣ q ( z ) − Q r ( z ) ∣ ≤ 2 ( 2 r ) ! ( 4 d 2 H ) r z r . (31) \lvert q(z) - Q_r(z)\rvert\le\frac{2}{(2r)!}\left(\frac{4d^2}{H}\right)^r z^r. \tag*{(31)} ∣ q ( z ) − Q r ( z )∣ ≤ ( 2 r )! 2 ( H 4 d 2 ) r z r . (31)
Proof. Denote M = ∥ q ∥ [ 0 , H ] = max z ∈ [ 0 , H ] ∣ q ( z ) ∣ M=\lVert q\rVert_{[0,H]}=\max_{z\in[0,H]}|q(z)| M = ∥ q ∥ [ 0 , H ] = max z ∈ [ 0 , H ] ∣ q ( z ) ∣ . Markov’s inequality gives
∥ q ′ ∥ [ 0 , H ] ≤ 2 d 2 H M . \lVert q'\rVert_{[0,H]}\le\frac{2d^2}{H}M. ∥ q ′ ∥ [ 0 , H ] ≤ H 2 d 2 M .
where q ′ q' q ′ denotes the first order derivative of q q q . A point attaining M M M lies within 1 / 2 1/2 1/2 of an integer, so
M ≤ 1 + 1 2 ∥ q ′ ∥ [ 0 , H ] ≤ 1 + d 2 H M ≤ 1 + M 2 , M\le1+\frac{1}{2}\lVert q'\rVert_{[0,H]}\le1+\frac{d^2}{H}M\le1+\frac{M}{2}, M ≤ 1 + 2 1 ∥ q ′ ∥ [ 0 , H ] ≤ 1 + H d 2 M ≤ 1 + 2 M ,
hence M ≤ 2 M\le2 M ≤ 2 .
If r > d r>d r > d , the Taylor remainder is zero. Otherwise, applying the higher-order Markov inequality and rescaling from [ − 1 , 1 ] [-1,1] [ − 1 , 1 ] to [ 0 , H ] [0,H] [ 0 , H ] , gives
∥ q ( r ) ∥ [ 0 , H ] r ! ≤ M r ! ( 2 H ) r d 2 r ( 2 r − 1 ) ! ! ≤ 2 ( 2 r ) ! ( 4 d 2 H ) r , \frac{\lVert q^{(r)}\rVert_{[0,H]}}{r!}\le\frac{M}{r!}\left(\frac{2}{H}\right)^r\frac{d^{2r}}{(2r-1)!!}\le\frac{2}{(2r)!}\left(\frac{4d^2}{H}\right)^r, r ! ∥ q ( r ) ∥ [ 0 , H ] ≤ r ! M ( H 2 ) r ( 2 r − 1 )!! d 2 r ≤ ( 2 r )! 2 ( H 4 d 2 ) r ,
where q ( r ) q^{(r)} q ( r ) denotes the r r r -th order derivative and for the last inequality we use r ! ( 2 r − 1 ) ! ! = ( 2 r ) ! / 2 r r!(2r-1)!!=(2r)!/2^r r ! ( 2 r − 1 )!! = ( 2 r )! / 2 r [22 ] . Applying Taylor’s theorem we get (10). □
Lemma 3.3 (Newton bound). Let H ≥ 1 H\ge1 H ≥ 1 and d ≥ 0 d\ge0 d ≥ 0 be integers, and let q ( z ) q(z) q ( z ) be any polynomial of degree at most d d d such that ∣ q ( z ) ∣ ≤ 1 |q(z)|\le1 ∣ q ( z ) ∣ ≤ 1 for z ∈ { 0 } ∪ [ H ] z\in\{0\}\cup[H] z ∈ { 0 } ∪ [ H ] . Its Newton coefficients are
d ℓ = ∑ s = 0 ℓ ( − 1 ) ℓ − s ( ℓ s ) q ( s ) ( 0 ≤ ℓ ≤ H ) . d_\ell=\sum_{s=0}^{\ell}(-1)^{\ell-s}\binom{\ell}{s}q(s)\qquad(0\le\ell\le H). d ℓ = s = 0 ∑ ℓ ( − 1 ) ℓ − s ( s ℓ ) q ( s ) ( 0 ≤ ℓ ≤ H ) . For an integer 1 ≤ r ≤ H + 1 1\le r\le H+1 1 ≤ r ≤ H + 1 , let Q r ( z ) = ∑ ℓ = 0 r − 1 d ℓ ( z ℓ ) Q_r(z)=\sum_{\ell=0}^{r-1}d_\ell\binom{z}{\ell} Q r ( z ) = ∑ ℓ = 0 r − 1 d ℓ ( ℓ z ) . At every z ∈ { 0 } ∪ [ H ] z\in\{0\}\cup[H] z ∈ { 0 } ∪ [ H ] ,
q ( z ) − Q r ( z ) = ∑ ℓ = r H d ℓ ( z ℓ ) = ∑ ℓ = r z d ℓ ( z ℓ ) , q(z)-Q_r(z)=\sum_{\ell=r}^{H}d_\ell\binom{z}{\ell}=\sum_{\ell=r}^{z}d_\ell\binom{z}{\ell}, q ( z ) − Q r ( z ) = ℓ = r ∑ H d ℓ ( ℓ z ) = ℓ = r ∑ z d ℓ ( ℓ z ) , where empty sums are understood to be zero. Assume moreover that d 2 ≤ H / 2 d^2\le H/2 d 2 ≤ H /2 . Then, for every integer 1 ≤ r ≤ H + 1 1\le r\le H+1 1 ≤ r ≤ H + 1 and z ∈ { 0 } ∪ [ H ] z\in\{0\}\cup[H] z ∈ { 0 } ∪ [ H ] ,
∣ q ( z ) − Q r ( z ) ∣ ≤ 2 ( 2 r ) ! ( 4 d 2 H ) r z r . (32) |q(z)-Q_r(z)|\le\frac{2}{(2r)!}\left(\frac{4d^2}{H}\right)^r z^r. \tag*{(32)} ∣ q ( z ) − Q r ( z ) ∣ ≤ ( 2 r )! 2 ( H 4 d 2 ) r z r . (32)
Proof. First we observe that
q ( z ) = ∑ ℓ = 0 H d ℓ ( z ℓ ) = ∑ ℓ = 0 z d ℓ ( z ℓ ) . q(z)=\sum_{\ell=0}^{H}d_\ell\binom{z}{\ell}=\sum_{\ell=0}^{z}d_\ell\binom{z}{\ell}. q ( z ) = ℓ = 0 ∑ H d ℓ ( ℓ z ) = ℓ = 0 ∑ z d ℓ ( ℓ z ) .
Indeed, for 0 ≤ t ≤ z 0\le t\le z 0 ≤ t ≤ z , substituting the definition of d ℓ d_\ell d ℓ gives the coefficient ( z t ) ( 1 − 1 ) z − t \binom{z}{t}(1-1)^{z-t} ( t z ) ( 1 − 1 ) z − t for q ( t ) q(t) q ( t ) . This is one for t = z t=z t = z and zero otherwise, proving the expansion and the remainder identity.
For the bound, extend q q q to the stated polynomial. The polynomial Q r Q_r Q r interpolates q q q at 0 , … , r − 1 0,\ldots,r-1 0 , … , r − 1 . If r > d r>d r > d , both q q q and Q r Q_r Q r have degree at most r − 1 r-1 r − 1 . Since they agree at r r r points, they must be identical polynomials. Otherwise, the interpolation remainder formula and the derivative estimate in the proof of Lemma 3.2 give
∣ q ( z ) − Q r ( z ) ∣ ≤ ∥ q ( r ) ∥ [ 0 , H ] r ! ∣ ∏ j = 0 r − 1 ( z − j ) ∣ ≤ 2 ( 2 r ) ! ( 4 d 2 H ) r z r . \begin{aligned}
|q(z)-Q_r(z)|\le\frac{\lVert q^{(r)}\rVert_{[0,H]}}{r!}\left|\prod_{j=0}^{r-1}(z-j)\right| \\
&\le\frac{2}{(2r)!}\left(\frac{4d^2}{H}\right)^r z^r.
\end{aligned} ∣ q ( z ) − Q r ( z ) ∣ ≤ r ! ∥ q ( r ) ∥ [ 0 , H ] j = 0 ∏ r − 1 ( z − j ) ≤ ( 2 r )! 2 ( H 4 d 2 ) r z r .
At integer z < r z < r z < r , the product is zero; at z ≥ r z \ge r z ≥ r , it is at most z r z^r z r .
Lemma 3.5 (Lagrange interpolation). Let A ≥ 2 A \ge2 A ≥ 2 and 0 ≤ d ≤ A 0 \le d \le A 0 ≤ d ≤ A be integers, and let s 0 < ⋯ < s d s_0 < \cdots< s_d s 0 < ⋯ < s d belong to { 0 } ∪ [ A ] \{0\} \cup[A] { 0 } ∪ [ A ] . Define
L i ( x ) = ∏ 0 ≤ h ≤ d h ≠ i x − s h s i − s h ( 0 ≤ i ≤ d ) . L_i(x) = \prod_{\substack{0 \le h \le d \\ h \ne i}} \frac{x-s_h}{s_i-s_h} \qquad(0 \le i \le d). L i ( x ) = 0 ≤ h ≤ d h = i ∏ s i − s h x − s h ( 0 ≤ i ≤ d ) . Every polynomial P P P of degree at most d d d satisfies P ( x ) = ∑ i = 0 d P ( s i ) L i ( x ) P(x) = \sum_{i=0}^{d} P(s_i)L_i(x) P ( x ) = ∑ i = 0 d P ( s i ) L i ( x ) . Moreover, at every integer t ∈ { 0 } ∪ [ A ] t \in\{0\} \cup[A] t ∈ { 0 } ∪ [ A ] , ∑ i = 0 d ∣ L i ( t ) ∣ ≤ 4 A − 1 \sum_{i=0}^{d} |L_i(t)| \le4^{A-1} ∑ i = 0 d ∣ L i ( t ) ∣ ≤ 4 A − 1 .
Proof. The first identity is the standard Lagrange interpolation formula [23 §3.3(i)] . At a node, ∑ i ∣ L i ( t ) ∣ = 1 \sum_i |L_i(t)| = 1 ∑ i ∣ L i ( t ) ∣ = 1 . Otherwise, the h h h -th largest distance from t t t to a grid point is at most A − h + 1 A-h+1 A − h + 1 , so the numerator of each L i ( t ) L_i(t) L i ( t ) is at most ( A ) d (A)_d ( A ) d . Integer spacing bounds its denominator below by i ! ( d − i ) ! i!(d-i)! i ! ( d − i )! . Hence
∑ i = 0 d ∣ L i ( t ) ∣ ≤ ∑ i = 0 d ( A ) d i ! ( d − i ) ! = 2 d ( A d ) ≤ 4 A − 1 . \sum_{i=0}^{d} |L_i(t)| \le\sum_{i=0}^{d} \frac{(A)_d}{i!(d-i)!} = 2^d {A \choose d} \le4^{A-1}. i = 0 ∑ d ∣ L i ( t ) ∣ ≤ i = 0 ∑ d i ! ( d − i )! ( A ) d = 2 d ( d A ) ≤ 4 A − 1 . To prove the last inequality, observe that 2 d ( A d ) 2^d {A \choose d} 2 d ( d A ) is the coefficient of x d x^d x d in the binomial expansion
( 1 + 2 x ) A = ∑ j = 0 A 2 j ( A j ) x j . (1+2x)^A = \sum_{j=0}^{A} 2^j {A \choose j} x^j. ( 1 + 2 x ) A = j = 0 ∑ A 2 j ( j A ) x j . The largest coefficient of ( 1 + 2 x ) 2 = 1 + 4 x + 4 x 2 (1+2x)^2 = 1+4x+4x^2 ( 1 + 2 x ) 2 = 1 + 4 x + 4 x 2 is 4 4 4 . Multiplication by 1 + 2 x 1+2x 1 + 2 x replaces each coefficient by itself plus twice the preceding coefficient, increasing the maximum by a factor of at most 3 3 3 . Thus every coefficient of ( 1 + 2 x ) A (1+2x)^A ( 1 + 2 x ) A is at most 4 ⋅ 3 A − 2 ≤ 4 A − 1 4 \cdot3^{A-2} \le4^{A-1} 4 ⋅ 3 A − 2 ≤ 4 A − 1 .
Deferred construction of matching moments
Our last missing proof is for a lemma in § 5.3.1 .
Lemma 5.3. For fixed 0 < η < 1 / 2 0 < \eta< 1/2 0 < η < 1/2 and every r ≥ 2 r \ge2 r ≥ 2 , there exist random variables X 0 , X 1 X_0, X_1 X 0 , X 1 on [ A ] [A] [ A ] , with A ≤ C r 2 A \le Cr^2 A ≤ C r 2 , such that
E [ X 0 j ] E [ X 0 ] = E [ X 1 j ] E [ X 1 ] ( 1 ≤ j < r ) , 1 E [ X 0 ] ≥ 1 − η , 1 E [ X 1 ] ≤ η . \frac{\mathbb{E}[X_0^j]}{\mathbb{E}[X_0]} = \frac{\mathbb{E}[X_1^j]}{\mathbb{E}[X_1]} \quad(1 \le j < r), \qquad\frac{1}{\mathbb{E}[X_0]} \ge1-\eta, \qquad\frac{1}{\mathbb{E}[X_1]} \le\eta. E [ X 0 ] E [ X 0 j ] = E [ X 1 ] E [ X 1 j ] ( 1 ≤ j < r ) , E [ X 0 ] 1 ≥ 1 − η , E [ X 1 ] 1 ≤ η . Here C C C depends only on η \eta η .
Proof of Lemma 5.3. Let d = r − 2 d = r-2 d = r − 2 , B = ⌈ 2 / η ⌉ B = \lceil2/\eta\rceil B = ⌈ 2/ η ⌉ , and A = 1 + ⌈ 16 B r 2 / η ⌉ ≤ 48 r 2 / η 2 A = 1+\lceil16Br^2/\eta\rceil\le48r^2/\eta^2 A = 1 + ⌈ 16 B r 2 / η ⌉ ≤ 48 r 2 / η 2 . Define
E d = min q : deg q ≤ d max a ∈ [ A ] ∣ a − 1 − q ( a ) ∣ ≤ 1 2 . E_d = \min_{\substack{q:\deg q \le d}} \max_{a \in[A]} |a^{-1} - q(a)| \le\frac{1}{2}. E d = q : d e g q ≤ d min a ∈ [ A ] max ∣ a − 1 − q ( a ) ∣ ≤ 2 1 .
The bound E d ≤ 1 / 2 E_d \le1/2 E d ≤ 1/2 follows by choosing the constant polynomial q ( a ) = 1 / 2 q(a) = 1/2 q ( a ) = 1/2 . A polynomial q q q with degree at most d d d that minimizes the above satisfies ∣ q ( a ) ∣ ≤ a − 1 + E d ≤ 3 / 2 < 2 |q(a)| \le a^{-1} + E_d \le3/2 < 2 ∣ q ( a ) ∣ ≤ a − 1 + E d ≤ 3/2 < 2 for a ∈ [ A ] a \in[A] a ∈ [ A ] . Applying Lemma 3.2 to q ( 1 + z ) / 2 q(1+z)/2 q ( 1 + z ) /2 , with keeping only the constant Taylor term, and comparing the approximation errors at 1 1 1 and B B B , gives us
∣ q ( 1 ) − q ( B ) ∣ ≤ 8 ( B − 1 ) d 2 A − 1 ≤ η 2 , \lvert q(1)-q(B)\rvert\le\frac{8(B-1)d^{2}}{A-1} \le\frac{\eta}{2}, ∣ q ( 1 ) − q ( B )∣ ≤ A − 1 8 ( B − 1 ) d 2 ≤ 2 η ,
2 E d ≥ 1 − 1 B − ∣ q ( 1 ) − q ( B ) ∣ ≥ 1 − η . 2E_d \ge1-\frac{1}{B}-\lvert q(1)-q(B)\rvert\ge1-\eta. 2 E d ≥ 1 − B 1 − ∣ q ( 1 ) − q ( B )∣ ≥ 1 − η .
Let us write q q q in the monomial basis, now taking the linear programming dual of the constraints ∣ a − 1 − q ( a ) ∣ ≤ t \lvert a^{-1}-q(a)\rvert\le t ∣ a − 1 − q ( a )∣ ≤ t , we have
E d = max u , v ∈ R ≥ 0 A ∑ a = 1 A u a − v a a E_d=\max_{u,v\in\mathbb{R}_{\geq0}^{A}} \sum_{a=1}^{A}\frac{u_a-v_a}{a} E d = u , v ∈ R ≥ 0 A max a = 1 ∑ A a u a − v a
subject to
∑ a = 1 A ( u a + v a ) = 1 , \sum_{a=1}^{A}(u_a+v_a)=1, a = 1 ∑ A ( u a + v a ) = 1 ,
∑ a = 1 A ( u a − v a ) a j = 0 ( 0 ≤ j ≤ d ) . \sum_{a=1}^{A}(u_a-v_a)a^j=0 \qquad(0\leq j\leq d). a = 1 ∑ A ( u a − v a ) a j = 0 ( 0 ≤ j ≤ d ) .
For an optimal solution, the j = 0 j=0 j = 0 constraint implies that ∑ a u a = ∑ a v a = 1 / 2 \sum_a u_a=\sum_a v_a=1/2 ∑ a u a = ∑ a v a = 1/2 . Hence ν 0 ( a ) = 2 u a \nu_0(a)=2u_a ν 0 ( a ) = 2 u a and ν 1 ( a ) = 2 v a \nu_1(a)=2v_a ν 1 ( a ) = 2 v a are probability distributions with matching moments through degree d d d . For θ b : = ∑ a ν b ( a ) / a \theta_b:=\sum_a \nu_b(a)/a θ b := ∑ a ν b ( a ) / a , the objective gives θ 0 − θ 1 = 2 E d ≥ 1 − η \theta_0-\theta_1=2E_d\geq1-\eta θ 0 − θ 1 = 2 E d ≥ 1 − η . Since 0 < θ b ≤ 1 0<\theta_b\leq1 0 < θ b ≤ 1 , we have θ 0 ≥ 1 − η \theta_0\geq1-\eta θ 0 ≥ 1 − η and θ 1 ≤ η \theta_1\leq\eta θ 1 ≤ η . Define
Pr [ X b = a ] = ν b ( a ) a θ b . \Pr[X_b=a]=\frac{\nu_b(a)}{a\theta_b}. Pr [ X b = a ] = a θ b ν b ( a ) .
Then E [ X b ] = 1 / θ b \mathbb{E}[X_b]=1/\theta_b E [ X b ] = 1/ θ b and E [ X b j ] / E [ X b ] = ∑ a ν b ( a ) a j − 1 \mathbb{E}[X_b^j]/\mathbb{E}[X_b]=\sum_a \nu_b(a)a^{j-1} E [ X b j ] / E [ X b ] = ∑ a ν b ( a ) a j − 1 , proving the claims.