Introduction
TFNP is the class of total search problems in NP, those for which solutions always exist and can be efficiently verified. TFNP is studied through its subclasses, each capturing a principle of totality . The smallest, FP, consists of the total problems solvable in polynomial time; every other subclass is defined by reduction to a canonical complete problem. Four well-studied classes are PPP, PWPP, PLS and PPAD. In PPP, for the pigeonhole principle [60 ] , the complete problem is to find a collision C ( x ) = C ( x ′ ) C(x)=C(x') C ( x ) = C ( x ′ ) of a circuit C : [ 2 n ] → [ 2 n − 1 ] C:[2^n]\to[2^n-1] C : [ 2 n ] → [ 2 n − 1 ] . PWPP, for the weak pigeonhole principle [Jeř16], has the same complete problem but now, C : [ 2 n ] → [ 2 n − 1 ] C:[2^n]\to[2^{n-1}] C : [ 2 n ] → [ 2 n − 1 ] has twice as many inputs as outputs. The third, PLS, captures local search [43 ] : given a monotonically increasing function f : [ 2 n ] → [ 2 n ] f:[2^n]\to[2^n] f : [ 2 n ] → [ 2 n ] , find a point at which it does not increase. Finally, PPAD captures the hardness of finding a Nash equilibrium in bimatrix games [23 , 16 ] , although the original complete problem rests on a parity argument on directed graphs [60 ] . Formal definitions are in Section A.
TFNP hardness and cryptography. The theory of total search problems studies under what conditions TFNP subclasses are hard , or hard on average , as evidence for the computational intractability of total problems such as finding a Nash equilibrium. It is unlikely that NP-hardness alone will suffice: if TFNP contains an NP-hard problem, then NP = co-NP [59 ] . Over the past decade, researchers have studied cryptographic assumptions as a source of hardness for TFNP. Conversely, this maps to studying which total problems are hard in each of Impagliazzo’s “worlds” [37 ] . All cryptographic assumptions trivially imply the hardness of NP, and are believed to in fact imply more, e.g. hardness of some NP-intermediate classes. TFNP is a candidate for such a class.
The main line of work in this field has centered on proving UEoPL average-case hardness from strong cryptographic assumptions, i.e. in the higher worlds. UEoPL [27 ] is the lowest of the standard TFNP subclasses: it is contained in every class mentioned so far. Average-case hardness of UEoPL was first shown from indistinguishability obfuscation [13 ] (see also [5 ] ), that is, in Obfustopia, and later from public-key assumptions [31 , 55 , 50 , 41 BCH+22, 46 , 18 ] , that is, in Cryptomania.
In Minicrypt, the world where one-way functions (OWFs) exist but no public-key assumptions hold, TFNP itself is hard on average, either non-uniformly or under an additional derandomization assumption [35 ] . However, no problem in any of its standard subclasses is known to be hard in Minicrypt, not even in the worst case, whereas the stronger assumptions above give average-case hardness of UEoPL, the most structured class of all. Barriers against restricted black-box constructions suggest that OWFs may not suffice [RSS21, HKKS20, FGH+24].
The random oracle model. Is public-key cryptography necessary? A natural starting point for this question is the random oracle model (ROM) [14 ] , a setting often studied in cryptography when OWFs appear to be insufficient. Briefly, in the ROM, all parties (instance samplers, solvers, verifiers, etc.) have query-access to a randomly sampled function (see § 3.1 for a complete definition). A random function is itself one-way, so morally, the ROM “contains” Minicrypt. On the other hand, public-key cryptography cannot be built in the ROM in a black-box way [39 ] (and hence not from OWFs either). The world with a random oracle, which we call Romantica ♡, therefore sits roughly between Minicrypt and Cryptomania.1 A natural question is whether TFNP or its subclasses are hard in Romantica. Hardness in Romantica means an efficient sampler with oracle access whose output instances, which may contain oracle gates, no poly-time solver with the same oracle can solve. The three TFNP-subclasses were previously known to be hard on average in Romantica: PPP and PWPP (whose hard distributions are simple), as well as PLS, which requires a non-trivial construction based on proofs of sequential work [7 ] . If moreover #SAT is hard, then UEoPL, and hence every class above it, is hard on average in Romantica [19 BCH+22] . Whether any other subclass, in particular PPAD, UEoPL, PPA or EoPL, is hard in Romantica without additional assumptions has been open until now.
Our results
We resolve, for every standard TFNP subclass, whether it is hard on average in Romantica; Figure 1 summarizes the results. Overall we show: PPAD is hard on average, and hence so is EoPL = PPAD ∩ \cap ∩ PLS, whereas UEoPL collapses to FP in the black-box sense: a solver making polynomially many oracle-queries exists. Finally, we initiate the study of separations between TFNP subclasses in Romantica: neither PWPP nor PPA reduces to PLS under public-coin reductions. We now state these results more fully in turn.
Figure 1. Separations, inclusions, and equivalences in the ROM (Romantica ), red arrows are average-case separations and are the results of this paper. Average-case hardness is equivalent to average-case separation from FP.
Theorem (Theorem 1, Informal). PPAD is hard on average in the random oracle model. The hard distribution is efficiently samplable, and any solver making polynomially many oracle queries finds a solution with negligible probability.
The proof modifies the Yamakawa–Zhandry hypergraph [YZ24], originally used to separate quantum from classical query algorithms, so that the search problem becomes total while remaining hard; see § 3.2 . Theorem 1 and the known hardness of PLS [7 ] imply, via a simple or-composition, average-case hardness of PLS ∩ \cap ∩ PPAD. This intersection equals EoPL [25 , 28 ] , the class of problems reducible to finding the end of a potential line [27 ] .
Corollary (Corollary 14, Informal). PPAD ∩ \cap ∩ PLS = EoPL is hard on average in the random oracle model.
Since PPA ⊇ \supseteq ⊇ PPAD, every class in Figure 1 except UEoPL is now known to be hard on average in Romantica. The remaining question is whether UEoPL, the lowest widely studied non-trivial TFNP subclass (and in particular a subclass of EoPL = PPAD ∩ \cap ∩ PLS), is also hard on average in Romantica. We answer this essentially in the negative , highlighting a key structural difference between UEoPL and EoPL with respect to random oracles:
Theorem (Theorem 15, Informal). In the random oracle model, given any poly-time samplable distribution over instances of UEoPL, there exists an algorithm that finds solutions with probability ≥ 2 / 3 \ge2/3 ≥ 2/3 and uses at most polynomially many queries to the random oracle.
Theorem 15 concerns query efficiency, not time efficiency: the solver makes polynomially many oracle queries, but its computation need not be efficient. Indeed, as mentioned previously, UEoPL is known to be hard on average in Romantica with the additional assumption that #SAT is hard on average [19 ] . This suggests that in Romantica, a computational assumption is necessary (and sufficient) to establish UEoPL-hardness. The proof rests on a recent dichotomy lemma [3 ] ; see § 3.3 .
To our knowledge, all previous average-case hardness results for PPAD and EoPL establish hardness of UEoPL and inherit it by containment. In Romantica, Theorem 15 rules out this route, so Theorem 1 is the first PPAD hardness result that does not go through UEoPL.
Finally, we also initiate the study of separations between different TFNP subclasses in Romantica: PWPP and PPA, the class for parity arguments on undirected graphs [60 ] , cannot be reduced to PLS under public reductions , whose only randomness is the random oracle itself:
Theorem (Theorem 36, Informal). In the random oracle model, there is no efficient public reduction from a PWPP-complete problem to a PLS-complete problem.
Theorem (Theorem 39, Informal). In the random oracle model, there is no efficient public reduction from a PPA-complete problem to a PLS-complete problem.
Our proofs reduce these separations to proof-complexity lower bounds; see § 3.4 . This step relies on the reductions being public. The oracle is visible to the solver of the target problem, so a public reduction hides nothing from the solver, who may choose which solution to return with full knowledge of the reduction. A private-coin reduction may in addition toss coins hidden from the solver, which may help the reduction. Separating TFNP subclasses in Romantica under private-coin reductions remains open, as do separations between other pairs of subclasses.
A proof-complexity perspective. Black-box TFNP subclasses correspond exactly to proof systems [BIK+96, BFI23, GHJ+22], and passing to the random oracle model, a reduction may now fail on a small fraction of oracles. From the proof side, this corresponds to proofs that are approximately sound , meaning that they are correct on all but a small fraction of uniformly random inputs. In particular, a ROM reduction to PLS is a narrow random resolution refutation with respect to a locally samplable distribution (see § 6 ) so Theorems 36 and 39 are lower bounds for approximately sound proofs. We note that for stronger proof systems such as bounded-depth Frege systems, a recurring issue is how to define approximate soundness in a meaningful way. Note that for any Frege proof (even of low depth) of a tautology, every line in the proof is semantically equivalent to “1” so any useful notion of an approximate proof must incorporate the local nature of the rules in order to avoid this pitfall.
More generally lower bounds for approximate proofs have many applications outside of cryptography: (i) they underlie lower bounds on the extension complexity of LP and SDP relaxations for approximating NP-hard problems; (ii) they are the object of study in random resolution, with applications to theories of approximate counting; (iii) they are exactly the missing ingredient in the Razborov–Smolensky approach to A C 0 [ p ] \mathrm{AC}^{0}[p] AC 0 [ p ] -Frege lower bounds that motivated the introduction of Nullstellensatz and Polynomial Calculus; and (iv) they are the mirror image of the algorithmic problem of refuting random 3SAT, which reduces to certifying that a random 3XOR instance is highly unsatisfiable. We discuss the first three connections in § 2.2 .
Related work
Average-case TFNP and cryptography
Unconditional hardness of TFNP subclasses in Romantica. It is not hard to see that the existence of collision-resistant hash functions (CRHFs) implies the average-case hardness of the weak pigeonhole principle. Hence, the average-case hardness of PPP and PWPP in the ROM follows from the fact that CRHFs exist in the ROM. Apart from this, the only TFNP-subclass that is known to be hard (and in fact, average-case hard) prior to our work is PLS [7 ] . Their result is obtained by combining the construction of proofs of work in the ROM [22 ] and ideas from the Fiat–Shamir heuristics.
On the pursuit of PPAD hardness. Showing hardness of PPAD in the ROM has been a long-standing open problem. Prior to our work, the best known results were conditional hardness for UEoPL (and hence PPAD) which, in addition to the random oracle, involved a complexity-theoretic assumption like #SAT being hard on average [19 Theorem 2] , or hardness of EoPL from the iterated squaring assumption [20 ] . As mentioned previously, this does not contradict our new UEoPL upper-bound since Theorem 15 only proves a query -complexity upper bound (i.e., a black-box upper-bound); the algorithm we give is not computationally efficient in the white-box sense. Theorem 1 is proved in a very different way compared to previous conditional hardness results. [19 Theorem 2] is proved by applying Fiat-Shamir to the sum-check protocol for # S A T \#\mathrm{SAT} # SAT . It is worth noting that several works have studied the instantiation of the Fiat-Shamir heuristics using concrete cryptographic hash functions, obtaining conditional hardness of PPAD in the plain model (see, e.g., [55 , 41 BCH+22, 46 , 18 ] ). It remains an open problem whether one can replace the random oracle model in Theorem 1 with well-studied cryptographic assumptions; black-box hardness does not translate into white-box hardness in general [49 ] .
Average-case TFNP and proof complexity
Proof complexity and black-box TFNP classes are intimately connected: each T F N P d t \mathrm{TFNP}^{\mathrm{dt}} TFNP dt subclass is characterized by a proof system [6 ] , with PLS corresponding to resolution width [BKT14, Kam19], PPA to Nullstellensatz over F 2 \mathbb{F}_2 F 2 [30 ] , and PPAD to unary Nullstellensatz [29 ] .
When extending these equivalences to the ROM, the relevant new feature is error, which we model by a low-width “advice” DNF B B B which is satisfied with probability at most 1 / 3 1/3 1/3 over the instance distribution ω ( u ) \omega(u) ω ( u ) induced by the uniformly random oracle u u u . In particular, a ROM reduction from some problem F F F to PLS becomes a narrow resolution refutation of F ∨ B F \vee B F ∨ B for an appropriate choice of B B B satisfying the aforementioned properties. This is closely related to “random resolution width” of [BKT14], and more generally to the notion of randomized reductions in TFNP [26 ] . The key distinction is that in our case, the distribution ω ( u ) \omega(u) ω ( u ) must be samplable by a low depth decision tree from a random oracle (i.e. a string of random independent bits); this is a significant restriction and rules out many candidate “hard distributions” one may attempt to use to prove a lower bound.
Our separations are thus lower bounds for approximately sound proofs. We briefly survey three settings in which such proofs arise.
Extension complexity. Lower bounds on the size of LP and SDP relaxations for approximating CSPs [21 , 54 , 47 ] convert, via query-to-communication lifting, a small relaxation into a low-degree Sherali–Adams or Sum-of-Squares certificate. The extracted certificate is correct only up to a small error, measured on average over assignments, which is absorbed into the approximation guarantee. At the core of such a result is therefore a degree lower bound for approximate low-degree refutations of a particular gap statement.
Random resolution. Random resolution, defined in [BKT14] following a suggestion of Dantchev, formalizes resolution refutations that may err on a small fraction of assignments; it arose as the propositional counterpart of Jeřábek’s theories of approximate counting. The first lower bounds for random resolution were obtained for the colored polynomial local search principle CPLS, and for the pigeonhole principle [61 , 52 ] .
The relation to the random oracle model is as follows. A ROM reduction from a totality principle F F F to PLS produces a narrow resolution refutation of F F F together with advice that is correct with high probability over the instance distribution ω ( u ) \omega(u) ω ( u ) , where u u u is the uniformly random oracle and ω \omega ω is a forest of shallow decision trees. That is, a ROM reduction to PLS is a narrow random resolution refutation with respect to a locally samplable distribution, and a ROM lower bound against PLS is a random resolution lower bound over that particular distribution. The converse does not always hold. For example, the previously established lower bounds for random resolution [61 , 52 ] yield distributions that are hard for random resolution, but these distributions are not known to be locally samplable from uniform bits, so they do not imply ROM separations. Separations between TFNP subclasses under deterministic black-box reductions are well understood [2 Mór01, 12 , 36 , 30 , 15 , 29 ] . Similarly the randomized separations between pairs of TFNP subclasses in [Li24, JLRX24, Kis26], and the oracle separations of the multi-collision classes in [48 ] , do not apply to the ROM. In contrast, Bitansky and Gerichter Bitansky and Gerichter [7 ] obtained a ROM separation of PLS from FP; that is, they constructed a distribution over PLS instances that is efficiently samplable from a uniformly random oracle, but that is hard for FP. Similarly we obtain the following ROM separations: (i) PWPP vs. PLS (Theorem 36), (ii) PPA vs. PLS (Theorem 39) and (iii) EoPL vs. FP (Corollary 14).
AC0 ^{0} 0 [p p p ]-Frege and the Razborov–Smolensky method. Nullstellensatz [BIK+96] and Polynomial Calculus [17 ] were introduced in large part to obtain an analogue, for AC0 ^{0} 0 [p p p ]-Frege, of the Razborov–Smolensky method [62 Smo87] , which replaces each gate of a circuit by a low-degree polynomial over F p \mathbb{F}_p F p agreeing with it on most inputs. Applied to a proof, the method replaces each line by a low-degree polynomial correct on most assignments, yielding an approximately sound low-degree algebraic refutation. [BIK+97] made this precise: AC0 ^{0} 0 [p p p ]-Frege lower bounds follow from degree lower bounds for Nullstellensatz over F p \mathbb{F}_p F p with extension axioms formalizing the approximation step, axioms that are sound only with high probability over a random choice of auxiliary variables. Strong degree lower bounds for the exact systems followed [BIK+96, Raz98, IPS99, BGIP01], and these underlie the Nullstellensatz characterizations of PPA and PPAD used in this paper; the robust half of the program is what remains open.
Techniques
We overview the techniques behind our results. § 3.1 recalls the decision-tree formulation of the random oracle model used throughout. § 3.2 sketches the proof of PPAD hardness (Theorem 1), § 3.3 the UEoPL algorithm (Theorem 15), and § 3.4 the separations from PLS (Theorems 36 and 39).
TFNP in the ROM briefing
In the cryptographic formulation, a TFNP problem in the ROM is specified by a verifier , a polynomial-time algorithm with oracle access that, given an instance and a candidate solution, decides whether the candidate is a solution; totality means that every instance has at least one solution. An instance is a circuit C C C with oracle gates mapping { 0 , 1 } poly ( n ) \{0,1\}^{\operatorname{poly}(n)} { 0 , 1 } poly ( n ) to Σ \Sigma Σ , with ∣ Σ ∣ ≤ 2 poly ( n ) |\Sigma| \le2^{\operatorname{poly}(n)} ∣Σ∣ ≤ 2 poly ( n ) . The problem is hard on average if some efficient sampler with oracle access outputs instances that no polynomial-time solver with oracle access solves with probability 2 / 3 2/3 2/3 over the oracle. We view the oracle as a random string u ∈ { 0 , 1 } N u \in\{0,1\}^{N} u ∈ { 0 , 1 } N . Let the truth table of C C C be x ∈ Σ N x \in\Sigma^{N} x ∈ Σ N , N = 2 poly ( n ) N = 2^{\operatorname{poly}(n)} N = 2 poly ( n ) . Then for a fixed oracle u u u , each entry of x x x is one evaluation of C C C , which reads poly ( n ) = polylog ( N ) \operatorname{poly}(n) = \operatorname{polylog}(N) poly ( n ) = polylog ( N ) bits of u u u , and checking a candidate solution means evaluating C C C at a few points. Please see Appendix § 11 for a formal definition of the cryptographic formulation of the ROM model.
Note that only these query counts matter for our lower bound proofs, which leads to the following decision-tree formulation , used throughout the paper. A TFNP d t \operatorname{TFNP}^{\mathrm{dt}} TFNP dt problem S ⊆ Σ N × O S \subseteq\Sigma^{N} \times\mathcal{O} S ⊆ Σ N × O , with ∣ O ∣ ≤ 2 polylog ( N ) |\mathcal{O}| \le2^{\operatorname{polylog}(N)} ∣ O ∣ ≤ 2 polylog ( N ) , that is total and such that for every o ∈ O o \in\mathcal{O} o ∈ O the predicate ( x , o ) ∈ S (x,o) \in S ( x , o ) ∈ S is decided by a decision tree of depth polylog ( N ) \operatorname{polylog}(N) polylog ( N ) over x x x . An instance distribution is a forest ω = ( ω 1 , … , ω N ) \omega= (\omega_1,\ldots,\omega_N) ω = ( ω 1 , … , ω N ) of decision trees ω i : { 0 , 1 } N → Σ \omega_i : \{0,1\}^{N} \to\Sigma ω i : { 0 , 1 } N → Σ of depth polylog ( N ) \operatorname{polylog}(N) polylog ( N ) , mapping the oracle u u u to the instance ω ( u ) ∈ Σ N \omega(u) \in\Sigma^{N} ω ( u ) ∈ Σ N . A solver is a decision tree A : { 0 , 1 } N → O A : \{0,1\}^{N} \to\mathcal{O} A : { 0 , 1 } N → O .
We say that S ∈ F P S \in\mathrm{FP} S ∈ FP in the black-box ROM if for every decision forest ω \omega ω there is a solver A A A of depth polylog ( N ) \operatorname{polylog}(N) polylog ( N ) with
Pr u ∼ { 0 , 1 } N [ ( ω ( u ) , A ( u ) ) ∈ S ] ≥ 2 / 3 , \Pr_{u \sim\{0,1\}^{N}}[(\omega(u), A(u)) \in S] \ge2/3, u ∼ { 0 , 1 } N Pr [( ω ( u ) , A ( u )) ∈ S ] ≥ 2/3 ,
and that S S S is hard on average in Romantica otherwise. A polynomial-time solver with oracle access makes polynomially many queries, so it is a solver of depth polylog ( N ) \operatorname{polylog}(N) polylog ( N ) , and black-box hardness implies hardness in the cryptographic formulation.
Since ω \omega ω is itself a shallow forest over u u u , it can be absorbed into the problem: S ′ = { ( u , o ) ∣ ( ω ( u ) , o ) ∈ S } S' = \{(u,o) \mid(\omega(u),o) \in S\} S ′ = {( u , o ) ∣ ( ω ( u ) , o ) ∈ S } is again a TFNP d t \operatorname{TFNP}^{\mathrm{dt}} TFNP dt problem, now over the oracle string. Throughout the paper the instance is therefore the oracle itself, and for convenience we take u ∼ Σ N u \sim\Sigma^{N} u ∼ Σ N .2
PPAD lower bound
Consider the following search problem template: given a large hypergraph with a labeling of the vertices, find an edge whose vertex labels satisfy a constraint. This yields a search problem for every choice of hypergraph and constraint. For several simple choices of the two, it is easy to show that the problem is total , but then it is also easy to solve. Our proof takes the Yamakawa–Zhandry hypergraph , originally used to separate quantum and classical algorithms [YZ24]. The constraint part of their search problem does not guarantee totality, but the search problem is hard for classical algorithms. The key idea is to tweak their construction, which sits at the hard-but-not-total end of this spectrum, toward the total-but-easy end, stopping at a problem that is total (in fact, in PPAD) while still hard.
Which class the resulting problem lands in is determined by how its totality is proved. We first show hardness-on-average in Romantica of the class PPA, for parity arguments , which contains the subclass PPAD. We then refine the construction to obtain a hard-on-average problem in PPAD. Informally, problems in PPA are exactly the problems whose totality can be proven by an efficient parity argument, and the problems in PPAD are the ones whose totality can be proven by an efficient signed counting argument. In our construction, these arguments simply sum local constraints modulo 2 or over Z \mathbb{Z} Z with signs ± 1 \pm1 ± 1 , respectively. These connections have been made formal in [30 ] and [29 ] respectively. The corresponding polynomial refutations must have suitably bounded degree and size, with coefficients measured in unary over Z \mathbb{Z} Z ; the formal proof verifies these bounds and provides efficient pairings witnessing the cancellations. In this exposition, we suppress these efficiency requirements, making the task:
Find a problem that is hard on average given random access to a uniformly random string, and whose totality can be proven by counting in F 2 \mathbb{F}_2 F 2 (for PPA) or Z \mathbb{Z} Z (for PPAD).
PPA worst-case hardness. A canonical PPA problem is finding a falsified equation in an unsatisfiable system of linear equations over F 2 \mathbb{F}_2 F 2 . Let N = 2 n N = 2^n N = 2 n , and let x 1 , … , x N x_1,\ldots,x_N x 1 , … , x N be the variables of the system. We identify each equation ∑ v ∈ e x v = 1 \sum_{v\in e} x_v = 1 ∑ v ∈ e x v = 1 (over F 2 \mathbb{F}_2 F 2 ) with a hyperedge e ⊆ [ N ] e \subseteq[N] e ⊆ [ N ] , and an evaluation x ∈ { 0 , 1 } N x \in\{0,1\}^N x ∈ { 0 , 1 } N of all N N N variables with a binary labeling of the nodes of a hypergraph G = ( [ N ] , E ) G = ([N],E) G = ([ N ] , E ) . Given any hypergraph G G G with edges of size ∣ e ∣ ≤ poly ( n ) |e| \le\operatorname{poly}(n) ∣ e ∣ ≤ poly ( n ) and an efficiently-accessible labeling of its nodes, we obtain the following NP-relation:
L i n G : = { ( x , e ) | ∑ v ∈ e x v = 0 } (1) \mathrm{Lin}_G := \left\{(x,e)\ \middle|\ \sum_{v\in e} x_v = 0\right\} \tag*{(1)} Lin G := { ( x , e ) v ∈ e ∑ x v = 0 } (1)
Of course, this NP-relation is only total if we can guarantee the unsatisfiability of the linear system. One way is to enforce that each node v ∈ [ N ] v \in[N] v ∈ [ N ] is contained in an even number (at most poly ( n ) \operatorname{poly}(n) poly ( n ) ) of hyperedges, and that the number of hyperedges ∣ E ∣ |E| ∣ E ∣ is odd . Then, one can show that the problem lies in PPA.
However, these conditions do not make the problem LinG _G G hard, even in the worst-case (e.g. G G G can be an odd cycle). Previous work has shown that worst-case hardness holds if G G G has strong expansion properties [Tse70, Urq87]. However, it is not clear how to extend this to average-case hardness; for instance, if the labeling x ∼ { 0 , 1 } N x \sim\{0,1\}^N x ∼ { 0 , 1 } N is sampled uniformly (a distribution that can be easily realized in the ROM), then finding a solution of ( ⋆ ) (\star) ( ⋆ ) is easy for every G G G : any edge is going to be a solution with probability 1 / 2 1/2 1/2 .
Yamakawa–Zhandry problem. Our second key ingredient is an NP-search problem defined by Yamakawa and Zhandry [YZ24] in order to separate quantum and classical algorithms for search problems in the ROM. Let G = ( [ N ] , E ) G = ([N],E) G = ([ N ] , E ) be a fixed hypergraph with E ⊆ ( [ N ] ℓ ) E \subseteq\binom{[N]}{\ell} E ⊆ ( ℓ [ N ] ) , where ℓ = poly ( n ) \ell= \operatorname{poly}(n) ℓ = poly ( n ) . The generic version of the problem YamakawaZhandryG _G G is: given a labeling x ∈ { 0 , 1 } N x \in\{0,1\}^N x ∈ { 0 , 1 } N find a hyperedge e ∈ E e \in E e ∈ E such that x v = 0 x_v = 0 x v = 0 for all v ∈ e v \in e v ∈ e . Note that this is unlike the condition that makes an edge a solution in the previous section, and makes this problem very far from total. However, Yamakawa and Zhandry construct a specific hypergraph for which it is hard to find a solution given uniformly random x ∼ { 0 , 1 } N x \sim\{0,1\}^N x ∼ { 0 , 1 } N . In other words, in the previous section we saw constructions of a hypergraph and edge-condition which yielded a total problem, but solutions were easy to find for random labelings. On the other end of the spectrum, Yamakawa-Zhandry’s hypergraph and edge-condition yields a hard search problem over uniform labelings, but not all instances will have solutions.
The key property of their construction is well-spreadness : G = ( [ N ] , E ) G = ([N],E) G = ([ N ] , E ) is ( r , a , b ) (r,a,b) ( r , a , b ) -well-spread if for every set S ⊆ ( [ N ] a ) S \subseteq\binom{[N]}{a} S ⊆ ( a [ N ] ) the number of hyperedges e ∈ E e \in E e ∈ E such that ∣ e ∩ S ∣ ≥ r |e \cap S| \ge r ∣ e ∩ S ∣ ≥ r is at most b b b . Why does well-spreadness make YamakawaZhandryG _G G hard? Suppose a decision tree queried at most a a a labels in x x x . Then there are at most b b b hyperedges for which the tree queries more than r r r labels. For each of those hyperedges, consider the moment when exactly r r r labels are queried. Then the conditional probability that the remaining queries make the edge all-0 is 2 r − ℓ 2^{r-\ell} 2 r − ℓ . So if b ⋅ 2 r − ℓ ≪ 1 b \cdot2^{r-\ell} \ll1 b ⋅ 2 r − ℓ ≪ 1 , we are unlikely to discover any solution.
PPA-hard problem. One obvious issue with Yamakawa–Zhandry's G G G for us is that it is not total, e.g. the labeling x = 1 N x=1^{N} x = 1 N has no solutions. Hence we will need to modify the condition for an edge to be a solution. For the problem to additionally be in PPA, a parity argument must guarantee that at least one edge satisfies our chosen condition. For a given graph G G G , let p e : { 0 , 1 } N → { 0 , 1 } p_e:\{0,1\}^{N}\to\{0,1\} p e : { 0 , 1 } N → { 0 , 1 } be the condition verifier of e e e , i.e. p e ( x ) = 1 p_e(x)=1 p e ( x ) = 1 iff e e e is a solution for x x x . One way to guarantee totality is to choose p e p_e p e such that
∑ e ∈ E p e ( x ) ≡ 1 ( m o d 2 ) . \sum_{e\in E}p_e(x)\equiv1\pmod2. e ∈ E ∑ p e ( x ) ≡ 1 ( mod 2 ) .
As witnessed by Lin, a choice of condition p e = 1 + ∑ v ∈ e x v p_e=1+\sum_{v\in e}x_v p e = 1 + ∑ v ∈ e x v over F 2 \mathbb{F}_2 F 2 satisfies the equation above (i.e. yields a total problem) whenever every node is contained in an even number of hyperedges and the total number of edges is odd. However, as we also discussed, Pr [ p e ( x ) = 1 ] = 1 / 2 \Pr[p_e(x)=1]=1/2 Pr [ p e ( x ) = 1 ] = 1/2 , so even if G G G is well-spread, finding the solution will be easy.
There is a natural fix for that: suppose that instead of binary labels, we used labels x 1 , … , x N ∈ { 0 , 1 } r x_1,\ldots,x_N\in\{0,1\}^r x 1 , … , x N ∈ { 0 , 1 } r , and we set p e ( x ) = ⟦ ⨁ v ∈ e x v = 0 r ⟧ p_e(x)=\llbracket\bigoplus_{v\in e}x_v=0^r\rrbracket p e ( x ) = [ [ ⨁ v ∈ e x v = 0 r ] ] . Then over a uniformly-random labeling, Pr [ p e ( x ) = 1 ] = 2 − r \Pr[p_e(x)=1]=2^{-r} Pr [ p e ( x ) = 1 ] = 2 − r , so for every well-spread G G G finding e e e with p e ( x ) = 1 p_e(x)=1 p e ( x ) = 1 is hard.
In order to see what is needed from G G G to make the problem total, it is convenient to plant a forbidden solution. Take e ∗ ∈ E e^*\in E e ∗ ∈ E and fix all its labels to 0 r 0^r 0 r , then forbid e ∗ e^* e ∗ as a solution. That makes the condition on the hypergraph G G G we need more convenient: ∑ e ∈ E p e ( x ) ≡ 0 ( m o d 2 ) \sum_{e\in E}p_e(x)\equiv0\pmod2 ∑ e ∈ E p e ( x ) ≡ 0 ( mod 2 ) . Since p e ∗ ( x ) = 1 p_{e^*}(x)=1 p e ∗ ( x ) = 1 , this gives ∑ e ≠ e ∗ p e ( x ) ≡ 1 ( m o d 2 ) \sum_{e\ne e^*}p_e(x)\equiv1\pmod2 ∑ e = e ∗ p e ( x ) ≡ 1 ( mod 2 ) , guaranteeing a non-forbidden solution. To see what we need from G G G , write p e p_e p e as a polynomial in the bits of the labels; the target expression becomes
∑ e ∈ E ∏ i ∈ [ r ] ( 1 + ∑ v ∈ e x v , i ) ≡ 0 ( m o d 2 ) . \sum_{e\in E}\prod_{i\in[r]}\left(1+\sum_{v\in e}x_{v,i}\right)\equiv0\pmod2. e ∈ E ∑ i ∈ [ r ] ∏ ( 1 + v ∈ e ∑ x v , i ) ≡ 0 ( mod 2 ) .
Expanding the brackets we get that the coefficient of monomial x v 1 , i 1 ⋯ x v k , i k x_{v_1,i_1}\cdots x_{v_k,i_k} x v 1 , i 1 ⋯ x v k , i k , with distinct bit coordinates i 1 , … , i k i_1,\ldots,i_k i 1 , … , i k , is the number of edges containing { v 1 , … , v k } \{v_1,\ldots,v_k\} { v 1 , … , v k } modulo 2. That gives us a sufficient condition on the hypergraph: we say that G = ( [ N ] , E ) G=([N],E) G = ([ N ] , E ) is r r r -even if for every S ∈ ( [ N ] ≤ r ) S\in\binom{[N]}{\le r} S ∈ ( ≤ r [ N ] ) the number of edges e ⊇ S e\supseteq S e ⊇ S is even. S = ∅ S=\varnothing S = ∅ ensures cancellation of the constant term. In § 4.4 , we show that a variant of the Yamakawa–Zhandry hypergraph is r r r -even for r = Θ ( ℓ ) r=\Theta(\ell) r = Θ ( ℓ ) .
PPAD-hard problem. To obtain a problem in PPAD, we replace the parity argument above with an integer cancellation argument. The input to the new hyperedge-search problem is a labeling x ∈ ( [ r ] ∪ { ⊥ } ) N x\in([r]\cup\{\perp\})^N x ∈ ([ r ] ∪ { ⊥ } ) N , where ⊥ \perp ⊥ is a void label that we do not count. We fix all labels on the distinguished edge e ∗ e^* e ∗ to ⊥ \perp ⊥ and again forbid e ∗ e^* e ∗ as a solution. The polynomial formulation of this problem has essentially the same structure:
p e : = ∏ i ∈ [ r ] ( 1 − ∑ v ∈ e ⟦ x v = i ⟧ ) . p_e:=\prod_{i\in[r]}\left(1-\sum_{v\in e}\llbracket x_v=i\rrbracket\right). p e := i ∈ [ r ] ∏ ( 1 − v ∈ e ∑ [ [ x v = i ] ] ) .
Thus, p e ( x ) ≠ 0 p_e(x)\ne0 p e ( x ) = 0 iff every non-⊥ \perp ⊥ label occurring on e e e occurs at least twice. The values of p e p_e p e are now integers rather than solution indicators. We choose signs ε e ∈ { ± 1 } \varepsilon_e\in\{\pm1\} ε e ∈ { ± 1 } so that ∑ e ∈ E ε e p e ≡ 0 \sum_{e\in E}\varepsilon_ep_e\equiv0 ∑ e ∈ E ε e p e ≡ 0 . In the expansion, the coefficient of a degree-k k k indicator monomial on distinct vertices S = { v 1 , … , v k } S=\{v_1,\ldots,v_k\} S = { v 1 , … , v k } and distinct labels is ( − 1 ) k ∑ e ⊇ S ε e (-1)^k\sum_{e\supseteq S}\varepsilon_e ( − 1 ) k ∑ e ⊇ S ε e , for 0 ≤ k ≤ r 0\le k\le r 0 ≤ k ≤ r ; terms assigning different labels to the same vertex vanish. Hence, it suffices to require that for every S ∈ ( [ N ] ≤ r ) S\in\binom{[N]}{\le r} S ∈ ( ≤ r [ N ] ) , including the empty set, the signs of the edges containing S S S sum to zero. We show in § 4.4 that the Yamakawa–Zhandry hypergraph admits such signing.
Since all labels on e ∗ e^* e ∗ are ⊥ \perp ⊥ , we have p e ∗ ( x ) = 1 p_{e^*}(x)=1 p e ∗ ( x ) = 1 . Normalizing the signing so that ε e ∗ = 1 \varepsilon_{e^*}=1 ε e ∗ = 1 and removing this planted contribution gives
− ∑ e ∈ E ∖ { e ∗ } ε e p e ( x ) = 1. -\sum_{e\in E\setminus\{e^*\}}\varepsilon_ep_e(x)=1. − e ∈ E ∖ { e ∗ } ∑ ε e p e ( x ) = 1.
At least one non-forbidden edge therefore has p e ( x ) ≠ 0 p_e(x)\ne0 p e ( x ) = 0 , proving totality via counting over integers . We make this formal in § 4.3 .
UEoPL upper bound
The problem setup. It is convenient to use the grid form of UEoPL from [29 ] . The nodes are the cells ( i , j ) (i,j) ( i , j ) of an N × N N \times N N × N grid, i i i the row. Every node has a successor pointer Succ ( i , j ) ∈ [ N ] ∪ { ⊥ } \operatorname{Succ}_{(i,j)} \in[N] \cup\{\perp\} Succ ( i , j ) ∈ [ N ] ∪ { ⊥ } , read as naming the node ( i + 1 , Succ ( i , j ) ) (i+1,\operatorname{Succ}_{(i,j)}) ( i + 1 , Succ ( i , j ) ) of the next row, and every node below row 1 has a predecessor pointer. A node is active if its successor’s predecessor points back to it: Succ ( i , j ) = k \operatorname{Succ}_{(i,j)} = k Succ ( i , j ) = k and Pred ( i + 1 , k ) = j \operatorname{Pred}_{(i+1,k)} = j Pred ( i + 1 , k ) = j (in the last row, active just means Succ ≠ ⊥ \operatorname{Succ} \ne\perp Succ = ⊥ ). If ( 1 , 1 ) (1,1) ( 1 , 1 ) is active, following successors from it traces a line that descends one row per step, so it must end at an inactive node that an active node points to (a proper sink ) or at an active node of row N N N . A solution is any of: ( 1 , 1 ) (1,1) ( 1 , 1 ) inactive; a proper sink; an active node of row N N N ; an active node other than ( 1 , 1 ) (1,1) ( 1 , 1 ) with no active predecessor; or two active nodes in the same row . The last kind is what makes this UEoPL rather than EoPL: proof of a second line is also a solution. Activity is the only notion our algorithm uses, and testing it costs at most two pointer reads.
In the random oracle model an instance is generated from the oracle u ∈ { 0 , 1 } N u \in\{0,1\}^{N} u ∈ { 0 , 1 } N by decision trees: each pointer is a tree of depth q q q over the bits of u u u . We show (Theorem 15) that there exists a decision tree of depth O ( q 5 log N ) O(q^{5}\log N) O ( q 5 log N ) , querying the bits of u u u , that outputs a solution with probability 2 / 3 2/3 2/3 over u u u , and never outputs a wrong answer. This is a black-box statement: it counts queries, not computation.
Jumping and a win-win argument. The obvious strategy is to begin at the active cell ( 1 , 1 ) (1,1) ( 1 , 1 ) in row 1, and move down one row at a time until we either reach a proper sink or an active node in the last row. The query cost is 2 q 2q 2 q queries per row, hence Θ ( q N ) \Theta(qN) Θ ( q N ) queries. To get to poly ( q ) log N \operatorname{poly}(q)\log N poly ( q ) log N queries, we jump: a jump of 2 r 2^r 2 r rows is two jumps of 2 r − 1 2^{r-1} 2 r − 1 rows. Composed naively this doubles the cost at each of the log N \log N log N levels, which is no better. The proof therefore rests on a dichotomy lemma (Lemma 16, originally proved in [3 ] ): an algorithm that finds solutions, whatever its query cost, can be collapsed either to a query-efficient one or to one that outputs two solutions . In our setting it says the following about any tree D D D , however deep, that almost always outputs an active node of a target row b b b : either there is a tree of depth O ( q 2 ) O(q^2) O ( q 2 ) , independent of the depth of D D D , that outputs an active node of row b b b with probability 1 / 2 1/2 1/2 ; or there is a tree, about twice as deep as D D D , that outputs two active nodes of row b b b , hence a solution, with probability Ω ( 1 / q ) \Omega(1/q) Ω ( 1/ q ) . The first case lets us replace the composition of two half-jumps by a tree whose depth does not grow with the level; the second ends the search.
Why the dichotomy holds. Think of each accepting leaf of the activity tree of a node y y y in row b b b as a certificate : at most 2 q 2q 2 q oracle bits that, once seen, guarantee that y y y is active. Since D D D almost always outputs an active node, almost every oracle lies in at least one certificate. Either the certificates fit together neatly, each oracle u u u lying in essentially one of them, or they do not. If they do, D D D ’s depth was never needed: a greedy procedure locates the certificate containing the oracle with O ( q 2 ) O(q^2) O ( q 2 ) queries, by repeatedly querying the bits of the candidate certificate least likely to overlap the others. If they do not, then many oracles lie in two certificates for different nodes, so they have two active nodes in row b b b , which is a solution; and the second node is not hidden, because on nearby oracles inside its certificate D D D outputs it, so running D D D once more on a slightly perturbed copy of the oracle tends to reveal it. Either way we win.
The algorithm. A subroutine Jump ( v , r ) \operatorname{Jump}(v,r) Jump ( v , r ) takes an active node v v v and tries to reach the row 2 r 2^r 2 r below. It defines , but does not run, the tree C C C that composes two half-jumps, and applies the dichotomy lemma to C C C and the activity trees of the target row. In the first case it runs the shallow tree and jumps; in the second it returns the pair-finding tree, which is as deep as two runs of C C C , all the way up the recursion, and the main loop runs it once and restarts on failure. C C C itself is run only when it is likely to produce a solution or such a tree, which ends the computation, so this happens O ( q ) O(q) O ( q ) times per level. The cost of a jump is thus linear in r r r rather than exponential, and r = ⌈ log 2 N ⌉ r = \lceil\log_2 N\rceil r = ⌈ log 2 N ⌉ levels give the bound.
Separations from PLS
The known worst-case separations from PLS are obtained by proving resolution-width lower bounds. A low-width resolution refutation can be viewed as a generalization of a low-height decision tree. In particular, let F ⊆ Σ n × O F \subseteq\Sigma^n \times\mathcal{O} F ⊆ Σ n × O be a total relation defining the search problem “given x ∈ Σ n x \in\Sigma^n x ∈ Σ n , find o ∈ O o \in\mathcal{O} o ∈ O such that ( x , o ) ∈ F (x,o) \in F ( x , o ) ∈ F .” A height-w w w decision tree solving F F F queries indices of an input x ∈ Σ n x \in\Sigma^n x ∈ Σ n adaptively for w w w rounds and determines some o ∈ O o \in\mathcal{O} o ∈ O such that ( x , o ) ∈ F (x,o) \in F ( x , o ) ∈ F . We can view this “success condition” in the following way: for each x x x , the decision tree queries x x x on w w w indices and hence at the end knows some partial assignment ρ ∈ ( Σ ∪ { ⋆ } ) n \rho\in(\Sigma\cup\{\star\})^n ρ ∈ ( Σ ∪ { ⋆ } ) n of width w w w (meaning it has w w w non-star values) which x x x extends. It must then be the case that the partial assignment ρ \rho ρ already “fixes a solution,” meaning that there exists o ρ ∈ O o_\rho\in\mathcal{O} o ρ ∈ O such that ( x ′ , o ρ ) ∈ F (x',o_\rho) \in F ( x ′ , o ρ ) ∈ F for all x ′ x' x ′ extending ρ \rho ρ .
We now describe a width-w w w resolution refutation of F F F . This is another kind of query procedure for solving F F F , which also has the property that its current “knowledge” about an input x x x can be described purely in terms of a width ≤ w \leq w ≤ w partial assignment ρ \rho ρ which x x x extends. Unlike a decision tree, a resolution refutation is permitted to run for an unbounded number of rounds; however, we require that the next query at each step, or the choice to halt and output some solution o o o , is purely a function of the current known partial assignment (and cannot depend otherwise on the history of the query procedure). To allow this process to run for more than w w w rounds, we permit the query procedure to “forget” the answers to queries it has made in the past in order to free space for the value of new queries while staying within the total budget w w w on the size of the partial assignment representing its current state. Up to increasing the width by at most 1, we may assume that whenever the current state is a partial assignment of width exactly w w w , a solution must be determined, and whenever its width is < w < w < w , a further query is made (possibly forgetting some past queries in the process). With this convention we formally define the model as follows.
Fact 1. ([BKT14, Kam19]). For any F ∈ T F N P d t F \in\mathrm{TFNP}^{\mathrm{dt}} F ∈ TFNP dt , F ∈ P L S d t F \in\mathrm{PLS}^{\mathrm{dt}} F ∈ PLS dt iff there is a width-poly( log n ) (\log n) ( log n ) pair ( F , S ) (\mathcal{F},S) ( F , S ) that solves F F F .
Definition 1. A resolution refutation of width w w w consists of a set F ⊆ ( Σ ∪ { ⋆ } ) n \mathcal{F} \subseteq(\Sigma\cup\{\star\})^n F ⊆ ( Σ ∪ { ⋆ } ) n of partial assignments together with a function S : F × Σ → F S:\mathcal{F} \times\Sigma\to\mathcal{F} S : F × Σ → F such that ⋆ n ∈ F \star^n \in\mathcal{F} ⋆ n ∈ F and for all ρ ∈ F \rho\in\mathcal{F} ρ ∈ F :
ρ \rho ρ has width at most w w w .
If ∣ ρ ∣ = w |\rho| = w ∣ ρ ∣ = w it fixes a solution : there is some o ∈ O o \in\mathcal{O} o ∈ O such that ( x , o ) ∈ F (x,o) \in F ( x , o ) ∈ F for all x ∈ Σ n x \in\Sigma^n x ∈ Σ n extending ρ \rho ρ .
If ∣ ρ ∣ < w |\rho| < w ∣ ρ ∣ < w , there is some i = i ( ρ ) ∈ [ n ] i=i(\rho) \in[n] i = i ( ρ ) ∈ [ n ] , ρ ( i ) = ⋆ \rho(i)=\star ρ ( i ) = ⋆ , such that for every a ∈ Σ a \in\Sigma a ∈ Σ , we have that S ( ρ , a ) ⊆ ρ ∪ { i ↦ a } S(\rho,a) \subseteq\rho\cup\{i \mapsto a\} S ( ρ , a ) ⊆ ρ ∪ { i ↦ a } .
Finally, there is a strict total ordering ≺ \prec ≺ on F \mathcal{F} F such that ρ ≺ S ( ρ , a ) \rho\prec S(\rho,a) ρ ≺ S ( ρ , a ) for all ρ ∈ F \rho\in\mathcal{F} ρ ∈ F with ∣ ρ ∣ < w |\rho| < w ∣ ρ ∣ < w and a ∈ Σ a \in\Sigma a ∈ Σ .
In the terminology of our previously described query procedure, F \mathcal{F} F is the set of allowable “states” (partial assignments), and S S S maps each non-terminal state to its successor based on the value of a query. The acyclicity condition is in fact a strict strengthening of the requirement that the query process reaches a terminal state and outputs a solution on every input; we require this termination condition to be enforced “syntactically” over the transition operations. The connection to PLS is given as follows:
With this perspective we can easily describe the classical separation P P P d t ⊈ P L S d t \mathrm{PPP}^{\mathrm{dt}} \not\subseteq\mathrm{PLS}^{\mathrm{dt}} PPP dt ⊆ PLS dt [2 ] . Let Σ = { 0 , 1 } n ∖ { 0 n } \Sigma=\{0,1\}^n \setminus\{0^n\} Σ = { 0 , 1 } n ∖ { 0 n } and N = 2 n N=2^n N = 2 n . A PPP instance is naturally represented as an element x ∈ Σ N x \in\Sigma^N x ∈ Σ N , listing the values x ( v ) x(v) x ( v ) for each v ∈ { 0 , 1 } n v \in\{0,1\}^n v ∈ { 0 , 1 } n in lexicographical order. We want to show that no width-w = polylog ( N ) w=\operatorname{polylog}(N) w = polylog ( N ) refutation can find a collision for x x x . We can actually prove this for width as large as N − 2 N-2 N − 2 : we simply observe that for any partial assignment ρ \rho ρ with at least two ⋆ \star ⋆ values, and any v v v with ρ ( v ) = ⋆ \rho(v)=\star ρ ( v ) = ⋆ , there exists an a ∈ Σ a \in\Sigma a ∈ Σ such that ρ ∪ { v ↦ a } \rho\cup\{v \mapsto a\} ρ ∪ { v ↦ a } does not fix any solution; we simply take a a a to be any value in the set Σ ∖ { ρ ( v ′ ) ∣ v ′ ≤ N } \Sigma\setminus\{\rho(v') \mid v' \leq N\} Σ ∖ { ρ ( v ′ ) ∣ v ′ ≤ N } , which must be nonempty.
To prove our actual separation, we need to somehow extend this argument to show that it holds “on average over a random x ∼ Σ N x \sim\Sigma^N x ∼ Σ N .” Consider some candidate width w = polylog ( N ) w=\operatorname{polylog}(N) w = polylog ( N ) resolution refutation F , S \mathcal{F},S F , S , satisfying all conditions above except the terminal state condition. Our task will be to show that with high probability over x ∼ Σ N x \sim\Sigma^N x ∼ Σ N , there exists some terminal state ρ ∈ F \rho\in\mathcal{F} ρ ∈ F , x ⊇ ρ x \supseteq\rho x ⊇ ρ , such that ρ \rho ρ does not determine a PPP solution (meaning there are no two values v ≠ v ′ ∈ [ N ] v \ne v' \in[N] v = v ′ ∈ [ N ] such that ρ ( v ) = ρ ( v ′ ) ∈ Σ \rho(v)=\rho(v') \in\Sigma ρ ( v ) = ρ ( v ′ ) ∈ Σ ). To approach this, we observe that our previous worst-case lower bound did not exploit a useful property of PPP: if ρ \rho ρ is a partial assignment of width polylog ( N ) \operatorname{polylog}(N) polylog ( N ) , then for any additional query v ∈ [ N ] v \in[N] v ∈ [ N ] , ρ ∪ { v ↦ a } \rho\cup\{v \mapsto a\} ρ ∪ { v ↦ a } will not fix a PPP solution with overwhelming probability over a random a ∼ Σ a \sim\Sigma a ∼ Σ ; in particular the failure probability is at most polylog ( N ) N − 1 \frac{\operatorname{polylog}(N)}{N-1} N − 1 polylog ( N ) . We call this property robustness ; it implies that for any nonterminal ρ \rho ρ which does not fix a solution,
Pr x ∼ Σ N [ S ( ρ , x i ( ρ ) ) fixes a solution ∣ x ⊇ ρ ] ≤ polylog ( N ) N − 1 \Pr_{x \sim\Sigma^N}\left[S(\rho,x_{i(\rho)})\text{ fixes a solution}\mid x\supseteq\rho\right]\leq\frac{\operatorname{polylog}(N)}{N-1} x ∼ Σ N Pr [ S ( ρ , x i ( ρ ) ) fixes a solution ∣ x ⊇ ρ ] ≤ N − 1 polylog ( N )
A naive strategy would be to start at ρ = ⋆ N \rho= \star^N ρ = ⋆ N and iteratively apply this bound as we traverse the refutation using S S S , arguing at each step that the probability we fix a solution is small. The obvious issue here is that the number of steps may far exceed N N N and so a union bound will fail to establish that a solution-fixing state is never reached. Indeed, requiring the refutation to fail when we specifically follow the path starting at the state ⋆ N \star^N ⋆ N far overshoots our intended goal, which is to find any terminal x ⊇ ρ ∈ F x \supseteq\rho\in\mathcal{F} x ⊇ ρ ∈ F which does not fix a solution; this will directly correspond to a PLS solution which fails to determine any PPP solution, hence ruling out the correctness of the reduction on this x x x .
Our approach will instead be more global. Let E ⊆ F \mathcal{E} \subseteq\mathcal{F} E ⊆ F be the terminal states in F \mathcal{F} F which do not fix a PPP solution and let B ⊆ Σ N B \subseteq\Sigma^N B ⊆ Σ N be the “bad” inputs for which there exists ρ ∈ E \rho\in\mathcal{E} ρ ∈ E such that x ⊇ ρ x \supseteq\rho x ⊇ ρ . We aim to show that Pr [ x ∈ B ] ≥ 1 − ( log N ) − ω ( 1 ) \Pr[x \in B] \ge1 - (\log N)^{-\omega(1)} Pr [ x ∈ B ] ≥ 1 − ( log N ) − ω ( 1 ) for a uniformly random x x x , i.e. the reduction to PLS fails on all but a negligible fraction of inputs. To prove this, we will define the auxiliary relation/search problem F ′ \mathcal{F}' F ′ : given x ∈ Σ N x \in\Sigma^N x ∈ Σ N , find either a PPP solution for x x x , or else find ρ ∈ E \rho\in\mathcal{E} ρ ∈ E such that x ⊇ ρ x \supseteq\rho x ⊇ ρ . We then observe that F \mathcal{F} F now serves as a worst-case resolution refutation for the relation F ′ \mathcal{F}' F ′ . It hence suffices to prove the following: if F ⊆ Σ N × O \mathcal{F} \subseteq\Sigma^N \times\mathcal{O} F ⊆ Σ N × O is any T F N P d t \mathsf{TFNP}^{\mathrm{dt}} TFNP dt search problem with the aforementioned “robustness” property, and we augment it to another T F N P d t \mathsf{TFNP}^{\mathrm{dt}} TFNP dt problem F ′ ⊆ Σ N × ( O ⊔ O ′ ) \mathcal{F}' \subseteq\Sigma^N \times(\mathcal{O} \sqcup\mathcal{O}') F ′ ⊆ Σ N × ( O ⊔ O ′ ) where (1) for x ∈ Σ N x \in\Sigma^N x ∈ Σ N , o ∈ O o \in\mathcal{O} o ∈ O , ( x , o ) ∈ F ′ ⟺ ( x , o ) ∈ F (x,o) \in\mathcal{F}' \Longleftrightarrow(x,o) \in\mathcal{F} ( x , o ) ∈ F ′ ⟺ ( x , o ) ∈ F and (2) Pr [ ∃ o ′ ∈ O ′ , ( x , o ′ ) ∈ F ′ ] ≤ 1 − ( polylog ( N ) ) − 1 \Pr[\exists o' \in\mathcal{O}', (x,o') \in\mathcal{F}'] \le1 - (\operatorname{polylog}(N))^{-1} Pr [ ∃ o ′ ∈ O ′ , ( x , o ′ ) ∈ F ′ ] ≤ 1 − ( polylog ( N ) ) − 1 , then F ′ \mathcal{F}' F ′ does not have a polylog ( N ) \operatorname{polylog}(N) polylog ( N ) -width refutation.
The key is that we have offloaded the “average case” condition into a modification of the search problem itself, and the remaining task is to prove a “worst case” resolution width lower bound for this modified search problem.
To prove this resolution bound we utilize a linear-algebraic embedding originally developed by Razborov [Raz03] as a key step in his pseudo-width method. To prove a resolution lower bound for F ′ \mathcal{F}' F ′ , it is natural to try to focus on the set of “safe states” ρ \rho ρ which fix no PPP solution and which admit at least one extension with no O ′ \mathcal{O}' O ′ solution, and argue that this set is closed under “query/forget” operations. This would immediately yield the width lower bound for F ′ \mathcal{F}' F ′ , since any width-w w w refutation would fail to “escape” this set of safe partial assignments (and none of them fix a solution for F ′ \mathcal{F}' F ′ ). While this naive safeness property holds for the empty partial assignment and is downward closed (i.e. closed under “forgetting” previous queries), it need not be closed under performing additional queries. The linear-algebraic embedding will provide us with a special downward-closed (and nonempty) subset of these safe states which is in fact perfectly closed under queries: for any ∣ ρ ∣ < w |\rho| < w ∣ ρ ∣ < w in this set and any i i i with ρ ( i ) = ⋆ \rho(i) = \star ρ ( i ) = ⋆ , there exists a ∈ Σ a \in\Sigma a ∈ Σ such that ρ ∪ { i ↦ a } \rho\cup\{i \mapsto a\} ρ ∪ { i ↦ a } also lies in the set.
As alluded to above, the only property of PPP we will use is its “robustness” (we have not defined robustness formally at this point). This property is easily shown to hold for the subclass PWPP, and so in § 6.3 we prove the stronger ROM separation PWPP ⊈ \not\subseteq ⊆ PLS directly. In § 6.4 we exhibit a problem in the class P P A d t \mathsf{PPA}^{\mathrm{dt}} PPA dt which satisfies the same robustness property and hence obtain the ROM separation PPA ⊈ \not\subseteq ⊆ PLS as well. Unlike in the case of PWPP it is not obvious how to efficiently construct a robust distribution of PPA; here we require a modification of the previously-discussed construction showing PPAD ⊈ \not\subseteq ⊆ FP in the ROM.
Average-case separation between PPAD and FP
In this section we prove the following theorem, giving an exponential separation between PPAD and FP in the ROM setting.
Theorem 1. There exists a TFNP search problem F = { F N ⊆ Σ N × O } \mathcal{F} = \{F_N \subseteq\Sigma^N \times\mathcal{O}\} F = { F N ⊆ Σ N × O } in PPAD satisfying that: every decision tree T T T with depth exp ( ( log N ) o ( 1 ) ) \exp((\log N)^{o(1)}) exp (( log N ) o ( 1 ) ) solves F \mathcal{F} F with probability at most
Pr u ∼ Σ N [ ( u , T ( u ) ) ∈ F N ] ≤ exp ( − ( log N ) Ω ( 1 ) ) . \Pr_{u \sim\Sigma^N}[(u,T(u)) \in F_N] \le\exp\left(-(\log N)^{\Omega(1)}\right). u ∼ Σ N Pr [( u , T ( u )) ∈ F N ] ≤ exp ( − ( log N ) Ω ( 1 ) ) . In particular, PPAD ̸ ⊆ R O M \not\subseteq_{\mathrm{ROM}} ⊆ ROM FP.
We start by defining the hard problem. Let G = ( [ N ] , E ) G = ([N], E) G = ([ N ] , E ) be an ℓ \ell ℓ -uniform hypergraph, i.e. E ⊆ ( [ N ] ℓ ) E \subseteq\binom{[N]}{\ell} E ⊆ ( ℓ [ N ] ) . We first describe a simplified problem: given a labeling h : [ N ] → [ τ ] h: [N] \to[\tau] h : [ N ] → [ τ ] find an edge e = { v 1 , … , v ℓ } ∈ E e = \{v_1,\ldots,v_\ell\} \in E e = { v 1 , … , v ℓ } ∈ E such that no label occurs exactly once in the list h ( v 1 ) , … , h ( v ℓ ) h(v_1),\ldots,h(v_\ell) h ( v 1 ) , … , h ( v ℓ ) . That is, for each i ∈ [ τ ] i \in[\tau] i ∈ [ τ ] either i ∉ { h ( v 1 ) , … , h ( v ℓ ) } i \notin\{h(v_1),\ldots,h(v_\ell)\} i ∈ / { h ( v 1 ) , … , h ( v ℓ )} or it occurs in the list at least twice. The actual problem has two differences: we allow labels to be voided ( ⊥ ) (\perp) ( ⊥ ) , and we plant a special edge e ∗ = [ ℓ ] e^* = [\ell] e ∗ = [ ℓ ] and fix all labels in [ ℓ ] [\ell] [ ℓ ] to ⊥ \perp ⊥ . This makes e ∗ e^* e ∗ a trivial solution, so the problem asks for another solution.
Formally, let H \mathcal{H} H be the set of functions h : [ N ] → ( { ⊥ } ∪ [ τ ] ) h : [N] \to(\{\perp\} \cup[\tau]) h : [ N ] → ({ ⊥ } ∪ [ τ ]) satisfying h ( [ ℓ ] ) = { ⊥ } h([\ell]) = \{\perp\} h ([ ℓ ]) = { ⊥ } . Then the problem Singleton G ⊆ H × ( E ∖ { e ∗ } ) \operatorname{Singleton}_{G} \subseteq\mathcal{H} \times(E \setminus\{e^*\}) Singleton G ⊆ H × ( E ∖ { e ∗ }) is as follows: given h ∈ H h \in\mathcal{H} h ∈ H , find an edge e = { v 1 , … , v ℓ } ∈ E ∖ { e ∗ } e = \{v_1,\ldots,v_\ell\} \in E \setminus\{e^*\} e = { v 1 , … , v ℓ } ∈ E ∖ { e ∗ } such that all non-⊥ \perp ⊥ elements in the list h ( v 1 ) , … , h ( v ℓ ) h(v_1),\ldots,h(v_\ell) h ( v 1 ) , … , h ( v ℓ ) occur at least twice. We will show that there exists G G G that simultaneously satisfies the following properties:
Hardness For h ∼ H h \sim\mathcal{H} h ∼ H , every decision tree T T T that makes at most 2 ℓ 1 / 4 2^{\ell^{1/4}} 2 ℓ 1/4 queries to h h h is very unlikely to solve Singleton G \operatorname{Singleton}_{G} Singleton G :
Pr [ ( h , T ( h ) ) ∈ Singleton G ] ≤ exp ( − ℓ Ω ( 1 ) ) . \Pr[(h,T(h)) \in\operatorname{Singleton}_{G}] \le\exp(-\ell^{\Omega(1)}). Pr [( h , T ( h )) ∈ Singleton G ] ≤ exp ( − ℓ Ω ( 1 ) ) .
PPAD-inclusion Singleton G ∈ PPAD \operatorname{Singleton}_{G} \in\operatorname{PPAD} Singleton G ∈ PPAD ;
In § 4.1 we prove that Singleton G \operatorname{Singleton}_{G} Singleton G is hard whenever the set of edges E E E is well-spread: We say that a subset family E ⊆ ( [ N ] ℓ ) E \subseteq\binom{[N]}{\ell} E ⊆ ( ℓ [ N ] ) is ( r , a , b ) (r,a,b) ( r , a , b ) -well-spread if for every set S ⊆ [ N ] S \subseteq[N] S ⊆ [ N ] of size at most a a a the number of edges e ∈ E e \in E e ∈ E such that ∣ e ∩ S ∣ ≥ r |e \cap S| \ge r ∣ e ∩ S ∣ ≥ r is at most b b b . See Figure 2 for an illustration.
Figure 2. This figure illustrates the setting of the problem Singleton.
Then in § 4.3 we show that Singleton G ∈ PPAD \operatorname{Singleton}_{G} \in\operatorname{PPAD} Singleton G ∈ PPAD if E E E is balanced: E ⊆ ( [ N ] ℓ ) E \subseteq\binom{[N]}{\ell} E ⊆ ( ℓ [ N ] ) is r r r -balanced if there exists a signing ε ∈ { ± 1 } E \varepsilon\in\{\pm1\}^{E} ε ∈ { ± 1 } E such that for every R ∈ ( [ N ] r ) R \in\binom{[N]}{r} R ∈ ( r [ N ] ) we have ∑ e ⊇ R ε e = 0 \sum_{e \supseteq R} \varepsilon_e = 0 ∑ e ⊇ R ε e = 0 .
Finally, in § 4.4 we show that there is an efficient construction of G G G satisfying both well-spreadness and balancedness.
PPAD hardness
Theorem 2. Fix τ \tau τ to be an even integer in [ ℓ / 4 , ℓ / 2.6 ] [\ell/4,\ell/2.6] [ ℓ /4 , ℓ /2.6 ] . Suppose that E E E is a ( 3 τ / 2 , q , b ) (3\tau/2,q,b) ( 3 τ /2 , q , b ) -well-spread set and T : H → E ∖ { e ∗ } T : \mathcal{H} \to E \setminus\{e^*\} T : H → E ∖ { e ∗ } is a decision tree of depth at most q q q . Additionally assume that for every e ∈ E ∖ { e ∗ } e \in E \setminus\{e^*\} e ∈ E ∖ { e ∗ } we have ∣ e ∩ [ ℓ ] ∣ ≤ τ |e \cap[\ell]| \le\tau ∣ e ∩ [ ℓ ] ∣ ≤ τ . Then the probability that ( h , T ( h ) ) ∈ Singleton ( [ N ] , E ) (h,T(h)) \in\operatorname{Singleton}_{([N],E)} ( h , T ( h )) ∈ Singleton ([ N ] , E ) is at most O ( b ) ⋅ exp ( − Ω ( τ ) ) O(b) \cdot\exp(-\Omega(\tau)) O ( b ) ⋅ exp ( − Ω ( τ )) .
Proof. Associated with each path in T T T is a partial assignment ρ ∈ ( { ⋆ , ⊥ } ∪ [ τ ] ) N \rho\in(\{\star,\perp\} \cup[\tau])^N ρ ∈ ({ ⋆ , ⊥ } ∪ [ τ ] ) N to the underlying variables that are queried along the path. Also let fix ( ρ ) \operatorname{fix}(\rho) fix ( ρ ) denote the set of queries made along path ρ \rho ρ : fix ( ρ ) : = ρ − 1 ( [ τ ] ∪ { ⊥ } ) \operatorname{fix}(\rho) := \rho^{-1}([\tau] \cup\{\perp\}) fix ( ρ ) := ρ − 1 ([ τ ] ∪ { ⊥ }) . For every vertex v ∈ T v \in T v ∈ T , let ρ v \rho_v ρ v denote the partial path/restriction from the root of T T T to vertex v v v , and for a path ρ \rho ρ let Leaf ( ρ ) \operatorname{Leaf}(\rho) Leaf ( ρ ) denote the leaf vertex on this path.
Let T ( ρ ) T(\rho) T ( ρ ) be the output of T T T in Leaf ( ρ ) \operatorname{Leaf}(\rho) Leaf ( ρ ) . Thus the overall probability that T T T succeeds on h ∼ H h \sim\mathcal{H} h ∼ H is:
∑ ρ a root-to-leaf path in T Pr [ h is consistent with ρ ] ⋅ Pr [ ( h , T ( ρ ) ) ∈ SINGLETON G ∣ h is consistent with ρ ] \sum_{\rho\ \text{a root-to-leaf path in }T} \Pr[h\text{ is consistent with }\rho]\cdot\Pr[(h,T(\rho))\in\operatorname{SINGLETON}_G\mid h\text{ is consistent with }\rho] ρ a root-to-leaf path in T ∑ Pr [ h is consistent with ρ ] ⋅ Pr [( h , T ( ρ )) ∈ SINGLETON G ∣ h is consistent with ρ ]
For a path ρ \rho ρ in T T T and an edge e ∈ E e \in E e ∈ E , we say that e e e is exposed by ρ \rho ρ if there are at least 3 τ / 2 3\tau/2 3 τ /2 nodes in e e e whose h h h -values are fixed by ρ \rho ρ .
The following Lemma states that for any path ρ \rho ρ in T T T and for any e ≠ e ∗ e \ne e^* e = e ∗ such that at most 3 τ / 2 3\tau/2 3 τ /2 h h h -values of e e e are fixed by ρ \rho ρ , the probability that e e e is a solution is exponentially small. We prove Lemma 3 in § 4.2 .
Lemma 3. Let G , e ∗ , ℓ , τ G,e^*,\ell,\tau G , e ∗ , ℓ , τ be as in Theorem 2. Let ρ \rho ρ be a partial assignment. Fix an edge e ≠ e ∗ e \ne e^* e = e ∗ and suppose that ∣ fix ( ρ ) ∩ e ∣ ≤ 3 τ / 2 |\operatorname{fix}(\rho)\cap e|\le3\tau/2 ∣ fix ( ρ ) ∩ e ∣ ≤ 3 τ /2 . Then, given ℓ ≥ 2.6 τ \ell\ge2.6\tau ℓ ≥ 2.6 τ and ℓ = O ( τ ) \ell=O(\tau) ℓ = O ( τ ) , we have
Pr [ ( h , e ) ∈ SINGLETON G ∣ h extends ρ ] ≤ exp ( − Ω ( τ ) ) . \Pr[(h,e)\in\operatorname{SINGLETON}_G\mid h\text{ extends }\rho]\le\exp(-\Omega(\tau)). Pr [( h , e ) ∈ SINGLETON G ∣ h extends ρ ] ≤ exp ( − Ω ( τ )) .
Equipped with Lemma 3, we proceed with the lower bound. There are two cases to consider.
Case I. The first case is if the path ρ \rho ρ in T T T is such that T ( ρ ) T(\rho) T ( ρ ) is not exposed. This is the easy case, and we can apply Lemma 3 directly to deduce that Pr [ ( h , T ( ρ ) ) ∈ SINGLETON G ∣ h extends ρ ] ≤ exp ( − Ω ( τ ) ) \Pr[(h,T(\rho))\in\operatorname{SINGLETON}_G\mid h\text{ extends }\rho]\le\exp(-\Omega(\tau)) Pr [( h , T ( ρ )) ∈ SINGLETON G ∣ h extends ρ ] ≤ exp ( − Ω ( τ )) .
Case II. The second case is the harder and more interesting case, where ρ \rho ρ is a path in T T T and T ( ρ ) T(\rho) T ( ρ ) has been exposed by ρ \rho ρ . Note that every path ρ \rho ρ could output an exposed edge e e e , so here we want to argue that the probability (over h h h ) that T ( ρ ) T(\rho) T ( ρ ) is exposed along its path and that ( h , T ( ρ ) ) ∈ SINGLETON G (h,T(\rho))\in\operatorname{SINGLETON}_G ( h , T ( ρ )) ∈ SINGLETON G is very small. In other words, we need to show that very few assignments h h h lead to exposed solutions .
The rest of the proof will focus on Case II. First, the following claim bounds the number of exposed edges on any given path of T T T .
Claim 4. For every path ρ \rho ρ in T T T , at most b b b edges are exposed by ρ \rho ρ .
Proof. Recall that fix ( ρ ) \operatorname{fix}(\rho) fix ( ρ ) is the set of queries made along path ρ \rho ρ , so since ∣ fix ( ρ ) ∣ ≤ q |\operatorname{fix}(\rho)|\le q ∣ fix ( ρ ) ∣ ≤ q applying ( 3 τ / 2 , q , b ) (3\tau/2,q,b) ( 3 τ /2 , q , b ) -well-spreadness to this set implies that at most b b b edges e ∈ E e\in E e ∈ E satisfy ∣ e ∩ fix ( ρ ) ∣ ≥ 3 τ / 2 |e\cap\operatorname{fix}(\rho)|\ge3\tau/2 ∣ e ∩ fix ( ρ ) ∣ ≥ 3 τ /2 .
For each path ρ \rho ρ in T T T , we define an ordered list of non-special edges that become exposed: Let List ( ρ ) \operatorname{List}(\rho) List ( ρ ) consist of all pairs ( v , e ) (v,e) ( v , e ) with e ≠ e ∗ e\ne e^* e = e ∗ such that e e e first becomes exposed along ρ \rho ρ at vertex v v v . By Claim 4, ∣ List ( ρ ) ∣ ≤ b |\operatorname{List}(\rho)|\le b ∣ List ( ρ ) ∣ ≤ b . Also we note that the vertices v v v may not be distinct as more than one edge could be exposed by the same query vertex v v v . Assume that List ( ρ ) \operatorname{List}(\rho) List ( ρ ) is ordered according to time so the edges that are exposed earlier occur before the edges that are exposed later; when more than one edge is exposed at the same vertex, we order them lexicographically. Thus, for every path ρ \rho ρ , List ( ρ ) \operatorname{List}(\rho) List ( ρ ) is an ordered list of length at most b b b .
Now let ρ \rho ρ be a path, and let ( v , e ) (v,e) ( v , e ) be one of the pairs in List ( ρ ) \operatorname{List}(\rho) List ( ρ ) . By definition, this means that at vertex v v v along ρ \rho ρ , e e e first becomes exposed. Let ρ v \rho_v ρ v denote the partial transcript of ρ \rho ρ from the root of T T T up to and including vertex v v v . Thus ρ v \rho_v ρ v fixes exactly 3 τ / 2 3\tau/2 3 τ /2 h h h -values in e e e and its other ℓ − 3 τ / 2 \ell-3\tau/2 ℓ − 3 τ /2 coordinates are still not queried.
Now we can apply Lemma 3 here to obtain:
Pr [ ( h , e ) ∈ SINGLETON G ∣ ρ v ] ≤ exp ( − Ω ( τ ) ) . \Pr[(h,e)\in\operatorname{SINGLETON}_G\mid\rho_v]\le\exp(-\Omega(\tau)). Pr [( h , e ) ∈ SINGLETON G ∣ ρ v ] ≤ exp ( − Ω ( τ )) .
Therefore, conditioned on extending ρ v \rho_v ρ v , the paths in T T T for which e e e is good have total probability mass at most exp ( − Ω ( τ ) ) \exp(-\Omega(\tau)) exp ( − Ω ( τ )) .
Now consider the entire collection of ordered lists { List ( ρ ) } ρ ∈ T \{\operatorname{List}(\rho)\}_{\rho\in T} { List ( ρ ) } ρ ∈ T , over all root-to-leaf paths ρ ∈ T \rho\in T ρ ∈ T . Fix a position j ∈ [ b ] j\in[b] j ∈ [ b ] ; this is a position in all of the ordered lists. Define
V j : = { ( v , e ) ∣ ρ is a path in T and ( v , e ) is the j th element of the list List ( ρ ) } . (2) V_j:=\{(v,e)\mid\rho\text{ is a path in }T\text{ and }(v,e)\text{ is the }j^{\text{th}}\text{ element of the list }\operatorname{List}(\rho)\}. \tag*{(2)} V j := {( v , e ) ∣ ρ is a path in T and ( v , e ) is the j th element of the list List ( ρ )} . (2)
Note that although we have shown that along any single path ρ \rho ρ , there are at most b b b exposed edges, since V j V_j V j contains the set of j t h j^{\mathrm{th}} j th exposed edges across all ρ \rho ρ ’s, the number of elements in V j V_j V j could be very large. Now for a vertex v ∈ T v \in T v ∈ T , define E v E_v E v to be the event that h h h is consistent with ρ v \rho_v ρ v :
E v : = { h ∈ H ∣ h extends ρ v } . E_v := \{h \in\mathcal{H} \mid h\text{ extends }\rho_v\}. E v := { h ∈ H ∣ h extends ρ v } .
Claim 5. For every j ≤ b j \le b j ≤ b and distinct pairs ( v , e ) , ( v ′ , e ′ ) ∈ V j (v,e),(v',e') \in V_j ( v , e ) , ( v ′ , e ′ ) ∈ V j , the events E v E_v E v and E v ′ E_{v'} E v ′ are mutually exclusive, and therefore
∑ ( v , e ) ∈ V j Pr [ E v ] ≤ 1. \sum_{(v,e)\in V_j} \Pr[E_v] \le1. ( v , e ) ∈ V j ∑ Pr [ E v ] ≤ 1.
Proof. Let ( v , e ) ≠ ( v ′ , e ′ ) ∈ V j (v,e) \ne(v',e') \in V_j ( v , e ) = ( v ′ , e ′ ) ∈ V j where ( v , e ) (v,e) ( v , e ) is the j t h j^{\mathrm{th}} j th element of the list List ( ρ ) \operatorname{List}(\rho) List ( ρ ) , and ( v ′ , e ′ ) (v',e') ( v ′ , e ′ ) is the j t h j^{\mathrm{th}} j th element on the list List ( ρ ′ ) \operatorname{List}(\rho') List ( ρ ′ ) . We want to show that ρ v \rho_v ρ v and ρ v ′ \rho_{v'} ρ v ′ must be inconsistent, and therefore the events E v , E v ′ E_v,E_{v'} E v , E v ′ are mutually exclusive. If not then assume without loss of generality that ρ v ′ \rho_{v'} ρ v ′ extends the partial assignment ρ v \rho_v ρ v , and therefore ρ v \rho_v ρ v corresponds to a subpath (possibly equal) of ρ v ′ \rho_{v'} ρ v ′ . But this implies that the first j j j elements must be identical in both lists List ( ρ ) \operatorname{List}(\rho) List ( ρ ) and List ( ρ ′ ) \operatorname{List}(\rho') List ( ρ ′ ) , contradicting our assumption that they disagree on the j t h j^{\mathrm{th}} j th element.
Now fix j ∈ [ b ] j \in[b] j ∈ [ b ] . By Claim 5, ∑ ( v , e ) ∈ V j Pr [ E v ] ≤ 1 \sum_{(v,e)\in V_j}\Pr[E_v] \le1 ∑ ( v , e ) ∈ V j Pr [ E v ] ≤ 1 , and therefore the probability (over assignments h h h ) that the j t h j^{\mathrm{th}} j th exposed edge on the sampled path exists and is a solution is:
∑ ( v , e ) ∈ V j Pr [ E v ] ⋅ Pr [ ( h , e ) ∈ Singleton G ∣ E v ] . \sum_{(v,e)\in V_j}\Pr[E_v]\cdot\Pr[(h,e)\in\operatorname{Singleton}_G\mid E_v]. ( v , e ) ∈ V j ∑ Pr [ E v ] ⋅ Pr [( h , e ) ∈ Singleton G ∣ E v ] .
We can use Lemma 3 to bound each second term by exp ( − Ω ( τ ) ) \exp(-\Omega(\tau)) exp ( − Ω ( τ )) , and by Claim 5, the sum of the first terms is at most 1. Therefore by a union bound over all j ∈ [ b ] j \in[b] j ∈ [ b ] , the probability that some non-special exposed edge on the sampled path is a solution is at most b ⋅ exp ( − Ω ( τ ) ) b\cdot\exp(-\Omega(\tau)) b ⋅ exp ( − Ω ( τ )) .
Proof of the main lemma
Finally, we prove Lemma 3, that we restate here for convenience.
Lemma 3. Let G , e ∗ , ℓ , τ G,e^*,\ell,\tau G , e ∗ , ℓ , τ be as in Theorem 2. Let ρ \rho ρ be a partial assignment. Fix an edge e ≠ e ∗ e \ne e^* e = e ∗ and suppose that ∣ fix ( ρ ) ∩ e ∣ ≤ 3 τ / 2 |\operatorname{fix}(\rho)\cap e|\le3\tau/2 ∣ fix ( ρ ) ∩ e ∣ ≤ 3 τ /2 . Then, given ℓ ≥ 2.6 τ \ell\ge2.6\tau ℓ ≥ 2.6 τ and ℓ = O ( τ ) \ell=O(\tau) ℓ = O ( τ ) , we have
Pr [ ( h , e ) ∈ Singleton G ∣ h extends ρ ] ≤ exp ( − Ω ( τ ) ) . \Pr[(h,e)\in\operatorname{Singleton}_G\mid h\text{ extends }\rho]\le\exp(-\Omega(\tau)). Pr [( h , e ) ∈ Singleton G ∣ h extends ρ ] ≤ exp ( − Ω ( τ )) .
The key probabilistic fact we need here is McDiarmid’s inequality:
Theorem 6 ([56 ] ). Let f : Σ m → R f:\Sigma^m\to\mathbb{R} f : Σ m → R be a function with c c c -bounded differences, i.e. such that for all x , x ′ ∈ Σ m x,x'\in\Sigma^m x , x ′ ∈ Σ m that differ in a single coordinate ∣ f ( x ) − f ( x ′ ) ∣ ≤ c |f(x)-f(x')|\le c ∣ f ( x ) − f ( x ′ ) ∣ ≤ c . Then
Pr x ∼ Σ m [ ∣ f ( x ) − E [ f ( x ) ] ∣ ≥ λ ] ≤ 2 exp ( − λ 2 / ( c 2 m ) ) . \Pr_{x\sim\Sigma^m}[|f(x)-\mathbb{E}[f(x)]|\ge\lambda]\le2\exp(-\lambda^2/(c^2m)). x ∼ Σ m Pr [ ∣ f ( x ) − E [ f ( x )] ∣ ≥ λ ] ≤ 2 exp ( − λ 2 / ( c 2 m )) .
Proof of Lemma 3. Let e = { u 1 , … , u ℓ } e=\{u_1,\ldots,u_\ell\} e = { u 1 , … , u ℓ } and assume wlog that h ( u 1 ) , … , h ( u k ) h(u_1),\ldots,h(u_k) h ( u 1 ) , … , h ( u k ) are either fixed by ρ \rho ρ or by the initial assignment of h ( 1 ) = ⋯ = h ( ℓ ) = ⊥ h(1)=\cdots=h(\ell)=\bot h ( 1 ) = ⋯ = h ( ℓ ) = ⊥ . By assumption, k ≤ 2.5 τ k\le2.5\tau k ≤ 2.5 τ , since at most 3 τ / 2 3\tau/2 3 τ /2 are fixed by ρ \rho ρ and at most τ \tau τ by the initial assignment. Denote the assignment ρ \rho ρ extended to [ ℓ ] [\ell] [ ℓ ] by ρ ′ \rho' ρ ′ .
Then h ( u k + 1 ) , … , h ( u ℓ ) h(u_{k+1}),\ldots,h(u_\ell) h ( u k + 1 ) , … , h ( u ℓ ) are i.i.d. uniform over [ τ ] ∪ { ⊥ } [\tau]\cup\{\bot\} [ τ ] ∪ { ⊥ } conditioned on ρ \rho ρ . Let D ⊆ [ τ ] D\subseteq[\tau] D ⊆ [ τ ] be the set of values d d d such that there is at most one i ∈ [ k ] i\in[k] i ∈ [ k ] with ρ ′ ( u i ) = d \rho'(u_i)=d ρ ′ ( u i ) = d . The size of D D D is at least τ / 4 \tau/4 τ /4 : each element in [ τ ] ∖ D [\tau]\setminus D [ τ ] ∖ D has to occur at least twice among the non-⊥ \bot ⊥ h ( u 1 ) , … , h ( u k ) h(u_1),\ldots,h(u_k) h ( u 1 ) , … , h ( u k ) , so ∣ [ τ ] ∖ D ∣ ≤ 3 τ / 4 |[\tau]\setminus D|\le3\tau/4 ∣ [ τ ] ∖ D ∣ ≤ 3 τ /4 , since the only fixed non-⊥ \bot ⊥ values are assigned by ρ \rho ρ .
We show that at least one label remains a singleton. Define f d ( x k + 1 , … , x ℓ ) f_d(x_{k+1},\ldots,x_\ell) f d ( x k + 1 , … , x ℓ ) to be 1 if d d d occurs exactly once in ρ ′ ( u 1 ) , … , ρ ′ ( u k ) , x k + 1 , … , x ℓ \rho'(u_1),\ldots,\rho'(u_k),x_{k+1},\ldots,x_\ell ρ ′ ( u 1 ) , … , ρ ′ ( u k ) , x k + 1 , … , x ℓ , and 0 otherwise. Then for I d = { i ≤ k ∣ ρ ′ ( u i ) = d } I_d=\{i\le k\mid\rho'(u_i)=d\} I d = { i ≤ k ∣ ρ ′ ( u i ) = d } we get
Pr [ f d ( h ( u k + 1 ) , … , h ( u ℓ ) ) = 1 ] = { ( 1 − 1 / ( τ + 1 ) ) ℓ − k If ∣ I d ∣ = 1 ; ( ℓ − k ) / ( τ + 1 ) ⋅ ( 1 − 1 / ( τ + 1 ) ) ℓ − k − 1 If I d = ∅ . \Pr[f_d(h(u_{k+1}),\ldots,h(u_\ell))=1]=
\begin{cases}
(1-1/(\tau+1))^{\ell-k} & \text{If } |I_d|=1;\\
(\ell-k)/(\tau+1)\cdot(1-1/(\tau+1))^{\ell-k-1} & \text{If } I_d=\varnothing.
\end{cases} Pr [ f d ( h ( u k + 1 ) , … , h ( u ℓ )) = 1 ] = { ( 1 − 1/ ( τ + 1 ) ) ℓ − k ( ℓ − k ) / ( τ + 1 ) ⋅ ( 1 − 1/ ( τ + 1 ) ) ℓ − k − 1 If ∣ I d ∣ = 1 ; If I d = ∅ .
In both cases the probability is exp ( − Θ ( ( ℓ − k ) / τ ) ) = Ω ( 1 ) \exp(-\Theta((\ell-k)/\tau))=\Omega(1) exp ( − Θ (( ℓ − k ) / τ )) = Ω ( 1 ) , since ℓ − k = Θ ( τ ) \ell-k=\Theta(\tau) ℓ − k = Θ ( τ ) .
Defining f = f 1 + ⋯ + f τ f=f_1+\cdots+f_\tau f = f 1 + ⋯ + f τ observe that f f f has 2-bounded differences: changing one value of h ( u i ) h(u_i) h ( u i ) may create at most two singletons. Thus, since E [ f ( h ( u k + 1 ) , … , h ( u ℓ ) ) ] = Ω ( τ ) \mathbb{E}[f(h(u_{k+1}),\ldots,h(u_\ell))]=\Omega(\tau) E [ f ( h ( u k + 1 ) , … , h ( u ℓ ))] = Ω ( τ ) , Theorem 6 gives
Pr [ f ( h ( u k + 1 ) , … , h ( u ℓ ) ) = 0 ] ≤ exp ( − Ω ( ( τ / 4 ) 2 / ( ℓ − k ) ) ) = exp ( − Ω ( τ ) ) . \Pr[f(h(u_{k+1}),\ldots,h(u_\ell))=0]\le\exp(-\Omega((\tau/4)^2/(\ell-k)))=\exp(-\Omega(\tau)). Pr [ f ( h ( u k + 1 ) , … , h ( u ℓ )) = 0 ] ≤ exp ( − Ω (( τ /4 ) 2 / ( ℓ − k ))) = exp ( − Ω ( τ )) .
PPAD containment
Recall that E ⊆ ( [ N ] r ) E \subseteq\binom{[N]}{r} E ⊆ ( r [ N ] ) is r r r -balanced if there is a signing ϵ ∈ { ± 1 } E \epsilon\in\{\pm1\}^{E} ϵ ∈ { ± 1 } E such that for every I ∈ ( [ N ] ℓ ) I \in\binom{[N]}{\ell} I ∈ ( ℓ [ N ] ) we have ∑ e ∈ E I ϵ e = 0 \sum_{e\in E_I}\epsilon_e = 0 ∑ e ∈ E I ϵ e = 0 for E I : = { e ∈ E ∣ e ⊇ I } E_I := \{e \in E \mid e \supseteq I\} E I := { e ∈ E ∣ e ⊇ I } . We say that E E E is efficiently r r r -balanced if the mapping e ↦ ϵ e e \mapsto\epsilon_e e ↦ ϵ e is efficiently computable, and for every I I I there is a poly-time computable involution σ I : E I → E I \sigma_I : E_I \to E_I σ I : E I → E I such that ϵ σ I ( e ) = − ϵ e \epsilon_{\sigma_I(e)}=-\epsilon_e ϵ σ I ( e ) = − ϵ e , i.e. given I I I and e e e there is a poly-time algorithm that computes σ I ( e ) \sigma_I(e) σ I ( e ) . Wlog we assume ϵ e ∗ = 1 \epsilon_{e^*}=1 ϵ e ∗ = 1 .
Theorem 7. Let G = ( [ N ] , E ) G=([N],E) G = ([ N ] , E ) with E ⊆ ( [ N ] ℓ ) E \subseteq\binom{[N]}{\ell} E ⊆ ( ℓ [ N ] ) be explicit with ℓ = poly ( log N ) \ell=\operatorname{poly}(\log N) ℓ = poly ( log N ) . Suppose that E E E is efficiently τ \tau τ -balanced. Then Singleton G ∈ PPAD \operatorname{Singleton}_G \in\operatorname{PPAD} Singleton G ∈ PPAD .
We reduce Singleton G \operatorname{Singleton}_G Singleton G to a uniform family of unsatisfiable polynomial equations over the reals, with integer coefficients. We show that for τ \tau τ -balanced graphs G G G this family has a simple (uniform) unary Nullstellensatz (uNS) refutation. The general theorem from [29 ] then immediately implies Singleton G ∈ PPAD \operatorname{Singleton}_G \in\operatorname{PPAD} Singleton G ∈ PPAD in the black-box model. Our proof does not formally rely on this theorem. We will show that efficient τ \tau τ -balancedness allows the argument to hold in the uniform setting.
Polynomial encoding of Singleton G \operatorname{Singleton}_G Singleton G . We define an unsatisfiable system of polynomials, P G \mathcal{P}_G P G . The underlying variables of it are h v , j h_{v,j} h v , j where v ∈ [ N ] v \in[N] v ∈ [ N ] and j ∈ [ w ] j \in[w] j ∈ [ w ] , where w = ⌈ log ( τ + 1 ) ⌉ w=\lceil\log(\tau+1)\rceil w = ⌈ log ( τ + 1 )⌉ . The (semantically boolean) variables h v , 1 , … , h v , w h_{v,1},\ldots,h_{v,w} h v , 1 , … , h v , w encode the value of h ( v ) ∈ { ⊥ } ∪ [ τ ] h(v)\in\{\bot\}\cup[\tau] h ( v ) ∈ { ⊥ } ∪ [ τ ] : the binary representations of elements in [ τ ] [\tau] [ τ ] encode those elements, all other strings encode ⊥ \bot ⊥ . Since the encoded function h ∈ H h\in\mathcal{H} h ∈ H , we also define h i , j = 0 h_{i,j}=0 h i , j = 0 for all i ∈ [ ℓ ] i\in[\ell] i ∈ [ ℓ ] , j ∈ [ w ] j\in[w] j ∈ [ w ] .
We need to represent the fact that ( h , e ) ∉ Singleton G (h,e)\notin\operatorname{Singleton}_G ( h , e ) ∈ / Singleton G as a polynomial in { h v , j } v ∈ [ N ] , j ∈ [ w ] \{h_{v,j}\}_{v\in[N],j\in[w]} { h v , j } v ∈ [ N ] , j ∈ [ w ] for a fixed e = { v 1 , … , v ℓ } e=\{v_1,\ldots,v_\ell\} e = { v 1 , … , v ℓ } . We want to count occurrences of each non-⊥ \bot ⊥ value in h ( v 1 ) , … , h ( v ℓ ) h(v_1),\ldots,h(v_\ell) h ( v 1 ) , … , h ( v ℓ ) . That is, for β ∈ [ τ ] \beta\in[\tau] β ∈ [ τ ] , define
n β ( e ; h ) : = ∣ { v ∈ e ∣ h ( v ) = β } ∣ , n_\beta(e;h):=\left|\{v\in e\mid h(v)=\beta\}\right|, n β ( e ; h ) := ∣ { v ∈ e ∣ h ( v ) = β } ∣ ,
n β ( e ; h ) n_\beta(e;h) n β ( e ; h ) counts the number of times the value β \beta β appears in the sequence.
The function n β ( e ; h ) n_\beta(e;h) n β ( e ; h ) can be expressed as a low degree polynomial in the variables { h v , j } \{h_{v,j}\} { h v , j } : writing [ h ( v ) = β ] [h(v)=\beta] [ h ( v ) = β ] to represent the product of literals h v , j h_{v,j} h v , j expressing h ( v ) = β h(v)=\beta h ( v ) = β , n β ( e ; h ) n_\beta(e;h) n β ( e ; h ) is computed by the polynomial ∑ v ∈ e [ h ( v ) = β ] \sum_{v\in e}[h(v)=\beta] ∑ v ∈ e [ h ( v ) = β ] of degree at most w w w .
Now we define the following system of polynomial equations:
P G = { p e ( h ) = 0 ∣ e ∈ E ∖ { e ∗ } } , where p e ( h ) : = ∏ β ∈ [ τ ] ( 1 − ∑ v ∈ e [ h ( v ) = β ] ) . \mathcal{P}_G=\{p_e(h)=0\mid e\in E\setminus\{e^*\}\},\qquad\text{where}\quad p_e(h):=\prod_{\beta\in[\tau]}\left(1-\sum_{v\in e}[h(v)=\beta]\right). P G = { p e ( h ) = 0 ∣ e ∈ E ∖ { e ∗ }} , where p e ( h ) := β ∈ [ τ ] ∏ ( 1 − v ∈ e ∑ [ h ( v ) = β ] ) .
Note that each p e p_e p e is a polynomial of degree τ w \tau w τ w . Also, with respect to boolean variables h v , j h_{v,j} h v , j , the polynomial 1 − ∑ v ∈ e [ h ( v ) = β ] 1-\sum_{v\in e}[h(v)=\beta] 1 − ∑ v ∈ e [ h ( v ) = β ] is zero exactly when β \beta β occurs once. Therefore we have:
p e ( h ) ≠ 0 ⟺ no value in [ τ ] occurs exactly once . p_e(h)\ne0\quad\Longleftrightarrow\quad\text{no value in }[\tau]\text{ occurs exactly once}. p e ( h ) = 0 ⟺ no value in [ τ ] occurs exactly once .
Unary Nullstellensatz and PPAD. Göös, Hollender, Jain, Maystre, Pires, Robere, and Tao [29 Lemma 5] prove that PPAD d t \operatorname{PPAD}^{\mathrm{dt}} PPAD dt -inclusion is equivalent to having a Unary Nullstellensatz (uNS) proof. More precisely, suppose that a 1 , … , a M ∈ Z [ x 1 , … , x N ] a_1,\ldots,a_M\in\mathbb{Z}[x_1,\ldots,x_N] a 1 , … , a M ∈ Z [ x 1 , … , x N ] are multilinear polynomials each depending on poly ( log N ) \operatorname{poly}(\log N) poly ( log N ) variables. Then a Nullstellensatz refutation is a collection of polynomials c i ∈ Z [ x 1 , … , x N ] c_i\in\mathbb{Z}[x_1,\ldots,x_N] c i ∈ Z [ x 1 , … , x N ] and d 1 , … , d N ∈ Z [ x 1 , … , x N ] d_1,\ldots,d_N\in\mathbb{Z}[x_1,\ldots,x_N] d 1 , … , d N ∈ Z [ x 1 , … , x N ] such that ∑ i ∈ [ M ] a i ⋅ c i + ∑ i ∈ [ N ] ( x i 2 − x i ) d i = 1 \sum_{i\in[M]}a_i\cdot c_i+\sum_{i\in[N]}(x_i^2-x_i)d_i=1 ∑ i ∈ [ M ] a i ⋅ c i + ∑ i ∈ [ N ] ( x i 2 − x i ) d i = 1 . Then Nullstellensatz degree is the maximum degree of each a i c i a_i c_i a i c i and unary Nullstellensatz size is the sum of magnitudes of all coefficients in c 1 , … , c M c_1,\ldots,c_M c 1 , … , c M .
Lemma 8 ([29 Lemma 5] ). Let S : = { ( x , i ) ∈ { 0 , 1 } N × [ M ] ∣ a i ( x ) ≠ 0 } S:=\{(x,i)\in\{0,1\}^N\times[M]\mid a_i(x)\ne0\} S := {( x , i ) ∈ { 0 , 1 } N × [ M ] ∣ a i ( x ) = 0 } , and suppose there exists a unary Nullstellensatz refutation of { a i } i ∈ [ M ] \{a_i\}_{i\in[M]} { a i } i ∈ [ M ] of degree poly ( log N ) \operatorname{poly}(\log N) poly ( log N ) and size 2 poly ( log N ) 2^{\operatorname{poly}(\log N)} 2 poly ( l o g N ) then S ∈ PPAD d t S\in\operatorname{PPAD}^{\mathrm{dt}} S ∈ PPAD dt .3
Totality of SingletonG _G G and PPAD upper bound. First we show that SingletonG _G G is total by proving that the underlying system of polynomial equations, P G \mathcal{P}_G P G is unsatisfiable. Then, using the general equivalence between PPAD and unary Nullstellensatz we show that SingletonG _G G has an efficient PPAD formulation.
Lemma 9 (Totality of SingletonG _G G ). In the setting of Theorem 7 the system P G \mathcal{P}_G P G of polynomial equations is unsatisfiable, equivalently SingletonG _G G is total. Furthermore, P G \mathcal{P}_G P G has the following simple uNS refutation (modulo the boolean axioms x 2 − x x^2-x x 2 − x for all variables x x x ):
1 = − ∑ e ∈ E ∖ { e ∗ } ε e p e . 1=-\sum_{e\in E\setminus\{e^*\}}\varepsilon_e p_e. 1 = − e ∈ E ∖ { e ∗ } ∑ ε e p e .
Proof. Expand the τ \tau τ factors defining p e p_e p e :
p e = ∑ B ⊆ [ τ ] ; κ ∈ e B ( − 1 ) ∣ B ∣ ∏ β ∈ B [ h ( κ β ) = β ] . p_e=\sum_{\substack{B\subseteq[\tau];\\ \kappa\in e_B}}(-1)^{|B|}\prod_{\beta\in B}[h(\kappa_\beta)=\beta]. p e = B ⊆ [ τ ] ; κ ∈ e B ∑ ( − 1 ) ∣ B ∣ β ∈ B ∏ [ h ( κ β ) = β ] .
That is, each term specifies a subset B ⊆ [ τ ] B\subseteq[\tau] B ⊆ [ τ ] , and a list of ∣ B ∣ |B| ∣ B ∣ nodes κ \kappa κ that all belong to e e e . Now define the set of nodes I I I , associated with this term:
I : = { κ β ∣ β ∈ B } ⊆ [ N ] , ∣ I ∣ ≤ ∣ B ∣ ≤ τ . I:=\{\kappa_\beta\mid\beta\in B\}\subseteq[N],\qquad|I|\leq|B|\leq\tau. I := { κ β ∣ β ∈ B } ⊆ [ N ] , ∣ I ∣ ≤ ∣ B ∣ ≤ τ .
If ∣ I ∣ < ∣ B ∣ |I|<|B| ∣ I ∣ < ∣ B ∣ , the coefficient of the term in p e p_e p e is 0 (by boolean axioms). If ∣ I ∣ = ∣ B ∣ |I|=|B| ∣ I ∣ = ∣ B ∣ the coefficient is ( − 1 ) ∣ B ∣ (-1)^{|B|} ( − 1 ) ∣ B ∣ if e ⊇ I e\supseteq I e ⊇ I , otherwise it is 0. Therefore, since ∣ I ∣ ≤ τ |I|\leq\tau ∣ I ∣ ≤ τ , the τ \tau τ -balancedness implies that the coefficient of the term in ∑ e ∈ E ε e p e \sum_{e\in E}\varepsilon_e p_e ∑ e ∈ E ε e p e is ( − 1 ) ∣ B ∣ ⋅ ∑ e ⊇ I ε e = 0 (-1)^{|B|}\cdot\sum_{e\supseteq I}\varepsilon_e=0 ( − 1 ) ∣ B ∣ ⋅ ∑ e ⊇ I ε e = 0 .
On the other hand, for e ∗ = [ ℓ ] e^*=[\ell] e ∗ = [ ℓ ] , by definition we have n β ( e ∗ ; h ) = 0 n_\beta(e^*;h)=0 n β ( e ∗ ; h ) = 0 since h ( v ) = ⊥ h(v)=\perp h ( v ) =⊥ for all v ∈ e ∗ v\in e^* v ∈ e ∗ . Therefore all of its counts n β ( e ∗ ; h ) n_\beta(e^*;h) n β ( e ∗ ; h ) are zero, and consequently we have p e ∗ ( h ) = 1 p_{e^*}(h)=1 p e ∗ ( h ) = 1 and ε e ∗ = 1 \varepsilon_{e^*}=1 ε e ∗ = 1 . Removing this polynomial p e ∗ ( h ) p_{e^*}(h) p e ∗ ( h ) from the sum we have 1 = − ∑ e ∈ E ∖ { e ∗ } ε e p e ( h ) 1=-\sum_{e\in E\setminus\{e^*\}}\varepsilon_ep_e(h) 1 = − ∑ e ∈ E ∖ { e ∗ } ε e p e ( h ) .
Now this implies that P G = { p e ( h ) ∣ e ∈ E ∖ { e ∗ } } \mathcal{P}_G=\{p_e(h)\mid e\in E\setminus\{e^*\}\} P G = { p e ( h ) ∣ e ∈ E ∖ { e ∗ }} is unsatisfiable: suppose for sake of contradiction that there is an assignment to the underlying variables h h h such that for every e ∈ E ∖ { e ∗ } e\in E\setminus\{e^*\} e ∈ E ∖ { e ∗ } , p e ( h ) = 0 p_e(h)=0 p e ( h ) = 0 . Then ∑ e ∈ E ∖ { e ∗ } ε e p e ( h ) = 0 \sum_{e\in E\setminus\{e^*\}}\varepsilon_ep_e(h)=0 ∑ e ∈ E ∖ { e ∗ } ε e p e ( h ) = 0 , but this contradicts the fact that the sum is identically 1 (as argued above).
Thus, we have not only shown that P G \mathcal{P}_G P G is unsatisfiable, but have given a unary Nullstellensatz refutation ∑ e ∈ E ∖ { e ∗ } ε e p e = − 1 \sum_{e\in E\setminus\{e^*\}}\varepsilon_ep_e=-1 ∑ e ∈ E ∖ { e ∗ } ε e p e = − 1 , where each ε e ∈ { ± 1 } \varepsilon_e\in\{\pm1\} ε e ∈ { ± 1 } . Therefore, the sum of the absolute values of the coefficients in p e p_e p e is at most ( 1 + ℓ 2 ) τ (1+\ell^2)^\tau ( 1 + ℓ 2 ) τ for each e ∈ E e\in E e ∈ E , and therefore the refutation has degree poly ( ℓ ) \operatorname{poly}(\ell) poly ( ℓ ) and unary size ∣ E ∣ ( 1 + ℓ 2 ) τ ≤ 2 O ( ℓ log N + τ log ℓ ) = 2 polylog N |E|(1+\ell^2)^\tau\leq2^{O(\ell\log N+\tau\log\ell)}=2^{\operatorname{polylog}N} ∣ E ∣ ( 1 + ℓ 2 ) τ ≤ 2 O ( ℓ l o g N + τ l o g ℓ ) = 2 polylog N . □
Efficiency of inclusion. By Lemma 8 and Lemma 9, Singleton ∈ \in ∈ PPADd t ^{\mathrm{dt}} dt . In this section we make the inclusion explicit. Using the efficiency of τ \tau τ -balancedness we can complete the proof following the one by [29 ] exactly. Let us introduce the canonical PPAD-complete problem:
Definition 2. End-of-Line problem is defined with two arrays Succ, Pred ∈ [ N ] N \in[N]^N ∈ [ N ] N ; solutions are
1 1 1 if Pred1 ≠ 1 _1\ne1 1 = 1 or Succ1 = 1 _1=1 1 = 1 or PredS u c c 1 ≠ 1 _{\mathrm{Succ}_1}\ne1 Succ 1 = 1 ; (distinguished node is not a source)
i ∈ [ N ] ∖ { 1 } i\in[N]\setminus\{1\} i ∈ [ N ] ∖ { 1 } if SuccP r e d i ≠ i _{\mathrm{Pred}_i}\ne i Pred i = i . (non-canonical source)
i ∈ [ N ] i\in[N] i ∈ [ N ] if PredS u c c i ≠ i _{\mathrm{Succ}_i}\ne i Succ i = i . (sink)
Proof of Theorem 7 . We instantiate the proof of [29 Lemma 5] in our simpler case (the refutation simply adds the axiom polynomials with coefficients { ± 1 } \{\pm1\} { ± 1 } ) and verify that the inclusion is efficient. The nodes of the End-of-Line formulation are pairs ( e , u ) (e,u) ( e , u ) with e ∈ E e\in E e ∈ E and u ∈ ( { ⊥ } ∪ e ) τ u\in(\{\perp\}\cup e)^\tau u ∈ ({ ⊥ } ∪ e ) τ . Each pair corresponds to an occurrence of a monomial m u : = ∏ i ∈ [ τ ] : u i ≠ ⊥ [ h ( u i ) = i ] m_u:=\prod_{i\in[\tau]:u_i\ne\perp}[h(u_i)=i] m u := ∏ i ∈ [ τ ] : u i = ⊥ [ h ( u i ) = i ] in p e p_e p e . We do not open up the representations of [ h ( u i ) = i ] [h(u_i)=i] [ h ( u i ) = i ] . For each ( e , u ) (e,u) ( e , u ) the coefficient of the corresponding monomial in p e p_e p e is c ( e , u ) : = ( − 1 ) ∣ { i ∣ u i ≠ ⊥ } ∣ c(e,u):=(-1)^{|\{i\mid u_i\ne\perp\}|} c ( e , u ) := ( − 1 ) ∣ { i ∣ u i = ⊥ } ∣ . The edges in the End-of-Line instance are either monomial-preserving, they express the cancellation of two occurrences of the same monomial with opposite signs; or hyperedge-preserving, they express the semantic behavior of the polynomial p e ( h ) p_e(h) p e ( h ) . See Figure 3 for an example.
Figure 3. An End-of-Line instance for G = ( [ 6 ] , E ) G=([6], E) G = ([ 6 ] , E ) with E = { 123 , 234 , 345 , 135 , 156 , 456 , 246 , 126 } E = \{123, 234, 345, 135, 156, 456, 246, 126\} E = { 123 , 234 , 345 , 135 , 156 , 456 , 246 , 126 } , e ∗ = 123 e^* = 123 e ∗ = 123 , and ϵ e = ( − 1 ) ∣ e ∩ { 4 , 5 , 6 } ∣ \epsilon_e = (-1)^{|e \cap\{4,5,6\}|} ϵ e = ( − 1 ) ∣ e ∩ { 4 , 5 , 6 } ∣ , writing a b c = { a , b , c } abc = \{a,b,c\} ab c = { a , b , c } . Here x v = [ h ( v ) = 1 ] x_v = [h(v) = 1] x v = [ h ( v ) = 1 ] , y v = [ h ( v ) = 2 ] y_v = [h(v) = 2] y v = [ h ( v ) = 2 ] , and 0 denotes ⊥ \bot ⊥ ; only monomial occurrences evaluating to 1 are shown. Blue edges (A A A ) cancel equal monomials across opposite-sign hyperedges; green edges (B h B_h B h ) match opposite coefficients within a hyperedge. Highlighted paths connect the source ( e ∗ , ⊥ 2 ) (e^*, \bot^2) ( e ∗ , ⊥ 2 ) (peach) to sinks (purple) on non-special solution edges.
Monomial-preserving For ( e , u ) (e,u) ( e , u ) identify the set S S S of non-⊥ \perp ⊥ elements of u u u . By τ \tau τ -balancedness there exists a mapping σ S : E S → E S \sigma_S:E_S\to E_S σ S : E S → E S that matches up edges satisfying e ⊇ S e\supseteq S e ⊇ S with the property ε e = − ε σ S ( e ) \varepsilon_e=-\varepsilon_{\sigma_S(e)} ε e = − ε σ S ( e ) . Then we define A ( e , u ) : = ( σ S ( e ) , u ) A(e,u):=(\sigma_S(e),u) A ( e , u ) := ( σ S ( e ) , u ) .
Hyperedge-preserving. Fix a hyperedge e ∈ E e \in E e ∈ E . For all nodes ( e , u ) (e,u) ( e , u ) if m u ( h ) = 1 m_u(h)=1 m u ( h ) = 1 we define B h ( e , u ) : = ( e , u ′ ) B_h(e,u):=(e,u') B h ( e , u ) := ( e , u ′ ) such that m u m_u m u and m u ′ m_{u'} m u ′ have opposite coefficients in p e ( h ) p_e(h) p e ( h ) and B h ( e , u ′ ) = ( e , u ) B_h(e,u')=(e,u) B h ( e , u ′ ) = ( e , u ) . The mapping B h B_h B h can be computed efficiently, since the set of u u u for which monomials m u ∈ p e m_u \in p_e m u ∈ p e evaluate to 1 is a simple product set: ∏ i ∈ [ τ ] ( { ⊥ } ∪ { v ∈ e ∣ h ( v ) = i } ) \prod_{i\in[\tau]}(\{\bot\}\cup\{v\in e\mid h(v)=i\}) ∏ i ∈ [ τ ] ({ ⊥ } ∪ { v ∈ e ∣ h ( v ) = i }) : given a monomial m u m_u m u we can compute its rank in the lexicographic order among all monomials with the same coefficient and map it to a monomial with the same rank, but opposite coefficient. If no such monomial exists, define B h ( e , u ) = ⊥ B_h(e,u)=\bot B h ( e , u ) = ⊥ . Thus, B h B_h B h is not correctly defined iff there are different numbers of monomials with + 1 +1 + 1 and − 1 -1 − 1 coefficient, i.e. p e ( h ) ≠ 0 p_e(h)\ne0 p e ( h ) = 0 .
Finally we are ready to define successors and predecessors using the matching A A A and B h B_h B h : if the monomial m u m_u m u evaluates to 0 by h h h , create a self-loop in the node ( e , u ) (e,u) ( e , u ) ; otherwise if ϵ e ⋅ c ( e , u ) ⋅ m u ( h ) = 1 \epsilon_e\cdot c(e,u)\cdot m_u(h)=1 ϵ e ⋅ c ( e , u ) ⋅ m u ( h ) = 1 , take Succ e , u : = A ( e , u ) \operatorname{Succ}_{e,u}:=A(e,u) Succ e , u := A ( e , u ) and Pred e , u : = B h ( e , u ) \operatorname{Pred}_{e,u}:=B_h(e,u) Pred e , u := B h ( e , u ) , if B h ( e , u ) = ⊥ B_h(e,u)=\bot B h ( e , u ) = ⊥ set Pred e , u = ( e , u ) \operatorname{Pred}_{e,u}=(e,u) Pred e , u = ( e , u ) . If ϵ e ⋅ c ( e , u ) ⋅ m u ( h ) = − 1 \epsilon_e\cdot c(e,u)\cdot m_u(h)=-1 ϵ e ⋅ c ( e , u ) ⋅ m u ( h ) = − 1 swap Succ \operatorname{Succ} Succ and Pred \operatorname{Pred} Pred .
By the definition of the matchings A A A and B h B_h B h , all the nodes ( e , u ) (e,u) ( e , u ) with m u ( h ) = 1 m_u(h)=1 m u ( h ) = 1 are matched, unless p e ( h ) ≠ 0 p_e(h)\ne0 p e ( h ) = 0 , hence, an unmatched node in the constructed End-of-Line instance reveals a solution. The exception is the node ( e ∗ , ⊥ τ ) (e^*,\bot^\tau) ( e ∗ , ⊥ τ ) , that we set to be the canonical source.
Construction of the graph
In this section, we construct G = ( [ N ] , E ) G=([N],E) G = ([ N ] , E ) that satisfies the requirements of both Theorem 2 and Theorem 7:
Theorem 10. Suppose ℓ \ell ℓ is large enough power of 4. Then there exists N = 2 poly ( ℓ ) N=2^{\operatorname{poly}(\ell)} N = 2 poly ( ℓ ) and an explicit G = ( [ N ] , E ) G=([N],E) G = ([ N ] , E ) such that E ⊆ ( [ N ] ℓ ) E\subseteq\binom{[N]}{\ell} E ⊆ ( ℓ [ N ] ) is
( 3 τ / 2 , exp ( ( log N ) Ω ( 1 ) ) , exp ( o ( ℓ ) ) ) (3\tau/2,\exp((\log N)^{\Omega(1)}),\exp(o(\ell))) ( 3 τ /2 , exp (( log N ) Ω ( 1 ) ) , exp ( o ( ℓ ))) -well-spread;
efficiently τ \tau τ -balanced;
every e ∈ E ∖ { e ∗ } e\in E\setminus\{e^*\} e ∈ E ∖ { e ∗ } satisfies ∣ e ∩ e ∗ ∣ ≤ τ |e\cap e^*|\le\tau ∣ e ∩ e ∗ ∣ ≤ τ ;
where τ = 3 ℓ / 8 \tau=3\ell/8 τ = 3 ℓ /8 .
The code. The construction of G G G comes from a folded Reed-Solomon error correcting code. We identify [ N ] [N] [ N ] with a set [ ℓ ] × Γ [\ell]\times\Gamma [ ℓ ] × Γ , identifying a codeword c ∈ Γ ℓ c\in\Gamma^\ell c ∈ Γ ℓ with a hyperedge e c : = { ( i , c i ) ∣ i ∈ [ ℓ ] } e_c:=\{(i,c_i)\mid i\in[\ell]\} e c := {( i , c i ) ∣ i ∈ [ ℓ ]} . The zero codeword 0 ℓ 0^\ell 0 ℓ corresponds to the planted edge e ∗ = e 0 ℓ = [ ℓ ] e^*=e_{0^\ell}=[\ell] e ∗ = e 0 ℓ = [ ℓ ] .
Then well-spreadness of E E E corresponds exactly to list-recovery of the code C C C : we say that C ⊆ Γ ℓ C \subseteq\Gamma^\ell C ⊆ Γ ℓ is ( δ , a , b ) (\delta,a,b) ( δ , a , b ) -list recoverable if for every S 1 , … , S ℓ ⊂ Γ S_1,\ldots,S_\ell\subset\Gamma S 1 , … , S ℓ ⊂ Γ with ∣ S i ∣ ≤ a |S_i| \le a ∣ S i ∣ ≤ a , the number of codewords ( c 1 , … , c ℓ ) ∈ C (c_1,\ldots,c_\ell) \in C ( c 1 , … , c ℓ ) ∈ C with ∣ { i ∈ [ ℓ ] ∣ c i ∈ S i } ∣ ≥ ( 1 − δ ) ℓ |\{i \in[\ell] \mid c_i \in S_i\}| \ge(1-\delta)\ell ∣ { i ∈ [ ℓ ] ∣ c i ∈ S i } ∣ ≥ ( 1 − δ ) ℓ is at most b b b . The following claim is trivial:
Claim 11. If C ⊆ Γ ℓ C \subseteq\Gamma^\ell C ⊆ Γ ℓ is ( δ , a , b ) (\delta,a,b) ( δ , a , b ) -list recoverable then E : = { e c ∣ c ∈ C } E := \{e_c \mid c \in C\} E := { e c ∣ c ∈ C } is ( ( 1 − δ ) ℓ , a , b ) ((1-\delta)\ell,a,b) (( 1 − δ ) ℓ , a , b ) -well-spread.
In order to verify the τ \tau τ -balancedness we need to fix a specific construction of a list-recoverable C C C . Given a field F \mathbb{F} F with ∣ F ∣ = n + 1 |\mathbb{F}|=n+1 ∣ F ∣ = n + 1 and a generator γ ∈ F ∗ \gamma\in\mathbb{F}^* γ ∈ F ∗ define
ReedSolomon F , γ , d : = { c ∈ F n ∣ c i = f ( γ i − 1 ) where f ∈ F [ x ] with deg ( f ) ≤ d } , \operatorname{ReedSolomon}_{\mathbb{F},\gamma,d} := \{c \in\mathbb{F}^n \mid c_i=f(\gamma^{i-1}) \text{ where } f \in\mathbb{F}[x] \text{ with } \deg(f) \le d\}, ReedSolomon F , γ , d := { c ∈ F n ∣ c i = f ( γ i − 1 ) where f ∈ F [ x ] with deg ( f ) ≤ d } ,
FoldedRS F , γ , d m : = { ( ( c 1 , … , c m ) , ( c m + 1 , … , c 2 m ) , … , ( c n − m + 1 , … , c n ) ) ∣ c ∈ ReedSolomon F , γ , d } . \operatorname{FoldedRS}^{m}_{\mathbb{F},\gamma,d} := \{((c_1,\ldots,c_m),(c_{m+1},\ldots,c_{2m}),\ldots,(c_{n-m+1},\ldots,c_n)) \mid c \in\operatorname{ReedSolomon}_{\mathbb{F},\gamma,d}\}. FoldedRS F , γ , d m := {(( c 1 , … , c m ) , ( c m + 1 , … , c 2 m ) , … , ( c n − m + 1 , … , c n )) ∣ c ∈ ReedSolomon F , γ , d } .
The following fact is a specialization of [Rud07, Section 3.6] used (with slightly different parameters) in [YZ24].
Corollary 12. Let ℓ \ell ℓ be a large enough power of 4 4 4 and Γ = F ℓ 2 ℓ − 1 \Gamma=\mathbb{F}_{\ell^2}^{\ell-1} Γ = F ℓ 2 ℓ − 1 . Then FoldedRS F ℓ 2 , γ , 3 ℓ ( ℓ − 1 ) / 8 ℓ − 1 ⊆ Γ ℓ + 1 \operatorname{FoldedRS}^{\ell-1}_{\mathbb{F}_{\ell^2},\gamma,3\ell(\ell-1)/8} \subseteq\Gamma^{\ell+1} FoldedRS F ℓ 2 , γ , 3 ℓ ( ℓ − 1 ) /8 ℓ − 1 ⊆ Γ ℓ + 1 is ( 9 / 16 , ℓ ℓ / 4 , ℓ 2 ℓ ) (9/16,\ell^{\ell/4},\ell^{2\sqrt{\ell}}) ( 9/16 , ℓ ℓ /4 , ℓ 2 ℓ ) -list recoverable.
We are now ready to prove the theorem.
Proof of Theorem 10 . By applying Corollary 12 we get Γ = F ℓ 2 ℓ − 1 \Gamma=\mathbb{F}_{\ell^2}^{\ell-1} Γ = F ℓ 2 ℓ − 1 , and C ′ : = FoldedRS F ℓ 2 , γ , 3 ℓ ( ℓ − 1 ) / 8 ℓ − 1 ⊆ Γ ℓ + 1 C' := \operatorname{FoldedRS}^{\ell-1}_{\mathbb{F}_{\ell^2},\gamma,3\ell(\ell-1)/8} \subseteq\Gamma^{\ell+1} C ′ := FoldedRS F ℓ 2 , γ , 3 ℓ ( ℓ − 1 ) /8 ℓ − 1 ⊆ Γ ℓ + 1 that is ( 9 / 16 , ℓ ℓ / 4 , ℓ 2 ℓ ) (9/16,\ell^{\ell/4},\ell^{2\sqrt{\ell}}) ( 9/16 , ℓ ℓ /4 , ℓ 2 ℓ ) -list recoverable. Let C : = { ( c 1 , … , c ℓ ) ∣ ( c 1 , … , c ℓ + 1 ) ∈ C ′ } C := \{(c_1,\ldots,c_\ell) \mid(c_1,\ldots,c_{\ell+1}) \in C'\} C := {( c 1 , … , c ℓ ) ∣ ( c 1 , … , c ℓ + 1 ) ∈ C ′ } be the punctured version of C ′ C' C ′ . Since the codewords in C ′ C' C ′ can be uniquely recovered by their marginals from C C C , the list-recoverability property is retained with a slightly weaker relative parameter: 1 − ( 1 − 9 / 16 ) ( ℓ + 1 ) / ℓ = 9 / 16 − 7 / ( 16 ℓ ) 1-(1-9/16)(\ell+1)/\ell= 9/16-7/(16\ell) 1 − ( 1 − 9/16 ) ( ℓ + 1 ) / ℓ = 9/16 − 7/ ( 16 ℓ ) . Hence by Claim 11 we have that E C : = { e c ∣ c ∈ C } E_C := \{e_c \mid c \in C\} E C := { e c ∣ c ∈ C } is ( 7 ℓ / 16 + O ( 1 ) , ℓ ℓ / 4 , ℓ 2 ℓ ) (7\ell/16+O(1),\ell^{\ell/4},\ell^{2\sqrt{\ell}}) ( 7 ℓ /16 + O ( 1 ) , ℓ ℓ /4 , ℓ 2 ℓ ) -well-spread, which trivially implies the required well-spreadness since 3 τ / 2 = 9 ℓ / 16 ≥ 7 ℓ / 16 + O ( 1 ) 3\tau/2=9\ell/16 \ge7\ell/16+O(1) 3 τ /2 = 9 ℓ /16 ≥ 7 ℓ /16 + O ( 1 ) for large enough ℓ \ell ℓ .
Let us check the distance property of E C E_C E C . For two edges e ≠ e ′ ∈ E C e \ne e' \in E_C e = e ′ ∈ E C let c c c and c ′ c' c ′ be the codewords from C C C corresponding to them. Then ∣ e ∩ e ′ ∣ ≤ ∣ { i ∈ [ ℓ ] ∣ c i = c i ′ } ∣ ≤ d / m = τ |e \cap e'| \le|\{i \in[\ell] \mid c_i=c'_i\}| \le d/m=\tau ∣ e ∩ e ′ ∣ ≤ ∣ { i ∈ [ ℓ ] ∣ c i = c i ′ } ∣ ≤ d / m = τ . The last inequality holds, since otherwise two polynomials agree on > d >d > d points which implies c = c ′ c=c' c = c ′ .
Finally, we establish efficient τ \tau τ -balancedness of E C E_C E C . Take a point x = γ m ℓ + 1 ∈ F ℓ 2 x=\gamma^{m\ell+1}\in\mathbb{F}_{\ell^2} x = γ m ℓ + 1 ∈ F ℓ 2 and fix a function κ : F ℓ 2 → { ± 1 } \kappa:\mathbb{F}_{\ell^2}\to\{\pm1\} κ : F ℓ 2 → { ± 1 } that satisfies ∑ y ∈ F ℓ 2 κ ( y ) = 0 \sum_{y\in\mathbb{F}_{\ell^2}}\kappa(y)=0 ∑ y ∈ F ℓ 2 κ ( y ) = 0 . Then for an edge e e e that corresponds to a codeword defined by the polynomial p e p_e p e define ϵ e : = κ ( p e ( x ) ) \epsilon_e:=\kappa(p_e(x)) ϵ e := κ ( p e ( x )) . Now fix some R ∈ ( [ ℓ ] × Γ < τ ) R\in\binom{[\ell]\times\Gamma}{<\tau} R ∈ ( < τ [ ℓ ] × Γ ) (the case ∣ R ∣ < τ |R|<\tau ∣ R ∣ < τ is handled below). We need to show that ∑ e ⊇ R ϵ e = 0 \sum_{e\supseteq R}\epsilon_e=0 ∑ e ⊇ R ϵ e = 0 . If R R R contains two points whose first coordinates coincide, then no edge contains R R R and the equality is trivial. Then R R R has at most one point in each set { i } × Γ \{i\}\times\Gamma { i } × Γ , so the condition e ⊇ R e\supseteq R e ⊇ R fixes the polynomial p e p_e p e in τ m = d \tau m=d τ m = d points. Fixing p e ( x ) = y p_e(x)=y p e ( x ) = y to any value y ∈ F ℓ 2 y\in\mathbb{F}_{\ell^2} y ∈ F ℓ 2 fixes the polynomial p e p_e p e , so there exists exactly one such polynomial q y q_y q y for every y y y . Hence ∑ e ⊇ R ϵ e = ∑ y ∈ F ℓ 2 κ ( y ) = 0 \sum_{e\supseteq R}\epsilon_e=\sum_{y\in\mathbb{F}_{\ell^2}}\kappa(y)=0 ∑ e ⊇ R ϵ e = ∑ y ∈ F ℓ 2 κ ( y ) = 0 .
In order to show that there is an efficient involution that matches the edges of opposite signs, choose κ ( y ) : = ( − 1 ) \kappa(y):=(-1) κ ( y ) := ( − 1 ) the first bit in the representation of y y y . Then in order to match-up the opposite-sign edges, given e e e and a valid R R R compute y = p e ( x ) y=p_e(x) y = p e ( x ) and take y ′ y' y ′ be the result of flipping the first bit in y y y . Then let e ′ e' e ′ be the result of the interpolation of a polynomial with p e ′ ( x ) = y ′ p_{e'}(x)=y' p e ′ ( x ) = y ′ and the d d d points defined by R R R .
Now let us verify τ \tau τ -balancedness for R ∈ ( [ ℓ ] × Γ ≤ τ ) R\in\binom{[\ell]\times\Gamma}{\le\tau} R ∈ ( ≤ τ [ ℓ ] × Γ ) , again we may assume wlog that R R R contains at most one point in each set { i } × Γ \{i\}\times\Gamma { i } × Γ , let I : = { i ∈ [ ℓ ] ∣ R ∩ ( { i } × Γ ) ≠ ∅ } I:=\{i\in[\ell]\mid R\cap(\{i\}\times\Gamma)\ne\varnothing\} I := { i ∈ [ ℓ ] ∣ R ∩ ({ i } × Γ ) = ∅ } . Fix a canonical I ′ ⊇ I I'\supseteq I I ′ ⊇ I of size exactly τ \tau τ , and define σ R ( e ) : = σ R ′ ( e ) \sigma_R(e):=\sigma_{R'}(e) σ R ( e ) := σ R ′ ( e ) where R ′ : = ( I ′ × Γ ) ∩ e R':=(I'\times\Gamma)\cap e R ′ := ( I ′ × Γ ) ∩ e .
Proof of Corollary 12 We use the following fact.
Fact 2 (restatement of [YZ24, Lemma 4.3], originally from [Rud07, Section 3.6]). Suppose m m m divides n = ∣ F ∣ − 1 n=|\mathbb{F}|-1 n = ∣ F ∣ − 1 . Let α , β \alpha,\beta α , β be positive integers and s ≤ m s\le m s ≤ m , δ ∈ ( 0 , 1 ) \delta\in(0,1) δ ∈ ( 0 , 1 ) be a real and suppose the following inequalities hold:
( 1 − δ ) n m ≥ ( 1 + s β ) ⋅ ( n α s ) 1 / ( s + 1 ) m − s + 1 ( β + s ) ( n α d ) 1 / ( s + 1 ) < ∣ F ∣ . \frac{(1-\delta)n}{m} \ge\left(1+\frac{s}{\beta}\right)\cdot\frac{(n\alpha^s)^{1/(s+1)}}{m-s+1}
\qquad
(\beta+s)\left(\frac{n\alpha}{d}\right)^{1/(s+1)}<|\mathbb{F}|. m ( 1 − δ ) n ≥ ( 1 + β s ) ⋅ m − s + 1 ( n α s ) 1/ ( s + 1 ) ( β + s ) ( d n α ) 1/ ( s + 1 ) < ∣ F ∣. Then FoldedRS F , γ , d m \operatorname{FoldedRS}^{m}_{\mathbb{F},\gamma,d} FoldedRS F , γ , d m is ( δ , α , ∣ F ∣ s ) (\delta,\alpha,|\mathbb{F}|^s) ( δ , α , ∣ F ∣ s ) -list recoverable.
Proof of Corollary 12. Instantiate Fact 2 with the following parameters:
∣ F ∣ = ℓ 2 ; m = ℓ − 1 ; τ = 3 ℓ / 8 ; s = ℓ ; β = ℓ ; d = τ m . |F| = \ell^2;\quad m = \ell- 1;\quad\tau= 3\ell/8;\quad s = \sqrt{\ell};\quad\beta= \ell;\quad d = \tau m. ∣ F ∣ = ℓ 2 ; m = ℓ − 1 ; τ = 3 ℓ /8 ; s = ℓ ; β = ℓ ; d = τ m .
Then for δ ∈ ( 0 , 1 ) \delta\in(0,1) δ ∈ ( 0 , 1 ) , α ∈ Z > 0 \alpha\in\mathbb{Z}_{>0} α ∈ Z > 0 , it suffices to verify that:
( 1 − δ ) ≥ 3 / 8 ( 1 + o ( 1 ) ) α 1 / ( 1 + ℓ ) (1-\delta) \geq3/8(1+o(1))\alpha^{1/(1+\sqrt{\ell})} ( 1 − δ ) ≥ 3/8 ( 1 + o ( 1 )) α 1/ ( 1 + ℓ )
( 1 + o ( 1 ) ) ( 8 α / 3 ) 1 / ( 1 + ℓ ) < ℓ , (1+o(1))(8\alpha/3)^{1/(1+\sqrt{\ell})} < \ell, ( 1 + o ( 1 )) ( 8 α /3 ) 1/ ( 1 + ℓ ) < ℓ ,
for the conclusion of Fact 2 to hold. Setting α = ℓ ℓ 1 / 4 \alpha= \ell^{\ell^{1/4}} α = ℓ ℓ 1/4 and δ = 9 / 16 \delta= 9/16 δ = 9/16 , we get the claim. □
Assembling the proof of Theorem 1
Proof of Theorem 1. Let ℓ \ell ℓ be a sufficiently large power of 4 and use the graph constructed in Theorem 10 , with parameters N = ℓ ∣ Γ ∣ = ℓ 2 ℓ − 1 N = \ell|\Gamma| = \ell^{2\ell-1} N = ℓ ∣Γ∣ = ℓ 2 ℓ − 1 , τ = 3 ℓ / 8 \tau= 3\ell/8 τ = 3 ℓ /8 , a = ℓ ℓ 1 / 4 a = \ell^{\ell^{1/4}} a = ℓ ℓ 1/4 , b = ℓ 2 ℓ b = \ell^{2\sqrt{\ell}} b = ℓ 2 ℓ . By Theorem 2, every decision tree of depth at most a a a solves Singleton G \operatorname{Singleton}_{G} Singleton G with probability at most
O ( b ) exp ( − Ω ( τ ) ) = exp ( O ( ℓ log ℓ ) − Ω ( ℓ ) ) = exp ( − Ω ( ℓ ) ) . O(b)\exp(-\Omega(\tau)) = \exp(O(\sqrt{\ell}\log\ell)-\Omega(\ell)) = \exp(-\Omega(\ell)). O ( b ) exp ( − Ω ( τ )) = exp ( O ( ℓ log ℓ ) − Ω ( ℓ )) = exp ( − Ω ( ℓ )) .
Since log N = Θ ( ℓ log ℓ ) \log N = \Theta(\ell\log\ell) log N = Θ ( ℓ log ℓ ) , this covers every depth exp ( ( log N ) o ( 1 ) ) \exp((\log N)^{o(1)}) exp (( log N ) o ( 1 ) ) and gives success at most exp ( − ( log N ) Ω ( 1 ) ) \exp(-(\log N)^{\Omega(1)}) exp ( − ( log N ) Ω ( 1 ) ) . Efficient τ \tau τ -balancedness and ℓ = poly ( log N ) \ell= \operatorname{poly}(\log N) ℓ = poly ( log N ) give Singleton G ∈ PPAD \operatorname{Singleton}_{G} \in\operatorname{PPAD} Singleton G ∈ PPAD by Theorem 7 .
Set Σ = { ⊥ } ∪ [ τ ] \Sigma= \{\bot\} \cup[\tau] Σ = { ⊥ } ∪ [ τ ] and define ( u , e ) ∈ F N (u,e) \in F_N ( u , e ) ∈ F N iff ( h u , e ) ∈ Singleton G (h_u,e) \in\operatorname{Singleton}_{G} ( h u , e ) ∈ Singleton G , where h u ( i ) = ⊥ h_u(i) = \bot h u ( i ) = ⊥ for i ∈ [ ℓ ] i \in[\ell] i ∈ [ ℓ ] and h u ( i ) = u i h_u(i) = u_i h u ( i ) = u i otherwise. Then F N ∈ PPAD F_N \in\operatorname{PPAD} F N ∈ PPAD , and uniform u ∈ Σ N u \in\Sigma^N u ∈ Σ N induces uniform h u ∈ H h_u \in\mathcal{H} h u ∈ H . Fixing the ignored coordinates u 1 , … , u ℓ u_1,\ldots,u_\ell u 1 , … , u ℓ and averaging transfers the same decision-tree lower bound to F N F_N F N , proving the theorem. □
Corollary: EoPL is not in FP
We will use the following claim that allows us to combine two TFNP search problems. The proof is straightforward.
Claim 13. Let F = { F N ⊆ Σ N × O } F = \{F_N \subseteq\Sigma^N \times\mathcal{O}\} F = { F N ⊆ Σ N × O } and G = { G N ⊆ Σ N × O ′ } G = \{G_N \subseteq\Sigma^N \times\mathcal{O}'\} G = { G N ⊆ Σ N × O ′ } be two arbitrary TFNP search problems. Define H = { H N ⊆ Σ N × ( O ∪ O ′ ) } H = \{H_N \subseteq\Sigma^N \times(\mathcal{O} \cup\mathcal{O}')\} H = { H N ⊆ Σ N × ( O ∪ O ′ )} by
( u , v ) ∈ H N ⟺ ( u , v ) ∈ F N or ( u , v ) ∈ G N . (u,v) \in H_N \Longleftrightarrow(u,v) \in F_N \text{ or } (u,v) \in G_N. ( u , v ) ∈ H N ⟺ ( u , v ) ∈ F N or ( u , v ) ∈ G N . Then,
H H H is efficiently reducible to either of F F F and G G G .
If any depth-q q q decision tree solves F F F and G G G with probability at most ϵ F \epsilon_F ϵ F and ϵ G \epsilon_G ϵ G over u ∼ Σ N u \sim\Sigma^N u ∼ Σ N , respectively, then any depth-q q q decision tree solves H H H with probability at most ϵ F + ϵ G \epsilon_F + \epsilon_G ϵ F + ϵ G over u ∼ Σ N u \sim\Sigma^N u ∼ Σ N .
The following is a direct corollary from the hardness of PPAD (Theorem 1), the hardness of PLS ([BG20])4 , the collapse PPAD ∩ PLS = EoPL \operatorname{PPAD} \cap\operatorname{PLS} = \operatorname{EoPL} PPAD ∩ PLS = EoPL ([GHJ+22, Theorem 1]), and Claim 13 . We note that ϵ PLS \epsilon_{\operatorname{PLS}} ϵ PLS supplied by [7 Theorems 36 and 43] is o ( 1 ) o(1) o ( 1 ) .
Corollary 14. There exists a TFNP search problem F = { F N ⊆ Σ N × O } F = \{F_N \subseteq\Sigma^N \times\mathcal{O}\} F = { F N ⊆ Σ N × O } in EoPL \operatorname{EoPL} EoPL satisfying that: every decision tree T T T with depth at most exp ( ( log N ) o ( 1 ) ) \exp((\log N)^{o(1)}) exp (( log N ) o ( 1 ) ) solves F F F with probability at most
Pr u ∼ Σ N [ ( u , T ( u ) ) ∈ F N ] = o ( 1 ) . \Pr_{u \sim\Sigma^N}[(u,T(u)) \in F_N] = o(1). u ∼ Σ N Pr [( u , T ( u )) ∈ F N ] = o ( 1 ) .
In particular, EoPL ̸ ⊆ ROM FP \operatorname{EoPL} \not\subseteq_{\operatorname{ROM}} \operatorname{FP} EoPL ⊆ ROM FP .
Efficient search for UEoPL in the black-box ROM
In this section we show that UEoPL is easy in the random oracle model: every instance that is generated from the oracle by shallow decision trees can be solved, with high probability over the oracle, by a shallow decision tree. We use the definition of UEoPL from [29 Section 3.2] , which we reproduce here.
Definition 3 (UEoPLN _N N [29 Section 3.2] ). Let N ≥ 2 N \ge2 N ≥ 2 . As input we are given a successor Succ u ∈ [ N ] ∪ { ⊥ } \operatorname{Succ}_u \in[N] \cup\{\perp\} Succ u ∈ [ N ] ∪ { ⊥ } for each u ∈ [ N ] × [ N ] u \in[N] \times[N] u ∈ [ N ] × [ N ] and a predecessor Pred u ∈ [ N ] ∪ { ⊥ } \operatorname{Pred}_u \in[N] \cup\{\perp\} Pred u ∈ [ N ] ∪ { ⊥ } for each u ∈ { 2 , … , N } × [ N ] u \in\{2,\ldots,N\} \times[N] u ∈ { 2 , … , N } × [ N ] . A node ( i , j ) ∈ [ N − 1 ] × [ N ] (i,j) \in[N-1] \times[N] ( i , j ) ∈ [ N − 1 ] × [ N ] is active if Succ i j = k ≠ ⊥ \operatorname{Succ}_{ij}=k \ne\perp Succ ij = k = ⊥ and Pred i + 1 , k = j \operatorname{Pred}_{i+1,k}=j Pred i + 1 , k = j , otherwise it is inactive; a node ( i , j ) ∈ { N } × [ N ] (i,j) \in\{N\} \times[N] ( i , j ) ∈ { N } × [ N ] is active if Succ i j ≠ ⊥ \operatorname{Succ}_{ij} \ne\perp Succ ij = ⊥ and inactive otherwise. A node u u u is a proper sink if u u u is inactive but some active node has u u u as a successor. A node ( i , j ) (i,j) ( i , j ) is a proper source if it is active, i < N i<N i < N , and no active node has ( i , j ) (i,j) ( i , j ) as a successor. The goal is to output any of the following
( 1 , 1 ) (1,1) ( 1 , 1 ) , if ( 1 , 1 ) (1,1) ( 1 , 1 ) is inactive, (inactive distinguished source)
( N , j ) (N,j) ( N , j ) , if ( N , j ) (N,j) ( N , j ) is active, (active sink)
( i , j ) (i,j) ( i , j ) , if ( i , j ) (i,j) ( i , j ) is a proper sink, (proper sink)
( i , j ) (i,j) ( i , j ) , if ( i , j ) ≠ ( 1 , 1 ) (i,j) \ne(1,1) ( i , j ) = ( 1 , 1 ) and ( i , j ) (i,j) ( i , j ) is a proper source, (proper source)
( i , j ) (i,j) ( i , j ) and ( i , j ′ ) (i,j') ( i , j ′ ) , if j ≠ j ′ j \ne j' j = j ′ and both nodes are active. (two parallel lines)
Formally, UEoPLN _N N is the set of all pairs ( x , z ) (x,z) ( x , z ) such that x x x is an input as above and z z z is one of the outputs listed for x x x . We call x x x an instance and z z z a solution of x x x .
Here the successor Succ v = k ≠ ⊥ \operatorname{Succ}_v=k \ne\perp Succ v = k = ⊥ of a node v = ( i , j ) v=(i,j) v = ( i , j ) with i < N i<N i < N is interpreted as naming the node ( i + 1 , k ) (i+1,k) ( i + 1 , k ) on the next row, and we also call this node the successor of v v v . A solution always exists: if ( 1 , 1 ) (1,1) ( 1 , 1 ) is active, then following successors from ( 1 , 1 ) (1,1) ( 1 , 1 ) traces a path that advances by one row with every step and ends in a proper sink or in an active node of the last row.
A proper sink u = ( i , j ) u=(i,j) u = ( i , j ) is locally verified by checking that i > 1 i>1 i > 1 , Pred u = p ≠ ⊥ \operatorname{Pred}_u=p \ne\perp Pred u = p = ⊥ , Succ i − 1 , p = j \operatorname{Succ}_{i-1,p}=j Succ i − 1 , p = j , and u u u is inactive. The two pointer equalities certify an incoming edge from an active node, and inactivity is checked with at most two further pointer evaluations.
Instances in the random oracle model. An instance is generated from the oracle u ∈ { 0 , 1 } N u \in\{0,1\}^{N} u ∈ { 0 , 1 } N by a decision forest ω \omega ω : every successor Succ v \operatorname{Succ}_v Succ v and predecessor Pred v \operatorname{Pred}_v Pred v of the instance ω ( u ) \omega(u) ω ( u ) is computed by a decision tree that queries bits of u u u and outputs an element of [ N ] ∪ { ⊥ } [N] \cup\{\perp\} [ N ] ∪ { ⊥ } . We write q q q for the maximum depth of the decision trees in ω \omega ω .
Theorem 15. Let N ≥ 2 N \ge2 N ≥ 2 and q ≥ 1 q \ge1 q ≥ 1 , and let ω \omega ω be a decision forest that generates instances of UEoPLN _N N and computes every pointer in depth at most q q q . Then there is a decision tree T T T of depth poly ( q ) ⋅ log N \operatorname{poly}(q) \cdot\log N poly ( q ) ⋅ log N such that
Pr u ∼ { 0 , 1 } N [ ( ω ( u ) , T ( u ) ) ∈ U E o P L N ] ≥ 2 3 . \Pr_{u \sim\{0,1\}^{N}}\left[(\omega(u),T(u)) \in\mathrm{UEoPL}_N\right] \ge\frac{2}{3}. u ∼ { 0 , 1 } N Pr [ ( ω ( u ) , T ( u )) ∈ UEoPL N ] ≥ 3 2 . Moreover, for every u ∈ { 0 , 1 } N u \in\{0,1\}^{N} u ∈ { 0 , 1 } N , the output T ( u ) T(u) T ( u ) is either a solution of ω ( u ) \omega(u) ω ( u ) or the failure symbol fail.
Remark on upper bounds in the decision tree setting. Theorem 15 bounds the number of oracle queries, not the computation: the tree T T T is shown to exist, and nothing is claimed about computing it. This is likely unavoidable, since UEoPL is hard in the white-box random oracle model under a complexity assumption [19 ] .
Restrictions. A restriction ρ \rho ρ assigns values to finitely many bits of the oracle, and cube ( ρ ) ⊆ { 0 , 1 } N \operatorname{cube}(\rho) \subseteq\{0,1\}^{N} cube ( ρ ) ⊆ { 0 , 1 } N is the set of oracles that agree with ρ \rho ρ . We write Pr ρ \Pr_{\rho} Pr ρ and E ρ \mathbb{E}_{\rho} E ρ for probability and expectation over u ∼ cube ( ρ ) u \sim\operatorname{cube}(\rho) u ∼ cube ( ρ ) . A decision tree on cube ( ρ ) \operatorname{cube}(\rho) cube ( ρ ) queries only bits that are not fixed by ρ \rho ρ .
Decision tree families. Throughout, a family of decision trees f = ( f y ) y ∈ Y f=(f_y)_{y\in Y} f = ( f y ) y ∈ Y with f y : { 0 , 1 } N → { 0 , 1 } f_y:\{0,1\}^{N}\to\{0,1\} f y : { 0 , 1 } N → { 0 , 1 } accepts the label y ∈ Y y\in Y y ∈ Y on u u u if f y ( u ) = 1 f_y(u)=1 f y ( u ) = 1 ; the failure symbol fail is never accepted. We say that a decision tree D : { 0 , 1 } N → Y ∪ { f a i l } D:\{0,1\}^{N}\to Y\cup\{\mathrm{fail}\} D : { 0 , 1 } N → Y ∪ { fail } certifies the label y ∈ Y y\in Y y ∈ Y on u u u if, before outputting y y y , it has queried all the bits fixed by some accepting leaf of f y f_y f y that u u u reaches; in that case, f f f accepts y y y on every oracle that agrees with the queried bits.
The proof of Theorem 15 relies on the following lemma, which does not refer to UEoPL.
Lemma 16. For every q ≥ 1 q \ge1 q ≥ 1 there are a = O ( q 2 ) a = O(q^2) a = O ( q 2 ) and η = Θ ( 1 / q ) \eta= \Theta(1/q) η = Θ ( 1/ q ) such that the following holds. Let f = ( f y ) y ∈ Y f = (f_y)_{y \in Y} f = ( f y ) y ∈ Y be a finite family of decision trees f y : { 0 , 1 } N → { 0 , 1 } f_y : \{0,1\}^{N} \to\{0,1\} f y : { 0 , 1 } N → { 0 , 1 } of depth at most q q q and let D : { 0 , 1 } N → Y ∪ { f a i l } D : \{0,1\}^{N} \to Y \cup\{\mathrm{fail}\} D : { 0 , 1 } N → Y ∪ { fail } be a decision tree of depth t t t such that
Pr u ∼ { 0 , 1 } N [ f accepts D ( u ) on u ] ≥ 1 − η . \Pr_{u \sim\{0,1\}^{N}}[f\text{ accepts }D(u)\text{ on }u] \ge1-\eta. u ∼ { 0 , 1 } N Pr [ f accepts D ( u ) on u ] ≥ 1 − η . Then at least one of the following holds.
There is a decision tree T 1 : { 0 , 1 } N → Y ∪ { f a i l } T_1 : \{0,1\}^{N} \to Y \cup\{\mathrm{fail}\} T 1 : { 0 , 1 } N → Y ∪ { fail } of depth at most a a a such that Pr u [ T 1 ( u ) ≠ f a i l ] ≥ 1 / 2 \Pr_u[T_1(u) \ne\mathrm{fail}] \ge1/2 Pr u [ T 1 ( u ) = fail ] ≥ 1/2 , and T 1 T_1 T 1 certifies T 1 ( u ) T_1(u) T 1 ( u ) on u u u whenever T 1 ( u ) ≠ f a i l T_1(u) \ne\mathrm{fail} T 1 ( u ) = fail .
There is a decision tree T 2 : { 0 , 1 } N → ( Y 2 ) ∪ { f a i l } T_2 : \{0,1\}^{N} \to\binom{Y}{2} \cup\{\mathrm{fail}\} T 2 : { 0 , 1 } N → ( 2 Y ) ∪ { fail } of depth O ( t + a ) O(t+a) O ( t + a ) such that Pr u [ T 2 ( u ) ≠ f a i l ] ≥ η \Pr_u[T_2(u) \ne\mathrm{fail}] \ge\eta Pr u [ T 2 ( u ) = fail ] ≥ η , and T 2 T_2 T 2 certifies both labels of T 2 ( u ) T_2(u) T 2 ( u ) on u u u whenever T 2 ( u ) ≠ f a i l T_2(u) \ne\mathrm{fail} T 2 ( u ) = fail .
In both cases the tree queries only bits that D D D or some f y f_y f y queries.
Remark 1. Lemma 16 is a decision-tree form of [3 Corollary 5.4] . The idea that a search problem with (almost) unique solutions cannot be hard relative to a random oracle goes back to Rudich [Rud88]; his conjecture was proved by Kahn, Saks, and Smyth [51 ] via the dual BKR inequality, which [32 ] and then [3 ] applied to verifiable delay functions and proofs of work. The proof below does not use the BKR inequality.
Intuition behind Lemma 16. In § 5.1 we prove our UEoPL upper bound (Theorem 15) by applying Lemma 16 recursively, where Y Y Y will correspond to the set of nodes in a row of the UEoPL instance, and the decision tree family ( f y ) y ∈ Y (f_y)_{y \in Y} ( f y ) y ∈ Y will be the depth-2 q 2q 2 q decision trees checking whether node y y y is active. Therefore “f f f accepts y ∈ Y y \in Y y ∈ Y on u u u ” means that node y y y in this row is active on input u u u , and “D D D certifies y y y on u u u ” means that D D D outputs y y y after reading a certificate that y y y is active. In this context, Lemma 16 gives a win-win dichotomy applied to this row of nodes. Informally it states: Let D D D be any decision tree (of potentially very large depth t ≫ q t \gg q t ≫ q ) that outputs an active node in this row with probability at least 1 − η 1-\eta 1 − η . Then at least one of the following holds: (1) There is a shallow decision tree T 1 T_1 T 1 (of depth at most O ( q 2 ) O(q^2) O ( q 2 ) ) such that T 1 ( u ) T_1(u) T 1 ( u ) outputs an active node in this row with probability at least 1 / 2 1/2 1/2 , and furthermore T 1 ( u ) T_1(u) T 1 ( u ) always outputs either an active node or fail; or (2) There is a decision tree T 2 T_2 T 2 of depth O ( t + a ) O(t+a) O ( t + a ) such that T 2 ( u ) T_2(u) T 2 ( u ) outputs two distinct active nodes in this row with probability at least η \eta η , and furthermore T 2 ( u ) T_2(u) T 2 ( u ) always outputs either 2 active nodes or fail.
Why should we expect such a win-win situation? Think of each accepting leaf of an activity tree f y f_y f y as a certificate: a small restriction ρ \rho ρ that guarantees that y y y is active for all u u u consistent with ρ \rho ρ . The tree D D D (however deep it is) is assumed to almost always output an active node, so almost every oracle u u u is active for at least one node, namely the one that D ( u ) D(u) D ( u ) outputs. Now there are two cases: either (1) the certificates corresponding to accepting leaves of ( f y ) y ∈ Y (f_y)_{y \in Y} ( f y ) y ∈ Y are almost disjoint, or (2) they overlap substantially. In case (1), D D D was never needed: we can construct a shallow tree T 1 T_1 T 1 that finds the unique active node in this row by applying a robust version of the classic result (due to Nisan) showing that any Boolean function represented by a disjoint q q q -DNF can be transformed into a depth O ( q 2 ) O(q^2) O ( q 2 ) decision tree. In case (2), since the certificates overlap, on many input oracles u u u , D ( u ) D(u) D ( u ) outputs one active node while u u u is also consistent with a different certificate. Such u u u 's have at least 2 active nodes, which in UEoPL is a solution! In this second case using a sensitivity argument it is shown that the tree T 2 T_2 T 2 obtained by running D D D twice, once on u u u and once on a slightly perturbed copy of u u u , tends to output two active nodes. In this second case even though the depth of T 2 T_2 T 2 is close to that of D D D , we get a big win since T 2 T_2 T 2 outputs an actual solution. As we explain below, we avoid incurring the expensive cost of running this high depth tree recursively by delaying running it until the end where it is only run once.
Proof of Theorem 15
Fix ω \omega ω and q q q as in Theorem 15. Throughout the algorithm, ρ \rho ρ denotes the restriction that records the answers to all queries made so far. It is a single global object: every subroutine reads it, and every query that any subroutine makes extends it. For an algorithm A A A that queries the oracle, we write Q ( A ) Q(A) Q ( A ) for the number of queries that A A A makes, and call E ρ [ Q ( A ) ] \mathbb{E}_{\rho}[Q(A)] E ρ [ Q ( A )] the expected query complexity of A A A on cube ( ρ ) \operatorname{cube}(\rho) cube ( ρ ) . A property ω ( u ) \omega(u) ω ( u ) holds on cube ( ρ ) \operatorname{cube}(\rho) cube ( ρ ) if it holds for every u ∈ cube ( ρ ) u \in\operatorname{cube}(\rho) u ∈ cube ( ρ ) .
Activity trees. For a node v v v , let act v ( u ) ∈ { 0 , 1 } \operatorname{act}_{v}(u) \in\{0,1\} act v ( u ) ∈ { 0 , 1 } indicate whether v v v is active in ω ( u ) \omega(u) ω ( u ) . This is computed by a decision tree of depth at most 2 q 2q 2 q , which evaluates Succ v \operatorname{Succ}_{v} Succ v and then, if v v v is not in the last row and Succ v ≠ ⊥ \operatorname{Succ}_{v} \ne\bot Succ v = ⊥ , the predecessor of the successor of v v v . For a row b ∈ [ N ] b \in[N] b ∈ [ N ] , let act b : = ( act ( b , j ) ) j ∈ [ N ] \operatorname{act}^{b} := (\operatorname{act}_{(b,j)})_{j \in[N]} act b := ( act ( b , j ) ) j ∈ [ N ] be the family of these trees for the nodes of row b b b . Throughout the proof, a = O ( q 2 ) a = O(q^{2}) a = O ( q 2 ) and η = Θ ( 1 / q ) \eta= \Theta(1/q) η = Θ ( 1/ q ) are the parameters that Lemma 16 provides for verifier depth 2 q 2q 2 q .
We apply Lemma 16 to a tree D D D on cube ( ρ ) \operatorname{cube}(\rho) cube ( ρ ) and to the trees act b \operatorname{act}^{b} act b with the bits of ρ \rho ρ fixed, which does not increase their depth. These trees, and hence T 1 T_{1} T 1 and T 2 T_{2} T 2 , query no bit that ρ \rho ρ fixes, so for every event E E E determined by their outputs, Pr u ∼ cube ( ρ ) [ E ] = Pr u ∼ { 0 , 1 } N [ E ] \Pr_{u \sim\operatorname{cube}(\rho)}[E] = \Pr_{u \sim\{0,1\}^{N}}[E] Pr u ∼ cube ( ρ ) [ E ] = Pr u ∼ { 0 , 1 } N [ E ] after renaming the free bits. In particular, a label that T 1 T_{1} T 1 or T 2 T_{2} T 2 certifies is accepted on the cube of the restriction obtained after running the tree; for the activity trees this means that the node is active on that cube.
High-level description of the algorithm. The backbone of the algorithm is the recursive subroutine Jump ( v , r ) \operatorname{Jump}(v,r) Jump ( v , r ) , given in Algorithm 1, which jumps from a node v = ( i , j ) v = (i,j) v = ( i , j ) in row i i i to the target row b : = min { i + 2 r , N } b := \min\{i + 2^{r}, N\} b := min { i + 2 r , N } . It is called only on nodes that are active on cube ( ρ ) \operatorname{cube}(\rho) cube ( ρ ) , and it returns one of three things: an active node of row b b b , a solution, or a decision tree that finds a solution with probability at least η \eta η (Claim 18). The third kind of output is explained below.
For r = 0 r = 0 r = 0 the subroutine reads the successor of v v v and tests whether it is active, which gives either a proper sink or an active node of the next row. For r ≥ 1 r \ge1 r ≥ 1 , the obvious way to reach row b b b is by two jumps of 2 r − 1 2^{r-1} 2 r − 1 rows (the solid arrows in Figure 4 ): let C C C be the decision tree that runs Jump ( v , r − 1 ) \operatorname{Jump}(v,r-1) Jump ( v , r − 1 ) and then, from the node v ′ v' v ′ that this returns, Jump ( v ′ , r − 1 ) \operatorname{Jump}(v',r-1) Jump ( v ′ , r − 1 ) . But running C C C at every level would double the number of queries with each level, and log N \log N log N levels would bring us back to Θ ( N ) \Theta(N) Θ ( N ) queries. So, as a rule, we do not run C C C . Instead we use it as the tree D D D of Lemma 16 , applied with the activity trees of row b b b as verifiers: since C C C almost always outputs an active node of row b b b , the lemma provides one of two trees.
Figure 4. One iteration of the loop in Algorithm 1: the two jumps on the left form C C C , T 1 T_1 T 1 (dashed) jumps directly, and T 2 T_2 T 2 outputs two active nodes w , w ′ w,w' w , w ′ of row i + 2 r i+2^r i + 2 r . The dots indicate active nodes at each layer.
In the compression case it provides a tree T 1 T_{1} T 1 of depth a a a , which does not depend on r r r , that outputs an active node of row b b b with probability at least 1 / 2 1/2 1/2 (the dashed arrow in Figure 4 ). We then jump by running T 1 T_{1} T 1 instead of C C C . Since T 1 T_{1} T 1 outputs fail on some oracles, this may fail; but then we have learned at least one new bit, so we repeat the loop with the enlarged restriction.
In the collision case it provides a tree T 2 T_{2} T 2 that outputs two active nodes of row b b b , which is a solution, with probability at least η \eta η . This is as good as a jump (in fact better), except for its cost: the depth of T 2 T_{2} T 2 is of the order of 1 / η 1/\eta 1/ η times the query complexity of C C C . Running it inside the recursion would multiply the cost of every level by 1 / η 1/\eta 1/ η , which compounds over the log N \log N log N levels. So Jump \operatorname{Jump} Jump does not run T 2 T_{2} T 2 , and instead it returns the tree T 2 T_{2} T 2 itself as its output, and every enclosing call returns it as well: a run of C C C that outputs a tree ends the loop of the next level in line 8 which returns the tree, and so on up to Algorithm 2. Thus the whole recursion unwinds at once, with no further queries, and Algorithm 2 runs T 2 T_{2} T 2 a single time. If that run fails, Algorithm 2 restarts Jump ( ( 1 , 1 ) , r ∗ ) \operatorname{Jump}((1,1),r^{*}) Jump (( 1 , 1 ) , r ∗ ) from the enlarged restriction. In this way the factor 1 / η 1/\eta 1/ η is paid once, at the top level, rather than once per level.
The only situation in which C C C itself is run is when it is likely, with probability at least η / 2 \eta/2 η /2 , to output a solution or a tree (line 8). Either output ends the entire computation of Jump ( v , r ) \operatorname{Jump}(v,r) Jump ( v , r ) as just described, so this happens O ( 1 / η ) O(1/\eta) O ( 1/ η ) times per level in expectation (Claim 19). In every other situation C C C outputs an active node of row b b b with probability more than 1 − η / 2 1-\eta/2 1 − η /2 , cutting it off after t = ⌈ 2 E ρ [ Q ( C ) ] / η ⌉ t = \lceil2\mathbb{E}_{\rho}[Q(C)]/\eta\rceil t = ⌈ 2 E ρ [ Q ( C )] / η ⌉ queries (line 10) costs another η / 2 \eta/2 η /2 by Markov’s inequality and yields the tree D D D of bounded depth that Lemma 16 needs.
It is important for the accounting that lines 7, 9, 10 and 11 of Algorithm 1 make no oracle queries: they define trees and compute probabilities and expectations on cube ( ρ ) \operatorname{cube}(\rho) cube ( ρ ) . The recursion is executed only in line 8, and queries are made only in lines 4, 8 and 12.
Algorithm 1 Subroutine JUMP in Algorithm 2.
Input: a node v = ( i , j ) v=(i,j) v = ( i , j ) that is active on cube( ρ ) (\rho) ( ρ ) , and r ≥ 0 r\geq0 r ≥ 0
Output: an active node of row min { i + 2 r , N } \min\{i+2^r,N\} min { i + 2 r , N } , a solution, or a decision tree
if i = N i=N i = N then return the node v v v .
Set b : = min { i + 2 r , N } b:=\min\{i+2^r,N\} b := min { i + 2 r , N } .
if r = 0 r=0 r = 0 then
Query Succ v \operatorname{Succ}_v Succ v and act v ′ \operatorname{act}_{v'} act v ′ , where v ′ : = ( i + 1 , Succ v ) v':=(i+1,\operatorname{Succ}_v) v ′ := ( i + 1 , Succ v ) is the successor of v v v .
return the solution v ′ v' v ′ if v ′ v' v ′ is inactive; the node v ′ v' v ′ otherwise.
loop
Let C C C be the decision tree on cube( ρ ) (\rho) ( ρ ) that runs JUMP( v , r − 1 ) (v,r-1) ( v , r − 1 ) and, if it outputs a node v ′ v' v ′ , runs JUMP( v ′ , r − 1 ) (v',r-1) ( v ′ , r − 1 ) ; C C C outputs the output of the last run.
if Pr ρ [ C \Pr_\rho[C Pr ρ [ C outputs a solution or a tree on u ] ≥ η / 2 u]\geq\eta/2 u ] ≥ η /2 then run C C C and return its output.
Set t : = ⌈ 2 E ρ [ Q ( C ) ] / η ⌉ t:=\lceil2\mathbb{E}_\rho[Q(C)]/\eta\rceil t := ⌈ 2 E ρ [ Q ( C )] / η ⌉ .
Let D D D be C C C cut off after t t t queries, with output fail if C C C is cut off or does not output a node.
Apply Lemma 16 on cube( ρ ) (\rho) ( ρ ) to act b \operatorname{act}_b act b and D D D . if it provides no tree T 1 T_1 T 1 then return the tree T 2 T_2 T 2 .
Run T 1 T_1 T 1 . if T 1 T_1 T 1 outputs a node v ′ v' v ′ then return the node v ′ v' v ′ .
Algorithm 2 The main algorithm.
Input: u ∈ { 0 , 1 } N u\in\{0,1\}^{N} u ∈ { 0 , 1 } N
Output: a solution of ω ( u ) \omega(u) ω ( u )
Query act ( 1 , 1 ) \operatorname{act}_{(1,1)} act ( 1 , 1 ) . if ( 1 , 1 ) (1,1) ( 1 , 1 ) is inactive then return ( 1 , 1 ) (1,1) ( 1 , 1 ) .
Set r ∗ : = ⌈ log 2 N ⌉ r^*:=\lceil\log_2 N\rceil r ∗ := ⌈ log 2 N ⌉ .
loop
Run JUMP( ( 1 , 1 ) , r ∗ ) ((1,1),r^*) (( 1 , 1 ) , r ∗ ) .
If it outputs a node or a solution z z z : return z z z .
If it outputs a decision tree G G G : run G G G , and return its output if it is a solution.
Let r ≥ 0 r\geq0 r ≥ 0 , let ρ \rho ρ be a restriction, and let v = ( i , j ) v=(i,j) v = ( i , j ) be a node that is active on cube( ρ ) (\rho) ( ρ ) . The following four claims are about Jump( v , r ) (v,r) ( v , r ) started from ρ \rho ρ . Claims 17 and 18 are proved together by induction on r r r ; Claims 19 and 20 then follow.
Claim 17. Jump( v , r ) (v,r) ( v , r ) halts on every u ∈ cube ( ρ ) u \in\operatorname{cube}(\rho) u ∈ cube ( ρ ) .
Claim 18. Jump( v , r ) (v,r) ( v , r ) outputs one of the following, where ρ ′ \rho' ρ ′ is the restriction right before it halts:
a node of its target row that is active on cube ( ρ ′ ) \operatorname{cube}(\rho') cube ( ρ ′ ) ;
a solution on cube ( ρ ′ ) \operatorname{cube}(\rho') cube ( ρ ′ ) ;
a decision tree G G G on cube ( ρ ′ ) \operatorname{cube}(\rho') cube ( ρ ′ ) such that G ( u ) G(u) G ( u ) is a solution of ω ( u ) \omega(u) ω ( u ) or fail for every u ∈ cube ( ρ ′ ) u \in\operatorname{cube}(\rho') u ∈ cube ( ρ ′ ) , and Pr ρ ′ [ G ( u ) ≠ f a i l ] ≥ η \Pr_{\rho'}[G(u) \ne\mathrm{fail}] \ge\eta Pr ρ ′ [ G ( u ) = fail ] ≥ η .
Proof of Claim 17. The cases i = N i=N i = N and r = 0 r=0 r = 0 are immediate, so let i < N i<N i < N and r ≥ 1 r\ge1 r ≥ 1 . By Claims 17 and 18 for level r − 1 r-1 r − 1 ,
the tree C C C of line 7 halts, and it outputs a solution or a tree as in Claim 18, or a node of row b b b that is active on the cube of the restriction at that time.
Equation not extracted
(3)
Consider an iteration of the loop, at a restriction ρ \rho ρ , that reaches line 9. Then C C C outputs a solution or a tree with probability less than η / 2 \eta/2 η /2 over cube ( ρ ) \operatorname{cube}(\rho) cube ( ρ ) , and by Markov’s inequality it makes more than t t t queries with probability less than η / 2 \eta/2 η /2 . So, by (1), the tree D D D of line 10 has depth at most t t t and outputs an active node of row b b b with probability more than 1 − η 1-\eta 1 − η , and Lemma 16 applies on cube ( ρ ) \operatorname{cube}(\rho) cube ( ρ ) to act b \operatorname{act}_b act b and D D D . If Jump( v , r ) (v,r) ( v , r ) does not halt in this iteration, then T 1 T_1 T 1 was run and output fail. Since Pr ρ [ T 1 ( u ) ≠ f a i l ] ≥ 1 / 2 \Pr_{\rho}[T_1(u)\ne\mathrm{fail}]\ge1/2 Pr ρ [ T 1 ( u ) = fail ] ≥ 1/2 , the tree T 1 T_1 T 1 cannot output fail without making a query, so the iteration fixes at least one more bit of the oracle. The instance ω ( u ) \omega(u) ω ( u ) depends on only finitely many bits of u u u , and no other bit ever needs to be queried, so there are only finitely many iterations.
Proof of Claim 18. If i = N i=N i = N , then the output is the active node v v v of row b = N b=N b = N . If i < N i<N i < N and r = 0 r=0 r = 0 , the query to Succv _v v fixes its successor v ′ v' v ′ in row b b b on cube ( ρ ′ ) \operatorname{cube}(\rho') cube ( ρ ′ ) . The node v v v remains active on cube ( ρ ′ ) \operatorname{cube}(\rho') cube ( ρ ′ ) , since ρ ′ \rho' ρ ′ extends the starting restriction. If the activity test finds v ′ v' v ′ inactive, its queried transcript certifies inactivity on cube ( ρ ′ ) \operatorname{cube}(\rho') cube ( ρ ′ ) , and the active node v v v witnesses an incoming edge to v ′ v' v ′ . Thus v ′ v' v ′ itself is a proper sink, and hence a solution, throughout cube ( ρ ′ ) \operatorname{cube}(\rho') cube ( ρ ′ ) . Otherwise the activity test certifies that v ′ v' v ′ is active on that cube. If i < N i<N i < N and r ≥ 1 r\ge1 r ≥ 1 , then Jump( v , r ) (v,r) ( v , r ) halts in line 8, 11 or 12.
In line 8 it outputs the output of C C C , which is as claimed by (1).
In line 11 it outputs T 2 T_2 T 2 , which by Lemma 16 outputs a pair of distinct active nodes of row b b b , that is, a solution, with probability at least η \eta η , and fail otherwise.
In line 12 it outputs a node of row b b b that T 1 T_1 T 1 certifies by Lemma 16, hence active on cube ( ρ ′ ) \operatorname{cube}(\rho') cube ( ρ ′ ) .
Claim 19. E ρ [ Q ( J u m p ( v , r ) ) ] = O ( a ( r + 1 ) / η ) \mathbb{E}_{\rho}[\mathrm{Q}(\mathrm{Jump}(v,r))]=O(a(r+1)/\eta) E ρ [ Q ( Jump ( v , r ))] = O ( a ( r + 1 ) / η ) .
Proof. For k ≤ r k\le r k ≤ r , let N k N_k N k be the number of times that Jump( ⋅ , k ) (\cdot,k) ( ⋅ , k ) is run during Jump( v , r ) (v,r) ( v , r ) , and let M k ≤ N k M_k\le N_k M k ≤ N k be the number of those times in which C C C is run in line 8. Then N r = 1 N_r=1 N r = 1 , and N k − 1 ≤ 2 M k N_{k-1}\le2M_k N k − 1 ≤ 2 M k for k ∈ [ r ] k\in[r] k ∈ [ r ] , because Jump( ⋅ , k − 1 ) (\cdot,k-1) ( ⋅ , k − 1 ) is run only inside such a C C C , and at most twice there. By the test in line 8, each time C C C is run it outputs a solution or a tree with probability at least η / 2 \eta/2 η /2 , and then Jump( v , r ) (v,r) ( v , r ) halts without running anything further. Hence E ρ [ M k ] = O ( 1 / η ) \mathbb{E}_{\rho}[M_k]=O(1/\eta) E ρ [ M k ] = O ( 1/ η ) for every k ∈ [ r ] k\in[r] k ∈ [ r ] , and so E ρ [ ∑ k = 1 r N k ] = O ( 1 + r / η ) \mathbb{E}_{\rho}[\sum_{k=1}^{r}N_k]=O(1+r/\eta) E ρ [ ∑ k = 1 r N k ] = O ( 1 + r / η ) .
Each time Jump( ⋅ , k ) (\cdot,k) ( ⋅ , k ) is run, the queries that it makes outside of line 8 are the O ( q ) = O ( a ) O(q)=O(a) O ( q ) = O ( a ) queries of line 4 and the queries of T 1 T_1 T 1 in line 12. Each time T 1 T_1 T 1 is run, it makes at most a a a queries and, with probability at least 1 / 2 1/2 1/2 , outputs a node, upon which Jump( ⋅ , k ) (\cdot,k) ( ⋅ , k ) halts. So these are O ( a ) O(a) O ( a ) queries in expectation, and E ρ [ Q ( J u m p ( v , r ) ) ] = O ( a ) ⋅ O ( 1 + r / η ) = O ( a ( r + 1 ) / η ) \mathbb{E}_{\rho}[\mathrm{Q}(\mathrm{Jump}(v,r))]=O(a)\cdot O(1+r/\eta)=O(a(r+1)/\eta) E ρ [ Q ( Jump ( v , r ))] = O ( a ) ⋅ O ( 1 + r / η ) = O ( a ( r + 1 ) / η ) .
Claim 20. Every tree that Jump( v , r ) (v,r) ( v , r ) outputs has depth O ( a ( r + 1 ) / η 2 ) O(a(r+1)/\eta^2) O ( a ( r + 1 ) / η 2 ) .
Proof. A tree that Jump( v , r ) (v,r) ( v , r ) outputs is the tree T 2 T_2 T 2 in line 11 of Jump( ⋅ , k ) (\cdot,k) ( ⋅ , k ) for some k ∈ [ r ] k\in[r] k ∈ [ r ] . Its depth is O ( t + a ) O(t+a) O ( t + a ) , where t = O ( E ρ [ Q ( C ) ] / η ) = O ( a k / η 2 ) t=O(\mathbb{E}_{\rho}[\mathrm{Q}(C)]/\eta)=O(ak/\eta^2) t = O ( E ρ [ Q ( C )] / η ) = O ( ak / η 2 ) by Claim 19.
Proof of Theorem 15. Consider an iteration of the loop in Algorithm 2 that starts from a restriction ρ \rho ρ . By Claims 17–20, Jump( 1 , 1 ) , r ∗ (1,1),r^* ( 1 , 1 ) , r ∗ makes O ( a r ∗ / η ) O(ar^*/\eta) O ( a r ∗ / η ) queries in expectation, and it outputs a solution or a tree G G G of depth O ( a r ∗ / η 2 ) O(ar^*/\eta^2) O ( a r ∗ / η 2 ) that outputs a solution with probability at least η \eta η . Hence the iteration makes O ( a r ∗ / η 2 ) O(ar^*/\eta^2) O ( a r ∗ / η 2 ) queries in expectation and returns with probability at least η \eta η over cube ( ρ ) \operatorname{cube}(\rho) cube ( ρ ) . So whenever Algorithm 2 halts on u u u , its output is a solution of ω ( u ) \omega(u) ω ( u ) , and its expected query complexity is at most
B = O ( q ) + 1 η ⋅ O ( a r ∗ η 2 ) = poly ( q ) ⋅ log N . B = O(q) + \frac{1}{\eta}\cdot O\left(\frac{ar^*}{\eta^2}\right) = \operatorname{poly}(q)\cdot\log N. B = O ( q ) + η 1 ⋅ O ( η 2 a r ∗ ) = poly ( q ) ⋅ log N .
Let T T T be Algorithm 2 stopped after 3 B 3B 3 B queries, with output fail if it has not halted by then. This is a decision tree of depth at most 3 B 3B 3 B , because an iteration that does not return makes at least one query, as it returns with positive probability over cube ( ρ ) \operatorname{cube}(\rho) cube ( ρ ) . By Markov’s inequality, T T T outputs fail with probability at most 1 / 3 1/3 1/3 .
Proof of Lemma 16
Let f f f and D D D be as in Lemma 16 ; the parameters a a a and η \eta η are chosen in the proof of Lemma 16 below. The trees f y f_y f y and D D D query only finitely many bits, which we rename to 1 , … , K 1,\ldots,K 1 , … , K . Below u u u is uniform over { 0 , 1 } K \{0,1\}^K { 0 , 1 } K , all trees query only these bits, and for a set A ⊆ { 0 , 1 } K A\subseteq\{0,1\}^K A ⊆ { 0 , 1 } K we write Pr [ A ] \Pr[A] Pr [ A ] for Pr [ u ∈ A ] \Pr[u\in A] Pr [ u ∈ A ] . Let
α : = Pr [ f does not accept D ( u ) on u ] , ε : = max E Pr [ f accepts E ( u ) on u , and E ( u ) ≠ D ( u ) ] , \alpha:= \Pr\left[f\text{ does not accept }D(u)\text{ on }u\right],\qquad
\varepsilon:= \max_E \Pr\left[f\text{ accepts }E(u)\text{ on }u,\text{ and }E(u)\ne D(u)\right], α := Pr [ f does not accept D ( u ) on u ] , ε := E max Pr [ f accepts E ( u ) on u , and E ( u ) = D ( u ) ] ,
where the maximum is over all decision trees E : { 0 , 1 } K → Y ∪ { fail } E:\{0,1\}^K\to Y\cup\{\operatorname{fail}\} E : { 0 , 1 } K → Y ∪ { fail } of depth at most t t t .
Let Λ \Lambda Λ be the set of all accepting leaves of the trees f y f_y f y that are reached on some input. For τ ∈ Λ \tau\in\Lambda τ ∈ Λ we write y τ y_\tau y τ for the label of the tree that τ \tau τ belongs to, and B τ ⊆ { 0 , 1 } K B_\tau\subseteq\{0,1\}^K B τ ⊆ { 0 , 1 } K for the subcube of inputs on which f y τ f_{y_\tau} f y τ reaches τ \tau τ ; it fixes at most q q q bits.
Claim 21. There is a set Λ ′ ⊆ Λ \Lambda'\subseteq\Lambda Λ ′ ⊆ Λ such that m ( u ) : = ∣ { τ ∈ Λ ′ : u ∈ B τ } ∣ m(u):=\lvert\{\tau\in\Lambda':u\in B_\tau\}\rvert m ( u ) := ∣{ τ ∈ Λ ′ : u ∈ B τ }∣ satisfies
E ∣ m ( u ) − 1 ∣ ≤ α + O ( q ε ) . \mathbb{E}\lvert m(u)-1\rvert\le\alpha+O(q\varepsilon). E ∣ m ( u ) − 1 ∣ ≤ α + O ( q ε ) .
Claim 22. There is an absolute constant c > 0 c>0 c > 0 such that the following holds. Let ( B τ ) τ ∈ Λ ′ (B_\tau)_{\tau\in\Lambda'} ( B τ ) τ ∈ Λ ′ be a finite family of subcubes of { 0 , 1 } K \{0,1\}^K { 0 , 1 } K , each fixing at most q q q bits, and let m ( u ) : = ∣ { τ ∈ Λ ′ : u ∈ B τ } ∣ m(u):=\lvert\{\tau\in\Lambda':u\in B_\tau\}\rvert m ( u ) := ∣{ τ ∈ Λ ′ : u ∈ B τ }∣ . If E ∣ m ( u ) − 1 ∣ ≤ c \mathbb{E}\lvert m(u)-1\rvert\le c E ∣ m ( u ) − 1 ∣ ≤ c , then there is a decision tree of depth O ( q 2 ) O(q^2) O ( q 2 ) whose output on u u u is either fail or some τ \tau τ with u ∈ B τ u\in B_\tau u ∈ B τ , and which outputs fail with probability at most 1 / 2 1/2 1/2 .
We prove Claim 21 in § 5.3 and Claim 22 in § 5.4 .
Proof of Lemma 16 . Let c c c be the constant of Claim 22 . We choose η = Θ ( 1 / q ) \eta=\Theta(1/q) η = Θ ( 1/ q ) small enough that the bound α + O ( q ε ) \alpha+O(q\varepsilon) α + O ( q ε ) of Claim 21 is at most c c c whenever α ≤ η \alpha\le\eta α ≤ η and ε ≤ 2 η \varepsilon\le2\eta ε ≤ 2 η , and we let a = O ( q 2 ) a=O(q^2) a = O ( q 2 ) be the depth bound of Claim 22 , which we may assume to be at least 2 q 2q 2 q . By the hypothesis on D D D , we have α ≤ η \alpha\le\eta α ≤ η .
Suppose first that ε ≤ 2 η \varepsilon\le2\eta ε ≤ 2 η . By Claim 21 , there is a set Λ ′ \Lambda' Λ ′ of accepting leaves with E ∣ m ( u ) − 1 ∣ ≤ c \mathbb{E}\lvert m(u)-1\rvert\le c E ∣ m ( u ) − 1 ∣ ≤ c . Let T 1 T_1 T 1 run the decision tree of Claim 22 for this family, and output y τ y_\tau y τ if that tree outputs τ \tau τ . Then T 1 T_1 T 1 has depth at most a a a and outputs fail with probability at most 1 / 2 1/2 1/2 . If it outputs y τ y_\tau y τ , then it has queried all bits fixed by B τ B_\tau B τ and u ∈ B τ u\in B_\tau u ∈ B τ , so T 1 T_1 T 1 certifies y τ y_\tau y τ on u u u .
Suppose now that ε > 2 η \varepsilon>2\eta ε > 2 η , and let E E E be a tree that attains the maximum in the definition of ε \varepsilon ε . Let T 2 T_2 T 2 run D D D and E E E ; if D ( u ) D(u) D ( u ) and E ( u ) E(u) E ( u ) are distinct labels in Y Y Y , it then runs f D ( u ) f_{D(u)} f D ( u ) and f E ( u ) f_{E(u)} f E ( u ) and outputs the pair { D ( u ) , E ( u ) } \{D(u),E(u)\} { D ( u ) , E ( u )} if both trees accept; in every other case it outputs fail. Then T 2 T_2 T 2 outputs both labels whenever it does not output fail, it has depth at most 2 t + 2 q = O ( t + a ) 2t+2q=O(t+a) 2 t + 2 q = O ( t + a ) , and
Pr [ T 2 ( u ) ≠ fail ] ≥ ε − α > η . \Pr[T_2(u)\ne\operatorname{fail}]\ge\varepsilon-\alpha>\eta. Pr [ T 2 ( u ) = fail ] ≥ ε − α > η .
Proof of Claim 21
For τ ∈ Λ \tau\in\Lambda τ ∈ Λ , let
A τ : = { u ∈ B τ : D ( u ) = y τ } , θ τ : = Pr [ A τ ] / Pr [ B τ ] , Γ : = ∑ τ ∈ Λ Pr [ A τ ] ( 1 − θ τ ) . A_\tau:=\{u\in B_\tau:D(u)=y_\tau\},\qquad
\theta_\tau:=\Pr[A_\tau]/\Pr[B_\tau],\qquad
\Gamma:=\sum_{\tau\in\Lambda}\Pr[A_\tau](1-\theta_\tau). A τ := { u ∈ B τ : D ( u ) = y τ } , θ τ := Pr [ A τ ] / Pr [ B τ ] , Γ := τ ∈ Λ ∑ Pr [ A τ ] ( 1 − θ τ ) .
The sets A τ A_\tau A τ are pairwise disjoint, since u ∈ A τ u\in A_\tau u ∈ A τ means that τ \tau τ is the leaf that the tree f D ( u ) f_{D(u)} f D ( u ) reaches on u u u . Their union is the event that f f f accepts D ( u ) D(u) D ( u ) , and hence ∑ τ Pr [ A τ ] = 1 − α \sum_\tau\Pr[A_\tau]=1-\alpha ∑ τ Pr [ A τ ] = 1 − α .
Definition 4. Let β ∈ [ 0 , 1 ] \beta\in[0,1] β ∈ [ 0 , 1 ] and u ∈ { 0 , 1 } K \mathbf{u} \in\{0,1\}^{K} u ∈ { 0 , 1 } K . A β \beta β -noisy copy of u \mathbf{u} u is the random string x \mathbf{x} x obtained from u \mathbf{u} u by independently replacing each bit, with probability β \beta β , by a fresh uniform bit.
Claim 23. Let x \mathbf{x} x be a β \beta β -noisy copy of u \mathbf{u} u . Then for every A ⊆ { 0 , 1 } K A \subseteq\{0,1\}^{K} A ⊆ { 0 , 1 } K with p : = Pr [ A ] p := \Pr[A] p := Pr [ A ] ,
Pr [ u ∈ A , x ∉ A ] ≥ β p ( 1 − p ) . \Pr[\mathbf{u} \in A,\ \mathbf{x} \notin A] \ge\beta p(1-p). Pr [ u ∈ A , x ∈ / A ] ≥ β p ( 1 − p ) .
Proof. Let g g g be the indicator of A A A , with Fourier coefficients g ^ ( J ) \widehat{g}(J) g ( J ) for J ⊆ [ K ] J \subseteq[K] J ⊆ [ K ] . Then g ^ ( ∅ ) = p \widehat{g}(\varnothing)=p g ( ∅ ) = p and ∑ J g ^ ( J ) 2 = p \sum_J \widehat{g}(J)^2=p ∑ J g ( J ) 2 = p , so
Pr [ u ∈ A , x ∈ A ] = ∑ J ( 1 − β ) ∣ J ∣ g ^ ( J ) 2 ≤ p 2 + ( 1 − β ) ( p − p 2 ) . \Pr[\mathbf{u} \in A,\ \mathbf{x} \in A] = \sum_J (1-\beta)^{|J|}\widehat{g}(J)^2 \le p^2+(1-\beta)(p-p^2). Pr [ u ∈ A , x ∈ A ] = J ∑ ( 1 − β ) ∣ J ∣ g ( J ) 2 ≤ p 2 + ( 1 − β ) ( p − p 2 ) .
Subtracting this from p p p gives the claim.
Claim 24. Γ = O ( q ε ) \Gamma=O(q\varepsilon) Γ = O ( q ε ) .
Proof. Let x \mathbf{x} x be a β \beta β -noisy copy of u \mathbf{u} u for β : = 1 / ( 2 q ) \beta:=1/(2q) β := 1/ ( 2 q ) , and run D D D on x \mathbf{x} x . The pairs ( u , x ) (\mathbf{u},\mathbf{x}) ( u , x ) and ( x , u ) (\mathbf{x},\mathbf{u}) ( x , u ) have the same distribution. Fix τ ∈ Λ \tau\in\Lambda τ ∈ Λ , and let H τ H_\tau H τ be the event that the noise replaces none of the at most q q q bits fixed by B τ B_\tau B τ , so that Pr [ H τ ] ≥ 1 − q β = 1 / 2 \Pr[H_\tau]\ge1-q\beta=1/2 Pr [ H τ ] ≥ 1 − q β = 1/2 . Conditioned on H τ H_\tau H τ and on u ∈ B τ \mathbf{u}\in B_\tau u ∈ B τ , we have x ∈ B τ \mathbf{x}\in B_\tau x ∈ B τ , and on the bits not fixed by B τ B_\tau B τ the pair ( u , x ) (\mathbf{u},\mathbf{x}) ( u , x ) is distributed as before. Applying Claim 23 inside the subcube B τ B_\tau B τ to the set A τ A_\tau A τ , with the roles of u \mathbf{u} u and x \mathbf{x} x exchanged, we get
Pr [ x ∈ A τ , u ∈ B τ ∖ A τ ] ≥ Pr [ B τ ] ⋅ Pr [ H τ ] ⋅ β θ τ ( 1 − θ τ ) ≥ β 2 Pr [ A τ ] ( 1 − θ τ ) . \Pr[\mathbf{x}\in A_\tau,\ \mathbf{u}\in B_\tau\setminus A_\tau]\ge\Pr[B_\tau]\cdot\Pr[H_\tau]\cdot\beta\theta_\tau(1-\theta_\tau)\ge\frac{\beta}{2}\Pr[A_\tau](1-\theta_\tau). Pr [ x ∈ A τ , u ∈ B τ ∖ A τ ] ≥ Pr [ B τ ] ⋅ Pr [ H τ ] ⋅ β θ τ ( 1 − θ τ ) ≥ 2 β Pr [ A τ ] ( 1 − θ τ ) .
The events on the left-hand side are disjoint for different τ \tau τ , because the sets A τ A_\tau A τ are. On each of them, the label D ( x ) = y τ D(\mathbf{x})=y_\tau D ( x ) = y τ is accepted on u \mathbf{u} u and differs from D ( u ) D(\mathbf{u}) D ( u ) . Therefore
Pr [ f accepts D ( x ) on u , and D ( x ) ≠ D ( u ) ] ≥ β Γ 2 . \Pr[f\text{ accepts }D(\mathbf{x})\text{ on }\mathbf{u},\text{ and }D(\mathbf{x})\ne D(\mathbf{u})]\ge\frac{\beta\Gamma}{2}. Pr [ f accepts D ( x ) on u , and D ( x ) = D ( u )] ≥ 2 β Γ .
Conditioned on which bits are replaced and on their new values, D ( x ) D(\mathbf{x}) D ( x ) is computed from u \mathbf{u} u by a decision tree of depth at most t t t , so this probability is at most ε \varepsilon ε . Hence Γ ≤ 2 ε / β = O ( q ε ) \Gamma\le2\varepsilon/\beta=O(q\varepsilon) Γ ≤ 2 ε / β = O ( q ε ) .
Proof of Claim 21 . Let Λ ′ : = { τ ∈ Λ : θ τ ≥ 1 / 2 } \Lambda' := \{\tau\in\Lambda:\theta_\tau\ge1/2\} Λ ′ := { τ ∈ Λ : θ τ ≥ 1/2 } . If m ( u ) = 0 m(\mathbf{u})=0 m ( u ) = 0 , then either u \mathbf{u} u lies in no set A τ A_\tau A τ , or it lies in A τ A_\tau A τ for some τ ∉ Λ ′ \tau\notin\Lambda' τ ∈ / Λ ′ . Since 1 ≤ 2 ( 1 − θ τ ) 1\le2(1-\theta_\tau) 1 ≤ 2 ( 1 − θ τ ) for τ ∉ Λ ′ \tau\notin\Lambda' τ ∈ / Λ ′ ,
Pr [ m ( u ) = 0 ] ≤ α + ∑ τ ∉ Λ ′ Pr [ A τ ] ≤ α + 2 ∑ τ ∉ Λ ′ Pr [ A τ ] ( 1 − θ τ ) . \Pr[m(\mathbf{u})=0]\le\alpha+\sum_{\tau\notin\Lambda'}\Pr[A_\tau]\le\alpha+2\sum_{\tau\notin\Lambda'}\Pr[A_\tau](1-\theta_\tau). Pr [ m ( u ) = 0 ] ≤ α + τ ∈ / Λ ′ ∑ Pr [ A τ ] ≤ α + 2 τ ∈ / Λ ′ ∑ Pr [ A τ ] ( 1 − θ τ ) .
Since every u \mathbf{u} u lies in at most one of the sets A τ A_\tau A τ , we have max { m ( u ) − 1 , 0 } ≤ ∣ { τ ∈ Λ ′ : u ∈ B τ ∖ A τ } ∣ \max\{m(\mathbf{u})-1,0\}\le|\{\tau\in\Lambda':\mathbf{u}\in B_\tau\setminus A_\tau\}| max { m ( u ) − 1 , 0 } ≤ ∣ { τ ∈ Λ ′ : u ∈ B τ ∖ A τ } ∣ . Hence, using Pr [ B τ ] = Pr [ A τ ] / θ τ ≤ 2 Pr [ A τ ] \Pr[B_\tau]=\Pr[A_\tau]/\theta_\tau\le2\Pr[A_\tau] Pr [ B τ ] = Pr [ A τ ] / θ τ ≤ 2 Pr [ A τ ] for τ ∈ Λ ′ \tau\in\Lambda' τ ∈ Λ ′ ,
E max { m ( u ) − 1 , 0 } ≤ ∑ τ ∈ Λ ′ Pr [ B τ ] ( 1 − θ τ ) ≤ 2 ∑ τ ∈ Λ ′ Pr [ A τ ] ( 1 − θ τ ) . \mathbb{E}\max\{m(\mathbf{u})-1,0\}\le\sum_{\tau\in\Lambda'}\Pr[B_\tau](1-\theta_\tau)\le2\sum_{\tau\in\Lambda'}\Pr[A_\tau](1-\theta_\tau). E max { m ( u ) − 1 , 0 } ≤ τ ∈ Λ ′ ∑ Pr [ B τ ] ( 1 − θ τ ) ≤ 2 τ ∈ Λ ′ ∑ Pr [ A τ ] ( 1 − θ τ ) .
Adding the two bounds gives E ∣ m ( u ) − 1 ∣ ≤ α + 2 Γ \mathbb{E}|m(\mathbf{u})-1|\le\alpha+2\Gamma E ∣ m ( u ) − 1∣ ≤ α + 2Γ , which is α + O ( q ε ) \alpha+O(q\varepsilon) α + O ( q ε ) by Claim 24 .
Proof of Claim 22
We prove Claim 22 with c = 1 / 64 c=1/64 c = 1/64 . Let
W ( u ) : = 1 [ m ( u ) = 0 ] + m ( u ) ⋅ 1 [ m ( u ) ≥ 2 ] . W(\mathbf{u}):=\mathbf{1}[m(\mathbf{u})=0]+m(\mathbf{u})\cdot\mathbf{1}[m(\mathbf{u})\ge2]. W ( u ) := 1 [ m ( u ) = 0 ] + m ( u ) ⋅ 1 [ m ( u ) ≥ 2 ] .
Since W ≤ 2 ∣ m − 1 ∣ W\le2|m-1| W ≤ 2∣ m − 1∣ pointwise, we have E [ W ( u ) ] ≤ 1 / 32 \mathbb{E}[W(\mathbf{u})]\le1/32 E [ W ( u )] ≤ 1/32 . The decision tree is given in Algorithm 3.
Algorithm 3. The decision tree of Claim 22 .
Input: u ∈ { 0 , 1 } K u \in\{0,1\}^{K} u ∈ { 0 , 1 } K
Output: τ ∈ Λ ′ \tau\in\Lambda' τ ∈ Λ ′ with u ∈ B τ u \in B_{\tau} u ∈ B τ , or fail
Initialize σ \sigma σ as the empty restriction.
for k ∈ [ 8 ( q + 1 ) ] k \in[8(q+1)] k ∈ [ 8 ( q + 1 )] do
if E σ [ W ( u ) ] > 1 / 8 \mathbb{E}_{\sigma}[W(u)] > 1/8 E σ [ W ( u )] > 1/8 then return fail.
Set τ ∗ : = arg min τ Pr σ [ m ( u ) ≥ 2 ∣ u ∈ B τ ] \tau^* := \arg\min_{\tau} \Pr_{\sigma}[m(u) \ge2 \mid u \in B_{\tau}] τ ∗ := arg min τ Pr σ [ m ( u ) ≥ 2 ∣ u ∈ B τ ] , where τ \tau τ ranges over Λ ′ \Lambda' Λ ′ with Pr σ [ B τ ] > 0 \Pr_{\sigma}[B_{\tau}] > 0 Pr σ [ B τ ] > 0 .
Query all bits that are fixed by B τ ∗ B_{\tau^*} B τ ∗ but not by σ \sigma σ , and record the answers in σ \sigma σ .
if u ∈ B τ ∗ u \in B_{\tau^*} u ∈ B τ ∗ then return τ ∗ \tau^* τ ∗ .
return fail.
Algorithm 3 makes at most 8 ( q + 1 ) ⋅ q = O ( q 2 ) 8(q+1)\cdot q = O(q^2) 8 ( q + 1 ) ⋅ q = O ( q 2 ) queries, and if it outputs τ \tau τ then u ∈ B τ u \in B_{\tau} u ∈ B τ . There are two cases where it outputs fail:
Algorithm 3 halts in line 3.
Algorithm 3 halts in line 7.
We denote these two events by E 1 E_1 E 1 and E 2 E_2 E 2 respectively.
Claim 25. Pr [ E 1 ] ≤ 1 / 4 \Pr[E_1] \le1/4 Pr [ E 1 ] ≤ 1/4 .
Proof. The restrictions σ \sigma σ at which Algorithm 3 halts in line 3 have disjoint cubes and satisfy E σ W > 1 / 8 \mathbb{E}_{\sigma} W > 1/8 E σ W > 1/8 . As W ≥ 0 W \ge0 W ≥ 0 ,
1 32 ≥ E W ( u ) ≥ ∑ σ Pr [ cube ( σ ) ] ⋅ E σ W ≥ 1 8 Pr [ E 1 ] , \frac{1}{32} \ge\mathbb{E}W(u) \ge\sum_{\sigma}\Pr[\operatorname{cube}(\sigma)]\cdot\mathbb{E}_{\sigma}W \ge\frac{1}{8}\Pr[E_1], 32 1 ≥ E W ( u ) ≥ σ ∑ Pr [ cube ( σ )] ⋅ E σ W ≥ 8 1 Pr [ E 1 ] ,
where the sum is over these restrictions.
Claim 26. Suppose that an iteration of Algorithm 3 reaches line 4 at a restriction σ \sigma σ . Then τ ∗ \tau^* τ ∗ exists, and B ∗ : = B τ ∗ B^* := B_{\tau^*} B ∗ := B τ ∗ satisfies Pr σ [ m ≥ 2 ∣ B ∗ ] ≤ 1 / 7 \Pr_{\sigma}[m \ge2 \mid B^*] \le1/7 Pr σ [ m ≥ 2 ∣ B ∗ ] ≤ 1/7 .
Proof. Let e : = E σ W ≤ 1 / 8 e := \mathbb{E}_{\sigma} W \le1/8 e := E σ W ≤ 1/8 . Since W ≥ 1 [ m ≠ 1 ] W \ge\mathbf{1}[m \ne1] W ≥ 1 [ m = 1 ] , we have Pr σ [ m = 1 ] ≥ 1 − e \Pr_{\sigma}[m = 1] \ge1-e Pr σ [ m = 1 ] ≥ 1 − e . Hence
∑ τ Pr σ [ B τ ] = E σ [ m ] ≥ 1 − e and ∑ τ Pr σ [ B τ ] ⋅ Pr σ [ m ≥ 2 ∣ B τ ] = E σ [ m ⋅ 1 [ m ≥ 2 ] ] ≤ e , \sum_{\tau}\Pr_{\sigma}[B_{\tau}] = \mathbb{E}_{\sigma}[m] \ge1-e
\qquad\text{and}\qquad
\sum_{\tau}\Pr_{\sigma}[B_{\tau}]\cdot\Pr_{\sigma}[m \ge2 \mid B_{\tau}] = \mathbb{E}_{\sigma}[m\cdot\mathbf{1}[m \ge2]] \le e, τ ∑ σ Pr [ B τ ] = E σ [ m ] ≥ 1 − e and τ ∑ σ Pr [ B τ ] ⋅ σ Pr [ m ≥ 2 ∣ B τ ] = E σ [ m ⋅ 1 [ m ≥ 2 ]] ≤ e ,
where the second sum is over τ \tau τ with Pr σ [ B τ ] > 0 \Pr_{\sigma}[B_{\tau}] > 0 Pr σ [ B τ ] > 0 . So τ ∗ \tau^* τ ∗ exists, and Pr σ [ m ≥ 2 ∣ B ∗ ] ≤ e / ( 1 − e ) ≤ 1 / 7 \Pr_{\sigma}[m \ge2 \mid B^*] \le e/(1-e) \le1/7 Pr σ [ m ≥ 2 ∣ B ∗ ] ≤ e / ( 1 − e ) ≤ 1/7 .
For u u u with m ( u ) = 1 m(u)=1 m ( u ) = 1 , let B ( u ) B(u) B ( u ) be the unique member of the family that contains u u u . We say that an iteration of Algorithm 3 makes progress on u u u if m ( u ) = 1 m(u)=1 m ( u ) = 1 and it either outputs τ ∗ \tau^* τ ∗ or queries a bit that is fixed by B ( u ) B(u) B ( u ) . As B ( u ) B(u) B ( u ) fixes at most q q q bits, at most q + 1 q+1 q + 1 iterations make progress on any given u u u .
Claim 27. An iteration of Algorithm 3 that reaches line 4 at a restriction σ \sigma σ makes progress with probability at least 1 / 2 1/2 1/2 over u ∼ cube ( σ ) u \sim\operatorname{cube}(\sigma) u ∼ cube ( σ ) .
Proof. Let N \mathcal{N} N be the set of u ∈ cube ( σ ) u \in\operatorname{cube}(\sigma) u ∈ cube ( σ ) such that m ( u ) = 1 m(u)=1 m ( u ) = 1 , the member B ( u ) B(u) B ( u ) is not B ∗ B^* B ∗ , and no bit is fixed to different values by B ( u ) B(u) B ( u ) and B ∗ B^* B ∗ . For u ∈ cube ( σ ) u \in\operatorname{cube}(\sigma) u ∈ cube ( σ ) , let x x x be obtained from u u u by overwriting the bits fixed by B ∗ B^* B ∗ with the values that B ∗ B^* B ∗ prescribes. If u ∼ cube ( σ ) u \sim\operatorname{cube}(\sigma) u ∼ cube ( σ ) , then x x x is uniform over cube ( σ ) ∩ B ∗ \operatorname{cube}(\sigma) \cap B^* cube ( σ ) ∩ B ∗ . If u ∈ N u \in\mathcal{N} u ∈ N , then x x x lies in both B ∗ B^* B ∗ and B ( u ) B(u) B ( u ) , and so m ( x ) ≥ 2 m(x) \ge2 m ( x ) ≥ 2 . By Claim 26 ,
Pr σ [ N ] ≤ Pr σ [ m ( x ) ≥ 2 ] = Pr σ [ m ≥ 2 ∣ B ∗ ] ≤ 1 7 . \Pr_{\sigma}[\mathcal{N}] \le\Pr_{\sigma}[m(x) \ge2] = \Pr_{\sigma}[m \ge2 \mid B^*] \le\frac{1}{7}. σ Pr [ N ] ≤ σ Pr [ m ( x ) ≥ 2 ] = σ Pr [ m ≥ 2 ∣ B ∗ ] ≤ 7 1 .
Now let u ∈ cube ( σ ) ∖ N u \in\operatorname{cube}(\sigma) \setminus\mathcal{N} u ∈ cube ( σ ) ∖ N with m ( u ) = 1 m(u)=1 m ( u ) = 1 . If B ( u ) = B ∗ B(u)=B^* B ( u ) = B ∗ , then the iteration outputs τ ∗ \tau^* τ ∗ . Otherwise some bit is fixed to different values by B ( u ) B(u) B ( u ) and B ∗ B^* B ∗ . This bit is not fixed by σ \sigma σ , because both B ( u ) B(u) B ( u ) and B ∗ B^* B ∗ intersect cube ( σ ) \operatorname{cube}(\sigma) cube ( σ ) , so the iteration queries it. Since E σ W ≤ 1 / 8 \mathbb{E}_{\sigma} W \le1/8 E σ W ≤ 1/8 and W ≥ 1 [ m ≠ 1 ] W \ge\mathbf{1}[m \ne1] W ≥ 1 [ m = 1 ] , the iteration makes progress with probability at least Pr σ [ m = 1 ] − Pr σ [ N ] ≥ 7 / 8 − 1 / 7 > 1 / 2 \Pr_{\sigma}[m=1]-\Pr_{\sigma}[\mathcal{N}] \ge7/8-1/7 > 1/2 Pr σ [ m = 1 ] − Pr σ [ N ] ≥ 7/8 − 1/7 > 1/2 .
Claim 28. Pr [ E 2 ] ≤ 1 / 4 \Pr[E_2] \le1/4 Pr [ E 2 ] ≤ 1/4 .
Proof. For k ≤ 8 ( q + 1 ) k \le8(q+1) k ≤ 8 ( q + 1 ) , let R k \mathcal{R}_k R k be the event that the k k k -th iteration reaches line 4, and let P k ⊆ R k \mathcal{P}_k \subseteq\mathcal{R}_k P k ⊆ R k be the event that it makes progress. Then Pr [ P k ] ≥ Pr [ R k ] / 2 \Pr[\mathcal{P}_k] \ge\Pr[\mathcal{R}_k]/2 Pr [ P k ] ≥ Pr [ R k ] /2 by Claim 27 , and ∑ k Pr [ P k ] ≤ q + 1 \sum_k \Pr[\mathcal{P}_k] \le q+1 ∑ k Pr [ P k ] ≤ q + 1 . If E 2 \mathcal{E}_2 E 2 occurs, then all the events R k \mathcal{R}_k R k occur. Hence
8 ( q + 1 ) ⋅ Pr [ E 2 ] ≤ ∑ k Pr [ R k ] ≤ 2 ∑ k Pr [ P k ] ≤ 2 ( q + 1 ) . 8(q+1) \cdot\Pr[\mathcal{E}_2] \le\sum_k \Pr[\mathcal{R}_k] \le2\sum_k \Pr[\mathcal{P}_k] \le2(q+1). 8 ( q + 1 ) ⋅ Pr [ E 2 ] ≤ k ∑ Pr [ R k ] ≤ 2 k ∑ Pr [ P k ] ≤ 2 ( q + 1 ) .
Given Claims 25 and 28 , Algorithm 3 outputs fail with probability at most 1 / 2 1/2 1/2 , which proves Claim 22 .
PLS separations from proof complexity
In this section we prove separations between TFNP classes in the random oracle model. We will work with the following notion of a ROM reduction.
Public reduction. Let F = { F n } F = \{F_n\} F = { F n } , R = { R m } R = \{R_m\} R = { R m } be TFNP problems, where F n ⊆ Σ n × O F_n \subseteq\Sigma^n \times\mathcal{O} F n ⊆ Σ n × O and R m ⊆ Σ m × O ′ R_m \subseteq\Sigma^m \times\mathcal{O}' R m ⊆ Σ m × O ′ . A public (ROM) reduction from F n F_n F n to R m R_m R m is given by a family of decision trees ( ω , f , g ) (\omega, f, g) ( ω , f , g ) satisfying the following properties.
The first family of decision trees, ω = { ω 1 , … , ω n } \omega= \{\omega_1, \ldots, \omega_n\} ω = { ω 1 , … , ω n } query variables u 1 , … , u t u_1, \ldots, u_t u 1 , … , u t , and together they map a random string u ∈ Σ t u \in\Sigma^t u ∈ Σ t to an instance of F n F_n F n . That is, for each random string u u u , ω ( u ) = ω 1 ( u ) ⋯ ω n ( u ) ∈ Σ n \omega(u) = \omega_1(u) \cdots\omega_n(u) \in\Sigma^n ω ( u ) = ω 1 ( u ) ⋯ ω n ( u ) ∈ Σ n defines an input to F n F_n F n , and thus ω \omega ω defines a “locally-samplable” distribution over instances of F n F_n F n .
The second family of decision trees, f = { f 1 , … , f m } f = \{f_1, \ldots, f_m\} f = { f 1 , … , f m } query u u u and together they define a reduction from an instance of F n F_n F n to an instance of R m R_m R m .
The third family of decision trees g = { g o ∣ o ∈ O ′ } g = \{g_o \mid o \in\mathcal{O}'\} g = { g o ∣ o ∈ O ′ } queries u u u , and if o o o is a legal solution to the instance f ( u ) f(u) f ( u ) of R m R_m R m , the decision tree g o ( u ) g_o(u) g o ( u ) outputs a candidate solution to F n F_n F n on instance ω ( u ) \omega(u) ω ( u ) .
The depth d ( ω , f , g ) d(\omega, f, g) d ( ω , f , g ) of a reduction ( f , g ) (f, g) ( f , g ) is the maximum depth of any of the decision trees, and the complexity is c ( ω , f , g ) : = d ( ω , f , g ) + log m c(\omega, f, g) := d(\omega, f, g) + \log m c ( ω , f , g ) := d ( ω , f , g ) + log m . The error of the reduction is
err ( ω , f , g ) : = Pr u ∼ Σ t [ ∃ o ∈ O ′ : ( f ( u ) , o ) ∈ R m ∧ ( ω ( u ) , g o ( u ) ) ∉ F n ] . \operatorname{err}(\omega, f, g) := \Pr_{u \sim\Sigma^t}\left[\exists o \in\mathcal{O}': (f(u), o) \in R_m \land(\omega(u), g_o(u)) \notin F_n\right]. err ( ω , f , g ) := u ∼ Σ t Pr [ ∃ o ∈ O ′ : ( f ( u ) , o ) ∈ R m ∧ ( ω ( u ) , g o ( u )) ∈ / F n ] .
We say that F F F public reduces to R R R if for every sufficiently large n n n there is a polylog( n ) (n) ( n ) -complexity reduction for every locally-samplable distribution. That is, for every polylog( n ) (n) ( n ) -depth ω \omega ω there exists f , g f, g f , g such that c ( ω , f , g ) = polylog ( n ) c(\omega, f, g) = \operatorname{polylog}(n) c ( ω , f , g ) = polylog ( n ) and err ( ω , f , g ) ≤ 1 / 3 \operatorname{err}(\omega, f, g) \le1/3 err ( ω , f , g ) ≤ 1/3 .
Note that up to a blow-up of d ( ω , f , g ) d(\omega, f, g) d ( ω , f , g ) this is equivalent to allowing f f f and g g g to depend on ω ( u ) \omega(u) ω ( u ) as well, since each query to a bit of ω ( u ) \omega(u) ω ( u ) can be simulated by querying the values of u u u that ω \omega ω queries for the value of that bit. As well, note that if err ( ω , f , g ) = 0 \operatorname{err}(\omega, f, g) = 0 err ( ω , f , g ) = 0 , then we recover the standard definition of a black-box reduction between TFNP problems.
Separations in the ROM from average-case proof complexity bounds
Our TFNP separations will proceed by a reduction to proof complexity lower bounds. Proof complexity and TFNP are intimately connected in the black-box model. Characterization theorems show that black-box TFNP subclasses correspond exactly to the search problems whose totality can be proven efficiently in a corresponding proof system [30 BF23] . For example, recalling Definition 1 of a resolution refutation, the following result shows that resolution is exactly the search problems whose totality can be proven by PLS-style arguments.
Resolution = PLS [BKT14, Kam19]. For any F ∈ T F N P d t F \in\mathrm{TFNP}^{dt} F ∈ TFNP d t , F ∈ P L S d t F \in\mathrm{PLS}^{dt} F ∈ PLS d t iff there is a width-poly ( log n ) \operatorname{poly}(\log n) poly ( log n ) pair ( F , S ) (\mathcal{F}, S) ( F , S ) that solves F F F . Quantitatively, a zero-error reduction of complexity t t t to the canonical PLS problem yields a resolution refutation of width O ( t + v ) O(t+v) O ( t + v ) , where v v v bounds the source-verifier depth; see [44 Theorem 8.18(1)] . We use the same characterization for alphabet-valued decision trees, replacing Boolean literals by cell equalities [ u i = a ] [u_i = a] [ u i = a ] .
In this section, we extend this connection to ROM reductions. Let ( ω , f , g ) (\omega, f, g) ( ω , f , g ) be a public reduction from a TFNP problem F ⊆ Σ n × O F \subseteq\Sigma^n \times O F ⊆ Σ n × O to a TFNP problem R ⊆ Σ m × O ′ R \subseteq\Sigma^m \times O' R ⊆ Σ m × O ′ . All our lower bounds will be against the uniform distribution ω ( u ) = u \omega(u)=u ω ( u ) = u , and henceforth we restrict attention to this case and omit ω \omega ω . The main difference between standard black-box reductions and ROM reductions is that the latter allows for error. We will capture this error by a low-width DNF B B B whose probability of being satisfied over the uniform distribution is err ( ω , f , g ) \operatorname{err}(\omega, f, g) err ( ω , f , g ) . A width-w w w DNF over an alphabet Σ \Sigma Σ is a disjunction of predicates B = ⋁ i ∈ [ t ] B i B = \bigvee_{i\in[t]} B_i B = ⋁ i ∈ [ t ] B i such that each B i B_i B i is a term depending on at most w w w variables—there is a single assignment to the variables of B i B_i B i satisfying it. This will give us a new search problem which we denote by F ∨ B F \vee B F ∨ B : on a given input, find either a solution to F F F or a satisfied term of B B B .
We now define B B B . For each target answer o ∈ O ′ o \in O' o ∈ O ′ , let H o H_o H o be the decision tree that first verifies ( f ( u ) , o ) ∈ R (f(u),o) \in R ( f ( u ) , o ) ∈ R , then runs the decoder g o g_o g o , and finally checks that ( u , g o ( u ) ) ∉ F (u,g_o(u)) \notin F ( u , g o ( u )) ∈ / F . Let viol ( f , g ) \operatorname{viol}(f,g) viol ( f , g ) be the set of accepting root-to-leaf transcripts of these trees, viewed as partial assignments to u u u . Define the violation DNF for the reduction as
B f , g : = ⋁ ρ ∈ viol ( f , g ) ⋀ i ∈ fix ( ρ ) [ u i = ρ i ] . B_{f,g} := \bigvee_{\rho\in\operatorname{viol}(f,g)} \bigwedge_{i\in\operatorname{fix}(\rho)} [u_i=\rho_i]. B f , g := ρ ∈ viol ( f , g ) ⋁ i ∈ fix ( ρ ) ⋀ [ u i = ρ i ] .
Thus B f , g ( u ) = 1 B_{f,g}(u)=1 B f , g ( u ) = 1 exactly when some valid target answer decodes to an invalid source answer. If the reduction has depth d d d and the target and source verifiers have depths v R v_R v R and v F v_F v F , respectively, each term has width at most d v R + d + v F d v_R+d+v_F d v R + d + v F . B f , g B_{f,g} B f , g captures the allowable error of the public reduction, and will be given to the proof system as “advice” to help prove F F F . The key property of B f , g B_{f,g} B f , g imposed by the reduction is that
Pr u ∼ Σ n [ B f , g ( u ) = 1 ] = err ( ω , f , g ) . \Pr_{u\sim\Sigma^n}[B_{f,g}(u)=1]=\operatorname{err}(\omega,f,g). u ∼ Σ n Pr [ B f , g ( u ) = 1 ] = err ( ω , f , g ) .
Therefore, if the reduction has low error, then B f , g B_{f,g} B f , g is almost never satisfied and intuitively cannot be too helpful in proving F F F . Abusing notation, let F ∨ B ⊆ Σ n × ( O ∪ { ρ ∣ ρ ∈ B } ) F \vee B \subseteq\Sigma^n \times(O \cup\{\rho\mid\rho\in B\}) F ∨ B ⊆ Σ n × ( O ∪ { ρ ∣ ρ ∈ B }) be the search problem of returning a solution to F F F or a satisfied term of B B B .
Lemma 29. Let F ⊆ Σ n × O F \subseteq\Sigma^n \times O F ⊆ Σ n × O have solution verifiers of depth at most w w w . Any public reduction ( id , f , g ) (\operatorname{id},f,g) ( id , f , g ) from F F F to the canonical PLS problem of complexity at most w w w yields a DNF B B B of width O ( w ) O(w) O ( w ) such that
Pr u ∼ Σ n [ B ( u ) = 1 ] = err ( id , f , g ) . \Pr_{u\sim\Sigma^n}[B(u)=1]=\operatorname{err}(\operatorname{id},f,g). u ∼ Σ n Pr [ B ( u ) = 1 ] = err ( id , f , g ) . and F ∨ B F \vee B F ∨ B has a resolution refutation of width O ( w ) O(w) O ( w ) . More precisely, if the reduction has depth d d d and the source verifiers have depth v F v_F v F , the DNF B B B has width at most 3 d + v F 3d+v_F 3 d + v F .
In particular, if F ∈ T F N P d t F \in\mathrm{TFNP}^{\mathrm{dt}} F ∈ TFNP dt and F ∨ B F \vee B F ∨ B has no polylogn n n -width resolution refutation for every width-polylogn n n DNF B B B satisfying Pr [ B ( u ) = 1 ] ≤ 1 / 3 \Pr[B(u)=1]\leq1/3 Pr [ B ( u ) = 1 ] ≤ 1/3 , then there is no public reduction from F F F to PLS. This is a lower bound on the randomized resolution width of F F F from [BKT14] specialized to the uniform distribution.
Proof. For each target answer o ∈ O ′ o \in O' o ∈ O ′ , the tree H o H_o H o defined above accepts exactly when o o o is valid for f ( u ) f(u) f ( u ) but g o ( u ) g_o(u) g o ( u ) is invalid for F F F . Its target-verification stage uses at most 2 d 2d 2 d source queries, its decoder uses at most d d d , and its source verifier uses at most v F v_F v F . Taking the disjunction of all accepting transcripts gives B = B f , g B=B_{f,g} B = B f , g of width at most 3 d + v F ≤ 4 w 3d+v_F\leq4w 3 d + v F ≤ 4 w , with satisfaction probability exactly err ( id , f , g ) \operatorname{err}(\operatorname{id},f,g) err ( id , f , g ) .
Modify the decoder to run the three stages of H o H_o H o . If the target check fails, return an arbitrary value. Otherwise, return g o ( u ) g_o(u) g o ( u ) when the source verifier accepts, or the accepting transcript of H o H_o H o , a satisfied term of B B B , when it rejects. This is a zero-error reduction from F ∨ B F \vee B F ∨ B to the same PLS instance, of complexity O ( w ) O(w) O ( w ) . Solutions to F ∨ B F \vee B F ∨ B are verified in depth O ( w ) O(w) O ( w ) , so the quantitative PLS–resolution characterization [44 Theorem 8.18(1)] supplies the width-O ( w ) O(w) O ( w ) refutation. □ \square □
Robust strategies and average-case resolution
In this section, we develop tools for proving average case resolution lower bounds—that is, F ∨ B F \vee B F ∨ B for every B B B satisfying the conditions of Lemma 29. We begin by describing the dual object (known as a Delayer strategy ) for resolution proofs, and later extend it to the average case. For a partial assignment ρ ∈ ( Σ ∪ { ⋆ } ) m \rho\in(\Sigma\cup\{\star\})^m ρ ∈ ( Σ ∪ { ⋆ } ) m , denote by fix ( ρ ) : = { i ∈ [ m ] ∣ ρ i ≠ ⋆ } \operatorname{fix}(\rho):=\{i\in[m]\mid\rho_i\ne\star\} fix ( ρ ) := { i ∈ [ m ] ∣ ρ i = ⋆ } , and let free ( ρ ) : = [ m ] ∖ fix ( ρ ) \operatorname{free}(\rho):=[m]\setminus\operatorname{fix}(\rho) free ( ρ ) := [ m ] ∖ fix ( ρ ) . As well, let cube ( ρ ) : = { x ∈ Σ m ∣ ∀ i ∉ free ( ρ ) , x i = ρ i } \operatorname{cube}(\rho):=\{x\in\Sigma^m\mid\forall i\notin\operatorname{free}(\rho),x_i=\rho_i\} cube ( ρ ) := { x ∈ Σ m ∣ ∀ i ∈ / free ( ρ ) , x i = ρ i } be the sub-cube of total assignments which agree with ρ \rho ρ .
Strategy. Let F ⊆ Σ m × O F \subseteq\Sigma^m \times O F ⊆ Σ m × O . A width-w w w strategy for F F F is a non-empty downward-closed set F ⊆ ( Σ ∪ { ⋆ } ) m \mathcal{F} \subseteq(\Sigma\cup\{\star\})^m F ⊆ ( Σ ∪ { ⋆ } ) m such that for every ρ ∈ F \rho\in\mathcal{F} ρ ∈ F with ∣ fix ( ρ ) ∣ ≤ w |\operatorname{fix}(\rho)| \le w ∣ fix ( ρ ) ∣ ≤ w the following hold:
For every o ∈ O o \in O o ∈ O , there is an x ∈ cube ( ρ ) x \in\operatorname{cube}(\rho) x ∈ cube ( ρ ) such that ( x , o ) ∉ F (x,o) \notin F ( x , o ) ∈ / F
Extension Property: If ∣ fix ( ρ ) ∣ < w |\operatorname{fix}(\rho)| < w ∣ fix ( ρ ) ∣ < w and i ∈ free ( ρ ) i \in\operatorname{free}(\rho) i ∈ free ( ρ ) there is a ∈ Σ a \in\Sigma a ∈ Σ such that ρ ∪ { x i = a } ∈ F \rho\cup\{x_i = a\} \in\mathcal{F} ρ ∪ { x i = a } ∈ F .
This is the dual object for resolution proofs:
Lemma 30 ([AD08]). There is a width-w w w resolution refutation of F F F iff there is no width-w w w strategy.
Hence, to separate F F F from PLS it suffices to show that there is a polylogn n n -width strategy for F ∨ B F \vee B F ∨ B for all suitable B B B . We show that this is implied by constructing a suitably robust strategy for F F F .
Robust strategy. A width-w w w strategy for F F F is k k k -robust if it also satisfies:
Lemma 31. Suppose that F ⊆ Σ m × O F \subseteq\Sigma^m \times O F ⊆ Σ m × O has a width-w w w k k k -robust strategy. Then for every width-w w w DNF B B B such that Pr u ∼ Σ m [ B ( u ) = 1 ] < ( 1 − k / ∣ Σ ∣ ) w \Pr_{u \sim\Sigma^m}[B(u)=1] < (1-k/|\Sigma|)^w Pr u ∼ Σ m [ B ( u ) = 1 ] < ( 1 − k /∣Σ∣ ) w there is an (ordinary) strategy of width w w w for F ∨ B F \vee B F ∨ B .
The remainder of this section is devoted to proving this lemma. Let us identify Σ = [ n ] \Sigma= [n] Σ = [ n ] for simplicity. We aim to extract an ordinary strategy for F ∨ B F \vee B F ∨ B from a k k k -robust strategy for F F F . The naive approach would be to take the k k k -robust strategy F \mathcal{F} F for F F F and keep only ρ ∈ F \rho\in\mathcal{F} ρ ∈ F such that
cube ( ρ ) ⊈ B − 1 ( 1 ) . (4) \operatorname{cube}(\rho) \not\subseteq B^{-1}(1). \tag*{(4)} cube ( ρ ) ⊆ B − 1 ( 1 ) . (4)
Then no ρ ∈ F \rho\in\mathcal{F} ρ ∈ F that meets (2) can falsify any clause of F F F or B B B . The issue with such a naive restriction is with the extension property. Let x 1 , … , x m x_1,\ldots,x_m x 1 , … , x m be the variables of F F F . Suppose ρ \rho ρ satisfies (2) and n − k n-k n − k extensions of the form ρ ∪ { x i = j } \rho\cup\{x_i=j\} ρ ∪ { x i = j } are in F \mathcal{F} F . If we show that at least one of the extensions also satisfies (2), then this proves the extension property. If k = 0 k=0 k = 0 , this would be trivial:
cube ( ρ ) ∖ B − 1 ( 1 ) = ⨆ j ∈ [ n ] ( cube ( ρ ∪ { x i = j } ) ∖ B − 1 ( 1 ) ) , (5) \operatorname{cube}(\rho) \setminus B^{-1}(1) = \bigsqcup_{j \in[n]} \left(\operatorname{cube}(\rho\cup\{x_i=j\}) \setminus B^{-1}(1)\right), \tag*{(5)} cube ( ρ ) ∖ B − 1 ( 1 ) = j ∈ [ n ] ⨆ ( cube ( ρ ∪ { x i = j }) ∖ B − 1 ( 1 ) ) , (5)
so if the left-hand side is non-empty, then at least one of the terms on the right-hand is non-empty. Hence, ρ \rho ρ satisfies the extension property. This becomes false even for k = 1 k=1 k = 1 , as the difference on the left-hand side may be completely contained in one of the parts of the right-hand side.
We resolve this by using the linear algebraic embedding of Razborov [Raz03] developed for the pseudowidth method. The high-level idea is to forget about which holes are occupied by pigeons under ρ \rho ρ and instead only track the number of holes that are occupied. To do so, we associate each pigeon i ∈ [ m ] i \in[m] i ∈ [ m ] with a vector space V i = R n − k V_i = \mathbb{R}^{n-k} V i = R n − k and choose vectors v i , 1 , … , v i , n v_{i,1},\ldots,v_{i,n} v i , 1 , … , v i , n such that every n − k n-k n − k of them span the space—this will have the effect of only counting the number of occupied holes. Random vectors or Vandermonde vectors have this property. Then we set V : = ⨂ i ∈ [ m ] V i V := \bigotimes_{i \in[m]} V_i V := ⨂ i ∈ [ m ] V i and define L : [ n ] m → V L : [n]^m \to V L : [ n ] m → V as mapping x ∈ Σ m x \in\Sigma^m x ∈ Σ m to ⨂ i ∈ [ m ] v i , x i \bigotimes_{i \in[m]} v_{i,x_i} ⨂ i ∈ [ m ] v i , x i . For a set A ⊆ [ n ] m A \subseteq[n]^m A ⊆ [ n ] m extend L ( A ) : = span { L ( x ) ∣ x ∈ A } L(A) := \operatorname{span}\{L(x) \mid x \in A\} L ( A ) := span { L ( x ) ∣ x ∈ A } and shorthand L ( ρ ) : = L ( cube ( ρ ) ) L(\rho) := L(\operatorname{cube}(\rho)) L ( ρ ) := L ( cube ( ρ )) . We then claim that
F ′ : = { ρ ∈ F ∣ L ( ρ ) ⊈ L ( B − 1 ( 1 ) ) } \mathcal{F}' := \{\rho\in\mathcal{F} \mid L(\rho) \not\subseteq L(B^{-1}(1))\} F ′ := { ρ ∈ F ∣ L ( ρ ) ⊆ L ( B − 1 ( 1 ))}
is a width-w w w strategy for F ∨ B F \vee B F ∨ B . Indeed, the key property of this embedding is that now if we want to extend ρ \rho ρ by mapping x i x_i x i then all we need to know is that there are n − k n-k n − k many values in Σ \Sigma Σ where x i x_i x i can be mapped to. This is formalized in the next lemma as the following “saturated counting” version of (3), stating that any n − k n-k n − k extensions of ρ \rho ρ are sufficient to span L ( ρ ) L(\rho) L ( ρ ) .
Lemma 32. For every M ∈ ( Σ n − k ) M \in\binom{\Sigma}{n-k} M ∈ ( n − k Σ ) and i ∉ fix ( ρ ) i \notin\operatorname{fix}(\rho) i ∈ / fix ( ρ ) we have L ( ρ ) = ∑ j ∈ M L ( ρ ∪ { x i = j } ) L(\rho) = \sum_{j \in M} L(\rho\cup\{x_i=j\}) L ( ρ ) = ∑ j ∈ M L ( ρ ∪ { x i = j }) .
Proof. By definition we have:
L ( ρ ) = ⨂ t ∈ fix ( ρ ) span ( v t , ρ ( t ) ) ⊗ V i ⊗ ⨂ ℓ ∈ [ m ] ∖ ( fix ( ρ ) ∪ { i } ) V ℓ = ⨂ t ∈ fix ( ρ ) span ( v t , ρ ( t ) ) ⊗ span { v i , j ∣ j ∈ M } ⊗ ⨂ ℓ ∈ [ m ] ∖ ( fix ( ρ ) ∪ { i } ) V ℓ . (6) \begin{aligned}
L(\rho) &= \bigotimes_{t \in\operatorname{fix}(\rho)} \operatorname{span}(v_{t,\rho(t)}) \otimes V_i \otimes\bigotimes_{\ell\in[m]\setminus(\operatorname{fix}(\rho)\cup\{i\})} V_\ell\\
&= \bigotimes_{t \in\operatorname{fix}(\rho)} \operatorname{span}(v_{t,\rho(t)}) \otimes\operatorname{span}\{v_{i,j} \mid j \in M\} \otimes\bigotimes_{\ell\in[m]\setminus(\operatorname{fix}(\rho)\cup\{i\})} V_\ell. \tag*{(6)}
\end{aligned} L ( ρ ) = t ∈ fix ( ρ ) ⨂ span ( v t , ρ ( t ) ) ⊗ V i ⊗ ℓ ∈ [ m ] ∖ ( fix ( ρ ) ∪ { i }) ⨂ V ℓ = t ∈ fix ( ρ ) ⨂ span ( v t , ρ ( t ) ) ⊗ span { v i , j ∣ j ∈ M } ⊗ ℓ ∈ [ m ] ∖ ( fix ( ρ ) ∪ { i }) ⨂ V ℓ . (6)
Then by the property of tensor products we can rewrite
L ( ρ ) = ∑ j ∈ M ⨂ t ∈ fix ( ρ ) span ( v t , ρ ( t ) ) ⊗ span ( v i , j ) ⊗ ⨂ ℓ ∈ [ m ] ∖ ( fix ( ρ ) ∪ { i } ) V ℓ = ∑ j ∈ M L ( ρ ∪ { x i = j } ) . L(\rho)=\sum_{j\in M}\bigotimes_{t\in\operatorname{fix}(\rho)}\operatorname{span}(v_{t,\rho(t)})\otimes\operatorname{span}(v_{i,j})\otimes\bigotimes_{\ell\in[m]\setminus(\operatorname{fix}(\rho)\cup\{i\})}V_\ell=\sum_{j\in M}L(\rho\cup\{x_i=j\}). L ( ρ ) = j ∈ M ∑ t ∈ fix ( ρ ) ⨂ span ( v t , ρ ( t ) ) ⊗ span ( v i , j ) ⊗ ℓ ∈ [ m ] ∖ ( fix ( ρ ) ∪ { i }) ⨂ V ℓ = j ∈ M ∑ L ( ρ ∪ { x i = j }) .
It follows that F ′ \mathcal{F}' F ′ satisfies the extension property: suppose that ρ ∈ F ′ \rho\in\mathcal{F}' ρ ∈ F ′ , so L ( ρ ) ⊈ L ( B − 1 ( 1 ) ) L(\rho)\not\subseteq L(B^{-1}(1)) L ( ρ ) ⊆ L ( B − 1 ( 1 )) , i ∈ [ m ] ∖ fix ( ρ ) i\in[m]\setminus\operatorname{fix}(\rho) i ∈ [ m ] ∖ fix ( ρ ) . Since ρ ∈ F \rho\in\mathcal{F} ρ ∈ F by the k k k -robustness of F \mathcal{F} F we have that the size of M = { j ∈ [ n ] ∣ ρ ∪ { x i = j } ∈ F } M=\{j\in[n]\mid\rho\cup\{x_i=j\}\in\mathcal{F}\} M = { j ∈ [ n ] ∣ ρ ∪ { x i = j } ∈ F } is at least n − k n-k n − k . If for all j ∈ M j\in M j ∈ M we have L ( ρ ∪ { x i = j } ) ⊆ L ( B − 1 ( 1 ) ) L(\rho\cup\{x_i=j\})\subseteq L(B^{-1}(1)) L ( ρ ∪ { x i = j }) ⊆ L ( B − 1 ( 1 )) , then by Lemma 32 ∑ j ∈ M L ( ρ ∪ { x i = j } ) = L ( ρ ) \sum_{j\in M}L(\rho\cup\{x_i=j\})=L(\rho) ∑ j ∈ M L ( ρ ∪ { x i = j }) = L ( ρ ) , and since L ( B − 1 ( 1 ) ) L(B^{-1}(1)) L ( B − 1 ( 1 )) is a subspace, we have L ( ρ ) ⊆ L ( B − 1 ( 1 ) ) L(\rho)\subseteq L(B^{-1}(1)) L ( ρ ) ⊆ L ( B − 1 ( 1 )) , a contradiction.
The remaining issue is the non-triviality of F ′ \mathcal{F}' F ′ ; indeed, the extension property is satisfied by the empty strategy. Thus, we need to show that ⋆ m ∈ F ′ \star^m\in\mathcal{F}' ⋆ m ∈ F ′ , equivalently V = L ( ⋆ m ) ⊈ L ( B − 1 ( 1 ) ) V=L(\star^m)\not\subseteq L(B^{-1}(1)) V = L ( ⋆ m ) ⊆ L ( B − 1 ( 1 )) . We show that for simple small sets A A A , dim ( L ( A ) ) \dim(L(A)) dim ( L ( A )) is also small:
Lemma 33. For every w w w -DNF B B B we have
dim ( L ( B − 1 ( 1 ) ) ) dim ( V ) ≤ ( 1 − k n ) − w ⋅ Pr u ∼ [ n ] m [ B ( u ) = 1 ] . \frac{\dim(L(B^{-1}(1)))}{\dim(V)}\leq\left(1-\frac{k}{n}\right)^{-w}\cdot\Pr_{u\sim[n]^m}[B(u)=1]. dim ( V ) dim ( L ( B − 1 ( 1 ))) ≤ ( 1 − n k ) − w ⋅ u ∼ [ n ] m Pr [ B ( u ) = 1 ] .
Given Lemma 33 , we can conclude the proof of Lemma 31: Pr [ B ( u ) = 1 ] < ( 1 − k / n ) w \Pr[B(u)=1]<(1-k/n)^w Pr [ B ( u ) = 1 ] < ( 1 − k / n ) w , so dim ( L ( B − 1 ( 1 ) ) ) < dim ( V ) \dim(L(B^{-1}(1)))<\dim(V) dim ( L ( B − 1 ( 1 ))) < dim ( V ) , and F ′ ∋ ⋆ m \mathcal{F}'\ni\star^m F ′ ∋ ⋆ m .
Proof of Lemma 33 . Let B 1 , … , B h B_1,\ldots,B_h B 1 , … , B h be the terms of B B B and let B ≤ i = ⋁ j ≤ i B j B_{\leq i}=\bigvee_{j\leq i}B_j B ≤ i = ⋁ j ≤ i B j . By induction on i i i , we will bound how much the dimension can increase from B ≤ i − 1 B_{\leq i-1} B ≤ i − 1 to B ≤ i B_{\leq i} B ≤ i . Denote Z i : = B i − 1 ( 1 ) Z_i:=B_i^{-1}(1) Z i := B i − 1 ( 1 ) and Z ≤ i : = ⋃ j ≤ i Z j Z_{\leq i}:=\bigcup_{j\leq i}Z_j Z ≤ i := ⋃ j ≤ i Z j , Z : = B − 1 ( 1 ) Z:=B^{-1}(1) Z := B − 1 ( 1 ) . We will prove that the following holds:
dim ( L ( Z ≤ i ) ) − dim ( L ( Z < i ) ) ≤ ( n − k n ) m − w ∣ Z i ∖ Z < i ∣ . (7) \dim(L(Z_{\leq i}))-\dim(L(Z_{<i}))\leq\left(\frac{n-k}{n}\right)^{m-w}\lvert Z_i\setminus Z_{<i}\rvert. \tag*{(7)} dim ( L ( Z ≤ i )) − dim ( L ( Z < i )) ≤ ( n n − k ) m − w ∣ Z i ∖ Z < i ∣ . (7)
We postpone the proof of this inequality and first complete the proof of the lemma. Summing over all i i i ,
dim ( L ( Z ) ) ≤ ( n − k n ) m − w ( ∑ i ∣ Z i ∖ Z < i ∣ ) = ( n − k n ) m − w ∣ Z ∣ . \dim(L(Z))\leq\left(\frac{n-k}{n}\right)^{m-w}\left(\sum_i\lvert Z_i\setminus Z_{<i}\rvert\right)=\left(\frac{n-k}{n}\right)^{m-w}\lvert Z\rvert. dim ( L ( Z )) ≤ ( n n − k ) m − w ( i ∑ ∣ Z i ∖ Z < i ∣ ) = ( n n − k ) m − w ∣ Z ∣ .
Hence,
dim ( L ( Z ) ) dim ( V ) ≤ ( ( n − k ) / n ) m − w ( n − k ) m ∣ Z ∣ = ( n − k n ) − w ∣ Z ∣ n − m = ( 1 − k n ) − w ⋅ Pr u ∼ [ n ] m [ B ( u ) = 1 ] . \frac{\dim(L(Z))}{\dim(V)}\leq\frac{((n-k)/n)^{m-w}}{(n-k)^m}\lvert Z\rvert=\left(\frac{n-k}{n}\right)^{-w}\lvert Z\rvert n^{-m}=\left(1-\frac{k}{n}\right)^{-w}\cdot\Pr_{u\sim[n]^m}[B(u)=1]. dim ( V ) dim ( L ( Z )) ≤ ( n − k ) m (( n − k ) / n ) m − w ∣ Z ∣ = ( n n − k ) − w ∣ Z ∣ n − m = ( 1 − n k ) − w ⋅ u ∼ [ n ] m Pr [ B ( u ) = 1 ] .
To prove Equation (7) we will use the following claim which bounds the dimension of a set as a function of its size.
Claim 34. For any partial assignment ρ : [ m ] → [ n ] ∪ { ⋆ } \rho:[m]\to[n]\cup\{\star\} ρ : [ m ] → [ n ] ∪ { ⋆ } and any A ⊆ cube ( ρ ) A\subseteq\operatorname{cube}(\rho) A ⊆ cube ( ρ ) ,
dim ( L ( A ) ) ≥ ( n − k n ) m − ∣ fix ( ρ ) ∣ ∣ A ∣ . \dim(L(A))\geq\left(\frac{n-k}{n}\right)^{m-\lvert\operatorname{fix}(\rho)\rvert}\lvert A\rvert. dim ( L ( A )) ≥ ( n n − k ) m − ∣ fix ( ρ )∣ ∣ A ∣ . In particular, dim ( L ( Z i ) ) ≥ ( ( n − k ) / n ) m − w \dim(L(Z_i))\geq((n-k)/n)^{m-w} dim ( L ( Z i )) ≥ (( n − k ) / n ) m − w .
Proof. First, we prove that for any A ⊆ [ n ] m A\subseteq[n]^m A ⊆ [ n ] m , dim ( L ( A ) ) ≥ ∣ A ∣ ( ( n − k ) / n ) m \dim(L(A))\geq\lvert A\rvert((n-k)/n)^m dim ( L ( A )) ≥ ∣ A ∣ (( n − k ) / n ) m . For each i ∈ [ m ] i\in[m] i ∈ [ m ] choose B i ∼ ( [ n ] n − k ) B_i\sim\binom{[n]}{n-k} B i ∼ ( n − k [ n ] ) and note that by our embedding, the vectors in L ( B i ) L(B_i) L ( B i ) are all linearly independent. Let B = ∏ i ∈ [ m ] B i B=\prod_{i\in[m]}B_i B = ∏ i ∈ [ m ] B i . Then,
dim ( L ( A ∩ B ) ) = ∣ A ∩ B ∣ , \dim(L(A\cap B))=\lvert A\cap B\rvert, dim ( L ( A ∩ B )) = ∣ A ∩ B ∣ ,
by linear independence. That is, B i B_i B i is restricting the i i i -th variable to have a value only in B i B_i B i . Hence
dim ( L ( A ) ) ≥ E [ dim ( L ( A ∩ B ) ) ] = E [ ∣ A ∩ B ∣ ] = ∣ A ∣ ( n − k n ) m , \dim(L(A))\geq\mathbb{E}[\dim(L(A\cap B))]=\mathbb{E}[\lvert A\cap B\rvert]=\lvert A\rvert\left(\frac{n-k}{n}\right)^m, dim ( L ( A )) ≥ E [ dim ( L ( A ∩ B ))] = E [∣ A ∩ B ∣] = ∣ A ∣ ( n n − k ) m ,
where the final equality is the probability that each element in B B B is in A A A . By the same argument, for any partial restriction ρ \rho ρ and A ⊆ cube ( ρ ) A\subseteq\operatorname{cube}(\rho) A ⊆ cube ( ρ ) ,
dim ( L ( A ) ) ≥ ( n − k n ) m − ∣ fix ( ρ ) ∣ ∣ A ∣ . \dim(L(A))\geq\left(\frac{n-k}{n}\right)^{m-\lvert\operatorname{fix}(\rho)\rvert}\lvert A\rvert. dim ( L ( A )) ≥ ( n n − k ) m − ∣ fix ( ρ )∣ ∣ A ∣ .
We now prove Equation (7) . First note that without loss of generality we can assume every term in B B B has width exactly w w w : a term B i B_i B i of width t t t can be transformed into an equivalent DNF of width t + 1 t+1 t + 1 by taking a variable x j x_j x j not mentioned in B i B_i B i and defining ⋁ a ∈ [ n ] B i ∧ [ [ x j = a ] ] \bigvee_{a\in[n]} B_i \land[[x_j=a]] ⋁ a ∈ [ n ] B i ∧ [[ x j = a ]] . With this simplification,
( n − k n ) m − w ∣ Z i ∖ Z < i ∣ = ( n − k n ) m − w ( ∣ Z i ∣ − ∣ Z i ∩ Z < i ∣ ) = ( n − k n ) m − w ( n m − w − ∣ Z i ∩ Z < i ∣ ) ≥ ( n − k ) m − w − dim ( L ( Z i ∩ Z < i ) ) (Applying xref‘Claim 34‘) = dim ( L ( Z i ) ) − dim ( L ( Z i ∩ Z < i ) ) ≥ dim ( L ( Z ≤ i ) ) − dim ( L ( Z < i ) ) , \begin{aligned}
\left(\frac{n-k}{n}\right)^{m-w}|Z_i \setminus Z_{<i}| = \left(\frac{n-k}{n}\right)^{m-w}\left(|Z_i|-|Z_i\cap Z_{<i}|\right) \\
&= \left(\frac{n-k}{n}\right)^{m-w}\left(n^{m-w}-|Z_i\cap Z_{<i}|\right) \\
&\ge(n-k)^{m-w}-\dim(L(Z_i\cap Z_{<i})) \qquad\text{(Applying {xref}`Claim 34`)} \\
&= \dim(L(Z_i))-\dim(L(Z_i\cap Z_{<i})) \\
&\ge\dim(L(Z_{\le i}))-\dim(L(Z_{<i})),
\end{aligned} ( n n − k ) m − w ∣ Z i ∖ Z < i ∣ = ( n n − k ) m − w ( ∣ Z i ∣ − ∣ Z i ∩ Z < i ∣ ) = ( n n − k ) m − w ( n m − w − ∣ Z i ∩ Z < i ∣ ) ≥ ( n − k ) m − w − dim ( L ( Z i ∩ Z < i )) (Applying xref ‘Claim 34‘) = dim ( L ( Z i )) − dim ( L ( Z i ∩ Z < i )) ≥ dim ( L ( Z ≤ i )) − dim ( L ( Z < i )) ,
where the final inequality follows by applying the next Lemma 35 with B = Z i ∩ Z < i B=Z_i\cap Z_{<i} B = Z i ∩ Z < i , A = Z i ∖ Z < i A=Z_i\setminus Z_{<i} A = Z i ∖ Z < i , and C = Z < i ∖ Z i C=Z_{<i}\setminus Z_i C = Z < i ∖ Z i .
Lemma 35. For any disjoint sets A A A , B B B , C C C ,
dim ( L ( A ∪ B ) ) − dim ( L ( B ) ) ≥ dim ( L ( A ∪ B ∪ C ) ) − dim ( L ( B ∪ C ) ) . \dim(L(A\cup B))-\dim(L(B))\ge\dim(L(A\cup B\cup C))-\dim(L(B\cup C)). dim ( L ( A ∪ B )) − dim ( L ( B )) ≥ dim ( L ( A ∪ B ∪ C )) − dim ( L ( B ∪ C )) .
Proof. Let A A A , B B B , C C C be disjoint sets. Then,
dim ( L ( A ∪ B ) ) − dim ( L ( B ) ) = dim ( L ( A ) ) − dim ( L ( A ) ∩ L ( B ) ) ≥ dim ( L ( A ) ) − dim ( L ( A ) ∩ L ( B ∪ C ) ) = dim ( L ( A ∪ B ∪ C ) ) − dim ( L ( B ∪ C ) ) , \begin{aligned}
\dim(L(A\cup B))-\dim(L(B))=\dim(L(A))-\dim(L(A)\cap L(B)) \\
&\ge\dim(L(A))-\dim(L(A)\cap L(B\cup C)) \\
&=\dim(L(A\cup B\cup C))-\dim(L(B\cup C)),
\end{aligned} dim ( L ( A ∪ B )) − dim ( L ( B )) = dim ( L ( A )) − dim ( L ( A ) ∩ L ( B )) ≥ dim ( L ( A )) − dim ( L ( A ) ∩ L ( B ∪ C )) = dim ( L ( A ∪ B ∪ C )) − dim ( L ( B ∪ C )) ,
where the final line follows by adding B ∪ C B\cup C B ∪ C to both sides.
PWPP is not in PLS
In this section we show that PWPP is not contained within PLS under public reductions.
Theorem 36. Let ( ω , f , g ) (\omega,f,g) ( ω , f , g ) , with ω ( u ) = u \omega(u)=u ω ( u ) = u , be any public reduction of complexity w ≤ n 1 / 3 w\le n^{1/3} w ≤ n 1/3 from Pigeon on [ n ] 2 n [n]^{2n} [ n ] 2 n to the canonical PLS-complete problem of Section A. Then, err ( ω , f , g ) = 1 − n − Ω ( 1 ) \operatorname{err}(\omega,f,g)=1-n^{-\Omega(1)} err ( ω , f , g ) = 1 − n − Ω ( 1 ) .
Consider the problem Pigeon ⊆ [ n ] m × ( [ m ] 2 ) \subseteq[n]^m\times\binom{[m]}{2} ⊆ [ n ] m × ( 2 [ m ] ) , for m > n m>n m > n , of finding a collision x i = x j x_i=x_j x i = x j in a given x ∈ [ n ] m x\in[n]^m x ∈ [ n ] m . For m = 2 n m=2n m = 2 n this is PWPP-complete. Let ( ω , f , g ) (\omega,f,g) ( ω , f , g ) , with ω ( u ) = u \omega(u)=u ω ( u ) = u , be a public reduction from Pigeon to the canonical PLS problem, of depth d d d and complexity w = d + log M w=d+\log M w = d + log M , where M ≥ 4 M\ge4 M ≥ 4 is the number of target pointers. A collision is verified with two source queries. Thus Lemma 29 gives a DNF B B B of width at most 3 d + 2 ≤ 3 w 3d+2\le3w 3 d + 2 ≤ 3 w and a resolution refutation of Pigeon ∨ B \vee B ∨ B of width O ( w ) O(w) O ( w ) , such that Pr u ∼ [ n ] m [ B ( u ) = 1 ] = err ( ω , f , g ) \Pr_{u\sim[n]^m}[B(u)=1]=\operatorname{err}(\omega,f,g) Pr u ∼ [ n ] m [ B ( u ) = 1 ] = err ( ω , f , g ) . Choose an absolute constant C C C such that both widths are at most W = ⌈ C w ⌉ W=\lceil Cw\rceil W = ⌈ C w ⌉ . The following lemma forces
err ( ω , f , g ) ≥ ( 1 − W / n ) W ≥ 1 − W 2 / n = 1 − O ( w 2 / n ) , \operatorname{err}(\omega,f,g)\ge(1-W/n)^W\ge1-W^2/n=1-O(w^2/n), err ( ω , f , g ) ≥ ( 1 − W / n ) W ≥ 1 − W 2 / n = 1 − O ( w 2 / n ) ,
which proves Theorem 36 for w ≤ n 1 / 3 w\le n^{1/3} w ≤ n 1/3 and sufficiently large n n n .
Lemma 37. If B B B is a width-w w w DNF such that Pr u ∼ [ n ] m [ B ( u ) = 1 ] < ( 1 − w / n ) w \Pr_{u\sim[n]^m}[B(u)=1]<(1-w/n)^w Pr u ∼ [ n ] m [ B ( u ) = 1 ] < ( 1 − w / n ) w then there is a width-w w w strategy for Pigeon ∨ B \vee B ∨ B .
Proof. By Lemma 31 it suffices to show that Pigeon has a w w w -robust strategy of width w w w . Define F \mathcal{F} F to be the set of all partial injections of width at most w w w . F \mathcal{F} F is downward-closed by definition and no injection falsifies Pigeon, so it remains to show the query property. Take ρ ∈ F \rho\in\mathcal{F} ρ ∈ F and arbitrary i ∈ free ( ρ ) i\in\operatorname{free}(\rho) i ∈ free ( ρ ) . For every j ∈ [ n ] ∖ range ( ρ ) j\in[n]\setminus\operatorname{range}(\rho) j ∈ [ n ] ∖ range ( ρ ) (there are n − w n-w n − w of those) the partial assignment ρ ∪ { p i = j } \rho\cup\{p_i=j\} ρ ∪ { p i = j } is a partial injection, so if ∣ fix ( ρ ) ∣ < w |\operatorname{fix}(\rho)|<w ∣ fix ( ρ ) ∣ < w , ρ ∪ { p i = j } ∈ F \rho\cup\{p_i=j\}\in\mathcal{F} ρ ∪ { p i = j } ∈ F as required.
As a consequence, we can also obtain average-case resolution size lower bounds. In terms of Definition 1 the size is ∣ F ∣ |F| ∣ F ∣ . Notice that we can relax Definition 1 so either ρ \rho ρ fixes a solution or i ( ρ ) i(\rho) i ( ρ ) is defined, regardless of the width of ρ \rho ρ . Then the terminal elements of F F F do not need to have the same width. The following corollary’s proof is a variant of [61 Proposition 3.7] .
Corollary 38. For any DNF B B B satisfying Pr u ∼ [ n ] m [ B ( u ) = 1 ] < ( 1 − w / n ) w − 1 / n \Pr_{u\sim[n]^m}[B(u)=1] < (1-w/n)^{w}-1/n Pr u ∼ [ n ] m [ B ( u ) = 1 ] < ( 1 − w / n ) w − 1/ n , any resolution refutation of Pigeon ∨ B \operatorname{Pigeon}\vee B Pigeon ∨ B has size at least n w n^w n w .
Proof. Suppose F F F is the (arbitrary width) refutation of Pigeon ∨ B \operatorname{Pigeon}\vee B Pigeon ∨ B of size < n w < n^w < n w . Remove all elements of F F F of width > w >w > w from F F F and form a DNF B ′ B' B ′ . Then Pr [ B ′ ( u ) = 1 ] < n w ⋅ n − ( w + 1 ) = 1 / n \Pr[B'(u)=1] < n^w\cdot n^{-(w+1)}=1/n Pr [ B ′ ( u ) = 1 ] < n w ⋅ n − ( w + 1 ) = 1/ n , so there is a width-( w + 1 ) (w+1) ( w + 1 ) resolution refutation of Pigeon ∨ B ∨ B ′ \operatorname{Pigeon}\vee B\vee B' Pigeon ∨ B ∨ B ′ , which contradicts Lemma 37 .
PPA is not in PLS
The preceding PPAD ∉ \notin ∈ / FP separation already implies PPA ∉ \notin ∈ / FP. Here we strengthen the conclusion: we construct a PPA search problem that has no low-depth average-case reduction to PLS.
The problem is again to find an edge in the hypergraph G = ( [ N ] , E ) G=([N],E) G = ([ N ] , E ) supplied by Theorem 10 : given a labeling h : [ N ] → { 0 , 1 } r h:[N]\to\{0,1\}^r h : [ N ] → { 0 , 1 } r find e ∈ E e\in E e ∈ E such that ⨁ v ∈ e h ( v ) = 0 r \bigoplus_{v\in e}h(v)=0^r ⨁ v ∈ e h ( v ) = 0 r . We again plant a special edge e ∗ = [ ℓ ] e^*=[\ell] e ∗ = [ ℓ ] and set h ( 1 ) = ⋯ = h ( ℓ ) = 0 r h(1)=\cdots=h(\ell)=0^r h ( 1 ) = ⋯ = h ( ℓ ) = 0 r , denoting H \mathcal{H} H the set of such functions, and forbid e ∗ e^* e ∗ as a solution:
ZeroEdge G : = { ( h , e ) ∈ H × ( E ∖ { e ∗ } ) : ⨁ v ∈ e h ( v ) = 0 r } . \operatorname{ZeroEdge}_G:=\{(h,e)\in\mathcal{H}\times(E\setminus\{e^*\}):\bigoplus_{v\in e}h(v)=0^r\}. ZeroEdge G := {( h , e ) ∈ H × ( E ∖ { e ∗ }) : v ∈ e ⨁ h ( v ) = 0 r } .
The reason for this change is in order to make ZeroEdge G \operatorname{ZeroEdge}_G ZeroEdge G hard even for PLS.
Theorem 39. There exists G = ( [ N ] , E ) G=([N],E) G = ([ N ] , E ) such that ZeroEdge G ∈ P P A \operatorname{ZeroEdge}_G\in\mathrm{PPA} ZeroEdge G ∈ PPA and there is no public reduction from ZeroEdge G \operatorname{ZeroEdge}_G ZeroEdge G to PLS of reduction complexity exp ( ( log N ) o ( 1 ) ) \exp((\log N)^{o(1)}) exp (( log N ) o ( 1 ) ) .
The theorem immediately follows from Lemmas 40 and 41 below:
Lemma 40. Suppose G = ( [ N ] , E ) G=([N],E) G = ([ N ] , E ) and E ⊆ ( [ N ] ℓ ) E\subseteq\binom{[N]}{\ell} E ⊆ ( ℓ [ N ] ) is ( ℓ , w + ℓ , b ) (\ell,w+\ell,b) ( ℓ , w + ℓ , b ) -well-spread. Then there exists a b b b -robust width-w w w strategy for ZeroEdge G \operatorname{ZeroEdge}_G ZeroEdge G .
Lemma 41. If G = ( [ N ] , E ) G=([N],E) G = ([ N ] , E ) with E ⊆ ( [ N ] ℓ ) E\subseteq\binom{[N]}{\ell} E ⊆ ( ℓ [ N ] ) is explicit and efficiently r r r -balanced, with ℓ = poly ( log N ) \ell=\operatorname{poly}(\log N) ℓ = poly ( log N ) , then ZeroEdge G ∈ P P A \operatorname{ZeroEdge}_G\in\mathrm{PPA} ZeroEdge G ∈ PPA .
Proof of Theorem 39. The graph supplied by Theorem 10 satisfies the preconditions of Lemmas 40 and 41 simultaneously. Then by Lemma 31 and the robust strategy given by Lemma 40 we get that for every DNF B B B of width w = exp ( ( log N ) o ( 1 ) ) w=\exp((\log N)^{o(1)}) w = exp (( log N ) o ( 1 ) ) and Pr [ B ( u ) = 1 ] ≤ 1 / 3 \Pr[B(u)=1]\le1/3 Pr [ B ( u ) = 1 ] ≤ 1/3 there is no width-w w w refutation for ZeroEdge G ∨ B \operatorname{ZeroEdge}_G\vee B ZeroEdge G ∨ B . Hence by Lemma 29, no public reduction from ZeroEdge G \operatorname{ZeroEdge}_G ZeroEdge G to PLS exists.
PLS hardness: proof of Lemma 40
Let L \mathcal{L} L be the set of all partial assignments ρ : [ N ] ∖ [ ℓ ] → { 0 , 1 } r ∪ { ⋆ } \rho:[N]\setminus[\ell]\to\{0,1\}^r\cup\{\star\} ρ : [ N ] ∖ [ ℓ ] → { 0 , 1 } r ∪ { ⋆ } . We say that ρ ∈ L \rho\in\mathcal{L} ρ ∈ L reveals an edge e ∈ E e\in E e ∈ E if ρ ( v ) ≠ ⋆ \rho(v)\ne\star ρ ( v ) = ⋆ for all v ∈ e ∖ [ ℓ ] v\in e\setminus[\ell] v ∈ e ∖ [ ℓ ] and ⨁ v ∈ e ∖ [ ℓ ] ρ ( v ) = 0 \bigoplus_{v\in e\setminus[\ell]}\rho(v)=0 ⨁ v ∈ e ∖ [ ℓ ] ρ ( v ) = 0 . Then we simply define
F : = { ρ ∈ L ∣ fix ( ρ ) ≤ w and ρ does not reveal any edge e ∈ E ∖ { e ∗ } } . \mathcal{F}:=\{\rho\in\mathcal{L}\mid\operatorname{fix}(\rho)\le w\text{ and }\rho\text{ does not reveal any edge }e\in E\setminus\{e^*\}\}. F := { ρ ∈ L ∣ fix ( ρ ) ≤ w and ρ does not reveal any edge e ∈ E ∖ { e ∗ }} .
Take any ρ ∈ F \rho\in\mathcal{F} ρ ∈ F of width less than w w w and any v ∈ ( [ N ] ∖ [ ℓ ] ) ∖ fix ( ρ ) v\in([N]\setminus[\ell])\setminus\operatorname{fix}(\rho) v ∈ ([ N ] ∖ [ ℓ ]) ∖ fix ( ρ ) . By well-spreadness we get that at most b b b edges F ⊆ E F\subseteq E F ⊆ E intersect fix ( ρ ) ∪ [ ℓ ] ∪ { v } \operatorname{fix}(\rho)\cup[\ell]\cup\{v\} fix ( ρ ) ∪ [ ℓ ] ∪ { v } in at least ℓ \ell ℓ nodes. By the fact that ρ \rho ρ does not reveal any edge, the sum of labels in all edges that do not contain v v v is non-zero. For each edge e ∈ F e\in F e ∈ F such that v ∈ e v\in e v ∈ e let f e : = ⨁ z ∈ e ∖ { v } ρ ( z ) f_e:=\bigoplus_{z\in e\setminus\{v\}}\rho(z) f e := ⨁ z ∈ e ∖ { v } ρ ( z ) be the value of h ( v ) h(v) h ( v ) that makes e e e a solution to ZeroEdge G \operatorname{ZeroEdge}_G ZeroEdge G . Then for α ∈ { 0 , 1 } r ∖ { f e ∣ e ∈ F ; v ∈ e } \alpha\in\{0,1\}^r\setminus\{f_e\mid e\in F;v\in e\} α ∈ { 0 , 1 } r ∖ { f e ∣ e ∈ F ; v ∈ e } the assignment ρ ∪ { h ( v ) = α } ∈ F \rho\cup\{h(v)=\alpha\}\in\mathcal{F} ρ ∪ { h ( v ) = α } ∈ F , so since ∣ F ∣ ≤ b |F|\le b ∣ F ∣ ≤ b the extension property of a b b b -robust strategy is satisfied.
PPA containment: proof of Lemma 41
We follow exactly the same strategy as in the PPAD case: encode ZeroEdge as a system of polynomials which is unsatisfiable over the Boolean cube and show that it has a short F 2 \mathbb{F}_{2} F 2 -Nullstellensatz proof, which implies that it lies within PPA by [30 ] . For every a ∈ [ N ] ∖ [ ℓ ] a \in[N] \setminus[\ell] a ∈ [ N ] ∖ [ ℓ ] , and j ∈ [ r ] j \in[r] j ∈ [ r ] , introduce one Boolean variable h a , j h_{a,j} h a , j . Write
h ( a ) = ( h a , 1 , … , h a , r ) ∈ { 0 , 1 } r . h(a) = (h_{a,1}, \ldots, h_{a,r}) \in\{0,1\}^{r}. h ( a ) = ( h a , 1 , … , h a , r ) ∈ { 0 , 1 } r .
Set h a , j : = 0 h_{a,j} := 0 h a , j := 0 for all a ∈ [ ℓ ] a \in[\ell] a ∈ [ ℓ ] and j ∈ [ r ] j \in[r] j ∈ [ r ] ; these are constants, not variables. Thus h ( 1 ) = ⋯ = h ( ℓ ) = 0 r h(1) = \cdots= h(\ell) = 0^{r} h ( 1 ) = ⋯ = h ( ℓ ) = 0 r . Let h = { h a , j ∣ a ∈ [ N ] ∖ [ ℓ ] , j ∈ [ r ] } h = \{h_{a,j} \mid a \in[N] \setminus[\ell], j \in[r]\} h = { h a , j ∣ a ∈ [ N ] ∖ [ ℓ ] , j ∈ [ r ]} . Then the number of Boolean variables in h h h is n : = ( N − ℓ ) r n := (N-\ell)r n := ( N − ℓ ) r .
For an edge e ∈ E e \in E e ∈ E , define
F e ( h ) = ∑ v ∈ e h ( v ) ∈ F 2 r , F e ( h ) j = ∑ v ∈ e h v , j . F_e(h) = \sum_{v \in e} h(v) \in\mathbb{F}_2^r,\qquad F_e(h)_j = \sum_{v \in e} h_{v,j}. F e ( h ) = v ∈ e ∑ h ( v ) ∈ F 2 r , F e ( h ) j = v ∈ e ∑ h v , j .
where the first sum is coordinate-wise XOR and the second sum is over F 2 \mathbb{F}_2 F 2 . Define
P G = { p e ( h ) ∣ e ∈ E ∖ { e ∗ } } , p e ( h ) = ∏ j = 1 r ( 1 + ∑ v ∈ e h v , j ) . (8) \mathcal{P}_G = \{p_e(h) \mid e \in E \setminus\{e^*\}\},\qquad p_e(h) = \prod_{j=1}^{r}\left(1+\sum_{v \in e} h_{v,j}\right). \tag*{(8)} P G = { p e ( h ) ∣ e ∈ E ∖ { e ∗ }} , p e ( h ) = j = 1 ∏ r ( 1 + v ∈ e ∑ h v , j ) . (8)
Every polynomial is over F 2 \mathbb{F}_2 F 2 . The set of polynomials in P G \mathcal{P}_G P G will be our system of (unsatisfiable) polynomial equations. On a Boolean assignment,
p e ( h ) = 1 ⟺ F e ( h ) = 0 r . p_e(h)=1 \quad\Longleftrightarrow\quad F_e(h)=0^r. p e ( h ) = 1 ⟺ F e ( h ) = 0 r .
The next lemma shows that if E E E is r r r -balanced, then the system of polynomial equations ( P G ) (\mathcal{P}_G) ( P G ) is unsatisfiable, and therefore ZeroEdgeG _G G is total. Secondly, we exhibit a simple NS2 _2 2 refutation for P G \mathcal{P}_G P G , which by [30 ] implies a black-box containment ZeroEdgeG ∈ P P A d t _G \in\mathrm{PPA}^{\mathrm{dt}} G ∈ PPA dt .
Lemma 42 (NS2 _2 2 refutation of P G \mathcal{P}_G P G ). The system P G \mathcal{P}_G P G is unsatisfiable and has the NS2 _2 2 refutation
1 = ∑ e ∈ E ∖ { e ∗ } p e ( h ) ( m o d 2 ) . 1 = \sum_{e \in E \setminus\{e^*\}} p_e(h) \pmod2. 1 = e ∈ E ∖ { e ∗ } ∑ p e ( h ) ( mod 2 ) . Furthermore, the NS2 _2 2 certificate, ∑ e ∈ E ∖ { e ∗ } p e \sum_{e \in E \setminus\{e^*\}} p_e ∑ e ∈ E ∖ { e ∗ } p e has degree r r r and at most ∣ E ∣ ( ℓ + 1 ) r |E|(\ell+1)^r ∣ E ∣ ( ℓ + 1 ) r monomial occurrences before cancellation.
Proof. Let p e ∗ ( h ) p_{e^*}(h) p e ∗ ( h ) be defined as above (although it isn’t one of the equations in P G \mathcal{P}_G P G ); that is, p e ∗ ( h ) = ∏ j ∈ [ r ] ( 1 + F e ∗ ( h ) j ) p_{e^*}(h) = \prod_{j \in[r]}(1+F_{e^*}(h)_j) p e ∗ ( h ) = ∏ j ∈ [ r ] ( 1 + F e ∗ ( h ) j ) . We first show that by the balancedness of E E E we have: ∑ e ∈ E p e ( h ) = 0 \sum_{e \in E} p_e(h) = 0 ∑ e ∈ E p e ( h ) = 0 over F 2 \mathbb{F}_2 F 2 . To see this first note that when we expand p e ( h ) p_e(h) p e ( h ) we get the sum of terms of the form
h a 1 , j 1 h a 2 , j 2 ⋯ h a s , j s , h_{a_1,j_1}h_{a_2,j_2}\cdots h_{a_s,j_s}, h a 1 , j 1 h a 2 , j 2 ⋯ h a s , j s ,
where s ≤ r s \le r s ≤ r , all j k j_k j k ’s are distinct, and a 1 , … , a s ∈ e a_1,\ldots,a_s \in e a 1 , … , a s ∈ e . Now, summing over all e e e and expanding each p e ( h ) p_e(h) p e ( h ) we want to show that every term appears an even number of times in ∑ e ∈ E p e ( h ) \sum_{e \in E}p_e(h) ∑ e ∈ E p e ( h ) . Each term appears exactly once in each p e ( h ) p_e(h) p e ( h ) where e e e contains the set of nodes mentioned in it. By the r r r -balancedness the number of edges that contain a fixed subset of size at most r r r is even.
On the other hand, since h ( 1 ) = ⋯ = h ( ℓ ) = 0 h(1)=\cdots=h(\ell)=0 h ( 1 ) = ⋯ = h ( ℓ ) = 0 , the polynomial p e ∗ ( h ) = p [ ℓ ] ( h ) p_{e^*}(h)=p_{[\ell]}(h) p e ∗ ( h ) = p [ ℓ ] ( h ) is equal to 1:
p e ∗ ( h ) = ∏ j ∈ [ r ] ( 1 + F e ∗ ( h ) j ) = ∏ j ∈ [ r ] ( 1 + ∑ i ∈ [ ℓ ] h ( i ) j ) = ∏ j ∈ [ r ] ( 1 + 0 ) = 1. p_{e^*}(h)=\prod_{j\in[r]}(1+F_{e^*}(h)_j)=\prod_{j\in[r]}\left(1+\sum_{i\in[\ell]}h(i)_j\right)=\prod_{j\in[r]}(1+0)=1. p e ∗ ( h ) = j ∈ [ r ] ∏ ( 1 + F e ∗ ( h ) j ) = j ∈ [ r ] ∏ 1 + i ∈ [ ℓ ] ∑ h ( i ) j = j ∈ [ r ] ∏ ( 1 + 0 ) = 1.
Therefore since p e ∗ ( h ) = 1 p_{e^*}(h)=1 p e ∗ ( h ) = 1 and ∑ e ∈ E p e ( h ) = 0 \sum_{e\in E}p_e(h)=0 ∑ e ∈ E p e ( h ) = 0 , it follows that ∑ e ∈ E ∖ { e ∗ } p e ( h ) = 1 \sum_{e\in E\setminus\{e^*\}}p_e(h)=1 ∑ e ∈ E ∖ { e ∗ } p e ( h ) = 1 over F 2 \mathbb{F}_2 F 2 . □
We have shown not only that P G \mathcal{P}_G P G is unsatisfiable, but that there is a simple NS2 _2 2 refutation, ∑ e p e q e = 1 \sum_e p_eq_e=1 ∑ e p e q e = 1 , (where the q e q_e q e ’s are all 1) obtained by simply taking the sum of all polynomials in P G \mathcal{P}_G P G . Lastly, each nonconstant p e p_e p e has degree r r r , and there are at most ( ℓ + 1 ) r (\ell+1)^r ( ℓ + 1 ) r terms in each p e p_e p e . Therefore, the proof size (number of monomials before cancellation) is at most ∣ E ∣ ( ℓ + 1 ) r = 2 poly ( ℓ ) |E|(\ell+1)^r = 2^{\operatorname{poly}(\ell)} ∣ E ∣ ( ℓ + 1 ) r = 2 poly ( ℓ ) .
Figure 5. This picture illustrates the translation with r = 1 r = 1 r = 1 and G G G being the ordinary 8-node cycle with e ∗ = { 1 , 2 } e^* = \{1,2\} e ∗ = { 1 , 2 } . The problem ZeroEdgeG in this case is given a boolean labeling h ∈ { 0 , 1 } 8 h \in\{0,1\}^{8} h ∈ { 0 , 1 } 8 with h ( 1 ) = h ( 2 ) = 0 h(1) = h(2) = 0 h ( 1 ) = h ( 2 ) = 0 to find an edge with equal nodes labels. One can view this instance of ZeroEdgeG as a Tseitin formula for the dual of G G G , so the NS2 _2 2 -refutation is simply ∑ u v ∈ E ( 1 + h u + h v ) = 0 \sum_{uv\in E}(1+h_u+h_v)=0 ∑ uv ∈ E ( 1 + h u + h v ) = 0 . Each cell of the table corresponds to some pair edge-monomial (monomials have degree ≤ 1 \leq1 ≤ 1 here), but only the cells ( e , u ) (e,u) ( e , u ) with u ∈ { ⊥ } ∪ e u \in\{\bot\}\cup e u ∈ { ⊥ } ∪ e are nodes of the PPA instance.
Translating from NS2 _2 2 to PPA. To finish the proof of PPA inclusion, we instantiate the conversion of a F 2 \mathbb{F}_2 F 2 -Nullstellensatz refutation to a PPA instance by [30 Lemma 13] . Their generic proof does not necessarily imply an efficient instance. We use the fact that G G G is efficiently r r r -balanced. Recall that it means that for every set S ⊆ [ N ] S \subseteq[N] S ⊆ [ N ] of size ≤ r \leq r ≤ r the edges e ⊇ S e \supseteq S e ⊇ S can be efficiently paired-up.
First recall the canonical PPA-complete problem.
Definition 5. Lonely problem is defined on a single array Mate ∈ ( [ 2 N + 1 ] ) 2 N + 1 \in([2N+1])^{2N+1} ∈ ([ 2 N + 1 ] ) 2 N + 1 .
i ∈ [ 2 N + 1 ] i \in[2N+1] i ∈ [ 2 N + 1 ] if M a t e M a t e i ≠ i \mathrm{Mate}_{\mathrm{Mate}_i} \ne i Mate Mate i = i , (mismatch)
i ∈ [ 2 N + 1 ] i \in[2N+1] i ∈ [ 2 N + 1 ] if M a t e i = i \mathrm{Mate}_i = i Mate i = i . (lonely node)
Every monomial occurrence in the refutation ∑ e ∈ E ∖ { e ∗ } p e ( h ) + 1 = 0 \sum_{e\in E\setminus\{e^*\}}p_e(h)+1=0 ∑ e ∈ E ∖ { e ∗ } p e ( h ) + 1 = 0 can be encoded by a pair ( e , u ) (e,u) ( e , u ) with e ∈ E e \in E e ∈ E and u ∈ ( e ∪ { ⊥ } ) r u \in(e\cup\{\bot\})^r u ∈ ( e ∪ { ⊥ } ) r , let V V V be the set of these encodings, excluding ( e ∗ , ⊥ r ) (e^*,\bot^r) ( e ∗ , ⊥ r ) . Then ∣ V ∣ = ∣ E ∣ ( ℓ + 1 ) r − 1 |V|=|E|(\ell+1)^r-1 ∣ V ∣ = ∣ E ∣ ( ℓ + 1 ) r − 1 is odd by balancedness for the empty set. A pair ( e , u ) (e,u) ( e , u ) corresponds to m u : = ∏ i ∈ [ r ] : u i ≠ ⊥ h u i , i m_u:=\prod_{i\in[r]:u_i\ne\bot}h_{u_i,i} m u := ∏ i ∈ [ r ] : u i = ⊥ h u i , i (if u i ∈ e ∗ u_i\in e^* u i ∈ e ∗ , then h u i , i h_{u_i,i} h u i , i is a constant 0). We define the instance Mate: H → V V \mathcal{H}\to V^V H → V V to reflect the cancellation of the different occurrences of the same monomial. Take some ( e , u ) (e,u) ( e , u ) such that m u ( h ) = 0 m_u(h)=0 m u ( h ) = 0 , i.e. the corresponding monomial evaluates to 0 in the refutation. Such monomials are not useful for finding a solution to ZeroEdgeG, so we match them up using syntactic properties of NS2 _2 2 refutation. Let S ⊆ e S\subseteq e S ⊆ e be the set of non-⊥ \bot ⊥ coordinates in u u u . By efficient r r r -balancedness there exists an involution σ S : E S → E S \sigma_S:E_S\to E_S σ S : E S → E S that matches-up the edges e e e containing the set S S S . Then we define M a t e e , u ( h ) = ( σ S ( e ) , u ) \mathrm{Mate}_{e,u}(h)=(\sigma_S(e),u) Mate e , u ( h ) = ( σ S ( e ) , u ) . Now we need to match the monomial occurrences that evaluate to 1 in the refutation. Take e ∈ E ∖ { e ∗ } e\in E\setminus\{e^*\} e ∈ E ∖ { e ∗ } . If p e ( h ) = 1 p_e(h)=1 p e ( h ) = 1 , we just define M a t e e , ⊥ r ( h ) = ( e , ⊥ r ) \mathrm{Mate}_{e,\bot^r}(h)=(e,\bot^r) Mate e , ⊥ r ( h ) = ( e , ⊥ r ) and pair-up all the other nodes corresponding to monomials evaluating to 1 on h h h . If any such node is a solution to the PPA-instance, ( h , e ) ∈ (h,e)\in ( h , e ) ∈ ZeroEdgeG by definition. If p e ( h ) = 0 p_e(h)=0 p e ( h ) = 0 , the number of monomials in p e p_e p e that evaluate to 1 is even, so we can pair them arbitrarily. To make the pairings above efficient observe that the set of tuples u ∈ ( e ∪ { ⊥ } ) r u\in(e\cup\{\bot\})^r u ∈ ( e ∪ { ⊥ } ) r such that m u ( h ) = 1 m_u(h)=1 m u ( h ) = 1 is a product set ∏ i ∈ [ r ] ( { ⊥ } ∪ { v ∈ e ∣ h v , i = 1 } ) \prod_{i\in[r]}\bigl(\{\bot\}\cup\{v\in e\mid h_{v,i}=1\}\bigr) ∏ i ∈ [ r ] ( { ⊥ } ∪ { v ∈ e ∣ h v , i = 1 } ) , so we can efficiently pair the elements up in the lexicographic order (excluding ⊥ r \bot^r ⊥ r in the case p e ( h ) = 1 p_e(h)=1 p e ( h ) = 1 ). Then all solutions correspond to solutions of ZeroEdgeG as required.
Acknowledgements
Ziyi Guan is funded by the Swiss National Science Foundation (SNSF) through a Postdoc.Mobility fellowship. Oliver Korten is supported by the National Science Foundation under Grant No. DMS-2424441. Artur Riazanov is supported by the Simons Foundation as a Junior Fellow in the Simons Society of Fellows (20599). Noah Fleming is supported by the Swedish Research Council under grant number 2025-06762. Mika Göös and Weiqiang Yuan are supported by the Swiss State Secretariat for Education, Research, and Innovation (SERI) under contract number MB22.00026.
The authors thank Nir Bitansky, Tal Malkin, Yaroslav Alekseev, Gilbert Maystre, Eylon Yogev, and Yiding Zhang for discussions related to this project.
AI disclosure
The separation from P W P P ⊈ P L S \mathrm{PWPP} \not\subseteq\mathrm{PLS} PWPP ⊆ PLS was obtained by the human authors, using ChatGPT 5.5 for assistance with writing the proof. The human authors obtained the collapse of U E o P L \mathrm{UEoPL} UEoPL by asking ChatGPT 6 to refine their initial recursive algorithm using results from [3 ] . The separations P P A ⊈ P L S \mathrm{PPA} \not\subseteq\mathrm{PLS} PPA ⊆ PLS and P P A D ⊈ F P \mathrm{PPAD} \not\subseteq\mathrm{FP} PPAD ⊆ FP were obtained by ChatGPT 6 supplied with the previous two results. In the generated proof, the use of Nullstellensatz equivalence was hidden. This paper is written by humans; all proofs were significantly simplified.
References
TFNP glossary
In this section, we give formal definitions of all TFNP classes we use. With the exception of the entire class TFNP and the smallest subclass (total) FP that contains efficiently solvable total relations, all subclasses are defined by canonical complete problems. Then if F F F is a complete relation for some class C \mathcal{C} C we say that F ′ ∈ C F' \in\mathcal{C} F ′ ∈ C iff there exists a zero-error public reduction (see § 6 ) from F ′ F' F ′ to F F F .
PPP (Pigeon). We are given Pigeon ∈ [ N ] N + 1 \operatorname{Pigeon} \in[N]^{N+1} Pigeon ∈ [ N ] N + 1 ; a solution is
PWPP (WeakPigeon). We are given Pigeon ∈ [ N ] 2 N \operatorname{Pigeon} \in[N]^{2N} Pigeon ∈ [ N ] 2 N ; a solution is
PPA (Lonely). We are given Mate ∈ [ 2 N + 1 ] 2 N + 1 \operatorname{Mate} \in[2N+1]^{2N+1} Mate ∈ [ 2 N + 1 ] 2 N + 1 ; solutions are
i ∈ [ 2 N + 1 ] i \in[2N+1] i ∈ [ 2 N + 1 ] such that Mate i = i \operatorname{Mate}_{i} = i Mate i = i . (lonely node)
i ∈ [ 2 N + 1 ] i \in[2N+1] i ∈ [ 2 N + 1 ] such that Mate Mate i ≠ i \operatorname{Mate}_{\operatorname{Mate}_{i}} \ne i Mate Mate i = i . (mismatch)
PPAD (End of Line). We are given Succ , Pred ∈ [ N ] N \operatorname{Succ},\operatorname{Pred} \in[N]^N Succ , Pred ∈ [ N ] N ; solutions are
1 1 1 if Pred 1 ≠ 1 \operatorname{Pred}_{1} \ne1 Pred 1 = 1 or Succ 1 = 1 \operatorname{Succ}_{1} = 1 Succ 1 = 1 or Pred Succ 1 ≠ 1 \operatorname{Pred}_{\operatorname{Succ}_{1}} \ne1 Pred Succ 1 = 1 ; (distinguished node is not a source)
i ∈ [ N ] ∖ { 1 } i \in[N] \setminus\{1\} i ∈ [ N ] ∖ { 1 } if Succ Pred i ≠ i \operatorname{Succ}_{\operatorname{Pred}_{i}} \ne i Succ Pred i = i . (non-canonical source)
i ∈ [ N ] i \in[N] i ∈ [ N ] if Pred Succ i ≠ i \operatorname{Pred}_{\operatorname{Succ}_{i}} \ne i Pred Succ i = i . (active sink)
A common grid formulation. For PLS, EoPL, and UEoPL, use the N × N N \times N N × N grid, N ≥ 2 N \ge2 N ≥ 2 , of Definition 3. Every node has a successor S u c c i j ∈ [ N ] ∪ { ⊥ } \mathrm{Succ}_{ij} \in[N] \cup\{\bot\} Succ ij ∈ [ N ] ∪ { ⊥ } ; for i < N i < N i < N , a non-⊥ \bot ⊥ value k k k names ( i + 1 , k ) (i+1,k) ( i + 1 , k ) . For PLS a node is active if S u c c i j ≠ ⊥ \mathrm{Succ}_{ij} \ne\bot Succ ij = ⊥ (for EoPL and UEoPL we restrict the activity requirement). A proper sink is an inactive node reached from an active node.
PLS (Sink of Dag). Solutions are
( 1 , 1 ) (1,1) ( 1 , 1 ) if it is inactive; (no canonical source)
( N , j ) (N,j) ( N , j ) if it is active; (sink)
( i , j ) (i,j) ( i , j ) with i < N i < N i < N if it is active, but ( i + 1 , S u c c i j ) (i+1,\mathrm{Succ}_{ij}) ( i + 1 , Succ ij ) is inactive. (predecessor of a proper sink)
In the third case we output the active predecessor, which witnesses an incoming edge to the inactive sink. This makes the solution locally checkable even though PLS has no predecessor pointers, as in [29 Section 3.2] .
EoPL (End of Potential Line). Add pointers P r e d i j ∈ [ N ] ∪ { ⊥ } \mathrm{Pred}_{ij} \in[N] \cup\{\bot\} Pred ij ∈ [ N ] ∪ { ⊥ } for rows 2 , … , N 2,\ldots,N 2 , … , N , and redefine activity throughout: for i < N i < N i < N , node ( i , j ) (i,j) ( i , j ) is active iff S u c c i j = k ≠ ⊥ \mathrm{Succ}_{ij}=k \ne\bot Succ ij = k = ⊥ and P r e d i + 1 , k = j \mathrm{Pred}_{i+1,k}=j Pred i + 1 , k = j ; in row N N N , activity still means S u c c N j ≠ ⊥ \mathrm{Succ}_{Nj} \ne\bot Succ N j = ⊥ . Keep the first two PLS solution types with this activity definition, replace the third by the proper sink itself, and add proper sources:
( i , j ) (i,j) ( i , j ) if it is a proper sink; (proper sink)
( i , j ) ≠ ( 1 , 1 ) (i,j) \ne(1,1) ( i , j ) = ( 1 , 1 ) with i < N i < N i < N if it is active and no active node has it as a successor. (proper source)
In particular, every active node in row 1 except ( 1 , 1 ) (1,1) ( 1 , 1 ) is a proper source. A proper sink itself is locally checkable here because its predecessor pointer identifies the only possible active predecessor; see Definition 3.
UEoPL (Unique End of Potential Line). Use the same instance, activity, and four solution types as EoPL, and add just one further type:
( i , j ) (i,j) ( i , j ) and ( i , j ′ ) (i,j') ( i , j ′ ) with j ≠ j ′ j \ne j' j = j ′ both active. (parallel active nodes)
TFNP separations in the ROM
In this section, we will give a formal definition of TFNP problems and reductions under the random oracle model. Let Γ a ( n ) , b ( n ) \Gamma_{a(n),b(n)} Γ a ( n ) , b ( n ) be the set of all Boolean functions γ : { 0 , 1 } a ( n ) → { 0 , 1 } b ( n ) \gamma:\{0,1\}^{a(n)} \to\{0,1\}^{b(n)} γ : { 0 , 1 } a ( n ) → { 0 , 1 } b ( n ) .
Definition 6 (Search problem in an oracle model). A search problem in the oracle-model of Γ a ( n ) , b ( n ) \Gamma_{a(n),b(n)} Γ a ( n ) , b ( n ) is a family of relations R = { R n } n ≥ 1 \mathcal{R}=\{R_n\}_{n\ge1} R = { R n } n ≥ 1 where R n ⊆ { 0 , 1 } n × Γ a ( n ) , b ( n ) × { 0 , 1 } s ( n ) R_n \subseteq\{0,1\}^n \times\Gamma_{a(n),b(n)} \times\{0,1\}^{s(n)} R n ⊆ { 0 , 1 } n × Γ a ( n ) , b ( n ) × { 0 , 1 } s ( n ) . R \mathcal{R} R is total if for all n n n , x ∈ { 0 , 1 } n x \in\{0,1\}^n x ∈ { 0 , 1 } n and γ n ∈ Γ a ( n ) , b ( n ) \gamma_n \in\Gamma_{a(n),b(n)} γ n ∈ Γ a ( n ) , b ( n ) there exists y y y such that ( x , γ n , y ) ∈ R n (x,\gamma_n,y) \in R_n ( x , γ n , y ) ∈ R n .
We say that an algorithm A A A average-case solves some oracle search problem R ( ⋅ ) \mathcal{R}^{(\cdot)} R ( ⋅ ) in the random oracle model if for all sufficiently large n n n , when γ n \gamma_n γ n is sampled uniformly over all functions from a ( n ) a(n) a ( n ) bits to b ( n ) b(n) b ( n ) bits,
Pr x ∼ { 0 , 1 } n , γ n ∼ Γ a ( n ) , b ( n ) [ A γ n ( x ) outputs y such that ( x , γ n , y ) ∈ R n ] ≥ 2 3 . \Pr_{\substack{x \sim\{0,1\}^n,\ \gamma_n \sim\Gamma_{a(n),b(n)}}}\left[A^{\gamma_n}(x)\text{ outputs }y\text{ such that }(x,\gamma_n,y)\in R_n\right] \ge\frac{2}{3}. x ∼ { 0 , 1 } n , γ n ∼ Γ a ( n ) , b ( n ) Pr [ A γ n ( x ) outputs y such that ( x , γ n , y ) ∈ R n ] ≥ 3 2 .
We say that an oracle TFNP search problem R ( ⋅ ) \mathcal{R}^{(\cdot)} R ( ⋅ ) is efficiently reducible to S ( ⋅ ) \mathcal{S}^{(\cdot)} S ( ⋅ ) in the ROM, if there are oracle algorithms f ( ⋅ ) , g ( ⋅ ) f^{(\cdot)},g^{(\cdot)} f ( ⋅ ) , g ( ⋅ ) in poly ( n ) \operatorname{poly}(n) poly ( n ) time, such that
Pr x ∼ { 0 , 1 } n , γ n ∼ Γ a ( n ) , b ( n ) [ ∀ y , ( f γ n ( 1 n , x ) , γ n , y ) ∈ S ( ⋅ ) ⟹ ( x , γ n , g γ n ( 1 n , x , y ) ) ∈ R ( ⋅ ) ] ≥ 2 3 . \Pr_{\substack{x \sim\{0,1\}^n,\ \gamma_n \sim\Gamma_{a(n),b(n)}}}\left[\forall y,\ (f^{\gamma_n}(1^n,x),\gamma_n,y)\in S^{(\cdot)} \Longrightarrow(x,\gamma_n,g^{\gamma_n}(1^n,x,y))\in R^{(\cdot)}\right] \ge\frac{2}{3}. x ∼ { 0 , 1 } n , γ n ∼ Γ a ( n ) , b ( n ) Pr [ ∀ y , ( f γ n ( 1 n , x ) , γ n , y ) ∈ S ( ⋅ ) ⟹ ( x , γ n , g γ n ( 1 n , x , y )) ∈ R ( ⋅ ) ] ≥ 3 2 .
One may assume that a ( n ) a(n) a ( n ) , b ( n ) b(n) b ( n ) , s ( n ) s(n) s ( n ) are all bounded by polynomials. For all the circuit TFNP problems we mentioned in this paper, i.e., TFNP problems, where the input is the description of a circuit whose truth table encodes an object of exponential length, it is natural to define the corresponding oracle TFNP problem by letting the input be descriptions of oracle circuits . For example, the oracle search problem P W P P ( ⋅ ) \mathrm{PWPP}^{(\cdot)} PWPP ( ⋅ ) has the input x x x being the description of some oracle circuit C γ : { 0 , 1 } m → { 0 , 1 } m − 1 C^{\gamma}\colon\{0,1\}^{m} \to\{0,1\}^{m-1} C γ : { 0 , 1 } m → { 0 , 1 } m − 1 , and ( x , γ n , ( y 1 , y 2 ) ) ∈ PWPP ( ⋅ ) (x,\gamma_n,(y_1,y_2)) \in\operatorname{PWPP}^{(\cdot)} ( x , γ n , ( y 1 , y 2 )) ∈ PWPP ( ⋅ ) if and only if C γ n ( y 1 ) = C γ n ( y 2 ) C^{\gamma_n}(y_1) = C^{\gamma_n}(y_2) C γ n ( y 1 ) = C γ n ( y 2 ) for y 1 ≠ y 2 y_1 \ne y_2 y 1 = y 2 .
Note that any of the circuit TFNP problems we considered in this paper is equivalent to another problem where the input oracle circuit is promised to be the canonical circuit C γ ( x ) : = γ ( x ) C^{\gamma}(x) := \gamma(x) C γ ( x ) := γ ( x ) . It is not hard to see that reductions between oracle versions of the TFNP problems in the ROM can be viewed as uniform versions of average-case reductions between the corresponding black-box problems, where each node of the decision trees can be locally printed by a uniform algorithm in polylog ( N ) \operatorname{polylog}(N) polylog ( N ) time.