betaFeedback

Reading v1View latest version

WorksMathematics

Recertifying decisions via e-closure: uniform improvements of conformal risk control and randomized e-BH

Abstract

Statistical procedures often control expected loss at a prescribed level while leaving part of their risk budget unused. Building on the e-value representation of risk-controlled decisions and the e-closure principle for multiple testing, we formulate recertification, a general paradigm for improving procedures by exploiting computable slack in their validity certificates. A valid procedure's losses normalized by their risk budgets form a state-indexed e-value collection; conversely, decisions whose normalized losses are bounded by this collection inherit its risk guarantees. Recertification uses distributional structure to quantify slack, enlarge the certifying e-values while preserving validity, and construct less conservative decisions. We develop two applications. For conformal risk control (CRC) with a known loss family, recertification redistributes unused risk budget among the held-out points of each hypothetical augmented sample. The resulting controller is valid under every finite exchangeable law and no more conservative than CRC on any calibration sample. For convex losses on an interval of actions, repeated recertification converges geometrically to an admissible controller. For false discovery rate control with arbitrarily dependent e-values, recertification exploits unused conditional budgets in randomized e-BH. It yields a closed-form randomized procedure whose rejection set contains that of randomized e-BH for every realization of the shared randomization and whose expected number of rejections is maximal subject to the same conditional budget constraints. Recertifying with the larger e-collection of closed e-BH gives a second closed-form procedure whose rejection set contains that of the first. Experiments on CIFAR-100 hierarchical classification and multiple testing simulations demonstrate improved budget utilization, informativeness and power over the baselines.

Keywords: e-values, conformal risk control, false discovery rate, multiple testing, exchangeability, admissibility.

Introduction

Many statistical procedures turn data into an informed action, while guaranteeing that some expected loss stays below a prescribed level. Statistical decision theory formalizes this task through a decision rule mapping data to actions, a loss depending on the action and an unknown state of nature, and the resulting statewise expected loss, or risk [43, 9]. The bound imposes a risk budget that must hold in every state. Among rules satisfying this constraint, one seeks the most useful decisions, as in the constrained problems of [22].

Multiple testing is a decision problem of exactly this kind. With KK hypotheses, the action is a rejection set R⊆[K]R\subseteq[K], so the action space is the collection 2[K]2^{[K]} of all subsets of [K][K], and the unknown state is the set T⊆[K]T\subseteq[K] of true null hypotheses. The false discovery proportion ∣T∩R∣/(∣R∣∨1)|T\cap R|/(|R|\vee1) is the loss, and false discovery rate (FDR) control bounds its expectation by α\alpha. The procedure of [8] achieves this by comparing the ordered p-values with linearly increasing thresholds; its e-value analogue, the e-BH procedure of [44], applies the reciprocal thresholds to e-values, which are nonnegative statistics with expectation at most one under their null hypotheses [41, 34]. The recent work of [47] introduces the e-closure principle, a general principle that uniformly improves many testing procedures based on e-values, including e-BH. Specifically, given an e-value ETE_T for each candidate true-null set TT, valid when TT is the set of true nulls, the principle certifies every rejection set RR that satisfies

∣T∩R∣∣R∣∨1≤αETfor every T⊆[K].\begin{equation} \frac{|T\cap R|}{|R|\vee1}\leq\alpha E_T\qquad\text{for every }T\subseteq[K]. \tag*{(1.1)} \end{equation}

Under the actual null set, the left side is the false discovery proportion and the right side has expectation at most α\alpha. The false discovery rate is therefore controlled even when the analyst chooses among the certified rejection sets after seeing the data. Conversely, [47] show that a procedure controls the false discovery rate simultaneously over the rejection sets it may report if and only if all of them are certified in this way by some family of e-values. The principle applies equally to other error rates that are expected losses, and it contains the classical closed testing principle for the familywise error rate [32] as the case of e-values taking only the values 00 and 1/α1/\alpha.

Nothing in this argument depends on the actions being rejection sets. In a general decision problem, a state ss specifies a class of distributions for the data XX, an action aa is chosen from an arbitrary set, and each of several losses Lt(s,a;X)L_t(s,a;X), indexed by tt, carries its own budget αt(s)\alpha_t(s). A family of e-values, one for each state and risk, certifies the actions whose losses fit within all the budgets it allows. Every data-dependent choice among the certified actions then controls every risk, and every procedure with this guarantee is certified by some such family [20, 21, 1]. In § 2 we review the e-closure principle at this level of generality, with menus of arbitrary actions, possibly continuously indexed states and risks, and losses that may depend on the data.

The correspondence can be read in both directions, and the direction from procedures to e-values suggests how to improve a procedure. Improving a decision rule directly is difficult: a more liberal rule may have higher power or utility, but it is rarely clear how far a given rule can be pushed before its guarantee fails. By contrast, improving an e-value is easier. If an e-value has expectation strictly below one, and the shortfall can be computed, for instance conditionally on a statistic whose conditional law is known under the null, then adding the shortfall back yields a larger e-value. Through the e-closure correspondence, larger e-values translate back into decisions. Starting from a valid procedure, we apply this construction to its canonical e-values: its losses divided by their risk budgets. Inverting the enlarged certificate yields a menu containing the original actions and potentially more liberal ones, all with the same guarantee. We call this step recertification. It generalizes the anchoring idea of [33], which keeps an existing false discovery rate procedure and spends the slack in its validity proof, and it can be repeated.

We apply recertification to two problems. The first is conformal risk control (CRC) [3], which extends conformal prediction from coverage to general monotone losses. Given nn exchangeable calibration points and a known family of losses indexed by a conservativeness parameter λ\lambda, CRC selects the least conservative λ\lambda for which the calibration losses, together with a bound on the loss of the unseen test point, fit within the budget (n+1)α(n+1)\alpha. The selected controller typically leaves part of this budget unused. Recertification computes this unused budget on every such sample, redistributes it among the n+1n+1 held-out positions, and inverts the resulting e-values. The new controller is valid under every finite exchangeable law, and for every calibration sample it is no more conservative than CRC. In this sense, for a fixed loss family and observation domain, it improves CRC uniformly. This recertification step can be repeated, with diminishing returns. For convex losses, the iterates converge geometrically to a controller that admits no further pointwise improvement, and on finite outcome spaces a coordinatewise sweep reaches such a controller without convexity (§ 3).

Figure 1. Risk-budget use and mean prediction-set size on CIFAR-100 with confidence-adaptive prediction rules (n=50n=50, α=0.15\alpha=0.15). Round 00 is CRC, and later rounds apply recertification. Results are averaged over 300 paired splits, each with 16 test images.

Figure 1 illustrates these gains in hierarchical classification on CIFAR-100 (§ 3.6), using rules that give more specific predictions when the classifier is more confident. At a target of 15%15\%, CRC attains a mean test risk of 14.21%14.21\%. Repeated recertification raises it to 14.95%14.95\%, close to the target, and reduces the mean prediction-set size from 10.7710.77 to 8.928.92 labels, a reduction of 17.2%17.2\%.

The second application returns to multiple testing. The e-BH procedure is valid under arbitrary dependence but can be conservative, and [45] showed that external randomization recovers part of the lost power. Their U-eBH procedure boosts the e-values by dividing them by a single uniform random variable and then applies e-BH. In this setting, we treat the conditional law of the rejection set given the e-values as a randomized action. In these terms, U-eBH is certified by the family of e-values behind e-BH, through a version of the self-consistency condition of [10] that holds on average over the randomization, and it typically leaves part of the budget allowed by this family unused. Recertification spends this budget and yields a closed-form randomized rule, recertified U-eBH (RU-eBH), which rejects at least as many hypotheses as U-eBH for every realization of the randomization and has the largest expected number of rejections among all randomized procedures certified by the same family.

The same principle applies to closed e-BH, the improvement of e-BH by e-closure [47], whose family of e-values is larger because it adapts to the number of true nulls. Recertifying with this family gives a second closed-form rule, recertified closed e-BH (RC-eBH), whose rejection set contains that of RU-eBH and which has the largest expected number of rejections among all randomized procedures certified by this family, closed e-BH included (§ 4). In simulations, both rules are more powerful than e-BH and U-eBH in every setting, and RC-eBH is the most powerful of the eight procedures we compare in nearly every setting.

Related work

3.25ex -1emE-values and decisions. E-values have become a standard tool for testing and multiple testing [41, 34]. Their link to decision making is developed by [21], who allows the significance level and the loss to be chosen after seeing the data, and by [26] and [11], who study post hoc testing and its admissible procedures. For a single risk, our certified menu is the set of actions whose e-posterior risk bound [20], with each state’s loss divided by its budget, is at most one. [1] study decisions reported together with certificates of their loss, and [28] give evidence-weighted loss bounds for decisions based on conformal e-prediction sets. Decision-theoretic views of conformal prediction also study how prediction sets should inform downstream actions [31, 25]. These works allow general states and actions; our focus is the constructive use of the correspondence, which keeps the error budget fixed and recertifies an existing procedure.

3.25ex -1emClosure principles. Closed testing [32] controls the familywise error rate, and every coherent procedure for that error rate is a closed testing procedure [36]. Closed testing also yields simultaneous bounds on the false discovery proportion of every rejection set [17], and only closed testing procedures are admissible for that purpose [18]. E-closure [47] extends the closure principle to error rates defined by expected losses. Its follow-ups include the uniform improvement of the Benjamini–Hochberg procedure [16], anchoring [33], online versions [46], and complete-class and admissibility results for e-value procedures [38]. We note that representation and admissibility are separate questions. Every valid procedure is certified by some family of e-values, while admissibility requires further conditions, and our admissibility results for CRC rely on the structure of that problem.

3.25ex -1emRandomized multiple testing. Randomization is classical in testing, where it makes tests based on discrete statistics exact [30]. For false discovery rate control with e-values under arbitrary dependence, [45] showed that stochastic rounding of the e-values and U-eBH increase the power of e-BH, and [47] combine stochastic rounding with e-closure. These methods randomize the e-values. Our procedures instead choose the distribution of the rejection set directly, subject either to per-hypothesis budgets that form a randomized version of the self-consistency condition of [10] or to the constraints that certify closed e-BH. Other uniform improvements of e-BH include its minimally adaptive version [23], closed e-BH [47], and conditional calibration [14, 29], which recalibrates the e-values given a sufficient statistic.

3.25ex -1emConformal risk control. CRC already handles several, even infinitely many, risks that share a monotone action parameter [3 Section 4.3]. Risk-Controlling Prediction Sets (RCPS) and Learn then Test (LTT) instead provide high-probability statements about population risks [7, 4]. Extensions of CRC treat non-exchangeable data [13], cross-validation [12], non-monotonic losses [2], and end-to-end training [48]. The leave-one-out characterization of validity that we use (Lemma 3.1) is the risk-control counterpart of the universality of conformal prediction [42 Proposition 2.9]; see also [39], and [2] for its sufficiency direction. Conformal prediction with e-values is developed by [40], [27], [15], and [28]. Apart from the sharper bound on the unseen test loss in envelope CRC [48], which serves as our starting point, we are not aware of work on improving CRC controllers pointwise or on their admissibility. We use CRC to show concretely how large such improvements can be and what they cost in computation.

Organization

§ 2 formulates e-closure for general decision problems, including randomized actions, and introduces recertification. § 3 develops the improvement of CRC, including its admissibility theory, worked examples and a real-data study. § 4 returns to multiple testing, recertifies randomized e-BH with the e-collections of e-BH and closed e-BH, and reports simulations on Gaussian mean testing. § 5 comments on the choice among certified actions and concludes.

Generalized e-closure and recertification

This section sets up the decision framework used throughout the paper. We first describe states, actions and losses, then establish the correspondence between e-values and valid decisions, and finally introduce recertification, which turns this correspondence into a way of improving existing procedures.

States, actions, and a family of risks

Suppose that a statistician observes data XX taking values in a space X\mathcal X. The distribution of XX is governed by an unknown state s∈Ss\in\mathcal S, and each state specifies a nonempty class Ps\mathcal P_s of distributions of XX. After observing XX, the statistician takes an action a∈Aa\in\mathcal A, whose quality is measured by a family of known nonnegative losses

Lt(s,a;x),t∈T.L_t(s,a;x),\qquad t\in\mathcal T.

The index tt ranges over the kinds of error that the statistician wishes to control, such as several error rates or a continuum of loss functions, and each loss may depend on the observation xx as well as on the state and the action. The sets S\mathcal S, A\mathcal A and T\mathcal T are arbitrary and may be uncountable.

Each loss comes with a budget. Given fixed positive levels αt(s)\alpha_t(s), a decision rule A:X→AA:\mathcal X\to\mathcal A is valid if

EP[Lt(s,A(X);X)]≤αt(s)for every s∈S, P∈Ps, t∈T.\begin{equation} {\mathbb E}_P [L_t(s,A(X);X)] \leq\alpha_t(s) \quad\text{for every }s\in\mathcal S,\ P\in\mathcal P_s,\ t\in\mathcal T. \tag*{(2.1)} \end{equation}

In words, whatever the state and whichever distribution within it generates the data, the expected loss of the selected action stays within its budget, separately for every loss in the family. The expectation is unconditional: it averages over the data and hence over the action that the rule selects. Throughout, we assume that all decision rules and all losses that we evaluate are measurable, and when we discuss sets of actions we also assume that their statewise loss envelopes, defined below, are measurable. Appendix § 6 gives sufficient conditions and discusses the uncountable intersections that arise.

Validity is certified by e-values. Recall that an e-value for a class of distributions is a nonnegative statistic whose expectation is at most one under every distribution in the class. Since (2.1) involves every state and every loss, we use one e-value for each such pair. An e-collection is a family of nonnegative measurable functions Es,tE_{s,t} satisfying

EPEs,t(X)≤1(s∈S, P∈Ps, t∈T).\begin{equation} {\mathbb E}_P E_{s,t}(X)\leq1\qquad(s\in\mathcal S,\ P\in\mathcal P_s,\ t\in\mathcal T). \tag*{(2.2)} \end{equation}

In other words, an e-collection is a set of e-values, one for each combination of state and loss. Because an e-collection will be used to certify actions, we also refer to it as a certificate.

From e-collections to decisions and back

We now make precise the correspondence between e-collections and valid decisions described in the introduction. It is convenient to work with sets of actions rather than with single rules. A menu assigns to each observation xx a nonempty set M(x)⊆A\mathcal M(x)\subseteq\mathcal A of actions that the statistician is prepared to take. After seeing the data, the statistician may choose any action from M(X)\mathcal M(X), for instance by maximizing a utility or following a scientific preference. A decision rule is the special case of a menu with a single action at each observation. We first show how an e-collection produces a menu, then how a menu produces an e-collection, and finally that the two constructions are compatible.

3.25ex -1emFrom e-collections to menus. An e-collection certifies an action at the observation xx when every loss of that action fits within its budget, scaled by the corresponding e-value. The certified menu of EE is therefore

Cα(E;x)={a∈A:Lt(s,a;x)≤αt(s)Es,t(x) ∀s,t}.\begin{equation} \mathcal C_\alpha(E;x)=\{a\in\mathcal A:L_t(s,a;x)\leq\alpha_t(s)E_{s,t}(x)\ \forall s,t\}. \tag*{(2.3)} \end{equation}

The constraint for state ss caps the loss an action may incur if ss is true, in proportion to Es,t(x)E_{s,t}(x). Intuitively, a large e-value indicates that the data are unlikely under ss, so the menu may include actions that would perform poorly under ss; a small one restricts the menu to actions that perform well under ss.

3.25ex -1emFrom menus to e-collections. Conversely, a menu determines the largest loss it can incur in each state. For a menu M\mathcal M, define its loss envelopes and their normalized versions by

gs,tM(x)=sup⁡a∈M(x)Lt(s,a;x),Es,tM(x)=gs,tM(x)αt(s).\begin{equation} g_{s,t}^{\mathcal M}(x)=\sup_{a\in\mathcal M(x)}L_t(s,a;x), \qquad E_{s,t}^{\mathcal M}(x)=\frac{g_{s,t}^{\mathcal M}(x)}{\alpha_t(s)}. \tag*{(2.4)} \end{equation}

The menu is valid if EP gs,tM(X)≤αt(s){\mathbb E}_P\,g_{s,t}^{\mathcal M}(X)\leq\alpha_t(s) for every s∈Ss\in\mathcal S, P∈PsP\in\mathcal P_s and t∈Tt\in\mathcal T. This requires (2.1) to hold for every selection from the menu simultaneously, and it is equivalent to EME^{\mathcal M} being an e-collection, which we call the canonical e-collection of M\mathcal M. Applying the first construction to it gives the closure of M\mathcal M,

\begin{equation} \overline\mathcal M(x)=\mathcal C_\alpha(E^{\mathcal M};x)=\{a:L_t(s,a;x)\leq g_{s,t}^{\mathcal M}(x)\ \forall s,t\}, \tag*{(2.5)} \end{equation}

which consists of all actions whose losses never exceed those already incurred by the menu.

The following theorem, which we call generalized e-closure, states that the two constructions describe the same objects: certified menus are valid, and every valid menu is certified by its canonical e-collection.

Theorem 2.1. Let EE be an e-collection. Every measurable selection A(X)∈Cα(E;X)A(X)\in\mathcal C_\alpha(E;X) satisfies (2.1). More strongly, for every state–loss pair (s,t)(s,t) and every P∈PsP\in\mathcal P_s, EP[sup⁡a∈Cα(E;X)Lt(s,a;X)]≤αt(s). {\mathbb E}_P\left[\sup_{a\in\mathcal C_\alpha(E;X)}L_t(s,a;X)\right]\leq\alpha_t(s). Further, a menu M\mathcal M is valid if and only if M⊆Cα(E)\mathcal M\subseteq\mathcal C_\alpha(E) for some e-collection EE. The loss closure (2.5) is extensive, monotone under inclusion of menus and idempotent, and it preserves every loss envelope. In particular, M=Cα(E)⟹M=Cα(EM). \mathcal M=\mathcal C_\alpha(E)\quad\Longrightarrow\quad\mathcal M=\mathcal C_\alpha(E^{\mathcal M}).

Proof. For every a∈Cα(E;X)a\in\mathcal C_\alpha(E;X), definition (2.3) gives Lt(s,a;X)≤αt(s)Es,t(X)L_t(s,a;X)\leq\alpha_t(s)E_{s,t}(X), so the supremum in (2.6) is at most αt(s)Es,t(X)\alpha_t(s)E_{s,t}(X). Taking expectations under P∈PsP\in\mathcal P_s and using (2.2) proves (2.6), and the validity of every measurable selection follows. If M⊆Cα(E)\mathcal M\subseteq\mathcal C_\alpha(E), then gs,tM≤αt(s)Es,tg^{\mathcal M}_{s,t}\leq\alpha_t(s)E_{s,t}, so M\mathcal M is valid. Conversely, if M\mathcal M is valid, then EME^{\mathcal M} is an e-collection, and every action in M(x)\mathcal M(x) satisfies the constraints defining Cα(EM;x)\mathcal C_\alpha(E^{\mathcal M};x), so \mathcal M\subseteq\overline\mathcal M. Every action in \overline\mathcal M(x) has losses at most gs,tM(x)g^{\mathcal M}_{s,t}(x), so \overline\mathcal M has the same envelopes as M\mathcal M; idempotence follows, and monotonicity follows from the monotonicity of the envelopes. Finally, if M=Cα(E)\mathcal M=\mathcal C_\alpha(E), then M⊆Cα(EM)\mathcal M\subseteq\mathcal C_\alpha(E^{\mathcal M}), and gs,tM≤αt(s)Es,tg^{\mathcal M}_{s,t}\leq\alpha_t(s)E_{s,t} gives the reverse inclusion Cα(EM)⊆Cα(E)=M\mathcal C_\alpha(E^{\mathcal M})\subseteq\mathcal C_\alpha(E)=\mathcal M. ◻

By (2.6), the guarantee holds simultaneously over all actions in a certified menu. The statistician may therefore choose an action after seeing the data, for instance by maximizing a utility or applying a scientific filter, and every such choice from the menu of a fixed e-collection controls every risk. This is closely related to the post hoc validity of e-values in hypothesis testing, where the significance level, and more generally the loss, may be chosen after the data are observed [21, 26, 11]. We also note that the e-values may be arbitrarily dependent, because for each loss the proof uses only the corresponding e-value under the true state.

3.25ex -1emMultiple testing as a special case. The e-closure principle for multiple testing is recovered as follows. Take both the state space and the action space to be 2[K]2^{[K]}, let PT\mathcal P_T contain the distributions under which TT is the set of true null hypotheses, and use the loss L(T,R)=∣T∩R∣/(∣R∣∨1)L(T,R)=|T\cap R|/(|R|\vee1). The certified menu (2.3) then consists of the rejection sets certified by (1.1), which is the e-closure principle for the false discovery rate [47], and the loss L(T,R)=1{T∩R≠∅}L(T,R)=\mathop{\mathrm{\mathds{1}}}\{T\cap R\ne\varnothing\} gives its familywise error rate version. E-values for intersection hypotheses, which are valid whenever TT is contained in the set of true nulls, are in particular valid for the exact-state classes PT\mathcal P_T used here. § 4 reviews this setting in more detail. The general framework requires no structure on the actions, such as unions or an ordering, and no monotonicity of the losses. For instance, the false discovery proportion can decrease when a rejection is added.

References

  1. [1]Andrews, & Chen. (2025). Certified decisions. https://arxiv.org/abs/2502.17830
  2. [2]Angelopoulos. (2026). Conformal risk control for non-monotonic losses. https://arxiv.org/abs/2602.20151
  3. [3]Angelopoulos, Bates, Fisch, Lei, & Schuster. (2024). Conformal risk control.
  4. [4]Angelopoulos, Bates, Candès, Jordan, & Lei. (2025). Learn then test: Calibrating predictive algorithms to achieve risk control. The Annals of Applied Statistics, 19(2), 1641–1662.
  5. [5]Bai, & Jin. (2024). Optimized conformal selection: Powerful selective inference after conformity score optimization. https://arxiv.org/abs/2411.17983
  6. [6]Bai, & Jin. (2026). Conformal selective prediction with general risk control. https://arxiv.org/abs/2603.24704
  7. [7]Bates, Angelopoulos, Lei, Malik, & Jordan. (2021). Distribution-free, risk-controlling prediction sets.
  8. [8]Benjamini, & Hochberg. (1995). Controlling the false discovery rate: A practical and powerful approach to multiple testing. Journal of the Royal Statistical Society: Series B, 57(1), 289–300.
  9. [9]Berger. (1985). Statistical Decision Theory and B ayesian Analysis.
  10. [10]Blanchard, & Roquain. (2008). Two simple sufficient conditions for FDR control. Electronic Journal of Statistics, 2, 963–992.
  11. [11]Chugg, Lardy, Ramdas, & Grünwald. (2026). On admissibility in post-hoc hypothesis testing. In International Journal of Approximate Reasoning (Vol. 191, p. 109634).
  12. [12]Cohen, Park, Simeone, & Shamai. (2024). Cross-validation conformal risk control.
  13. [13]Farinhas, Zerva, Ulmer, & Martins. (2024). Non-exchangeable conformal risk control.
  14. [14]Fithian, & Lei. (2022). Conditional calibration for false discovery rate control under dependence. The Annals of Statistics, 50(6), 3091–3118.
  15. [15]Gauthier, Bach, & Jordan. (2025). E-values expand the scope of conformal prediction. https://arxiv.org/abs/2503.13050
  16. [16]Goeman. (2026). A uniform improvement of the B enjamini-- H ochberg procedure via e-closure. https://arxiv.org/abs/2606.01854
  17. [17]Goeman, & Solari. (2011). Multiple testing for exploratory research. Statistical Science, 26(4), 584–597.
  18. [18]Goeman, Hemerik, & Solari. (2021). Only closed testing procedures are admissible for controlling false discovery proportions. The Annals of Statistics, 49(2), 1218–1238.
  19. [19]González-González. (2026). Embedded representations of popular image datasets ( CIFAR10 , CIFAR100 , CIFAR100coarse , MNIST , FashionMNIST , SVHN ). https://doi.org/10.5281/zenodo.21131944}
  20. [20]Grünwald. (2023). The e-posterior. Philosophical Transactions of the Royal Society A, 381(2247), 20220146.
  21. [21]Grünwald. (2024). Beyond N eyman-- P earson: E-values enable hypothesis testing with a data-driven alpha.
  22. [22]Hodges, & Lehmann. (1952). The use of previous experience in reaching statistical decisions. The Annals of Mathematical Statistics, 23(3), 396–407.
  23. [23]Ignatiadis, Wang, & Ramdas. (2024). E-values as unnormalized weights in multiple testing. Biometrika, 111(2), 417–439.
  24. [24]Jin, & Candès. (2023). Model-free selective inference under covariate shift via weighted conformal p-values. https://arxiv.org/abs/2307.09291
  25. [25]Kiyani, Pappas, Roth, & Hassani. (2025). Decision theoretic foundations for conformal prediction: Optimal uncertainty quantification for risk-averse agents.
  26. [26]Koning. (2023). Post-hoc $\alpha$ hypothesis testing and the post-hoc $p$-value. https://arxiv.org/abs/2312.08040
  27. [27]Koning. (2026). Measuring evidence against exchangeability and group invariance with e-values. The Annals of Statistics, 54(4), 1843–1869.
  28. [28]Koning, & van Meer. (2026). Fuzzy prediction sets: Conformal prediction with e-values. https://arxiv.org/abs/2509.13130
  29. [29]Lee, & Ren. (2024). Boosting e- BH via conditional calibration. https://arxiv.org/abs/2404.17562
  30. [30]Lehmann, & Romano. (2022). Testing Statistical Hypotheses.
  31. [31]Lekeufack, Angelopoulos, Bajcsy, Jordan, & Malik. (2024). Conformal decision theory: Safe autonomous decisions from imperfect predictions.
  32. [32]Marcus, Peritz, & Gabriel. (1976). On closed testing procedures with special reference to ordered analysis of variance. Biometrika, 63(3), 655–660.
  33. [33]Ramdas. (2026). Anchored multiple testing: A transparent use of e-closure to improve FDR procedures. https://arxiv.org/abs/2610.11279
  34. [34]Ramdas, & Wang. (2025). Hypothesis testing with e-values. In Foundations and Trends in Statistics (Vol. 1, Numbers 1--2, pp. 1–390).
  35. [35]Solari, & Goeman. (2017). Minimally adaptive BH : A tiny but uniform improvement of the procedure of B enjamini and H ochberg. Biometrical Journal, 59(4), 776–780.
  36. [36]Sonnemann. (2008). General solutions to multiple testing problems. Biometrical Journal, 50(5), 641–656.
  37. [37]Srivastava. (1998). A Course on B orel Sets, volume 180 of Graduate Texts in Mathematics.
  38. [38]Sun, & Wang. (2026). Admissibility and complete classes for false discovery rate control with e-values. https://arxiv.org/abs/2607.14380
  39. [39]Tibshirani, Barber, & Ramdas. (2026). Conformal prediction through the lens of hypothesis testing: Universality, impossibility, and optimality. https://arxiv.org/abs/2608.27310
  40. [40]Vovk. (2025). Conformal e-prediction. Pattern Recognition, 166, 111674.
  41. [41]Vovk, & Wang. (2021). E-values: Calibration, combination and applications. The Annals of Statistics, 49(3), 1736–1754.
  42. [42]Vovk, Gammerman, & Shafer. (2022). Algorithmic Learning in a Random World.
  43. [43]Wald. (1950). Statistical Decision Functions.
  44. [44]Wang, & Ramdas. (2022). False discovery rate control with e-values. Journal of the Royal Statistical Society: Series B, 84(3), 822–852.
  45. [45]Xu, & Ramdas. (2023). More powerful multiple testing under dependence via randomization. https://arxiv.org/abs/2305.11126
  46. [46]Xu, Fischer, & Ramdas. (2026a). Improving online FDR procedures via online analogs of e-closure and compound e-values.
  47. [47]Xu, Solari, Fischer, de Heide, Ramdas, & Goeman. (2026b). Bringing closure to false discovery rate control: A general principle for multiple testing. https://arxiv.org/abs/2509.02517
  48. [48]Yeh, Christianson, Wierman, & Yue. (2025). Conformal risk training: End-to-end optimization of conformal risk control.

Paper details

vlnc:W_upthgsg8
Published
Fresh — added to the Hub within the last 30 days
Added
License
CC BY 4.0
Usage

views · 0

downloads · 0

A view counts once per browser per day, a download each time the PDF is requested.

  • Mathematics

AI

View statement
Looking for related papers…
Contents