betaFeedback

WorksEngineering

Adaptive Scenario Generation for KL-DRO Around a Learned Density Model

Abstract

Distributionally robust optimization (DRO) hedges data-driven two-stage stochastic programs against error in the distribution estimated from a finite record, and standard ambiguity sets differ in how they treat realizations absent from that record. A divergence ball around the empirical distribution contains only reweightings of the record, whereas a transport ball also contains distributions supported off the record, including on realizations the data-generating process cannot produce, against which the decision is then hedged as well. We instead propose a Kullback-Leibler (KL) ball centered at a density model fitted to the record, the learned nominal, which lets the adversary up-weight costly unobserved realizations in proportion to the probability the model assigns them. Solving the resulting problem poses a second difficulty, because it can accommodate only a few scenarios, and an independent sample of that size is likely to omit the rare realizations on which the worst case concentrates. We therefore build the scenario set adaptively, alternating between solving the finite problem and drawing new realizations from the learned nominal, steered toward the worst case at the current decision, with importance weights that correct the draws back to the model. On a multi-item newsvendor problem and a capacity expansion problem on realistic grid data, centering the ball at the learned nominal rather than at the record lowers cost under distribution shift, at comparable in-distribution cost, when the record is scarce and the model class captures structure that lets it extrapolate beyond the record. The advantage fades as the record grows or as the shift departs from the structure the model has learned.

Introduction

Two-stage stochastic programs model decisions that must be committed before uncertainty is realized, with recourse actions taken after, in applications spanning finance, supply chains, telecommunications, and energy systems [5] (Wallace & Ziemba 2005). We consider their data-driven, distributionally robust form,

min⁡x∈X{c(x)+max⁡P∈P(Q)RP[Q(x,ξ)]},Q(x,ξ):=min⁡y∈Y(ξ,x)q(y),(1)\min_{x \in\mathcal{X}} \left\{c(x) + \max_{P \in\mathcal{P}(\mathbb{Q})} \mathcal{R}_{P}[Q(x,\xi)]\right\}, \qquad Q(x,\xi) := \min_{y \in\mathcal{Y}(\xi,x)} q(y), \tag*{(1)}

where xx denotes here-and-now decisions with cost c(x)c(x), ξ∈RD\xi\in\mathbb{R}^{D} the random vector, Q(x,ξ)Q(x,\xi) the cost of the wait-and-see decisions yy, P(Q)\mathcal{P}(\mathbb{Q}) an ambiguity set of distributions considered plausible around a nominal distribution Q\mathbb{Q} (in the standard setting, the empirical distribution QN\mathbb{Q}_{N} of a record of NN past realizations), and RP\mathcal{R}_{P} a risk measure, such as the expectation or the conditional value at risk (CVaR). We are motivated by problems whose cost is dominated by tail events, in which several dimensions of uncertainty move against the plan at once, such as a demand surge that arrives while a supplier is down.

Such problems expose two gaps in how data-driven distributionally robust optimization (DRO) treats realizations absent from the record. The first lies in the ambiguity set (Sec. 3). Divergence balls around the empirical distribution contain only reweightings of the record, while Wasserstein balls and moment-based sets admit unobserved realizations but judge them only by their distance from the record or by a few moments. Each family carries a statistical guarantee tied to the record [21, 44], but none uses how the components of the uncertainty move together in the tail, the structure that distinguishes plausible unobserved realizations from implausible ones. The second gap lies in the finite scenario set on which the problem is actually solved, whose size is limited because each scenario adds a copy of the recourse problem. A divergence ball can only reweight this set. Scenario reduction and problem-driven selection choose it from the record or from a sample drawn once, so the set is likely to miss the rare realizations on which the worst case concentrates.

Both gaps concern realizations that the record lacks, and both could be narrowed by a model that generates plausible ones. High-resolution operational records, often spanning only a few years, are available in many applications of stochastic programming, and generative models trained on such records can capture their dependence structure and respect known properties of the process, including the behavior of its extremes [8, 45, 12]. Such a model offers both a new center for the ambiguity set, addressing the first gap, and a new source of scenarios, addressing the second. This raises the question of how a generative model learned from a short record can be integrated into risk-averse stochastic programming, so that a limited set of scenarios hedges against tail risks the record underrepresents.

We propose Kullback–Leibler DRO (KL-DRO) centered at a learned nominal: we take Q\mathbb{Q} in equation (1) to be a density model Qθ\mathbb{Q}_{\theta} trained on the record, such as a normalizing flow, a Gaussian copula, or a diffusion model, and the ambiguity set to be

Pρ(Qθ):={P:KL⁡(P∥Qθ)≤ρ}.(2)\mathcal{P}_{\rho}(\mathbb{Q}_{\theta}) := \left\{ \mathbb{P} : \operatorname{KL}(\mathbb{P} \mathbin{\|} \mathbb{Q}_{\theta}) \le\rho\right\}. \tag*{(2)}

Over this ball, the adversary can up-weight costly realizations absent from the record in proportion to the probability Qθ\mathbb{Q}_{\theta} assigns them, so what it can reach is governed by the learned nominal rather than by a distance from the record, which addresses the first gap. To close the second, we build the scenario set adaptively, alternating between solving the finite problem and drawing new realizations from the learned nominal, steered toward the worst case at the current decision, with importance weights that center the ball at an estimate of Qθ\mathbb{Q}_{\theta}. Centering the ball at a learned nominal does, however, give up the finite-sample guarantees of balls centered at the record, so we choose the radius empirically (Sec. 5).

Contributions. Our contributions are as follows.

  • Distributionally robust optimization with a learned nominal. We pose KL-DRO with the ambiguity set centered at a learned generative model, extending balls centered at parametric models or Bayesian posteriors for single-stage objectives (Watson & Holmes, 2016; Dellaportа et al., 2025) to high-dimensional nominals and two-stage objectives.

  • Finite scenario approximations for tail-dominated problems. We build the scenario set by adaptive importance sampling toward the ball’s worst case at each decision, so that the scenarios are drawn where the adversary places its weight.

  • Evaluations in controlled and realistic settings. We evaluate the framework on a multi-item newsvendor problem with a known distribution and controlled record size and shift, and on a capacity expansion problem over a 20-zone network with realistic demand and renewable data and an out-of-distribution test year.

Background

Risk-averse stochastic programming. Given a limited record of past realizations, we seek decisions that are cost-effective both in distribution, even when the record is too small to learn the data-generating process, and out of distribution, when that process changes at evaluation time. To weigh both typical and tail costs, we take R\mathcal{R} to be the mean–CVaR objective, which can be defined as the minimum over a scalar ζ\zeta of an expectation [47],

RP[Q(x,ξ)]=(1−β)EP[Q(x,ξ)]+βCVaR⁡α,P[Q(x,ξ)]=min⁡ζ∈R{ζ+EP[ψζ(Q(x,ξ))]},(3)\begin{aligned} \mathcal{R}_{\mathbb{P}}[\mathbb{Q}(x,\xi)] = (1-\beta)\mathbb{E}_{\mathbb{P}}[\mathbb{Q}(x,\xi)] + \beta\operatorname{CVaR}_{\alpha,\mathbb{P}}[\mathbb{Q}(x,\xi)] \\ &= \min_{\zeta\in\mathbb{R}} \left\{ \zeta+ \mathbb{E}_{\mathbb{P}}[\psi_{\zeta}(\mathbb{Q}(x,\xi))] \right\}, \tag*{(3)} \end{aligned}
ψζ(u)=(1−β)(u−ζ)+β1−α(u−ζ)+,\psi_{\zeta}(u) = (1-\beta)(u-\zeta) + \frac{\beta}{1-\alpha}(u-\zeta)_{+},

where α\alpha is the tail level, β∈[0,1]\beta\in[0,1] the weight on the tail, and the minimizing ζ\zeta the value at risk at level α\alpha. Throughout, we assume that the recourse problem is feasible (relatively complete recourse) and bounded for every x∈Xx \in\mathcal{X} and every ξ\xi in the support of the nominal, so that Q(x,ξ)Q(x,\xi) is finite.

Kullback–Leibler DRO. For a nominal distribution Q\mathbb{Q}, empirical or otherwise, the Kullback–Leibler (KL) ambiguity set {P:KL⁡(P∥Q)≤ρ}\{\mathbb{P} : \operatorname{KL}(\mathbb{P}\mathbin\Vert\mathbb{Q}) \le\rho\} is a standard choice for two-stage problems [4, 3]. Because every member assigns zero probability wherever Q\mathbb{Q} does, the ball reweights the realizations Q\mathbb{Q} supports and adds none, and when centered at the empirical record, it changes only the probabilities of the recorded scenarios. The ball is computationally attractive because dualizing the KL constraint reformulates the inner maximization of equation (1) as a minimization [30 App. B.5],

max⁡P:KL⁡(P∥Q)≤ρRP[Q(x,ξ)]=min⁡ζ,λ>0{ζ+λρ+λlog⁡EQ[exp⁡(ψζ(Q(x,ξ))/λ)]}.(4)\max_{\mathbb{P}:\operatorname{KL}(\mathbb{P}\mathbin\Vert\mathbb{Q})\le\rho} \mathcal{R}_{\mathbb{P}}[Q(x,\xi)] = \min_{\zeta,\lambda>0}\left\{\zeta+\lambda\rho+\lambda\log\mathbb{E}_{\mathbb{Q}}\left[\exp\left(\psi_{\zeta}(Q(x,\xi))/\lambda\right)\right]\right\}. \tag*{(4)}

For ρ>0\rho>0, both sides are finite only if EQ[exp⁡(Q(x,ξ)/λ)]<∞\mathbb{E}_{\mathbb{Q}}[\exp(Q(x,\xi)/\lambda)]<\infty for some λ>0\lambda>0, which holds for any finite nominal and any bounded cost. The dual is jointly convex in ζ\zeta and λ\lambda, and in xx as well when the recourse cost is convex in xx, as it is for linear recourse. In particular, for a finite nominal Q^=∑i=1Kwiδξi\widehat{\mathbb{Q}}=\sum_{i=1}^{K}w_i\delta_{\xi_i}, a set of KK scenarios with weights wi>0w_i>0 summing to one, the expectation is a weighted sum, and equation (1) over the ball becomes, when X\mathcal{X} and cc are convex, the single convex program

min⁡x∈X, ζ, λ>0c(x)+ζ+λρ+λlog⁡∑i=1Kwiexp⁡(ψζ(Q(x,ξi))/λ),(5)\min_{x\in\mathcal{X},\,\zeta,\,\lambda>0} c(x)+\zeta+\lambda\rho+\lambda\log\sum_{i=1}^{K}w_i\exp\left(\psi_{\zeta}(Q(x,\xi_i))/\lambda\right), \tag*{(5)}

in which each scenario contributes one copy of the recourse problem and the risk measure adds one variable. The empirical measure Q^N\widehat{\mathbb{Q}}_N is the special case with K=NK=N and wi=1/Nw_i=1/N. Since the reformulation holds for any finite nominal, two modeling choices remain open: which realizations the adversary can reach, which is set by Q\mathbb{Q}, and which finite Q^\widehat{\mathbb{Q}} the problem is solved on. We discuss them in turn.

Ambiguity centered at a learned nominal. The first choice determines which realizations the adversary can reach. Ideally, the nominal places mass on realizations the record lacks but not on those the data-generating process cannot produce, so that the decision is hedged against unrecorded events without paying for implausible ones. A density model QθQ_{\theta} fitted to the record places mass between and beyond the recorded realizations, distributed according to the dependence structure it has learned, so the ball around it contains distributions that weight events the record lacks. How well it withholds mass from implausible realizations depends on how faithfully it captures the dependence structure of the process. Because QθQ_{\theta} is itself an estimate, the ball around it also hedges against error in the model, as in Watson & Holmes (2016) and Delarport et al. (2025). We therefore adopt the ambiguity set equation (2), the KL ball above centered at QθQ_{\theta} rather than at the record. To make the nominal easy to sample and its draws easy to weight, we take QθQ_{\theta} to be the pushforward of the standard normal distribution φ:=N(0,I)\varphi:= \mathcal{N}(0,I), whose density we also write φ\varphi, by a deterministic decoder GθG_{\theta}, so that sampling amounts to drawing z∼φz\sim\varphi and applying GθG_{\theta}. Normalizing flows, Gaussian copulas, and diffusion models with deterministic samplers are of this form, and the known latent density is what gives the sampler of § 4 exact importance weights.

Finite scenario approximation. The second choice is the finite nominal on which the problem is solved. The finite program equation (5), which we call the master problem, grows with each scenario, so the number of scenarios KK must be small, and the decision is then largely determined by which KK scenarios the master sees. When the realizations that drive the decision are rare, such as the few periods in which a demand surge coincides with a supplier outage, KK independent draws are likely to miss them. Scenario reduction and problem-driven selection mitigate this by choosing the KK scenarios from a larger pool (§ 3), but a pool fixed in advance cannot supply realizations it lacks. A learned nominal, by contrast, can be sampled wherever it has mass, so the KK scenarios can be generated where the decision is sensitive. Because such scenarios are not drawn from QθQ_{\theta} itself, each carries a base weight wiw_i, an importance weight back to QθQ_{\theta}, and we solve equation (5) with these weights normalized to sum to one, so that the ball is centered at an importance-weighted estimate of QθQ_{\theta} rather than at the distribution the scenarios were drawn from.

Related Work

Ambiguity sets. Divergence-based sets [4, 3] reweight the empirical record and so preclude unobserved realizations, or, with the arguments of the divergence reversed, admit them only on a fixed finite support (Van Parys et al., 2021). Transport-based sets [44, 24] admit them, but judge them by a cost that measures how far a recorded point moves and says nothing directly about whether the moved point is plausible. The Sinkhorn variant smooths this cost against a reference measure chosen in advance, such as a Gaussian, which sets where the worst case can place mass (Wang et al., 2021). Moment-based sets [18] constrain only low-order statistics. Closest in motivation are works that learn part of the set: the transport cost, from labels or the data manifold [7, 40], or the nominal itself, a fitted model or Bayesian posterior at which a KL-based set is centered [19] (Watson & Holmes 2016).

Scenario construction. Distribution-driven methods match specified moments [31] or reduce a pool under a probability metric [22, 28] without reference to the decision. Problem-driven methods cluster by decision-based dissimilarity or minimize implementation error [29, 36], or, for tail risk measures, sample only the region of the support on which the risk measure depends [23]. All of these methods construct the set once, before the problem is solved, whereas the importance sampling methods of § 4 adapt the proposal to the decision.

Generative models in optimization. A more recent line of work samples scenarios from a generative model fitted to the record [13, 35] or trains the generator on the downstream decision loss [33] (Zhao et al. 2026), producing scenarios but no ambiguity set. A second line makes the generator the adversary, through a learned transport map to a continuous least favorable distribution [14] (Xu et al. 2024), a family of parametric generative models within a KL budget [42], a family of generators of bounded reconstruction loss (Wen & Yang, 2026), a Sinkhorn comparison between conditional generators (Zhang et al., 2026), or, for two-stage robust optimization, a search of a generator’s latent space for a single worst-case realization [10]. In each, the worst case is obtained by optimizing over that parameterization, and all but the last are posed for single-stage objectives. We instead center a divergence ball at the generator, which leaves the generator as trained, gives the worst case in closed form, and keeps the likelihood ratios exact.

Adaptive Importance Sampling Algorithm

Section 2 called for a finite scenario set generated where the decision is sensitive and weighted back to QθQ_{\theta}. We propose building it iteratively by adaptive importance sampling toward a target known up to a normalizing constant [11], re-targeting as the decision changes, as Dantzig & Glynn [17], Infanger [32], Parpas et al. [46], and Aloaritei et al. (2026) do for a known density. Each round tilts a sample of the model toward the worst case at the current decision and forms the batch either by resampling that sample, which needs only draws of the model, or by drawing from a Gaussian fitted to the tilt by weighted moment matching, a cross-entropy step [48] that can reach realizations beyond the initial sample. Our approach differs from these methods in its target and its nominal. First, our target is the worst case of the KL ball, so the draws supply the realizations the adversary up-weights (Sec. 4.2), whereas Aloaritei et al. (2026) target the variance of a stochastic gradient. Second, we draw from a learned density model (Sec. 4.3), whereas the methods above assume a known density and Parpas et al. [46] fit a kernel density estimate to Markov chain samples, which degrades in high dimension. Kim et al. [37] also steer a generative model toward costly inputs with importance weights, but to train a predictor rather than to make a decision. Figure 1 summarizes the resulting loop, whose components the rest of this section develops: the master solved each round (§ 4.1), the target toward which scenarios are drawn (§ 4.2), and the two ways a batch is drawn (§ 4.3).

Adaptive loop and sampling steps in latent and scenario space

Figure 1. (a) The adaptive loop. (b–d) One sampling step in a 2-D slice of the latent space (contours of φ\varphi; cost rises to the upper right): (b) an initial sample is evaluated; (c) it is tilted by exp⁡(Q/λ)\exp(Q/\lambda), and a Gaussian proposal gtg_t (orange) is fitted; (d) new scenarios are resampled (rings) or drawn from the proposal (filled), with weights back to the nominal (marker area). Bottom row. The same steps after decoding by GθG_\theta: new scenarios reach beyond the record (gray), and the target moves with the decision (dotted).

Alternating Master and Sampler

The master on the scenario set. Each round draws a batch of nn scenarios at the incumbent xtx_t with base weights back to the nominal (Sec. 4.3), adds it to the set held, and solves equation 5 on that set for xt+1x_{t+1} (Algorithm 1). Scenarios drawn at earlier decisions can be kept at later ones, because a batch’s weights depend only on how it was drawn. Hence, for any decision xx fixed in advance, the weighted sum of the batch’s costs, before normalization, estimates nn times the nominal expected cost without bias. Since equation 5 requires weights that sum to one, the weights of all rounds are normalized together, wˉi=wi/∑jwj\bar{w}_i = w_i/\sum_j w_j over the Kt+1K_{t+1} scenarios held. The master’s objective is therefore a biased estimate of its counterpart under QθQ_\theta, through this division by a random total and through the logarithm and the minimizations over ζ\zeta and λ\lambda below. With these weights, the master on the held scenarios is

min⁡x∈X, ζ, λ>0c(x)+ζ+λρ+λlog⁡∑i=1Kt+1wˉiexp⁡(ψζ(Q(x,ξi))/λ).(6)\min_{x\in\mathcal{X},\,\zeta,\,\lambda>0} c(x)+\zeta+\lambda\rho+\lambda\log\sum_{i=1}^{K_{t+1}}\bar{w}_i\exp\left(\psi_\zeta(Q(x,\xi_i))/\lambda\right). \tag*{(6)}

At a decision xx, the adversary’s worst case is available in closed form, pi∝wˉiexp⁡(ψζ∗(Q(x,ξi))/λ∗)p_i\propto\bar{w}_i\exp(\psi_{\zeta^*}(Q(x,\xi_i))/\lambda^*), where ζ∗\zeta^* and λ∗\lambda^* attain the minimum at xx, so that KL⁡(p∥wˉ)=ρ\operatorname{KL}(p\mathbin\Vert\bar{w})=\rho. When equation 6 is too large to solve jointly, as in the capacity expansion study, this closed form offers a cheaper alternative, in which the master is solved with the weights fixed at the worst case

Algorithm 1 Adaptive scenario acquisition.

Require: Nominal QQ that can be sampled; radii ρ\rho and ρref\rho_{\mathrm{ref}}; initial sample size MM; batch size nn; rounds TT; re-targeting rounds T∋0\mathcal{T}\ni0; mixture weight aa

  1. Choose an initial decision x0x_0; set S0←∅\mathcal{S}_0\leftarrow\varnothing

  2. for t=0,…,T−1t=0,\ldots,T-1 do

  3. &nbsp;&nbsp;&nbsp;&nbsp;if t∈Tt\in\mathcal{T} then ▷ Re-target; otherwise keep the last

  4. &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;Draw ξ1,…,ξM∼Q\xi_1,\ldots,\xi_M\sim Q and evaluate Qt←Q(xt,ξi)Q_t\leftarrow Q(x_t,\xi_i) ▷ Initial sample

  5. &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;Bisect λt∝exp⁡(Qi/λt)\lambda_t\propto\exp(Q_i/\lambda_t) satisfies ∑iτilog⁡(Mτi)=ρref\sum_i\tau_i\log(M\tau_i)=\rho_{\mathrm{ref}} ▷ Tilt

  6. &nbsp;&nbsp;&nbsp;&nbsp;end if

  7. &nbsp;&nbsp;&nbsp;&nbsp;if resampling then

  8. &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;Resample nn indices ∝τ\propto\tau; Bt←{(ξi,ci/(Mτi))}\mathcal{B}_t\leftarrow\{(\xi_i,c_i/(M\tau_i))\} over distinct ii ▷ Resampling

  9. &nbsp;&nbsp;&nbsp;&nbsp;else

  10. &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;Fit gtg_t to the tilted latent points of the initial sample ▷ Fitted proposal

  11. &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;Draw from rt=(1−a)φ+agtr_t=(1-a)\varphi+a g_t with weights φ/rt\varphi/r_t; keep nn draws as Bt\mathcal{B}_t, or resample nn by the tilt as above

  12. &nbsp;&nbsp;&nbsp;&nbsp;end if

  13. &nbsp;&nbsp;&nbsp;&nbsp;St+1←St∪Bt\mathcal{S}_{t+1}\leftarrow\mathcal{S}_t\cup\mathcal{B}_t

  14. &nbsp;&nbsp;&nbsp;&nbsp;Solve equation 6 on St+1\mathcal{S}_{t+1} for xt+1x_{t+1} ▷ Master

  15. end for

  16. return xTx_T

computed at xtx_t, which requires KtK_t recourse evaluations. Weak duality then bounds the resulting optimality gap on the held scenarios at the cost of one more master solve (App. B.5).

Sampler and radii. The sampler, which chooses the scenarios that enter the set, tilts an initial sample of MM draws from the nominal toward the worst case at a reference radius ρref\rho_{\mathrm{ref}}, τi∝exp⁡(Q(xt,ξi)/λt)\tau_i \propto\exp(Q(x_t,\xi_i)/\lambda_t) with ∑iτilog⁡(Mτi)=ρref\sum_i \tau_i\log(M\tau_i)=\rho_{\mathrm{ref}}, and forms the batch from this tilt (Sec. 4.3). The two radii thus play different roles, ρref\rho_{\mathrm{ref}} determining which scenarios enter the set and ρ\rho how the master weights them, so that ρ=0\rho=0 with ρref>0\rho_{\mathrm{ref}}>0 solves the nominal problem with a decision-aware sampler. We take ρref≥ρ\rho_{\mathrm{ref}}\ge\rho as a heuristic, because a sampler that reaches beyond the adversary only costs efficiency, whereas one that reaches less leaves tail scenarios out of the set, and no reweighting can restore them. The tilt is the worst case under the expectation rather than under the mean–CVaR objective, but because ψζ\psi_\zeta is nondecreasing, both worst cases rank scenarios by cost in the same way. Since the weights correct any proposal back to the nominal, this choice affects efficiency but not the quantity being estimated.

Cost of a round. Each initial sample costs MM recourse evaluations, which run in parallel, whereas only the batch of nn enters the master, whose size grows with each scenario. To save evaluations, the initial sample need only be redrawn and re-tilted in the rounds t∈Tt\in\mathcal{T}, because the tilt depends on the decision only through the costs at xtx_t and so changes little once the incumbent settles. Later batches reuse the last initial sample and proposal, and their weights remain exact, although resampling the same initial sample again does not reduce its own sampling error.

The Sampling Target

Latent space. The sampler works in the latent space, where the nominal is the standard Gaussian φ\varphi. A simple parametric family would match QθQ_\theta poorly in the ambient space, but because φ\varphi is known, a proposal from such a family has likelihood ratios in closed form in the latent space, without evaluating the density of QθQ_\theta. These ratios correct the expectation of any function of zz, including the cost Q(x,Gθ(z))Q(x,G_\theta(z)) of the decoded scenario. The whole problem can also be posed in the latent space,

min⁡x∈X{c(x)+max⁡p:KL⁡(p∥φ)≤ρEz∼p[Q(x,Gθ(z))]}(7)\min_{x\in\mathcal{X}}\left\{c(x)+\max_{p:\operatorname{KL}(p\mathbin{\|}\varphi)\le\rho}\mathbb{E}_{z\sim p}\left[Q(x,G_\theta(z))\right]\right\} \tag*{(7)}

in which the adversary reweights φ\varphi. This latent problem is equivalent to the original one, because decoding maps the latent ball onto the ball around QθQ_\theta for any measurable GθG_\theta. Pushing two distributions through the same map cannot increase the divergence between them [16], so the latent ball decodes into the ambient ball. Conversely, any P\mathbb{P} in the ambient ball is the image of φ\varphi reweighted by dPdQθ∘Gθ\frac{\mathrm{d}\mathbb{P}}{\mathrm{d}Q_\theta}\circ G_\theta, whose divergence from φ\varphi equals KL⁡(P∥Qθ)\operatorname{KL}(\mathbb{P}\mathbin{\|}Q_\theta). For a law-invariant R\mathcal{R}, such as the expectation and CVaR [38], the two problems therefore have the same value and minimizers, whether or not GθG_\theta is invertible.

The tilt as a proposal. Under the expectation, the worst case of equation 7 at a fixed decision is the exponential tilt

π(z∣x)∝φ(z)exp⁡(Q(x,Gθ(z))/λ),(8)\pi(z\mid x)\propto\varphi(z)\exp\left(Q(x,G_\theta(z))/\lambda\right), \tag*{(8)}

with λ\lambda fixed by the radius. Used as a sampling target, the tilt weights a realization by the level of its cost, whereas the decision responds only to the part of the cost that xx can change. The level is therefore a faithful proxy when the costly realizations are those the decision can mitigate, such as unserved load that added capacity would avert, but it fails when the costliest realizations are costly whatever the decision, since the tilt then concentrates the sample where the master cannot respond. The tilt also links the two roles the scenario set plays. Read as robustness, π(⋅∣x)\pi(\cdot\mid x) is the least favorable distribution, and read as estimation, it is the exponential tilting of rare-event sampling [6]. For large λ\lambda, which corresponds to a small radius, it is close to a mixture of φ\varphi and the minimum-variance proposal for the expected cost, which reweights φ\varphi by the cost itself when the cost is nonnegative, and for small λ\lambda, it concentrates on the costliest scenarios, where the master’s worst case places its weight. The sampler draws from a proposal that approximates the tilt, and importance weights correct for the approximation, however rough it is. For any proposal gg positive wherever φ\varphi is, draws zj∼gz_j\sim g with the weight

w(z)=φ(z)g(z)(9)w(z)=\frac{\varphi(z)}{g(z)} \tag*{(9)}

give an unbiased estimate 1n∑jw(zj)Q(x,Gθ(zj))\frac{1}{n}\sum_j w(z_j)Q(x,G_\theta(z_j)) of Eφ[Q(x,Gθ(z))]\mathbb{E}_{\varphi}[Q(x,G_\theta(z))].

Drawing the Batch

Sampling the target equation 8 directly is expensive, because it is known only through evaluations of QQ, each a second-stage solve. Of the existing alternatives, guided sampling of the generator yields draws without likelihood ratios, and Markov chain Monte Carlo (Parpas et al. [46]) needs many sequential evaluations of QQ per retained sample. We instead form the batch from the tilt τ\tau of the initial sample, in one of two ways.

Resampling. The simpler variant resamples nn indices with probabilities τ\tau, and a scenario drawn cic_i times enters with base weight wi=ci/(Mτi)w_i = c_i/(M\tau_i), which corrects the selection back to the nominal. The batch then holds only realizations in the initial sample, so its reach is governed by MM. In return, resampling needs only draws, so it also applies to models available only as samplers and to the empirical measure.

Fitted proposal. To reach beyond the initial sample, the second variant fits a Gaussian gt=N(μ^,Σ^)g_t = \mathcal{N}(\hat{\mu},\hat{\Sigma}) to the latent points ziz_i of the initial sample, ξi=Gθ(zi)\xi_i = G_\theta(z_i), weighted by the tilt, μ^=∑iτizi\hat{\mu} = \sum_i \tau_i z_i and Σ^=∑iτi(zi−μ^)(zi−μ^)⊤\hat{\Sigma} = \sum_i \tau_i(z_i-\hat{\mu})(z_i-\hat{\mu})^\top. When the MM evaluations are few relative to the latent dimension, Σ^\hat{\Sigma} can be regularized, for example by shrinkage toward its diagonal or, at the extreme, by fixing Σ^=I\hat{\Sigma}=I so that only the mean shifts. The sampler then draws from the defensive mixture rt=(1−a) φ+a gtr_t=(1-a)\,\varphi+a\,g_t with a∈(0,1)a\in(0,1), decodes ξ=Gθ(z)\xi=G_\theta(z), and attaches the weight

w(z)=φ(z)rt(z)=[(1−a)+agt(z)φ(z)]−1≤11−a,(10)w(z)=\frac{\varphi(z)}{r_t(z)}=\left[(1-a)+a\frac{g_t(z)}{\varphi(z)}\right]^{-1}\le\frac{1}{1-a}, \tag*{(10)}

with gt/φg_t/\varphi in closed form. The weight is exact however gtg_t was fitted, and since the component φ\varphi bounds it, a poor fit lowers efficiency but cannot produce an unbounded weight. The draws either enter the master directly with the weights equation (10) or form a pool from which nn are resampled by the tilt as above. In that case, the uniform weights 1/M1/M are replaced by the weights of equation (10) normalized within the pool, which makes the batch’s weighted sum only approximately unbiased (App. § 9.§ 4).

Choosing a variant. Resampling needs only draws of the nominal, but its weights vary with the tilt, so a concentrated tilt and a small nn give a noisy correction. The fitted proposal, in contrast, reaches beyond the initial sample, with every weight below 1/(1−a)1/(1-a) when its draws enter the master directly, but it needs latent coordinates and a proposal family that fits the tilt, a fit that degrades with dimension. It should therefore help most when the events that drive the worst case are rare in an initial sample of size MM and the tilted target is close to a single Gaussian in the latent space, and least when decoded draws cannot leave the record’s range or the map from zz to a scenario is strongly nonlinear (§ 5.1).

Experiments

We evaluate the framework in two settings. The first, a multi-item newsvendor problem and a standard testbed for DRO ([49, 27]) and data-driven optimization ([2]), has a known demand distribution, so optimality gaps can be computed accurately, and a record size and shift under our control, which lets us isolate the regimes in which a learned nominal improves on the record. The second, a capacity expansion problem for the Texas grid on realistic data, tests whether these findings carry over to a planning problem of practical scale.

Methods. All methods solve the master equation 5 on a finite scenario set and differ in where the scenarios come from, how they are chosen, and how the master hedges. Our method draws scenarios from a learned nominal, either by resampling its draws (KL-Gen) or from a proposal fitted to the tilt (KL-Gen-P), chooses them by the tilt at the current decision, and hedges with a KL ball. We group the comparators by which of these components they change. Source: KL-DRO centered at the record (KL-Rec) removes generation; KL-DRO over record points moved toward higher cost by optimal transport (KL-OT) extrapolates by distance from the record instead of by a model; alternative nominals isolate the model class; and in the newsvendor an oracle applies our sampler to the true distribution. Selection: cost-space scenario clustering (CSSC; Keutchayan et al. [36]) chooses scenarios once, by their effect on the decision. Hedge: sample average approximation (SAA) applies none, and Wasserstein DRO (W-DRO; Mohajerin Esfahani & Kuhn [44]) hedges with a transport ball around the record. Both studies use the mean–CVaR objective with β=0.25\beta= 0.25 and α=0.9\alpha= 0.9, and Table 2 and Table 9 give the implementations. Hedging can lower out-of-distribution cost at the expense of in-distribution cost, so a comparison at a single setting would confound how much a method hedges with how well it hedges. We therefore compare the frontiers of out-of-distribution (OOD) against in-distribution (ID) cost that each method’s settings trace.

Table 2: Newsvendor methods. KL-Gen-P and KL-Gen are run with each nominal of Figure 4, and CSSC with the log-normal and the log-normal mixture. Weights are normalized to sum to one.

MethodScenarios in the masterWeightsRadius
SAAthe NN record pointsuniform0
KL-Recthe NN record pointsuniformgrid
KL-Gen-P, oraclen=100n = 100 draws of the samplerφ/r\varphi/rgrid
KL-Gen356 draws of the nominal, resampled 100 times by the tiltci/(356 τi)c_i/(356\,\tau_i)grid
CSSCK=100K = 100 medoids of 1,024 draws of the nominalcluster massgrid
W-DROthe NN record points, moveduniform0
KL-OTmin⁡(100,N)\min(100,N) record points selected by the tilt, moveduniformgrid

Table 2.

MethodCandidates per roundScenarios in the masterWeights
KL-Rec256 record daysat most 48, four per roundKL worst case at ρ\rho
KL-Gen256 draws of the flowsamesame
KL-Gen-P192 draws from a fitted proposalsamesame
KL-Gen (copula)256 copula drawssamesame
KL-Gen-P (copula)192 draws from a proposal fitted to the copulasamesame
KL-OT (δ\delta)256 record days, moved from the second roundsamesame
W-DRO (δ\delta)a moved copy of each day, from the second round48 record days, each valued at its largest penalized cost over the day and its moved copies1/481/48
CSSC256 record days (all 182 at k=12k = \frac{1}{2})48 selectedcluster masses
SAAnone48 record days1/481/48

Table 9. Capacity expansion methods. All use the objective in equation (12) with β=0.25\beta= 0.25, α=0.9\alpha= 0.9, and the budget BB.

Multi-Item Newsvendor with Substitution

Problem. A retailer orders five products at a cost of 1 per unit before demand is observed. As recourse, unmet demand for a product can be served from the next product’s stock at a penalty of 0.5 per unit (substitution) or lost at a cost of 100 per unit, and leftover stock is salvaged at 0.25. For a single product, the order that minimizes expected cost is the quantile of demand at the critical ratio (100−1)/(100−0.25)≈0.99(100 - 1)/(100 - 0.25) \approx0.99, and the mean–CVaR objective used here raises it further, so the orders lie in the upper tail of demand, which a short record samples poorly. Log demand follows a known Gaussian mixture with a rare shock that raises demand for every product at once (App. § 8). A decision-maker sees a record of N∈{16,32,64,128}N \in\{16, 32, 64, 128\} periods and is scored under one of four shifted distributions: a level shift in every product’s demand, a tail shift to a heavier-tailed shock, a support shift that adds a shock on different products, and a coincidence shift, in which the record’s shocks strike one product at a time and the test distribution’s strike all products together, with unchanged marginals.

Setup. For each record, we fit five learned nominals: a Gaussian copula; a log-normal; a two-component log-normal mixture, the family of the base distribution; a RealNVP flow; and a Gaussian fitted to raw demand, which captures dependence only through its covariance. KL-Gen-P, KL-Gen, and the oracle run a single round (T=1T = 1) from the risk-neutral decision on the record. Because both the distribution the records are drawn from and the shifted distributions are known, we report each cost as a percentage above the optimum under the distribution it is scored on, and Table 1 reads the resulting frontiers in two ways: (a) the OOD cost within an ID budget of 5 points over SAA, chosen on held-out records without the shifted distribution, and (b) the ID cost needed to halve SAA’s OOD cost, which prices protection but is not a deployable rule.

Method\multicolumn{4}{c}{(a) OOD cost at SAA’s ID budget}\multicolumn{4}{c}{ }
\multicolumn{4}{c}{N=16N = 16}\multicolumn{4}{c}{N=128N = 128}\multicolumn{4}{c}{N=16N = 16}\multicolumn{4}{c}{N=128N = 128}
LTSCLTSCLTSCLTSC
SAA643154434244129889839········
KL-Rec6471554352271418911139········
W-DRO803992154244530185568559712421220
KL-OT8843991594557442557645797122912·
KL-Gen-P
Log-normal5252473135563515212321249†9^{\dagger}·9†9^{\dagger}15
Flow525243334158351819191923†23^{\dagger}11·919
Gaussian229104158492501071745140·4042····
KL-Gen (flow)229103152492061011384636·3633····

Table 1. Newsvendor: cost above the optimum (%, median over records) under the level (L), tail (T), support (S), and coincidence (C) shifts. (a) Out-of-distribution cost at each method’s selection rule. (b) In-distribution cost needed to halve SAA’s out-of-distribution cost; ·: never reached; †^{\dagger}: lowest in under 80% of bootstrap resamples. Bold: lowest among the rows shown.

Record size and shift. The optimal order depends on each product’s top 1% of demand, which lies above the record’s maximum in 85% of records at N=16N = 16. Reweighting the record cannot reach this region, so KL-Rec costs as much as SAA at every NN. The methods that extrapolate beyond the record can reach this region. At N=16N = 16, Wasserstein cross-validation keeps the flow at its log-normal initialization (App. § 8.§ 3), KL-Gen-P with the log-normal or the flow does so most cheaply, halving SAA’s OOD cost at about a third of the ID cost that W-DRO and KL-OT need (Table 1b). Which method leads at a fixed ID budget, however, depends on the shift (Table 1a). W-DRO leads or ties under the tail shift at every NN and overtakes KL-Gen-P under the level and support shifts as NN grows.

KL-Gen-P stays lowest under the coincidence shift because a fitted nominal places mass on joint shocks, which transport reaches only by moving every product of a record point at once.

The proposal and the nominal. At the same 356 cost evaluations, KL-Gen-P cuts the out-of-distribution cost of KL-Gen by a factor of two to six under the level and support shifts for every nominal fitted to log demand other than the copula (Table 3–Table 6). This is because only about four of 356 draws from a nominal exceed a product’s 99th percentile, whereas the proposal draws there directly (§ 4.3). The copula is the exception, because its draws stay within the record’s range whatever the latent proposal, and for it the proposal gains at most a factor of two. Nor does a larger generated pool substitute for sampling toward the worst case, since CSSC, which reduces a pool of 1,024 generated draws at 95 times the evaluations, costs as much as KL-Gen. Finally, the nominal’s tail matters more than its exact family. With the proposal, the log-normal costs less out of distribution than the Gaussian in every cell, and less than the log-normal mixture, the family of the base distribution, under the level and support shifts up to N=64N = 64 and under the coincidence shift at every NN. These results support training generative models to reproduce the extremes of the process accurately ([34, 39, 45]).

MethodLTSCID cost ρ=0\rho= 0LTSC
SAA643 ±\pm59154 ±\pm8434 ±\pm39244 ±\pm21184····
KL-Rec647 ±\pm55155 ±\pm7435 ±\pm36227 ±\pm20184····
W-DRO80 ±\pm1039 ±\pm492 ±\pm10154 ±\pm20–55685597
KL-OT88 ±\pm1143 ±\pm499 ±\pm11159 ±\pm20–57645797
Gaussian
KL-Gen-P229 ±\pm31104 ±\pm4158 ±\pm1949 ±\pm711540·4042
KL-Gen480 ±\pm43135 ±\pm5316 ±\pm27128 ±\pm12116····
Copula
KL-Gen-P490 ±\pm46136 ±\pm6338 ±\pm30126 ±\pm12125····
KL-Gen503 ±\pm48137 ±\pm6344 ±\pm30133 ±\pm13127····
Log-normal
KL-Gen-P52 ±\pm1152 ±\pm647 ±\pm831 ±\pm54821232124
KL-Gen238 ±\pm37105 ±\pm5162 ±\pm2356 ±\pm94843·4340
CSSC240 ±\pm35104 ±\pm5163 ±\pm2266 ±\pm95744·4445
Log-normal mixture
KL-Gen-P65 ±\pm1352 ±\pm659 ±\pm1044 ±\pm84126272639
KL-Gen216 ±\pm34102 ±\pm5151 ±\pm2059 ±\pm84140·4049
CSSC193 ±\pm3597 ±\pm6136 ±\pm2463 ±\pm94939·3952
Flow
KL-Gen-P52 ±\pm952 ±\pm543 ±\pm733 ±\pm64119191923†
KL-Gen229 ±\pm34103 ±\pm5152 ±\pm2149 ±\pm73836·3633
Heavy-tailed flow
KL-Gen-P55 ±\pm1139 ±\pm454 ±\pm1149 ±\pm82822222225
KL-Gen178 ±\pm2996 ±\pm5126 ±\pm2039 ±\pm63631·3131
Oracle (reference)18 ±\pm321 ±\pm232 ±\pm322 ±\pm33

Table 3. Newsvendor, every method, N=16N = 16 (300 records): cost above the optimum (%) under the level (L), tail (T), support (S), and coincidence (C) shifts. (a) Median out-of-distribution cost (±\pm 2 SE) at each method’s selection rule. ID cost at ρ=0\rho= 0: median in-distribution cost of the unhedged fit (none for W-DRO and KL-OT). (b) Lowest median in-distribution cost at which a setting halves SAA’s median out-of-distribution cost; ·: never. Bold: lowest per column, excluding the oracle; †: lowest in fewer than 80% of bootstrap resamples.

MethodLTSCρ=0\rho= 0LTSC
SAA129 ±1788 ±398 ±1139 ±515····
KL-Rec141 ±1989 ±3111 ±1339 ±415····
W-DRO24 ±545 ±330 ±318 ±3–12421220
KL-OT45 ±857 ±444 ±625 ±3–122912·
Gaussian
KL-Gen-P250 ±18107 ±2174 ±1151 ±481····
KL-Gen389 ±22124 ±2261 ±13103 ±682····
Copula
KL-Gen-P77 ±975 ±360 ±710 ±115···13
KL-Gen151 ±1691 ±3108 ±1121 ±318····
Log-normal
KL-Gen-P35 ±756 ±435 ±515 ±2299†·9†15
KL-Gen189 ±1799 ±3134 ±1240 ±534····
CSSC202 ±18101 ±3140 ±1241 ±540····
Log-normal mixture
KL-Gen-P34 ±854 ±535 ±523 ±413132613·
KL-Gen106 ±1782 ±485 ±1239 ±519····
CSSC96 ±1679 ±481 ±1136 ±417····
Flow
KL-Gen-P41 ±758 ±435 ±518 ±33311·919
KL-Gen206 ±20101 ±3138 ±1346 ±531····
Heavy-tailed flow
KL-Gen-P56 ±1168 ±445 ±749 ±624133213·
KL-Gen184 ±1998 ±3128 ±1251 ±630····
Oracle (reference)9 ±237 ±218 ±114 ±23

Table 6. Newsvendor, every method, N=128N = 128 (300 records); as Table 3. (a) OOD cost at SAA’s ID budget; (b) ID cost to halve SAA’s OOD.

Capacity Expansion Planning

Problem. A planner sizes wind, solar, gas, and battery capacity in 20 zones of the Texas system, and transmission between them, within a capital budget, then dispatches hourly, with a linearized unit commitment of gas plants, over a day of uncertain zonal demand and renewable availability (D=1,440D = 1{,}440). Unserved load costs $10,000/MWh, so cost is dominated by the few days on which high demand coincides with low renewable output across zones, and a record of a year or less rarely holds the worst of them.

Setup. A record covers kk years of 2001–2010: every second day of one year (k=12k = \frac{1}{2}), a full year (k=1k = 1), or, in App. § 9.7, five years (k=5k = 5). The learned nominal is a seasonally conditioned normalizing flow, fitted to the record alone and decoded through the record’s marginal distributions (App. § 9.§ 3). Every method minimizes annualized capital cost plus the mean–CVaR operating cost under the same capital budget (B=21.5B = 21.5 bn$/yr), holds at most K=48K = 48 scenarios, and, if adaptive, re-targets every round. For the transport methods, KL-OT and W-DRO, the tables report the transport budget δ=1\delta= 1 (App. § 9.§ 4). Each plan is scored by the same objective, in bn$/yr, on every day of 2011–2014 (ID), the four years after the record decade, and of 2020 (OOD), the most extreme year of 2001–2020 in the tail of demand (App. § 9.§ 2).

Frontiers across record lengths. Adaptive sampling alone cuts cost well below that of a static set of record days. At ρ=0\rho= 0, KL-Rec is far cheaper than SAA at every kk (Table 10). At k=12k = \frac{1}{2} the five radius pairs of Table 10, every setting of KL-Rec, and every setting of KL-OT except its cheapest in distribution, is dominated in median cost by a setting of KL-Gen (Figure 2(a)). Over the three kk, KL-Gen is cheaper than KL-OT out of distribution at all 15 radius pairs, at a small in-distribution premium for k≥1k \ge1 (Table 11). The advantage narrows as the record grows: KL-Gen’s out-of-distribution margin over KL-OT falls from 2.3–6.5 bn$/yr at k=12k = \frac{1}{2} to 0.07–0.76 at k=5k = 5, and KL-Rec joins the Pareto front at k=5k = 5. KL-OT reaches the front at every kk only through its cheapest in-distribution setting, and SAA, CSSC, and W-DRO never reach it. KL-Gen-P and KL-Gen with a seasonal Gaussian copula stay close to KL-Gen. The copula appears to capture what these decisions need, although the flow fits held-out days better (App. § 9.§ 3), and at this dimension the fitted proposal adds little over resampling (§ 4.3).

Figure 2. Capacity expansion at k=12k = \frac{1}{2} (panels defined in App. § 9.§ 6). (a) OOD against ID cost (bn$/yr) of each setting, with Pareto frontiers; KL-Rec, CSSC, and SAA lie outside the range. (b) Zonal wind on the most severe OOD day and admitted scenarios (top), and their spatial coherence (bottom). (c) Severity against demand-rescaled distance to the nearest real day, for the most severe admitted scenarios. (d) Demand relative to its 2001–2010 maximum against system wind; stars: the 20 most severe OOD days.

In-distributionOut-of-distribution
ρref\rho_{\mathrm{ref}}ρ\rhoKL-RecKL-OTKL-GenKL-Gen-PKL-Gen (copula)KL-RecKL-OTKL-GenKL-Gen-PKL-Gen (copula)
k=1k = 1 (10 record years)
0.2033.4430.3530.3430.7130.3956.9638.4233.9133.3538.79
0.0532.6730.4330.8930.6531.0953.6235.9733.0732.9033.51
0.232.4430.7331.1431.0031.0850.1938.8633.1933.1733.66
0.4032.3130.2930.5330.4830.3455.7140.5733.5833.6034.30
0.0531.7030.7330.8831.0030.6647.4637.3533.0832.9732.88
SAA42.7997.06
CSSC34.1249.10
W-DRO31.4241.42
k=1k = 1 (5 record years)
0.2030.8330.2730.3430.4130.4549.6735.9832.8733.1134.83
0.0530.5630.4930.7531.1431.0743.4334.4633.0232.7733.11
0.230.8230.9631.0831.0831.3242.7634.1633.2133.1833.29
0.4030.3630.0230.2030.4430.2646.4835.7032.9632.8833.10
0.0530.5830.4130.9131.1330.6946.6033.6732.8533.0232.79
SAA40.9983.64
CSSC33.6545.32
W-DRO30.6936.43
k=5k = 5 (5 record blocks)
0.2030.1130.1830.0530.2429.9842.5934.7733.5432.6533.97
0.0530.7330.5330.8030.6030.5246.2833.2632.7232.8133.16
0.230.8330.7131.0230.6831.0244.1834.6933.2733.1333.58
0.4029.7829.8930.3730.1930.0339.7535.2432.7633.0533.34
0.0529.8830.2930.8730.9230.5437.0933.1232.6132.6233.04
SAA42.9788.00
CSSC32.7342.12
W-DRO34.7838.51

Table 10. Capacity expansion: in-distribution (2011–2014) and out-of-distribution (2020) cost (bn$/yr) at the five radius pairs (ρref\rho_{\mathrm{ref}}, ρ\rho) run at every kk, and of SAA, CSSC, and W-DRO, which have no KL radii (median over records of the median over five seeds). Standard errors over records are 0.02–1.6 in distribution and 0.05–6.5 out of distribution for the methods with radii, and up to 6.7 and 15.6 for the others. Table 11 gives paired differences. Bold: on the Pareto front at that kk. KL-OT and W-DRO use δ=1\delta= 1.

In-distributionOut-of-distribution
ρref\rho_{\mathrm{ref}}ρ\rhoKL-Gen − KL-RecKL-Gen − KL-OTKL-Gen-P − KL-GenKL-Gen − KL-Gen (copula)KL-Gen − KL-RecKL-Gen − KL-OTKL-Gen-P − KL-GenKL-Gen − KL-Gen (copula)
k=1k = 1 (10 record years)
0.20−2.92 (1.02)*+0.14 (0.30)−0.07 (0.12)+0.30 (0.15)−22.21 (4.64)**−2.65 (2.22)*−0.27 (0.75)−1.44 (0.87)
0.05−1.72 (1.06)+0.28 (0.30)−0.05 (0.14)+0.19 (0.16)−18.29 (5.13)**−2.41 (2.85)−0.07 (0.30)−0.55 (0.90)
0.2−1.19 (0.78)+0.31 (0.15)−0.20 (0.15)+0.06 (0.25)−14.95 (3.86)**−2.28 (1.48)**−0.10 (0.58)−0.05 (0.58)
0.40−1.93 (1.14)*+0.12 (0.45)+0.04 (0.18)+0.16 (0.15)−17.66 (4.45)**−6.51 (2.96)*−0.13 (1.36)−0.03 (1.10)
0.05−0.46 (1.18)+0.16 (0.24)+0.10 (0.14)−0.02 (0.15)−12.71 (5.57)**−4.09 (1.46)**+0.01 (0.66)+0.30 (1.33)
k=1k = 1 (5 record years)
0.20−0.47 (0.34)+0.30 (0.50)−0.16 (0.05)+0.19 (0.04)−14.51 (1.34)−1.93 (1.93)−0.03 (1.47)−0.16 (1.33)
0.05+0.45 (0.26)+0.45 (0.23)−0.19 (0.29)+0.24 (0.20)−8.42 (2.78)−1.46 (3.47)−0.65 (3.39)+0.16 (2.22)
0.2+0.16 (0.33)+0.17 (0.12)−0.00 (0.28)+0.06 (0.13)−9.23 (1.25)−0.46 (1.87)−0.02 (1.59)−0.03 (1.25)
0.40−0.43 (0.33)+0.14 (0.25)+0.33 (0.24)−0.07 (0.21)−12.63 (2.71)−1.33 (1.18)−0.29 (0.66)+0.00 (0.57)
0.05−0.23 (0.59)+0.42 (0.18)+0.20 (0.08)+0.22 (0.18)−14.31 (1.87)−0.39 (0.85)−0.11 (0.30)−0.00 (0.43)
k=5k = 5 (5 record blocks)
0.20+0.25 (0.25)−0.11 (0.09)+0.18 (0.04)+0.07 (0.09)−8.90 (2.50)−0.07 (0.34)−0.14 (0.89)−0.79 (0.82)
0.05−0.07 (0.31)+0.09 (0.08)+0.01 (0.16)+0.31 (0.26)−13.80 (2.06)−0.39 (0.81)−0.28 (0.13)−0.84 (0.35)
0.2+0.18 (0.17)+0.38 (0.36)−0.08 (0.22)+0.04 (0.19)−10.19 (1.77)−0.33 (0.58)−0.35 (0.17)+0.17 (0.85)
0.40+0.57 (0.34)+0.33 (0.10)−0.13 (0.08)+0.26 (0.07)−6.50 (1.87)−0.76 (0.50)+0.37 (0.31)−0.15 (0.67)
0.05+0.73 (0.15)+0.24 (0.19)+0.31 (0.16)+0.36 (0.15)−3.79 (1.97)−0.18 (0.74)−0.08 (0.11)−0.31 (0.15)

Table 11. Capacity expansion: paired cost differences (bn$/yr; negative: the first method is cheaper) at each radius pair of Table 10: the median over records (standard error) of each record’s median over seeds. */**: two-sided Wilcoxon signed-rank p<0.05/0.01p < 0.05/0.01 over records. With five records (k=1k = 1) or blocks (k=5k = 5), the smallest attainable pp is 0.0625.

What the generator extrapolates. The most severe days of 2020 lie within the demand range of 2001–2010 and are severe because high demand coincides with low renewable output across zones (panel d), a pattern present even in a k=12k = \frac{1}{2} record. The flow reproduces it: its most severe scenarios reach the OOD days’ severity with spatial shapes as close to real days as the record’s own severe days (panel c) and wind as spatially coherent as on real days (panel b).

What transport extrapolates. KL-OT makes scenarios costly by inflating demand zone by zone, up to 2.4 times the highest system demand of 2001–2010 at δ=3\delta= 3 (panel d), whereas on real days each zone’s demand moves with the system total. At δ=1\delta= 1 its most severe scenarios fall just short of the OOD days’ severity, and at δ=3\delta= 3 they reach it only with shapes farther from real days than the record’s own severe days (panel c). Widening the transport budget brings its OOD cost toward that of KL-Gen only at a higher ID cost (panel a). This premium is paid every year to hedge against days unlike those in the data.

Conclusion

For two-stage stochastic programs with severe tail risk, we proposed centering a KL ball at a generative model of a short record, so that the adversary judges unobserved realizations by learned dependence rather than distance from the record, and solving the resulting problem on scenarios drawn adaptively toward its worst case. Across both case studies, we found that the learned nominal helps most when the record is short and the model class extrapolates along structure the record shows, such as the co-movement of demand across products or of renewable shortfalls across zones. The advantage fades as the record grows, and transport around the record hedges more cheaply against shifts the model class does not anticipate. As for the sampler, a fitted proposal adds most when the realizations driving the worst case are rare among the model’s draws.

Limitations. Both case studies have linear recourse, so integer and nonlinear convex recourse remain untested. On the theoretical side, the ball around QθQ_{\theta} contains a distribution PP, shifted or not, only if ρ≥KL⁡(P∥Qθ)\rho\ge\operatorname{KL}(P \mathbin\Vert Q_{\theta}). This divergence is set by the model’s misspecification, which the record does not reveal, and is infinite if the model assigns no mass where PP has some, as nominals decoded through the record’s empirical marginals do beyond its range. We therefore choose the radius empirically, without a finite-sample guarantee. Statistically, the master’s objective is a biased estimate of its counterpart under QθQ_{\theta}, and we do not show that the returned plan converges: under the alternation, it is a best response whose optimality gap on the held scenarios is bounded only after the fact (App. § 9.§ 5).

AI Use Statement

The authors received assistance from Claude Code in implementing the methods and baselines, producing the tables and figures from the data of the computational experiments, reviewing the literature, and editing and revising the text, and take full responsibility for the content of the paper.

Newsvendor

Problem

A retailer chooses order quantities x∈R+5x \in\mathbb{R}_{+}^{5} at unit cost, c(x)=1Txc(x) = \mathbf{1}^{\mathsf{T}}x, before demand ξ∈R+5\xi\in\mathbb{R}_{+}^{5} is observed. Stock of product ii ships yijy_{ij} units to demand for product jj along the arcs E={(j,j)}j=15∪{(j+1,j)}j=14\mathcal{E} = \{(j,j)\}_{j=1}^{5} \cup\{(j+1,j)\}_{j=1}^{4}, and the recourse cost is

Q(x,ξ)=min⁡y,u,v≥00.5∑j=14yj+1,j+100∑j=15uj−0.25∑i=15vi(11)Q(x,\xi) = \min_{y,u,v\geq0} 0.5\sum_{j=1}^{4} y_{j+1,j} + 100\sum_{j=1}^{5}u_j - 0.25\sum_{i=1}^{5}v_i \tag*{(11)}
s.t.∑j:(i,j)∈Eyij+vi=xi,∑i:(i,j)∈Eyij+uj=ξj,i,j=1,…,5,\text{s.t.}\quad\sum_{j:(i,j)\in\mathcal{E}} y_{ij} + v_i = x_i,\qquad\sum_{i:(i,j)\in\mathcal{E}} y_{ij} + u_j = \xi_j,\qquad i,j=1,\ldots,5,

where uju_j is unmet demand and viv_i leftover stock. The critical ratio is (100−1)/(100−0.25)=0.9925(100-1)/(100-0.25) = 0.9925, and recourse is relatively complete, since y=0y=0 is always feasible. The objective is c(x)c(x) plus the mean–CVaR equation 3 of Q(x,ξ)Q(x,\xi) with β=0.25\beta= 0.25 and α=0.9\alpha= 0.9.

Distributions and Records

Under the base distribution P0\mathbb{P}_{0}, log demand is 0.95N(μ,Σ)+0.05N(μ+Δ,Σ)0.95\mathcal{N}(\mu,\Sigma) + 0.05\mathcal{N}(\mu+\Delta,\Sigma), with μj=log⁡100\mu_j = \log100, standard deviations 0.35, and correlations 0.6. The shock Δ\Delta is 0.9 on products 1, 3, and 5 and 0.225 on products 2 and 4. Each shift family pairs the distribution the records are drawn from with a shifted distribution (Figure 3).

Figure 3. The four newsvendor shift families: joint densities of log demand for products 1 and 3 (1 and 2 in (c)) under the records’ distribution (top) and the shifted distribution (bottom), with contours spanning 3.5 orders of magnitude so that the shocks are visible. (a) Level: the density translates. (b) Tail: the shock spreads into a wide, faint band. (c) Support: a new component appears where the records’ distribution has almost no mass. (d) Coincidence: shocks to one product at a time become joint shocks, with unchanged marginals.

Level. Records from P0\mathbb{P}_{0}; the shifted distribution adds 0.35 to every component of μ\mu.

Tail. Records from P0\mathbb{P}_{0}; the shifted distribution multiplies the covariance of the shock component by 8, keeping expected demand unchanged.

Support. Records from P0\mathbb{P}_{0}; the shifted distribution adds a third component of weight 0.05 whose shock is 1.35 on products 2 and 4 and 0.34 on the others.

Coincidence. Records from a mixture of a calm component of weight 0.75 and five components of weight 0.05, the jjth adding Δj\Delta_j to product jj only; the shifted distribution is P0P_0, with the same marginals.

There are 300 records at every NN, nested across NN, and the level, tail, and support families share them.

Learned Nominals

Each nominal, and a heavy-tailed variant of the flow, is fitted to all five products of a record and sampled as a map of z∼N(0,I5)z \sim N(0, I_5), so the weights φ/rt\varphi/r_t are exact whether or not the map is invertible (§ 4.2). Figure 4 compares them on single records.

Scatterplots of draws from each nominal distribution for products 1 and 3

Figure 4. What each nominal can represent: 4,000 draws from each nominal fitted to one record of N=16N = 16 (top) and one of N=128N = 128 (bottom), shown for products 1 and 3 (black points: the record; dashed box: its range). The copula’s draws stay within the record’s range, while the other nominals extrapolate beyond it. Here, cross-validation keeps the flow at its log-normal initialization, and the heavy-tailed flow selects a log-tt with 30 degrees of freedom.

Gaussian. Sample mean and covariance of raw demand, with draws clipped at zero.

Copula. The correlation of the normal scores Φ−1((m+12)/N)\Phi^{-1}((m+\frac{1}{2})/N) of each coordinate’s rank m∈{0,…,N−1}m \in\{0,\ldots,N-1\} in the record, where Φ\Phi is the standard normal distribution function. Draws are decoded through the record’s empirical quantiles, so they stay within its range.

Log-normal. A maximum-likelihood Gaussian on log demand.

Log-normal mixture. Two components fitted by expectation maximization, the family of the base distribution, sampled through the inverse of its Rosenblatt transform.

Flow. A RealNVP flow (Dinh et al., [20]) on whitened log demand, with six affine coupling layers of width 16, initialized at the log-normal and fitted by maximum likelihood with Adam. Its number of steps (0 to 400) and weight decay are chosen by five-fold cross-validation, which keeps zero steps on every record at N=16N = 16. There the flow remains a log-normal, but with the unbiased covariance (divisor N−1N-1) rather than the maximum-likelihood one (divisor NN), so its rows differ from the log-normal’s by this 16/15 wider covariance and by independent sampler draws.

Heavy-tailed flow. A tail-adaptive flow after Jaini et al. [34]: the same flow on a Student-tt base with a learned number of degrees of freedom per coordinate, obtained by mapping each latent coordinate through Φ\Phi and then the Student-tt quantile function. Cross-validation chooses among the log-normal, a log-tt, and the tt-base flow.

Methods

Table 2 summarizes the methods. Methods with a KL ball are run at every radius of the grid ρ∈{0,0.003,0.005,0.007,0.01,0.015,0.02,0.03,0.05,0.1,0.2,0.4,0.8}\rho\in\{0, 0.003, 0.005, 0.007, 0.01, 0.015, 0.02, 0.03, 0.05, 0.1, 0.2, 0.4, 0.8\}, and methods that depend on a decision use the risk-neutral decision x^\hat{x} on the record and tilt at ρref=0.8\rho_{\mathrm{ref}} = 0.8.

KL-Rec and SAA. KL-DRO on the empirical distribution [30]. SAA is KL-Rec at ρ=0\rho= 0.

KL-Gen-P and the oracle. One round of the sampler at x^\hat{x}: M=256M = 256 latent draws are evaluated, a Gaussian is fitted to their tilt, with its covariance shrunk toward its diagonal with weight 0.25, and n=100n = 100 scenarios are drawn from the defensive mixture with a=0.9a = 0.9, once per record for all radii. The oracle applies the same sampler to the true distribution and serves only as a reference.

KL-Gen. Resamples 100 of 356 draws of the nominal by the tilt, with replacement, matching the 256 + 100 recourse evaluations of the sampler.

CSSC. Reduces 1,024 draws of the log-normal or the log-normal mixture to K=100K = 100 medoids weighted by cluster mass, clustering each draw’s costs under x^\hat{x} and 32 single-scenario decisions with kk-medoids, a scalable variant of the program of Keutchayan et al. [36].

Transport step. W-DRO and KL-OT move each record point ξ0\xi^0 to an approximate maximizer of Q(x,ξ)−γ∥ω(ξ)−ω(ξ0)∥22Q(x,\xi) - \gamma\lVert\omega(\xi) - \omega(\xi^0)\rVert_2^2, the Lagrangian of a type-2 Wasserstein ball, with ω\omega the standardized log demand, by damped fixed-point steps on the recourse duals. The multiplier γ\gamma is set at x^\hat{x} so that the mean squared displacement is ϵ\epsilon times the median squared nearest-neighbor spacing of the record, and we call ϵ\epsilon the displacement. Both methods alternate three rounds of moving the points and solving the master.

W-DRO. Moves all NN record points, with ϵ∈{0.01,0.03,0.1,0.3,1,3,10}\epsilon\in\{0.01, 0.03, 0.1, 0.3, 1, 3, 10\}, and has no KL ball.

KL-OT. Moves min⁡(100,N)\min(100,N) record points selected by the tilt, at the displacements of W-DRO, within the ball at every radius of the grid.

Parity. All methods share the records, the evaluation distributions, the selection rule, and the master. KL-Gen-P and KL-Gen evaluate the recourse 356 times per record, and KL-Gen’s master holds a median of 69 distinct scenarios against the 100 of KL-Gen-P. CSSC evaluates it 33 times per pool draw, and W-DRO and KL-OT about 1,300 times per setting at N=16N = 16 and 8,400 to 9,700 at N=128N = 128. KL-OT also chooses among 91 settings, against 13 for the other KL methods and 7 for W-DRO. The differences in evaluations and in KL-OT’s grid favor the baselines.

Solving the Master

The master is a linear program at ρ=0\rho= 0, solved by Gurobi [26], and otherwise an exponential-cone program solved by Clarabel [25]. A Clarabel solution is accepted if its value agrees with the objective recomputed at its decision to 10−510^{-5} relative and is no worse than the solution for ρ=0\rho= 0. Otherwise, a sequential least squares programming solve starts from the solution for ρ=0\rho= 0. This fallback served 10% of the master solves with ρ>0\rho> 0, and 22% of those of KL-Gen-P.

Selection and Evaluation

Selection rule. Records are split into odd- and even-numbered halves. On each half, each method’s setting is chosen as the largest whose mean in-distribution cost is within 5 percentage points of that of SAA, or the cheapest if none is, and it is scored on the other half, so the shifted distribution is never consulted. Settings are ordered by radius, by displacement for W-DRO, and by displacement and then radius for KL-OT. Table 1(b) instead reads the frontiers of Figure 5 at a fixed target: the lowest median in-distribution cost among a method’s settings whose median out-of-distribution cost is at most half that of SAA, with the stability of the lowest method assessed over 200 bootstrap resamples of the records. Under relative rules that admit in-distribution costs up to 1.10 or 1.25 times that of SAA, the lowest method is unchanged in 7 of the 8 columns of Table 1(a) at 1.10, where the log-normal replaces W-DRO at N=128N = 128 under the tail shift, and in all 8 at 1.25.

Newsvendor frontiers

Figure 5. Newsvendor frontiers: out-of-distribution against in-distribution cost above the optimum (%, median over records) as each method’s settings vary. Each line is a method’s Pareto frontier (lower left is better). Rows are record sizes and columns shifts. The open square is SAA, and the dashed line is half of SAA’s out-of-distribution cost, the target of Table 1(b).

Scoring. In- and out-of-distribution costs are the objective of App. § 8.§ 1 under the records’ distribution and the shifted distribution, as a percentage above the optimum under that distribution, computed on a scrambled Sobol quadrature with 4,096 points per mixture component. Tables report the median over records with the standard error 1.2533 σ^/n1.2533\,\hat{\sigma}/\sqrt{n}, where σ^\hat{\sigma} is the interquartile range divided by 1.349.

Full Results

Figure 5 and Table 3–Table 6 give the full results.

Capacity Expansion

Model

Variables. Let Z\mathcal{Z} be the 20 zones, indexed by nn, L\mathcal{L} the candidate lines with zone-line incidence matrix AA, G\mathcal{G} the technologies, of which Gth\mathcal{G}_{\mathrm{th}} are gas and Gcont=G∖Gth\mathcal{G}_{\mathrm{cont}} = \mathcal{G} \setminus\mathcal{G}_{\mathrm{th}} the others, S\mathcal{S} the scenarios, and t=1,…,24t = 1,\ldots,24 the hours of a day. The first stage builds generation capacity xnggenx^{\mathrm{gen}}_{ng} and transmission capacity xℓtrx^{\mathrm{tr}}_{\ell} from zero. Gas capacity is Pˉgung\bar{P}_g u_{ng} for a plant count ungu_{ng}, which is relaxed to be continuous throughout. The recourse variables of scenario ss, collected in ysy_s, are dispatch pstngp_{stng}, flows fstℓf_{st\ell}, load shedding ℓstnshed\ell^{\mathrm{shed}}_{stn}, and battery charge pstnchp^{\mathrm{ch}}_{stn}, discharge pstndisp^{\mathrm{dis}}_{stn}, and state of charge estne_{stn}.

MethodLTSCID cost ρ=0\rho= 0LTSC
SAA412 ±\pm41126 ±\pm5273 ±\pm26149 ±\pm1487····
KL-Rec412 ±\pm41126 ±\pm5284 ±\pm27143 ±\pm1387····
W-DRO46 ±\pm523 ±\pm357 ±\pm685 ±\pm11–26432656
KL-OT46 ±\pm524 ±\pm361 ±\pm698 ±\pm12–24372456
Gaussian
KL-Gen-P222 ±\pm27104 ±\pm4159 ±\pm1750 ±\pm793···37
KL-Gen414 ±\pm30127 ±\pm3278 ±\pm19119 ±\pm990····
Copula
KL-Gen-P285 ±\pm29111 ±\pm4195 ±\pm1858 ±\pm661···44
KL-Gen313 ±\pm29114 ±\pm4214 ±\pm1966 ±\pm860···53
Log-normal
KL-Gen-P36 ±\pm749 ±\pm535 ±\pm523 ±\pm33713†1713†19
KL-Gen190 ±\pm2498 ±\pm4138 ±\pm1644 ±\pm73328·2829
CSSC223 ±\pm26103 ±\pm4151 ±\pm1851 ±\pm744···35
Log-normal mixture
KL-Gen-P49 ±\pm1043 ±\pm551 ±\pm939 ±\pm53020262028
KL-Gen168 ±\pm2694 ±\pm5124 ±\pm1748 ±\pm73228·2835
CSSC160 ±\pm2890 ±\pm5119 ±\pm1854 ±\pm63230·3038
Flow
KL-Gen-P41 ±\pm955 ±\pm533 ±\pm624 ±\pm33413171317
KL-Gen195 ±\pm2898 ±\pm4135 ±\pm1845 ±\pm73027·2729
Heavy-tailed flow
KL-Gen-P44 ±\pm837 ±\pm546 ±\pm743 ±\pm6241417†1420
KL-Gen170 ±\pm2494 ±\pm4120 ±\pm1634 ±\pm52825·2525
Oracle (reference)19 ±\pm321 ±\pm232 ±\pm323 ±\pm33

Table 4. Newsvendor, every method, N=32N = 32 (300 records); as Table 3.

MethodLTSCρ=0\rho= 0LTSC
SAA245 ±30107 ±4169 ±1876 ±1038····
KL-Rec264 ±30108 ±4182 ±1878 ±838····
W-DRO31 ±434 ±344 ±537 ±4–16321636
KL-OT39 ±845 ±448 ±651 ±7–16291636
Gaussian
KL-Gen-P245 ±20107 ±3172 ±1355 ±690····
KL-Gen406 ±21126 ±2267 ±13113 ±887····
Copula
KL-Gen-P157 ±1892 ±3115 ±1124 ±430···22
KL-Gen205 ±21101 ±3151 ±1439 ±533···26
Log-normal
KL-Gen-P39 ±752 ±431 ±521 ±3359†209†17
KL-Gen204 ±21101 ±3145 ±1343 ±634····
CSSC209 ±21101 ±3151 ±1445 ±642····
Log-normal mixture
KL-Gen-P41 ±945 ±542 ±635 ±52215221523
KL-Gen143 ±2189 ±4109 ±1342 ±625····
CSSC127 ±2185 ±599 ±1344 ±52624···
Flow
KL-Gen-P34 ±651 ±431 ±422 ±33410171015
KL-Gen204 ±22100 ±3144 ±1447 ±635····
Heavy-tailed flow
KL-Gen-P35 ±743 ±535 ±528 ±42512281218
KL-Gen177 ±2096 ±3128 ±1335 ±530···23
Oracle (reference)19 ±322 ±230 ±325 ±33

Table 5. Newsvendor, every method, N=64N = 64 (300 records); as Table 3. (a) OOD cost at SAA’s ID budget; (b) ID cost to halve SAA’s OOD.

Objective. Given scenario weights psp_s summing to one (App. B.5), the master is

min⁡ Cinv(x)+(1−β)∑s∈Sps νCsop(x,ys)+β(ζ+11−α∑s∈Spsvs)(12)\min\ C^{\mathrm{inv}}(x) + (1-\beta)\sum_{s\in\mathcal{S}}p_s\,\nu C_s^{\mathrm{op}}(x,y_s) + \beta\left(\zeta+\frac{1}{1-\alpha}\sum_{s\in\mathcal{S}}p_s v_s\right) \tag*{(12)}

s.t. vs≥νCsop(x,ys)−ζv_s \ge\nu C_s^{\mathrm{op}}(x,y_s)-\zeta, vs≥0v_s\ge0, ∀s\forall s, Cinv(x)≤BC^{\mathrm{inv}}(x)\le B,

together with the constraints below, where ν=8760/24\nu=8760/24 annualizes a day’s operating cost, BB is the capital budget below, β=0.25\beta=0.25, α=0.9\alpha=0.9, and ζ\zeta and vsv_s are the auxiliary variables of the Rockafellar–Uryasev representation of CVaR [47]. The investment and operating costs are

Cinv(x)=∑n,g∈Gcontcginvxnggen+∑n,g∈GthcginvP‾gung+∑ℓ∈Lctr∣ℓ∣xℓtr,C^{\mathrm{inv}}(x)=\sum_{n,g\in\mathcal{G}_{\mathrm{cont}}}c_g^{\mathrm{inv}}x_{ng}^{\mathrm{gen}}+\sum_{n,g\in\mathcal{G}_{\mathrm{th}}}c_g^{\mathrm{inv}}\overline{P}_g u_{ng}+\sum_{\ell\in\mathcal{L}}c^{\mathrm{tr}}|\ell|x_\ell^{\mathrm{tr}},
Csop(x,ys)=∑t,n,gcgvarpstng+cshed∑t,nℓstnshed,C_s^{\mathrm{op}}(x,y_s)=\sum_{t,n,g}c_g^{\mathrm{var}}p_{stng}+c^{\mathrm{shed}}\sum_{t,n}\ell_{stn}^{\mathrm{shed}},

where ∣ℓ∣|\ell| is the length of line ℓ\ell, cginvc_g^{\mathrm{inv}} and ctrc^{\mathrm{tr}} are annualized, and for gas cgvar=cfuelhg+cgvom+cCO2rCO2hgc_g^{\mathrm{var}}=c^{\mathrm{fuel}}h_g+c_g^{\mathrm{vom}}+c^{\mathrm{CO2}}r^{\mathrm{CO2}}h_g, with variable operation and maintenance cost cgvomc_g^{\mathrm{vom}}, heat rate hgh_g, and emissions rate rCO2r^{\mathrm{CO2}}.

Constraints. For all ss, tt, and nn, zonal balance is

∑gpstng+pstndis−pstnch+ℓstnshed−dstn=(Afst)n,\sum_g p_{stng}+p_{stn}^{\mathrm{dis}}-p_{stn}^{\mathrm{ch}}+\ell_{stn}^{\mathrm{shed}}-d_{stn}=(Af_{st})_n,

where dstnd_{stn} is the scenario’s demand in zone nn at hour tt, and flows are limited by −xℓtr≤fstℓ≤xℓtr-x_\ell^{\mathrm{tr}}\le f_{st\ell}\le x_\ell^{\mathrm{tr}}, a network-flow model without power-flow constraints. Wind and solar dispatch is bounded by the scenario’s capacity factors, pstng≤astngxnggenp_{stng}\le a_{stng}x_{ng}^{\mathrm{gen}}, and gas dispatch by installed capacity, pstng≤P‾gungp_{stng}\le\overline{P}_g u_{ng}. For batteries,

0≤pstnch,pstndis≤xngen,bat,0≤estn≤Hxngen,bat,estn=es,t−1,n+ηchpstnch−pstndis/ηdis,0\le p_{stn}^{\mathrm{ch}},p_{stn}^{\mathrm{dis}}\le x_n^{\mathrm{gen,bat}},\qquad0\le e_{stn}\le Hx_n^{\mathrm{gen,bat}},\qquad e_{stn}=e_{s,t-1,n}+\eta^{\mathrm{ch}}p_{stn}^{\mathrm{ch}}-p_{stn}^{\mathrm{dis}}/\eta^{\mathrm{dis}},

where xngen,batx_n^{\mathrm{gen,bat}} is the battery power capacity of zone nn, with the last hour linked cyclically to the first. Load shedding satisfies 0≤ℓstnshed≤max⁡{dstn,0}0\le\ell_{stn}^{\mathrm{shed}}\le\max\{d_{stn},0\}. Gas plants follow a linearized clustered unit commitment: the committed count cstng∈[0,ung]c_{stng}\in[0,u_{ng}] of each gas technology in each zone changes by start-ups and shut-downs, output satisfies P‾gcstng≤pstng≤P‾gcstng\underline{P}_g c_{stng}\le p_{stng}\le\overline{P}_g c_{stng}, started and stopped units respect minimum up- and down-times (cyclic over the day), and each start-up adds cgsuP‾gc_g^{\mathrm{su}}\overline{P}_g to CsopC_s^{\mathrm{op}}. The count cstngc_{stng} is continuous, so the recourse remains a linear program. There are no ramping constraints.

Capital budget. B=21.5B=21.5 bn$/yr for every method, radius, record, seed, and kk. It was fixed before any run, inside the range (19.5 to 23.6 bn$/yr) of the investment cost of unbudgeted plans from a preliminary configuration of KL-Rec at k=1k=1 (ρ=0\rho=0, ρref=0.4\rho_{\mathrm{ref}}=0.4). At B=19.35B=19.35 and 23.65 bn$/yr (±10%\pm10\%), KL-Gen remains cheaper out of distribution than KL-Rec and KL-OT at (ρref,ρ)=(0.2,0.05)(\rho_{\mathrm{ref}},\rho)=(0.2,0.05) at every kk.

Network and parameters. The 214 counties of the region of the Electric Reliability Council of Texas (ERCOT) are grouped into 20 zones by kk-means on county locations. Dallas and Rockwall counties, which have no coordinates in the source table, take their 2020 Census internal points. Zonal demand is the sum of county demand, and zonal capacity factors are county averages. Candidate lines join zone centroids along the edges of their Gabriel graph (40 lines, 116 to 279 km, median 178 km). Figure 6 shows the zones and lines, and Table 7 gives the cost and technology parameters.

Map of the 20 zones of the capacity expansion model, with zone centroids and transmission corridors

Figure 6. The 20 zones of the capacity expansion model. Counties of the ERCOT region are shaded by zone (other Texas counties in gray) and zone boundaries are drawn in dark gray. Lines join zone centroids along the 40 candidate transmission corridors, and centroid markers are sized by the zone’s share of 2010 demand.

Cost and technology parameters, in real 2024 dollars. Generation costs are from the 2024 Annual Technology Baseline of the National Renewable Energy Laboratory [43] (Moderate scenario, 2030, converted from 2022 dollars by ×1.061\times1.061), and heat rates are assumed. The gas price and emissions rate are from the Energy Information Administration (Annual Energy Outlook 2024, 2030). Capital costs are annualized with the capital recovery factor CRF⁡(r,L)=r(1+r)L(1+r)L−1\operatorname{CRF}(r,L)=\frac{r(1+r)^L}{(1+r)^L-1} over the lifetime LL, plus fixed operation and maintenance (O&M). VOM is variable O&M.

TechnologyCapital (/kW) | Fixed O&M (/kW-yr)VOM ($/MWh) | Heat rate (MMBtu/MWh) | Lifetime (yr)
Wind149431.00.0–30
Solar126619.10.0–30
Gas, combined cycle148933.72.26.430
Gas, combustion turbine134826.57.49.530
Battery 4h154034.50.0–15

Table 7.

Data and Records

Data. The source is hourly county-level ERCOT data: wind and solar capacity factors from Bracken et al. [9] and demand simulated by the Total Electricity Load (TELL) model McGrath et al. [41], aggregated to the 20 zones. A scenario is one day of 20 zonal demands and 40 zonal capacity factors, so D=1,440D=1{,}440, cut at local midnight. Short gaps are interpolated, and days with longer gaps are dropped. Table 8 gives the periods.

Data periods. Records A to J are the years 2010, 2009, 2007, 2008, 2005, 2001, 2002, 2003, 2004, and 2006. The years 2015–2019 are used only to place 2020 among the other years.

PeriodYearsDaysRole
Record2001–201010 × 364records and fitted nominals
In distribution (ID)2011–20141,458evaluation
Out of distribution (OOD)2020364evaluation

Table 8.

ParameterValueParameterValue
Lost load cshedc^{\mathrm{shed}}$10,000/MWh | Discount rate rr | 7%
Carbon price cCO2c^{\mathrm{CO2}}$150/tCO2_2 | Gas units (combined cycle, turbine) | 500, 150 MW
Gas price cfuelc^{\mathrm{fuel}}$3.43/MMBtu | Battery duration HH | 4 h
Emissions rate rCO2r^{\mathrm{CO2}}0.05306 t/MMBtuEfficiency ηch=ηdis\eta^{\mathrm{ch}}=\eta^{\mathrm{dis}}0.85\sqrt{0.85}
Transmission ctrc^{\mathrm{tr}}$1,500/MW-km | Line lifetime, fixed O&M | 40 yr, 2%/yr
Minimum output pgp_g (CC, CT)40%, 30%Minimum up/down time (CC, CT)6 h, 1 h
Start-up cost cgsuc_g^{\mathrm{su}} (CC, CT)$79, $179/MW

Table 12.

Records. At k=1k=1 a record is one year, at k=12k=\frac{1}{2} every second day of it (182 days), and at k=5k=5 one of five sets of five years. Every record is run with five seeds.

Out-of-distribution year. 2020 was designated out of distribution before any method was scored on it, although its days later also served for development (App. § 9.§ 6). It is the most extreme year of 2001–2020 in the tail of demand: its annual peak (77.4 GW) lies 2.5 standard deviations of year-to-year variation above the 2001–2019 trend. Net load is demand less the output of a fixed reference fleet of 62.6 GW of wind and 24.3 GW of solar, the mean zonal capacities of 25 KL-OT plans at k=12k=\frac{1}{2}. The 99th percentile of daily peak net load is 50.4 GW in 2020, against at most 46.7 GW in any other year.

Learned Nominals

KL-Gen and KL-Gen-P use a conditional normalizing flow, and KL-Gen (copula) and KL-Gen-P (copula) a Gaussian copula with a separate mean and covariance for each season. Both are fitted to the record alone and share their marginal transform and smoothing.

Copula. Each coordinate of a day, in log demand and logit capacity factors, is mapped to its normal score among the record’s days, and the scores of each season define a Gaussian. A draw uses one extra latent coordinate z0z_0 to choose the season in proportion to the record’s season counts, forms the seasonal Gaussian draw from the other coordinates of zz, maps each coordinate back through the record’s empirical quantiles, and smooths the day over adjacent hours with weights (0.2, 0.6, 0.2).

Flow. The flow replaces the seasonal Gaussian with a model of the 16 leading whitened principal components of the scores, a conditional RealNVP (Dinh et al. [20]) with an affine layer and two coupling layers of width 16 (2,720 parameters), conditioned on two harmonics of the day of the year and on the season. The remaining components follow a seasonal Gaussian. The flow is fitted by maximum likelihood with AdamW, with Gaussian noise of standard deviation 0.3 added to the components, for a number of steps chosen on a season-stratified 20% of the record’s days, and then refitted on all of them. All seeds of a record share one flow. In a draw, z0z_0 selects a record day, whose calendar day and season are the covariates, and the other coordinates drive the flow and the Gaussian remainder. The day is then decoded and smoothed as for the copula.

Properties and fidelity. Before smoothing, each coordinate of a draw of either nominal lies within the record’s range, although a draw can combine coordinates into a system-wide peak that no record day reaches. In a separate study on 2001–2010, the flow’s held-out log-likelihood exceeded that of a seasonal Gaussian of the copula’s form, with tuned shrinkage, in each of the ten years, by a median of 0.97 nats per day with 182 training days and 1.85 with 320 (three training seeds). Its configuration was fixed from that study before any plan was scored. The most severe scenarios KL-Gen admits are less spatially coherent in solar than real days (mean correlation of zonal solar profiles 0.82, against 0.87 for the 20 most severe days of 2020). Both nominals overstate the frequency of the decade’s tail: at k=12k=\frac{1}{2}, the share of their draws whose peak net load exceeds the 2001–2010 99th percentile is about 1.7 times the decade’s own share for the copula and 2.1 times for the flow.

Methods

Table 9 summarizes the methods. KL-Rec, KL-Gen, KL-Gen-P, their copula variants, and KL-OT share the adaptive loop of Algorithm 1:

Rounds. The initial plan solves the unbudgeted, risk-neutral problem on one scenario fixed by the seed. Each of twelve rounds evaluates M=256M=256 candidates at the current plan (for the proposal methods, an initial sample of M=64M=64, to which the proposal is fitted, and 192 draws from it), tilts them at ρf\rho_f, and admits n=4n=4, so the master holds at most 48 scenarios.

Base weights. A new scenario’s base weight, ci/(Mτi)c_i/(M\tau_i), or cibi/τic_i b_i/\tau_i for the proposal methods, where bi∝φ(zi)/rt(zi)b_i\propto\varphi(z_i)/r_t(z_i) and τi∝biexp⁡(Qi/λt)\tau_i\propto b_i\exp(Q_i/\lambda_t), is fixed at admission, and the weights of all rounds are normalized together.

Master. Each round recomputes the worst case at the current plan (App. § 9.§ 5) and solves for the next plan. The last plan is reported.

Radii. KL-Rec, KL-OT, and the copula variants are run at k<1k < 1 at the eleven pairs with ρref∈{0.2,0.4}\rho_{\mathrm{ref}} \in\{0.2, 0.4\}, ρ∈{0,0.02,0.05,0.1,0.2,0.4}\rho\in\{0, 0.02, 0.05, 0.1, 0.2, 0.4\}, and ρ≤ρref\rho\le\rho_{\mathrm{ref}}. KL-Gen, KL-Gen-P, and every method at k=5k = 5 are run at the five pairs (0.2,0)(0.2, 0), (0.2,0.05)(0.2, 0.05), (0.2,0.2)(0.2, 0.2), (0.4,0)(0.4, 0), and (0.4,0.05)(0.4, 0.05).

The methods differ as follows.

KL-Rec. Candidates are record days drawn with replacement.

KL-Gen. Candidates are draws of the flow.

KL-Gen-P. Candidates are 192 draws from a proposal that shifts the mean of φ\varphi (the mean-shift case of Sec. 4.3) in a 10-dimensional active subspace [15] of the cost gradients of 64 fitting draws, mixed with φ\varphi at a=0.5a = 0.5. Four are resampled by the tilt.

KL-Gen (copula) and KL-Gen-P (copula). KL-Gen and KL-Gen-P with the copula in place of the flow, with all else identical. The tables report KL-Gen (copula).

KL-OT (δ\delta). Candidates are 256 record days. From the second round, each is moved before evaluation to an approximate maximizer of Q(xt,ξ)−γ∥ω(ξ)−ω(ξ0)∥22Q(x_t,\xi) - \gamma\lVert\omega(\xi) - \omega(\xi^0)\rVert_2^2, the Lagrangian of a type-2 Wasserstein ball, where ξ0\xi^0 is the record day and ω\omega its standardized log demand and logit capacity factors, by three damped fixed-point steps on the dispatch subgradient. A moved day keeps its record day’s base weight. The multiplier γ\gamma is set once, at the second round, so that the mean cost increase of moved days is δ\delta times the mean cost of the unmoved candidates. The transport budget δ∈{0.3,1,3}\delta\in\{0.3, 1, 3\} is thus a cost-increase target at one plan rather than a radius.

W-DRO (δ\delta). Holds 48 record days with uniform weights and no KL ball. Each round moves every day by the step of KL-OT, with γ\gamma set as for KL-OT, to the target δ\delta, at the first plan, and re-solves the master on each day’s largest penalized cost, for at most four rounds. At δ=1\delta= 1, 68 of 100 runs reach the four-round cap, with a median relative gap of 2 to 4×10−34 \times10^{-3} across kk.

CSSC. Selects 48 days from 256 record days (all 182 at k=12k = \frac{1}{2}) by the clustering program of Keutchayan et al. [36], with opportunity costs Cinv(xi∗)+νQ(xi∗,ξj)C^{\mathrm{inv}}(x_i^*) + \nu Q(x_i^*, \xi_j) for the plan xi∗x_i^* that solves the problem on day ii alone, and weights them by cluster mass. It has no KL ball.

SAA. Solves the master on 48 record days with uniform weights.

Solving the Master

The worst case. For the mean–CVaR risk measure, with Qi:=Q(x,ξi)Q_i := Q(x,\xi_i) and normalized base weights wˉ\bar{w}, the adversary maximizes min⁡ζ{ζ+∑ipiψ(Qi)}\min_{\zeta}\{\zeta+ \sum_i p_i \psi(Q_i)\} over the ball Bρ\mathcal{B}_{\rho} of probability vectors pp with ∑ipilog⁡(pi/wˉi)≤ρ\sum_i p_i \log(p_i/\bar{w}_i) \le\rho. The objective is linear in pp and convex in ζ\zeta, and the feasible set is convex and compact, so the maximum and minimum may be exchanged (Sion, 1958). For fixed ζ\zeta the maximizer is the tilt pi∝wˉiexp⁡(ψζ(Qi)/λ)p_i \propto\bar{w}_i \exp(\psi_\zeta(Q_i)/\lambda), with λ\lambda bisected so that the KL constraint binds, and ζ\zeta is found by golden-section search over [min⁡iQi,max⁡iQi][\min_i Q_i,\max_i Q_i].

The alternation. Each round solves the linear program equation (12) with the weights fixed at the worst case computed at the current plan, so the reported plan xTx_T is a best response to the worst case at xT−1x_{T-1} rather than a solution of the KL-DRO problem on the final scenario set. Weak duality bounds its optimality gap. With J(x,p)J(x,p) the value of equation (12) at plan xx and weights pp, minimized over the recourse and auxiliary variables, pTp_T the final weights, and p′p' the worst case at xTx_T, the gap is at most max⁡p∈BρJ(xT,p)−max⁡{min⁡xJ(x,pT),min⁡xJ(x,p′)}\max_{p\in B_\rho} J(x_T,p)-\max\{\min_x J(x,p_T),\min_x J(x,p')\}, which costs one more master solve. Over 200 runs of KL-Rec, KL-OT, KL-Gen, and KL-Gen (copula) at (ρref,ρ)=(0.2,0.05)(\rho_{\mathrm{ref}},\rho)=(0.2,0.05) and k=12k=\frac{1}{2}, the bound is small for a typical run (median 0.02 to 0.21 bn$/yr by method, under 0.7% of the objective) but not for every run (90th percentile 0.4 to 1.1 bn$/yr, and above 0.5 bn$/yr in 36 runs). Individual plans are therefore not settled, and one further step moves a run’s OOD cost by more than 0.5 bn$/yr in 100 of the 200 runs. These moves are small against the variation over seeds (median 0.5 against a seed standard deviation of 4.1 bn$/yr), and they leave the comparisons intact. Re-scored at the further step, every comparison of KL-Gen with KL-Rec, KL-OT, and KL-Gen (copula) at this radius pair keeps its sign, in and out of distribution, and KL-Gen’s out-of-distribution advantage is 15.4 bn$/yr over KL-Rec and 2.5 over KL-OT, against 18.3 and 2.4 at the reported plans.

Solver and computation. Masters are built directly in the Gurobi Python interface and solved by the Gurobi barrier method [26] on 8 threads, and the candidates’ recourse costs are evaluated in parallel on 8 cores.

Evaluation and Statistics

Scoring. The final plan of every run is scored by the objective in equation (12) with uniform weights over all ID or OOD days.

Statistics. Paired differences between methods at the same seed are summarized by their median over the five seeds, so the record is the unit of analysis: ten records at k=12k=\frac{1}{2}, five (A to E) at k=1k=1, and five five-year blocks at k=5k=5. Table 11 gives the median over records with its standard error, the standard deviation over records divided by the square root of their number, and a two-sided Wilcoxon signed-rank test.

Development. The radii, the risk weight β\beta, the marginals and smoothing of the nominals, and the construction of the base weights were chosen after comparing configurations on the ID and OOD days, which therefore served for development as well as for evaluation. The flow’s architecture and training were fixed before any plan was scored (App. § 9.§ 3), and it shares the copula’s marginals and smoothing.

Severity. A day’s severity is its system peak net load, with net load as in App. § 9.§ 2, and its peak hour is the hour of that peak. The OOD days of Figure 2 are the 20 most severe days of 2020 (42.2 to 54.3 GW), and a method’s most severe scenarios are the top 10% by severity of the scenarios it admits, 48 per run, pooled over record years and seeds at (ρref,ρ)=(0.2,0.05)(\rho_{\mathrm{ref}},\rho)=(0.2,0.05).

Figure 2(a). Each point is a setting’s median over records of the median over seeds, and a method’s frontier joins its non-dominated settings. KL-OT at δ=3\delta=3 was run at three of the five radius pairs, and W-DRO is a single point. Further radius pairs for KL-Rec and KL-OT are dominated by the KL-Gen points shown, except KL-OT at (0.2,0.02)(0.2,0.02), which is cheaper in distribution than every KL-Gen setting.

Figure 2(b). The maps show zonal wind capacity factors, standardized per zone over the day and clipped at ±2\pm2, on the most severe day of 2020 and on each method’s most severe admitted scenario over all 50 runs. Spatial coherence is the mean correlation of the 24-hour profiles over the 190 pairs of zones, over daylight hours for solar. Boxes span the interquartile range, whiskers the 10th to 90th percentiles, and the gray band is the interquartile range over the 20 OOD days.

Figure 2(c). Each day is represented by its 20 zonal net loads at its peak hour, standardized per zone over 2001–2010. The horizontal axis is peak net load relative to the median OOD day. The vertical axis is the distance to the nearest real day of 2001–2010 outside the record’s year, after the scenario’s demand is scaled so that its system net load equals that day’s, so only the spatial shape counts. Small markers are medians per record, large markers medians over records, the star the median OOD day, and the dotted lines the OOD days’ median severity and the median distance of the decade’s own most severe days. A small distance marks a shape common among real days but does not prove realism. Over the full day (24 hours of demand, wind, and solar), the most severe scenarios of KL-Gen lie 0.424 from the nearest real day of 2011–2014 and 2020, against 0.367 for real days of the same severity and 0.372 for KL-OT (δ=1\delta= 1). Compared with each OOD day, the nearest admitted scenarios of KL-Gen lie within 0.2 of the OOD days’ demand level, against 0.5 to 1.0 below for KL-OT and KL-Rec. With demand rescaled, the three methods’ shape distances are nearly the same.

Figure 2(d). Demand is system demand at the scenario’s peak hour, relative to the largest such value over the 2001–2010 days (72.6 GW), and wind is system wind output at that hour under the reference fleet. Gray points are the 2001–2010 days; some of them, and seven scenarios of KL-OT (δ=3\delta= 3), lie outside the axes.

Reported settings. KL-OT and W-DRO were also run at δ∈{0.3,3}\delta\in\{0.3, 3\}, KL-OT at four radius pairs for k≤1k \le1 and two for k=5k = 5. These settings never reach the Pareto front, so the tables report δ=1\delta= 1, and Figure 2 also shows KL-OT at δ=3\delta= 3.

Full Results

Tables 10 and 11 give the full results, in which the copula ablation is the two KL-Gen (copula) columns of Table 10 and the two KL-Gen − KL-Gen (copula) columns of Table 11. Figure 7 shows that the two radii act as designed, and Figure 8 summarizes KL-Gen’s advantage across record lengths.

Figure 7. The two radii act as designed (capacity expansion, k=12k = \frac{1}{2}). Boxes span the interquartile range over the ten records (each the median over five seeds; in (a), seeds are pooled), and whiskers the full range. (a) Share of admitted scenarios above the record’s 99th percentile of peak net load, at ρ=0\rho= 0 (dotted: the record’s own 1%). Raising ρref\rho_{\mathrm{ref}} admits more severe scenarios, in 37 of 40 (method, record) pairs. (b) Effective sample size of the worst-case weights, as a share of the admitted scenarios, at ρref=0.2\rho_{\mathrm{ref}} = 0.2. It falls as ρ\rho grows, and the realized divergence equals ρ\rho in every run. (c) Capacity added relative to ρ=0\rho= 0 (GW) at ρref=0.2\rho_{\mathrm{ref}} = 0.2, paired within record and seed. Raising ρ\rho moves capital toward the budget and changes the mix.

Figure 8. KL-Gen’s advantage across record lengths (capacity expansion). Paired cost difference (bn$/yr; negative: KL-Gen is cheaper) against (a) KL-Rec, (b) KL-OT (δ=1\delta= 1), and (c) KL-OT (δ=3\delta= 3), out of distribution (filled) and in distribution (hatched). Each record contributes the median, over the radius pairs of Table 10 at which both methods were run (all five; for δ=3\delta= 3, three at k≤1k \le1 and two at k=5k = 5), of its median over seeds. Boxes span the interquartile range over records and whiskers the full range; the numbers are two-sided Wilcoxon signed-rank pp-values over records (with five records, the smallest attainable is 0.0625). The out-of-distribution gap to KL-Rec and to KL-OT (δ=1\delta= 1) shrinks as the record grows; KL-OT (δ=3\delta= 3) narrows it at k=12k = \frac{1}{2} at a higher in-distribution cost.

Paired comparisons. Table 11 compares methods at the same radius pair (ρref,ρ)(\rho_{\mathrm{ref}}, \rho). With five records at k=1k = 1 and five blocks at k=5k = 5, no difference can reach p<0.05p < 0.05, so we report the number of records in which the first method is cheaper.

KL-Gen vs. KL-Rec. KL-Gen’s out-of-distribution cost is lower at every radius pair:

  • at k=12k = \frac{1}{2}, by 12.7–22.2 bn$/yr, in 10 of 10 records (p<0.01p < 0.01 at all five pairs);

  • at k=1k = 1, by 8.4–14.5 bn$/yr, in 5 of 5 records;

  • at k=5k = 5, by 3.8–13.8 bn$/yr, in 5 of 5 blocks.

The gap shrinks as the record grows in the median over radius pairs (Figure 8), though not at every pair. In distribution, KL-Gen is cheaper at k=12k = \frac{1}{2} (by 0.46–2.92 bn$/yr), mixed at k=1k = 1, and up to 0.73 bn$/yr more expensive at k=5k = 5.

KL-Gen vs. KL-OT. KL-Gen’s out-of-distribution cost is lower at all 15 radius pairs:

  • at k=12k = \frac{1}{2}, by 2.3–6.5 bn$/yr, in 7–9 of 10 records (p<0.05p < 0.05 at four pairs);

  • at k=1k = 1, by 0.4–1.9 bn$/yr, in 3–5 of 5 records;

  • at k=5k = 5, by 0.07–0.76 bn$/yr, in 3–4 of 5 blocks.

In distribution the two are indistinguishable at k=12k = \frac{1}{2}. At k≥1k \ge1, KL-Gen costs up to 0.45 bn$/yr more, and is cheaper in at most 3 of 5 records. At k≥1k \ge1 and the same radii, KL-Gen therefore trades a small in-distribution premium for lower out-of-distribution cost.

Ablations. The proposal variant stays within 0.65 bn$/yr of KL-Gen on both axes, and none of its ten differences at k=12k = \frac{1}{2} is significant. Out of distribution, KL-Gen and KL-Gen (copula) are within two standard errors of each other at every radius pair and kk except two pairs at k=5k = 5, where KL-Gen is cheaper (by 0.31 and 0.84 bn$/yr). In distribution, the copula is up to 0.36 bn$/yr cheaper at k≥1k \ge1, beyond two standard errors at one pair at k=1k = 1 and two at k=5k = 5. Replacing the copula with the flow thus changes out-of-distribution cost little and adds a small in-distribution premium when the record is longer.

References

  1. [2]Gah-Yi Ban and Cynthia Rudin. The Big Data Newsvendor: Practical Insights from Machine Learning. _Operations Research_, 67(1):90–108, 2019. doi: 10.1287/opre.2018.1757.DOI
  2. [3]Güzin Bayraksan and David K. Love. Data-Driven Stochastic Programming Using Phi-Divergences. In Dionne Aleman, Aurélie Thiele, J. Cole Smith, and Harvey J. Greenberg (eds.), _The Operations Research Revolution_, pp. 1–19. INFORMS, September 2015. ISBN 978-0-9843378-8-0. doi: 10.1287/educ.2015.0134. URL http://pubsonline.informs.org/doi/10.1287/educ.2015.0134.DOI
  3. [4]Aharon Ben-Tal, Dick den Hertog, Anja De Waegenaere, Bertrand Melengberg, and Gijs Ren-nen. Robust Solutions of Optimization Problems Affected by Uncertain Probabilities. _Management Science_, 59(2):341–357, February 2013. doi: 10.1287/mnsc.1120.1641. URL https://pubsonline.informs.org/doi/10.1287/mnsc.1120.1641.
  4. [5]John R. Birge and François Louveaux. _Introduction to Stochastic Programming_. Springer, second edition, 2011. doi: 10.1007/978-1-4614-0237-4.DOI
  5. [6]Jose Blanchet and Henry Lam. Rare event simulation techniques. In S. Jain, R. R. Creasey, J. Himmelspach, K. P. White, and M. Fu (eds.), _Proceedings of the 2011 Winter Simulation Conference_, pp. 146–160, 2011. doi: 10.1109/WSC.2011.6147747.DOI
  6. [7]Jose Blanchet, Yang Kang, Karthyek Murthy, and Fan Zhang. Data-driven optimal transport cost selection for distributionally robust optimization. In _Proceedings of the Winter Simulation Conference_, pp. 3740–3751, 2019. doi: 10.1109/WSC40007.2019.9004785.DOI
  7. [8]Younes Boulaguiem, Jakob Zscheischler, Edoardo Vignotto, Karin van der Wiel, and Sebastian Engelke. Modeling and simulating spatial extremes by combining extreme value theory with generative adversarial networks. _Environmental Data Science_, 1:e5, 2022. doi: 10.1017/eds.2022.4.DOI
  8. [9]Cameron Bracken, Travis Thurber, and Nathalie Voisin. Hourly wind and solar generation profiles at 1/8th degree resolution, 2023. URL https://zenodo.org/records/10214348. Dataset.
  9. [10]Aron Brenner, Rahman Khorramfar, Jennifer Z. Sun, and Saurabh Amin. A deep generative learning approach for two-stage adaptive robust optimization. In _International Conference on Learning Representations_, 2025.arxiv.org/abs/2409.03731
  10. [11]Mónica F. Bugallo, Víctor Elvira, Luca Martino, David Luengo, Joaquín Míguez, and Petar M. Djurić. Adaptive importance sampling: The past, the present, and the future. _IEEE Signal Processing Magazine_, 34(4):60–79, 2017. doi: 10.1109/MSP.2017.2699226.DOI
  11. [12]Kai Chang and Themistoklis P. Sapsis. Extreme event aware (η−) learning. _Nature Communications_, 17:9919, 2026. doi: 10.1038/s41467-026-76811-x. arXiv:2510.19161.DOI
  12. [13]Yize Chen, Yishen Wang, Daniel Kirschen, and Baosen Zhang. Model-free renewable scenario generation using generative adversarial networks. _IEEE Transactions on Power Systems_, 33(3):3265–3275, 2018.
  13. [14]Xiuyuan Cheng, Yao Xie, Linglingzhi Zhu, and Yunqin Zhu. Worst-case generation via minimax optimization in Wasserstein space, December 2025. URL http://arxiv.org/abs/2512.08176. arXiv:2512.08176 [stat].
  14. [15]Paul G. Constantine. _Active Subspaces: Emerging Ideas for Dimension Reduction in Parameter Studies_. Society for Industrial and Applied Mathematics, 2015. doi: 10.1137/1.9781611973860.DOI
  15. [16]Thomas M. Cover and Joy A. Thomas. _Elements of Information Theory_. Wiley, 2nd edition, 2006.
  16. [17]George B. Dantzig and Peter W. Glynn. Parallel processors for planning under uncertainty. _Annals of Operations Research_, 22:1–21, 1990. doi: 10.1007/BF02023045.DOI
  17. [18]Erick Delage and Yinyu Ye. Distributionally Robust Optimization Under Moment Uncertainty with Application to Data-Driven Problems. _Operations Research_, 58(3):595–612, 2010. doi: 10.1287/opre.1090.0741.DOI
  18. [19]Charita Dellaporta, Patrick O’Hara, and Theodoros Damoulas. Decision making under the exponential family: Distributionally robust optimisation with Bayesian ambiguity sets. In Proceedings of the 42nd International Conference on Machine Learning, 2025.arxiv.org/abs/2411.16829
  19. [20]Laurent Dinh, Jascha Sohl-Dickstein, and Samy Bengio. Density estimation using Real NVP. In International Conference on Learning Representations, 2017. URL https://openreview.net/forum?id=Hkpb nH9lx.arxiv.org/abs/1605.08803
  20. [21]John C. Duchi, Peter W. Glynn, and Hongseok Namkoong. Statistics of robust optimization: A generalized empirical likelihood approach. Mathematics of Operations Research, 46(3):946–969, 2021. doi: 10.1287/moor.2020.1085.DOI
  21. [22]J. Dupačová, N. Gröwe-Kuska, and W. Römisch. Scenario reduction in stochastic programming. Mathematical Programming, 95(3):493–511, March 2003. doi: 10.1007/s10107-002-0331-0. URL http://link.springer.com/10.1007/s10107-002-0331-0.
  22. [23]Jamie Fairbrother, Amanda Turner, and Stein W. Wallace. Problem-driven scenario generation: an analytical approach for stochastic programs with tail risk measure. Mathematical Programming, 191(1):141–182, January 2022. doi: 10.1007/s10107-019-01451-7. URL https://link.springer.com/10.1007/s10107-019-01451-7.
  23. [24]Rui Gao and Anton Kleywegt. Distributionally Robust Stochastic Optimization with Wasserstein Distance. Mathematics of Operations Research, 48(2):603–655, 2023. doi: 10.1287/moor.2022.1275.DOI
  24. [25]Paul J. Goulart and Yuwen Chen. Clarabel: An interior-point solver for conic programs with quadratic objectives, 2024. URL https://arxiv.org/abs/2405.12762.
  25. [26]Gurobi Optimization, LLC. Gurobi Optimizer Reference Manual, 2026. URL https://www.gurobi.com.
  26. [27]Grani A. Hanasusanto, Daniel Kuhn, Stein W. Wallace, and Steve Zymler. Distributionally robust multi-item newsvendor problems with multimodal demand distributions. Mathematical Programming, 152(1-2):1–32, 2015. doi: 10.1007/s10107-014-0776-y.DOI
  27. [28]Holger Heitsch and Werner Römisch. Scenario Reduction Algorithms in Stochastic Programming. Computational Optimization and Applications, 24(2–3):187–206, February 2003. doi: 10.1023/A:1021805924152. URL https://doi.org/10.1023/A:1021805924152.
  28. [29]Mike Hewitt, Janosch Ortmann, and Walter Rei. Decision-based scenario clustering for decision-making under uncertainty. Annals of Operations Research, 315(2):747–771, August 2022. doi: 10.1007/s10479-020-03843-x. URL https://link.springer.com/10.1007/s10479-020-03843-x.DOI
  29. [30]Zhaolin Hu and L. Jeff Hong. Kullback-Leibler divergence constrained distributionally robust optimization. Optimization Online, 2013. URL https://optimization-online.org/?p=12225.
  30. [31]Kjetil Høyland, Michal Kaut, and Stein W. Wallace. A Heuristic for Moment-matching Scenario Generation. Computational Optimization and Applications, 24(2–3):169–185, 2003. doi: 10.1023/A:1021853807313.DOI
  31. [32]Gerd Infanger. Monte Carlo (importance) sampling within a Benders decomposition algorithm for stochastic linear programs. Annals of Operations Research, 39(1):69–95, December 1992. doi: 10.1007/BF02060936. URL http://link.springer.com/10.1007/BF02060936.DOI
  32. [33]David Islip, Roy H. Kwon, Sanghyeon Bae, and Woo Chang Kim. Contextual scenario generation for two-stage stochastic programming, 2025. URL https://arxiv.org/abs/2502.05349.
  33. [34]Priyank Jaini, Ivan Kobyzev, Yaoliang Yu, and Marcus Brubaker. Tails of Lipschitz triangular flows. In Proceedings of the 37th International Conference on Machine Learning, 2020.arxiv.org/abs/1907.04481
  34. [35]Congmei Jiang, Yongfang Mao, Yi Chai, Mingbiao Yu, and Songbing Tao. Scenario generation for wind power using improved generative adversarial networks. IEEE Access, 6:62193–62203, 2018. doi: 10.1109/ACCESS.2018.2875936.DOI
  35. [36]Julien Keutchayan, Janosch Ortmann, and Walter Rei. Problem-driven scenario clustering in stochastic optimization. Computational Management Science, 20(1):13, December 2023. doi: 10.1007/s10287-023-00446-2. URL https://link.springer.com/10.1007/s10287-023-00446-2.DOI
  36. [37]Heasung Kim, Taekyun Lee, Hyeji Kim, and Gustavo de Veciana. Generating Informative Samples for Risk-Averse Fine-Tuning of Downstream Tasks. In Advances in Neural Information Processing Systems, 2025.DOI
  37. [38]Daniel Kuhn, Soroosh Shafiee, and Wolfram Wiesemann. Distributionally robust optimization. Acta Numerica, 34:579–804, 2025. doi: 10.1017/S0962492924000084.DOI
  38. [39]Mike Laszkiewicz, Johannes Lederer, and Asja Fischer. Marginal tail-adaptive normalizing flows. In Proceedings of the 39th International Conference on Machine Learning, 2022.arxiv.org/abs/2206.10311
  39. [40]Jiashuo Liu, Jiayun Wu, Bo Li, and Peng Cui. Distributionally robust optimization with data geometry. In Advances in Neural Information Processing Systems, volume 35, 2022.DOI
  40. [41]Casey R. McGrath, Casey D. Burleyson, Zarrar Khan, Aowabin Rahman, Travis Thurber, Chris R. Vernon, Nathalie Voisin, and Jennie S. Rice. tell: a Python package to model future total electricity loads in the United States. Journal of Open Source Software, 7(79):4472, 2022. doi: 10.21105/joss.04472.DOI
  41. [42]Paul Michel, Tatsunori Hashimoto, and Graham Neubig. Modeling the second player in distributionally robust optimization. In International Conference on Learning Representations, 2021.arxiv.org/abs/2103.10282
  42. [43]Brian Mirletz, Laura Vimmerstedt, Tyler Stehly, Dana Stright, Stuart Cohen, Wesley Cole, Patrick Duffy, David Feldman, Parthiv Kurup, Vignesh Ramasamy, Jarett Zuboy, Gbadebo Oladosu, Jeffrey Hoffmann, Annika Eberle, Owen Roberts, Daniel Mulas Hernando, Greg Avery, Evan Rosenlieb, Anna Schleifer, Dayo Akindipe, Eric Witter, Becca Fuchs, Gabriel Zuckerman, Alex Zolan, Abdalla Abou Jaoude, Levi Larson, Chris Lohse, Nahuel Guaita, Ishita Trivedi, Fred Jesock, Ty Hedalen, Ben Rakov, and Ashok Sekar. 2024 Annual Technology Baseline (ATB) Cost and Performance Data for Electricity Generation Technologies. Technical Report 6006, DOE Open Energy Data Initiative (OEDI); National Renewable Energy Laboratory (NREL), June 2024. URL https://www.osti.gov/biblio/2377191.DOI
  43. [44]Peyman Mohajerin Esfahani and Daniel Kuhn. Data-driven distributionally robust optimization using the Wasserstein metric: performance guarantees and tractable reformulations. Mathematical Programming, 171(1-2):115–166, September 2018. doi: 10.1007/s10107-017-1172-1. URL http://link.springer.com/10.1007/s10107-017-1172-1.
  44. [45]Kushagra Pandey, Jaideep Pathak, Yilun Xu, Stephan Mandt, Michael Pritchard, Arash Vahdat, and Morteza Mardani. Heavy-tailed diffusion models. In International Conference on Learning Representations, 2025.arxiv.org/abs/2410.14171
  45. [46]Panos Parpas, Berk Ustun, Mort Webster, and Quang Kha Tran. Importance Sampling in Stochastic Programming: A Markov Chain Monte Carlo Approach. INFORMS Journal on Computing, 27(2):358–377, 2015. doi: 10.1287/ijoc.2014.0630.DOI
  46. [47]R. Tyrrell Rockafellar and Stanislav Uryasev. Optimization of conditional value-at-risk. Journal of Risk, 2(3):21–41, 2000.DOI
  47. [48]Reuven Y. Rubinstein and Dirk P. Kroese. The Cross-Entropy Method: A Unified Approach to Combinatorial Optimization, Monte-Carlo Simulation, and Machine Learning. Springer, New York, 2004.
  48. [49]Herbert Scarf. A min-max solution of an inventory problem. In Kenneth J. Arrow, Samuel Karlin, and Herbert Scarf (eds.), Studies in the Mathematical Theory of Inventory and Production, pp. 201–209. Stanford University Press, 1958.

Paper details

vlnc:W_xdhkkm6d
Version
v1 · latest
Published
Fresh — added to the Hub within the last 30 days
Added
License
CC BY 4.0
Usage

views · 0

downloads · 0

A view counts once per browser per day, a download each time the PDF is requested.

  • Engineering

Claude Code

View statement
Looking for related papers…
Contents