betaFeedback

WorksComputer Science

Multimodal Spatiotemporal Atmospheric Data Assimilation with Latent Video Flow-matching

Abstract

Data assimilation (DA) uses Bayesian inference to update the state of a numerical forecast model with observed data. In this study, we propose a fundamentally different, unified approach to atmospheric data assimilation. We use latent video flow-matching to sample temporally consistent trajectories from a prior trained using ERA5 reanalysis (69 variables over an 8-day window). We also use posterior sampling to assimilate real observation sources, such as those from the NOAA Integrated Global Radiosonde Archive and the Integrated Surface Database. Because the prior generates a continuous trajectory, it naturally propagates information between observed and unobserved frames. Therefore, we can perform various DA tasks, such as filtering and smoothing, simply by changing the observed frames. Moreover, we generate full-state ensemble forecasts directly from sparse observations, achieving performance competitive with state-of-the-art observation-to-forecast models.

Introduction

Earth’s atmospheric dynamics span a wide range of spatial and temporal scales [1, 2, 3]. Forecasting such a system is difficult because it can only be simulated approximately and requires accurate initial conditions. However, atmospheric states can only be partially observed using specialized instruments [4, 5]. This creates a need for data and model fusion, in which first-principles numerical models provide a prior (background) state that is updated given partial observations through a Bayesian formulation [6, 7]. This update, known as data assimilation (DA), is central to modern weather prediction and underpins reanalysis products such as ERA5 [8]. However, these classical variational and ensemble methods [9, 10, 11] are computationally expensive and require several iterations of expensive numerical models.

Generative machine learning [12, 13] offers an alternative [14]. Instead of re-running a numerical model, one learns an implicit probability density of the atmospheric state from which new samples can be drawn, and conditions that density in real time on sparse observations. Diffusion models [15, 16, 17] learn such densities by corrupting data with noise through a forward stochastic process and learning the score (the gradient of the log-probability density), so that the reverse process can iteratively denoise pure noise into samples from the data distribution. Flow-matching [18] is an adjacent method that learns a velocity field, which is used to directly interpolate from noise to the data distribution. Recent advances in the computer vision community have shown that flow-matching techniques have an edge over previous methods in high-dimensional generative tasks [19]. A trained generative model also enables zero-shot conditioning: the pretrained unconditional prior can be guided by sparse observations without retraining [16, 20, 21]. This is effectively equivalent to sampling from the posterior distribution.

Previous work has demonstrated this for ERA5 snapshots, combining coarse-grid fields, NOAA Integrated Global Radiosonde Archive (IGRA) data, and a climate emulator for super-resolution and multimodal reconstruction [22]. There, temporal consistency came only from conditioning on the output of a separate emulator. In this work, temporal propagation is internal to the prior itself. This has two consequences that are absent in a single snapshot generation setting. First, the prior inherently propagates information from observed frames to unobserved frames, removing the need for a separate emulator or numerical forecast model. Second, different classical DA regimes are accurately recovered simply by choosing which frames (or data) are observed. The frames here refer to the individual timesteps in the video. We summarize our contributions as follows.

  1. We train an unconditional latent video flow-matching prior (TrigFlow [23] with a 3D diffusion-transformer backbone [24]) that generates a 32-frame (8-day, 6-hourly) window of the global atmosphere for 69 ERA5 variables. This serves as a background model for a wide range of data-assimilation experiments without any retraining or observation-specific conditioning.

  1. On the methods side, we adopt an adaptive noise-level weighting for the TrigFlow loss. We also explore a broad set of guided-sampler designs, utilizing low-noise-level correctors and gradient (and noise) rescaling techniques for both efficiency and accuracy.

  1. On the experimental side, we recover the full atmospheric state from both structured coarse observations and real observations from the NOAA Integrated Global Radiosonde Archive (IGRA) [25], the NOAA Integrated Surface Database (ISD) [26], and the International Comprehensive Ocean-Atmosphere Data Set (ICOADS) [27]. We use these to realize the three classical DA regimes (filtering, smoothing, and fixed-interval reconstruction) from the same prior by changing only which frames are observed. We further use the prior for direct observation-to-forecast, producing a forecast competitive with some prior observation-to-forecast models (GraphDOP [28]). Finally, we study its behavior in a particular case, Hurricane Laura (2020).

Our results indicate that latent video flow-matching priors can perform accurate multimodal spatiotemporal DA from multiple real data sources, with uncertainty quantification through the spread of posterior draws. An end-to-end comparison with operational assimilation is beyond our scope. The codes used in the work are in https://github.com/ISCLPurdue/era5_videogen.

Related work

Deep learning has produced strong results in reconstructing the state of high-dimensional multiscale dynamical systems [29, 30, 31, 32, 33, 34, 35]. Specifically, Graph Neural Networks (GNNs) or Voronoi-tessellation-assisted methods have been used for reconstruction from unstructured sensor measurements [36, 37]. Most of these demonstrations, however, rely on coarse grids extracted from the fine state, so inputs and targets come from the same dataset. Additionally, they require retraining when the observation source changes, and, being deterministic, lack uncertainty quantification (UQ). Probabilistic networks [38], deep ensembles [39], and stochastic weight averaging [40, 41] provide UQ at the cost of restrictive assumptions or increased computation, which motivates generative priors.

Score-based diffusion models are now the dominant generative models for physical systems, beginning with diffusion probabilistic models [42, 43] and score-based generative models [44] (building on score matching [45]), unified through stochastic differential equations [16] and refined by the EDM design space exploration [17]. Flow-matching [18, 46, 47] uses a different construction, prescribing an interpolation path from noise to the data distribution directly rather than reversing a noising process. These priors solve inverse problems in a zero-shot, plug-and-play manner through gradient guidance (DPS [21], NIGDM [48]), range-null-space methods (DDNM [49], DDNM [50]), variational and variable-splitting solvers (RED-diff [51], DiffPIR [52], PnP-DM [53], DAPS [54]), and latent-space variants [55, 56]. The InverseBench benchmark [57] compares many of these. We also re-implement some of these methods on our prior in App. A.5. In atmospheric applications, they have been applied for downscaling and super-resolution [58, 59, 60], probabilistic forecasting [61, 14, 62], and data assimilation [63, 64, 65, 66, 67, 68, 69]. Similar to us, Qu et al. [66] target a multimodal setting, and Liang et al. [69] and Bao et al. [68] pursue score-based filtering, but on single-time or lower-dimensional states rather than a latent video trajectory of the full ERA5 state. SEEDS [61] generates skillful forecast ensembles cheaply but emulates an ensemble rather than assimilating observations. Manshausen et al. [64] assimilate sparse station data from a single source on a single snapshot, while we assimilate several independently sourced observations over an 8-day trajectory and infer the full vertical column of the atmosphere.

Spatiotemporal diffusion priors for scientific video inverse problems [70] and Appa Weather [71] are the closest to our work, and we differ from each as follows. STeP [70] performs spatiotemporal latent posterior sampling but is evaluated on simulated observations. Similarly, Appa uses a latent diffusion prior and synthetic observations for global data assimilation and forecasting. Here, we use real observations to perform various data-assimilation tasks and show over three weeks of competitive forecast performance directly from observations.

Methods

A high-level view of the full methodology is given in the schematic of Figure 1: an autoencoder compresses spatiotemporal ERA5 data into a latent video, a TrigFlow prior is trained on those latents, and at sampling time the learned prior is combined with an observation likelihood to draw posterior samples. The subsections below describe each ingredient in turn.

Overview of the proposed method

Figure 1. Overview of the proposed method. An autoencoder (E,D\mathcal{E},\mathcal{D}) compresses 8-day (32 timesteps) ERA5 windows (69 variables at 128×256128 \times256 grid) into a latent video z∈R128×8×32×64\mathbf{z} \in\mathbb{R}^{128 \times8 \times32 \times64}. The TrigFlow prior FF is trained by velocity matching along the spherical noising path zt=cos⁡t z0+sin⁡t ϵ\mathbf{z}_t = \cos t\,\mathbf{z}_0 + \sin t\,\boldsymbol{\epsilon}. From approximately pure noise, NN guided steps sample the posterior: each step decodes the latent Tweedie estimate z^0\hat{\mathbf{z}}_0, scores it against the observations y\mathbf{y} through the measurement operator AA, and injects the guidance term ℓ\ell into the update, with the annealed likelihood variance σlik2\sigma_{\mathrm{lik}}^2 weakening guidance at high noise. D\mathcal{D} and FF stay frozen while sampling, so a single pretrained prior serves every assimilation task in this paper zero-shot. Note: The latent video looks like Gaussian noise visually; however, it has some small structures that the decoder can decode successfully.

Autoencoder.

We train a 3D-convolutional autoencoder (AE) (E,D\mathcal{E},\mathcal{D}) to compress the ERA5 data x\mathbf{x} to a latent representation z\mathbf{z} for faster training and sampling. The decoder D\mathcal{D} maps the latent back to the 69 standardized ERA5 variables at T=32T=32, H=128H=128, and W=256W=256. The autoencoder has a 4×4\times temporal and 4×4\times spatial compression (each direction) for the latent grid. The generative prior is trained on the latents of the autoencoder (similar to a video) of shape (C=128,T=8,H=32,W=64)(C=128,T=8,H=32,W=64). Because likelihoods are evaluated in the physical field space, guidance passes through the decoder as in latent-diffusion inverse solvers [55, 56].

Generative modeling

Flow-matching. Flow-matching [18, 47] prescribes an interpolation path xt=αtx0+βtϵ\mathbf{x}_t = \alpha_t \mathbf{x}_0 + \beta_t \boldsymbol{\epsilon} between data and Gaussian noise. The network is trained to regress the velocity dxt/dt\mathrm{d}\mathbf{x}_t/\mathrm{d}t along that path. During sampling, new samples are generated by simulating the ordinary differential equation (ODE) dxt=vθ(xt,t) dt\mathrm{d}\mathbf{x}_t = v_\theta(\mathbf{x}_t,t)\,\mathrm{d}t from t=Tt=T (pure noise) to t=0t=0. Various flow models correspond to particular choices of schedule (αt,βt)(\alpha_t,\beta_t).

TrigFlow. The TrigFlow parameterization [23] is a flow-matching formulation whose interpolation between data and noise is spherical. Our prior is trained not on the ERA5 fields (x\mathbf{x}) themselves but on the latent z\mathbf{z} of an autoencoder. The forward interpolation path for the noise is defined as:

zt=cos⁡(t) z0+sin⁡(t) ϵ,ϵ∼N(0,σd2I),t∈(0,π2).(1)\mathbf{z}_t = \cos(t)\,\mathbf{z}_0 + \sin(t)\,\boldsymbol{\epsilon}, \qquad\boldsymbol{\epsilon} \sim\mathcal{N}(0,\sigma_d^2 I), \quad t \in\left(0,\frac{\pi}{2}\right). \tag*{(1)}

We fix σd=1\sigma_d=1 throughout. Differentiating Eq. (1) with respect to time gives the target velocity dzt/dt=−sin⁡(t) z0+cos⁡(t) εd z_t/dt=-\sin(t)\,z_0+\cos(t)\,\varepsilon. A neural network F(zt/σd,t)F(z_t/\sigma_d,t), here a 3D diffusion transformer (DiT3D [24]), is trained so that σdF(zt/σd,t)≈dzt/dt\sigma_d F(z_t/\sigma_d,t)\approx d z_t/dt. At the optimum of the training loss, the learned velocity yields an estimate of the clean latent, which coincides with the Tweedie (minimum mean squared error) estimate [72],

z^0=cos⁡(t) zt−sin⁡(t) σdF(zt/σd,t).(2)\hat{z}_0=\cos(t)\,z_t-\sin(t)\,\sigma_d F(z_t/\sigma_d,t). \tag*{(2)}

Sampling integrates the ODE dxt=vθ(xt,t)dtd x_t=v_\theta(x_t,t)dt from tmax⁡=arctan⁡(σmax⁡/σd)t_{\max}=\arctan(\sigma_{\max}/\sigma_d) (approximately pure noise) to t=0t=0 (data).

Adaptive noise-level weighting. The baseline flow model is trained to match the velocity by minimizing the expected squared error:

L(θ)=Ez0,ε,t[∥σdF(zt/σd,t;θ)−dztdt∥2].(3)\mathcal{L}(\theta)=\mathbb{E}_{z_0,\varepsilon,t}\left[\left\lVert\sigma_d F(z_t/\sigma_d,t;\theta)-\frac{d z_t}{d t}\right\rVert^2\right]. \tag*{(3)}

The velocity target contains the noise ε\varepsilon, so the regression has a tt-dependent irreducible variance. Since no network can predict the specific noise component, the loss floor is disproportionately large at certain noise levels. Under a fixed weighting, high noise levels dominate the gradient, which hampers learning. We therefore utilize an adaptive uncertainty weighting [73], where the network additionally predicts a scalar log-variance u(t)u(t) through a small linear head on its noise-level embedding. The loss is formulated as the maximum-likelihood objective for a Gaussian error model with level-dependent variance:

L(θ)=E[e−u(t)∥σdF(zt/σd,t;θ)−dztdt∥2+u(t)].(4)\mathcal{L}(\theta)=\mathbb{E}\left[e^{-u(t)}\left\lVert\sigma_d F(z_t/\sigma_d,t;\theta)-\frac{d z_t}{d t}\right\rVert^2+u(t)\right]. \tag*{(4)}

At the optimum, this objective sets eu(t)e^{u(t)} to the expected squared error at level tt, ensuring that every noise level contributes gradients of comparable magnitude regardless of its floor. Training noise levels are drawn from a log-normal distribution centered on the data scale, ln⁡σ∼N(0,1.52)\ln\sigma\sim\mathcal{N}(0,1.5^2) with σ=tan⁡t\sigma=\tan t. The uu head is discarded at inference, so sampling is unaffected.

Posterior sampling and data fusion. To sample the posterior p(x∣y)p(x\mid y) we draw latents from p(z∣y)p(z\mid y) and decode them, utilizing Bayes’ theorem to combine the pretrained unconditional prior with a measurement likelihood. The posterior score is the sum of the prior and likelihood scores,

∇ztlog⁡p(zt∣y)=∇ztlog⁡p(zt)+∇ztlog⁡p(y∣zt),(5)\nabla_{z_t}\log p(z_t\mid y)=\nabla_{z_t}\log p(z_t)+\nabla_{z_t}\log p(y\mid z_t), \tag*{(5)}

structurally analogous to classifier guidance [74]. For a differentiable measurement operator AA and Gaussian observation noise with standard deviation σy\sigma_y, DPS [21] evaluates the likelihood at the Tweedie estimate z^0\hat{z}_0,

log⁡p(y∣zt)≈−12σlik2(σ)∥y−A(D(z^0))∥2,(6)\log p(y\mid z_t)\approx-\frac{1}{2\sigma_{\mathrm{lik}}^2(\sigma)}\left\lVert y-A(D(\hat{z}_0))\right\rVert^2, \tag*{(6)}

and score-based data assimilation (SDA) [75] accounts for the variance of z^0\hat{z}_0 through an annealed likelihood variance,

σlik2(σ)=σy2+γ(σ/σd)2,(7)\sigma_{\mathrm{lik}}^2(\sigma)=\sigma_y^2+\gamma\left(\sigma/\sigma_d\right)^2, \tag*{(7)}

where γ\gamma is the SDA annealing coefficient and σd\sigma_d is the latent data scale (fixed to 1 here, so σ/σd=σ\sigma/\sigma_d=\sigma is the running noise level while sampling). This is used to automatically weaken guidance at high noise levels.

Guided TrigFlow sampler

All sampling methods in this article are built on our guided TrigFlow sampler (Algorithm 1), which combines three base techniques. First, it uses the Elucidating Diffusion Model (EDM) noise schedule [17], with each noise level mapped to a TrigFlow angle through t=arctan⁡(σ/σd)t=\arctan(\sigma/\sigma_d). Second, it advances the state with the DPM-Solver++ update [76], which in TrigFlow coordinates is a rotation (the second-order coefficient is derived in Appendix § 7.§ 1). Third, at every step it adds DPS-style measurement guidance with SDA annealing.

The sampler has an option to follow a predictor-corrector structure [16]. The guided rotation acts as the predictor: it transports the sample from one noise level to the next, with the guidance term bending the trajectory toward measurement consistency. However, since the error of this predictor step is carried to the next level, a Langevin corrector (Algorithm 2) holds the noise level fixed and takes one Langevin step toward the intermediate posterior p(zt∣y)∝p(zt) p(y∣zt)p(z_t\mid y)\propto p(z_t)\,p(y\mid z_t), using a fresh denoiser evaluation and a fresh likelihood gradient. Since each corrector step costs one extra denoiser evaluation, we apply it only below a threshold σmax⁡c\sigma_{\max}^{c}, where the Tweedie estimate is sharp and measurement fidelity is actually established (Sec. 2.3.1).

Algorithm 1: Guided TrigFlow sampler. Tunable options and their defaults are described in § 2.3.

input: measurement yy, steps NN, σd=1\sigma_d=1, scale; angles t0>…>tN=0t_0>\ldots>t_N=0 at σ\sigma levels, tk=arctan⁡(σk/σd)t_k=\arctan(\sigma_k/\sigma_d); clip⁡(⋅)\operatorname{clip}(\cdot) is the elementwise clip to [−1,1][-1,1] (used in all runs)

  1. zt←σd⋅εz_t\leftarrow\sigma_d\cdot\varepsilon, ε∼N(0,I)\varepsilon\sim\mathcal{N}(0,I); z^0prev←∅\hat{z}^{\mathrm{prev}}_0\leftarrow\varnothing; ℓm←0\ell^m\leftarrow0;

  2. for k=0,…,N−1k=0,\ldots,N-1 do

  3. s←tks\leftarrow t_k, t←tk+1t\leftarrow t_{k+1}, δ←s−t\delta\leftarrow s-t, σ←σdtan⁡s\sigma\leftarrow\sigma_d\tan s;

  4. Fs←F(zt/σd,s)F_s\leftarrow F(z_t/\sigma_d,s); // denoiser velocity

  5. z^0←cos⁡(s)zt−sin⁡(s)σdFs\hat{z}_0\leftarrow\cos(s)z_t-\sin(s)\sigma_dF_s; // Tweedie estimate, Eq. (2)

  6. if σmin⁡g≤σ≤σmax⁡g\sigma^g_{\min}\leq\sigma\leq\sigma^g_{\max} then

  7. g←∇zt[−12σlik2∥y−A(D(z^0))∥2]g\leftarrow\nabla_{z_t}\left[-\frac{1}{2\sigma_{\mathrm{lik}}^2}\lVert y-A(\mathcal{D}(\hat{z}_0))\rVert^2\right]; // backprop through D\mathcal{D} and FF

  8. ℓ←scale⋅σ⋅clip⁡(g)\ell\leftarrow\textit{scale}\cdot\sigma\cdot\operatorname{clip}(g) or scale⋅σ⋅clip⁡(ng/∥g∥2)\textit{scale}\cdot\sigma\cdot\operatorname{clip}(\sqrt{n}g/\lVert g\rVert_2) under DSG; // n=CTHWn=CTHW

  9. ℓ←ℓ+mℓm\ell\leftarrow\ell+m\ell^m; ℓm←ℓ\ell^m\leftarrow\ell; // momentum on the scaled score

  10. else

  11. ℓ←0\ell\leftarrow0; // guidance band gate

  12. z(1)←cos⁡(δ)zt−sin⁡(δ)σdFsz^{(1)}\leftarrow\cos(\delta)z_t-\sin(\delta)\sigma_dF_s; // 1st-order rotation

  13. if 0<k<N−10<k<N-1 and z^0prev≠∅\hat{z}^{\mathrm{prev}}_0\neq\varnothing then

  14. r←(log⁡tan⁡s−log⁡tan⁡tprev)/(log⁡tan⁡s−log⁡tan⁡t)r\leftarrow(\log\tan s-\log\tan t_{\mathrm{prev}})/(\log\tan s-\log\tan t);

  15. znext←z(1)+sin⁡δ2rsin⁡s(z^0prev−z^0)z_{\mathrm{next}}\leftarrow z^{(1)}+\frac{\sin\delta}{2r\sin s}(\hat{z}^{\mathrm{prev}}_0-\hat{z}_0); // 2nd-order

  16. else

  17. znext←z(1)z_{\mathrm{next}}\leftarrow z^{(1)}

  18. znext←znext+sin⁡(δ)σdℓz_{\mathrm{next}}\leftarrow z_{\mathrm{next}}+\sin(\delta)\sigma_d\ell; // inject guidance, F→F−ℓF\to F-\ell

  19. z^0prev←z^0\hat{z}^{\mathrm{prev}}_0\leftarrow\hat{z}_0;

  20. if corrector and k<N−1k<N-1 and σdtan⁡t≤σmax⁡c\sigma_d\tan t\leq\sigma^c_{\max} then

  21. znext←LANGEVINCORRECTOR⁡(znext,t)z_{\mathrm{next}}\leftarrow\operatorname{LANGEVINCORRECTOR}(z_{\mathrm{next}},t); // Alg. 2

  22. z^0prev←∅\hat{z}^{\mathrm{prev}}_0\leftarrow\varnothing; // 2nd-order unused for next step

  23. tprev←st_{\mathrm{prev}}\leftarrow s; zt←znextz_t\leftarrow z_{\mathrm{next}};

output: ztz_t

Algorithm 2: LANGEVINCorrector(z,sz,s): one SDA-style Langevin step at angle ss toward the posterior score.

  1. Fˉ←F(z/σd,s)\bar{F}\leftarrow F(z/\sigma_d,s); z^0←cos⁡s z−sin⁡s σdF\hat{z}_0\leftarrow\cos s\,z-\sin s\,\sigma_dF; // σ=σdtan⁡s\sigma=\sigma_d\tan s

  2. g←∇z[−12σlik2∥y−A(D(z^0))∥2]g\leftarrow\nabla_z\left[-\frac{1}{2\sigma_{\mathrm{lik}}^2}\lVert y-A(\mathcal{D}(\hat{z}_0))\rVert^2\right]; ℓ←scale⋅σclip⁡(g)\ell\leftarrow\textit{scale}\cdot\sigma\operatorname{clip}(g); // clip/DSG as in Alg. 1; no momentum

  3. spri←(cos⁡s z^0−z)/(sin⁡2s σd2)s_{\mathrm{pri}}\leftarrow(\cos s\,\hat{z}_0-z)/(\sin^2s\,\sigma_d^2); // prior score

  4. slik←ℓ/(σdtan⁡s)s_{\mathrm{lik}}\leftarrow\ell/(\sigma_d\tan s); // likelihood score

  5. η←(snr⁡⋅sin⁡s σd)2\eta\leftarrow(\operatorname{snr}\cdot\sin s\,\sigma_d)^2;

  6. z←z+η(spri+slik)+λ2η εz\leftarrow z+\eta(s_{\mathrm{pri}}+s_{\mathrm{lik}})+\lambda\sqrt{2\eta}\,\varepsilon, ε∼N(0,I)\varepsilon\sim\mathcal{N}(0,I); // λ=1\lambda=1: sample; λ→0\lambda\to0: mode-seeking

output: zz

Design choices

We have the following tunable options in our sampler.

  • scale: guidance scale (the strength of the likelihood gradient);

  • [σmin⁡g,σmax⁡g][\sigma^g_{\min},\sigma^g_{\max}]: guidance band, outside which no guidance is applied;

  • mm: momentum decay on the guidance term;

  • DSG: normalization of the guidance gradient;

  • λ,σmax⁡c\lambda,\sigma^c_{\max}: noise scale and activation threshold of the Langevin corrector.

We highlight the following designs which are combinations of the above choices. Table 1 mentions them with their design choice settings and Number of Function Evaluations (NFE). Extended reasoning behind these designs is given in Appendix § 7.§ 1. All the hyperparameters have been tuned using the ablation studies in Appendix § 7. The DPS mentioned in the rest of the paper is DPS with the annealed likelihood variance of Eq. (7).

Samplersteps NNcorrectormmλ\lambdaDSGNFE
DPS50-0--50
+mom0.550-0.5--50
+corr50σ<3\sigma<301-76
+corr+λ\lambda050σ<3\sigma<300-76
+corr+λ\lambda0+mom50σ<3\sigma<30.30-76
+corr+DSG50σ<3\sigma<301✓76
+corr+DSG+λ\lambda050σ<3\sigma<300✓76
+corr(all σ\sigma)50all σ\sigma01-99
+corr(all σ\sigma)+λ\lambda050all σ\sigma00-99
+corr(all σ\sigma)+λ\lambda0+mom50all σ\sigma0.30-99
+corr (N25)25σ<3\sigma<301-38
+corr (N30)30σ<5\sigma<501-47
+corr (N30)+λ\lambda030σ<5\sigma<500-47

Table 1. Configuration of sampler variants used in the results, expressed as the switches of Algs. 1 and 2 hyperparameters: solver steps NN, corrector gate σmax⁡c\sigma_{\max}^{c}, momentum mm, corrector noise scale λ\lambda, and DSG normalization. NFE = solver steps + corrector evaluations. Tags are cumulative additions to the DPS baseline; (N25)/(N30) denote reduced-step variants and (all σ\sigma) an ungated corrector.

Low noise level correction. Every solver step and every corrector step costs one denoiser forward pass, plus one backward pass when guidance is active. At high σ\sigma the Tweedie estimate z^0\hat{z}_0 is blurry, and SDA annealing further shrinks the likelihood gradient, so guidance accomplishes little there. Measurement fidelity is only established near t→0t\to0. The reduced-step corrector configurations (Table 1) therefore reallocate the NFE budget. The Langevin corrector steps are restricted to the low-σ\sigma band (Algorithm 2). The configurations we use further set the step count NN and corrector gate σmax⁡c\sigma_{\max}^{c} to

  • DPS+corr (N25): (N,σmax⁡c)=(25,3)(N, \sigma_{\max}^{c}) = (25, 3);

  • DPS+corr (N30): (N,σmax⁡c)=(30,5)(N, \sigma_{\max}^{c}) = (30, 5).

Reshaping gradients and noise. We modify how the sampler uses the gradients and noise in the following ways.

  • λ\lambda noise-scaling [77] multiplies the corrector’s injected noise, λ2η ϵ\lambda\sqrt{2\eta}\,\epsilon in Algorithm 2, by a factor λ∈[0,1]\lambda\in[0,1]. This interpolates between posterior samples at λ=1\lambda=1, the default, and a deterministic mode-seeking trajectory at λ=0\lambda=0, used by the mode-seeking configurations of Table 1.

  • Momentum guidance accumulates the scaled likelihood score across steps, ℓt=scale⁡⋅σtgt+mℓt−1\ell_t = \operatorname{scale}\cdot\sigma_t g_t + m\ell_{t-1}, with decay m∈[0.3,0.5]m \in[0.3,0.5] (Algorithm 1). Unlike lazy gradient reuse [78], the gradient is still recomputed at every step; momentum only averages successive directions. The accumulator starts at ℓ−1=0\ell_{-1}=0, so the first step is plain DPS. One variant uses m=0.5m=0.5; the other momentum variants use m=0.3m=0.3 (Table 1).

  • DSG (diffusion with spherical-Gaussian constraint) [79] unit-normalizes the guidance gradient per sample and rescales it to magnitude n\sqrt{n}, where n=CTHWn=CTHW is the number of latent elements (here n=128⋅8⋅32⋅64=2,097,152n=128\cdot8\cdot32\cdot64=2{,}097{,}152), before the elementwise clip and the guidance scale are applied as in Algorithm 1. This fixes the guidance step size regardless of the raw gradient magnitude.

Measurement operators

For our posterior sampling, we change only the measurement operator AA entering the likelihood. We broadly divide the measurement operators used here into these three categories.

  • Structured (gridded) subsampling. For SR-type tasks with a structured observation, AA selects the observed frames of the decoded video and spatially subsamples them by the coarsening factor.

  • Sparse point interpolation. For station datasets, AA bilinearly interpolates the decoded fields at the reported [lat, lon] locations on the observed frames. The observations are fused by taking their union.

  • Super-obbed point observations. For the dense, strongly clustered observations (ISD and the ICOADS), we use grid-cell super-obbing, the standard assimilation thinning step [80, 81]. All raw observations in a cell are collapsed to a single super-observation weighted by their distance from the cell centers.

All likelihoods take the form of Eq. (6)–(7).

Experimental configuration

Data

We use ERA5 reanalysis [8] regridded to 1.40625∘1.40625^\circ (128×256128 \times256) from WeatherBench [82], organized into 32-frame 6-hourly windows of 69 variables (surface fields plus geopotential, wind, temperature, and specific humidity on 13 pressure levels). The flow prior is trained on autoencoder latents of these windows. The years 1979 − 2018 are used for training, 2019 for validation, and 2020 for testing.

For observations we use the NOAA Integrated Global Radiosonde Archive (IGRA) [25] and the Integrated Surface Database (ISD; the ISD-Lite subset) [26]. IGRA provides on average ∼300\sim300 active stations per observed frame (ranging from ∼600\sim600 at the 00/12 UTC launch times down to a few tens at 06/18 UTC; ∼900\sim900 distinct sites), reporting 63 of the 69 variables: the three near-surface fields (2 m temperature, 10 m uu, vv wind) and, on every one of the thirteen pressure levels, geopotential, zonal and meridional wind, and temperature, together with specific humidity at 300 hPa and below. The soundings carry no mean sea-level pressure, and we discard radiosonde humidity above 300 hPa, where the sensors are unreliable and the reports correlate poorly with the reanalysis. ISD provides four surface variables (2 m temperature, 10 m u/vu/v wind, mean sea-level pressure) from ∼2500\sim2500 globally grid-thinned stations per step (∼3100\sim3100 distinct sites, ∼9400\sim9400 observations per 6 h step): a dense but surface-only observation. For the observations-to-forecast experiments, we additionally ingest the International Comprehensive Ocean-Atmosphere Data Set (ICOADS) [27] ship and buoy reports (marine air temperature, wind, and pressure), which extend the surface coverage over the oceans. The ERA5 data closely match the observations for the temperature fields but less so for the winds, whose local behavior cannot be captured by ERA5 at ≈1.4∘\approx1.4^\circ. Although we note that these observations are closer to the ground truth at those stations (up to measurement accuracy), we use ERA5 data for the evaluation of global reconstructions.

Autoencoder

The flow-matching prior operates in the latent space of a 3D-convolutional autoencoder trained separately on the same ERA5 windows. The encoder is a ResNet-style 3D network with four resolution levels (hidden widths [96, 192, 384, 768], three residual blocks per level) that maps a 69-variable, 32-timeframe window at 128×256128 \times256 down to a latent of shape (C=128C=128, T=8T=8, H=32H=32, W=64W=64) via the anisotropic strides [(1, 2, 2), (2, 2, 2), (2, 1, 1)], a 4× temporal and 4× spatial compression; the decoder mirrors the encoder with one extra residual block per level. The latent is passed through a smooth transformation x↦x/1+(x/10)2x \mapsto x/\sqrt{1+(x/10)^2} that bounds its range without hard clipping. Two static fields, the land-sea mask and the surface geopotential, are area resampled to each decoder resolution and added to the decoder through zero-initialized 3×33 \times3 convolutions. This ensures that the decoder need not expend its capacity to learn the fixed surface structures.

The autoencoder is trained deterministically for 155 epochs with Adam [83], a base learning rate 5×10−45 \times10^{-4} cosine-annealed to 10−810^{-8}, gradient clipping at 5, and a batch size of 128. A small Gaussian latent noise (std 0.02) is injected before the decoder during training as a regularizer. The reconstruction objective is a latitude-weighted and variance-normalized MSE, so high-variance fields do not dominate. We also have three terms to preserve small-scale details, each weighted 0.05: a spatial gradient, a Laplacian for second-order sharpness, and a temporal-difference penalty. The trained autoencoder is frozen for all posterior sampling, and every likelihood is evaluated in physical field space through its decoder. The complete architecture and training configuration are tabulated in Appendix B. We tune these hyperparameters empirically using a smaller subset of training data.

Flow-matching training and sampling

The prior FF is a DiT3D [24] trained with the modified TrigFlow loss Eq. (4) on (128,8,32,64)(128, 8, 32, 64) latents. It uses a [1, 2, 2] patch so the (8, 32, 64) latent grid becomes a 4096-token sequence. The DiT3D uses hidden size 1536, depth 12, 24 attention heads, and MLP ratio 4 with a size-384 sinusoidal timestep embedding, and is trained with log-noise ln⁡σ∼N(0,1.52)\ln\sigma\sim\mathcal{N}(0, 1.5^2) and σd=1\sigma_d=1 using AdamW [84] and learning rate 2×10−42 \times10^{-4}, weight decay 0.01, batch size 256, with an exponential moving average of the weights with a half-life of 500 kilo-images (kimg) and a 500-kimg learning-rate ramp-up. The prior is never fine-tuned or conditioned on observations; all results use a single EMA checkpoint at 19,901 kimg. The full architecture and training details are in Appendix B. The sampling hyperparameters are given in their respective subsections.

Metric and cost

The common metric used is the per-variable latitude-weighted RMSE in physical units, following the WeatherBench evaluation convention [82]: for each variable we compute the area-weighted (cosine-latitude) RMSE of the ensemblemean prediction against ERA5, then average over frames. For variable vv, with uˉ=1d∑k=1du(k)\bar{u} = \frac{1}{d}\sum_{k=1}^{d}u^{(k)} the mean over dd posterior draws, ERA5 truth u∗u^*, latitude ϕi\phi_i, and frame index ff running over the T=32T=32 decoded frames (or a stated frame subset),

RMSE⁡v=1T∑f=1T∑i,jcos⁡ϕi(uˉv,f,i,j−uv,f,i,j∗)2∑i,jcos⁡ϕi.(8)\operatorname{RMSE}_v = \frac{1}{T}\sum_{f=1}^{T}\sqrt{\frac{\sum_{i,j}\cos\phi_i\left(\bar{u}_{v,f,i,j}-u^*_{v,f,i,j}\right)^2}{\sum_{i,j}\cos\phi_i}}. \tag*{(8)}

The reported values in the results are mean ±\pm standard deviation over eight independent initial conditions (distinct, non-overlapping ERA5 windows), and every prediction is the mean of an 8-member ensemble, each member an independent posterior draw from a distinct seed. The sampler ablations are done in the validation split, and the forecast results are done in a disjoint test split of the data. For some tasks like forecasts, we have used more initial conditions and ensemble members, which are mentioned in those sections.

Results

We first recover the full state from structured coarse observations, which we call super-resolution (SR) in § 4.1, and from real station observations, which we call data fusion in § 4.2. We then evaluate each case for posterior accuracy, ensemble spread, physical consistency, and performance against unseen observations. We perform extensive ablation studies on the different sampling methods (Appendix § 7) and propose a set of recommended sampling hyperparameters in Table 2. Next, we explore the classical filtering, smoothing, and fixed-interval regimes of traditional DA with the same fixed prior (§ 4.3). Finally, we perform forecasting directly from observations (§ 4.4), including a case study of Hurricane Laura.

taskefficiency recommendationaccuracy recommendationReference
super-resolutionDPS+corr (N30) (47)DPS+corr(all σ\sigma) (99)Tables 8, 10
stations (IGRA/ISD/joint)DPS+corr (N30) (47)DPS+corr+DSG+λ0\lambda_0 (76)Tables 9, 11, 12
obs →\to forecast–DPS+corr+DSG+λ0\lambda_0 (76)Fig. 16
filtering/smoothing studyDPS+corr (N30) (47)DPS+corr+DSG+λ0\lambda_0 (76)Table 7, Fig. 15

Table 2. Recommended sampler configurations per task: the efficiency column gives the best low-NFE configuration and the accuracy column the best overall configuration in the corresponding ablation tables (key switches as in Table 1; NFE in parentheses).

Super-resolution

We first perform a uniform spatio-temporal super-resolution (SR): a 4×4\times temporal and 8×8\times-per-axis spatial down-sampling. From these observations the prior recovers 2 m temperature to 1.02 K RMSE with the most accurate configuration (Table 2; the efficiency-tuned default gives 1.05 K at half the cost; Table 8, Table 10). For reference, the autoencoder’s own reconstruction floor is 0.84 K for 2 m temperature. Figure 2 shows the reconstruction of the surface variables on an observed frame. The ensemble mean recovers fine-scale structure absent from the coarsened observations. The ensemble spread (Figure 3) quantifies uncertainty, which is lower over the regularly sampled observation grid and higher over dynamically active regions. The corresponding reconstructions for all 69 output channels (the four surface fields and the five upper-air fields at all 13 pressure levels) are reported in Appendix E.2. Spectral analysis (Figure 4) confirms that the posterior recovers the correct zonal energy spectrum well beyond the observation cutoff, unlike a naive upsampling of the low-resolution field. The longitudinal traces (Figure 5) show that the ensemble mean tracks sharp peaks and troughs with an uncertainty band (quantified below). The scatter of reconstructed against true values (Figure 6) collapses onto the diagonal at observed pixels and remains tight at unobserved pixels, indicating effective full-state recovery. In time, the per-frame RMSE (Figure 7) has a sawtooth structure that dips at each observed frame (shaded orange). We see the error drop after the first frame as the prior’s internal dynamics (and two-sided information) help reconstruction. We observe higher errors after the last observed frame, as expected. The following paragraphs explore whether the recovered posterior has calibrated spread and physical consistency.

Super-resolution reconstruction on an observed frame for the surface variables: the low-resolution observation (left), ERA5 truth (middle), and posterior ensemble mean (right)

Figure 2. Super-resolution reconstruction on an observed frame for the surface variables: the low-resolution observation (left), ERA5 truth (middle), and posterior ensemble mean (right). The prior recovers fine-scale structure absent from the coarsened observations. All 69 channels are shown in Appendix § 11.§ 2.

Posterior ensemble mean, signed error of the mean from ERA5, and ensemble standard deviation for an eight-seed ensemble

Figure 3. Super-resolution uncertainty quantification: posterior ensemble mean (left), signed error of the mean from ERA5 (middle), and ensemble standard deviation (right) of an eight-seed ensemble. Spread is lowest over the regular observation grid and highest over dynamically active regions, where the error also concentrates.

Zonal power spectra for t2m, u10m, v10m, and msl

Figure 4. Zonal power spectra. The posterior sampling recovers the correct spectral slope up to high wavenumbers.

Longitudinal traces of t2m, u10m, v10m, and msl

Figure 5. Longitudinal traces at 40.4∘N40.4^\circ\mathrm{N}: ERA5 truth vs. the posterior ensemble mean with a ±2σ\pm2\sigma band.

Reconstruction scatter plots for t2m, u10m, and msl

Figure 6. Reconstruction scatter: ensemble mean vs. ERA5 truth at observed (red) and unobserved (grey) pixels. Points on the diagonal indicate exact recovery.

Six-panel plot of SR per-frame physical RMSE per variable for t2m, u10m, v10m, q1000, z500, and t850

Figure 7. SR per-frame physical RMSE per variable (six panels: t2m, u10m, v10m, q1000, z500, t850). Vertical shading marks the observed frames (every fourth).

methodNFEwall (s)t2mu10mv10mq1000z500
DPS501231.09±0.041.09\pm0.041.13±0.021.13\pm0.021.17±0.021.17\pm0.020.65±0.040.65\pm0.0466.6±3.166.6\pm3.1
+corr(all σ\sigma)992431.02±0.041.02\pm0.041.08±0.021.08\pm0.021.12±0.021.12\pm0.020.61±0.030.61\pm0.0359.5±1.059.5\pm1.0
+corr76186<u>1.02±0.041.02\pm0.04</u><u>1.09±0.021.09\pm0.02</u><u>1.13±0.021.13\pm0.02</u><u>0.61±0.030.61\pm0.03</u><u>60.4±0.960.4\pm0.9</u>
+corr (N30)471161.03±0.041.03\pm0.041.10±0.021.10\pm0.021.15±0.021.15\pm0.020.63±0.030.63\pm0.0362.8±1.362.8\pm1.3
+corr (N25)38941.05±0.041.05\pm0.041.12±0.021.12\pm0.021.16±0.021.16\pm0.020.64±0.030.64\pm0.0365.9±2.665.9\pm2.6
bicubic (no prior)--5.64±0.305.64\pm0.304.29±0.104.29\pm0.103.97±0.143.97\pm0.142.44±0.092.44\pm0.09794.7±30.0794.7\pm30.0
AE floor--0.84±0.030.84\pm0.030.53±0.010.53\pm0.010.48±0.010.48\pm0.010.42±0.020.42\pm0.0237.0±1.937.0\pm1.9

Table 8. SR sampler ablations: per-variable latitude-weighted physical RMSE. Units: t2m K, u10m/v10m m/s, q1000 g/kg, z500 m²/s². Bicubic = bicubic upsampling of the observed frames; AE floor = Autoencoder reconstruction error. Bold = best, underline = second-best, per variable.

Table 10: SR sampler noise, normalization, and momentum ablations: per-variable physical RMSE (8-window mean of 8-member ensembles; units as Table 8; bold = best, underline = second-best per variable). This table is complementary to Table 8, which gives the efficiency ablations.

methodNFEt2mu10mv10mq1000z500
DPS501.09±0.041.13±0.021.17±0.020.65±0.0466.6±3.1
+corr (N30)+λ0 (low-NFE)471.05±0.031.09±0.021.13±0.020.63±0.0363.9±1.7
+mom0.5 (λ=1)501.04±0.041.09±0.021.13±0.020.62±0.0360.3±0.9
+corr(all σ) (prior best)991.02±0.041.08±0.021.12±0.020.61±0.0359.5±1.0
+corr(all σ)+λ099<u>1.04±0.04</u>1.09±0.02<u>1.12±0.02</u><u>0.62±0.03</u>64.3±1.9
+corr(all σ)+λ0+mom991.04±0.04<u>1.08±0.02</u>1.12±0.020.63±0.0364.0±2.1
AE floor-0.84±0.030.53±0.010.48±0.010.42±0.0237.0±1.9

Table 10.

Calibration of the posterior spread. An ensemble is useful only if its spread is calibrated, that is, if the mean is wrong by about 1 K (skill), then the members should typically differ by 1 K (spread). We compute a total spread-skill ratio (SSR) that combines all 69 variables in their standardized and latitude-weighted units (1 is ideal). Table 3 reports it for 8-member ensembles of various sampling configurations. As expected, we observe that the setting λ=0\lambda=0 removes the injected noise from the corrector, making the SSR worse. For the sparse radiosonde observations, sampling (using λ=1\lambda=1) is the closest to calibrated (SSR 0.85). On the densely observed uniform SR task, the sampling configurations are more under-dispersed (SSR 0.72 to 0.75), meaning the spread is smaller relative to error. In short, λ=1\lambda=1 remains the choice whenever a calibrated spread is required. In future work, we would need to utilize an inflation-style correction, as operational ensembles routinely apply.

taskconfigurationSSREmpirical coverageSSR unobs.Empirical coverage unobs.
SRDPS (λ=1\lambda=1)0.720.7720.740.777
SR+corr (N30) (λ=1\lambda=1)0.720.7660.740.770
SR+corr(all σ\sigma) (λ=1\lambda=1)0.730.7730.740.778
SR+mom0.5 (λ=1\lambda=1)0.750.7780.760.784
SR+corr (N30)+λ\lambda0 (λ=0\lambda=0)0.520.5650.530.570
SR+corr(all σ\sigma)+λ\lambda0 (λ=0\lambda=0)0.230.1720.240.178
IGRA+corr+DSG (λ=1\lambda=1)0.850.8030.870.818
IGRA+corr+DSG+λ\lambda0 (λ=0\lambda=0)0.830.7320.850.763

Table 3. Ensemble calibration, 8-member ensembles for every configuration. Total Spread-Skill Ratio (SSR) combines all 69 variables in standardized units (latitude weighted, scaled by (d+1)/d\sqrt{(d+1)/d} for a dd-member ensemble; 1 is ideal, and values below 1 mean the ensemble is overconfident). Empirical ±2σ\pm2\sigma coverage has Gaussian target 0.954. The unobs. restricts to the unobserved frames.

Physical consistency. A posterior can score well on RMSE while producing physically inconsistent states, so we test the samples against two atmospheric balances (following the physical-consistency checks in prior work [71]) (Table 4). The first is geostrophic balance: in the extratropics, the wind should blow along the geopotential contours. We assess this by comparing the actual 500 hPa wind with the geostrophic wind computed from the sampled geopotential gradient. The second is hypsometric consistency: the 500-850 hPa thickness dictates the layer-mean temperature, so the thickness-implied temperature should match the directly sampled one. We observe that the posterior samples are at least as geostrophically balanced as the reanalysis in every configuration. In samples conditioned on IGRA measurements, the hypsometric residual is marginally above the reference (0.98-0.99 K versus 0.95 K). In general, the samples are dynamically and physically plausible states.

taskconfigurationgeo. cosspeed ratiohyps. RMSE [K]
-ERA5 truth0.9821.0450.95
SRDPS0.9861.0330.94
SR+corr(all σ\sigma)0.9861.0450.93
SR+corr (N30)+λ\lambda00.9871.0400.94
IGRA+corr+DSG0.9861.0470.98
IGRA+corr+DSG+λ\lambda00.9881.0510.99

Table 4. Physical consistency of the posterior samples. Geostrophic balance at 500 hPa in the extratropics (25∘≤∣lat∣≤70∘25^\circ\leq|\mathrm{lat}| \leq70^\circ): cosine similarity between actual and geostrophic wind, and their speed ratio. Hypsometric check: RMSE between the 500-850 hPa thickness-implied layer-mean temperature and the directly sampled one.

Real-observation data fusion

We now condition on real, sparse observations (Figure 8): IGRA measurements and the ISD surface measurements. From these sparse point observations, the prior reconstructs the full 69-channel field (Figure 9), including the six unobserved channels (mean-sea-level pressure and specific humidity above 300 hPa). The ensemble spread of the generated samples (Figure 10) is lower near the observation stations and higher over the sparse regions. The reconstruction scatter (Figure 11) collapses onto the diagonal at the observed station locations (top row), where it largely reflects the data fit, and, more informatively, stays close to the diagonal at off-station grid points (bottom row), quantifying information gain at the soundings. However, some fields, like the winds, are intrinsically small-scale and highly chaotic, which causes higher pixel-wise RMSE error (Table 5, Table 9). Moreover, the truth here is ERA5, which at the 1.4∘1.4^\circ grid differs considerably from the localized observations. Moreover, even a perfect posterior cannot beat the autoencoder reconstruction floor (Table 8; e.g. u10mu10m 0.53 m/s, z500z500 37.0 m2^2/s2^2), so a portion is due to the irreducible decoder error.

modalityt2mu10mv10mq1000z500
Joint (IGRA+ISD, 64 var)1.80±0.111.80\pm0.112.93±0.142.93\pm0.143.00±0.173.00\pm0.171.13±0.041.13\pm0.04467.6±48.5467.6\pm48.5
IGRA (radiosonde, 63 var)<u>1.90±0.131.90\pm0.13</u><u>3.01±0.173.01\pm0.17</u><u>3.08±0.183.08\pm0.18</u><u>1.15±0.041.15\pm0.04</u><u>474.9±50.4474.9\pm50.4</u>
ISD (surface, 4 var)2.21±0.112.21\pm0.113.34±0.183.34\pm0.183.33±0.203.33\pm0.201.41±0.091.41\pm0.09701.3±65.8701.3\pm65.8

Table 5. Multimodal data-fusion: per-variable physical RMSE (Units: t2m K, u10m/v10m m/s, q1000 g/kg, z500 m2^2/s2^2; bold = best, underline = second-best).

Maps of IGRA radiosondes and ISD surface stations

Figure 8. The two real observation sources IGRA and ISD (union of reporting sites across the eight observed frames and eight windows).

IGRA radiosonde data-fusion surface fields

Figure 9. IGRA radiosonde data-fusion surface fields: ERA5 truth, posterior ensemble mean, and signed error.

IGRA radiosonde data fusion uncertainty quantification: ensemble mean and standard deviation

Figure 10. IGRA radiosonde data fusion uncertainty quantification: ensemble mean (left) and standard deviation (right). Spread is lower over the regions with more observation locations.

IGRA reconstruction vs ERA5 scatter plots for three observed variables (t2m, u10m, z500)

Figure 11. IGRA reconstruction vs ERA5 scatter plots for three observed variables (t2m, u10m, z500). Top: at the radiosonde station locations; bottom: at off-station grid points. Color shows log⁡10\log_{10} hexbin count; mentioned text gives the RMSE in physical units and Pearson rr. Similar plots for all observed variables are in Appendix § 11.§ 3.

methodNFEwall (s)t2mu10mv10mq1000z500
DPS (50 steps)501422.23±0.212.23\pm0.213.32±0.113.32\pm0.113.49±0.143.49\pm0.141.25±0.031.25\pm0.03567.5±29.6567.5\pm29.6
+corr (50 st, corr σ<3\sigma<3)76215<u>2.16±0.202.16\pm0.20</u><u>3.30±0.113.30\pm0.11</u><u>3.47±0.143.47\pm0.14</u><u>1.23±0.031.23\pm0.03</u><u>560.7±30.5560.7\pm30.5</u>
+corr (N30) (30 st, corr σ<5\sigma<5)471342.27±0.252.27\pm0.25<u>3.32±0.113.32\pm0.11</u>3.49±0.143.49\pm0.141.27±0.031.27\pm0.03567.4±22.4567.4\pm22.4
+corr (N25) (25 st, corr σ<3\sigma<3)381092.33±0.262.33\pm0.263.35±0.113.35\pm0.113.51±0.143.51\pm0.141.28±0.031.28\pm0.03573.1±22.5573.1\pm22.5

Table 9. IGRA data-fusion sampler ablations: per-variable physical RMSE (mean±\pmstd; units as Table 8; bold = best, underline = second-best).

Multimodal data fusion. Intuitively, the addition of more observation points shows lower errors on joint sampling than individually using IGRA and ISD (Table 5). The surface-only ISD is worst despite its density because the prior has to reconstruct every upper-air variable from surface observations alone. The comparison therefore contrasts two whole observing systems: the soundings are sparser on the map but report 63 channels through the depth of the atmosphere against ISD’s four. Figure 12 visualizes this as the 2 m-temperature error map across modalities, and Figure 13 shows the truth-vs-reconstruction scatter for the ISD surface observations.

2 m-temperature signed error by assimilation modality

Figure 12. 2 m-temperature signed error by assimilation modality. Among the real-observations data-fusion, the joint ISD+IGRA has the lowest error. The SR panel uses structured dense observations and is shown only for reference.

ISD surface reconstruction vs ERA5 scatter plots for three observed variables

Figure 13. ISD surface reconstruction vs ERA5 scatter plots for three observed variables (t2m, u10m, MSLP). Top: at the station locations; bottom: at off-station grid points (random subsample). Color shows log⁡10\log_{10} hexbin count; mentioned text gives the RMSE (physical units) and Pearson rr. All four observed ISD variables are in Appendix § 11.§ 3.

Matching held-out observations. Everything above scores the reconstruction against ERA5, which is not the perfect representation of the ground truth. We therefore verify directly in observation space similar to prior work [28]. We withhold a random 20% of stations, assimilate only the remaining 80%, and measure the deviation of the reconstruction from the unseen observations. Because station observations are highly localized, a meaningful reference error is the deviation of ERA5 at the same sites. Table 6 shows the result on the observed frames: on the withheld stations the reconstruction is at or below the ERA5 deviations on three of four ISD variables (10 m winds and pressure) and close for 2 m temperature. For the IGRA radiosondes, the reconstruction deviation from held-out observations closely tracks that of ERA5.

ObservationVariableRMSEERA5
ISD2 m temperature [K]3.243.06
ISD10 m uu-wind [m/s]2.272.44
ISD10 m vv-wind [m/s]2.192.31
ISDMSLP [hPa]2.162.50
IGRA2 m temperature [K]3.162.91
IGRA10 m uu-wind [m/s]2.392.40
IGRAz500 [m²/s²]165155
IGRAz850 [m²/s²]124108
IGRAt500 [K]1.210.91
IGRAt850 [K]1.581.23
IGRAt300 [K]1.421.19
IGRAu200 [m/s]3.772.95

Table 6. Observation-space verification at withheld stations.

Table 6: Observation-space verification at withheld stations. RMSE of the reconstruction versus that of ERA5 at the same sites and times (lower half: withheld IGRA radiosondes; upper half: withheld ISD surface stations). Bold marks where the reconstruction departure is at or below the ERA5 reference.

Filtering and smoothing

We now experiment with the classical estimation regimes of traditional DA [85] with the same learned prior, changing only which temporal frames are observed. In classical systems, these regimes require distinct frameworks around a numerical forecast model, whereas here, each is just a different observation mask on the same posterior [75, 71]. The smoother observes the middle-8 frames to reconstruct the full 32-frame (8-day) spatio-temporal chunk. The filter observes the leading eight frames, so its unobserved tail is a forecast. We also use a fixed-interval reference which observes one frame per day. A schematic of these tasks is in Figure 14. We demonstrate these first with the idealized observations (similar to SR), and then with the real IGRA observations. The sampling method is held fixed within each observation source, using the recommended configurations of Table 2.

The three temporal observation geometries over the 32-frame window

Figure 14. The three temporal observation geometries over the 32-frame window, each observing 8 frames: smoother (two-sided), filter (causal/leading), and the fixed-interval reference (every fourth frame, the geometry of a reanalysis). Only which frames are observed differs; each realizes one classical DA regime with the same frozen prior.

The motivation of this experiment is to show that a single unconditional prior realizes each regime and shows exactly the behavior classical DA associates with it, in Figure 15. Table 7 has the quantitative analysis. The fixed-interval reference flattens the error across the whole window at a low level, as expected when observations constrain the entire trajectory. The smoother gives the familiar U-shape, with the lowest error within the observation window. The filter shows error that is low over the leading observed frames and grows forward in time as the prior must forecast beyond the last observation. The error grows smoothly forward, suggesting that the prior learns to propagate the atmospheric fields. Therefore, the prior acts as the learned forecast model, which is the function of a numerical model in classical assimilation. We also run the same three regimes on the real IGRA radiosonde observations, the lower half of Table 7. Together, these show that the same unconditional video prior supports filtering, smoothing, and fixed-interval observing, simply by changing the temporal observation geometry. Classically, each of these would be a separate algorithm wrapped around a forecast model.

DA experiments: per-frame physical RMSE per variable

Figure 15. DA experiments: per-frame physical RMSE per variable (six panels: t2m, u10m, v10m, q1000, z500, t850) for the three temporal geometries. The filter experiment’s error grows forward in time, the smoother is U-shaped, and the fixed-interval reference is flat.

geometryt2mu10mv10mq1000z500
SR observations (8× subsample, sampling configuration is DPS+corr (N30))
Smoother (frames 12-19)1.40±0.041.40 \pm0.041.96±0.051.96 \pm0.052.01±0.072.01 \pm0.070.85±0.030.85 \pm0.03232.9±12.4232.9 \pm12.4
Filter (frames 0-7, causal)1.85±0.041.85 \pm0.042.58±0.092.58 \pm0.092.73±0.072.73 \pm0.071.05±0.031.05 \pm0.03412.7±32.6412.7 \pm32.6
Fixed-interval (every 4th frame, ref.)1.03±0.041.03 \pm0.041.10±0.021.10 \pm0.021.15±0.021.15 \pm0.020.63±0.030.63 \pm0.0362.8±1.362.8 \pm1.3
IGRA radiosondes (real soundings, sampling configuration is DPS+corr+DSG+λ0\lambda_0)
Smoother (frames 12-19)1.90±0.131.90 \pm0.133.01±0.173.01 \pm0.173.08±0.183.08 \pm0.181.15±0.041.15 \pm0.04474.9±50.4474.9 \pm50.4
Filter (frames 0-7, causal)2.13±0.092.13 \pm0.093.38±0.113.38 \pm0.113.51±0.103.51 \pm0.101.26±0.061.26 \pm0.06621.3±32.1621.3 \pm32.1
Fixed-interval (every 4th frame, ref.)1.51±0.111.51 \pm0.112.29±0.102.29 \pm0.102.28±0.102.28 \pm0.100.94±0.020.94 \pm0.02272.6±35.8272.6 \pm35.8

Table 7. DA experiments: per-variable physical RMSE over all frames. All geometries observe 8 of the 32 frames; only which frames differs. Upper panel: using 8× subsampled observations per axis. Lower panel: using IGRA radiosonde observations; for its fixed-interval row the window starts are aligned to the 00/12 UTC launch hours. Per-frame observed/unobserved breakdown in Figure 15 and Appendix § 11.§ 1. The frame here refers to the specific timestep of our video window.

Observations to forecast

The causal filtering geometry of the previous section motivates conditioning on real observations and propagating forward for forecasting, a direct observation-to-forecast [86, 28]. We assimilate a global in-situ observation on the leading frames of the window and let the prior forecast the remaining timesteps. Now, since the likelihood is a bilinear interpolation of the decoded field (§ 2.4), it admits only observations that directly measure an ERA5 state variable. This admits three useful in-situ observation sources: IGRA radiosondes, ISD surface stations, and ICOADS ships and buoys (§ 3.1; compared to [86]). It excludes the satellite radiances and scatterometer backscatter, which require a radiative-transfer or geophysical forward operator. We therefore assimilate the union ISD ∪\cup IGRA ∪\cup ICOADS, a land, ocean, and upper-air network of observations per 6-hourly step.

We therefore apply the grid-cell super-obbing of § 2.4 to the dense ISD and ICOADS observations. This lets the likelihood gradient not be dominated by the over-sampled regions and equalizes each cell’s contribution. More details on this are in Appendix § 9. The sampler which performs best in this case is DPS+corr+DSG+λ0\lambda0 (Table 1: 50 solver steps, one corrector step at σ<3\sigma<3, λ=0\lambda=0, 76 NFE). The DSG guidance scale is re-selected on a set of validation windows and applied to a disjoint test set of thirty-two initial conditions spread evenly across 2020, over which we report the mean.

Chaining windows into a three-week forecast. The same posterior sampler supports autoregressive chaining, an analogue of the cycled reinitialization of operational systems. We take the last generated frame of a window and re-assimilate it as the initial condition of the next window, treating it as a dense observation of that window’s first frame.

The observation operator for the next window becomes the identity at the first window for every grid cell and all 69 channels. Each additional window extends the forecast by 7 days and 18 hours.

Firstly, we observe that the forecast beats persistence of the last observed frame at essentially all leads and stays at or below the annual-climatology error. Figure 16 compares this forecast against GraphDOP [28], the directly comparable observation-only, end-to-end data-driven forecast system, and the operational ECMWF Integrated Forecasting System (IFS), all verified against ERA5. The GraphDOP and IFS skill curves are extracted from the respective figure of [28], every 12 h through day 10, their full range. The comparison is asymmetric in input information: GraphDOP is trained on a broad slice of the operational observing system, ingesting several satellite measurements alongside the surface, marine, aircraft, and radiosonde measurements [28]. However, we still improve on GraphDOP at all leads for 2 m temperature where our dense surface observation is helpful. For other surface fields, our errors start above GraphDOP and converge to it by days 5 to 7 as forecast error saturates. This suggests that the satellite measurements are very helpful for an accurate forecast, especially at shorter lead times. In longer forecast leads, our methodology shows clear advantages over GraphDOP. We see better stability in the generated forecasts with the metric eventually reaching climatological values.

Observations-to-forecast skill

Figure 16. Observations-to-forecast skill. Latitude-weighted RMSE against ERA5 versus lead over thirty-two initial conditions spread evenly across 2020, 8-member ensembles. The GraphDOP and IFS curves [28] are extracted from their published figures. The persistence and annual-climatology floors are for reference. Persistence is omitted for 2 m temperature because of the diurnal cycle.

We perform additional analysis for our observation-to-forecast case. First, we observe that the length of the observed analysis window does not affect the forecast performance. Shortening it from two days to one day, or even to a single analysis frame, leaves forecast skill essentially unchanged (Appendix § 9). Moreover, in Appendix § 10, we use additional gridded observations from [86], where our forecasts perform close to GraphDOP. However, we could perform limited tests due to the availability of only a single observation from [86]. We leave further tests with operators that can be associated with satellite data to future work.

Hurricane tracking. We finally conduct a case study of Hurricane Laura (in 2020), one of the strongest hurricanes on record to make landfall in the U.S. Starting the window at Aug 23 06Z, Laura passes Hispaniola on its way to Cuba. We condition on the real in-situ observations (ISD ∪ IGRA ∪ ICOADS union, exactly the same as the forecast configuration above) over observed windows of increasing length, two, three, and four days of observations, and let the frozen prior forecast the remainder up to when landfall occurs on Aug 27 06Z at Cameron, Louisiana. Figure 17 shows sixteen ensemble trajectories for the three cases against ERA5. We observe that the trajectory tightens accordingly, with the forecast with 4 observed days being the closest and showing the least spread. The lower spread here does not directly

Hurricane Laura actual and predicted member trajectories for three observed windows

Figure 17. Hurricane Laura case study: actual track (ERA5, black; minimum-MSLP) versus the sixteen individual predicted member trajectories for three observed windows starting Aug 23 06Z: two days (blue; landfall at a 54-hour lead), three days (orange), and four days (green). Red dots show the actual observation sites (stations and ships) at the first analysis time; the star marks landfall (Aug 27 06Z, Cameron, Louisiana).

mean greater accuracy, but that the forecasts become more confident. Firstly, at 1.40625° the grid cannot resolve a hurricane. Secondly, there are only a few observations over the Gulf. However, some of the ensemble members track the hurricane accurately. The distribution of 10 m wind inside the hurricane region (Figure 19) shows that the posterior matches ERA5 except the extreme tails. We also repeat the experiment from the storm’s early life: a window starting Aug 21 00Z, observing the three days in which Laura crosses the Lesser Antilles, Puerto Rico, and Hispaniola, followed by a 32-member ensemble forecast in which landfall is a 3.5-day-lead prediction (Figure 18). The forecast seems to carry the storm into the Caribbean and then spreads, some entering the Gulf. Both these experiments show promising results where our learned prior and posterior sampling methodology can be used for direct obs-to-forecast, given an ideal observation set and the related operator is available.

Hurricane Laura actual and predicted member trajectories for a window starting Aug 21 00Z

Figure 18. Hurricane Laura case study: the window starts Aug 21 00Z and the first three days are observed as Laura crosses the Lesser Antilles, Puerto Rico, and Hispaniola (last observed frame: open square, Aug 23 18Z); everything afterward is forecast. Thirty-two member trajectories are shown (light blue), and red dots are the observation sites at the first analysis time.

Distribution of the 10 m zonal wind $u$ near the Laura region

Figure 19. Distribution of the 10 m zonal wind uu near the Laura region: ERA5 (black) against the posterior ensemble for two, three, and four days of observations.

Hindcast. The same framework also runs in reverse. We take the Laura window starting Aug 21 00Z, but now observe the real in-situ observations only over the last four days (Aug 25-28), when the storm runs from maturity to landfall, and hindcast using the prior to infer the first four days (Aug 21-24). This is the initial state that grew into the observed hurricane. We plot individual posterior members, their ensemble mean, and the ensemble spread along with ERA5 (Figure 20 and Figure 21). The figures show a coherent structure moving westward across the Caribbean. Information from the observed mature storm propagates backwards in time through the prior to constrain its unobserved genesis, with increasing errors backwards in time. The wind distributions (Figure 22) here reproduce the full range of ERA5’s 10 m wind, as expected when a past state is reconstructed rather than forecasting an extreme event.

Hindcast of Hurricane Laura showing ERA5, posterior members, ensemble mean, and ensemble spread

Figure 20. Hindcast of Hurricane Laura (10 m wind speed): ERA5 (top row), two individual posterior members, the ensemble mean, and the ensemble spread (standard deviation across members, bottom row) on the four inferred days Aug 21-24 00Z. Black contours are each field’s own MSLP; the ×\times marks the storm position.

Hindcast of Hurricane Laura’s precursor

Figure 21. Hindcast of Hurricane Laura’s precursor (mean sea-level pressure). Individual members develop a closed low that deepens and tracks with the storm’s position (×\times) as Aug 24 approaches, recovering the broad structure of ERA5’s developing low.

Distribution of the 10 m zonal wind $u$ inside the box

Figure 22. Distribution of the 10 m zonal wind uu inside the box for the hindcast, split into the observed segment (Aug 25-28, green) and the inferred precursor (Aug 21-24, red); ERA5 solid, posterior dashed.

Discussion

In this work, we train a latent generative video prior of ERA5 and perform spatio-temporal data assimilation. We perform several experiments starting from simplified super-resolution to data fusion using real observations such as IGRA radiosondes, ISD surface stations, and the ICOADS ocean-atmosphere dataset. We also show that our generated samples are physically consistent in the limited tests that we have performed. Moreover, because the prior is a video, the methodology supports the classical data assimilation experiments without requiring an autoregressive forecast model: observing leading frames yields a causal filter whose error grows forward in time, and observing the middle yields a two-sided smoother. The same posterior sampling framework also yields a direct observation-to-forecast pipeline. Driven only by in-situ observations, with no learned encoder for observations and no separate forecast model, it can produce a prediction competitive with other trained obs-to-forecast systems like GraphCast [28]. We also explore different sampling algorithms, some of which improve efficiency by distributing the sampling budget towards lower noise levels, and others that scale the gradients and noise injection for more accuracy and calibrated spread.

Future work includes extending our sequential cycling across consecutive windows for long-term sub-seasonal forecasts. Moreover, an operator that can inject several observations, especially from satellites, and convert them to the ERA5 grid (like Aardvark [86] or HealDA [87]) can be used to further improve our pipeline. We present a preliminary experiment using Aardvark in Appendix D. Another future direction is to directly include these observations as input to the flow model, with the option to exclude them when unavailable.

Acknowledgments

This research used resources of the Argonne Leadership Computing Facility, a U.S. Department of Energy Office of Science User Facility operated under contract DE-AC02-06CH11357. DC and RM acknowledge support from the DOE ASCR award “Inertial neural surrogates for stable dynamical prediction.” DC and RM also acknowledge computing resources through an AI for Science allocation at the National Energy Research Scientific Computing Center (NERSC) and from the Penn State Institute for Computational and Data Sciences (ICDS). RM acknowledges the support of a YIP from the ARO Modeling of Complex Systems program (PM: Robert Martin). We also acknowledge Melissa Adrian for the useful discussions related to this work.

Exploring different sampling techniques

This appendix collects the design rationale and the sampling study behind the recommended configurations of Table 2. Sec. A.1 justifies the central design choices of the guided sampler; the remaining subsections report the experiments. In every experiment the prior is fixed, every run is scored with the same latitude-weighted physical RMSE as the main results, and each method is tested on both observation types: the dense structured SR grid and the sparse, irregular station observations. Unless stated otherwise, the reported rows are 8-member ensembles over the 8 validation windows disjoint from the test set. Conceptually, the sampler has two independent directions to explore: where the NFE budget is spent (Sec. A.2) and how the computed gradient and injected noise are used (Sec. A.3). Sec. A.4 then reports the likelihood-weight sweeps behind the settings used in the paper, and Secs. A.5 and A.6 benchmark existing samplers in the literature on the same tasks.

Sampler design choices

We justify the central design choices here.

(a) Low-σ\sigma corrector helps. At high σ\sigma the rotation mostly transports the prior and observation yy barely constrains the decoded z^0\hat{z}_0. The low-σ\sigma Langevin corrector targets the posterior score and recovers measurement fidelity only in the low-σ\sigma band where it can be determined.

(b) Lazy reuse fails. DPS requires ∇ztlog⁡p(y∣zt)=(∂z^0∂zt)T∇z^0log⁡p(y∣z^0)\nabla_{z_t}\log p(y \mid z_t) = \left(\frac{\partial\hat{z}_0}{\partial z_t}\right)^{\mathsf{T}}\nabla_{\hat{z}_0}\log p(y \mid\hat{z}_0). From (2) the TriFlow denoiser Jacobian is

∂z^0∂zt=cos⁡(t)I−sin⁡(t) σd∂F∂zt.(9)\frac{\partial\hat{z}_0}{\partial z_t} = \cos(t) I - \sin(t)\,\sigma_d \frac{\partial F}{\partial z_t}. \tag*{(9)}

Through (9) the likelihood gradient depends on cos⁡(t)\cos(t), sin⁡(t)\sin(t), and the changing z^0\hat{z}_0. Therefore, holding it fixed across steps and reusing injects a stale direction which hampers performance in our test cases.

(c) Effect of momentum. The per-step likelihood (through a decoder) gradient can be a noisy estimate of the misfit gradient. Momentum averages successive estimates, so the guidance direction has lower variance, similar to several optimizers. We observe empirically in our test cases that it does not help when the Langevin corrector is present: the corrector already re-equilibrates the state at each level, so the accumulated gradient direction adds little. We leave further exploration of the effect of momentum on highly non-linear measurement operators to future work.

(d) DSG normalization. The per-timestep coverage of station measurements swings widely (for IGRA it is dense at 00/12Z and sparse at 06/18Z). Therefore, the raw gradient magnitude varies erratically and DSG sphere-normalization is preferred.

(e) Second-order update of Algorithm 1. Substituting σdFs=(cos⁡s zt−z^0)/sin⁡s\sigma_d F_s = (\cos s\,z_t-\hat{z}_0)/\sin s (from Eq. (2)) into the first-order rotation gives the exact exponential-integrator form

z(1)=sin⁡tsin⁡szt+sin⁡δsin⁡sz^0,(10)z^{(1)} = \frac{\sin t}{\sin s}z_t+\frac{\sin\delta}{\sin s}\hat{z}_0, \tag*{(10)}

the trigonometric analogue of DDIM: the step would be exact if z^0\hat{z}_0 were constant along it. The multistep second-order scheme of DPM-Solver++(2M) [76] replaces z^0\hat{z}_0 by its linear extrapolation in log⁡σ=log⁡tan⁡\log\sigma=\log\tan using the previous estimate, z^0→z^0+12r(z^0prev−z^0)\hat{z}_0 \to\hat{z}_0+\frac{1}{2r}(\hat{z}_0^{\mathrm{prev}}-\hat{z}_0) with rr the log-σ\sigma step ratio defined in Algorithm 1 (negative under that sign convention). Inserting this yields the correction term sin⁡δ2rsin⁡s(z^0prev−z^0)\frac{\sin\delta}{2r\sin s}(\hat{z}_0^{\mathrm{prev}}-\hat{z}_0) of Algorithm 1.

Efficiency: distributing the NFE budget

We observe that using NFEs strategically by using the corrector steps at low noise levels helps, as per Table 8 and Figure 23. On SR, the reduced-step DPS+corr (N25) matches the 50-step DPS baseline with fewer steps and less wall time, and adding more corrector steps improves accuracy consistently. The IGRA radiosondes show a similar ordering (Table 9), except that the 50-step corrector configuration concentrated at low noise performs best. Restricting guidance to late steps [88] degrades results the more guidance is removed, and reusing gradients across steps hurts accuracy (Appendix § 7.§ 1). An SDEdit warm start [89] matches the baseline but does not beat it. The only acceleration that actually helps is the NFE reallocation above. Wall-times per draw are listed alongside NFE in Table 8 and Table 9; Figure 24 shows the SR accuracy against wall time instead of NFE.

SR sampler efficiency: SR physical RMSE per variable across six panels

Figure 23. SR sampler efficiency: SR physical RMSE per variable (six panels: t2m, u10m, v10m, q1000, z500, t850) vs. NFE; lower is better. Error bars are ±1\pm1 standard deviation.

Physical RMSE per variable across six panels versus wall-time per draw

Figure 24. Physical RMSE per variable (six panels: t2m, u10m, v10m, q1000, z500, t850) vs. wall-time per draw; markers are the 8-window mean with ±1\pm1 standard-deviation error bars.

Reshaping gradients and noise

Three modifications change how the sampler uses the computed gradient and noise (§ 2.3.1). First, on the sparse-station tasks, use λ=1\lambda=1 when the ensemble spread itself matters. On SR task, the λ=0\lambda=0 shows worse performance (Tables 10, 11). Second, DSG normalization [79] shows significant performance for station data because the misfit gradient varies with the per-frame report schedule and DSG normalization is needed to keep the updates stable. DSG outperforms on the sensor measurements on most of the variables (Table 12). Third, momentum guidance is safe only at small decay; it is roughly neutral up to m=0.3m=0.3 and degrades beyond that. All headline configurations keep m=0m=0. We hypothesize that it may be helpful for highly non-linear or noisy operators.

Table 12: Sampler ablations on the ISD and joint (IGRA+ISD) observations (per-variable physical RMSE, units as Table 8; bold = best, underline = second-best). Full set in Appendix E.1.

Observationmethodt2mu10mv10mq1000z500
ISD (surface)DPS2.10±0.083.39±0.123.55±0.191.44±0.06641.1±34.9
ISD (surface)+corr+DSG2.15±0.103.36±0.193.35±0.221.39±0.09669.7±59.8
ISD (surface)+corr+DSG+λ02.21±0.113.34±0.183.33±0.201.41±0.09701.3±65.8
Joint (both)DPS2.09±0.173.27±0.113.43±0.131.23±0.02557.3±27.4
Joint (both)+corr+DSG<u>1.81±0.10</u><u>2.95±0.14</u><u>3.01±0.17</u><u>1.13±0.04</u>467.2±52.8
Joint (both)+corr+DSG+λ01.80±0.112.93±0.143.00±0.171.13±0.04<u>467.6±48.5</u>

Table 12.

Table 11: IGRA sampler noise, normalization, and momentum ablations: per-variable physical RMSE (units as Table 8; bold = best, underline = second-best). This table is complementary to Table 9, which gives the efficiency ablations.

methodNFEt2mu10mv10mq1000z500
DPS+corr+DSG+λ0 (scale 0.5)761.90±0.133.01±0.173.08±0.181.15±0.04474.9±50.4
DPS+corr+DSG (λ=1, scale 0.5)76<u>1.91±0.11</u><u>3.03±0.17</u><u>3.11±0.20</u>1.15±0.03<u>480.0±50.8</u>
DPS+corr+λ0+mom762.07±0.193.23±0.123.39±0.141.21±0.02539.4±31.8
DPS+corr+λ0762.14±0.213.29±0.113.45±0.141.23±0.02561.5±32.3
DPS+corr762.16±0.203.30±0.113.47±0.141.23±0.03560.7±30.5

Table 11.

Likelihood weighting

Table 13 sweeps the SR likelihood weight (guidance scale and the annealing coefficient γ\gamma) for the base DPS sampler. Table 14 contrasts DPS guidance at three scales against DSG-normalized guidance across six scales on the IGRA network. SR uses scale 4.0, γ=0.1\gamma=0.1 and all station tasks use DSG normalization at scale 0.5. The structured SR misfit is summed over the observed pixels, whereas the station misfit is averaged over points, channels, and observed frames. Under the averaged reduction, the guidance scale acts as a per-channel weight, so it is re-selected whenever the observed channel set changes, and the variable-splitting baselines require the same retuning.

settingt2mu10mv10mq1000z500
DPS (scale 3)3.06±0.454.52±0.204.83±0.211.63±0.04834.1±59.6
DPS (scale 5)2.73±0.344.38±0.164.68±0.171.57±0.04773.1±59.2
DPS (scale 7)3.31±0.624.44±0.134.63±0.091.63±0.10791.8±28.9
DSG scale 0.053.06±0.414.35±0.224.53±0.151.66±0.22793.5±63.1
DSG scale 0.152.91±0.474.04±0.224.13±0.171.52±0.21687.1±66.0
DSG scale 0.32.44±0.133.94±0.304.10±0.271.42±0.13674.2±114.9
DSG scale 0.52.43±0.093.83±0.253.92±0.291.40±0.11626.9±79.3
DSG scale 0.72.64±0.263.93±0.284.01±0.341.41±0.14701.5±135.8
DSG scale 1.02.90±0.454.09±0.443.83±0.201.48±0.12717.7±163.7

Table 14. Station likelihood ablation on IGRA (4 validation windows, single seed): DPS guidance scale vs. DSG-normalized guidance, per-variable physical RMSE (units as Table 8; bold = best).

Comparison with existing samplers

We benchmark against existing inverse-problem samplers. We port them from their respective paper and tune them for our case, on both observation experiments in Table 15. The compared methods include the leading variable-splitting methods of the InverseBench benchmark [57]: DPS [54] and PnP-DM [53], its most accurate methods on the closed-form operators, together with the efficient DiffPIR [52], alongside RED-diff [51], STeP’s HMC sampler [70], guided Restart [90], and a back-projection/DDNM port [50]. The table also has graded corrector, our own ablation that adds a second batch of Langevin steps in a lowest-σ\sigma band on top of the single-band corrector of Alg. 2. The two experiments show different outcomes. On the uniformly observed SR task, several of those methods are genuinely competitive with 8-member ensembles: guided Restart is the most accurate on the winds, and our ablated graded corrector on temperature and geopotential. RED-diff, DPS, and PnP-DM show poor performance, the latter two at an order of magnitude more cost per draw, because their decoupled annealing runs an inner reverse-diffusion and Langevin chain at every noise level. On the sparse radiosondes, in contrast, every other sampling technique performs inferior to our sampler on every variable, and the variable-splitting methods fail badly (we did not pursue some methods that showed clear inferiority). We conjecture that the decoupled-annealing robustness that makes these methods accurate on nonlinear closed-form operators offers little advantage for our smooth, differentiable operator, where gradient guidance is already stable.

settingt2mu10mv10mq1000z500
guidance scale (γ=0.1\gamma=0.1)
scale 1.51.78±1.021.57±0.091.63±0.080.82±0.0997.8±5.3
scale 2.01.39±0.401.48±0.051.55±0.050.77±0.0590.6±5.9
scale 2.51.14±0.021.41±0.011.48±0.020.74±0.0283.3±2.1
scale 3.01.13±0.021.39±0.021.45±0.020.73±0.0180.7±1.8
scale 3.51.14±0.011.37±0.011.44±0.020.73±0.0279.4±2.1
scale 4.01.15±0.021.36±0.021.43±0.020.74±0.0279.5±2.4
annealing γ\gamma (scale 2.5)
γ=10−2\gamma=10^{-2}1.80±0.091.60±0.031.65±0.030.93±0.03110.0±6.2
γ=3×10−2\gamma=3 \times10^{-2}1.37±0.071.38±0.021.44±0.030.81±0.0386.2±3.9
γ=10−1\gamma=10^{-1}1.14±0.021.41±0.011.48±0.020.74±0.0283.3±2.1
γ=3×10−1\gamma=3 \times10^{-1}1.76±0.551.76±0.091.83±0.080.87±0.05129.2±18.9

Table 13. SR likelihood-weight ablation (base DPS, 50 steps, 4 tuning windows disjoint from the test set): per-variable physical RMSE (units as Table 8; bold = best within each sweep). Guidance scale swept at γ=0.1\gamma=0.1; γ\gamma swept at scale 2.5. The scale trend flattens near 3–3.5; the production SR runs use scale 4.0, γ=0.1\gamma=0.1.

A major issue for the station observations is how the data term is scaled. The strength hyperparameters used for SR case are far too weak for the sub-steps of the variable-splitting samplers (Table 18). Once that strength is re-tuned for the station likelihood (DiffPIR σn=5×10−4\sigma_n=5 \times10^{-4}, PnP-DM τ=10−4\tau=10^{-4}, matching the DAPS retune), the gap shrinks considerably and DiffPIR comes close to the guided samplers, but none of them beats our sampler on any variable. The remaining gap can be accounted for by the changes in the number of station locations from frame to frame, which keeps the data sub-step poorly scaled. The performance of these methods reflects our implementations rather than the methods in general.

settingt2mu10mv10mq1000z500
SR
DiffPIR (w=100w=100)1.08±0.091.16±0.021.20±0.020.66±0.0370.1±3.6
DiffPIR (w=300w=300)1.20±0.061.49±0.041.56±0.030.76±0.0394.5±3.3
PnP-DM (τ=0.02\tau=0.02)2.32±1.011.93±0.091.95±0.081.03±0.08158.3±12.4
PnP-DM (τ=0.01\tau=0.01)1.56±0.341.50±0.061.53±0.060.77±0.04101.2±7.8
PnP-DM (τ=0.005\tau=0.005)1.55±0.301.48±0.041.54±0.030.76±0.0395.5±6.5
IGRA
DiffPIR (σn=5×10−4\sigma_n=5 \times10^{-4}, 8-member)2.53±0.293.32±0.213.39±0.181.28±0.06600.0±95.5
DiffPIR (σn=5×10−4\sigma_n=5 \times10^{-4}, w=300w=300)3.43±0.684.55±0.184.75±0.221.74±0.12835.3±52.6
DiffPIR (σn=5×10−3\sigma_n=5 \times10^{-3})3.48±0.824.72±0.214.84±0.271.86±0.19877.2±63.8
DiffPIR (σn=0.05\sigma_n=0.05)6.73±2.625.56±0.285.68±0.232.84±0.821360.5±285.7
PnP-DM (τ=3×10−5\tau=3 \times10^{-5})14.56±1.877.51±0.584.69±0.233.39±0.292643.2±212.0
PnP-DM (τ=10−4\tau=10^{-4}, 8-member)4.13±0.584.18±0.104.06±0.141.89±0.18857.9±37.5
PnP-DM (τ=0.005\tau=0.005)7.76±2.906.74±0.594.68±0.122.95±0.862210.0±283.1

Table 18. DiffPIR and PnP-DM ablation, per-variable physical RMSE (units as Table 8). Top block: SR; bottom: IGRA.

Variable-splitting samplers: further ablations

Tables 16–17 give further hyperparameter ablations behind the DAPS rows of Table 15, and Table 18 those for DiffPIR and PnP-DM. The likelihood weight τ\tau (the assumed measurement-noise scale in the data term of the inner Langevin) controls data-fitting strength. On SR a small τ\tau performs well, and on the station data a much smaller τ\tau recovers a usable performance. All DAPS runs use 40 annealing levels with 3 inner reverse-diffusion and 30 Langevin steps each, chosen for reasonable compute in comparison to other methods. This is roughly 1/8 of the InverseBench default denoiser budget. Even at this budget DAPS costs an order of magnitude more per draw than our sampler.

We also perform ablation studies on other methods. Because the decoder operator is nonlinear, we replace DiffPIR's closed-form proximal data solve Zhu et al. by a single clamped gradient step. Its prior-trust weight ω\omega is swept, where a larger ω\omega weakens the data step since the step size is α∝1/ω\alpha\propto1/\omega (data clamp 0.3 at ω=100\omega=100, 0.2 at ω=300\omega=300). DiffPIR runs 50 steps with ξ=0.1\xi=0.1 and uses our stabilized re-noising variant, with the effective noise computed from the pre-correction estimate. PnP-DM is the split-Gibbs sampler which uses a likelihood Langevin step anchored on the previous clean sample (coupling ρ set to the annealed σ) alternates with a stochastic reverse-flow prior step, at 40 annealing levels with 10 inner ancestral and 30 Langevin steps each.

methodNFEt2mu10mv10mq1000z500
Super-resolution (uniform space-time subsampling)
RED-diff [51]1501.30±0.131.65±0.061.70±0.050.78±0.02104.9±4.6
STeP-HMC [70]30†1.32±0.161.17±0.031.20±0.030.75±0.0886.9±13.0
guided Restart [90]851.05±0.041.07±0.021.10±0.020.63±0.0366.1±2.5
back-projection / DDNM [50]761.08±0.051.10±0.021.14±0.020.63±0.0369.3±2.8
graded corrector (ours, ablated)711.02±0.04<u>1.09±0.02</u>1.13±0.020.62±0.0360.7±1.1
DAPS [54]120†1.20±0.081.28±0.041.34±0.040.67±0.0378.6±3.0
DiffPIR [52]501.08±0.091.16±0.021.20±0.020.66±0.0370.1±3.6
PnP-DM [53]400†1.56±0.341.50±0.061.53±0.060.77±0.04101.2±7.8
ours (DPS+corr (N30)+λ0)47<u>1.05±0.03</u>1.09±0.02<u>1.13±0.02</u>0.63±0.03<u>63.9±1.7</u>
IGRA radiosondes (real soundings)
STeP-HMC [70]50†2.35±0.233.43±0.103.60±0.141.29±0.03613.9±29.8
guided Restart [90]95<u>2.25±0.20</u><u>3.38±0.10</u><u>3.55±0.14</u><u>1.27±0.03</u><u>590.2±28.4</u>
graded corrector (ours, ablated)1102.27±0.213.40±0.103.57±0.141.27±0.03597.1±29.3
DAPS [54]120†3.43±0.613.86±0.143.94±0.131.57±0.11767.9±69.1
DiffPIR [52]502.53±0.293.32±0.213.39±0.181.28±0.06600.0±95.5
PnP-DM [53]400†4.13±0.584.18±0.104.06±0.141.89±0.18857.9±37.5
ours (DPS+corr+DSG+λ0)761.90±0.133.01±0.173.08±0.181.15±0.04474.9±50.4

Table 15. Comparison with other existing samplers, on both observation geometries: per-variable physical RMSE (8-window mean of 8-member ensemble means; units as Table 8; bold = best, underline = second-best per panel). NFE counts denoiser evaluations per draw; † marks methods whose inner loops use additional compute.

settingt2mu10mv10mq1000z500
τ=0.022.16±0.801.76±0.081.82±0.070.87±0.07123.0±16.1
τ=0.011.20±0.081.28±0.041.34±0.040.67±0.0378.6±3.0
τ=0.01 + λ = 01.50±0.331.56±0.061.64±0.070.76±0.0396.5±5.5
τ=0.01 + DSG (lr 10^{-2})2.52±0.462.94±0.213.08±0.151.31±0.15258.0±34.2
τ=0.01 + DSG + (λ = 0)2.48±0.322.92±0.223.03±0.171.31±0.13250.6±21.7

Table 16. DAPS ablation on SR (8-window mean; 40 anneal steps, 3 inner reverse-diffusion + 30 Langevin steps each): per-variable physical RMSE (units as Table 8; bold = best).

settingt2mu10mv10mq1000z500
τ=0.017.93±3.175.69±0.285.92±0.273.13±0.971530.9±358.4
τ=0.0058.84±4.175.62±0.395.77±0.293.39±1.251586.2±486.5
τ=3 × 10^{-5}10.22±1.035.32±0.314.23±0.152.51±0.112118.5±136.9
τ=10^{-4} (8-member)3.43±0.613.86±0.143.94±0.131.57±0.11767.9±69.1
τ=10^{-4} + (λ = 0)4.24±0.854.97±0.155.13±0.252.12±0.29988.9±100.0
DSG (lr 5 × 10^{-3})5.75±1.645.37±0.435.50±0.302.52±0.591911.6±252.5
DSG (lr 2 × 10^{-2})5.02±0.755.17±0.295.47±0.222.41±0.411064.7±118.1
DSG (lr 10^{-2})5.03±1.015.25±0.235.45±0.232.36±0.321118.8±127.9
DSG (lr 10^{-2}) + (λ = 0)4.55±0.815.12±0.265.29±0.142.29±0.331032.7±123.5

Table 17. DAPS ablation on IGRA: per-variable physical RMSE (units as Table 8; bold = best per column). The row carried into the IGRA panel of Table 15 is τ=10^{-4}. The SR-tuned τ (0.005-0.01) badly underfits (note the large t2m errors); τ≈10^{-4} or the scale-invariant DSG step is needed. The τ ∈ {0.01, 0.005} rows use Langevin lr 2 × 10^{-4} and the τ ∈ {10^{-4}, 3 × 10^{-5}} rows lr 10^{-4}.

Model and training details

Tables 19 and 20 collect the complete architecture and training configuration of the two trained components, the autoencoder and the TrigFlow prior; everything else in the paper runs zero-shot on these frozen weights.

Architecture
parameters451.1 M (encoder 188.6 M, decoder 262.4 M)
widths / blocks[96, 192, 384, 768]; 3 residual blocks per level (+1 per decoder level)
level strides[(1, 2, 2), (2, 2, 2), (2, 1, 1)]
latent saturationsoftclip2, scale 10
surface conditioningland-sea mask + orography, area-resampled per decoder level, injected through zero-initialized 3×33 \times3 convolutions
dropout0.05
Optimization
objectivelatitude-weighted, variance-normalized MSE (variance floor 10−210^{-2}) + 0.05×0.05 \times (spatial-gradient + Laplacian + temporal-difference)
optimizerAdam, β=(0.9,0.95)\beta=(0.9, 0.95), weight decay 0
learning rate5×10−45 \times10^{-4}, cosine-annealed; gradient clip 5
batch=128=128
latent regularizerGaussian latent noise, std 0.02, before the decoder
epochs155
Data and hardware
training data32-frame ERA5 windows, 1979-2018 (2019 validation)
hardware16× NVIDIA A100-40GB
training time≈ 9 days

Table 19. Autoencoder: architecture and training details.

Grid-cell super-obbing and the observed-window length

Figure 25 shows the effect of the super-obbing step of § 4.4. This process collapses the clustered raw observations to one weighted super-observation per occupied grid cell. We observe that this lowers latitude-weighted forecast RMSE in the first forecast timesteps. Beyond day two the raw and super-obbed forecasts are essentially similar. However, we use super-obbing in our results following previous DA works [91].

The length of the observed window does not drastically change the outcomes either (Figure 26). Shortening it from two days (eight frames) to one day leaves day-1 to day-3 skill essentially unchanged even conditioning on a single analysis frame only slightly worsens the first forecast timestep. This result is consistent with previous work on AI based weather forecasting [92].

Observed-window ablation plots for t2m, t850, u10m, v10m, u200, and v200

Figure 26. Observed-window ablation for the in-situ obs→forecast task of § 4.4: conditioning on a two-day window, a one-day window, and a single analysis frame. The plots show Latitude-weighted RMSE against ERA5 versus lead.

Architecture
parameters525.4 M
inputstandardized AE latents (128, 8, 32, 64)
tokenizationpatch (1, 2, 2) →\rightarrow 4096 tokens
width / depth / heads1536 / 12 / 24; MLP ratio 4
timestep embeddingsinusoidal, size 384, input scale 1000
Optimization
objectiveTrigFlow velocity matching, σd=1\sigma_d=1, ln⁡σ∼N(0,1.52)\ln\sigma\sim\mathcal{N}(0,1.5^2), adaptive log-variance weighting; σ∈[0.002,80]\sigma\in[0.002, 80]
optimizerAdamW, lr 2×10−42 \times10^{-4}, β=(0.9,0.999)\beta=(0.9, 0.999), weight decay 0.01; gradient clip 1
lr schedule500-kimg linear ramp-up, floor at 0.05×0.05\times peak
batch size256
EMAhalf-life 500 kimg, ramp-up ratio 0.05
precisionbf16 autocast (TF32 matmul)
training length19,901 kilo images
Data and hardware
training dataAE latents of the ERA5 training windows (1979-2018)
hardware8×\times NVIDIA A100-40GB
Training time≈\approx 5 days

Table 20. TrigFlow prior (DiT3D): architecture and training details.

Forecasting from the Aardvark latent observations

§ 4.4 uses only the fraction of the global observing system that our interpolation operator ingests directly. Especially fields at lower pressure levels are weak because a few hundred radiosonde measurements sample it sparsely and the satellite observations are excluded. To experiment with richer observations, we use the Aardvark latent observations [86], whose encoder maps several observation modalities (including the satellite radiances, scatterometer, and geostationary imagery) onto a regular grid of 24 ERA5 variables. We use the Aardvark latent observation to forecast a 23.25-day lead (Figure 27). This experiment is just an illustration, not a rigorous test case benchmark. The public Aardvark release contains only one observation data point, on 2018-08-18, (which falls within our training period). A held-out, multiple initial conditions test would require an extended observation-assembly pipeline, which we leave for future work. In this simplified experiment, we observe that the Aardvark latent lowers the forecast errors, with some variables performing better than GraphDOP.

Six-panel forecast plots for t2m, t850, u10m, v10m, u200, and v200

Figure 27. Forecast using a single (train-period) latent observation of Aardvark (2018-08-18). GraphDOP and IFS as reported in [28] through day 10. The plots show Latitude-weighted RMSE against ERA5 versus lead.

Extended results

This section expands the five-variable tables and the selected-variable figures of the main text across the full channel set: the complete per-variable RMSE tables for every experiment (Sec. E.1), the per-channel super-resolution reconstructions (Sec. E.2), and the reconstruction-versus-observation scatter for every observed variable (Sec. E.3).

Full per-variable physical RMSE

The main-text tables report five representative variables; here we give the latitude-weighted physical RMSE of all 69 output channels. Tables 21-26 are divided by variables and pressure levels and columns have the different tasks: super-resolution and the IGRA, ISD, and joint measurements, each with its recommended sampler configuration from Table 2 (mean±\pmstd).

variableSRIGRAISDJoint
2m temperature (K)1.05±\pm0.031.90±\pm0.132.21±\pm0.111.80±\pm0.11
10m uu-wind (m/s)1.09±\pm0.023.01±\pm0.173.34±\pm0.182.93±\pm0.14
10m vv-wind (m/s)1.13±\pm0.023.08±\pm0.183.33±\pm0.203.00±\pm0.17
MSLP (Pa)77.6±\pm2.1469.3±\pm44.4492.8±\pm43.1447.7±\pm38.1

Table 21. Full per-variable physical RMSE, Surface (SR: DPS+corr (N30)+λ\lambda0; stations: DPS+corr+DSG+λ\lambda0).

variableSRIGRAISDJoint
50 hPa109.6±4.1109.6 \pm4.1857.8±327.3857.8 \pm327.32461.9±466.12461.9 \pm466.1839.2±319.1839.2 \pm319.1
100 hPa93.6±8.593.6 \pm8.5709.6±168.8709.6 \pm168.82202.2±490.62202.2 \pm490.6703.0±164.4703.0 \pm164.4
150 hPa82.7±6.082.7 \pm6.0678.0±109.0678.0 \pm109.01969.2±407.91969.2 \pm407.9670.2±109.8670.2 \pm109.8
200 hPa80.3±5.380.3 \pm5.3684.6±84.0684.6 \pm84.01721.5±319.81721.5 \pm319.8676.1±83.1676.1 \pm83.1
250 hPa85.1±6.085.1 \pm6.0694.6±73.7694.6 \pm73.71495.6±237.11495.6 \pm237.1685.8±71.4685.8 \pm71.4
300 hPa81.8±4.481.8 \pm4.4668.1±67.4668.1 \pm67.41287.7±179.81287.7 \pm179.8659.5±64.6659.5 \pm64.6
400 hPa73.9±2.973.9 \pm2.9566.4±57.4566.4 \pm57.4942.0±108.5942.0 \pm108.5558.7±54.7558.7 \pm54.7
500 hPa63.9±1.763.9 \pm1.7474.9±50.4474.9 \pm50.4701.3±65.8701.3 \pm65.8467.6±48.5467.6 \pm48.5
600 hPa56.9±1.356.9 \pm1.3410.1±45.2410.1 \pm45.2540.8±38.3540.8 \pm38.3402.2±43.4402.2 \pm43.4
700 hPa54.7±1.754.7 \pm1.7370.7±40.5370.7 \pm40.5443.5±25.5443.5 \pm25.5361.2±38.3361.2 \pm38.3
850 hPa54.0±1.754.0 \pm1.7349.0±34.9349.0 \pm34.9383.0±29.8383.0 \pm29.8336.8±31.4336.8 \pm31.4
925 hPa56.4±1.956.4 \pm1.9355.6±34.0355.6 \pm34.0383.3±32.8383.3 \pm32.8341.9±29.8341.9 \pm29.8
1000 hPa61.0±1.861.0 \pm1.8369.2±34.5369.2 \pm34.5392.9±34.7392.9 \pm34.7353.5±29.9353.5 \pm29.9

Table 22. Full per-variable physical RMSE, Geopotential (m2^2/s2^2) (SR: DPS+corrDPS+corr (N30N30) +λ0+\lambda_0; stations: DPS+corr+DSG+λ0DPS+corr+DSG+\lambda_0).

variableSRIGRAISDJoint
50 hPa1.78±0.051.78 \pm0.054.47±0.924.47 \pm0.9210.29±1.3810.29 \pm1.384.43±0.934.43 \pm0.93
100 hPa2.10±0.062.10 \pm0.064.91±0.254.91 \pm0.257.59±0.737.59 \pm0.734.85±0.264.85 \pm0.26
150 hPa2.40±0.062.40 \pm0.066.10±0.356.10 \pm0.359.35±0.649.35 \pm0.646.02±0.366.02 \pm0.36
200 hPa2.57±0.052.57 \pm0.057.46±0.477.46 \pm0.4710.60±0.5910.60 \pm0.597.35±0.457.35 \pm0.45
250 hPa2.72±0.052.72 \pm0.058.26±0.498.26 \pm0.4911.06±0.5111.06 \pm0.518.16±0.458.16 \pm0.45
300 hPa2.73±0.052.73 \pm0.058.19±0.428.19 \pm0.4210.56±0.4610.56 \pm0.468.10±0.408.10 \pm0.40
400 hPa2.50±0.062.50 \pm0.066.95±0.336.95 \pm0.338.63±0.388.63 \pm0.386.88±0.306.88 \pm0.30
500 hPa2.19±0.042.19 \pm0.045.74±0.295.74 \pm0.296.96±0.346.96 \pm0.345.68±0.275.68 \pm0.27
600 hPa2.00±0.042.00 \pm0.045.01±0.275.01 \pm0.275.90±0.305.90 \pm0.304.94±0.254.94 \pm0.25
700 hPa1.87±0.041.87 \pm0.044.57±0.244.57 \pm0.245.31±0.285.31 \pm0.284.50±0.224.50 \pm0.22
850 hPa1.68±0.031.68 \pm0.034.27±0.234.27 \pm0.234.86±0.264.86 \pm0.264.18±0.204.18 \pm0.20
925 hPa1.54±0.041.54 \pm0.044.28±0.224.28 \pm0.224.79±0.254.79 \pm0.254.18±0.184.18 \pm0.18
1000 hPa1.20±0.031.20 \pm0.033.33±0.193.33 \pm0.193.75±0.223.75 \pm0.223.25±0.163.25 \pm0.16

Table 23. Full per-variable physical RMSE, Zonal wind uu (m/s) (SR: DPS+corrDPS+corr (N30N30) +λ0+\lambda_0; stations: DPS+corr+DSG+λ0DPS+corr+DSG+\lambda_0).

variableSRIGRAISDJoint
50 hPa1.73±0.041.73 \pm0.043.39±0.573.39 \pm0.575.10±0.665.10 \pm0.663.37±0.583.37 \pm0.58
100 hPa2.07±0.072.07 \pm0.074.34±0.294.34 \pm0.295.76±0.135.76 \pm0.134.30±0.264.30 \pm0.26
150 hPa2.35±0.072.35 \pm0.075.79±0.425.79 \pm0.427.74±0.317.74 \pm0.315.72±0.395.72 \pm0.39
200 hPa2.53±0.072.53 \pm0.077.37±0.577.37 \pm0.579.57±0.449.57 \pm0.447.24±0.557.24 \pm0.55
250 hPa2.70±0.052.70 \pm0.058.39±0.628.39 \pm0.6210.42±0.5010.42 \pm0.508.25±0.618.25 \pm0.61
300 hPa2.73±0.042.73 \pm0.048.38±0.538.38 \pm0.5310.07±0.3810.07 \pm0.388.25±0.528.25 \pm0.52
400 hPa2.49±0.052.49 \pm0.057.06±0.427.06 \pm0.428.21±0.288.21 \pm0.286.95±0.406.95 \pm0.40
500 hPa2.17±0.042.17 \pm0.045.77±0.395.77 \pm0.396.60±0.276.60 \pm0.275.67±0.375.67 \pm0.37
600 hPa1.97±0.031.97 \pm0.034.94±0.374.94 \pm0.375.55±0.285.55 \pm0.284.84±0.354.84 \pm0.35
700 hPa1.84±0.031.84 \pm0.034.42±0.324.42 \pm0.324.89±0.264.89 \pm0.264.33±0.304.33 \pm0.30
850 hPa1.67±0.041.67 \pm0.044.13±0.294.13 \pm0.294.45±0.264.45 \pm0.264.03±0.274.03 \pm0.27
925 hPa1.57±0.041.57 \pm0.044.29±0.274.29 \pm0.274.62±0.274.62 \pm0.274.18±0.264.18 \pm0.26
1000 hPa1.25±0.021.25 \pm0.023.44±0.203.44 \pm0.203.75±0.253.75 \pm0.253.35±0.203.35 \pm0.20

Table 24. Full per-variable physical RMSE, Meridional wind vv (m/s) (SR: DPS+corrDPS+corr (N30N30) +λ0+\lambda_0; stations: DPS+corr+DSG+λ0DPS+corr+DSG+\lambda_0).

Six-panel line plots showing RMSE by forecast lead for t2m, t850, u10m, v10m, u200, and v200

Figure 25. Effect of grid-cell super-obbing on forecast skill: the raw clustered observations versus one super-observation per cell, both compared against ERA5 and averaged over the eight test initial conditions (8-member ensembles). Gray reference lines mark persistence of the last observed frame (dashed) and the annual climatology (dotted).

Per-channel super-resolution reconstructions

The qualitative figures in the main text show a small set of the variables. This appendix shows the reconstruction of every one of the 69 output channels: the four surface fields and the five upper-air fields (geopotential, zonal and meridional wind, temperature, and specific humidity), each at all 13 pressure levels (50-1000 hPa; Figure 28-Figure 38). Every panel shows the ERA5 truth, the posterior ensemble mean (the same 8-member protocol as the quantitative tables), and the signed error (mean − truth) for the super-resolution task (8×8 \times spatial subsample on every fourth frame, DPS+corr (N30N_{30}) sampler) at a representative observed frame.

Surface variables: truth, ensemble mean, and error

Figure 28. Surface variables: ERA5 truth, 8-member ensemble mean, and signed error (mean − truth; red positive, blue negative) for the super-resolution task. The following per-level figures use the same panel layout.

Specific humidity (per pressure level), part 2/2

Figure 38. Specific humidity (per pressure level), part 2/2; same panel layout as Figure 28.

Per-variable observation scatter

The main text shows truth-vs-reconstruction scatter for three variables per task (Figure 11 and Figure 13). Here we give the record of all remaining variables, at the station locations and at off-station grid points, pooled over the eight observed frames and eight windows.

variableSRIGRAISDJoint
50 hPa0.92±0.030.92 \pm0.032.47±0.632.47 \pm0.635.91±1.055.91 \pm1.052.48±0.602.48 \pm0.60
100 hPa0.86±0.030.86 \pm0.032.29±0.412.29 \pm0.414.60±0.684.60 \pm0.682.26±0.432.26 \pm0.43
150 hPa0.70±0.020.70 \pm0.022.25±0.272.25 \pm0.274.57±0.924.57 \pm0.922.23±0.262.23 \pm0.26
200 hPa0.72±0.020.72 \pm0.022.68±0.242.68 \pm0.245.53±0.985.53 \pm0.982.65±0.212.65 \pm0.21
250 hPa0.73±0.020.73 \pm0.022.43±0.112.43 \pm0.115.38±1.065.38 \pm1.062.42±0.132.42 \pm0.13
300 hPa0.71±0.020.71 \pm0.022.15±0.142.15 \pm0.145.03±0.925.03 \pm0.922.12±0.152.12 \pm0.15
400 hPa0.71±0.020.71 \pm0.022.27±0.152.27 \pm0.154.79±0.724.79 \pm0.722.21±0.132.21 \pm0.13
500 hPa0.72±0.010.72 \pm0.012.26±0.142.26 \pm0.144.27±0.544.27 \pm0.542.20±0.102.20 \pm0.10
600 hPa0.74±0.010.74 \pm0.012.23±0.132.23 \pm0.133.84±0.433.84 \pm0.432.16±0.092.16 \pm0.09
700 hPa0.77±0.010.77 \pm0.012.19±0.142.19 \pm0.143.49±0.373.49 \pm0.372.12±0.102.12 \pm0.10
850 hPa0.97±0.020.97 \pm0.022.37±0.152.37 \pm0.153.00±0.133.00 \pm0.132.29±0.142.29 \pm0.14
925 hPa0.93±0.030.93 \pm0.032.19±0.182.19 \pm0.182.62±0.132.62 \pm0.132.09±0.152.09 \pm0.15
1000 hPa0.93±0.030.93 \pm0.031.96±0.171.96 \pm0.172.31±0.112.31 \pm0.111.86±0.141.86 \pm0.14

Table 25. Full per-variable physical RMSE, Temperature (K) (SR: DPS+corrDPS+corr (N30)+λ0\lambda_0; stations: DPS+corr+DSG+λ0DPS+corr+DSG+\lambda_0).

variableSRIGRAISDJoint
50 hPa0.000±0.0000.000 \pm0.0000.000±0.0000.000 \pm0.0000.000±0.0000.000 \pm0.0000.000±0.0000.000 \pm0.000
100 hPa0.000±0.0000.000 \pm0.0000.001±0.0000.001 \pm0.0000.001±0.0000.001 \pm0.0000.001±0.0000.001 \pm0.000
150 hPa0.002±0.0000.002 \pm0.0000.002±0.0000.002 \pm0.0000.003±0.0000.003 \pm0.0000.002±0.0000.002 \pm0.000
200 hPa0.010±0.0010.010 \pm0.0010.014±0.0010.014 \pm0.0010.019±0.0020.019 \pm0.0020.014±0.0010.014 \pm0.001
250 hPa0.034±0.0020.034 \pm0.0020.050±0.0040.050 \pm0.0040.063±0.0040.063 \pm0.0040.050±0.0030.050 \pm0.003
300 hPa0.078±0.0030.078 \pm0.0030.118±0.0080.118 \pm0.0080.148±0.0080.148 \pm0.0080.117±0.0080.117 \pm0.008
400 hPa0.232±0.0070.232 \pm0.0070.361±0.0210.361 \pm0.0210.463±0.0220.463 \pm0.0220.358±0.0210.358 \pm0.021
500 hPa0.447±0.0140.447 \pm0.0140.710±0.0220.710 \pm0.0220.886±0.0430.886 \pm0.0430.703±0.0220.703 \pm0.022
600 hPa0.649±0.0120.649 \pm0.0121.061±0.0171.061 \pm0.0171.248±0.0631.248 \pm0.0631.050±0.0151.050 \pm0.015
700 hPa0.873±0.0220.873 \pm0.0221.419±0.0481.419 \pm0.0481.645±0.0871.645 \pm0.0871.402±0.0441.402 \pm0.044
850 hPa1.064±0.0381.064 \pm0.0381.622±0.0571.622 \pm0.0571.859±0.1101.859 \pm0.1101.603±0.0531.603 \pm0.053
925 hPa0.794±0.0270.794 \pm0.0271.220±0.0551.220 \pm0.0551.497±0.1121.497 \pm0.1121.206±0.0541.206 \pm0.054
1000 hPa0.627±0.0310.627 \pm0.0311.151±0.0361.151 \pm0.0361.411±0.0941.411 \pm0.0941.132±0.0371.132 \pm0.037

Table 26. Full per-variable physical RMSE, Specific humidity (g/kg) (SR: DPS+corrDPS+corr (N30)+λ0\lambda_0; stations: DPS+corr+DSG+λ0DPS+corr+DSG+\lambda_0).

Geopotential (per pressure level), part 1/2; same panel layout as Fig. 28.

Figure 29. Geopotential (per pressure level), part 1/2; same panel layout as Figure 28.

Geopotential per pressure level, part 2/2, showing truth, ensemble mean, and error across six pressure levels

Figure 30. Geopotential (per pressure level), part 2/2; same panel layout as Figure 28.

Zonal wind $u$ per pressure level, part 1/2

Figure 31. Zonal wind uu (per pressure level), part 1/2; same panel layout as Figure 28.

Zonal wind $u$ (per pressure level), part 2/2

Figure 32. Zonal wind uu (per pressure level), part 2/2; same panel layout as Figure 28.

Meridional wind $v$ (per pressure level), part 1/2

Figure 33. Meridional wind vv (per pressure level), part 1/2; same panel layout as Figure 28.

Meridional wind $v$ (per pressure level) (part 2/2), showing truth, ensemble mean, and error across six pressure levels

Figure 34. Meridional wind vv (per pressure level), part 2/2; same panel layout as Figure 28.

Temperature (per pressure level), part 1/2

Figure 35. Temperature (per pressure level), part 1/2; same panel layout as Figure 28.

Temperature (per pressure level), part 2/2

Figure 36. Temperature (per pressure level), part 2/2; same panel layout as Fig. 28.

Specific humidity (per pressure level), part 1/2; same panel layout as Fig. 28

Figure 37. Specific humidity (per pressure level), part 1/2; same panel layout as Figure 28.

IGRA: ERA5 truth versus reconstruction at radiosonde station locations

Figure 39. IGRA: ERA5 truth vs. reconstruction at the radiosonde station locations, for a representative subset of the 63 observed variables (the surface fields, and each upper-air field sampled at an upper, middle and lower level).

IGRA: ERA5 truth vs. reconstruction at off-station grid points

Figure 40. IGRA: ERA5 truth vs. reconstruction at off-station grid points, for the same representative subset of the 63 observed variables. Winds and humidity show the largest off-station scatter.

ISD surface observations: ERA5 truth vs. reconstruction at stations and off-station grid points

Figure 41. ISD surface observations: ERA5 truth vs. reconstruction at stations (top) and off-station grid points (bottom), all four observed variables.

References

  1. [1]A Arakawa, J-H Jung, and C-M Wu. Toward unification of the multiscale modeling of the atmosphere. Atmospheric Chemistry and Physics, 11(8):3731–3742, 2011.DOI
  2. [2]Horst J Neugebauer. Dynamics of multiscale earth systems, volume 97. Springer Science & Business Media, 2003.DOI
  3. [3]Wei-Kuo Tao and Mitchell W Moncrieff. Multiscale cloud system modeling. Reviews of Geophysics, 47(4), 2009.DOI
  4. [4]Jean-Noël Thépaut. Satellite data assimilation in numerical weather prediction: An overview. In Proceedings of ECMWF Seminar on Recent Developments in Data Assimilation for Atmosphere and Ocean, ECMWF, Reading, UK, pages 8–12, 2003.
  5. [5]François Bouttier and Graeme Kelly. Observing-system experiments in the ecmwf 4d-var data assimilation system. Quarterly Journal of the Royal Meteorological Society, 127(574):1469–1488, 2001.
  6. [6]Christopher K Wikle and L Mark Berliner. A bayesian tutorial for data assimilation. Physica D: Nonlinear Phenomena, 230(1-2):1–16, 2007.DOI
  7. [7]Kody JH Law and Andrew M Stuart. Evaluating data assimilation algorithms. Monthly weather review, 140(11):3757–3782, 2012.DOI
  8. [8]Hans Hersbach, Bill Bell, Paul Berrisford, Shoji Hirahara, Andrés Horányi, Joaquín Muñoz-Sabater, Julien Nicolas, Carole Peubey, Raluca Radu, Dinand Schepers, et al. The era5 global reanalysis. Quarterly journal of the royal meteorological society, 146(730):1999–2049, 2020.
  9. [9]Istvan Szunyogh. Applicable atmospheric dynamics: Techniques for the exploration of atmospheric dynamics. World Scientific, 2014.
  10. [10]Bin Wang, Xiaolei Zou, and Jiang Zhu. Data assimilation and its applications. Proceedings of the National Academy of Sciences, 97(21):11143–11144, 2000.pubmed.ncbi.nlm.nih.gov/11027322
  11. [11]Rolf H Reichle. Data assimilation methods in the earth sciences. Advances in water resources, 31(11):1411–1418, 2008.DOI
  12. [12]Ruslan Salakhutdinov. Learning deep generative models. Annual Review of Statistics and Its Application, 2(1):361–385, 2015.DOI
  13. [13]Han Gao, Sebastian Kaltenbach, and Petros Koumoutsakos. Generative learning for forecasting the dynamics of high-dimensional complex systems. Nature Communications, 15(1):8904, 2024.
  14. [14]Ilan Price, Alvaro Sanchez-Gonzalez, Ferran Alet, Tom R Andersson, Andrew El-Kadi, Dominic Masters, Timo Ewalds, Jacklynn Stott, Shakir Mohamed, Peter Battaglia, et al. Probabilistic weather forecasting with machine learning. Nature, 637(8044):84–90, 2025.DOI
  15. [15]Yang Song, Conor Durkan, Iain Murray, and Stefano Ermon. Maximum likelihood training of score-based diffusion models. Advances in neural information processing systems, 34:1415–1428, 2021.arxiv.org/abs/2101.09258
  16. [16]Yang Song, Jascha Sohl-Dickstein, Diederik P Kingma, Abhishek Kumar, Stefano Ermon, and Ben Poole. Score-based generative modeling through stochastic differential equations. arXiv preprint arXiv:2011.13456, 2020.arxiv.org/abs/2011.13456
  17. [17]Tero Karras, Miika Aittala, Timo Aila, and Samuli Laine. Elucidating the design space of diffusion-based generative models. Advances in neural information processing systems, 35:26565–26577, 2022.arxiv.org/abs/2206.00364
  18. [18]Yaron Lipman, Ricky TQ Chen, Heli Ben-Hamu, Maximilian Nickel, and Matt Le. Flow matching for generative modeling. arXiv preprint arXiv:2207.02747, 2022.
  19. [19]Patrick Esser, Smith Kulal, Andreas Blattmann, Rahim Entezari, Jonas Müller, Harry Saini, Yam Levi, Dominik Lorenz, Axel Sauer, Frederic Boesel, et al. Scaling rectified flow transformers for high-resolution image synthesis. In Forty-first international conference on machine learning, 2024.
  20. [20]Alexandros Graikos, Nikolay Malkin, Nebojsa Jojic, and Dimitris Samaras. Diffusion models as plug-and-play priors. Advances in Neural Information Processing Systems, 35:14715–14728, 2022.DOI
  21. [21]Hyeongjin Chung, Jeongsol Kim, Michael T Mccann, Marc L Klaszky, and Jong Chul Ye. Diffusion posterior sampling for general noisy inverse problems. arXiv preprint arXiv:2209.14687, 2022.arxiv.org/abs/2209.14687
  22. [22]Dibyajyoti Chakraborty, Haiwen Guan, Jason Stock, Troy Arcomano, Guido Cervone, and Romit Maulik. Multimodal atmospheric super-resolution with deep generative models. Machine Learning: Earth, 2(1):015001, 2026.
  23. [23]Cheng Lu and Yang Song. Simplifying, stabilizing and scaling continuous-time consistency models. In International Conference on Learning Representations, volume 2025, pages 50611–50649, 2025.arxiv.org/abs/2410.11081
  24. [24]William Peebles and Saining Xie. Scalable diffusion models with transformers. In Proceedings of the IEEE/CVF international conference on computer vision, pages 4195–4205, 2023.arxiv.org/abs/2212.09748
  25. [25]Imke Durre, Russell S Vose, and David B Wuertz. Overview of the integrated global radiosonde archive. Journal of Climate, 19(1):53–68, 2006.DOI
  26. [26]Adam Smith, Neal Lott, and Russ Vose. The integrated surface database: Recent developments and partnerships. Bulletin of the American Meteorological Society, 92(6):704–708, 2011.DOI
  27. [27]Eric Freeman, Scott D Woodruff, Steven J Worley, Sandra J Lubker, Elizabeth C Kent, William E Angel, David I Berry, Philip Brohan, Ryan Eastman, Lydia Gates, et al. Icoads release 3.0: a major update to the historical marine climate record. International Journal of Climatology, 37(5):2211–2232, 2017.
  28. [28]Mihai Alexe, Eulalie Boucher, Peter Lean, Ewan Pinnington, Patrick Laloyaux, Anthony McNally, Simon Lang, Matthew Chantry, Chris Burrows, Marcin Chrust, et al. Graphdop: Towards skilful data-driven medium-range weather forecasts learnt and initialised directly from observations. arXiv preprint arXiv:2412.15687, 2024.
  29. [29]Kai Fukami, Koji Fukagata, and Kunihiko Taira. Super-resolution reconstruction of turbulent flows with machine learning. Journal of Fluid Mechanics, 870:106–120, 2019.
  30. [30]Mojtaba F Fathi, Isaac Perez-Raya, Ahmadreza Baghaie, Philipp Berg, Gabor Janiga, Amirhossein Arzani, and Roshan M D’Souza. Super-resolution and denoising of 4d-flow mri using physics-informed deep neural nets. Computer Methods and Programs in Biomedicine, 197:105729, 2020.
  31. [31]Daniel Kelshaw, Georgios Rigas, and Luca Magri. Physics-informed cnns for super-resolution of sparse observations on dynamical systems. arXiv preprint arXiv:2210.17319, 2022.
  32. [32]Kai Fukami, Koji Fukagata, and Kunihiko Taira. Super-resolution analysis via machine learning: a survey for fluid flows. Theoretical and Computational Fluid Dynamics, 37(4):421–444, 2023.
  33. [33]Han Gao, Luning Sun, and Jian-Xun Wang. Super-resolution and denoising of fluid flow using physics-informed convolutional neural networks without high-resolution labels. Physics of Fluids, 33(7), 2021.
  34. [34]Pu Ren, Chengping Rao, Yang Liu, Zihan Ma, Qi Wang, Jian-Xun Wang, and Hao Sun. Physr: Physics-informed deep super-resolution for spatiotemporal data. Journal of Computational Physics, 492:112438, 2023.
  35. [35]Kai Fukami and Kunihiko Taira. Single-snapshot machine learning for super-resolution of turbulence. Journal of Fluid Mechanics, 1001:A32, 2024.
  36. [36]Shivam Barwey, Pinaki Pal, Saumil Patel, Riccardo Balin, Bethany Lusch, Venkatram Vishwanath, Romit Maulik, and Ramesh Balakrishnan. Mesh-based super-resolution of fluid flows with multiscale graph neural networks. Computer Methods in Applied Mechanics and Engineering, 443:118072, 2025.
  37. [37]Kai Fukami, Romit Maulik, Nesar Ramachandra, Koji Fukagata, and Kunihiko Taira. Global field reconstruction from sparse sensors with voronoi tessellation-assisted deep learning. Nature Machine Intelligence, 3(11):945–951, 2021.
  38. [38]Romit Maulik, Kai Fukami, Nesar Ramachandra, Koji Fukagata, and Kunihiko Taira. Probabilistic neural networks for fluid flow surrogate modeling and data recovery. Physical Review Fluids, 5(10):104401, 2020.
  39. [39]Romit Maulik, Romain Egele, Krishnan Raghavan, and Prasanna Balaprakash. Quantifying uncertainty for deep learning based forecasting and flow-reconstruction using neural architecture search ensembles. Physica D: Nonlinear Phenomena, 454:133852, 2023.
  40. [40]Pavel Izmailov, Dmitrii Podoprikhin, Timur Garipov, Dmitry Vetrov, and Andrew Gordon Wilson. Averaging weights leads to wider optima and better generalization. arXiv preprint arXiv:1803.05407, 2018.
  41. [41]Masaki Morimoto, Kai Fukami, Romit Maulik, Ricardo Vinuesa, and Koji Fukagata. Assessments of epistemic uncertainty using gaussian stochastic weight averaging for fluid-flow regression. Physica D: Nonlinear Phenomena, 440:133454, 2022.
  42. [42]Jascha Sohl-Dickstein, Eric Weiss, Niru Maheswaranathan, and Surya Ganguli. Deep unsupervised learning using nonequilibrium thermodynamics. In International conference on machine learning, pages 2256–2265. pmlr, 2015.
  43. [43]Jonathan Ho, Ajay Jain, and Pieter Abbeel. Denoising diffusion probabilistic models. Advances in neural information processing systems, 33:6840–6851, 2020.arxiv.org/abs/2006.11239
  44. [44]Yang Song and Stefano Ermon. Generative modeling by estimating gradients of the data distribution. Advances in neural information processing systems, 32, 2019.
  45. [45]Aapo Hyvärinen. Estimation of non-normalized statistical models by score matching. Journal of Machine Learning Research, 6(4), 2005.DOI
  46. [46]Xingchao Liu, Chengyue Gong, and Qiang Liu. Flow straight and fast: Learning to generate and transfer data with rectified flow. arXiv preprint arXiv:2209.03003, 2022.arxiv.org/abs/2209.03003
  47. [47]Michael Albergo, Nicholas M Boffi, and Eric Vanden-Eijnden. Stochastic interpolants: A unifying framework for flows and diffusions. Journal of Machine Learning Research, 26(209):1–80, 2025.
  48. [48]Jiaming Song, Arash Vahdat, Morteza Mardani, and Jan Kautz. Pseudoinverse-guided diffusion models for inverse problems. In International conference on learning representations, 2023.
  49. [49]Bahjat Kawar, Michael Elad, Stefano Ermon, and Jiaming Song. Denoising diffusion restoration models. Advances in neural information processing systems, 35:23593–23606, 2022.arxiv.org/abs/2201.11793
  50. [50]Yinhui Wang, Jiwen Yu, and Jian Zhang. Zero-shot image restoration using denoising diffusion null-space model. arXiv preprint arXiv:2212.00490, 2022.arxiv.org/abs/2212.00490
  51. [51]Morteza Mardani, Jiaming Song, Jan Kautz, and Arash Vahdat. A variational perspective on solving inverse problems with diffusion models. In International Conference on Learning Representations, volume 2024, pages 28027–28053, 2024.arxiv.org/abs/2305.04391
  52. [52]Yuanzhi Zhu, Kai Zhang, Jingyun Liang, Jiezhang Cao, Bihan Wen, Radu Timofte, and Luc Van Gool. Denoising diffusion models for plug-and-play image restoration. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 1219–1229, 2023.arxiv.org/abs/2305.08995
  53. [53]Zihui Wu, Yu Sun, Yifan Chen, Bingliang Zhang, Yisong Yue, and Katherine L Bouman. Principled probabilistic imaging using diffusion models as plug-and-play priors. Advances in Neural Information Processing Systems, 37:118389–118427, 2024.arxiv.org/abs/2405.18782
  54. [54]Bingliang Zhang, Wenda Chu, Julius Berner, Chenlin Meng, Anima Anandkumar, and Yang Song. Improving diffusion inverse problem solving with decoupled noise annealing. In Proceedings of the Computer Vision and Pattern Recognition Conference, pages 20895–20905, 2025.DOI
  55. [55]Litu Rout, Negin Raoof, Giannis Daras, Constantine Caramanis, Alex Dimakis, and Sanjay Shakkottai. Solving linear inverse problems provably via posterior sampling with latent diffusion models. Advances in Neural Information Processing Systems, 36:49960–49990, 2023.arxiv.org/abs/2307.00619
  56. [56]Bowen Song, Soo Min Kwon, Zecheng Zhang, Xinyu Hu, Qing Qu, and Liyue Shen. Solving inverse problems with latent diffusion models via hard data consistency. In International Conference on Learning Representations, volume 2024, pages 7624–7654, 2024.arxiv.org/abs/2307.08123
  57. [57]Hongkai Zheng, Wenda Chu, Bingliang Zhang, Zihui Wu, Austin Wang, Berthy Feng, Caifeng Zou, Yu Sun, Nikola Kovachki, Zachary Ross, et al. Inversebench: Benchmarking plug-and-play diffusion priors for inverse problems in physical sciences. In International Conference on Learning Representations, volume 2025, pages 90912–90940, 2025.arxiv.org/abs/2503.11043
  58. [58]Morteza Mardani, Noah Brenowitz, Yair Cohen, Jaideep Pathak, Chieh-Yu Chen, Cheng-Chin Liu, Arash Vahdat, Mohammad Amin Nabian, Tao Ge, Akshay Subramaniam, et al. Residual corrective diffusion modeling for km-scale atmospheric downscaling. Communications Earth & Environment, 6(1):124, 2025.arxiv.org/abs/2309.15214
  59. [59]Prakhar Srivastava, Ruihan Yang, Gavin Kerrigan, Gideon Dresdner, Jeremy McGibbon, Christopher Bretherton, and Stephan Mandt. Precipitation downscaling with spatiotemporal video diffusion. Advances in Neural Information Processing Systems, 37:56374–56400, 2024.arxiv.org/abs/2312.06071
  60. [60]Robbie A Watt and Laura A Mansfield. Generative diffusion-based downscaling for climate. arXiv preprint arXiv:2404.17752, 2024.arxiv.org/abs/2404.17752
  61. [61]Lizao Li, Robert Carver, Ignacio Lopez-Gomez, Fei Sha, and John Anderson. Generative emulation of weather forecast ensembles with diffusion models. Science Advances, 10(13):eadk4489, 2024.DOI
  62. [62]Martin Andrae, Tomas Landelius, Joel Oskarsson, and Fredrik Lindsten. Continuous ensemble weather forecasting with diffusion models. In International Conference on Learning Representations, volume 2025, pages 26392–26416, 2025.arxiv.org/abs/2410.05431
  63. [63]Langwen Huang, Lukas Gianinazzi, Yuejiang Yu, Peter D Dueben, and Torsten Hoefler. Diffda: a diffusion model for weather-scale data assimilation. arXiv preprint arXiv:2401.05932, 2024.arxiv.org/abs/2401.05932
  64. [64]Peter Manshausen, Yair Cohen, Peter Harrington, Jaideep Pathak, Mike Pritchard, Piyush Garg, Morteza Mardani, Karthik Kashinath, Simon Byrne, and Noah Brenowitz. Generative data assimilation of sparse weather station observations at kilometer scales. Journal of Advances in Modeling Earth Systems, 17(10):e2024MS004505, 2025.arxiv.org/abs/2406.16947
  65. [65]Shangshang Yang, Congyi Nai, Xinyan Liu, Weidong Li, Jie Chao, Jingnan Wang, Leyi Wang, Xichen Li, Xi Chen, Bo Lu, et al. Generative assimilation and prediction for weather and climate. arXiv preprint arXiv:2503.03038, 2025.arxiv.org/abs/2503.03038
  66. [66]Yongquan Qu, Juan Nathaniel, Shuolin Li, and Pierre Gentine. Deep generative data assimilation in multimodal setting. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 449–459, 2024.arxiv.org/abs/2404.06665
  67. [67]Hao Wang, Jindong Han, Wei Fan, Weijia Zhang, and Hao Liu. Phydra: Physics-guided diffusion models for data assimilation in atmospheric systems. arXiv preprint arXiv:2505.12882, 2025.arxiv.org/abs/2505.12882
  68. [68]Feng Bao, Zezhong Zhang, and Guannan Zhang. A score-based filter for nonlinear data assimilation. Journal of Computational Physics, 514:113207, 2024.
  69. [69]Siming Liang, Hoang Tran, Feng Bao, Hristo G Chipilski, Peter Jan van Leeuwen, and Guannan Zhang. Ensemble score filter with image inpainting for data assimilation in tracking surface quasi-geostrophic dynamics with partial observations. arXiv preprint arXiv:2501.12419, 2025.arxiv.org/abs/2501.12419
  70. [70]Binjiang Zhang, Zihui Wu, Berthy T Feng, Yang Song, Yisong Yue, and Katherine L Bouman. Step: A framework for solving scientific video inverse problems with spatiotemporal diffusion priors. arXiv preprint arXiv:2504.07549, 2025.arxiv.org/abs/2504.07549
  71. [71]Gérôme Andry, Sacha Lewin, François Rozet, Omer Rochman, Victor Mangeleer, Matthias Pirlet, Elise Faulx, Marilaure Grégoire, and Gilles Louppe. Appa: Bending weather dynamics with latent diffusion models for global data assimilation. arXiv preprint arXiv:2504.18720, 2025.arxiv.org/abs/2504.18720
  72. [72]Bradley Efron. Tweedie’s formula and selection bias. Journal of the American Statistical Association, 106(496):1602–1614, 2011.pubmed.ncbi.nlm.nih.gov/22505788
  73. [73]Tero Karras, Miika Aittala, Jaakko Lehtinen, Janne Hellsten, Timo Aila, and Samuli Laine. Analyzing and improving the training dynamics of diffusion models. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 24174–24184, 2024.arxiv.org/abs/2312.02696
  74. [74]Jonathan Ho and Tim Salimans. Classifier-free diffusion guidance. arXiv preprint arXiv:2207.12598, 2022.arxiv.org/abs/2207.12598
  75. [75]François Rozet and Gilles Louppe. Score-based data assimilation. Advances in Neural Information Processing Systems, 36:40521–40541, 2023.arxiv.org/abs/2306.10574
  76. [76]Cheng Lu, Yuhao Zhou, Fan Bao, Jianfei Chen, Chongxuan Li, and Jun Zhu. Dpm-solver++: Fast solver for guided sampling of diffusion probabilistic models. Machine Intelligence Research, 22(4):730–751, 2025.DOI
  77. [77]Yuhan Wang, Suzhi Bi, Ying-Jun Angela Zhang, and Xiaojun Yuan. Traversing distortion-perception tradeoff using a single score-based generative model. In Proceedings of the Computer Vision and Pattern Recognition Conference, pages 2377–2386, 2025.arxiv.org/abs/2503.20297
  78. [78]Angela Castillo, Jonas Kohler, Juan C Pérez, Juan Pablo Pérez, Albert Pumarola, Bernard Ghanem, Pablo Arbeláez, and Ali Thabet. Adaptive guidance: Training-free acceleration of conditional diffusion models. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 39, pages 1962–1970, 2025.
  79. [79]Lingxiao Yang, Shutong Ding, Yifan Cai, Jingyi Yu, Jingya Wang, and Ye Shi. Guidance with spherical gaussian constraint for conditional diffusion. arXiv preprint arXiv:2402.03201, 2024.arxiv.org/abs/2402.03201
  80. [80]AC Lorenc. A global three-dimensional multivariate statistical interpolation scheme. Monthly Weather Review, 109(4):701–721, 1981.doi.org/10.1175/1520-0493(1981)109<0701:agtdms>2.0.co;2
  81. [81]Tilo Ochotta, Christoph Gebhardt, Dietmar Saupe, and Werner Wergen. Adaptive thinning of atmospheric observations in data assimilation with vector quantization and filtering methods. Quarterly Journal of the Royal Meteorological Society: A journal of the atmospheric sciences, applied meteorology and physical oceanography, 131(613):3427–3437, 2005.DOI
  82. [82]Stephan Rasp, Peter D Dueden, Sebastian Scher, Jonathan A Weyn, Soukayna Mouatadid, and Nils Thuerey. Weatherbench: a benchmark data set for data-driven weather forecasting. Journal of Advances in Modeling Earth Systems, 12(11):e2020MS002203, 2020.
  83. [83]Diederik P Kingma and Jimmy Ba. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980, 2014.arxiv.org/abs/1412.6980
  84. [84]Ilya Loshchilov and Frank Hutter. Decoupled weight decay regularization. arXiv preprint arXiv:1711.05101, 2017.arxiv.org/abs/1711.05101
  85. [85]Stephen E Cohn, NS Sivakumaran, and Ricardo Todling. A fixed-lag kalman smoother for retrospective data assimilation. Monthly Weather Review, 122(12):2838–2867, 1994.doi.org/10.1175/1520-0493(1994)122<2838:aflksf>2.0.co;2
  86. [86]Anna Allen, Stratis Markou, Will Tebbutt, James Requeima, Wessel P Bruinsma, Tom R Andersson, Michael Herzog, Nicholas D Lane, Matthew Chantry, J Scott Hosking, et al. End-to-end data-driven weather prediction. Nature, 641(8065):1172–1179, 2025.DOI
  87. [87]Aayush Gupta, Akshay Subramaniam, Michael S Pritchard, Karthik Kashinath, Sergey Frolov, Kelsey Lieberman, Christopher Miller, Nicholas Silverman, and Noah D Brenowitz. Healda: Highlighting the importance of initial errors in end-to-end ai weather forecasts. arXiv preprint arXiv:2601.17636, 2026.arxiv.org/abs/2601.17636
  88. [88]Tuomas Kynkäänniemi, Miika Aittala, Tero Karras, Samuli Laine, Timo Aila, and Jaakko Lehtinen. Applying guidance in a limited interval improves sample and distribution quality in diffusion models. Advances in Neural Information Processing Systems, 37:122458–122483, 2024.arxiv.org/abs/2404.07724
  89. [89]Chenlin Meng, Yutong He, Yang Song, Jiaming Song, Jiajun Wu, Jun-Yan Zhu, and Stefano Ermon. Sded it: Guided image synthesis and editing with stochastic differential equations. arXiv preprint arXiv:2108.01073, 2021.arxiv.org/abs/2108.01073
  90. [90]Yilun Xu, Mingyang Deng, Xiang Cheng, Yonglong Tian, Ziming Liu, and Tommi Jaakkola. Restart sampling for improving generative processes. Advances in Neural Information Processing Systems, 36:76806–76838, 2023.arxiv.org/abs/2306.14878
  91. [91]Ross N Hoffman. The effect of thinning and superobservations in a simple one-dimensional data analysis with mischaracterized error. Monthly Weather Review, 146(4):1181–1195, 2018.DOI
  92. [92]Remi Lam, Alvaro Sanchez-Gonzalez, Matthew Willson, Peter Wirnsberger, Meire Fortunato, Ferran Alet, Suman Ravuri, Timo Ewalds, Zach Eaton-Rosen, Weihua Hu, et al. Learning skillful medium-range global weather forecasting. Science, 382(6677):1416–1421, 2023.DOI

Paper details

vlnc:W_hsbz23y6
Version
v1 · latest
Published
Fresh — added to the Hub within the last 30 days
Added
License
CC BY 4.0
Usage

views · 0

downloads · 0

A view counts once per browser per day, a download each time the PDF is requested.

  • Computer Science

Not recorded for this paper

View statement
Looking for related papers…
Contents