WorksComputer Science
AdjointFlow: Accelerating Scientific Inverse Problems with Physics-Based Transport
Abstract
Inverse problems are ubiquitous across scientific applications ranging from seismic imaging to astrophysics to nondestructive testing, yet classical solvers often struggle with nonconvexity and repeated evaluations of expensive physical models. Diffusion models can amortize this computation offline, but largely data-driven conditional models underutilize known physics and suffer from ill-conditioned transport maps when the target distribution is concentrated. Plug-and-play (PnP) methods explicitly leverage the physical model to guide a learned prior, improving data consistency but reintroducing costly iterative computations. We instead propose AdjointFlow, a framework built on stochastic interpolants that injects the known physics into the generative transport itself. We design a data-dependent, adjoint-based initialization to reduce transport distance to the target, modify the transport velocity to remain regular as the endpoint distributions concentrate, and parameterize the network to build the initialization directly into the learned velocity. Together, these enable accurate reconstruction at substantially lower cost than generative models starting from Gaussian noise. Experiments on inverse scattering, seismic imaging, and black hole imaging show that AdjointFlow consistently produces more accurate reconstructions than conditional diffusion models while being up to five orders of magnitude faster at inference than PnP methods. Optional inference-time refinement that queries the physical model can further improve data consistency, matching or exceeding the accuracy of PnP methods without retraining.
Introduction
Inverse problems are ubiquitous across science and engineering, arising in diverse domains ranging from molecular X-ray diffraction [1] and seismic imaging [2] to medical tomography [3] and astrophysics [4]. In each case, the objective is to recover unknown structural or material properties of a medium from indirect measurements, typically acquired at the boundary. Unlike standard image-processing tasks, these scientific inverse problems are governed by physical forward models that can be highly nonlinear, often leading to a nonconvex optimization landscape containing numerous nonphysical, or “spurious,” local minima [5]. Consequently, computing or learning the inverse map from measurements to the underlying medium can be especially difficult.
Wave-based inverse problems are perhaps the most representative of these challenges [6]. Historically1, hand-crafted asymptotic approximations [7] have been used to obtain computationally efficient, qualitative reconstructions [8, 9]. However, the advent of modern computers coupled with advances in numerical simulation has made PDE-constrained optimization [10, 11, 12] the prevalent approach for numerical inversion. These optimization methods are based on well-established computational techniques and can yield high-quality reconstructions [13]. Nevertheless, their nonconvex optimization landscapes are often plagued by spurious local minima, making the reconstruction sensitive to initialization and requiring carefully designed algorithmic strategies [14, 15, 16]. Moreover, every iteration necessitates several calls to the forward map (and its adjoint), which in turn entails solving the underlying physical model – typically a system of partial differential equations (PDEs). Repeated PDE solves render the overall computation prohibitive as the desired reconstruction resolution increases.
Over the past decade, machine learning (ML) has emerged as a promising paradigm for inverse problems, offering the ability to amortize the cost of inversion. Within this paradigm, a neural network is trained offline on a collection of examples and subsequently deployed to perform rapid inference, typically bypassing the iterative optimization and repeated PDE solves. ML-based approaches broadly fall into two categories. *Deterministic methods directly learn a point estimate of the reconstruction, typically by training highly-tailored neural networks to approximate the inverse map [17, 18, 19]. Generative methods, by contrast, seek to learn the underlying distribution rather than a single point estimate. Modern generative models based on diffusion [20, 21] or flow matching [22, 23] generate samples by learning a transport map from a simple base distribution to a target distribution. In the context of inverse problems, this target distribution is the conditional posterior distribution of the unknown parameters given the measurements, providing a natural framework for approximating and sampling from the Bayesian posterior [24]. Such generative approaches can be classified based on how they incorporate the relationship between measurements and unknown parameters: Diffusion-based plug-and-play methods first learn an unconditional prior and then incorporate measurement data during inference [25, 26, 27] using highly tailored guidance terms. Conditional generative models instead learn the measurement-reconstruction relationship during training, allowing them to estimate the posterior directly [28, 29].
Generative models have recently demonstrated strong performance on inverse problems [25, 30, 26, 31, 32, 27, 29, 33, 34, 28, 35], providing highly accurate reconstructions. However, most of these methods adopt a fixed Gaussian reference distribution; here we argue that Gaussian-to-posterior transport is poorly suited to scientific inverse problems. We instead adapt the reference distribution and transport velocity to the structure of these problems and obtain an iterative, deterministic method that retains the noise-augmented training of generative models while being able to match or surpass their accuracy at a substantially lower inference cost.
Two features of scientific inverse problems motivate this departure from a fixed Gaussian reference. First, an independent Gaussian reference discards information already available through the physical forward model. As such, generation must begin from uninformative noise even when cheap physics-based approximations are available, leaving the full relationship between measurements and unknown parameters to be learned from data or injected via guidance. Second, scientific inverse problems can exhibit strong posterior concentration as the quantity or quality of measurements increases, as described by the Bernstein–von Mises theorem [36]. Transporting order-one Gaussian noise to an increasingly concentrated conditional target requires increasingly contractive dynamics and can lead to velocity fields with poor endpoint regularity. Such rapidly varying fields can be difficult to approximate accurately and integrate numerically, creating challenges for both learning and inference and ultimately degrading the overall performance of the generative model [37, 38]. Together, these observations motivate a physics-aware reconstruction method with transport dynamics which are easier to learn and which permit accurate reconstruction using fewer integration steps.
Our proposed method, AdjointFlow, addresses these two limitations through two complementary design choices. First, we exploit the flexibility of the stochastic interpolant (SI) framework [23, 39] to replace the independent Gaussian reference with a data-dependent, physics-aware initialization. Specifically, we use an adjoint-based approximation to map measurements into the unknown parameter space, converting paired measurement-reconstruction data into paired transport endpoints. We find that a reference distribution centered at a physical approximation – and, in the concentrated posterior regime, one that is similarly concentrated – reduces transport distance to the desired reconstruction; see Figure 1 for an illustration. Second, we introduce a modified SI velocity field tailored to concentrated endpoint distributions, which remains well-conditioned as these endpoints become singular. We show that together, these design choices admit an especially natural data-dependent target prediction parameterization of the learned velocity, which analytically incorporates the known physical approximation and reduces the task of learning a velocity field to the task of predicting the target reconstruction itself. In summary, AdjointFlow replaces a generic Gaussian-to-data transport problem with a physics-informed refinement problem whose velocity is better behaved near concentrated targets and whose learning objective is directly aligned with the desired reconstruction.
Figure 1. Overview. Traditional diffusion-based approaches start from uninformative Gaussian noise and can suffer from ill-conditioned transport fields when the target posterior becomes concentrated, such as when more informative measurements are acquired. Conversely, AdjointFlow starts from a data-dependent initialization – for example, one constructed from the adjoint as shown above – reducing transport distance relative to Gaussian noise and producing favorable learning conditions for the solver. AdjointFlow further leverages a noise-free velocity which remains regular near concentrated endpoints.
Beyond these core components, the flexibility of the SI framework also allows AdjointFlow to interface with inference-time refinement strategies without retraining the underlying model. Such refinement permits additional computation to be introduced at deployment – for example, via calls to the forward model – when greater reconstruction accuracy or physical consistency is desired. Finally, we evaluate AdjointFlow across a diverse collection of scientific inverse problems, demonstrating that these modeling choices translate into meaningful improvements in both accuracy and efficiency.
Our main contributions can be summarized as follows:
We incorporate governing physics into the transport initialization through a singular, adjoint-based reference distribution, and analyze conditions under which this choice reduces transport distance to the target posterior.
We characterize the regularity issues that arise in the SI velocity field with highly concentrated endpoint distributions and develop a modified noise-free velocity with improved regularity in this regime.
We combine these design choices into an iterative, deterministic reconstruction method which admits a natural data-dependent target prediction parameterization. This parameterization analytically incorporates the physical initialization and reduces velocity learning to predicting the target reconstruction from time-dependent, noise-augmented states.
We demonstrate that AdjointFlow can be combined with optional plug-and-play algorithms that interface with the physical forward model at inference time, enabling training-free improvements to reconstruction accuracy and physical consistency.
We evaluate our framework on scientific inverse problems from two benchmarks [29, 40] covering inverse scattering, seismic imaging, and black hole imaging. We observe up to ∼70% lower reconstruction error compared to state-of-the-art inversion algorithms – even when they use larger or more complex architectures – and speedups of one to five orders of magnitude.
The remainder of the paper is organized as follows. In § 2, we review background details on scientific inverse problems and stochastic interpolants. In § 3, we introduce the methodological framework of AdjointFlow, developing a generative algorithm for scientific inverse problems in the concentrated posterior regime. We present numerical results in § 4 and ablate our primary design choices in § 5. In § 6 we provide a comprehensive discussion of related work. We conclude with final remarks in § 7.
Background and Preliminaries
In this section, we briefly review scientific inverse problems, which provide the motivating problem setting, and stochastic interpolants, which provide our methodological framework. We emphasize the features leveraged by our method and the limitations it is designed to address.
Inverse Problems
The goal in inverse problems is to recover an unknown signal from indirect, possibly noisy measurements. The measurement procedure is represented by a forward problem , where the forward function maps parameters to observational data , and the inverse problem subsequently asks to recover from . In scientific settings, typically involves a physical model characterized by a PDE with measurements obtained from the resulting physical state (such as at the domain boundary).
While we primarily focus on inverse scattering, a canonical wave-based scientific inverse problem illustrated in the three leftmost settings in Figure 2, our framework is general and applicable to arbitrary scientific inverse problems, particularly those which admit an efficient linearized solution.
Figure 2. Diagram of the different settings and modalities of inverse problems we consider. Top: a diagram of the data acquisition setting, including a representative example of the parameters represented by the wavespeed (in the case of scattering problems) or brightness (in the case of black holes). Bottom: an example of the measurement data used for the reconstruction. Note that the full aperture scattering is measured in the frequency domain, while the geophysical scattering is measured in the time domain.
A classical approach to numerically solve the inverse problem is to formulate it as a PDE-constrained optimization problem. In this setting, one searches for the parameters whose predicted measurements best match the true observed data . Namely, one seeks the minimizer to the following least-squares problem:
For a linear forward operator , an explicit solution is given by the Tikhonov-regularized [41] reconstruction
sometimes referred to as the filtered back-projection formula (FBP), where is a parameter introduced to mitigate the numerical rank deficiency of .
is the adjoint of the forward operator, and is often called the back-projection operator. Intuitively, takes the data measured at the boundary and propagates it back into the unknown domain , providing a rough estimate of where the perturbation is located. The operator then acts as a filtering operator, which compensates and sharpens the estimate produced by the back-projection. Solving the entire linear system is often prohibitive in practice; however, using only the back-projection operator can already yield a strong low-pass approximation – see, for example, Figure 4 – at a fraction of the computational cost.
Figure 4. Qualitative results on nonlinear inverse scattering for (a) 10h Overlapping Squares, (b) 3–5–10h Triangles, (c) Shepp–Logan, and (d) Brain Scans. Within each panel, columns show distinct test examples; rows show, from top to bottom, the ground-truth perturbation, the adjoint-based initialization, the AdjointFlow reconstruction, and its absolute reconstruction error. The wavelength marker corresponds to 8 points per wavelength (PPW) in (a)–(c) and 5 PPW in (d).
In essence, an adjoint can act as an approximate inverse providing an inexpensive initial reconstruction. However, as we show in what follows, in some cases even an approximation of the adjoint can still convey useful information to the reconstruction.
If the problem is nonlinear, a natural extension is to linearize the forward operator around a simple background medium :
where now is the Jacobian matrix of the forward operator3. This approximation simplifies the inversion back into a linearized least-squares minimization with data misfit term , which can be solved with the FBP formula. Note that the linearized problem is posed in the perturbation rather than in itself, so the back-projection is applied to the residual and returns an estimate of .
When high contrast or strong nonlinearity undermines linearized, FBP-like approximations [43], one can instead address the fully nonlinear problem through iterative gradient-based optimization. Adjoints remain central in this setting: the adjoint-state method [44] is a key algorithm for evaluating the data misfit gradient with one forward and one adjoint PDE solve, regardless of the dimension of .
However, difficulties still remain. For one, the map typically involves a compact operator which attenuates high-frequency details in and renders the problem ill-posed [45] in the sense that small changes in can lead to large changes in . If measurement noise is present, or if the physical model contains epistemic uncertainties, the challenge of obtaining a high-quality reconstruction is even more formidable. Thus, while PDE-constrained optimization provides a general recipe for solving scientific inverse problems, it can still struggle to mitigate instability and characterize uncertainty.
Bayesian Perspective
One solution to these challenges is to approach the inverse problem from a Bayesian perspective which explicitly characterizes the uncertainty. Following Bayes’ theorem, we assume the unknown parameters follow a conditional posterior distribution
where is the likelihood function and is a prior distribution on . A reconstruction can then be obtained, for example, by computing the maximum a posteriori (MAP) estimator
A regime of particular relevance for scientific inverse problems is that of the small-noise or increasing-information limit. In such a regime, identifiable inverse problems – those in which unknown parameters are uniquely determined by noiseless observations – can exhibit posterior concentration around the ground truth , provided the inversion is also stable and the prior satisfies suitable support conditions [46, 47]. Many scientific inverse problems, such as wave-based inverse problems, admit uniqueness under sufficiently informative measurements [9], and can exhibit posterior concentration with enough data. Conversely, in common image-based inverse problems such as inpainting or super-resolution, the forward operator typically has a nontrivial null space and the posterior remains spread out even as the noise vanishes.
For instance, in a finite-dimensional setting under suitable regularity conditions, the Bernstein–von Mises theorem characterizes this concentration by an asymptotically Gaussian posterior with vanishing covariance centered around an estimator :
where denotes weak convergence, is the Fisher information matrix and is an effective posterior variance scale with or for an increasing number of measurements or decreasing measurement noise , respectively. This observation motivates us to examine solvers that work effectively in the regime of concentrated posterior distributions.
Although direct evaluation of the posterior is typically intractable, many algorithms aim to generate samples from it [24]. A common class of methods is based on Markov chains constructed so that their invariant measure is the posterior distribution, as in Langevin Monte Carlo. Unfortunately, sampling from the posterior can be computationally prohibitive, as each likelihood evaluation requires applying the forward map . Moreover, theoretical guarantees of efficient sampling for these algorithms often rely on assumptions that may not hold in practice. Recently, generative models have been used to shift much of this computational cost to an offline training stage, enabling more efficient online reconstruction.
Stochastic Interpolants
The generative problem is to produce new samples from a distribution given only a dataset of samples drawn from . The stochastic interpolant (SI) framework [48, 23] solves this problem by defining an interpolation process which connects two endpoint distributions and and learning a map which transports samples from one endpoint to the other. Then, by choosing an easy-to-sample “base distribution” for and the target distribution for , one can transform samples from into samples from by simply solving an ordinary differential equation (ODE) or stochastic differential equation (SDE) that realizes .
Specifically, we define an interpolant
where for a distribution which has marginals and , and is independent of . The coefficients must satisfy and , be differentiable for , and be continuous for , but otherwise leave considerable flexibility in how one designs the transport map.
In the SI paper [23] the authors use , and , though different choices can produce other common generative models. For example, a variance-preserving diffusion [21, 49] can be represented as and , and flow matching [22] as and . Additionally, standard flow and diffusion models often choose given that the base distribution is already chosen to be a Gaussian independent of .
We then let for . Under suitable integrability and regularity assumptions, these laws satisfy the continuity equation
where the expectation in is taken over both and . Equivalently, for and , the density satisfies
Thus, any sample drawn from and transported according to either (8) or (9) generates a sample from at .
To realize this in practice, one must learn4 a velocity field by solving a squared-error regression problem with the flow matching objective
where the inner expectation is over training data and the independent noise , and is parametrized by a neural network. If SDE sampling is desired, a similar objective can be used to learn .
Once and are learned, we may generate samples from the target distribution by initializing and numerically integrating the probability flow ODE
or SDE
from to , where is Brownian noise.
Remark 2.1. Extending the SI framework to conditional sampling is straightforward. Given a dataset of paired samples drawn from a joint distribution , we seek to learn a generative model that, given new data , produces samples from the conditional distribution . The SI formulation can be directly extended to this conditional setting by making all functions parameterized by an external variable ; for example, one would extend to . The training objective (10) is also modified so that the inner expectation is over paired training data in addition to .
Methodology
In this section we introduce our proposed framework for AdjointFlow, a generative model designed for scientific inverse problems in the concentrated posterior regime. The key insight of AdjointFlow is to combine an informative physics-based initialization with a velocity formulation suited to concentrated posterior distributions. The adjoint of the forward map provides a physically meaningful initial estimate, while posterior concentration motivates concentrating the initial distribution around this estimate. Since standard SI velocity fields can become ill-conditioned near concentrated endpoints, this construction also motivates a velocity formulation that remains regular in this regime.
We develop these components as follows. In § 3.1, we explore how to define an informative, physically relevant initial distribution by leveraging the adjoint of the forward map, including how posterior concentration motivates concentrating this initialization as well. In § 3.2 we devise a velocity field which remains regular even with highly concentrated endpoints. § 3.3 combines these two ideas into a cohesive generative method by leveraging a data-dependent target prediction parameterization that directly aligns the learning objective with the desired reconstruction. Finally, § 3.4 demonstrates how AdjointFlow can incorporate inference-time scaling for improved physical consistency without retraining.
Physics-Based Couplings with Stochastic Interpolants
Generative models for scientific inverse problems look to sample from the conditional posterior distribution by learning a conditional velocity field parameterized by measurements , as detailed in Remark 2.1. While the standard convention is to define an independent Gaussian reference distribution , the SI framework (7) is not restricted to this choice: the endpoint distributions and may be arbitrary, and even coupled [39]. Therefore, taking motivation from work showing that optimal-transport-based couplings can simplify learned flows and improve training and inference efficiency [50, 51], we investigate how the design of can affect the transport distance between endpoints, and what choices can minimize it.
The paired-data setting inherent to inverse problems provides a natural correspondence from which to construct endpoint distributions: each training sample provides measurements together with the corresponding unknown parameters . However, the domains are mismatched: and generally occupy different spaces and cannot be directly interpolated. A physics-based reconstruction map resolves this mismatch by converting each measurement into an approximation of in parameter space .
A natural choice – if the problem is linear or admits an efficient linearization – is to use the adjoint to approximate and map measurements into . Specifically, one may use (3) to define a physics-based initialization
where is a pre-specified background medium. In the case of a homogeneous background with , the initialization reduces to . Henceforth, we use to denote an inexpensive physics-based approximation used to initialize the interpolant, even if it may not directly correspond to the adjoint operator (see, for example, § 4.4).
Though is not the exact inversion, it contains physically meaningful information. We may therefore hypothesize that can serve as an informative center to the reference distribution, for example, by defining . We are further left with the question of how to concentrate around , and may naturally hypothesize that the optimal concentration of should match the concentration of .
To aid our analysis, we first introduce the Wasserstein-2 distance, a cornerstone of optimal-transport theory which measures the minimum root-mean-square Euclidean displacement required to transport one distribution into the other. The distance is defined as
where is the set of all couplings of the distributions and .
To decompose the analysis of the transport distance between endpoints into differences of centers and spreads, we leverage the following property of the distance: for any distributions and with finite second moments and means and ,
where and are the shifted versions of and which have zero mean. This result comes immediately from examining (14), since the act of translation induces a bijection between couplings and the cross term in vanishes once the distributions have zero mean.
Using this fact, we now demonstrate that centering the reference distribution around a physics-based approximation can reduce the transport distance to the target posterior relative to a mean-zero reference distribution (such as a standard Gaussian initialization). We leave the proofs to Appendix A.
Proposition 3.1. Let for a linear forward operator with and a flat prior on , and suppose . Furthermore, with the mean of the posterior , take any zero-mean distribution with finite second moment, and its translation by . Then
so whenever .
We can extend this result to nonlinear operators by leveraging the linearization in (3). Namely, we suppose is differentiable at a fixed background with Jacobian , and reformulate the problem in the perturbation coordinates
where is now the posterior over (assumed to have finite second moment and mean ).
Proposition 3.2 (Nonlinear extension). Suppose has -Lipschitz Jacobians and satisfies . Suppose further that there exists an unconstrained least-squares solution with residual . Defining and , if
then for any zero-mean with finite second moment and its translation by , we have .
Each term in the inequality (18) has a clear meaning: accounts for the offset between the posterior mean and the least-squares solution, is the Taylor remainder of the linearization6, couples the least-squares residual to the nonlinearity, and is the margin bought by the adjoint’s accuracy as an inverse.
In particular, in the identifiable, stable small-noise regime described in § 2.2, with uniform integrability of under the posterior distributions, we have , , and ; the sufficient condition then becomes
Remark 3.3. The bound is a scale-dependent condition which depends on the units of . In practice we input a normalized to the neural network, which fixes the choice of units, and only the condition number of remains intrinsic. For ill-conditioned operators where , the guaranteed margin is small. However, is a sufficient but not necessary condition: the proofs only use bounds on along relevant directions, which can hold even when if these directions are well-conditioned.
Having addressed where to center , we now ask how concentrated it should be. We show that to minimize the transport distance in the case of Gaussian endpoints, should aim to match the spread of .
Proposition 3.4. Assume a -dimensional isotropic Gaussian target and reference distribution . Then
which, for fixed , is minimized at . Consequently, in the singular-endpoint limit motivated by (6), the optimal base variance also vanishes. In particular, when , the minimum is attained by .
Proof. This result can be quickly inferred from the Wasserstein-2 formula for Gaussians:
With isotropic Gaussian endpoints, this becomes when is the identity. □
These conclusions suggest that, if we suspect a concentrated posterior distribution, a singular reference distribution —e.g. using an adjoint-based approximation —can provide an initialization that is geometrically better aligned to the target than a standard Gaussian distribution.
We verify this numerically by computing Wasserstein-2 distances for all datasets considered in this paper. As reported in Table E.12, the concentrated, physics-based reference has a smaller transport distance than a standard Gaussian on every dataset considered (see Appendix § 16.§ 3 for more details). We additionally examine empirically how transport distance relates to reconstruction accuracy in our ablations (see Table 7).
| Initialization | PSNR ↑ | SSIM ↑ | Meas err (%) ↓ | |
| 60 receivers | ||||
| Constant | 127.0 (16.3) | 13.007 (2.830) | 0.436 (0.208) | 38.05 (8.67) |
| Training mean | 157.1 (20.9) | 17.025 (2.675) | 0.631 (0.156) | 14.74 (2.31) |
| Adjoint | 110.2 (18.4) | 25.341 (6.155) | 0.910 (0.066) | 5.50 (1.85) |
| Pseudoinverse | 53.5 (10.2) | 25.460 (4.969) | 0.920 (0.054) | 4.70 (0.99) |
| 180 receivers | ||||
| Constant | 127.0 (16.3) | 13.233 (2.667) | 0.518 (0.204) | 42.87 (10.26) |
| Training mean | 157.1 (20.9) | 18.687 (2.506) | 0.701 (0.127) | 11.13 (1.72) |
| Adjoint | 98.6 (19.7) | 29.913 (4.819) | 0.966 (0.024) | 2.76 (0.50) |
| Pseudoinverse | 23.8 (4.9) | 32.459 (3.935) | 0.980 (0.013) | 1.87 (0.20) |
| 360 receivers | ||||
| Constant | 127.0 (16.3) | 14.314 (2.565) | 0.531 (0.199) | 33.09 (6.46) |
| Training mean | 157.1 (20.9) | 19.546 (2.554) | 0.735 (0.115) | 9.64 (1.44) |
| Adjoint | 96.7 (19.1) | 30.056 (4.831) | 0.966 (0.024) | 2.74 (0.49) |
| Pseudoinverse | 22.6 (4.7) | 32.797 (3.966) | 0.981 (0.013) | 1.86 (0.21) |
Table 7. We present the results of AdjointFlow for linear inverse scattering with four choices of initialization , three different levels of measurement sparsity, and noise level following [40] (bold result indicates best for each receiver count). All models share the architecture and training procedure of § 4.2 and differ only in ; the pseudoinverse corresponds to AdjointFlow in Table 3. Within each block, the first two initializations are data-independent and the last two are data-dependent. is the empirical transport distance between singular endpoints (Appendix § 16.§ 3), averaged over the test set.
A Noise-Free Velocity Field for Concentrated Endpoints
The second component of AdjointFlow is a modified SI velocity field designed to remain regular even with singular endpoints. Our construction is motivated by the concentrated-posterior regime (6), which also favors concentrating the physics-based initialization, as shown in Proposition 3.4. However, concentration at either endpoint can introduce difficulties for the standard SI velocity field. The following proposition makes this precise: when either endpoint distribution collapses to a point mass, the spatial Lipschitz constant cannot remain uniformly bounded near that endpoint.
Proposition 3.5. Suppose
are independent Gaussians and the interpolant covariance satisfies for . Then, for any the SI velocity field (8) admits an analytic form
where . In the singular-endpoint limit (6) where , becomes unbounded as ; thus, fails to remain uniformly Lipschitz in near the target endpoint. Namely,
Similarly, if , the spatial Lipschitz constant cannot remain uniformly bounded near the base endpoint, as
The unbounded Lipschitz constant identified by Proposition 3.5 creates spatial sensitivity that one would like to numerically avoid. Since , small state errors from learned approximation or numerical discretization can produce large velocity errors, potentially complicating learning and requiring smaller integration steps. The behavior along exact interpolant trajectories also depends on the interpolant: for a linear interpolant, velocities remain bounded as along exact interpolant trajectories, yet they diverge for a variance-preserving diffusion interpolant (see Appendix A.§ 3). Another common strategy known as early stopping avoids the endpoint singularity by truncating the integration at a fixed , yet this generally introduces bias by terminating transport before fully reaching the target distribution.
While the preceding examples concern transporting a nondegenerate source to a singular target, Proposition 3.4 suggests a more natural design in this regime: choosing a concentrated source as well. However, with deterministic endpoints and no bridge noise, training states collapse onto the trajectory , leaving the learned field unconstrained away from it. Adding bridge noise gives the training distribution full support at interior times, but the standard SI velocity must generate and remove this noise artificially, leading to the endpoint ill-conditioning identified in Proposition 3.5. To retain noise augmentation during training while separating its contribution to the velocity, we use the standard decomposition
where is as in (9) and we term
the noise-free velocity since the noise bridge term has been removed from the expectation. The following corollary establishes spatial regularity of the noise-free velocity for singular endpoints and, under suitable interpolant schedules, exact recovery of the target mean even when the target has nonzero variance.
Corollary 3.6. Under the same assumptions as Proposition 3.5, the noise-free velocity field admits an analytic form
where and are as in (23). In the singular-endpoint limit (6) with , if and then and , which has uniform spatial regularity since . Moreover, if , , and , choosing , , and ensures that the noise-free ODE initialized at uniquely recovers the target mean .
Corollary 3.6 thus motivates using the noise-free velocity with a deterministic source and nonzero bridge noise . The proofs of Proposition 3.5 and Corollary 3.6 are left to Appendix A, and leverage the conditional expectation formula for jointly Gaussian random variables as their primary tool.
Remark 3.7. In practice, the combination of a deterministic reference distribution with the noise-free velocity yields an iterative, but deterministic, reconstruction method. Namely, for fixed measurements this method produces a single point reconstruction rather than a sample from a non-degenerate posterior. Randomness enters only through time-dependent noise augmentation during training. A similar training strategy appears in [52], which adds noise-augmented states to a standard flow-matching loss to improve generalization of flow-based generative models. Here, we derive this construction from the regularity of interpolants with concentrated endpoints.
Data-Dependent Target-Prediction
We now combine the main ideas from § 3.1 and § 3.2 into a cohesive framework. To attain a base distribution geometrically aligned with the target, Proposition 3.2 and Proposition 3.4 suggest choosing a singular base distribution located at a physically informative initialization. If the forward model can be linearized efficiently, the adjoint typically provides a strong initial guess and a natural initialization is . Corollary 3.6 then shows that to generate samples when the endpoint distributions are singular, the noise-free velocity could be numerically advantageous because it recovers regularity where the standard SI velocity lacks it.
Hence, we define AdjointFlow as the reconstruction method which solves the ODE
where denotes a physics-based approximation, with the notable example being when an efficient linearization of the forward model is available. As is now a deterministic function of , the noise-free velocity naturally decomposes as
This expression motivates a data-dependent target-prediction (DD-TP) parameterization of the velocity, where a network is trained to predict the clean target – a “denoiser-style” objective – rather than the tangential velocity directly. Specifically, we learn the target-prediction network
and define the velocity as
Although target and velocity prediction are equivalent on a theoretical level, they induce different finite-capacity hypothesis classes. Multiple recent works have argued for TP [53, 54] on the basis that it has a more stable training signal than velocity prediction. Intuitively, a TP parameterization allows the network to focus on refining the residual not already explained by the adjoint approximation. Moreover, as , target prediction approaches an identity map, whereas velocity prediction must continue to represent the measurement-dependent displacement from .
For AdjointFlow, target prediction is particularly natural because the initialization is deterministic and exact. In contrast, the standard TP is typically derived for a linear interpolant with by eliminating the unknown to get
While the data-dependent TP directly hard-codes the physical source into velocity, standard TP must reconstruct the velocity indirectly which introduces an undesirable factor.
We also emphasize that while (31) superficially resembles a direct reconstruction network, its role in (32) leads to a different learning problem: target prediction is supervised across time-dependent, noise-perturbed intermediate states and composed iteratively at inference. TP thus incorporates mechanisms such as supervised iterative computation and training-time stochastic regularization, which have been associated with improved performance over single-step regression in recent work [55, 56], even when inference produces a deterministic prediction.
The training and inference algorithms for AdjointFlow are provided in Algorithm 1 and Algorithm 2. Even with the modifications to the standard SI framework, the implementation remains straightforward. We use the interpolant ; the empirical performance of other choices of is investigated in § 5. We parameterize the TP network as where is the primary target-prediction network and is a bespoke data-encoding model designed to process the measurements. Figure 3 provides an illustration of this architecture.
Figure 3. Model architecture. A data encoding network extracts domain-specific features to condition the target-prediction network , which then forms the velocity to be integrated, with initial state at , to produce an estimate at . Red boxes denote learned components.
Algorithm 1 AdjointFlow Training
Input: paired dataset ; physics-based approximate inverse function ; untrained target-prediction network ; untrained data encoding network ; batch size ; bridge noise level .
repeat
for do
Sample pair , time , and noise .
Compute the physics-based initialization .
Define the target .
Compute the interpolant .
end for
Compute empirical target-prediction loss
Take a gradient step on to update and .
until converged
Return: Trained target-prediction model and data encoder .
Algorithm 2 AdjointFlow Inference (Forward Euler)
Input: measurement data ; trained models and ; physics-based approximate inverse function ; integration steps .
Initialize .
for do
Let and .
Compute .
Update .
end for
Return: prediction .
Inference-Time Scaling
Inference-time scaling is a common strategy in generative modeling for improving output quality without retraining the generative model. The strategy allocates additional computational resources at inference time, for example by introducing an additional guidance term or by recasting generation as a search or optimization problem. Plug-and-play (PnP) algorithms are a prominent example of inference-time scaling which apply guidance to an unconditional diffusion model trained to sample from a prior distribution [40]. Although often computationally expensive due to repeated evaluations of the forward or adjoint map, similar to classical optimization algorithms, these methods can effectively incorporate physics and measurement information into the generative transport and produce high-quality reconstructions.
Fortunately, the AdjointFlow framework is also compatible with inference-time scaling. In particular, physics-based guidance can further improve reconstruction quality and measurement consistency at the expense of increased computational cost. To this end, we adapt the RED-Diff algorithm [57] to the stochastic interpolant framework. We refer to the resulting algorithm as RED-Flow.
RED-Diff recasts the generation problem as a variational inference problem. Inference is performed by minimizing an objective that balances the data misfit with a denoising-score-matching term that acts as a regularizer. Following this formulation, we replace the score-based regularization with an analogous flow-matching term which yields the following optimization problem:
where , , is a weighting schedule, is given by (32), and is the stop-gradient operator. Since due to the target-prediction parameterization, the regularization adds a gradient term which pulls the iterate toward the learned reconstruction while the misfit term enforces data consistency. We initialize the reconstruction to the approximation , then solve (34) using Adam [58]. By explicitly incorporating the forward model into inference through the data-misfit term, RED-Flow can improve the physical consistency of the reconstruction, albeit at increased computational cost due to repeated evaluations of . Further details are provided in Appendix § 14, including the full algorithm in Algorithm 3.
Experiments
We investigate the performance of AdjointFlow and RED-Flow across four diverse inverse problems from scientific domains, each with their own formulations, modalities, and challenges: Nonlinear Frequency-Domain Inverse Scattering (§ 4.1), Linear Frequency-Domain Inverse Scattering (§ 4.2), Time-Domain Seismic Imaging (§ 4.3), and Black Hole Imaging (§ 4.4).
We compare against a range of state-of-the-art methods including classical optimization, deterministic ML models, conditional diffusion models (CDM), and plug-and-play diffusion prior (PnP-DP) methods, evaluating performance on a variety of accuracy metrics as well as on inference cost. Our evaluation metrics, detailed in Appendix § 15, aim to match the evaluation criteria of the benchmarks we test against. We report quantitative baseline results directly from the respective benchmark papers [29] or [40] unless otherwise stated. We recompute all reported Sinkhorn divergences using a common library version, since updating the library substantially changed the numerical values. We generate qualitative baseline reconstructions locally using the corresponding implementations and pretrained checkpoints, and plot absolute errors with respect to the ground truth. Unless otherwise stated, AdjointFlow uses 8 forward-Euler steps (Algorithm 2) and CDM models use 256 forward-Euler-Maruyama steps.
Nonlinear Frequency-Domain Inverse Scattering
In domains such as medical imaging and nondestructive testing, a common task is to infer the properties, shape, or interior characteristics of an unknown object or medium by analyzing the scattering patterns of impinging waves. To this end, the unknown medium is probed with monochromatic (single-frequency) waves, with the resulting impulse responses, in the form of scattered waves, recorded at the boundary of the domain (see Figure 2 left). This is known as the inverse scattering problem.
We consider the wideband inverse scattering problem in a two-dimensional acoustic setting. The physical model of time-harmonic wave propagation is provided by the Helmholtz equation,
where is the total wave field, is the wavenumber of the probing wave, and is the squared refractive index which governs the speed at which a wave travels through the medium. We bound the medium inside a domain and assume a homogeneous vacuum of as the background. The natural choice for the media of interest then becomes the refractive index perturbation to have .
Forward problem. The medium is illuminated by a monochromatic incident plane wave
where denotes the direction of incidence and denotes a wave field induced by such an incident wave. The resulting total wave field thus decomposes as , with the scattered wave satisfying:
where the second equation ensures uniqueness via the Sommerfeld radiation condition. Measurements are collected from receivers placed at angles on a circle of radius . The recorded far-field measurements at frequency are then denoted as
The forward map, which associates a perturbation with its corresponding scattered field data, is defined as .
Challenges. A major challenge of the inverse problem is multiple scattering effects: The solution to the inhomogeneous Helmholtz equation (37) admits the Born expansion
revealing a series of higher-order nonlinear terms which entangle interactions and make it difficult to know where a signal originated.
As a result, attempting to infer from single-frequency data is a challenging, highly unstable and nonconvex problem that can lead to cycle-skipping: a phenomenon where optimization algorithms become trapped in local minima, yielding spurious, non-physical reconstructions. Collecting measurements across a range of frequencies can significantly stabilize the inversion, as each frequency band probes complementary aspects of the medium. In practice, reconstructions are carried out by aggregating the information from multiple frequencies, leading to a wideband formulation where the forward operator collects data over a set of pre-specified frequencies .
Adjoint. Instead of using the adjoint of the discretized PDE, we use the far-field asymptotic approximation [9] of the Green’s function of (35) to write (up to a frequency-dependent complex prefactor) the linearized forward operator as a Fourier transform:
which then gives a formulation of the far-field adjoint:
This expression allows us to efficiently apply an approximate adjoint map. Despite not being the exact adjoint, it provides informative back-projections of the measurement data as illustrated in Figure 4. Since we are in the wideband setting, each frequency admits an adjoint ; we initialize AdjointFlow with the real component of the lowest-frequency adjoint because this resolves the large-scale structures of the desired reconstruction and is less prone to high-frequency artifacts.
Benchmark Dataset
We use the evaluation suite from the Back-Projection Diffusion (BPD) benchmark [29], which contains 4 datasets of varying difficulty, designed to probe distinct challenges in nonlinear inverse scattering:
The 3–5–10h Triangles dataset contains small, randomly placed and oriented triangles with sub-wavelength features, testing the ability of the network to recover fine-scale details.
The 10h Overlapping Squares dataset [59] consists of multiple strongly overlapping squares, emphasizing nonlinear superposition and multiple scattering effects.
The Shepp–Logan Phantom dataset, designed as a simple mimicry of human brains, includes strong discontinuities and resonant cavity effects, producing dominant reflections and masking interior structures.
The Brain Scans dataset uses the processed MRI brain perturbations released with BPD [60], derived from fastMRI [61, 62] to evaluate performance on complex, non-synthetic perturbations with rich spatial variability.
Numerical details. The datasets use a physical domain of , discretized on an uniform grid. Measurements are collected at 80 equally spaced receivers on a circle of radius , using 80 equally spaced incident plane-wave directions, so that the discretized measurement data is represented by a complex matrix . Far-field patterns are generated by numerically solving (37) at three dyadically spaced frequencies: with an effective wavelength of 8 points per wavelength (PPW) for all but the Brain Scans dataset; and with an effective wavelength of 5 PPW for Brain Scans. Differential operators are approximated using tensor-product eighth-order finite differences to avoid numerical dispersion, and radiation boundary conditions are enforced via a second-order perfectly matched layer (PML) with intensity 80. The resulting sparse linear systems are solved using sparse LU factorization.
Methods. The BPD benchmark evaluates a range of both classical and machine learning algorithms which includes: (a) Full Waveform Inversion (FWI) [42], a classical optimization algorithm; (b) SwitchNet [18], WideBNet [63], EquiNet/B-EquiNet [19], four deterministic ML models based on the FBP formula (2); and (c) EquiNet CDM and B-EquiNet CDM7 [29], two FBP-based conditional diffusion models. Furthermore, we instantiate AdjointFlow with the same EquiNet architecture as EquiNet CDM (the best performing model from the BPD benchmark) to isolate the advantage of our modified SI formulation against a more traditional diffusion model. For the Brain Scans dataset, we add additional comparisons against two state-of-the-art PnP methods: RED-Diff [57] and DAPS [27]. For these PnP methods, we evaluate the forward model using a JAX-based finite-difference Helmholtz solver8 configured to match the measurement data.
Results
We showcase representative reconstructions in Figure 4 and Figure 5, where we observe that AdjointFlow successfully recovers sub-wavelength structures and handles multiple-scattering effects efficiently. Quantitative results are given in Table 1 and Table 2. In addition to improved accuracy, AdjointFlow also provides accelerated inference, requiring only a single call to the adjoint and a small number of integration steps to solve the ODE in (29). As a result, it becomes much more efficient than conditional diffusion, which can require hundreds of sampling steps, as well as PnP-DP algorithms, which can require hundreds of function / gradient evaluations. The result,
| Method | Shepp–Logan RRMSE ↓ | Shepp–Logan MELR ↓ | Shepp–Logan SD ↓ | 3–5–10h Triangles RRMSE ↓ | 3–5–10h Triangles MELR ↓ | 3–5–10h Triangles SD ↓ | 10h Overlapping Squares RRMSE ↓ | 10h Overlapping Squares MELR ↓ | 10h Overlapping Squares SD ↓ |
| Traditional | |||||||||
| FWI | 52.041 | 241.893 | 7.658 | 28.637 | 159.894 | 0.809 | 38.777 | 281.057 | 4.773 |
| Deterministic | |||||||||
| SwitchNet | 4.305 | 8.071 | 1.122 | 15.084 | 9.377 | 0.570 | 20.102 | 24.295 | 2.643 |
| WideBNet | 3.843 | 13.255 | 1.059 | 17.263 | 10.582 | 0.608 | 14.327 | 44.182 | 1.996 |
| B-EquiNet | 2.022 | 2.906 | 0.805 | 2.944 | 2.010 | 0.301 | 9.484 | 21.434 | 1.456 |
| EquiNet | 1.693 | 2.827 | 0.758 | 2.741 | 1.734 | 0.298 | 10.891 | 25.906 | 1.614 |
| Conditional Diffusion | |||||||||
| B-EquiNet CDM | 1.406 | 1.757 | 0.722 | 1.657 | 1.318 | 0.263 | 2.046 | 2.683 | 0.607 |
| EquiNet CDM | 1.323 | 1.564 | 0.717 | 1.590 | 1.385 | 0.260 | 1.744 | 1.979 | 0.578 |
| Ours | |||||||||
| AdjointFlow | 0.379 | 0.474 | 0.576 | 1.108 | 0.607 | 0.258 | 1.143 | 1.401 | 0.514 |
Table 1. We compare performance on three synthetic datasets (Shepp–Logan, 3–5–10h Triangles, 10h Overlapping Squares) using RRMSE (%), MELR (), and Sinkhorn divergence (SD) metrics (see Appendix § 15 for definitions, bold indicates best performance for a given metric). All Sinkhorn divergence values, including those of the baselines, are recomputed using an updated library version and therefore differ from those reported in [29]. We find that AdjointFlow outperforms all models, including conditional diffusion, across the board.
| Method | RRMSE ↓ | MELR ↓ | SD ↓ |
| Brain Scans | |||
| PnP Diffusion Prior | |||
| DAPS | 12.572 | 18.700 | 0.278 |
| RED-Diff | 2.873 | 7.370 | 0.107 |
| Conditional Diffusion | |||
| EquiNet CDM | 5.661 | 3.494 | 0.157 |
| EquiNet CDM† | 34.990 | 99.337 | 0.667 |
| Ours | |||
| AdjointFlow | 3.421 | 4.482 | 0.136 |
| RED-Flow | 2.467 | 3.389 | 0.099 |
Table 2. We compare AdjointFlow and RED-Flow to PnP-DP and CDM baselines for nonlinear inverse scattering on the Brain Scans dataset, with bold indicating the best performance on each metric. We report RRMSE as a percentage and MELR . EquiNet CDM results are obtained from a model we trained using the pipeline from [29]. CDM† indicates that we evaluate the diffusion model at the same number of function evaluations as AdjointFlow (namely, 8 sampling steps), thus demonstrating the advantage of AdjointFlow when compute is limited.
Figure 5. Qualitative comparison of reconstructions on the Brain Scans dataset for nonlinear inverse scattering. For CDM†, we evaluate the diffusion model at the same number of NFE (number of function evaluations) as AdjointFlow (namely, we fix 8 sampling steps). AdjointFlow clearly performs far better in this iso-compute comparison, demonstrating its superior efficiency.
illustrated in Figure 6a, reveals an inference acceleration of up to five orders of magnitude, while reconstruction accuracy still remains competitive. We find that inference-time scaling methods like RED-Flow can boost the performance of AdjointFlow even further, albeit at a higher computational cost.
Figure 6. Comparison of the efficiency–accuracy tradeoff for nonlinear and linear inverse scattering. All timings were measured on the same NVIDIA RTX A6000 GPU. (a) AdjointFlow achieves a strong balance between performance and efficiency, while RED-Diff and RED-Flow offer small accuracy improvements at substantially greater inference cost; the seconds-per-sample axis uses a logarithmic scale. (b) AdjointFlow achieves competitive accuracy at the lowest cost, though the efficiency gain is smaller than in the nonlinear problem.
Linear Frequency-Domain Inverse Scattering
Often encountered in optical microscopy [64] due to the weak scattering (little to no multiple internal reflections) of most cells and thin tissue, this inverse problem linearizes the problem presented in § 4.1, approximating the impulse response with a linear map . Practically, this allows faster and more stable reconstructions for high-throughput and live-cell imaging. Here the forward model stems from a first-order Born approximation (39) resulting in
where consists of the linear measurement operator composed with the linear approximation
where is the Green’s function for the homogeneous two-dimensional Helmholtz equation.
Linear inverse problems. The presence of a linear forward map makes this setup structurally similar to many common inverse problems in image processing and computer vision, such as de-blurring and super-resolution. Therefore, it provides a middle ground to test methods like AdjointFlow, specifically designed for scientific inverse problems, with other generative inversion algorithms which were primarily designed with linear image-based methods in mind. In particular, this includes PnP-DP algorithms which are only applicable in a linear regime, for example because they rely on access to a singular value decomposition or pseudoinverse. Furthermore, linearity significantly affects accuracy-cost tradeoffs, as forward and gradient evaluations are no longer prohibitively expensive; they can now be computed via simple matrix multiplications.
Benchmark Dataset
We use the dataset of microscopic cell phantoms (based on HL60 nuclei) generated by InverseBench [40, 65] using the online simulator CytoPacq [66].
Numerical details. The physical domain is a square discretized on a uniform grid. There are uniformly spaced sources at a radius from the origin, and a specified number of equally spaced receivers to evaluate performance across different levels of data sparsity. The simulation uses monochromatic illumination with an effective wavelength of 6 PPW. Measurements are generated using a linear map constructed via the first Born approximation (42). The specific unknown used in the benchmark is the scattering potential for permittivity . In keeping with the original benchmark, Gaussian measurement noise with strength is added to the measurement data.
Methods. InverseBench evaluates a large number of PnP diffusion algorithms (see Appendix § 13.§ 1), all using the same pretrained diffusion prior, as well as the traditional optimization algorithm FISTA-TV [67]. The results from InverseBench use a larger U-net based architecture since, as a diffusion prior, it has no need to specially process conditional measurement inputs. However, given that AdjointFlow uses a conditioned network, we adopt a smaller EquiNet architecture similar to that used in § 4.1. We also add a comparison against a CDM with the same EquiNet architecture to separate the benefit of the architecture from the generative model. Furthermore, for this case, we choose the coupling for AdjointFlow to be with the regularized pseudoinverse, namely, , with the regularization coefficient. The pseudoinverse is also concatenated as an additional channel to the conditional input to the CDM.
Results
Quantitative results are summarized in Table 3, with a representative example shown in Figure 7. On all three levels of measurement sparsity, RED-Flow outperforms baselines by a significant margin in reconstruction PSNR, and also surpasses most to all baselines on SSIM. Therefore, while the linear setting favors PnP-DP methods – many of which rely on the SVD or pseudoinverse of the forward map – AdjointFlow still delivers competitive performance while only leveraging the linear structure of the problem via the physics-based initialization.

Figure 7. Qualitative comparisons of reconstructions from AdjointFlow and diffusion baselines on linear inverse scattering with 60 receivers.
| Method | 360 PSNR ↑ | 360 SSIM ↑ | 360 Meas err (%) ↓ | 180 PSNR ↑ | 180 SSIM ↑ | 180 Meas err (%) ↓ | 60 PSNR ↑ | 60 SSIM ↑ | 60 Meas err (%) ↓ |
| Traditional | |||||||||
| FISTA-TV | 32.126 (2.139) | 0.979 (0.009) | 1.23 (0.25) | 26.523 (2.678) | 0.914 (0.040) | 2.65 (0.30) | 20.938 (2.513) | 0.709 (0.103) | 6.05 (0.65) |
| PnP Diffusion Prior | |||||||||
| DDRM | 32.598 (1.825) | 0.929 (0.012) | 1.04 (0.26) | 28.080 (1.516) | 0.890 (0.019) | 1.57 (0.39) | 20.436 (1.210) | 0.545 (0.037) | 3.04 (0.92) |
| DDNM | 36.381 (1.098) | 0.935 (0.017) | 0.78 (0.22) | 35.024 (0.993) | 0.895 (0.027) | 0.58 (0.16) | 29.235 (3.376) | 0.917 (0.022) | 0.28 (0.07) |
| ΠGDM | 27.925 (3.211) | 0.889 (0.072) | 2.74 (1.23) | 26.412 (3.430) | 0.816 (0.114) | 3.66 (1.79) | 20.074 (2.608) | 0.540 (0.198) | 6.90 (3.38) |
| DPS | 32.061 (2.163) | 0.846 (0.127) | 4.35 (1.19) | 31.798 (2.163) | 0.862 (0.123) | 4.28 (1.20) | 27.372 (3.415) | 0.813 (0.133) | 4.53 (1.31) |
| LGD | 27.901 (2.346) | 0.812 (0.037) | 1.17 (0.20) | 27.837 (2.337) | 0.803 (0.034) | 1.06 (0.16) | 20.491 (3.031) | 0.552 (0.077) | 1.45 (0.68) |
| DiffPIR | 34.241 (2.310) | 0.988 (0.006) | 1.11 (0.24) | 34.010 (2.269) | 0.987 (0.006) | 1.04 (0.23) | 26.321 (3.272) | 0.918 (0.028) | 1.27 (0.23) |
| PnP-DM | 33.914 (2.054) | 0.988 (0.006) | 1.21 (0.25) | 31.817 (2.073) | 0.981 (0.008) | 1.42 (0.26) | 24.715 (2.874) | 0.909 (0.046) | 2.20 (0.34) |
| DAPS | 34.641 (1.693) | 0.957 (0.006) | 1.03 (0.25) | 33.160 (1.704) | 0.944 (0.009) | 1.11 (0.25) | 25.875 (3.110) | 0.885 (0.030) | 1.51 (0.25) |
| RED-Diff | 36.556 (2.292) | 0.981 (0.005) | 0.89 (0.23) | 35.411 (2.166) | 0.984 (0.004) | 0.87 (0.21) | 27.072 (3.330) | 0.935 (0.037) | 1.18 (0.23) |
| FPS | 33.242 (1.602) | 0.870 (0.026) | 0.70 (0.01) | 29.624 (1.651) | 0.710 (0.040) | 0.37 (0.01) | 21.323 (1.445) | 0.460 (0.030) | 0.15 (0.02) |
| MCGdiff | 30.937 (1.964) | 0.751 (0.029) | 0.70 (0.01) | 28.057 (1.672) | 0.631 (0.042) | 0.38 (0.01) | 21.004 (1.571) | 0.445 (0.028) | 0.21 (0.06) |
| Conditional Diffusion | |||||||||
| CDM | 29.921 (3.267) | 0.952 (0.019) | 2.56 (0.45) | 29.609 (3.289) | 0.964 (0.017) | 2.49 (0.27) | 23.064 (4.078) | 0.886 (0.070) | 7.48 (0.91) |
| Ours | |||||||||
| AdjointFlow | 32.797 (3.966) | 0.981 (0.013) | 1.86 (0.21) | 32.459 (3.935) | 0.980 (0.013) | 1.87 (0.20) | 25.460 (4.969) | 0.920 (0.054) | 4.70 (0.99) |
| RED-Flow | 38.651 (2.871) | 0.984 (0.003) | 0.97 (0.32) | 37.476 (3.081) | 0.984 (0.003) | 0.87 (0.30) | 31.553 (5.028) | 0.936 (0.032) | 0.66 (0.16) |
Table 3. We present the results for linear inverse scattering with three different levels of measurement sparsity and noise level following [40] (bold result indicates best). “Meas err” quantifies relative agreement between predicted and observed measurements, following InverseBench’s normalization convention. Across all three levels of data sparsity, RED-Flow achieves the best reconstruction PSNR, while also having either the best or close to the best SSIM and competitive data consistency.
Figure 6b again demonstrates that AdjointFlow strongly leads competing methods in terms of speed, albeit with a smaller performance gap when compared to the nonlinear problem (see Figure 6a) due to the reduced cost of running iterative algorithms in the linear setting. And, with an increased inference-time cost, RED-Flow again produces state-of-the-art reconstruction quality without any retraining of the base model. Furthermore, while methods which explicitly leverage the linear structure of the forward map – such as DDNM, FPS, and MCGDiff – retain the lowest measurement errors, RED-Flow remains competitive with many of these methods, while also significantly improving data consistency over the base AdjointFlow model, especially in the low-data regime. Our findings thus support that additional sampling guidance via the forward model is especially helpful in producing physically plausible reconstructions.
Time-Domain Seismic Imaging
Widely used in geophysics, time-domain inverse scattering reconstructs complex underground structures using broadband seismic waveforms, often with sources and/or receivers limited to the surface.
Forward problem. The full waveform inversion problem aims to recover the features of sub-surface geophysical structures using the full time-series information of measured waveforms. Here, we aim to recover the compressional wavespeed , which determines the speed at which sound waves travel through solids like soil and rock. This quantity is crucial for subsurface mapping as it varies considerably with material density, porosity, lithology, fracturing, and pressure.
Mathematically, we model the propagation of seismic waves through a heterogeneous medium with the acoustic wave equation
where is the source wave and is the pressure wavefield. This equation is then discretized as
where represents the discretization of the operator and therefore depends on in a nonlinear fashion. Here encodes both the time and spatial dimensions, and acts on the pressure field for all discretized times and positions. For explicit time integrators, usually has a block-lower triangular structure inherited from time causality. Finally, measurements are obtained from
where is the sampling operator for receivers which records the wavefield pressure at specified surface locations over a series of timesteps.
Adjoint. Using the adjoint-state method to compute the gradient is a classical recipe [44]. Algorithmically, the adjoint is computed by treating the residual between the observed measurements and the predicted measurements as a new source. It injects the error as a wave and propagates it backwards in time to get the adjoint wavefield defined as
Here, will have a block upper-triangular structure, which requires solving for backwards in time. Finally, applying Equation (47) allows us to compute the gradient of the data misfit functional [44]. In particular, the gradient is obtained by zero-lag cross-correlation of the forward wavefield and the adjoint wavefield :
which can subsequently be used in gradient descent optimization methods. Here the cross-correlation is expressed in squared-slowness coordinates ; the wavespeed gradient follows by applying the chain rule: .
The adjoint-state method thus enables direct computation of the back-projection by simply running the wavefield backward-in-time on a reference medium and cross-correlating. For our case, we take the reference medium to be the mean of the training dataset, which approximates a simple depth-varying gradient. Light additional post-processing is needed to smooth out artifacts near the sources and receivers and render amplitudes consistent across depths.
Challenges. As measurements are typically only taken at the free surface, the inverse problem is severely ill-posed and can have non-unique solutions. Classical algorithms that apply the adjoint-state method and cast the inversion as a local optimization problem are often more prone to cycle-skipping than in the frequency-domain inverse scattering problem. As a result, the success of this method heavily depends on starting from a sufficiently accurate initial model, which is often generated from simpler ray-based methods such as travel-time tomography [13]. In addition, many state-of-the-art methods rely on frequency sweeps during the optimization loop [68], where one applies low-pass filters at increasing frequency cut-offs to regularize the landscape of the loss. This procedure is closely related to the recursive-linearization approach [16] through the Parseval-Plancherel identity, though the two still differ in their update rules and continuation schedules. In this case, however, to remain consistent with InverseBench, we use its FWI setup based on Devito [69], which directly minimizes the full time-domain data misfit without frequency continuation or low-pass filtering.
Benchmark Dataset
We use the adapted dataset distributed by InverseBench [40, 65], derived from the CurveFault dataset in OpenFWI [70] composed of velocity profiles typically found in seismic imaging.
Numerical details. Velocity maps have been resized to from the original CurveFault dataset using bilinear interpolation and anti-aliasing. Measurements are generated utilizing the Devito software stack [69]. The source is given as a Ricker wavelet with a central frequency of 5 Hz, and the simulation records 1,001 timesteps with a temporal sampling rate of [s]. The acquisition geometry consists of 16 evenly-spaced sources at a depth of 1,270 [m] and 129 evenly-spaced receivers at a depth of 10 [m], mimicking regional earthquake transmission tomography. As a result, the final measurement data is of shape . All boundaries except the top are set to be absorbing to avoid artificial reflections.
Methods. We benchmark AdjointFlow against six PnP-DP algorithms evaluated by InverseBench which, as before, all use the same pretrained diffusion prior model based on an ADM U-net architecture. We also report InverseBench’s classical optimization baselines (Adam, L-BFGS) [40]; rows marked † consider a “best-case” scenario where the optimization is initialized with a smooth background model of the target medium, while the unmarked Adam row is initialized at a constant velocity of 3 km/s.
Seismic imaging FWI does not carry the same symmetries as full-aperture frequency-domain inverse scattering; therefore, we instantiate AdjointFlow with a comparable ADM U-net architecture [71] to that used by InverseBench. To process the conditional inputs, we first take a Fourier transform of the raw wavefield and select a subset of coefficients based on their energy content, reducing the measurement dimensionality from to . From there, we add a Fourier positional embedding [72] to encode the acquisition geometry of the sources and receivers and then process the data with a small MLP to obtain a latent context vector of dimension (we choose ), which is then injected into the U-net via added cross-attention blocks. Finally, for training we set the target to the velocity perturbations relative to the reference medium . We again include a comparison against a CDM with the same architecture as AdjointFlow.
Results
Results are summarized in Table 4, which demonstrates that AdjointFlow outperforms all non-oracle baselines on all metrics but data consistency. Notably, we observe that for image-reconstruction metrics, generative models which approximate the conditional distribution directly (AdjointFlow, CDM) – thus leveraging the knowledge encoded in paired data – mostly outperform PnP-DP approaches which attempt to approximate this distribution via a Bayesian framework at inference time. On the other hand, PnP-DP approaches often provide better data consistency due to their direct use of the forward model.
| Method | RRMSE | PSNR | SSIM | Data misfit |
| Traditional | ||||
| Adam | 33.3 (8.6) | 9.968 (2.083) | 0.305 (0.120) | 115.14 (52.10) |
| Adam† | 8.9 (2.1) | 21.273 (2.045) | 0.679 (0.073) | 15.89 (10.16) |
| L-BFGS† | 7.0 (2.3) | 23.398 (2.749) | 0.704 (0.077) | 9.18 (6.47) |
| PnP Diffusion Prior | ||||
| DPS | 25.0 (15.4) | 14.111 (6.820) | 0.491 (0.161) | 155.08 (92.17) |
| LGD | 24.4 (2.4) | 12.288 (0.889) | 0.341 (0.047) | 258.47 (26.40) |
| DiffPIR | 20.4 (12.9) | 16.113 (6.962) | 0.554 (0.191) | 88.53 (56.91) |
| DAPS† | 20.1 (10.3) | 14.914 (4.184) | 0.321 (0.067) | 111.13 (71.33) |
| PnP-DM | 25.9 (7.5) | 11.983 (2.269) | 0.431 (0.073) | 308.84 (26.34) |
| RED-Diff | 31.9 (10.2) | 10.372 (2.650) | 0.280 (0.108) | 94.67 (41.33) |
| Conditional Diffusion | ||||
| CDM | 17.6 (2.1) | 15.074 (1.298) | 0.425 (0.064) | 243.25 (35.69) |
| Ours | ||||
| AdjointFlow | 9.7 (1.9) | 20.530 (1.516) | 0.676 (0.062) | 115.63 (30.89) |
Table 4. We present the results for seismic imaging from InverseBench [40] (bold result indicates best non-oracle method). “Data misfit” quantifies agreement between predicted and observed measurements, following InverseBench’s normalization convention. For AdjointFlow we report performance using 1 sampling step, as we found this to give the best performance based on validation data. † indicates “oracle models” initialized from ground-truth data blurred with a Gaussian filter ( pixels), which requires access to the unknown ground truth and therefore serves only as an oracle baseline.
However, given the reliance of PnP methods on minimizing a data misfit functional at inference time, we find that they are prone to suffer from cycle-skipping in this setting because the functional is highly nonconvex (see Figure G.16). The significantly higher variance exhibited by almost all PnP-DP methods in Table 4 further evidences the instability.
Minimizing the data misfit functional is also computationally demanding, as calculating its derivatives requires intensive PDE simulations. PnP reconstructions inherit this high cost, and thus often take hours to generate a single result. Furthermore, while InverseBench [40] notes that the performance of PnP methods on seismic imaging can be highly sensitive to hyperparameter choices, AdjointFlow works out-of-the-box and circumvents the need for tedious tuning procedures. Thus, AdjointFlow avoids these inherent limitations of PnP methods and produces significantly more efficient and stable reconstructions of the wavespeed. Figure 8 illustrates a qualitative comparison of the results, where the relative stability of AdjointFlow compared to other methods is quite apparent.
Figure 8. Comparisons of AdjointFlow against different diffusion-based methods on the seismic imaging task.
Black Hole Imaging
According to the Rayleigh criterion (or diffraction limit) the resolution of a telescope is inversely proportional to the diameter of its aperture. Thus, to detect objects with small angular scales, such as black holes, one would desire a telescope as large as possible. While we cannot feasibly construct an Earth-sized telescope, it is still possible to obtain sparse measurements corresponding to such a telescope using an array of linked telescopes across the globe via a technique known as Very Long Baseline Interferometry (VLBI).
Forward problem. We wish to measure the brightness distribution of a black hole , where denotes angular sky coordinates supported in the field of view . VLBI does not directly construct an image but instead measures complex-valued sparse samples of the image’s 2D Fourier transform (often called visibilities).
Physically, a pair of telescopes acts as an interferometer: radiation arriving from the direction reaches the two sites with a small geometric path delay that depends on the physical separation vector between the telescopes. This delay induces a relative phase shift between received waveforms that varies sinusoidally across the sky, projecting an interference pattern onto the field of view. Correlating the recorded electric fields therefore yields one complex number per telescope pair and time: an inner product of the sky brightness and a complex sinusoid whose spatial frequency is set by the separation between telescopes.
Let and index two telescopes observed at time , and denote by the dimensionless baseline: the separation vector between the telescopes projected onto the 2D angular plane of the sky. Then to obtain a measurement, we use the van Cittert–Zernike theorem [73, 74] which states that the ideal visibility corresponding to this time-dependent baseline is the spatial Fourier coefficient of at that baseline:
Thus, each telescope pair and time provides one data point in the -plane. As the Earth rotates, the projected baselines change with , yielding additional Fourier samples, though the coverage remains highly sparse relative to the number of image pixels.
Challenges. In practice, the measured complex visibility is corrupted by telescope-dependent calibration errors and thermal noise [75, 76]. A common measurement model for observed visibilities is
for three sources of error: amplitude gains , phase errors (e.g., due to atmospheric turbulence and clock offsets), and additive thermal Gaussian noise . Because the per-telescope phase factors can dominate the visibility phase, direct use of is often unreliable. Instead, VLBI imaging commonly relies on closure quantities that cancel telescope-dependent errors [77].
For any telescope triple , the closure phase is defined as
Similarly, for a telescope quadruple , the log closure amplitude is
which removes the unknown gains under mild assumptions. Finally, to anchor the overall intensity scale, we constrain the total flux
Collecting these observables over available times and telescope combinations yields the nonlinear forward map
Since measurements are nonlinear closure quantities of , the inverse problem is inherently nonconvex and can admit multiple plausible solutions, especially under sparse coverage and super-resolution requirements.
Adjoint. Due to the underlying Fourier fringe kernels and sparse sampling, gradients computed on closure residuals generally appear as global oscillatory patterns rather than image-like features, even when they provide correct descent directions. Therefore, to facilitate successful reconstructions with AdjointFlow, we choose the initializer , where is the standardized per-pixel mean of the training dataset (namely, re-normalized to have zero spatial mean and unit spatial variance). While a simple, data-independent initialization, it nonetheless provides an inductive bias toward physically plausible black-hole image manifolds by encoding a strong ring-shaped prior.
To demonstrate a hypothetical setting in which we have access to a more informative data-dependent coupling, we also consider an “oracle” initialization obtained by Gaussian-blurring the ground-truth medium:
where is an isotropic Gaussian kernel and denotes convolution. Here controls the spatial smoothing level, and we choose (for images of resolution ), which removes fine-scale details while preserving the large-scale structure.
Benchmark Dataset
Since the General Relativistic Magnetohydrodynamic (GRMHD) simulated black hole images training dataset used by InverseBench is not publicly available, we generate our own dataset of the same size – 50,000 black holes at resolution – using the pretrained diffusion prior made available by InverseBench. However, we evaluate our models using the validation and test sets provided by InverseBench [40, 65] (which were also generated with a pretrained diffusion prior).
Methods. InverseBench evaluates two classical optimization algorithms (SMILI [78], EHT-Imaging [79, 80]) and six PnP-DP methods on this problem. Their diffusion priors use a pretrained NCSN++ U-net [49]; however, we find that AdjointFlow achieves superior results even when instantiated with a smaller convolutional architecture, similar to that used in the frequency-domain inverse scattering problems. We also find that the gradient of the closure quantities, though generally appearing as a global oscillatory pattern, still provides useful physical information to the network and empirically helps reduce the data misfit statistics. Therefore, we concatenate the gradient to the network as an additional input channel. Measurement data is pre-processed with a small MLP and then embedded to modulate the network features via FiLM conditioning [81].
Results
Results are presented in Table 5, with illustrative examples shown in Figure 9. We find that over all levels of measurement sparsity, AdjointFlow performs substantially better than previous methods in terms of PSNR reconstruction quality. However, we also find that the base AdjointFlow model using data-independent initialization markedly struggles to produce reconstructions consistent with the measurement data, as evidenced by large metrics. CDM also outperforms PnP-DP methods on reconstruction quality, though not to the extent of AdjointFlow, yet similarly struggles with data consistency.

Figure 9. Comparisons of AdjointFlow against different diffusion-based methods for black hole imaging with 3% observation ratio. Even with the simple ring-shaped initialization, AdjointFlow properly matches the shape of both simpler ring-like black holes as well as those with a more exotic accretion disk.
Table 5. We present the results for black hole imaging from InverseBench [40] with visibility noise (gain, phase, and thermal) added via EHT library. AdjointFlow † indicates that we use as the physics-based approximation the ground-truth image blurred with a Gaussian filter (). While the baseline AdjointFlow improves reconstruction accuracy, it struggles to achieve high data consistency. This issue is resolved by either (a) inference-time guidance via RED-Flow, or (b) a more informative coupling with AdjointFlow †, both of which significantly improve data consistency to be competitive with state-of-the-art. The top panel reports reconstruction quality and the bottom panel data consistency. Bold indicates best performance of non-oracle models.
| Reconstruction quality | ||||||
| Observation time ratio | 3% | 10% | 100% | |||
| Method | PSNR ↑ | Blur PSNR ↑ | PSNR ↑ | Blur PSNR ↑ | PSNR ↑ | Blur PSNR ↑ |
| Traditional | ||||||
| SMILI | 18.51 (1.39) | 23.08 (2.12) | 20.85 (2.90) | 25.24 (3.86) | 22.67 (3.13) | 27.79 (4.02) |
| EHT-Imaging | 21.72 (3.39) | 25.66 (5.04) | 22.67 (3.46) | 26.66 (3.93) | 24.28 (3.63) | 28.57 (4.52) |
| PnP Diffusion Prior | ||||||
| DPS | 24.20 (3.72) | 30.83 (5.58) | 24.36 (3.72) | 30.79 (5.75) | 25.86 (3.90) | 32.94 (6.19) |
| LGD | 22.51 (3.76) | 28.50 (5.49) | 22.08 (3.75) | 27.48 (5.09) | 21.22 (3.64) | 26.06 (4.98) |
| RED-Diff | 20.74 (2.62) | 26.10 (3.35) | 22.53 (3.02) | 27.67 (4.53) | 23.77 (4.13) | 29.13 (6.22) |
| PnP-DM | 24.25 (3.45) | 30.49 (4.93) | 24.57 (3.47) | 30.80 (5.22) | 26.07 (3.70) | 32.88 (6.02) |
| DAPS | 23.54 (3.28) | 29.48 (4.88) | 23.99 (3.56) | 30.10 (5.13) | 25.60 (3.64) | 32.78 (5.68) |
| DiffPIR | 24.12 (3.25) | 30.45 (4.88) | 23.84 (3.59) | 30.04 (5.03) | 25.01 (4.64) | 31.86 (6.56) |
| Conditional Diffusion | ||||||
| CDM | 26.86 (3.60) | 35.43 (5.32) | 26.98 (3.67) | 35.96 (5.76) | 26.98 (3.61) | 35.56 (5.39) |
| Ours | ||||||
| AdjointFlow | 28.78 (3.44) | 38.28 (5.23) | 28.35 (3.38) | 37.81 (5.42) | 29.12 (3.47) | 38.91 (5.25) |
| RED-Flow | 28.54 (3.81) | 37.62 (5.98) | 28.55 (3.72) | 37.68 (6.08) | 29.63 (3.50) | 39.69 (5.51) |
| AdjointFlow † | 31.28 (2.37) | 42.96 (2.20) | 31.20 (2.38) | 42.94 (2.24) | 31.26 (2.37) | 42.92 (2.25) |
| Data consistency | ||||||
| Observation time ratio | 3% | 10% | 100% | |||
| Method | ||||||
| Traditional | ||||||
| SMILI | 1.478 (0.428) | 4.348 (3.827) | 1.209 (0.169) | 21.788 (12.491) | 1.878 (0.952) | 17.612 (10.299) |
| EHT-Imaging | 1.507 (0.485) | 1.695 (0.539) | 1.166 (0.156) | 1.240 (0.205) | 1.251 (0.250) | 1.259 (0.316) |
| PnP Diffusion Prior | ||||||
| DPS | 8.024 (24.336) | 5.007 (5.750) | 13.052 (43.087) | 6.614 (26.789) | 8.759 (37.784) | 5.456 (24.185) |
| LGD | 15.825 (16.838) | 12.862 (12.663) | 10.775 (21.684) | 13.375 (56.397) | 13.239 (17.231) | 13.233 (39.107) |
| RED-Diff | 6.713 (6.925) | 9.128 (19.052) | 2.488 (2.925) | 4.916 (13.221) | 1.853 (0.938) | 2.050 (2.361) |
| PnP-DM | 2.201 (1.352) | 1.668 (0.551) | 1.433 (0.417) | 1.336 (0.478) | 1.311 (0.195) | 1.199 (0.221) |
| DAPS | 3.647 (3.287) | 2.329 (1.354) | 1.545 (0.705) | 2.253 (9.903) | 1.300 (0.324) | 1.229 (0.532) |
| DiffPIR | 14.085 (14.105) | 10.545 (8.860) | 5.374 (3.733) | 5.205 (5.556) | 3.271 (1.623) | 2.970 (1.202) |
| Conditional Diffusion | ||||||
| CDM | 21.811 (46.440) | 13.202 (31.235) | 16.200 (25.382) | 13.978 (23.813) | 19.241 (23.680) | 13.531 (12.885) |
| Ours | ||||||
| AdjointFlow | 8.118 (18.273) | 7.868 (20.607) | 15.743 (33.948) | 18.372 (71.714) | 11.734 (16.559) | 16.302 (49.840) |
| RED-Flow | 1.483 (0.545) | 1.539 (0.726) | 1.155 (0.143) | 1.302 (0.254) | 1.130 (0.123) | 1.196 (0.177) |
| AdjointFlow † | 1.515 (0.520) | 1.668 (0.630) | 1.293 (0.253) | 1.302 (0.295) | 1.294 (0.241) | 1.371 (0.363) |
To overcome this challenge, we demonstrate that adding inference-time guidance from the forward model via RED-Flow is sufficient to improve data consistency. In fact, RED-Flow achieves the best data consistency in all but two instances, for which it is a close second. Furthermore, using the blurred-ground-truth initialization (55) produces high-quality and data-consistent reconstructions without added inference-time costs. However, we recall that this is an oracle diagnostic unavailable from the observation alone and is therefore not a deployable initialization in practice. Therefore, it serves primarily as a demonstration of the possible gains from a more informative initializer, lending support to the empirical benefits of choosing a physically informative initialization .
Ablations
To verify the design of AdjointFlow, we ablate the choices we made given the motivation of § 3. We focus on the nonlinear inverse scattering problem – which supplies four distinct datasets covering a range of difficulties and challenges – as a strong canonical baseline on which to test sampling methods, interpolant designs, reference distributions, and network parameterizations. To isolate the choice of initialization for AdjointFlow, we additionally consider the linear inverse scattering problem, as it admits inexpensive physics-based approximations of varying accuracy (namely, both an adjoint and a regularized pseudoinverse).
Sampling methods and learned flow. As discussed in § 2.3, the SI framework provides flexibility with several modeling choices: how to add noise, how to generate samples (deterministically with ODEs (11) or stochastically with SDEs (12)), and how to schedule the added noise.
We test how ODE and SDE sampling methods, different learned fields, as well as different choices for the noise bridge affect performance, especially when using the physics-based reference distribution .
Specifically, as enabled by the velocity decomposition (26), we evaluate both learning the standard SI velocity field directly, or learning and and then combining them to form the standard velocity. We also investigate three choices of the noise-bridge term: , , and . For the schedule labeled the interpolant is with , namely, a Gaussian centered at the physics-based initialization. The standard SI ODE and SDE use this Gaussian initialization, whereas the noise-free-velocity ODE still starts deterministically at .
We evaluate performance across a range of sampling timesteps and noise-bridge scale , and present the accuracy-efficiency curve for the best performing choice of on each dataset in Figure 10. Among the evaluated configurations, the noise-free-velocity ODE achieves highest accuracy on three of the four datasets. Notably, the noise-free velocity’s performance is largely decoupled from the choice of both noise bridge and number of sampling steps, enabling more flexibility in interpolant design and accelerated sampling.
Figure 10. We compare accuracy (RRMSE) and efficiency (number of sampling steps) of different stochastic interpolants on the four nonlinear inverse scattering datasets. The best performance on each dataset is labeled with a diamond. We do not use TP parameterizations for this ablation. For SDE sampling we choose in (12) to cancel the explicit factor in the score correction. For , the noise-free-velocity ODE uses a deterministic initialization, while the other samplers use a Gaussian initialization. We observe that sampling with performs consistently well across datasets and only requires a small number of sampling steps for near-optimal performance.
Initial distribution and parameterization. We compare the standard flow-matching interpolant with reference distribution (an “uncoupled SI”) with AdjointFlow’s physics-based initialization (a “coupled SI”). We also evaluate both interpolant designs with and without their respective TP parameterizations – (33) for the uncoupled SI, and (32) for the coupled SI. Following [53], we clip the denominator of (33) when it goes below 0.05 to avoid numerical instability during training.
We train all interpolants with the same architecture and training procedure, and evaluate them on the four nonlinear inverse scattering datasets. For all models, inference is conducted with a fixed 8 sampling steps.
We present results in Table 6, which illustrates a crucial interaction between the construction of reference distribution and network parameterization. Without TP, the coupled SI has lower accuracy than the uncoupled SI on three of four datasets. With TP, this comparison reverses: the coupled model achieves higher accuracy on every dataset, and outperforms the base uncoupled SI on all but 3–5–10h Triangles. The effect of TP likewise depends on the initialization: on all four datasets, it improves accuracy for the coupled SI but worsens it for the uncoupled SI. Crucially, the DD-TP which improves the coupled SI so much is only possible with the singular reference distribution used by AdjointFlow; the standard TP from (33) includes a singular denominator and thus requires additional truncation to remain stable, yet rendering it less effective.
| Method | Shepp–Logan | 3–5–10h Triangles | 10h Overlapping Squares | Brain Scans |
| RRMSE (%) ↓ | ||||
| Uncoupled SI + | 0.972 (0.395) | 0.590 (1.599) | 1.808 (2.403) | 4.711 (1.250) |
| Uncoupled SI + + TP | 1.097 (0.504) | 1.356 (2.871) | 2.649 (2.537) | 4.887 (1.282) |
| Coupled SI + | 1.031 (0.265) | 1.228 (1.473) | 2.345 (2.159) | 4.233 (1.020) |
| Coupled SI + + DD-TP (AdjointFlow) | 0.379 (0.158) | 1.108 (2.861) | 1.143 (1.686) | 3.421 (0.809) |
Table 6. Comparison of reference distribution and model parameterization on the four nonlinear inverse scattering datasets, with mean and standard deviation of RRMSE across the test set shown. We fix the number of sampling steps at 8 for all models. Without TP, we find that a coupled interpolant does not meaningfully improve results on these datasets, demonstrating the practical necessity of the DD-TP parameterization. Bold indicates the best result on each dataset.
Together, the physics-based initialization and DD-TP achieve the best accuracy on three of the four datasets. These results suggest that the benefits of the method depend on the combined construction of initialization and network parameterization, rather than either modification in isolation. Namely, the known physics-based coupling allows DD-TP to express the velocity as a residual between the predicted reconstruction and the prescribed initialization. Incorporating this known contribution analytically may therefore help explain why TP is particularly effective in the coupled setting.
We note that the 3–5–10h Triangles dataset is the one case in both ablation studies in which the noise-free velocity does not achieve the best performance. This suggests that the adjoint-based initialization may not be as informative for this dataset as for the others. Qualitatively, one may note that the back-projections from the low-frequency adjoint in Figure 4b fail to fully capture high-frequency details of the smallest triangles. Therefore, a more informative initialization for 3–5–10h Triangles may reduce the observed performance gap; we leave this exploration to future work.
Choice of initialization. The 3–5–10h Triangles results suggest that the benefit of AdjointFlow depends on how informative its initialization is. To test this directly, we train AdjointFlow on the linear inverse scattering problem of § 4.2 with four choices of , holding the architecture, training procedure, and sampler fixed. Two initializations are data-dependent: the adjoint and the regularized pseudoinverse used in the main experiments. The other two initializations are data-independent: the constant , and the standardized training mean equivalent to the initialization used for black hole imaging. We report empirical transport distance (Appendix § 16.§ 3) computed over the test sets alongside reconstruction metrics in Table 7.
Data-dependent initializations demonstrate a clear advantage, vastly outperforming data-independent ones across all metrics: for example, they improve reconstructions by 8 to 19 dB in PSNR at every receiver count. Consistent with Proposition 3.1, the adjoint also lies closer to the target than the constant initialization at every receiver count. The pseudoinverse initialization further reduces transport distance between endpoints and achieves the best performance at every receiver count.
Between the two data-independent initializations, however, improves performance over even though it lies farther from the target (a consequence of standardization of the unscaled training mean), demonstrating that transport distance by itself is not entirely predictive of performance. We posit that, despite the increased transport distance, the resulting spatial structure of may nonetheless be easier for the network to refine than a constant image.
Together, these results support choosing a physically informative initialization: incorporating the measurements has the largest effect, and between the data-dependent initializations, a more accurate one further improves reconstruction.
Additional ablations. Additional ablations and tests covering performance in noisy or uncertain environments, sample complexity, empirical transport distances, and training techniques are covered in Appendix § 16.
Related Work
Classical Approaches
Optimization-based reconstruction has long been a standard technique for solving many classical scientific inverse problems. In this setting, one seeks to minimize a data misfit together with regularization to stabilize the inversion in ill-posed and noisy regimes [41, 82]. We focus on this optimization viewpoint and refer the reader to [8, 83, 9] for reviews of qualitative and analysis-driven approaches.
In particular, wave-based inverse problems constitute an important and challenging subclass, where the goal is to reconstruct medium or object properties – such as the refractive index, permittivity, or wavespeed – from boundary or diffraction measurements of scattered wave fields [9, 13].
With improved numerical solutions of the underlying PDEs, full waveform inversion (FWI) emerged in the 1980s [42] and became a central paradigm in seismic imaging [11, 12]. FWI recasts inversion as a PDE-constrained optimization problem, seeking parameters that minimize the mismatch between measured data and synthetic data generated by solving the governing PDE. Its primary advantage over ray-based methods is its ability to model the full wavefield, thereby capturing finite-frequency, diffraction, and scattering effects neglected by geometric-optics approximations. This increased physical fidelity comes at the expense of substantial computational and optimization challenges.
Despite its success, particularly in exploration geophysics, FWI faces several well-known obstacles. First, the per-iteration cost is dominated by repeated forward and adjoint PDE solves, making high-resolution inversion computationally expensive even with modern fast wave solvers such as sweeping and domain-decomposition-style methods [84, 85]. Second, the objective is highly nonconvex, and convergence to spurious local minima (cycle-skipping) is common, especially in the absence of low-frequency data [5]. Common mitigation strategies include adding regularization [15, 5], employing multiscale or frequency-continuation strategies [68, 16], and extrapolating or interpolating missing low frequencies [14]. Third, recovery of fine-scale structure is constrained by wavelength, acquisition geometry, and diffraction, even under favorable noise levels and sampling [86].
Deterministic ML Approaches
Motivated by the limitations of classical optimization-based methods, a large body of work has explored learning-based solvers that replace or accelerate inversion by learning explicit mappings from measurements to reconstructions using supervised regression. Representative approaches include learned representation transforms [87] and model-based deep learning architectures such as MoDL, which combines a learned CNN prior with alternating data-consistency updates in an unrolled iterative reconstruction framework [88].
In the context of wave-based inverse scattering, deterministic ML approaches typically employ supervised neural networks to regress unknown parameters directly from measured scattered fields [89]. Learned primal-dual methods unroll gradient-like optimization schemes while replacing hand-crafted update rules with learned operators that receive data-misfit information [90, 91]. Other architectures explicitly seek to exploit structure and symmetries in the wave-based inverse operator itself, such as SwitchNet [18], WideBNet [63], EquiNet, and B-EquiNet [19].
Transport-Based Generative Models
Bayesian formulations provide a principled framework for uncertainty quantification by modeling the posterior distribution of the unknown parameters conditioned on the measurements [24, 92]. Posterior inference can be carried out using sampling methods such as Markov chain Monte Carlo or Langevin-type dynamics, or through variational approximations, with the forward operator incorporated through the likelihood. However, repeated likelihood evaluations can become computationally expensive when the forward model requires solving a large-scale PDE.
Generative models provide an alternative by shifting much of this computational burden to an offline training stage and learning a distribution over reconstructions rather than individual point estimates. In particular, conditional diffusion models aim to sample from the unknown posterior directly, and have demonstrated strong performance in applications such as MRI, elastography, and computational imaging [28, 29, 93, 94, 95].
Diffusion models are defined by a stochastic process which transforms samples from a simple base distribution – commonly an isotropic Gaussian – into samples from the target conditional distribution [20, 21]. By approximating the score function of a reverse-time denoising process [96], diffusion models allow generation of new samples via numerically solving the reverse-time SDE. However, diffusion samplers can require hundreds of network evaluations for high-quality reconstructions, which can be restrictive when inference-time efficiency is important [49, 21]. It was subsequently realized that the sampling process could be reframed as solving a reverse-time ODE, providing substantial speedups with little loss of accuracy compared to SDEs [97]. Taking inspiration from optimal transport, flow matching [22, 98, 48] expands upon this approach by directly learning transport velocities along prescribed paths which efficiently transport mass between endpoint distributions.
Stochastic interpolants (SI) [48, 23] offer a unifying framework for such transport-based generative models. The SI framework additionally permits general, potentially dependent couplings between its endpoint distributions [39], providing flexibility beyond the conventional independent Gaussian source used by standard diffusion and flow models.
Ensuing work has aimed to further improve generative efficiency by constructing straighter or otherwise better-conditioned transport trajectories, thereby reducing the numerical cost of sampling even further [98, 99]. Distillation provides another route to few-step inference by compressing a trained diffusion or flow sampler into a student requiring fewer network evaluations [100, 101, 102]. Our approach is complementary in that we shorten and structure the transport path using information from the governing inverse problem itself.
Flow matching has also been applied to scientific inverse problems such as seismic FWI [103], including within online inversion [33] and to refine an existing FWI reconstruction [104]. A recent study [105] examines the behavior of conditional flow matching in the physics-constrained, finite-training-data regime characteristic of scientific inversion, and compares Gaussian sources with sources sampled from the parameter prior. More closely related to our setting, DAWN-FM [35] applies flow matching to inverse problems by conditioning the learned velocity field on a physics-based data embedding, such as a back-projection. However, the physics-based approximation enters DAWN-FM as conditioning information while the transport itself retains the standard Gaussian reference distribution.
Alternative Endpoints, Couplings, and Bridges in Generative Models
A related line of work replaces the standard noise-to-image paradigm by learning transport directly between informative endpoint distributions. Within image restoration and translation, ISB [106] and BBDM [107] formulate generation as a stochastic bridge between degraded and clean image distributions. InDI [108] instead learns a direct iterative corrupted-to-clean inversion map rather than a conditional denoising process initialized from pure noise. Mean-reverting SDE models retain a stochastic diffusion formulation but center the forward process around the degraded observation itself [109]. DBIM [110] adapts design principles of denoising diffusion implicit models [97] to further accelerate the inference speed of diffusion bridge models on image restoration tasks.
Informative-endpoint constructions also extend to inverse problems whose measurements and unknowns occupy different mathematical spaces, where inexpensive approximate reconstructions – for example via back-projection or linearized adjoints – can provide useful parameter-space information. Jiang et al. [111] employ diffusion Schrödinger bridges to transport between electromagnetic property maps and channel representations, using a learned autoencoder network to rectify the dimensional mismatch. Projection Embedded Diffusion Bridge initializes CT reconstruction from a filtered back-projection image and incorporates the projection measurements into the reverse dynamics to improve data consistency [112]. Related work also considers learning from indirect corrupted measurements through self-consistent stochastic interpolants, using a black-box forward simulator to enforce consistency between generated samples and observed data [113]. AdjointFlow extends this perspective to nonlinear scientific inverse problems and analyzes how a physics-based initialization interacts with the choice of reconstruction dynamics, particularly when the conditional posterior is highly concentrated.
Singular endpoint distributions have also been considered in recent works. floq [55] employs flow matching with a Dirac target distribution in the context of Q-learning. They demonstrate the benefits of iterative computation with dense supervision brought by a generative framework, a perspective supported by [56], even when the target is deterministic. Conversely, Chen and Vanden-Eijnden [114] study how stochastic dynamics can generate a nondegenerate target distribution from a deterministic initial state. AdjointFlow uses a singular physics-based reference distribution motivated by inverse problems with highly concentrated posteriors. We thus analyze the limiting setting in which both endpoints become concentrated and characterize the regularity of the standard and noise-free velocity fields used for reconstruction.
Plug-and-Play Priors
Another approach, complementary to sampling from the conditional posterior directly, is to learn an unconditional prior over the unknown parameters and incorporate the measurement information only during inference. Plug-and-play (PnP) methods originally introduced this idea by replacing an explicit regularizer with an external denoising prior [115]. More recently, diffusion and score models have been leveraged as powerful learned priors, while information from the likelihood or forward model is incorporated through inference-time guidance [49, 25, 30, 26, 116, 117]. PnP algorithms with learned priors have also been developed for scientific applications such as electromagnetic scattering [118, 119] and seismic FWI [31, 120]. While successful in many imaging applications, these methods typically require repeated forward-model evaluations and, depending on the approach, adjoint, pseudoinverse, or Jacobian-based computations throughout inference. For wave-based problems, this can yield inference costs comparable to classical iterative inversion algorithms. The InverseBench benchmark [40] provides a systematic comparison of these approaches across a range of scientific inverse problems.
Conclusion
We introduce AdjointFlow, a physics-based framework for scientific inverse problems motivated by two limitations of conventional Gaussian-to-data transport: an uninformative initialization leaves available physics-based approximations unused, and transport to sharply concentrated posteriors can produce ill-conditioned velocity fields. AdjointFlow addresses these limitations by reconsidering two design axes: the source distribution and the velocity used for reconstruction.
First, we exploit paired measurement-reconstruction data and the governing physics to construct an informative initialization. An adjoint or approximate inverse function maps measurements into parameter space, providing a physically meaningful initialization associated with each target reconstruction. We identify conditions under which this initialization reduces transport distance and show that posterior concentration favors concentrating the source as well. Second, we introduce a noise-free velocity formulation whose regularity properties in the concentrated-endpoint regime support stable learning and numerical integration. Together, these choices yield a natural and practically effective data-dependent target-prediction parameterization that incorporates the known initialization analytically and aligns the learning objective with the desired reconstruction.
Across four scientific inverse problems, AdjointFlow matches or even improves reconstruction accuracy on five of seven datasets, while requiring substantially fewer integration steps than diffusion-based baselines. By employing additional inference-time scaling, RED-Flow further improves physical consistency and achieves state-of-the-art reconstruction accuracy on every dataset where we apply it. Our results indicate that the design of generative models for scientific inverse problems should account for the available physics in the generative transport itself, replacing generic noise-to-data transport with physics-informed refinement.
Limitations and future work. Several limitations of AdjointFlow motivate directions for future work.
First, AdjointFlow benefits most when the initialization is informative. Many PDE-constrained inverse problems admit useful adjoints or approximate adjoints, but in settings where the adjoint is unavailable, inaccurate, computationally expensive, or weakly correlated with the target, the advantage of the method may diminish. Heuristic physical priors, truncated classical inversions, or learned approximate inverse maps can be substituted, but their effectiveness is problem-dependent and may require additional validation or inference-time refinement.
Second, our current implementations assume paired measurement-reconstruction data and, in several experiments, fixed acquisition geometries. Extending the method to variable acquisition geometries such as changing sensor placements or numbers of sensors, as well as to unknown acquisition protocols or strongly distribution-shifted data, is likely possible, but would require additional architecture modifications and broader training distributions beyond the scope of this work.
Third, our best-performing variant of AdjointFlow falls outside the standard assumptions of existing stochastic-interpolant theory in two places by using a singular initial distribution and training against the noise-free velocity. We therefore do not inherit the marginal-correctness guarantees typical of stochastic interpolants when the conditions of the singular-endpoint limit are not met.
Finally, although we include robustness experiments, many benchmarks remain synthetic or semi-synthetic. Deployment in high-stakes scientific or engineering pipelines will require further testing under real measurement noise, model mismatch, calibration error, and out-of-distribution physical regimes.
Impact Statement
This work aims to improve machine-learning methods for scientific inverse problems. By enabling efficient, high-quality reconstructions, AdjointFlow may lower the computational cost and energy usage of generative inverse solvers, especially in settings where repeated forward and adjoint PDE solves are expensive. More efficient reconstruction tools could make advanced imaging and simulation-based inference more accessible to scientific laboratories, medical researchers, and engineering groups with limited computational resources.
At the same time, inverse-problem solvers can affect consequential decisions when used in domains such as healthcare, geophysics, infrastructure inspection, or remote sensing. Reconstructions produced by AdjointFlow are learned approximations and may be unreliable under certain conditions, an important consideration in settings where false positives/negatives could influence medical diagnosis, safety assessment, resource exploration, or scientific interpretation.
CRediT Authorship Contribution Statement
Ethan Hanold: Conceptualization, Methodology, Software, Investigation, Formal analysis, Validation, Writing – original draft, Writing – review & editing, Visualization. Nicholas M. Boffi: Conceptualization, Methodology, Supervision, Writing – original draft, Writing – review & editing. Qin Li: Conceptualization, Methodology, Supervision, Formal analysis, Writing – original draft, Writing – review & editing. Leonardo Zepeda-Núñez: Conceptualization, Methodology, Supervision, Writing – original draft, Writing – review & editing.
Data Availability
Much of the data used in this study is made available by the respective benchmarks: Back-Projection Diffusion [29] provides the 10hSquares [59] and Brain Scans [60] nonlinear inverse scattering datasets, and InverseBench [40] provides the cell phantom and FWI datasets, as well as validation and test sets for black holes [65]. The 3–5–10h Triangles and Shepp–Logan datasets were provided directly by the authors of Back-Projection Diffusion [29]. Code for generating these datasets is publicly available at https://github.com/borongzhang/back_projection_diffusion. The pretrained diffusion prior model checkpoint and generation script for generating a black hole training dataset are publicly available at https://github.com/devzhk/InverseBench. Code for AdjointFlow will be made available upon reasonable request.
Declaration of Generative AI and AI-Assisted Technologies in the Manuscript Preparation Process
During the preparation of this work the authors used ChatGPT, Gemini and Claude to write code and improve language and formatting. After using these tools, the authors reviewed and edited the content as needed and take full responsibility for the content of the published article.
Proofs
Proof of Proposition 3.1
Proof. Let . Then , and completing the square up to an -independent factor gives
We now apply the decomposition (15), using the fact that since they only differ by a shift:
This is nonnegative, and positive when . If , both base distributions coincide. □
Proof of Proposition 3.2
Proof. Given the decomposition (15), we aim to show . By the triangle inequality, , and by the reverse triangle inequality, . Comparing them gives a difference
so we look to show that the right-hand side is positive. By Taylor’s theorem, with an -Lipschitz Jacobian,
with . Therefore,
and
where we use because minimizes the least-squares misfit. Then, taking the norm of the above equation gives
where because the Jacobians are -Lipschitz. Finally, applying assumption (18) and plugging back into (A.3) gives the desired result.
Proof of Proposition 3.5
Proof. Since and are jointly Gaussian, the conditional expectation formula for jointly Gaussian random variables gives
Define
If , , and are independent, then and
If the target endpoint is singular, i.e. , we may write with , and then
Then, interpolant boundary conditions dictate that as , and thus must become unbounded as . Similarly, if , we may apply Jacobi’s formula for differentiating a determinant to get
The interpolant boundary conditions imply as , so and once again becomes unbounded as we approach the singular endpoint.
For the linear schedule with , , and along exact interpolant trajectories.
For the variance-preserving schedule and , one instead obtains and , which diverges in norm for .
Proof of Corollary 3.6
Proof. The same Gaussian-conditioning formula, now for , gives
Crucially, vanishes if .
More generally, suppose , , and the target distribution has a positive-definite covariance (here we absorb any scaling into ). Then, under the schedules , , and we have
has eigenvalues for since is positive definite, and thus extends continuously to . As a result,
so is uniformly Lipschitz in , giving uniqueness for the noise-free ODE. Finally, we set , with . Then initial condition and uniqueness give , hence .
Baselines
Plug-and-Play Methods
Since the posterior can be expressed as , plug-and-play diffusion prior (PnP-DP) methods leverage a pretrained diffusion model which can sample from , and then incorporate data-misfit information from the forward model to approximate the likelihood . PnP-DP methods have recently emerged as a powerful paradigm for image-based inverse problems due to the existence of large-scale diffusion prior models for natural images [71], and have recently begun to see use in scientific applications as well [31, 118, 119, 120]. These methods fall into a number of distinct categories, as delineated by InverseBench [40], which we summarize now for completeness:
Likelihood-based guidance. Guidance methods [116, 117, 121, 122, 26, 123] apply Bayes rule to rewrite the posterior score function as
and approximate the likelihood score while using a pretrained diffusion model to approximate the prior score.
Variable splitting. Borrowing from variable-splitting techniques in optimization [124], these methods divide inference into two alternating steps [125, 126, 127, 27, 128]. One step uses the forward model to sample the posterior in the neighborhood of the current (for example, using Langevin Monte Carlo) to reduce data misfit, and the second step uses the diffusion model to apply a prior-based denoising update.
Variational inference. These methods aim to approximate the posterior distribution with a simpler, easy-to-sample variational distribution via the KL-minimization objective
thus transforming the standard sampling procedure into an optimization problem [57, 32, 129].
Sequential Monte Carlo. SMC [130] augments standard Markov Chain Monte Carlo algorithms – which can struggle in inverse problems due to abrupt transitions from prior to posterior – and has recently been adapted to the sampling process of diffusion models [131, 132, 133, 134]. Such algorithms ease the transition from prior to posterior by introducing a smooth sequence of intermediate distributions that converge to the target distribution. Intermediate distributions are represented by a population of particles with importance weights that are evolved through iterative reweighting and resampling.
Deterministic Baselines
Two types of deterministic baselines are considered: classical numerical inversion and optimization algorithms and deterministic point-reconstruction ML models.
For nonlinear inverse scattering and seismic imaging, full waveform inversion (FWI) [42] is a physics-based baseline that reconstructs the perturbation by minimizing the nonlinear data misfit while updating the background model. Optimization is conducted with momentum techniques such as Adam or quasi-Newton methods such as L-BFGS [135]. In addition, for seismic imaging we consider the best-case scenario for FWI, where we set the initial condition of the model to a smoothed version of the ground-truth. This is unrealistic as computing this initial condition is still an area of active research [14], and is usually performed by other modalities, which are lower-resolution but are less prone to local minima.
For nonlinear inverse scattering we also consider four state-of-the-art deterministic neural operators. Building on the filtered back-projection (FBP) [9] framework, these networks aim to approximate both the back-scattering and filtering operators with structured neural networks. All four methods represent the filtering operator using a translationally equivariant CNN. They differ primarily in how the back-scattering operator is parameterized. In particular, SwitchNet [18] and WideBNet [63] employ butterfly-based factorizations to obtain low-complexity representations of the scattering operator, with WideBNet further incorporating FFT-inspired structure. EquiNet [19] reformulates the scattering integral via a change of variables to construct a rotationally equivariant network. Building on this, B-EquiNet [19] compresses the EquiNet architecture via a butterfly factorization. Deterministic models are trained end-to-end by minimizing mean squared error between predicted and ground-truth perturbations.
For linear inverse scattering, we consider FISTA-TV [67], which reconstructs the scattering potential by minimizing a least-squares data misfit with total variation (TV) regularization. The data misfit uses the linear forward operator obtained under the first Born approximation, while the TV penalty promotes piecewise-constant Algorithm 3 RED-Flow: learned-field data-consistency refinement
Input: , initialization , target-prediction network , forward map , steps , time-sampling distribution , weight , and optimizer.
Set and ; initialize optimizer state.
for do
Draw ; set .
Calculate gradient .
Take one optimizer step using , producing .
end for
Return: .
reconstructions with sharp interfaces. Optimization combines gradient steps on the data misfit with proximal updates for the TV regularizer and a momentum-based extrapolation that accelerates convergence.
For black hole imaging, we consider the classical reconstruction algorithms SMILI [78] and EHT-Imaging [79, 80]. Both implement regularized imaging methods that balance agreement with interferometric measurements against explicitly prescribed image priors. For the closure-based formulation considered here, reconstruction involves fitting closure phases and log closure amplitudes, together with the total flux constraint. These methods optimize the image directly, using regularization to constrain the reconstruction under sparse Fourier coverage.
Inference-Time Scaling
RED-Diff [57] is a variational approach to inference that bears resemblance to the regularization-by-denoising (RED) optimization method proposed in [136]. We adapt this method to the stochastic interpolant framework and call the resulting method RED-Flow.
Following the framework of RED-Diff, we aim to approximate the intractable posterior distribution with a simpler Gaussian variational distribution that seeks to minimize the KL divergence
essentially aiming to match the dominant mode of the posterior. Then, by allowing , the objective can be reduced to solving for the MAP estimator [57] which satisfies:
where is the stop-gradient operator, is a time-dependent weight scaling to balance the two terms, and is the minimum MSE target-prediction estimator produced by a diffusion model (with the expectation taken over time and the noise initialization of the diffusion model).
We now consider the coupled stochastic interpolant with a learned noise-free velocity . With the residual of the corresponding flow-matching loss, we have
where the terms cancel due to the data-dependent target-prediction parameterization. We therefore recover an analogue of the original regularization term in (C.2) (up to a factor of ), leading us to propose the RED-Flow objective
with . We then initialize with the physics-based initializer and run an off-the-shelf optimizer such as Adam [58] to solve the stochastic optimization problem. The full algorithm is covered in Algorithm 3.
We mention that unlike in RED-Diff, here carries no injected noise. The noise in RED-Diff is a sample from its Gaussian source, whereas our source is deterministic (the bridge noise serves only as training-time augmentation and we do not include it for inference). As a result, the only source of randomness for RED-Flow is the interpolant time .
In practice, we find it sufficient to parameterize the time-dependent weighting as for hyperparameters . We also found it beneficial to use a U-shaped time-sampling distribution [99] which biases the endpoints of :
where is a hyperparameter that controls how strongly samples concentrate near and . For these, as well as the optimizer’s base learning rate , we perform a hyperparameter sweep over a validation set with Bayesian optimization to select the final hyperparameters used for this paper’s results.
We implement RED-Flow for both linear and nonlinear inverse scattering, as well as black hole imaging. We find that it consistently leads to improved data consistency – and often reconstruction quality as well – at the cost of additional inference-time compute (for example, as shown in Figure 6a). Most notable is the impact on black hole imaging in Table 5: AdjointFlow struggles to achieve competitive metrics but RED-Flow fully resolves this issue, producing some of the best values of any method while using the same base model.
Therefore, if higher accuracy is desired and real-time reconstruction is not required, RED-Flow can improve reconstruction quality of a pretrained AdjointFlow model with no additional retraining.
Metrics
We evaluate reconstruction accuracy using the following metrics, which encompass standard image-based analyses, distributional distances, and problem-specific metrics. For stochastic methods, we generate one reconstruction per measurement , average metrics across the entire evaluation dataset, and report the means (and for some cases standard deviations). All reported inference costs correspond to this single-realization setting. We find that averaging multiple reconstructions per measurement does not substantially affect accuracy results, yet greatly increases inference cost, so we do not focus on this case.
Relative root mean square error (RRMSE).
is a common metric used to quantify pixel-wise reconstruction fidelity in PDE problems.
Peak signal-to-noise ratio (PSNR).
where is the Mean-Squared Error for images. PSNR gives the ratio between the maximum possible signal strength of the image and the power of the noise corrupting the reconstruction, and is represented as a logarithmic quantity using the decibel scale. For black-hole imaging, Blur PSNR evaluates reconstruction accuracy after blurring to the telescope’s target resolution [40].
Structural similarity index measure (SSIM).
is a metric used to quantify perceptual similarity between two images by taking into account the comparative measures of luminance (), contrast (), and structure () [137].
Sinkhorn divergence (SD). Sinkhorn Divergence, an entropically regularized optimal-transport-based distance between distributions [138, 139], is a metric to measure distributional alignment. We compute SD using the JAX-based Optimal Transport Tools [140] version 0.5.1, updated from the version used in [29].
Mean energy log ratio (MELR). To quantify how well reconstructions capture spectral consistency across spatial scales, we use MELR, which compares the energy spectra of generated and ground-truth samples in the Fourier domain.
We define the energy spectrum, which conveys how much energy an image has in a given radial frequency, as
where is the magnitude of the 2D wave-vector and represent the underlying spatial grid. Then to assess the overall consistency of the spectrum of the predicted image, we compute the scalar quantity
statistics. For the problem of black hole imaging, a standard data-fidelity objective uses a (normalized) misfit9 on the closure quantities and flux:
with representing estimated standard deviations and the counts of closure measurements. As a value closer to 1 indicates a better fit, we follow [40] and define a unified metric
to encompass both underfitting () and overfitting () cases.
Additional Ablations and Experiments
Here, we extend the exploration of model design choices discussed in § 5 of the main paper.
Robustness
In our experiments, the forward operator is exactly known and perfectly generates the synthetic data we train on. Yet, real-world measurement data often contains uncertainty due to factors such as imperfect sensing devices or even epistemic uncertainty in the system we are modeling. We should therefore not expect any guarantee that real-world data perfectly matches the training distribution on which AdjointFlow was trained. In fact, both benchmarks we compare against [29, 40] explicitly state the importance of robustness to distributional shifts due to noisy or mismatched forward models. Therefore, to assess the robustness of AdjointFlow to real-world measurement uncertainties, we evaluate performance in two scenarios: noisy measurements and inverse crimes.
Noisy Measurement Data
Following the evaluation criteria of InverseBench [40], the linear inverse scattering dataset already contains Gaussian noise and the black-hole dataset already contains Gaussian thermal noise in addition to phase and amplitude errors. In both cases, AdjointFlow still performs well compared to other methods (see Table 3 and Table 5).
To further investigate the effect of noisy measurements on AdjointFlow, we perform a systematic sweep over varying levels of measurement noise for each of the four nonlinear inverse scattering datasets. Specifically, we artificially corrupt the measurement data with 10%, 20%, and 40% additive Gaussian noise, where corrupting the data with noise is defined as
We present the results, alongside a comparison with EquiNet CDM, in Table E.8 with examples displayed in Figure E.11. For the three synthetic datasets, AdjointFlow remains accurate even in the presence of large amounts of measurement noise and successfully reconstructs most large, prominent features; however, reconstructions are heavily corrupted even at 10% noise for brain scans. Interestingly, even though AdjointFlow is deterministic at inference time, it continues to perform on par with the probabilistic CDM when observations are noisy.
Figure E.11. Effect of measurement noise on nonlinear inverse scattering. The panels show 10h Overlapping Squares (top left), 3–5–10h Triangles (top right), Shepp–Logan (bottom left), and Brain Scans (bottom right). Within each panel, columns correspond to 0%, 10%, 20%, and 40% added noise, as defined in the text. Rows show the measurement data, adjoint-based initialization, AdjointFlow reconstruction, reconstruction within the boxed region of interest (ROIs), reconstruction error, and error within that region.
| Noise Level | Method | Shepp–Logan | 3–5–10h Triangles | 10h Overlapping Squares | Brain Scans |
| 0% Noise | AdjointFlow | 0.379 | 1.108 | 1.143 | 3.421 |
| EquiNet CDM | 1.323 | 1.590 | 1.744 | 5.661 | |
| 10% Noise | AdjointFlow | 2.844 | 1.141 | 2.015 | 21.598 |
| EquiNet CDM | 3.355 | 1.564 | 2.675 | 21.889 | |
| 20% Noise | AdjointFlow | 7.800 | 1.677 | 5.763 | 38.648 |
| EquiNet CDM | 7.422 | 1.618 | 8.464 | 38.805 | |
| 40% Noise | AdjointFlow | 15.827 | 3.524 | 17.842 | 65.231 |
| EquiNet CDM | 14.827 | 3.522 | 24.761 | 65.949 |
Table E.8. Model performance on the four nonlinear inverse scattering datasets with increasing levels of noise added to the data, from 10% to 40%. We fix the number of sampling steps for AdjointFlow at 8, and compare to the results of the EquiNet CDM from [29] with 256 sampling steps. EquiNet CDM results for brain scans are obtained from a model we trained using the pipeline from [29].
Inverse Crimes
An inverse crime is where the same mathematical model is used to generate the synthetic data for training and to test the inversion algorithm. We now test how well AdjointFlow responds to out-of-distribution data generated by a different numerical method. Specifically, we follow [29] and assess performance on measurement data generated using lower-order solvers. We evaluate the effects of mismatched forward models on nonlinear inverse scattering and seismic imaging because the numerical implementations of the forward models we use for these problems have easily configurable finite-difference stencil orders.
For nonlinear inverse scattering, the training data was generated using an 8th-order finite-difference scheme, and we test performance on measurements generated with 4th- and 6th-order solvers for the three synthetic inverse scattering datasets. We visualize the distributional mismatch in Figure E.12, and observe that while the scattering data can differ by up to 10%, the adjoints remain essentially unchanged. Results are given in Table E.9 and demonstrate that AdjointFlow is robust to these distributional shifts, with minimal change in performance except for Shepp–Logan with a 4th order stencil.
| Stencil Order | Shepp–Logan RRMSE ↓ | Shepp–Logan MELR↓ | Shepp–Logan SD↓ | 3–5–10h Triangles RRMSE ↓ | 3–5–10h Triangles MELR ↓ | 3–5–10h Triangles SD↓ | 10h Overlapping Squares RRMSE↓ | 10h Overlapping Squares MELR ↓ | 10h Overlapping Squares SD↓ |
| 4th Order Stencil | 0.726 | 0.788 | 0.624 | 1.112 | 0.617 | 0.258 | 1.242 | 1.506 | 0.525 |
| 6th Order Stencil | 0.382 | 0.479 | 0.576 | 1.122 | 0.626 | 0.258 | 1.150 | 1.411 | 0.515 |
| 8th Order Stencil | 0.379 | 0.474 | 0.576 | 1.108 | 0.607 | 0.258 | 1.143 | 1.401 | 0.514 |
Table E.9. AdjointFlow performance on the three synthetic inverse scattering datasets when the test data is generated using different finite-difference stencil orders (training data was generated with an 8th order stencil). We report RRMSE as a percentage and MELR , and fix the number of sampling steps for AdjointFlow at 8.
For seismic imaging, the training data was generated using a 4th-order spatial finite-difference scheme, and we test performance on measurements generated with 2nd- and 4th-order solvers. We visualize the distributional mismatch in Figure E.13, and again note that the distributional shift has very little impact on the adjoint. The results in Table E.10 show that the different solver order has negligible impact on performance, further supporting the robustness of AdjointFlow to distributional shifts.
| Stencil Order | RRMSE (%) ↓ | PSNR ↑ | SSIM ↑ | Data misfit ↓ |
| 2nd order | 9.7 (1.9) | 20.515 (1.509) | 0.676 (0.062) | 112.39 (29.17) |
| 4th order | 9.7 (1.9) | 20.530 (1.516) | 0.676 (0.062) | 115.63 (30.89) |
Table E.10. AdjointFlow performance on seismic imaging using test data generated with 2nd and 4th order spatial finite-difference stencils (training data was generated with a 4th order stencil). We report performance using 1 sampling step, as we found this to give the best performance based on validation data.
Sample Complexity
We compare the training-data efficiency of AdjointFlow and EquiNet CDM by varying the number of training samples from 1,000 to 21,000, while fixing their respective sampling budgets at 8 and 256 steps. Results are presented in Table E.11, and show that AdjointFlow consistently achieves lower RRMSE across all four datasets and all training-set sizes. The improvement is already evident with only 1,000 samples and persists as additional training data are introduced. Notably, AdjointFlow requires far fewer training samples to achieve comparable
Figure E.12. Effect of finite-difference stencil order on nonlinear inverse scattering for (a) 10h Overlapping Squares, (b) 3–5–10h Triangles, and (c) Shepp–Logan. Each panel shows the ground-truth perturbation at left. The remaining columns compare the 8th-order and 4th-order results and their signed difference: measurement data at the highest probing frequency in the top row, and the corresponding adjoint back-projections in the bottom row.
Figure E.13. Effect of spatial finite-difference stencil order on seismic imaging. The ground-truth wavespeed map is shown at left. The remaining columns compare the 4th-order and 2nd-order results and their signed difference. The top row shows single-shot receiver measurements, and the bottom row shows the corresponding adjoint-based initializations. Each color bar gives the scale of its associated image.
accuracy to EquiNet CDM. These results indicate that the performance gains of AdjointFlow are not restricted to the large-data regime and suggest improved training-data efficiency relative to EquiNet CDM.
Table E.11: Model performance on four inverse scattering datasets as the number of training samples increases from 1,000 to 21,000. We fix the number of sampling steps for AdjointFlow at 8, and compare to the results of the EquiNet CDM from [29] with a fixed budget of 256 sampling steps. EquiNet CDM results for brain scans are obtained from a model we trained using the pipeline from [29].
| Training Samples | Method | Shepp–Logan | 3–5–10h Triangles | 10h Overlapping Squares | Brain Scans |
| 1,000 | AdjointFlow | 1.912 | 4.356 | 7.933 | 5.476 |
| EquiNet CDM | 2.085 | 8.475 | 12.454 | 9.485 | |
| 2,000 | AdjointFlow | 1.242 | 3.136 | 5.856 | 4.829 |
| EquiNet CDM | 1.644 | 5.454 | 7.893 | 7.995 | |
| 4,000 | AdjointFlow | 0.853 | 2.582 | 4.014 | 4.331 |
| EquiNet CDM | 1.379 | 3.525 | 4.896 | 7.120 | |
| 8,000 | AdjointFlow | 0.612 | 1.647 | 2.424 | 4.004 |
| EquiNet CDM | 1.376 | 2.824 | 2.756 | 6.291 | |
| 16,000 | AdjointFlow | 0.426 | 1.529 | 1.481 | 3.568 |
| EquiNet CDM | 1.281 | 1.957 | 2.184 | 5.833 | |
| 21,000 | AdjointFlow | 0.379 | 1.108 | 1.143 | 3.421 |
| EquiNet CDM | 1.323 | 1.590 | 1.744 | 5.661 |
Table E.11. Model performance on four inverse scattering datasets as the number of training samples increases from 1,000 to 21,000.
Empirical Transport Distances
To illustrate the geometry of the initializations in the concentrated-posterior regime, we approximate the conditional target for each measurement–reconstruction pair by . Writing for the initialization used by AdjointFlow and for the dimension of the reconstruction, we apply (21) to explicitly compute
We report the mean and standard deviation of these distances across the training examples in each dataset. Table E.12 shows that the concentrated, physics-based AdjointFlow initialization reduces transport distance compared to a standard Gaussian on every dataset we test. While our transport-distance analysis provides strong geometric motivation for the AdjointFlow initialization, it does not necessarily establish a causal relationship with observed model performance. Additionally, (E.2) provides a useful estimate when the training dataset is finite and discrete, but does not capture posterior variability that may exist in real-world settings.
Auxiliary Training Techniques
We observed modest gains for AdjointFlow in some settings from flow-matching training techniques adapted from Lee et al. [99]. These fall outside our main scope but suggest directions for future work.
| Reference Distribution | Shepp–Logan | 3-5-10h Tri | 10h Squares | Brain Scans | Cells () | Seismic Imaging | Black Holes |
| Gaussian | 113.1 (3.0) | 111.6 (18.7) | 113.1 (3.8) | 112.8 (8.6) | 180.7 (11.4) | 180.1 (18.3) | 89.7 (11.9) |
| Physics-based | 94.1 (16.0) | 77.4 (22.9) | 68.6 (7.2) | 95.7 (24.3) | 53.6 (10.1) / 24.0 (4.8) / 22.8 (4.7) | 169.6 (29.0) | 48.9 (11.3) |
Table E.12. Comparison of Wasserstein-2 distances estimated numerically between the reference and target distributions when the base distribution is a standard Gaussian vs. when the base distribution is concentrated at the physics-based approximation. We report the averages across each training dataset with standard deviation shown in parentheses.
Adapting [99], we replace the squared loss in (10) with a Pseudo-Huber loss combined with a time-weighted, SSIM-based (D.3) perceptual term:
where for an image , and . One may also use to add a data consistency term to the training loss, but we generally found this to be either computationally infeasible and/or ineffective in our limited experiments.
Additionally, one may optimize a reweighted objective. The U-shaped time-weighting scheme (C.5) of Lee et al. [99], with their choice , biases the endpoints of where learning may be more difficult.
Implementation Details
We implemented all models using JAX10, FLAX11 and swirl-dynamics12, and trained on NVIDIA Quadro RTX 6000, RTX A6000, L40S, and H100 GPUs. We use Adam [58] with linear warm-up from to over the first 5% of training, followed by cosine annealing to . We targeted the benchmark models’ epoch counts, reducing batch sizes when GPU memory required it. We use InverseBench’s publicly available implementations, pretrained diffusion prior checkpoints, and hyperparameter choices13 for linear inverse scattering, FWI, and black hole imaging. For our own PnP implementations, we follow InverseBench’s tuning procedure [40] with comparable hyperparameter ranges and tuning iterations, using Optuna [141] for Bayesian optimization. For RED-Flow we use 500 optimization iterations for nonlinear inverse scattering and 1000 for other problems. Tables F.13 and F.14 report parameter counts and dataset details.
| Model | Problem | ||
| EquiNet-CNN | Nonlinear inverse scattering | 156k | 375k |
| ADM (PnP) | Nonlinear inverse scattering | 0 | 26.8M |
| EquiNet-CNN | Linear inverse scattering () | 20k / 145k / 549k | 2.73M |
| ADM (PnP) | Linear inverse scattering | 0 | 26.8M |
| ADM (PnP) | Seismic Imaging | 0 | 26.8M |
| ADM (conditional) | Seismic Imaging | 550k | 27.8M |
| CNN | Black hole imaging (obs. ratio=3%/10%/100%) | 128k/263k/862k | 1.89M |
| NCSN++ (PnP) | Black hole imaging | 0 | 20.0M |
Table F.13. Neural network parameter counts by problem. As in Algorithm 1, denotes the main score/velocity/target-prediction network parameters and the conditional branch parameters. PnP models have no conditional branch ().
| Problem | Dimension of | Dimension of | Forward Eval. (sec) | Gradient Eval. (sec) | ||
| Nonlinear inverse scattering | 21000 | 500 | 2.310 | 2.455 | ||
| Linear inverse scattering | 10000 | 100 | 0.004 / 0.005 / 0.006 | 0.011 / 0.012 / 0.015 | ||
| Seismic Imaging | 50000 | 10 | 4.004 | 6.261 | ||
| Black hole imaging | 50000 | 100 | 185/885/4007 | 0.001 / 0.002 / 0.008 | 0.005 / 0.019 / 0.111 |
Table F.14. Dataset parameters and forward/gradient evaluation timings (medians of 50 evaluations after warm-up). FWI measurements are Fourier-transformed and sub-sampled to (§ 4.3). Linear inverse scattering uses receivers; black hole observation ratios are 3%, 10%, and 100%. Inverse scattering uses one Quadro RTX 6000 GPU; seismic and black hole imaging use Intel Xeon Gold 6248R CPUs on the same node, with 16 single-threaded workers and one CPU thread, respectively, following [40].
Additional Results
We provide additional qualitative comparisons for nonlinear inverse scattering on Brain Scans in Figure G.14, linear inverse scattering in Figure G.15, seismic imaging in Figure G.16, and black holes in Figure G.17. These examples complement the representative reconstructions shown in the main text and illustrate performance across a broader set of test instances.
Figure G.14. Further qualitative comparisons of AdjointFlow with different diffusion-based methods on nonlinear inverse scattering for the Brain Scans dataset.

Figure G.15. Further qualitative comparisons of AdjointFlow against diffusion baselines for linear inverse scattering with 60 receivers.

Figure G.16. Further qualitative comparisons of AdjointFlow against diffusion baselines for seismic imaging. Note that while other methods occasionally produce accurate reconstructions, only AdjointFlow consistently avoids cycle-skipping.

Figure G.17. Further qualitative comparisons of AdjointFlow against diffusion baselines for black hole imaging with 3% observation ratio.
References
- [1]W. Friedrich, P. Knipping, M. Laue, Interferenzerscheinungen bei Röntgenstrahlen, Annalen der Physik 346 (10) (1913) 971–988. doi:10.1002/andp.19133461004.DOI
- [2]N. Bleistein, J. W. Stockwell, Jr., J. K. Cohen, Mathematics of Multidimensional Seismic Imaging, Migration, and Inversion, 1st Edition, in: Interdisciplinary Applied Mathematics, Springer New York, 2001. doi:10.1007/978-1-4613-0001-4.DOI
- [3]F. Natterer, The Mathematics of Computerized Tomography, Vol. 32 of Classics in Applied Mathematics, SIAM, 2001. doi:10.1137/1.9780898719284.DOI
- [4]K. L. Bouman, M. D. Johnson, D. Zoran, V. L. Fish, S. S. Doeleman, W. T. Freeman, Computational imaging for VLBI image reconstruction, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2016, pp. 913–922. URL https://openaccess.thecvf.com/content_cvpr_2016/html/Bouman_Computational_Imaging_for_CVPR_2016_paper.htmlarxiv.org/abs/1512.01413
- [5]T. van Leeuwen, F. J. Herrmann, Mitigating local minima in full-waveform inversion by expanding the search space, Geophys. J. Int. 195 (1) (2013) 661–667. doi:10.1093/gji/ggt258.DOI
- [6]P. Hähner, T. Hohage, New stability estimates for the inverse acoustic inhomogeneous medium problem and applications, SIAM Journal on Mathematical Analysis 33 (3) (2001) 670–685. doi:10.1137/S0036141001383564.
- [7]D. Colton, R. Kress, Integral Equation Methods in Scattering Theory, Society for Industrial and Applied Mathematics, Philadelphia, PA, 2013. doi:10.1137/1.9781611973167.DOI
- [8]F. Cakoni, D. Colton, Qualitative methods in inverse scattering theory: An introduction, 1st Edition, Interaction of Mechanics and Mathematics, Springer Berlin, 2006. doi:10.1007/3-540-31230-7.DOI
- [9]D. L. Colton, R. Kress, Inverse Acoustic and Electromagnetic Scattering Theory, 2nd Edition, Vol. 93 of Applied Mathematical Sciences, Springer Berlin, 1998. doi:10.1007/978-3-662-03537-5.DOI
- [10]A. Tarantola, Inverse Problem Theory and Methods for Model Parameter Estimation, SIAM, 2005. doi:10.1137/1.9780898717921.DOI
- [11]R. G. Pratt, Seismic waveform inversion in the frequency domain; part 1: Theory and verification in a physical scale model, Geophysics 64 (3) (1999) 888–901. doi:10.1190/1.1444597.DOI
- [12]J. Virieux, A. Asnaashari, R. Brossier, L. Métivier, A. Ribodetti, W. Zhou, An introduction to full waveform inversion, in: V. Grechka, K. Wapenaar (Eds.), Encyclopedia of Exploration Geophysics, Society of Exploration Geophysicists (SEG), 2014, Ch. 6, pp. R1–1–R1–40. doi:10.1190/1.9781560803027.entry6.DOI
- [13]J. Virieux, S. Operto, An overview of full-waveform inversion in exploration geophysics, Geophysics 74 (6) (2009) WCC1–WCC26. doi:10.1190/1.3238367.DOI
- [14]Y. E. Li, L. L. Demanet, Full-waveform inversion with extrapolated low-frequency data, Geophysics 81 (6) (2016) R339–R348. doi:10.1190/geo2016-0038.1.DOI
- [15]W. W. Symes, J. J. Carazzone, Velocity inversion by differential semblance optimization, Geophysics 56 (5) (1991) 654–663. doi:10.1190/1.1443082.DOI
- [16]Y. Chen, Inverse scattering via Heisenberg’s uncertainty principle, Inverse Problems 13 (2) (1997) 253–282. doi:10.1088/0266-5611/13/2/005.DOI
- [17]Z. Xu, Y. Li, X. Cheng, Butterfly-Net2: Simplified Butterfly-Net and Fourier transform initialization, in: J. Lu, R. R. Ward (Eds.), Proceedings of The First Mathematical and Scientific Machine Learning Conference, Vol. 107 of Proceedings of Machine Learning Research, PMLR, 2020, pp. 431–450. URL https://proceedings.mlr.press/v107/xu20b.htmlarxiv.org/abs/1912.04154
- [18]Y. Khoo, L. Ying, SwitchNet: A neural network model for forward and inverse scattering problems, SIAM Journal on Scientific Computing 41 (5) (2019) A3182–A3201. doi:10.1137/18M1222399.DOI
- [19]B. Zhang, L. Zepeda-Núñez, Q. Li, Solving the wide-band inverse scattering problem via equivariant neural networks, Journal of Computational and Applied Mathematics 451 (2024) 116050. doi:10.1016/j.cam.2024.116050.DOI
- [20]Y. Song, S. Ermon, Generative modeling by estimating gradients of the data distribution, in: Advances in Neural Information Processing Systems, Vol. 32, Curran Associates, Inc., 2019, pp. 11918–11930. URL https://openreview.net/forum?id=B1lCyYrBgLHarxiv.org/abs/1907.05600
- [21]J. Ho, A. Jain, P. Abbeel, Denoising diffusion probabilistic models, in: H. Larochelle, M. Ranzato, R. Hadsell, M. F. Balcan, H. Lin (Eds.), Advances in Neural Information Processing Systems, Vol. 33, Curran Associates, Inc., 2020, pp. 6840–6851. URL https://proceedings.neurips.cc/paper/2020/hash/4c5bcfec8584af0d967f1ab10179ca4b-Abstract.htmlarxiv.org/abs/2006.11239
- [22]Y. Lipman, R. T. Q. Chen, H. Ben-Hamu, M. Nickel, M. Le, Flow matching for generative modeling, in: International Conference on Learning Representations, 2023. URL https://openreview.net/forum?id=PqvMRDCJ9tarxiv.org/abs/2210.02747
- [23]M. Albergo, N. M. Boffi, E. Vanden-Eijnden, Stochastic interpolants: A unifying framework for flows and diffusions, Journal of Machine Learning Research 26 (209) (2025) 1–80. URL http://jmlr.org/papers/v26/23-1605.html
- [24]A. M. Stuart, Inverse problems: A Bayesian perspective, Acta Numerica 19 (2010) 451–559. doi: 10.1017/S0962492910000061.DOI
- [25]A. Jalal, M. Arvinte, G. Daras, E. Price, A. G. Dimakis, J. Tamir, Robust compressed sensing MRI with deep generative priors, in: M. Ranzato, A. Beygelzimer, Y. Dauphin, P. S. Liang, J. W. Vaughan (Eds.), Advances in Neural Information Processing Systems, Vol. 34, Curran Associates, Inc., 2021, pp. 14938–14954. URL https://openreview.net/forum?id=wHoJrT6MMbarxiv.org/abs/2108.01368
- [26]H. Chung, J. Kim, M. T. McCann, M. L. Klasky, J. C. Ye, Diffusion posterior sampling for general noisy inverse problems, in: International Conference on Learning Representations, 2023. URL https://openreview.net/forum?id=OnD9zGAGT0karxiv.org/abs/2209.14687
- [27]B. Zhang, W. Chu, J. Berner, C. Meng, A. Anandkumar, Y. Song, Improving diffusion inverse problem solving with decoupled noise annealing, in: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2025, pp. 20895–20905. doi:10.1109/CVPR52734.2025.01946.
- [28]A. Dasgupta, A. Marciano da Cunha, A. Fardisi, M. Aminy, B. Binder, B. Shaddy, A. A. Oberai, Unifying and extending diffusion models through PDEs for solving inverse problems, Computer Methods in Applied Mechanics and Engineering 448 (2026) 118431. doi:10.1016/j.cma.2025.118431.
- [29]B. Zhang, M. Guerra, Q. Li, L. Zepeda-Núñez, Back-Projection Diffusion: Solving the wideband inverse scattering problem with diffusion models, Computer Methods in Applied Mechanics and Engineering 443 (2025) 118036. doi:10.1016/j.cma.2025.118036.
- [30]Y. Song, L. Shen, L. Xing, S. Ermon, Solving inverse problems in medical imaging with score-based generative models, in: International Conference on Learning Representations, 2022. URL https://openreview.net/forum?id=vaRCHVj0uGI
- [31]F. Wang, X. Huang, T. A. Alkhalifah, A prior regularized full waveform inversion using generative diffusion models, IEEE Transactions on Geoscience and Remote Sensing 61 (2023) 1–11. doi:10.1109/TGRS.20233.3337014.
- [32]B. T. Feng, J. Smith, M. Rubinstein, H. Chang, K. L. Bouman, W. T. Freeman, Score-based diffusion models as principled priors for inverse imaging, in: 2023 IEEE/CVF International Conference on Computer Vision (ICCV), 2023, pp. 10486–10497. doi:10.1109/ICCV51070.2023.00965.
- [33]X. Huang, P. Perdikaris, Self-flow-matching assisted full waveform inversion (2026). arXiv:2603.13425.arxiv.org/abs/2603.13425
- [34]H. Chung, J. Kim, J. C. Ye, Direct diffusion bridge using data consistency for inverse problems, in: A. Oh, T. Naumann, A. Globerson, K. Saenko, M. Hardt, S. Levine (Eds.), Advances in Neural Information Processing Systems, Vol. 36, Curran Associates, Inc., 2023, pp. 7158–7169. doi:10.52202/075280-0313.
- [35]S. Ahamed, E. Haber, DAWN-FM: Data-aware and noise-informed flow matching for solving inverse problems, Foundations of Data Science 11 (2026) 121–149. doi:10.3934/fods.2026005.
- [36]A. W. van der Vaart, Asymptotic Statistics, Vol. 3 of Cambridge Series in Statistical and Probabilistic Mathematics, Cambridge University Press, Cambridge, 1998. doi:10.1017/CBO9780511802256.
- [37]Y. Gao, J. Huang, Y. Jiao, S. Zheng, Convergence of continuous normalizing flows for learning probability distributions (2024). arXiv:2404.00551.
- [38]L. Kunkel, Distribution estimation via flow matching with Lipschitz guarantees, Journal of Multivariate Analysis 215 (2026) 105657. doi:10.1016/j.jmva.2026.105657.
- [39]M. S. Albergo, M. Goldstein, N. M. Boffi, R. Ranganath, E. Vanden-Eijnden, Stochastic interpolants with data-dependent couplings, in: R. Salakhutdinov, Z. Kolter, K. Heller, A. Weller, N. Oliver, J. Scarlett, F. Berkenkamp (Eds.), Proceedings of the 41st International Conference on Machine Learning, Vol. 235 of Proceedings of Machine Learning Research, PMLR, 2024, pp. 921–937. URL https://proceedings.mlr.press/v235/albergo24a.htmlarxiv.org/abs/2310.03725
- [40]H. Zheng, W. Chu, B. Zhang, Z. Wu, A. Wang, B. Feng, C. Zou, Y. Sun, N. Kovachki, Z. Ross, K. Bouman, Y. Yue, InverseBench: Benchmarking plug-and-play diffusion priors for inverse problems in physical sciences, in: Y. Yue, A. Garg, N. Peng, F. Sha, R. Yu (Eds.), International Conference on Learning Representations, 2025, pp. 90912–90940. URL https://openreview.net/forum?id=U3PBITXNG6
- [41]A. N. Tikhonov, V. Y. Arsenin, Solutions of Ill-posed Problems, Winston, 1977.DOI
- [42]A. Tarantola, Inversion of seismic reflection data in the acoustic approximation, Geophysics 49 (1984) 1259–1266. doi:10.1190/1.1441754.DOI
- [43]W. W. Symes, The seismic reflection inverse problem, Inverse Problems 25 (12) (2009) 123008. doi: 10.1088/0266-5611/25/12/123008.DOI
- [44]R.-E. Plessix, A review of the adjoint-state method for computing the gradient of a functional with geophysical applications, Geophysical Journal International 167 (2006) 495–503. doi:10.1111/j.1365-246X.2006 .02978.x.DOI
- [45]J. Hadamard, Sur les problèmes aux dérivées partielles et leur signification physique, Princeton University Bulletin 13 (1902) 49–52.
- [46]Y. Lu, On the Bernstein-von Mises theorem for high dimensional nonlinear Bayesian inverse problems (2017). arXiv:1706.00289.arxiv.org/abs/1706.00289
- [47]S. Agapiou, S. Larsson, A. M. Stuart, Posterior contraction rates for the Bayesian approach to linear ill-posed inverse problems, Stochastic Processes and their Applications 123 (10) (2013) 3828–3860. doi:10.1016/j.spa.2013.05.001.DOI
- [48]M. S. Albergo, E. Vanden-Eijnden, Building normalizing flows with stochastic interpolants, in: International Conference on Learning Representations, 2023. URL https://openreview.net/forum?id=li7qeBbCR1tarxiv.org/abs/2209.15571
- [49]Y. Song, J. Sohl-Dickstein, D. P. Kingma, A. Kumar, S. Ermon, B. Poole, Score-based generative modeling through stochastic differential equations, in: International Conference on Learning Representations, 2021. URL https://openreview.net/forum?id=PxTIG12RRHS
- [50]A. Tong, K. Fatras, N. Malkin, G. Huguet, Y. Zhang, J. Rector-Brooks, G. Wolf, Y. Bengio, Improving and generalizing flow-based generative models with minibatch optimal transport, Transactions on Machine Learning Research (2024). URL https://openreview.net/forum?id=CD9Snc73AWarxiv.org/abs/2302.00482
- [51]A.-A. Pooladian, H. Ben-Hamu, C. Domingo-Enrich, B. Amos, Y. Lipman, R. T. Q. Chen, Multisample flow matching: Straightening flows with minibatch couplings, in: A. Krause, E. Brunskill, K. Cho, B. Engelhardt, S. Sabato, J. Scarlett (Eds.), Proceedings of the 40th International Conference on Machine Learning, Vol. 202 of Proceedings of Machine Learning Research, PMLR, 2023, pp. 28100–28127. URL https://proceedings.mlr.press/v202/pooladian23a.htmlarxiv.org/abs/2304.14772
- [52]T. Reu, S. Dromigny, M. Bronstein, F. Vargas, Gradient variance reveals failure modes in flow-based generative models, in: D. Belgrave, C. Zhang, H. Lin, R. Pascanu, P. Koniusz, M. Ghassemi, N. Chen (Eds.), Advances in Neural Information Processing Systems, Vol. 38, Curran Associates, Inc., 2025, pp. 142630–142664. doi:10.52202/085713-4282.DOI
- [53]T. Li, K. He, Back to basics: Let denoising generative models denoise, in: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2026, pp. 36115–36125. URL https://openaccess.thecvf.com/content/CVPR2026/html/Li_Back_to_Basics_Let_Denoising_Generative_Models_Denoise_CVPR_2026_paper.htmlarxiv.org/abs/2511.13720
- [54]X. Han, J. Hu, L. Liu, Self-consistent flow: Unifying velocity and endpoint prediction for rectified flow models, Transactions on Machine Learning Research (2026). URL https://openreview.net/forum?id=z9FMX0JgyIarxiv.org/abs/2607.12171
- [55]B. Agrawalla, M. Nauman, K. Agrawal, A. Kumar, floq: Training critics via flow-matching for scaling compute in value-based RL, in: C. Vondrick, B. Hariharan, C. Raffel, L. Pinto, D. Yang, A. Faust (Eds.), International Conference on Learning Representations, 2026, pp. 54569–54595. URL https://openreview.net/forum?id=mI4YndmPArarxiv.org/abs/2509.06863
- [56]C. Pan, G. Anantharaman, N.-C. Huang, C. Jin, D. Pfrommer, C. Yuan, F. Permenter, G. Qu, N. Boffi, G. Shi, M. Simchowitz, Much ado about noising: Dispelling the myths of generative protocol control, in: C. Vondrick, B. Hariharan, C. Raffel, L. Pinto, D. Yang, A. Faust (Eds.), International Conference on Learning Representations, 2026, pp. 90575–90614. URL https://openreview.net/forum?id=LzWKuxTKuWarxiv.org/abs/2512.01809
- [57]M. Mardani, J. Song, J. Kautz, A. Vahdat, A variational perspective on solving inverse problems with diffusion models, in: B. Kim, Y. Yue, S. Chaudhuri, K. Fragkiadaki, M. Khan, Y. Sun (Eds.), International Conference on Learning Representations, 2024, pp. 28027–28053. URL https://openreview.net/forum?id=1Y04EE3SPBarxiv.org/abs/2305.04391
- [58]D. P. Kingma, J. Ba, Adam: A method for stochastic optimization, in: International Conference on Learning Representations, 2015. URL https://arxiv.org/abs/1412.6980
- [59]B. Zhang, M. Guerra, Q. Li, L. Zepeda-Núñez, Sample dataset and trained model parameters for Back-Projection Diffusion, Zenodo, version 2 (2025). doi:10.5281/zenodo.14911327.DOI
- [60]B. Zhang, L. Zepeda-Núñez, MRI brain perturbations, Zenodo, version 1 (2025). doi:10.5281/zenodo.14760123.DOI
- [61]J. Zbontar, F. Knoll, A. Sriram, T. Murrell, Z. Huang, M. J. Muckley, A. Defazio, R. Stern, P. Johnson, M. Bruno, M. Parente, K. J. Geras, J. Katsnelson, H. Chandarana, Z. Zhang, M. Drozdzal, A. Romero, M. Rabbat, P. Vincent, N. Yakubova, J. Pinkerton, D. Wang, E. Owens, C. L. Zitnick, M. P. Recht, D. K. Sodickson, Y. W. Lui, fastMRI: An open dataset and benchmarks for accelerated MRI (2018). arXiv:1811.08839.arxiv.org/abs/1811.08839
- [62]F. Knoll, J. Zbontar, A. Sriram, M. J. Muckley, M. Bruno, A. Defazio, M. Parente, K. J. Geras, J. Katsnelson, H. Chandarana, Z. Zhang, M. Drozdzal, A. Romero, M. Rabbat, P. Vincent, J. Pinkerton, D. Wang, N. Yakubova, E. Owens, C. L. Zitnick, M. P. Recht, D. K. Sodickson, Y. W. Lui, fastMRI: A publicly available raw k-space and DICOM dataset of knee images for accelerated MR image reconstruction using machine learning, Radiology: Artificial Intelligence 2 (1) (2020) e190007. doi:10.1148/ryai.2020190007.DOI
- [63]M. Li, L. Demanet, L. Zepeda-Núñez, Wide-band butterfly network: Stable and efficient inversion via multi-frequency neural networks, Multiscale Modeling & Simulation 20 (4) (2022) 1191–1227. doi:10.1137/20M1383276.
- [64]A. Matlock, A. Sentenac, P. C. Chaumet, J. Yi, L. Tian, Inverse scattering for reflection intensity phase microscopy, Biomed. Opt. Express 11 (2) (2020) 911–926. doi:10.1364/BOE.380845.DOI
- [65]H. Zheng, Data for InverseBench (ICLR 2025 spotlight), CaltechDATA, version 4 (2025). doi:10.22002/zg89b-mpv16.
- [66]D. Wiesner, D. Svoboda, M. Maška, M. Kozubek, CytoPacq: A web-interface for simulating multi-dimensional cell imaging, Bioinformatics 35 (21) (2019) 4531–4533. doi:10.1093/bioinformatics/btz417.DOI
- [67]A. Beck, M. Teboulle, Fast gradient-based algorithms for constrained total variation image denoising and deblurring problems, IEEE Transactions on Image Processing 18 (11) (2009) 2419–2434. doi:10.1109/TIP.2009.2028250.DOI
- [68]C. Bunks, F. M. Saleck, S. Zaleski, G. Chavent, Multiscale seismic waveform inversion, Geophysics 60 (5) (1995) 1457–1473. doi:10.1190/1.1443880.DOI
- [69]M. Louboutin, M. Lange, F. Luporini, N. Kukreja, P. A. Witte, F. J. Herrmann, P. Velesko, G. J. Gorman, Devito (v3.1.0): an embedded domain-specific language for finite differences and geophysical exploration, Geoscientific Model Development 12 (3) (2019) 1165–1187. doi:10.5194/gmd-12-1165-2019.DOI
- [70]C. Deng, S. Feng, H. Wang, X. Zhang, P. Jin, Y. Feng, Q. Zeng, Y. Chen, Y. Lin, OpenFWI: Large-scale Multi-structural Benchmark Datasets for Full Waveform Inversion, in: S. Koyejo, S. Mohamed, A. Agarwal, D. Belgrave, K. Cho, A. Oh (Eds.), Advances in Neural Information Processing Systems, Vol. 35, Curran Associates, Inc., 2022, pp. 6007–6020. doi:10.52202/068431-0435.DOI
- [71]P. Dhariwal, A. Nichol, Diffusion models beat GANs on image synthesis, in: M. Ranzato, A. Beygelzimer, Y. Dauphin, P. S. Liang, J. W. Vaughan (Eds.), Advances in Neural Information Processing Systems, Vol. 34, Curran Associates, Inc., 2021, pp. 8780–8794. URL https://openreview.net/forum?id=AAWuCvzaVt
- [72]M. Tancik, P. Srinivasan, B. Mildenhall, S. Fridovich-Keil, N. Raghavan, U. Singhal, R. Ramamoorthi, J. Barron, R. Ng, Fourier features let networks learn high frequency functions in low dimensional domains, in: H. Larochelle, M. Ranzato, R. Hadsell, M. F. Balcan, H. Lin (Eds.), Advances in Neural Information Processing Systems, Vol. 33, Curran Associates, Inc., 2020, pp. 7537–7547. URL https://openreview.net/forum?id=Q1r9GeYMKwG6
- [73]P. H. van Cittert, Die wahrscheinliche Schwingungsverteilung in einer von einer Lichtquelle direkt oder mittels einer Linse beleuchteten Ebene, Physica 1 (1–6) (1934) 201–210. doi:10.1016/S0031-8914(34)90026-4.DOI
- [74]F. Zernike, The concept of degree of coherence and its application to optical problems, Physica 5 (8) (1938) 785–795. doi:10.1016/S0031-8914(38)80203-2.DOI
- [75]Event Horizon Telescope Collaboration, First M87 Event Horizon Telescope results. III. Data Processing and Calibration, The Astrophysical Journal Letters 875 (1) (2019) L3. doi:10.3847/2041-8213/ab0c57.DOI
- [76]Y. Sun, Z. Wu, Y. Chen, B. T. Feng, K. L. Bouman, Provable probabilistic imaging using score-based generative priors, IEEE Transactions on Computational Imaging 10 (2024) 1290–1305. doi:10.1109/TCI.2024.3449114.DOI
- [77]L. Blackburn, D. W. Pesce, M. D. Johnson, M. Wielgus, A. A. Chael, P. Christian, S. S. Doeleman, Closure statistics in interferometric data, The Astrophysical Journal 894 (1) (2020) 31. doi:10.3847/1538-4357/ab8469.DOI
- [78]K. Akiyama, K. Kuramochi, S. Ikeda, V. L. Fish, F. Tazaki, M. Honma, S. S. Doeleman, A. E. Broderick, J. Dexter, M. Móscibrodzka, K. L. Bouman, A. A. Chael, M. Zaizen, Imaging the Schwarzschild-radius-scale structure of M87 with the Event Horizon Telescope using sparse modeling, The Astrophysical Journal 838 (1) (2017) 1. doi:10.3847/1538-4357/aa6305.DOI
- [79]A. A. Chael, M. D. Johnson, R. Narayan, S. S. Doeleman, J. F. C. Wardle, K. L. Bouman, High-resolution linear polarimetric imaging for the Event Horizon Telescope, The Astrophysical Journal 829 (1) (2016) 11. doi:10.3847/0004-637X/829/1/11.DOI
- [80]A. A. Chael, M. D. Johnson, K. L. Bouman, L. L. Blackburn, K. Akiyama, R. Narayan, Interferometric imaging directly with closure phases and closure amplitudes, The Astrophysical Journal 857 (1) (2018) 23. doi:10.3847/1538-4357/aab6a8.DOI
- [81]E. Perez, F. Strub, H. de Vries, V. Dumoulin, A. Courville, FiLM: Visual reasoning with a general conditioning layer, in: Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 32, 2018, pp. 3942–3951. doi:10.1609/aaai.v32i1.11671.DOI
- [82]H. W. Engl, M. Hanke, A. Neubauer, Regularization of Inverse Problems, Vol. 375 of Mathematics and Its Applications, Springer Dordrecht, 1996.
- [83]D. Colton, H. Haddar, M. Piana, The linear sampling method in inverse electromagnetic scattering theory, Inverse Problems 19 (6) (2003) S105–S137. doi:10.1088/0266-5611/19/6/057.DOI
- [84]B. Engquist, L. Ying, Sweeping preconditioner for the Helmholtz equation: Moving perfectly matched layers, Multiscale Modeling & Simulation 9 (2) (2011) 686–710. doi:10.1137/100804644.DOI
- [85]L. Zepeda-Núñez, L. Demanet, The method of polarized traces for the 2D Helmholtz equation, Journal of Computational Physics 308 (2016) 347–388. doi:10.1016/j.jcp.2015.11.040.
- [86]A. Fichtner, J. Trampert, Resolution analysis in full waveform inversion, Geophysical Journal International 187 (3) (2011) 1604–1624. doi:10.1111/j.1365-246X.2011.05218.x.DOI
- [87]M. T. McCann, K. H. Jin, M. Unser, Convolutional neural networks for inverse problems in imaging: A review, IEEE Signal Processing Magazine 34 (6) (2017) 85–95. doi:10.1109/MSP.2017.2732999.DOI
- [88]H. K. Aggarwal, M. P. Mani, M. Jacob, MoDL: Model-based deep learning architecture for inverse problems, IEEE Transactions on Medical Imaging 38 (2) (2019) 394–405. doi:10.1109/TMI.2018.2865536.DOI
- [89]X. Chen, Z. Wei, M. Li, P. Rocca, A review of deep learning approaches for inverse scattering problems (invited review), Progress in Electromagnetics Research 167 (2020) 67–81. doi:10.2528/PIER20030705.DOI
- [90]J. Adler, O. Öktem, Solving ill-posed inverse problems using iterative deep neural networks, Inverse Problems 33 (12) (2017) 124007. doi:10.1088/1361-6420/aa9581.DOI
- [91]J. Adler, O. Öktem, Learned primal-dual reconstruction, IEEE Transactions on Medical Imaging 37 (6) (2018) 1322–1332. doi:10.1109/tmi.2018.2799231.DOI
- [92]J. Kaipio, E. Somersalo, Statistical and Computational Inverse Problems, Vol. 160 of Applied Mathematical Sciences, Springer New York, 2005. doi:10.1007/b138659.DOI
- [93]Y. Korkmaz, T. Cukur, V. M. Patel, Self-supervised MRI reconstruction with unrolled diffusion models, in: H. Greenspan, A. Madabhushi, P. Mousavi, S. Salcudean, J. Duncan, T. Syeda-Mahmood, R. Taylor (Eds.), Medical Image Computing and Computer Assisted Intervention – MICCAI 2023, Vol. 14229, Springer, Cham, 2023, pp. 491–501. doi:10.1007/978-3-031-43999-5_47.DOI
- [94]J. Liu, Q. Lin, Z. Xiong, S. Shan, C. Liu, M. Li, F. Liu, G. B. Pike, H. Sun, Y. Gao, Highly undersampled MRI reconstruction via a single posterior sampling of diffusion models, IEEE Transactions on Medical Imaging 45 (5) (2026) 2414–2428. doi:10.1109/tmi.2026.3654585.DOI
- [95]A. Dasgupta, H. Ramaswamy, J. Murgoitio-Esandi, K. Y. Foo, R. Li, Q. Zhou, B. F. Kennedy, A. A. Oberai, Conditional score-based diffusion models for solving inverse elasticity problems, Computer Methods in Applied Mechanics and Engineering 433 (2025) 117425. doi:10.1016/j.cma.2024.117425.DOI
- [96]B. D. O. Anderson, Reverse-time diffusion equation models, Stochastic Processes and their Applications 12 (3) (1982) 313–326. doi:10.1016/0304-4149(82)90051-5.DOI
- [97]J. Song, C. Meng, S. Ermon, Denoising diffusion implicit models, in: International Conference on Learning Representations, 2021. URL https://openreview.net/forum?id=St1giarCHLParxiv.org/abs/2010.02502
- [98]X. Liu, C. Gong, Q. Liu, Flow straight and fast: Learning to generate and transfer data with rectified flow, in: International Conference on Learning Representations, 2023. URL https://openreview.net/forum?id=XVjTT1nw5zarxiv.org/abs/2209.03003
- [99]S. Lee, Z. Lin, G. Fanti, Improving the training of rectified flows, in: A. Globerson, L. Mackey, D. Belgrave, A. Fan, U. Paquet, J. Tomczak, C. Zhang (Eds.), Advances in Neural Information Processing Systems, Vol. 37, Curran Associates, Inc., 2024, pp. 63082–63109. doi:10.52202/079017-2014.DOI
- [100]T. Salimans, J. Ho, Progressive distillation for fast sampling of diffusion models, in: International Conference on Learning Representations, 2022. URL https://openreview.net/forum?id=TIdIXIpzhoIarxiv.org/abs/2202.00512
- [101]J. Zhao, B. Song, L. Shen, CoSIGN: Few-Step Guidance of ConSIstency Model to Solve General Inverse Problems, in: A. Leonardis, E. Ricci, S. Roth, O. Russakovsky, T. Sattler, G. Varol (Eds.), Computer Vision – ECCV 2024, Vol. 15106 of Lecture Notes in Computer Science, Springer Nature Switzerland, Cham, 2025, pp. 108–126. doi:10.1007/978-3-031-73195-2_7.DOI
- [102]N. Boffi, M. Albergo, E. Vanden-Eijnden, How to build a consistency model: Learning flow maps via self-distillation, in: D. Belgrave, C. Zhang, H. Lin, R. Pascan u, P. Koniusz, M. Ghassemi, N. Chen (Eds.), Advances in Neural Information Processing Systems, Vol. 38, Curran Associates, Inc., 2025, pp. 33346–33382. doi:10.52202/085713-1121.DOI
- [103]B. Paulwitz, S. Buske, Probabilistic inversion with flow matching (2026). arXiv:2606.31288.arxiv.org/abs/2606.31288
- [104]H. Zhang, T. Alkhalifah, Post-FWI injection of learned priors using a flow matching model (2026). arXiv:2607.23719.arxiv.org/abs/2607.23719
- [105]A. Dasgupta, A. Fardisi, M. Aminy, B. Binder, B. Shaddy, S. Moazami, A. A. Oberai, Conditional flow matching for physics-constrained inverse problems with finite training data (2026). arXiv:2603.14135.arxiv.org/abs/2603.14135
- [106]G.-H. Liu, A. Vahdat, D.-A. Huang, E. Theodorou, W. Nie, A. Anandkumar, I²SB: Image-to-image Schrödinger bridge, in: A. Krause, E. Brunskill, K. Cho, B. Engelhardt, S. Sabato, J. Scarlett (Eds.), Proceedings of the 40th International Conference on Machine Learning, Vol. 202 of Proceedings of Machine Learning Research, PMLR, 2023, pp. 22042–22062. URL https://proceedings.mlr.press/v202/liu23ai.html
- [107]B. Li, K. Xue, B. Liu, Y.-K. Lai, BBDM: Image-to-image translation with Brownian bridge diffusion models, in: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2023, pp. 1952–1961. doi:10.1109/CVPR52729.2023.00194.DOI
- [108]M. Delbracio, P. Milanfar, Inversion by direct iteration: An alternative to denoising diffusion for image restoration, Transactions on Machine Learning Research (2023). URL https://openreview.net/forum?id=VmyFF5LlL3Farxiv.org/abs/2303.11435
- [109]Z. Luo, F. K. Gustafsson, Z. Zhao, J. Sjölund, T. B. Schön, Image restoration with mean-reverting stochastic differential equations, in: A. Krause, E. Brunskill, K. Cho, B. Engelhardt, S. Sabato, J. Scarlett (Eds.), Proceedings of the 40th International Conference on Machine Learning, Vol. 202 of Proceedings of Machine Learning Research, PMLR, 2023, pp. 23045–23066. URL https://proceedings.mlr.press/v202/luo23b.htmlarxiv.org/abs/2301.11699
- [110]K. Zheng, G. He, J. Chen, F. Bao, J. Zhu, Diffusion bridge implicit models, in: Y. Yue, A. Garg, N. Peng, F. Sha, R. Yu (Eds.), International Conference on Learning Representations, 2025, pp. 81857–81884. URL https://openreview.net/forum?id=eghAocVqBkarxiv.org/abs/2405.15885
- [111]Y. Jiang, F. Gao, S. Jin, Electromagnetic property sensing and channel reconstruction based on diffusion Schrödinger bridge in ISAC, IEEE Transactions on Wireless Communications 24 (8) (2025) 6737–6752. doi:10.1109/TWC.2025.3555685.DOI
- [112]Y. Wang, P. Jin, S. Yoon, M. Tivnan, S. Zhang, L. Zhang, Q. Li, Z. Chen, D. Wu, Projection embedded diffusion bridge for CT reconstruction from incomplete data (2025). arXiv:2510.22605.arxiv.org/abs/2510.22605
- [113]C. Modi, J. Han, E. Vanden-Eijnden, J. Bruna, Generative modeling from black-box corruptions via self-consistent stochastic interpolants, in: C. Vondrick, B. Hariharan, C. Raffel, L. Pinto, D. Yang, A. Faust (Eds.), International Conference on Learning Representations, 2026, pp. 104078–104107. URL https://openreview.net/forum?id=RJHHbXhokVarxiv.org/abs/2512.10857
- [114]Y. Chen, E. Vanden-Eijnden, Variational optimality of Föllmer processes in generative diffusions (2026). arXiv:2602.10989.arxiv.org/abs/2602.10989
- [115]S. V. Venkatakrishnan, C. A. Bouman, B. Wohlberg, Plug-and-play priors for model based reconstruction, in: 2013 IEEE Global Conference on Signal and Information Processing, 2013, pp. 945–948. doi: 10.1109/GlobalSIP.2013.6737048.DOI
- [116]J. Song, A. Vahdat, M. Mardani, J. Kautz, Pseudoinverse-guided diffusion models for inverse problems, in: International Conference on Learning Representations, 2023. URL https://openreview.net/forum?id=9_gsMA8MRKQ
- [117]Y. Wang, J. Yu, J. Zhang, Zero-shot image restoration using denoising diffusion null-space model, in: International Conference on Learning Representations, 2023. URL https://openreview.net/forum?id=mRieQgMtNTQarxiv.org/abs/2212.00490
- [118]W. Guo, Y. Gao, Y. Sun, ScoreField: Neural inverse scattering with score-based generative priors (2026). arXiv:2608.02937.arxiv.org/abs/2608.02937
- [119]R. Guo, Y. Zhang, Y. Kvich, T. Huang, M. Li, Y. C. Eldar, Plug-and-play latent diffusion for electromagnetic inverse scattering with application to brain imaging (2025). arXiv:2509.04860.arxiv.org/abs/2509.04860
- [120]M. H. Taufik, T. Alkhalifah, Diffusion model-based posterior sampling in full waveform inversion (2025). arXiv:2512.12797.arxiv.org/abs/2512.12797
- [121]B. Kawar, M. Elad, S. Ermon, J. Song, Denoising diffusion restoration models, in: S. Koyejo, S. Mohamed, A. Agarwal, D. Belgrave, K. Cho, A. Oh (Eds.), Advances in Neural Information Processing Systems, Vol. 35, Curran Associates, Inc., 2022, pp. 23593–23606. doi:10.52202/068431-1714.DOI
- [122]L. Rout, N. Raoof, G. Daras, C. Caramanis, A. Dimakis, S. Shakkottai, Solving linear inverse problems provably via posterior sampling with latent diffusion models, in: A. Oh, T. Naumann, A. Globerson, K. Saenko, M. Hardt, S. Levine (Eds.), Advances in Neural Information Processing Systems, Vol. 36, Curran Associates, Inc., 2023, pp. 49960–49990. doi:10.52202/075280-2174.DOI
- [123]J. Song, Q. Zhang, H. Yin, M. Mardani, M.-Y. Liu, J. Kautz, Y. Chen, A. Vahdat, Loss-guided diffusion models for plug-and-play controllable generation, in: A. Krause, E. Brunskill, K. Cho, B. Engelhardt, S. Sabato, J. Scarlett (Eds.), Proceedings of the 40th International Conference on Machine Learning, Vol. 202 of Proceedings of Machine Learning Research, PMLR, 2023, pp. 32483–32498. URL https://proceedings.mlr.press/v202/song23k.html
- [124]M. Vono, N. Dobigeon, P. Chainais, Split-and-augmented Gibbs sampler—application to large-scale inference problems, IEEE Transactions on Signal Processing 67 (6) (2019) 1648–1661. doi:10.1109/TSP.2019.2894825.DOI
- [125]Y. Zhu, K. Zhang, J. Liang, J. Cao, B. Wen, R. Timofte, L. Van Gool, Denoising diffusion models for plug-and-play image restoration, in: 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), IEEE Computer Society, Los Alamitos, CA, USA, 2023, pp. 1219–1229. doi:10.1109/CVPRW59228.2023.00129.DOI
- [126]X. Li, S. M. Kwon, S. Liang, I. Alkhouri, S. Ravishankar, Q. Qu, DCDP: Decoupled data consistency via diffusion purification for inverse problems, in: 2026 IEEE International Conference on Computational Photography (ICCP), 2026, pp. 1–15. doi:10.1109/ICCP69532.2026.11668875.DOI
- [127]B. Song, S. M. Kwon, Z. Zhang, X. Hu, Q. Qu, L. Shen, Solving inverse problems with latent diffusion models via hard data consistency, in: B. Kim, Y. Yue, S. Chaudhuri, K. Fragiadaki, M. Khan, Y. Sun (Eds.), International Conference on Learning Representations, 2024, pp. 7624–7654. URL https://openreview.net/forum?id=j8hdRqOuHnarxiv.org/abs/2307.08123
- [128]X. Xu, Y. Chi, Provably robust score-based diffusion posterior sampling for plug-and-play image reconstruction, in: A. Globerson, L. Mackey, D. Belgrave, A. Fan, U. Paquet, J. Tomczak, C. Zhang (Eds.), Advances in Neural Information Processing Systems, Vol. 37, Curran Associates, Inc., 2024, pp. 36148–36184. doi:10.52202/079017–1140.arxiv.org/abs/2403.17042
- [129]B. Feng, K. Bouman, Variational Bayesian imaging with an efficient surrogate score-based prior, Transactions on Machine Learning Research (2024). URL https://openreview.net/forum?id=db2pFKVcm1arxiv.org/abs/2309.01949
- [130]P. Del Moral, A. Doucet, A. Jasra, Sequential Monte Carlo samplers, Journal of the Royal Statistical Society: Series B (Statistical Methodology) 68 (3) (2006) 411–436. doi:10.1111/j.1467-9868.2006.00553.x.DOI
- [131]L. Wu, B. Trippe, C. Naesseth, D. Blei, J. Cunningham, Practical and asymptotically exact conditional sampling in diffusion models, in: A. Oh, T. Naumann, A. Globerson, K. Saenko, M. Hardt, S. Levine (Eds.), Advances in Neural Information Processing Systems, Vol. 36, Curran Associates, Inc., 2023, pp. 31372–31403. doi:10.52202/075280–1363.arxiv.org/abs/2306.17775
- [132]B. L. Trippe, J. Yim, D. Tischer, D. Baker, T. Broderick, R. Barzilay, T. S. Jaakkola, Diffusion probabilistic modeling of protein backbones in 3D for the motif-scaffolding problem, in: International Conference on Learning Representations, 2023. URL https://openreview.net/forum?id=6TxBxqNME1Yarxiv.org/abs/2206.04119
- [133]G. Cardoso, Y. Janati, S. Le Corff, E. Moulines, Monte Carlo guided denoising diffusion models for Bayesian linear inverse problems, in: International Conference on Learning Representations, 2024. URL https://openreview.net/forum?id=nHESwXvxWKarxiv.org/abs/2308.07983
- [134]Z. Dou, Y. Song, Diffusion posterior sampling for linear inverse problem solving: A filtering perspective, in: B. Kim, Y. Yue, S. Chaudhuri, K. Fragiadaki, M. Khan, Y. Sun (Eds.), International Conference on Learning Representations, 2024, pp. 12069–12095. URL https://openreview.net/forum?id=tplXNcHZs1
- [135]D. C. Liu, J. Nocedal, On the limited memory BFGS method for large scale optimization, Mathematical Programming 45 (1989) 503–528. doi:10.1007/BF01589116.
- [136]Y. Romano, M. Elad, P. Milanfar, The little engine that could: Regularization by denoising (RED), SIAM Journal on Imaging Sciences 10 (4) (2017) 1804–1844. doi:10.1137/16M1102884.DOI
- [137]Z. Wang, A. C. Bovik, H. R. Sheikh, E. P. Simoncelli, Image quality assessment: From error visibility to structural similarity, IEEE Transactions on Image Processing 13 (4) (2004) 600–612. doi:10.1109/TIP.2003.819861.DOI
- [138]M. Cuturi, Sinkhorn distances: Lightspeed computation of optimal transport, in: Advances in Neural Information Processing Systems, Vol. 26, 2013, pp. 2292–2300. URL https://proceedings.neurips.cc/paper/2013/hash/af21d0c97db2e27e13572cbf59eb343d-Abstract.html
- [139]G. Peyré, M. Cuturi, Computational optimal transport with applications to data sciences, Foundations and Trends in Machine Learning 11 (5-6) (2019) 355–607. doi:10.1561/2200000073.
- [140]M. Cuturi, L. Meng-Papaxanthos, Y. Tian, C. Bunne, G. Davis, O. Teboul, Optimal transport tools (OTT): A JAX toolbox for all things Wasserstein (2022). arXiv:2201.12324.arxiv.org/abs/2201.12324
- [141]T. Akiba, S. Sano, T. Yanase, T. Ohta, M. Koyama, Optuna: A next-generation hyperparameter optimization framework, in: Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, 2019, pp. 2623–2631. doi:10.1145/3292500.3330701.DOI











