WorksComputer Science
FANO: Anchored Forward-Noise Optimization for Diffusion Inverse Problems
Abstract
Pre-trained diffusion models have become a widely adopted zero-shot prior for image inverse problems, among which annealed decoupling methods achieve leading reconstruction performance on nonlinear tasks. We find, however, that annealed methods that directly optimize the denoiser input exhibit radial drift in later layers: within-layer optimization drives the noise-component norm of away from its typical value, pushing the denoiser out of its high-performance regime and degrading reconstruction quality. To address this, we propose FANO (Anchored Forward-Noise Optimization). At each annealing layer, FANO fixes the previous denoiser estimate as an anchor and optimizes only the forward noise , whose distribution is known, instead of , thereby preserving the forward-diffusion structure of the denoiser input. The standard Gaussian prior on concentrates its norm near the typical value, and deviations degrade denoiser performance. We accordingly decompose in polar coordinates into a direction and a radial magnitude, and apply a soft potential to regulate the radius, keeping in the high-density region of the forward distribution. On multiple linear and nonlinear inverse problems, FANO matches the strongest current baselines on linear tasks and achieves consistent improvements on nonlinear tasks.
region of the forward distribution. On multiple linear and nonlinear inverse problems, FANO matches the strongest current baselines on linear tasks and achieves consistent improvements on nonlinear tasks.
Introduction
From a degraded measurement , image inverse problems aim to recover an unknown image , with the two related through the forward measurement model , where is a linear or nonlinear measurement operator and denotes measurement noise. Owing to information loss ( or noninvertible ) and noise, inverse problems are typically severely ill-posed and require prior information to constrain the solution space.
Pretrained diffusion models have become the most widely adopted generative priors for zero-shot image inverse problems [12, 25]. These methods directly use the denoiser provided by an unconditional diffusion model as an implicit image prior and incorporate measurement consistency into reverse sampling through the known at inference time, without retraining the model for each degradation type.
Among diffusion-prior methods for inverse problems (§ 2), annealed decoupling methods [2, 16] (Zhang et al. 2025) decompose inference into a sequence of within-layer subproblems along an annealing schedule, achieving the strongest current reconstruction performance on nonlinear inverse problems. However, when analyzing SITCOM [2], an annealed method that directly optimizes the denoiser input, we find that the measurement residual continues to decrease in later annealing layers while reconstruction quality abruptly collapses (Figure 2(a,Figure 2c)). Tracking the norm of the noise component in the denoiser input reveals a sharp increase in later layers (Figure 2(a)); controlled experiments show that this deviation is accompanied by degraded denoiser performance (Figure 2(b)). Moreover, the norm deviates more severely in the absence of measurement noise, ruling out the overfitting hypothesis. We refer to this phenomenon as radial drift. § 3.1 presents the full analysis.
Figure 2. Radial drift on FFHQ (, ). (a) Mean PSNR and normalized radius on FFHQ100 for SITCOM (Alkhouri et al., [2]) and FANO; insets magnify late-layer PSNR, and shading marks layers after SITCOM’s peak. (b) Denoiser PSNR drop relative to when varying the radius along fixed random noise directions. (c) SITCOM reconstructions at layers 2, 18, and 20, illustrating late-layer degradation as increases.
Based on this analysis, we propose Anchored Forward-Noise Optimization (FANO). Radial drift arises because the measurement-consistency objective does not constrain the norm of the noise component when directly optimizing . FANO replaces the denoiser input with the forward noise as the search variable: each layer fixes the previous layer’s denoised estimate as an anchor, keeps the denoiser input within the conditional forward distribution , and progressively contracts the search region through annealing. High-dimensional Gaussian concentration indicates that should concentrate near , and deviations degrade denoiser performance (Figure 2(b)). We therefore decompose into a direction and a radial magnitude in polar coordinates: the measurement loss drives the directional search, while a concentration-inspired potential anchors the radial magnitude near its typical value, keeping the denoiser input in the high-density region of the forward distribution. Experiments on 5 linear and 3 nonlinear inverse problems on FFHQ and ImageNet show that FANO matches the strongest current baselines on linear tasks and achieves consistent improvements on nonlinear tasks (Figure 1, Table 1). Figure 3 provides an overview of the method.

Figure 1. Visual comparison on FFHQ and ImageNet across four inverse problems (): (a) nonlinear deblurring, (b) phase retrieval, (c) random inpainting, (d) high dynamic range (HDR). Each panel shows the measurement, DAPS, SITCOM, FANO, and the reference. Metrics below each panel are averaged over the two examples, with the best in bold; FANO recovers sharper structures and finer textures across all tasks, with the advantage most pronounced on nonlinear problems.
Figure 3. Overview of FANO. (a) Blue: direct optimization of ; red: FANO fixes the anchor and optimizes only the forward noise . Circular diagrams contrast radial drift (blue) with controlled search (red). (b) The radial potential is minimized at , softly penalizing deviations from the typical noise shell. FANO decomposes and jointly optimizes direction and magnitude .
| Task | Method | FFHQ PSNR | FFHQ SSIM | FFHQ LPIPS | ImageNet PSNR | ImageNet SSIM | ImageNet LPIPS |
| SR | DAPS | 29.351.47 | 0.7820.028 | 0.2680.035 | 25.472.86 | 0.6380.087 | 0.3760.061 |
| SITCOM | __30.551.87__ | 0.8680.033 | 0.2230.034 | 27.093.84 | 0.7570.116 | 0.3070.077 | |
| FAST-DIPS | 29.591.75 | 0.8430.041 | 0.2410.042 | 26.553.65 | 0.7250.125 | 0.3250.072 | |
| DiffRGD | 29.241.93 | 0.8380.042 | 0.2140.037 | 25.963.70 | 0.7120.136 | 0.3220.084 | |
| INO | 29.241.80 | 0.8090.037 | 0.2600.038 | 25.653.50 | 0.6940.131 | __0.3100.090__ | |
| FANO | 30.681.88 | 0.8720.032 | 0.2320.036 | __27.033.87__ | __0.7550.118__ | 0.3210.082 | |
| Gauss. deblur | DAPS | 29.611.63 | 0.7860.031 | 0.2590.032 | 25.883.23 | 0.6570.105 | 0.3560.062 |
| SITCOM | __29.891.95__ | __0.8490.038__ | 0.2420.038 | 26.383.60 | 0.7260.128 | 0.3400.083 | |
| FAST-DIPS | 29.201.92 | 0.8300.045 | 0.2590.045 | 25.923.74 | 0.6940.142 | 0.3580.082 | |
| DiffRGD | 27.055.12 | 0.7800.162 | 0.2480.106 | 22.873.36 | 0.5640.171 | 0.4130.091 | |
| INO | 28.721.88 | 0.7890.048 | 0.2750.042 | 24.763.46 | 0.6530.145 | 0.3340.087 | |
| FANO | 30.652.04 | 0.8680.036 | 0.2250.038 | 27.013.95 | 0.7460.128 | 0.3170.084 | |
| Motion deblur | DAPS | 31.651.34 | 0.8360.022 | 0.2080.029 | 28.653.11 | 0.7690.066 | 0.2440.055 |
| SITCOM | __32.371.70__ | __0.8970.024__ | __0.1880.031__ | __29.383.68__ | __0.8320.080__ | __0.2350.062__ | |
| FAST-DIPS | 31.381.59 | 0.8730.035 | 0.2000.036 | 28.793.92 | 0.7960.106 | 0.2610.078 | |
| DiffRGD | 29.242.07 | 0.8350.044 | 0.2130.035 | 23.403.44 | 0.5910.169 | 0.4210.100 | |
| FANO | 33.041.82 | 0.9090.024 | 0.1670.029 | 29.884.19 | 0.8400.085 | 0.2250.070 | |
| Inpaint (box) | DAPS | 24.322.67 | 0.7470.031 | 0.2360.034 | __21.053.44__ | 0.7130.036 | 0.2710.057 |
| SITCOM | 24.472.52 | 0.7370.033 | 0.2450.030 | 19.622.91 | 0.6990.038 | 0.2550.060 | |
| FAST-DIPS | __25.182.45__ | 0.8570.028 | __0.1820.030__ | 21.534.17 | 0.7970.058 | __0.2570.044__ | |
| INO | 22.792.91 | __0.8270.039__ | 0.2220.041 | 18.693.02 | 0.7390.105 | 0.2820.070 | |
| FANO | 25.332.94 | 0.8660.028 | 0.1560.030 | 20.403.30 | __0.7860.040__ | 0.2060.040 | |
| Inpaint (rand.) | DAPS | 30.721.35 | 0.8010.020 | 0.2300.026 | 27.353.20 | 0.7250.066 | 0.2480.050 |
| SITCOM | __32.401.44__ | 0.8630.018 | __0.1820.030__ | 28.903.57 | 0.8140.054 | __0.1800.053__ | |
| FAST-DIPS | 31.781.57 | __0.8920.030__ | 0.1850.034 | __29.464.11__ | __0.8280.093__ | 0.2140.058 | |
| DiffRGD | __32.731.91__ | __0.9120.023__ | __0.1670.030__ | 28.904.15 | 0.8250.094 | 0.2390.070 | |
| INO | __32.972.14__ | __0.9150.031__ | __0.1660.035__ | 28.334.55 | 0.8100.124 | 0.2180.082 | |
| FANO | 34.071.97 | 0.9310.017 | 0.1200.027 | 29.944.61 | 0.8640.074 | 0.1570.050 | |
| Phase retrieval | DAPS | 30.092.96 | 0.7810.057 | 0.2390.058 | __22.946.22__ | 0.5050.216 | __0.4110.148__ |
| SITCOM | __29.214.99__ | 0.8170.178 | 0.2640.122 | 20.496.38 | 0.4670.274 | 0.4650.163 | |
| FAST-DIPS | 28.373.71 | __0.8490.094__ | 0.2210.085 | 21.386.72 | 0.5480.274 | 0.4400.191 | |
| FANO | 31.984.14 | 0.8770.118 | 0.1870.091 | 23.837.99 | 0.5670.289 | 0.3880.187 | |
| HDR | DAPS | 27.483.64 | 0.8370.082 | 0.2100.073 | 26.074.08 | 0.8280.096 | 0.2040.110 |
| SITCOM | __28.133.12__ | 0.8100.107 | 0.2170.086 | __25.753.66__ | 0.7710.147 | __0.2320.131__ | |
| FAST-DIPS | 25.903.25 | 0.8370.077 | 0.2270.071 | 24.584.04 | 0.8090.113 | 0.2370.116 | |
| FANO | 29.883.42 | 0.8780.082 | 0.1570.076 | 27.323.68 | 0.8320.116 | 0.1960.113 | |
| NL deblur | DAPS | 28.531.53 | 0.7630.032 | 0.2590.034 | 27.253.13 | 0.7200.080 | 0.2840.064 |
| SITCOM | __29.312.17__ | 0.8010.085 | 0.2400.073 | __28.473.96__ | 0.8020.094 | 0.2040.064 | |
| FAST-DIPS | 27.551.63 | 0.8030.044 | 0.2820.048 | 25.503.59 | 0.6960.140 | 0.3830.111 | |
| INO | 27.532.41 | __0.7970.056__ | 0.2520.041 | 25.393.74 | 0.6880.137 | 0.3180.081 | |
| FANO | 30.831.77 | 0.8730.031 | 0.1830.033 | 29.094.25 | 0.8190.100 | 0.2220.072 |
Table 1. Quantitative results at , reported as the mean standard deviation over 100 test images. The best results are in bold, and the second-best results are __underlined__.
Our contributions are:
Diagnosis of radial drift. We identify radial drift in annealed methods that directly optimize : the equivalent noise norm deviates from its typical value in later layers, degrading denoiser performance. Controlled experiments confirm the association and show that radial correction can recover the quality lost at the final layer.
Forward-noise optimization with radial control. We propose FANO, which uses the forward noise as the within-layer search variable. This fixes the denoiser input to the forward-diffusion form and excludes the anchor from optimization. Exploiting the Gaussian prior, we decompose into a direction and a radial magnitude, with a concentration-inspired potential to keep the denoiser input in the high-density region.
Comprehensive evaluation. Experiments on 5 linear and 3 nonlinear inverse problems show that FANO matches the strongest baselines on linear tasks and achieves consistent improvements on nonlinear tasks. Ablation studies identify the -search framework as the primary source of gains.
Background and Related Work
For zero-shot inverse problem solving, the denoiser provided by a pretrained diffusion model is directly used as an implicit image prior, incorporating measurement consistency into reverse sampling at inference time without retraining for each degradation type. Existing methods differ primarily in their search strategies and have broadly evolved along three directions: stepwise guidance locally corrects the diffusion state at each reverse step; end-to-end noise optimization encodes the reverse process as a deterministic mapping and performs a global search in the initial noise space; and annealed decoupling decomposes inference into a sequence of subproblems across noise levels, allowing a broader search within each layer.
Diffusion Models
Diffusion models transform the data distribution into an approximately Gaussian distribution through a forward process that progressively adds noise, and then learn a reverse denoising process to generate data from noise [12, 25]. Given noise-schedule parameters , the conditional distribution of the forward process at timestep is
Reverse generation is driven by the score function [3, 23], approximated in practice by a learned network . Tweedie’s formula [4] relates the score to ; substituting defines the denoiser
which provides the minimum mean-square-error estimate of given .
Stepwise Measurement Guidance
DPS [7] approximates via the denoised estimate , enabling guidance for arbitrary forward operators; subsequent work refines the approximation or exploits problem structure [6, 24, 21]. Spectral-domain methods such as DDRM [15] and DDNM [28] achieve exact data consistency on decomposable linear operators but do not extend to nonlinear problems. DSG (Yang et al., 2024) and DiffRGD [19] exploit the spherical geometry of high-dimensional Gaussians to mitigate guidance-induced distribution shift, the latter performing Riemannian optimization on a sphere of a given radius. Nonetheless, the correction range of stepwise guidance remains restricted to a neighborhood of the current diffusion state, making it difficult to traverse multiple posterior modes in nonlinear problems(Zhang et al., 2025).
End-to-End Noise Optimization
End-to-end noise optimization treats the reverse process as a deterministic mapping and directly solves in the initial noise space [27]. INO [13] constrains the search to the Gaussian typical shell via tangent-space optimization; N-HMC [30] instead samples the posterior with Hamiltonian Monte Carlo. This family avoids the approximation but requires backpropagation through the entire generation chain, inherits the nonconvexity of the multistep composition, and loses the coarse-to-fine structure of diffusion.
Annealed Decoupling
Annealed decoupling methods decompose the reverse process into a sequence of within-layer subproblems along an annealing schedule, retaining diffusion’s coarse-to-fine hierarchy [22, 10] while allowing a broader search within each layer. Between layers, resampling—adding forward noise conditioned on a clean estimate [20]—returns the state to the forward distribution.
DAPS (Zhang et al., 2025) uses as the search variable and samples the within-layer posterior via Langevin dynamics; FAST-DIPS (Kim et al., [16] replaces the Langevin chain with ADMM splitting for faster convergence ([18] (Zhang et al. 2026)). SITCOM (Alkhouri et al., [2] shifts the search variable to the denoiser input , optimizing
and leveraging the denoiser’s implicit bias for regularization. However, its Euclidean regularizer does not directly constrain the distributional structure of ; within-layer optimization can drive away from the high-density region of the forward distribution (§ 3.1). FANO addresses this by using the forward noise as the search variable and introducing a concentration-inspired radial potential (§ 3).
Method
This section first analyzes radial drift in existing annealed methods (§ 3.1), then introduces an optimization strategy using the forward noise as the search variable together with a radial control mechanism (§ 3.2), and finally presents the complete algorithm, FANO (Anchored Forward-Noise Optimization, § 3.3).
Radial Drift in Annealed Decoupling
Annealed decoupling methods share the following core recursion: given an annealing schedule , each layer adds fresh noise to the previous layer’s denoised result and searches for a new estimate consistent with the measurement at the current noise level. Taking SITCOM (Alkhouri et al., [2]) as a representative method, we track this recursion (Figure 2(a)) and observe a puzzling phenomenon: on two nonlinear inverse problems, the measurement residual RMSE decreases monotonically throughout, and reconstruction PSNR improves over the first 18 layers, yet abruptly reverses and decreases in the final two layers. The optimizer thus degrades reconstruction quality while successfully matching the measurement more closely. A natural alternative explanation is overfitting to measurement noise, but a control experiment with rules out this hypothesis: without noise, the final-layer PSNR loss increases from 0.7 dB to 3.4 dB for nonlinear deblurring and from 0.3 dB to 0.5 dB for HDR. This more severe degradation indicates that the issue arises from the optimization dynamics themselves rather than noise overfitting.
To trace the cause of this degradation, we examine the variable optimized within each SITCOM layer. SITCOM directly optimizes the denoiser input at each annealing layer to make the denoised output match the measurement as closely as possible. Given the current layer’s anchor , the forward process allows any denoiser input to be parameterized by an equivalent forward noise . Define the normalized equivalent radius as ; under , high-dimensional concentration ensures . Tracking across layers (Figure 2(a), bottom row) reveals an anomalous signal coinciding with the degradation: over the first 18 layers, , but its mean rises to 2.9 for nonlinear deblurring and 2.3 for HDR in the final layer, with both statistics computed over the full FFHQ100 dataset. Panel (c) visualizes the layerwise reconstructions of a single nonlinear deblurring example: at layer 18, PSNR reaches 28.4 dB (); in the final layer, increases to 8.2 and PSNR drops to 25.1 dB.
Figure 2(b) tests the association between radial deviation and performance degradation through a controlled experiment. Holding a randomly sampled noise direction fixed and scaling only the radius , we find that denoiser performance is optimal near at every annealing layer. This test uses random directions, whereas directions obtained through multiple measurement-driven optimization steps are no longer random samples. We therefore further examine the terminal state of the final layer in the same SITCOM run, fixing the anchor and optimized direction but reconstructing the denoiser input as to normalize the equivalent noise’s radial magnitude to 1. This increases mean PSNR by 0.15 dB for HDR and 0.49 dB for nonlinear deblurring, recovering most of the final-layer degradation by correcting the radius alone. We refer to this late-stage degradation caused by the radial magnitude deviating from its typical value as radial drift. Note that is measured relative to the estimated anchor rather than the ground truth, so anchor error can partially amplify the observed . The red curves in Figure 2(a) show the layerwise behavior of our method, FANO (Sections 3.2–3.3), under the same conditions: mean PSNR continues to improve through the final layer, the normalized radius remains near 1, and radial drift disappears.
Forward-Noise Optimization and Radial Control
The preceding analysis directly links radial drift to the uncontrolled norm of the noise component during within-layer optimization. FANO therefore shifts the search variable from to the forward noise : at each annealing layer, it fixes the previous layer’s denoised estimate as an anchor and parameterizes the denoiser input as , using as the sole within-layer search variable. This parameterization preserves the forward-diffusion structure of the denoiser input. Searching over treats the anchor as a fixed offset excluded from within-layer optimization, so within-layer updates modify only the noise component.
The prior is uniform in direction and highly concentrated in radius (Figure 2(b)), motivating a polar decomposition of into a radial magnitude and a direction . The measurement loss drives the directional search, while a concentration-inspired soft constraint controls the radius.
We decompose the forward noise into a normalized radial magnitude and a direction as , where . Let , so that . Under the polar change of variables, the joint density of the standard Gaussian prior factorizes as
where the direction is uniformly distributed on and the radius follows a normalized distribution[17]. The prior has no directional preference but strongly favors a particular radial range, leading to the following constraint strategy: constrain only the radial dimension and let the measurement loss fully drive the angular search.
The negative log of the radial prior yields the radial potential
which attains its minimum value of zero at (i.e., ; see Appendix § 9.§ 1 for the derivation), providing soft radial control of the denoiser input inspired by Gaussian radial statistics. Let denote the measurement loss. For a fixed annealing layer and anchor , the measurement loss along direction is . Replacing the coefficient prescribed by the prior with a tunable hyperparameter gives FANO’s within-layer objective:
The following proposition characterizes the optimization landscape of the one-dimensional radial subproblem .
Proposition 1 (Boundedness and benefits of radial relaxation). Assume , , and that is nonnegative and continuous on . Then, :
(i) attains a global minimum over at , and
(ii) If is differentiable at and , then .
Part (i) guarantees that the optimal radius does not diverge: the radial potential anchors near 1, with the deviation shrinking as increases. Part (ii) shows that when the measurement loss has a nonzero radial gradient, hard spherical search with cannot exploit this descent direction, whereas the soft constraint permits a bounded deviation and strictly reduces the objective. This result is consistent with the ablation in Table 2, where FANO outperforms FANO-Sphere on HDR by approximately 0.8 dB. The proof is provided in Appendix § 9.§ 2, and the strong-regularization asymptotic expansion in Corollary 1.
| Variant | Polar | Radial freedom | HDR PSNR | HDR SSIM | HDR LPIPS | NL deblur PSNR | NL deblur SSIM | NL deblur LPIPS |
| FANO | ✓ | ✓ | 29.88 | 0.878 | 0.157 | 30.83 | 0.873 | 0.183 |
| FANO-Sphere | ✓ | × | 29.06 | 0.858 | 0.167 | 30.72 | 0.870 | 0.183 |
| FANO-Euc | × | ✓ | 29.18 | 0.859 | 0.171 | 30.80 | 0.871 | 0.182 |
Table 2. Ablation of the polar parameterization and radial freedom (FFHQ100, ). The three variants share the -search framework (, , and residual-based early stopping) and differ in two design choices: Polar (the polar decomposition ) and Radial freedom (allowing to vary freely; otherwise, is fixed). The best results are in bold.
Algorithm
FANO proceeds recursively along an annealing schedule . Layer uses the denoised estimate from layer , , as its anchor. Each layer performs three steps: (i) Initialization: sample a random direction on the sphere and set the radius to ; (ii) Forward-noise optimization: solve Equation (5) for , using Riemannian Adam for the direction [1] and standard Adam for the radius . Each inner step requires only one forward and one backward pass through the denoiser to obtain gradients for both variables, requiring, over layers with at most steps per layer, at most NFEs; (iii) Anchor update: pass the optimized denoised estimate to the next layer:
The initial anchor is obtained by denoising pure noise with .
Within-layer iterations use the measurement residual for early stopping. The current layer terminates when
where is the standard deviation of the measurement noise and is the measurement dimension. The quantity is the typical norm of additive Gaussian noise ; a residual below this level indicates that optimization is beginning to fit the noise itself. In the noiseless case, and the criterion reduces to a fixed iteration budget. The full pseudocode is provided in Appendix § 10.§ 1, and optimizer implementation details in Appendix § 10.§ 2.
Experiments
We evaluate FANO on 5 linear tasks (super-resolution, Gaussian deblurring, motion deblurring, box inpainting, and random inpainting) and 3 nonlinear tasks (phase retrieval, high dynamic range (HDR) reconstruction, and nonlinear deblurring).
Experimental Setup
Datasets, tasks, and metrics Experiments are conducted on FFHQ [14] and ImageNet [8], using 100 test images from each dataset. We use publicly available pretrained VP SDE DDPMs: the FFHQ model is from Choi et al. [5], and the ImageNet model is from Dhariwal & Nichol [9], without task-specific fine-tuning. Degradation operators for linear tasks follow the standard settings of DAPS (Zhang et al., 2025). For nonlinear tasks, phase retrieval uses an oversampling ratio of 1.5 (a resolution ratio of , corresponding to a FFT; DAPS (Zhang et al., 2025) denotes this as OS = 2), HDR reconstruction uses a clipping factor of 2, and the spatially varying blur kernels for nonlinear deblurring are from BKSE [26]. The measurement noise level is in our experiments; task-specific degradation parameters are detailed in Appendix § 10.§ 4. We report PSNR, SSIM [29], and LPIPS (Zhang et al., 2018), with LPIPS consistently computed using a VGG16 feature network.
Methods and configurations We compare against DAPS (Zhang et al., 2025), SITCOM [2], FAST-DIPS [16], DiffRGD [19], and INO [13]. All methods are rerun using their public code and recommended hyperparameters with the same checkpoints, test images, degradation operators, and noise levels. Table 1 reports each baseline on the tasks supported by its public code: DiffRGD covers linear tasks except box inpainting, and INO does not cover motion deblurring, phase retrieval, or HDR. FANO uses the same algorithmic framework across all tasks (Appendix Algorithm 1), with learning rates and the noise-ball early-stopping criterion in Equation (8); detailed configurations are listed in Appendix § 10.§ 5. Following the convention in prior work [7, 2] (Zhang et al. 2025), phase retrieval uses 4 independent runs per image and reports the best result; all baselines use the same protocol.
Quantitative Results
Table 1 summarizes the quantitative results across all tasks. On linear inverse problems, FANO achieves reconstruction quality comparable to or slightly better than the strongest current baselines: it outperforms the second-best method in PSNR by 0.48–1.10 dB on random inpainting, 0.63–0.76 dB on Gaussian deblurring, and 0.50–0.67 dB on motion deblurring, with box inpainting remaining a relative weakness. The performance gap is more pronounced on nonlinear tasks: on FFHQ, FANO exceeds the second-best method in PSNR by 1.89 dB for phase retrieval, 1.52 dB for nonlinear deblurring, and 1.75 dB for HDR reconstruction. Its advantage on nonlinear tasks is particularly pronounced relative to SITCOM, which shares the annealing framework but searches in Euclidean space. This is consistent with the analysis in § 3.1: radial drift occurs more frequently with nonlinear measurement operators, and soft radial control effectively keeps the denoiser input within its operating regime.
Appendix D compares the computational costs and runtimes of the main methods. FANO’s reconstruction quality degrades smoothly as measurement noise increases, with detailed noise-robustness comparisons provided in Appendix § 13.§ 1. Figure 1 presents visual reconstruction comparisons on representative tasks, and qualitative results for additional tasks are provided in Appendix § 14. Appendix § 13.§ 2 further explores the ability of generative priors to compensate for missing oversampling information in phase retrieval without oversampling (OS = 1).
Ablation Studies
Our ablation isolates the respective contributions of the polar parameterization and radial freedom (Table 2). All three variants share the -search framework (, , residual-based early stopping, and hyperparameters), differing only in parameterization and radial freedom:
FANO (default): uses the polar decomposition and jointly optimizes ;
FANO-Sphere: uses the polar decomposition, fixes , and optimizes only the direction ;
FANO-Euc: directly optimizes with standard Adam, retaining the radial potential but without the polar decomposition.
All three variants outperform every comparison method in Table 1 in PSNR, SSIM, and LPIPS on HDR and nonlinear deblurring, indicating that the -search framework itself provides the primary gains. In particular, FANO-Sphere fixes and requires no tuning of , yet its PSNR still exceeds the strongest comparison method by 0.93 dB and 1.41 dB on the two tasks, respectively, making it a ready-to-use, tuning-free default. The complete comparison across 8 tasks is given in Appendix Table 5, and sensitivity to is analyzed in Appendix § 11.§ 2.
Differences within the framework are task-dependent. On nonlinear deblurring, the PSNR gap among the three variants is at most 0.11 dB, with no notable separation in SSIM or LPIPS either. This indicates that the -search framework already realizes its advantages on this task, leaving limited additional benefit from the polar decomposition or radial freedom. HDR behaves differently: allowing radial deviations improves FANO over FANO-Sphere by 0.82 dB, while the polar decomposition improves FANO over FANO-Euc by 0.70 dB. Both gains also hold for SSIM and LPIPS, indicating independent contributions from the two mechanisms.
Conclusion
We analyze radial drift in annealed diffusion methods for inverse problems: within-layer optimization drives the equivalent noise norm of the denoiser input away from the typical value of the Gaussian prior, degrading reconstruction quality in later layers. To address this limitation, we propose FANO, which uses the forward noise instead of the denoiser input as the within-layer search variable in an annealing framework. The anchor is excluded from within-layer updates, the denoiser input retains the forward-diffusion structure, and the search region contracts progressively through annealing. The Gaussian prior on further provides a statistical basis for radial control, with a concentration-inspired radial potential keeping the denoiser input in the high-density region of the forward distribution. Experiments on 8 linear and nonlinear tasks validate the effectiveness of FANO. Ablation studies identify the -search framework as the primary source of improvement, and the gains on nonlinear tasks are consistent with the observations from our radial drift analysis.
The current framework relies on deterministic optimization and restricts the search space to a neighborhood of a single optimization trajectory, preventing exploration of the multimodal structure of the inverse problem posterior. Incorporating the geometric structure of noise into a stochastic sampling framework, for example by constructing Langevin dynamics on the sphere, offers a possible path from single-point reconstruction to sampling multiple solutions and quantifying uncertainty.
REPRODUCIBILITY STATEMENT
Algorithm 1 provides the complete pseudocode for FANO. All hyperparameters (annealing layers, inner steps, learning rates, and radial regularization coefficients) are listed in Appendix Table 4; task-specific degradation parameters are given in Appendix Table 3; and the Riemannian Adam optimizer and positivity safeguards are detailed in Appendix § 10.§ 2. All experiments use publicly available pretrained diffusion models from Choi et al. [5] and Dhariwal & Nichol [9] without task-specific fine-tuning. Code to reproduce all experiments will be released upon acceptance.
ETHICS STATEMENT
This work proposes a general-purpose optimization method for image inverse problems using pretrained diffusion models. All experiments are conducted on publicly available face (FFHQ) and object (ImageNet) datasets. The method does not involve human subjects, collection of new data, or deployment in sensitive applications. As with other image reconstruction techniques, the underlying diffusion models were trained on large-scale image datasets whose curation may carry biases; we do not address dataset bias in this work.
AI USE STATEMENT
In this work, we have not used generative AI tools for any of the following required-disclosure tasks: generating synthetic data, developing theoretical models or conceptual frameworks, formulating mathematical claims, assisting in the writing of proofs, proposing or refining hypotheses, designing research methodology or experiments, implementing methods, interpreting results, assisting with translation, cleaning or reformatting datasets, or supporting qualitative and thematic data analysis. All research ideas, mathematical derivations, algorithm design, and experimental conclusions are solely the work of the authors.
Additionally, we used generative AI tools (Claude via Cursor IDE) to edit and polish draft text for improved readability and English fluency. All AI-edited text was reviewed and revised by the authors to ensure accuracy. We take responsibility for the final content of this work, including all text, claims, and artifacts.
Theoretical Derivations and Proofs
Derivation of the Radial Potential
A standard Gaussian vector has density . We decompose in polar coordinates as , where the normalized radial magnitude is and the direction is . Since , the Jacobian of the polar change of variables (the spherical surface element in dimensions multiplied by the radial factor ) yields the joint density
where the direction is uniformly distributed on . Integrating over gives the radial marginal density
Taking the negative log and subtracting a constant so that the minimum is zero gives the radial potential
which attains its minimum value of zero at (i.e., ). Its curvature at is , reflecting the strength of high-dimensional concentration: larger imposes a greater cost for deviations from the typical value.
Proof of Proposition 1
Following the notation in the main text, fix the annealing layer , anchor , and direction , and write , , and .
Proof of Proposition 1. (i): Existence and bounded deviation. Since , we have , and therefore
Moreover, as or . Together with , this implies . Every sublevel set at a finite level is closed and bounded, so continuity ensures that admits a global minimizer . By the global optimality of and ,
Combining this with Equation (A.4) gives , or equivalently . Define ; then . Substituting the radius bound above yields the following bound on the denoiser input shift:
(ii): Strict relaxation gain. Since , we have . If , then is not a stationary point of . Set for sufficiently small . Then
By the global optimality of , .
Strong-Regularization Asymptotic Expansion
Corollary 1 (Strong-regularization asymptotics). Under the assumptions of Proposition 1, further assume that is twice continuously differentiable in a neighborhood of , and let and . Fix , , , and , and let (equivalently, ). Then
Proof. By part (i), as . Let . The first-order condition at an interior minimizer is
Part (i) gives , but a tighter order is needed below. Since and is continuous near 1, there exists a -independent constant such that . Using , the first-order condition gives , hence .
Expanding the bracketed term as and using gives
which yields Equation (A.6). A Taylor expansion of the objective gives
Substituting , the measurement loss contributes and the potential contributes . Combining the two yields Equation (A.7). □
Equations (A.6)–(A.7) show that, under strong regularization, the optimal radius has an deviation from 1; when , this corresponds to an objective decrease of order . Radial regularization thus limits the magnitude of radial deviations without entirely eliminating measurement-gradient-driven radial adjustment.
Implementation Details and Experimental Setup
Algorithm Pseudocode
Algorithm 1. FANO: Anchored Forward-Noise Optimization
Input Measurement , forward operator , denoiser .
Schedule ; at most inner steps per layer.
Learning rates ; radial penalty ; threshold .
Output Restored image .
Sample ; set
Outer loop: annealing
for do
; sample
;
Inner loop: polar optimization
for do
;
if then
break
end if
;
end for
Update the anchor
end for
return
Polar Gradients and Optimizers
Separation of polar gradients The within-layer objective in Equation (5) is
Since is independent of , the gradient with respect to comes entirely from the measurement loss:
The gradient with respect to contains contributions from both the measurement loss and the radial potential:
where . Because the angular Riemannian gradient uses the tangent-space projection (B.3) to further remove the radial component along , the updates to the two variables are geometrically separated: the angular update moves along a tangent direction of the sphere, while the radial update adjusts the scalar . The radial regularization term appears only in the latter.
Riemannian Adam for the direction variable Fix the outer layer , let , and write . The angular variable is optimized on . Denote the variables at step by . The denoiser input and its input-space gradient are, respectively,
The corresponding Euclidean angular gradient is . The update rules are as follows:
(i) Tangent-space projection. Project the Euclidean gradient onto the tangent space at :
(ii) Adam moment updates. Maintain first- and second-moment estimates in the tangent space:
Apply bias correction and . After computing the preconditioned update direction, project it onto the tangent space once more:
(iii) Retraction. Retract the tangent update onto the sphere:
(iv) Momentum transport. After the update, reproject the first moment onto the tangent space at the new point:
This keeps the momentum on the manifold. The default hyperparameters are , , and .
Adam for the radius variable and positivity safeguards The radial scalar is updated with standard Adam. If the updated value satisfies (with the default ), a backtracking search repeatedly halves the step size until or the maximum number of backtracking steps is reached. This mechanism keeps positive throughout optimization, ensuring that the potential has a well-defined term. Backtracking was never triggered on any task in our experiments, indicating that does not approach zero along normal optimization trajectories.
Statistical Motivation for Early Stopping
For a fixed outer layer , within-layer optimization uses the measurement residual for early stopping, terminating when . The threshold is set to
where is the standard deviation of the measurement noise and is the measurement dimension. This choice is motivated by the concentration of additive Gaussian noise: if , then , and concentration inequalities for the distribution imply , with deviations of order . Thus, is the typical norm of the measurement noise: a residual below this level indicates that the optimizer is beginning to fit the noise itself, so further optimization harms generalization. In the noiseless case , we have , and the criterion reduces to a fixed iteration budget.
Task-Specific Degradation Parameters
Table 3 lists the degradation-operator parameters for each task.
| Task | Type | Parameters |
| SR | Linear | Bicubic, factor 4 |
| Gauss. deblur | Linear | Gaussian, |
| Motion deblur | Linear | motion, intensity 0.5 |
| Inpaint (box) | Linear | random mask |
| Inpaint (rand.) | Linear | Pixel mask prob. 0.7 |
| Phase retrieval | Nonlinear | Oversampling ratio 1.5 |
| HDR | Nonlinear | Clipping factor 2 |
| NL deblur | Nonlinear | BKSE varying kernel |
Table 3. Degradation-operator parameters for each task.
Task-Specific Hyperparameters for FANO
Table 4 lists the number of annealing layers , the number of inner steps , and the radial regularization coefficient used for each task in the main FANO experiments. The same configurations are used for FFHQ and ImageNet. The direction is optimized with Riemannian Adam and the radius with Adam, both using learning rates , , and . The annealing schedule is sampled at uniform intervals from a 1000-step VP diffusion process. The forward coefficients at each layer are and , where denotes the cumulative signal-to-noise ratio schedule of VP diffusion. All tasks use the same scheduling procedure.
| Task | Annealing layers | Inner steps | |
| SR | 50 | 30 | 0 |
| Gauss. deblur | 50 | 30 | 0.0015 |
| Motion deblur | 50 | 30 | 0.01 |
| Inpaint (box) | 20 | 20 | 0 |
| Inpaint (rand.) | 20 | 30 | 1 |
| Phase retrieval | 50 | 30 | 0.01 |
| HDR | 50 | 30 | 0.0015 |
| NL deblur | 50 | 30 | 0.0015 |
Table 4. Annealing configurations and radial regularization coefficients used in the main FANO experiments on FFHQ and ImageNet ().
Ablation and Parameter Sensitivity Analysis
A Tuning-Free Baseline: FANO-Sphere
When task-specific tuning of is undesirable, FANO-Sphere with provides a tuning-free default. Table 5 compares its PSNR with the two most closely related annealed baselines in Table 1, SITCOM and DAPS. Among the 16 dataset–task combinations, FANO-Sphere outperforms both SITCOM and DAPS in 15; the sole exception is ImageNet box inpainting, where DAPS leads by 0.88 dB. Its advantage over SITCOM is particularly pronounced on nonlinear tasks: 2.85 dB on FFHQ and 3.37 dB on ImageNet for phase retrieval, and 0.93–1.05 dB for HDR. The default FANO configuration in the main text, which jointly optimizes , provides a further improvement of approximately 0.8 dB on HDR.
| Task | FFHQ SITCOM | FFHQ DAPS | FFHQ Sphere | ImageNet SITCOM | ImageNet DAPS | ImageNet Sphere |
| SR × 4 | 30.55 | 29.35 | 30.57 | 27.09 | 25.47 | 27.14 |
| Gauss. deblur | 29.89 | 29.61 | 30.66 | 26.38 | 25.88 | 27.01 |
| Motion deblur | 32.37 | 31.65 | 33.03 | 29.38 | 28.65 | 29.89 |
| Inpaint (box) | 24.47 | 24.32 | 25.14 | 19.62 | 21.05 | 20.17 |
| Inpaint (rand.) | 32.40 | 30.72 | 34.06 | 28.90 | 27.35 | 29.90 |
| Phase retrieval | 29.21 | 30.09 | 32.06 | 20.49 | 22.94 | 23.86 |
| HDR | 28.13 | 27.48 | 29.06 | 25.75 | 26.07 | 26.80 |
| NL deblur | 29.31 | 28.53 | 30.72 | 28.47 | 27.25 | 29.16 |
Table 5. PSNR comparison of FANO-Sphere (, without tuning ) against annealed baselines (). The best result for each combination is in bold.
Sensitivity to the Hyperparameter rad
We assess the sensitivity of reconstruction quality to the radial regularization coefficient through a parameter sweep. For box inpainting, random inpainting, and HDR, we use the first 30 FFHQ images to sweep . Each task uses the annealing budget in Table 4, with the remaining hyperparameters fixed at , , and seed=42. Within each task, all coefficients share the same images, measurements, and initializations (Figure C.1).
Figure C.1. Sensitivity to on three representative tasks (the first 30 FFHQ images, ). The top row shows PSNR and the bottom row shows LPIPS (VGG16), both averaged over images. Dashed lines and open circles mark the default value used for each task in the main text.
The curves for box inpainting and random inpainting are relatively flat. Across the full sweep, box inpainting varies by 0.28 dB in PSNR and 0.0018 in LPIPS, with the default achieving both the highest PSNR and the lowest LPIPS. Random inpainting varies by at most 0.05 dB in PSNR and 0.0010 in LPIPS; the default achieves the highest PSNR, and its LPIPS differs from the lowest value in the sweep by less than 0.0001.
HDR is more sensitive to radial regularization: the default achieves both the highest PSNR and the lowest LPIPS on the sweep grid. Increasing the coefficient to 0.1 or above reduces PSNR by at least 0.41 dB and increases LPIPS by at least 0.0079, with stronger regularization further limiting reconstruction quality. This is consistent with the role of radial freedom in nonlinear tasks (see § 3.1): when the measurement operator is strongly nonlinear, the optimizer needs moderate radial flexibility to match the measurement, and excessive radial constraints limit this ability. These results use the FFHQ30 subset and a single random seed to illustrate sensitivity trends; the configurations used for the full-dataset experiments are listed in Table 4.
Computational Cost and Efficiency Analysis
Do FANO’s reconstruction gains arise from the method itself rather than greater computational cost? We address this question through three comparisons: (1) a direct comparison with the most closely related method, SITCOM, under matched NFE budgets to isolate the method’s contribution; (2) a comparison of NFE and GPU memory efficiency with INO, which also performs spherical noise optimization; and (3) a comparison of actual runtime with DAPS.
Matched-Budget Comparison with SITCOM
SITCOM and FANO share the same algorithmic structure of annealing layers with within-layer optimization, making SITCOM the most directly comparable baseline in the main text. Table 1 uses the configuration recommended in the SITCOM paper, whereas FANO defaults to , , resulting in different NFE budgets. To remove this confounding factor, Table 6 adjusts both the number of SITCOM annealing layers and its inner steps to match FANO (denoted SITCOM-TB), giving the two methods the same maximum NFE budget. Both methods use the residual-based early-stopping criterion in Equation (8).
| Task | Method | FFHQ PSNR↑ | FFHQ SSIM↑ | FFHQ LPIPS↓ | ImageNet PSNR↑ | ImageNet SSIM↑ | ImageNet LPIPS↓ |
| SR ×4 | SITCOM-TB | 30.61 | 0.869 | 0.226 | 27.11 | 0.759 | 0.311 |
| SR ×4 | FANO | 30.68 | 0.872 | 0.232 | 27.03 | 0.755 | 0.321 |
| Gauss. deblur | SITCOM-TB | 30.09 | 0.854 | 0.244 | 26.56 | 0.732 | 0.337 |
| Gauss. deblur | FANO | 30.65 | 0.868 | 0.225 | 27.01 | 0.746 | 0.317 |
| Motion deblur | SITCOM-TB | 32.62 | 0.902 | 0.187 | 29.68 | 0.838 | 0.231 |
| Motion deblur | FANO | 33.04 | 0.909 | 0.167 | 29.88 | 0.840 | 0.225 |
| Inpaint (box) | SITCOM-TB | 24.47 | 0.737 | 0.245 | 19.62 | 0.699 | 0.256 |
| Inpaint (box) | FANO | 25.33 | 0.866 | 0.156 | 20.40 | 0.786 | 0.206 |
| Inpaint (rand.) | SITCOM-TB | 32.38 | 0.863 | 0.182 | 28.89 | 0.814 | 0.181 |
| Inpaint (rand.) | FANO | 34.07 | 0.931 | 0.120 | 29.94 | 0.864 | 0.157 |
| Phase retrieval | SITCOM-TB | 30.47 | 0.868 | 0.232 | 23.36 | 0.577 | 0.402 |
| Phase retrieval | FANO | 31.98 | 0.877 | 0.187 | 23.83 | 0.567 | 0.388 |
| HDR | SITCOM-TB | 28.03 | 0.809 | 0.216 | 25.81 | 0.765 | 0.237 |
| HDR | FANO | 29.88 | 0.878 | 0.157 | 27.32 | 0.832 | 0.196 |
| NL deblur | SITCOM-TB | 29.68 | 0.815 | 0.237 | 29.00 | 0.820 | 0.197 |
| NL deblur | FANO | 30.83 | 0.873 | 0.183 | 29.09 | 0.819 | 0.222 |
Table 6. Matched-budget comparison of SITCOM-TB and FANO at . For each task, both methods use the same number of annealing layers , inner steps , residual-based early-stopping criterion, and number of candidate runs. The best results are in bold.
Under the same annealing budget, FANO outperforms SITCOM-TB in FFHQ PSNR on all eight tasks, with particularly pronounced gains on inpainting and nonlinear tasks: 0.86 dB for box inpainting and 1.51 dB for phase retrieval on FFHQ, consistent with the analysis in § 3.1. On ImageNet, its PSNR for SR ×4 is lower by 0.08 dB and its LPIPS for nonlinear deblurring is higher by 0.025, with trade-offs on individual metrics more apparent for linear degradation tasks. Overall, FANO’s gains on nonlinear tasks arise from using as the search variable rather than from an additional NFE budget.
Computational Cost Comparison with INO
Both FANO and INO [13] optimize noise variables on a sphere, but use different inference frameworks: FANO progressively refines the estimate across annealing layers, requiring gradients through only a single denoiser call per layer, whereas INO treats the diffusion model as a black box and optimizes the initial noise of a three-step DDIM chain end to end. FANO uses a total NFE of , whereas each of INO’s 1000 AdamSphere steps requires 3 DDIM forward steps, for a total NFE of 3000, twice that of FANO. In terms of GPU memory, INO must backpropagate through the full DDIM chain and reaches approximately 5.34 GiB of peak allocated GPU memory, compared with only 2.30 GiB for FANO, less than half as much. Despite its substantially lower NFE and memory usage, across the 30 metrics reported by both methods, FANO achieves better mean performance on 29 (Table 1). Under these experimental conditions, spherical search within a layerwise annealing framework outperforms end-to-end black-box optimization in both reconstruction quality and computational cost.
Runtime Comparison with DAPS
Table 7 reports the average core reconstruction time of FANO and DAPS (Zhang et al., 2025) on FFHQ, with all configurations executed sequentially on the same NVIDIA A100-PCIE-40GB GPU. DAPS uses its recommended 1k configuration, while FANO uses the task-specific annealing budgets, with , for most tasks. For nonlinear deblurring, DAPS uses 200 Langevin updates per layer, compared with 100 for the other tasks. The nonlinear blur operator also requires calls to the BKSE network, making this task substantially more time-consuming than linear tasks.
| Task | DAPS | FANO |
| SR | 83 | 74 |
| Gauss. deblur | 68 | 88 |
| Motion deblur | 68 | 88 |
| Inpaint (box) | 46 | 86 |
| Inpaint (rand.) | 46 | 34 |
| Phase retrieval | 107 | 87 |
| HDR | 57 | 90 |
| NL deblur | 606 | 101 |
Table 7. Average core reconstruction time (seconds) of FANO and DAPS on FFHQ, executed sequentially on a single A100.
Total Budget and Budget Allocation
This section presents two sets of budget experiments. Figure D.1 sweeps FANO’s annealing budgets on the FFHQ10 subset, and Table 8 compares two annealing configurations on the full datasets.
| Task | Config | FFHQ | ImageNet | ||||
| PSNR | SSIM | LPIPS | PSNR | SSIM | LPIPS | ||
| SR 4 | , | 30.68 | 0.872 | 0.232 | 27.03 | 0.755 | 0.321 |
| SR 4 | , | 30.64 | 0.869 | 0.226 | 27.10 | 0.756 | 0.315 |
| Gauss. deblur | , | 30.65 | 0.868 | 0.225 | 27.01 | 0.746 | 0.317 |
| Gauss. deblur | , | 30.55 | 0.866 | 0.217 | 27.08 | 0.750 | 0.306 |
| Motion deblur | , | 33.04 | 0.909 | 0.167 | 29.88 | 0.840 | 0.225 |
| Motion deblur | , | 33.01 | 0.908 | 0.161 | 30.02 | 0.845 | 0.208 |
| Phase retrieval | , | 31.98 | 0.877 | 0.187 | 23.83 | 0.567 | 0.388 |
| Phase retrieval | , | 31.16 | 0.852 | 0.199 | 22.77 | 0.526 | 0.410 |
| HDR | , | 29.88 | 0.878 | 0.157 | 27.32 | 0.832 | 0.196 |
| HDR | , | 29.61 | 0.868 | 0.162 | 27.21 | 0.827 | 0.182 |
| NL deblur | , | 30.83 | 0.873 | 0.183 | 29.09 | 0.819 | 0.222 |
| NL deblur | , | 31.01 | 0.874 | 0.173 | 29.30 | 0.828 | 0.186 |
Table 8. Results for two FANO configurations on FFHQ100 and ImageNet100 (): , and , , both with a maximum NFE of 1500. The best metric for each task and dataset is in bold.
Figure D.1 shows FANO’s performance on one linear task (motion deblurring) and one nonlinear task (nonlinear deblurring) for different numbers of annealing layers and inner steps , as a function of total NFE ().
Monotonic improvement for fixed For each fixed , increasing monotonically improves both PSNR and LPIPS, with diminishing marginal gains as NFE increases.
Convergence of curves for different The three curves corresponding to different tend to converge in the high-NFE regime (at NFE2000, LPIPS differences are ). This indicates that FANO’s final reconstruction quality depends primarily on the total computational budget and is relatively insensitive to its allocation between and . Notably, curves for larger retain greater curvature at high NFE, suggesting that further increasing may allow larger- configurations to match or exceed the asymptotic performance of smaller- configurations.
Trade-off between annealing layers and inner steps at a fixed budget Table 8 uses the same maximum NFE budget of 1500 to compare , (more layers with fewer steps per layer) and , (fewer layers with more steps per layer). Linear tasks are insensitive to this allocation, with PSNR differences of at most 0.14 dB between the two configurations. The three nonlinear tasks respond differently: improves PSNR by 0.82–1.06 dB for phase retrieval and 0.11–0.27 dB for HDR, whereas improves PSNR by 0.18–0.21 dB for nonlinear deblurring and consistently achieves better LPIPS. The gains on phase retrieval substantially outweigh the losses on nonlinear deblurring, so Table 1 adopts , as the default configuration. Table 8 omits box inpainting and random inpainting; the budgets used for these two tasks in the main experiments are listed in Table 4.

Figure D.1. FANO reconstruction performance under different NFE budgets. The left column shows motion deblurring and the right column nonlinear deblurring; the top row shows PSNR () and the bottom row LPIPS (). Each curve corresponds to a number of annealing layers , with total NFE (= ) on the horizontal axis.
Extended Experiments
Noise Robustness
Figure E.1 compares FANO and DAPS on motion deblurring and nonlinear deblurring as the measurement noise increases from 0.01 to 0.30, using 20 FFHQ images. Both metrics for FANO degrade smoothly and monotonically: PSNR decreases from 34.21 dB to 27.89 dB for motion deblurring and from 31.34 dB to 26.27 dB for nonlinear deblurring, without abrupt changes or collapse. By contrast, DAPS performs relatively close to FANO for but degrades sharply for

Figure E.1. Reconstruction performance of FANO and DAPS at different measurement noise levels . The left column shows motion deblurring and the right column nonlinear deblurring; the top row shows PSNR () and the bottom row LPIPS (). FANO uses , and DAPS uses its recommended 1k configuration. All results are averaged over 20 FFHQ images.

Figure E.2. Phase retrieval without oversampling (OS = 1, noiseless) on 100 FFHQ images. (a) Time–LPIPS trade-off. (b) Visual comparison at OS = 1. LPIPS as a function of per-image wall-clock time on a single A100: solid curves show FANO and DAPS under varying compute budgets; dashed lines mark HIO at three oversampling rates. Three representative examples comparing HIO (OS = 1), HIO (OS = 2), DAPS, FANO, and the reference. At roughly 300 s per image, FANO reaches perceptual quality comparable to HIO at OS = 2, recovering clean structures without any oversampling.
: its motion deblurring PSNR drops from 27.88 dB at to 15.88 dB at , while LPIPS increases from 0.228 to 0.630.
Phase Retrieval without Oversampling: Compensation by Generative Priors
Classical phase retrieval methods, such as HIO [11], already provide reliable recovery in the noiseless setting when the oversampling ratio satisfies OS . Oversampling reduces ill-conditioning by increasing the measurement dimension, but lower oversampling ratios impose fewer requirements on optical systems and reduce acquisition costs in practice. A potential advantage of diffusion generative priors is their ability to compensate for missing oversampling information and enable high-quality recovery even at , without oversampling.
Figure E.2 compares FANO, DAPS, and classical HIO on 100 FFHQ test images. The experiment follows the phase retrieval configuration in § 4.1, changing only to 1 and removing measurement noise. At its largest budget of 437 seconds per image, DAPS reduces LPIPS to only approximately 0.45, whereas FANO reaches 0.26 at approximately 300 seconds, comparable to HIO at . Representative examples in Figure E.2(b) further corroborate this gap: at , FANO recovers structures and textures close to the reference, whereas DAPS exhibits substantial distortions and HIO fails completely at .
HIO is implemented using Fourier-magnitude projections and a known image-support constraint, processing the three RGB channels separately and clipping the final output to . For all , the feedback parameter is fixed at , and each candidate undergoes 500 updates.
Additional Qualitative Results
We present representative reconstructions for each task below. Each figure contains two tasks (left and right); for each task, the upper half shows FFHQ and the lower half ImageNet, with three examples per dataset. The columns, from left to right, show the degraded measurement (Measurement), DAPS, SITCOM, FANO (ours), and the ground truth (Reference).

Figure F.1. Super resolution (left) and Gaussian deblurring (right) results. First (resp. last) three rows are for the FFHQ (resp. ImageNet) dataset.

Figure F.2. Motion deblurring (left) and nonlinear deblurring (right) results. First (resp. last) three rows are for the FFHQ (resp. ImageNet) dataset.

Figure F.3. Box inpainting (left) and random inpainting (right) results. First (resp. last) three rows are for the FFHQ (resp. ImageNet) dataset.

Figure F.4. Phase retrieval (left) and high dynamic range (right) results. First (resp. last) three rows are for the FFHQ (resp. ImageNet) dataset.
References
- [1]P.-A. Absil, Robert Mahony, and Rodolphe Sepulchre. Optimization Algorithms on Matrix Manifolds. Princeton University Press, 2008. ISBN 978-0-691-13298-3. URL https://sites.uclouvain.be/absil/amsbook/.DOI
- [2]Ismail Alkhouri, Shijun Liang, Cheng-Han Huang, Jimmy Dai, Qing Qu, Saiprasad Ravishankar, and Rongrong Wang. SITCOM: Step-wise triple-consistent diffusion sampling for inverse problems. In Proceedings of the 42nd International Conference on Machine Learning, volume 267 of Proceedings of Machine Learning Research, pp. 1128–1158. PMLR, 2025. URL https://proceedings.mlr.press/v267/alkhouri25b.html.arxiv.org/abs/2410.04479
- [3]Brian D. O. Anderson. Reverse-time diffusion equation models. Stochastic Processes and their Applications, 12(3):313–326, 1982. doi: 10.1016/0304-4149(82)90051-5. URL https://doi.org/10.1016/0304-4149(82)90051-5.
- [4]Benjamin Boys, Mark Girolami, Jakiw Pidstrigach, Sebastian Reich, Alan Mosca, and Omer Deniz Akyildiz. Tweedie moment projected diffusions for inverse problems. Transactions on Machine Learning Research, 2024. URL https://openreview.net/forum?id=4unJi0qrTE. Preprint. Under review.
- [5]Jooyoung Choi, Sungwon Kim, Yonghyun Jeong, Youngjune Gwon, and Sungroh Yoon. ILVR: Conditioning method for denoising diffusion probabilistic models. In 2021 IEEE/CVF International Conference on Computer Vision (ICCV), pp. 14347–14356. IEEE, 2021. doi: 10.1109/ICCV48922.2021.01410. URL https://doi.org/10.1109/ICCV48922.2021.01410.
- [6]Hyungjin Chung, Byeongsu Sim, Dohoon Ryu, and Jong Chul Ye. Improving diffusion models for inverse problems using manifold constraints. In Advances in Neural Information Processing Systems, volume 35, pp. 25683–25696. Curran Associates, Inc., 2022. doi: 10.52202/068431-1862. URL https://proceedings.neurips.cc/paper_files/paper/2022/hash/a48e5877c7bf86a513950ab23b360498-Abstract-Conference.html.DOI
- [7]Hyungjin Chung, Jeongsol Kim, Michael Thompson McCann, Marc Louis Klasky, and Jong Chul Ye. Diffusion posterior sampling for general noisy inverse problems. In International Conference on Learning Representations, 2023. URL https://openreview.net/forum?id=OnD9zGAGT0k.arxiv.org/abs/2209.14687
- [8]Jia Deng, Wei Dong, Richard Socher, Li-Jia Li, Kai Li, and Li Fei-Fei. ImageNet: A large-scale hierarchical image database. In 2009 IEEE Conference on Computer Vision and Pattern Recognition, pp. 248–255. IEEE Computer Society, 2009. doi: 10.1109/CVPR.2009.5206848. URL https://doi.org/10.1109/CVPR.2009.5206848.
- [9]Prafulla Dhariwal and Alexander Nichol. Diffusion models beat GANs on image synthesis. In Advances in Neural Information Processing Systems, volume 34, pp. 8780–8794. Curran Associates, Inc., 2021. URL https://proceedings.neurips.cc/paper_files/paper/2021/hash/49ad23d1ec9fa4bd8d77d02681df5cfa-Abstract.html.
- [10]Sander Dieleman. Diffusion is spectral autoregression. Sander Dieleman’s blog, September 2024. URL https://sander.ai/2024/09/02/spectral-autoregression.html.
- [11]James R. Fienup. Phase retrieval algorithms: A comparison. Applied Optics, 21(15):2758–2769, 1982. doi: 10.1364/AO.21.002758. URL https://doi.org/10.1364/AO.21.002758.
- [12]Jonathan Ho, Ajay Jain, and Pieter Abbeel. Denoising diffusion probabilistic models. In Advances in Neural Information Processing Systems, volume 33, pp. 6840–6851. Curran Associates, Inc., 2020. URL https://proceedings.neurips.cc/paper_files/paper/2020/hash/4c5bcfec8584af0d967f1ab10179ca4b-Abstract.html.arxiv.org/abs/2006.11239
- [13]Jing Jia, Wei Yuan, Sifan Liu, Liyue Shen, and Guanyang Wang. Weak diffusion priors can still achieve strong inverse-problem performance. In International Conference on Machine Learning, 2026. URL https://openreview.net/forum?id=fdkSA4F0IN.arxiv.org/abs/2601.22443
- [14]Tero Karras, Samuli Laine, and Timo Aila. A style-based generator architecture for generative adversarial networks. IEEE Transactions on Pattern Analysis and Machine Intelligence, 43(12):4217–4228, 2021. doi: 10.1109/TPAMI.2020.2970919. URL https://doi.org/10.1109/TPAMI.2020.2970919.
- [15]Bahjat Kawar, Michael Elad, Stefano Ermon, and Jiaming Song. Denoising diffusion restoration models. In Advances in Neural Information Processing Systems, volume 35, pp. 23593–23606. Curran Associates, Inc., 2022. doi: 10.52202/068431-1714. URL https://proceedings.neurips.cc/paper_files/paper/2022/hash/95504595b616913b6ed6cd72eb05616-Abstract-Conference.html.DOI
- [16]Minwoo Kim, Seung hyeok Shin, and Hongki Lim. FAST-DIPS: Adjoint-free analytic steps and hard-constrained likelihood correction for diffusion-prior inverse problems. In International Conference on Learning Representations, volume 2026, pp. 104696–104730, 2026. URL https://proceedings.iclr.cc/paper_files/paper/2026/hash/ab378fb084f313a204432f0a1e697bae-Abstract-Conference.html.arxiv.org/abs/2603.01591
- [17]Beatrice Laurent and Pascal Massart. Adaptive estimation of a quadratic functional by model selection. The Annals of Statistics, 28(5):1302–1338, 2000. doi: 10.1214/aos/1015957395. URL https://doi.org/10.1214/aos/1015957395. Preprint. Under review.
- [18]Xiang Li, Soo Min Kwon, Shijun Liang, Ismail R. Alkhouri, Saiprasad Ravishankar, and Qing Ou. Decoupled data consistency with diffusion purification for image restoration. In International Conference on Computational Photography, 2026. URL https://arxiv.org/abs/2403.06054.
- [19]Jia-Wei Liao, Li-Xuan Peng, Mei-Heng Yueh, Min Sun, Cheng-Fu Chou, and Jun-Cheng Chen. DiffRGD: An inference-time diffusion guidance through Riemannian gradient descent. In European Conference on Computer Vision, 2026. URL https://media.eventhosts.cc/Conferences/ECCV2026/pdfs/9638.pdf.arxiv.org/abs/2606.28417
- [20]Andreas Lugmayr, Martin Danelljan, Andres Romero, Fisher Yu, Radu Timofte, and Luc Van Gool. RePaint: Inpainting using denoising diffusion probabilistic models. In 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 11451–11461. IEEE, 2022. doi: 10.1109/CVPR52688.2022.01117. URL https://doi.org/10.1109/CVPR52688.2022.01117.
- [21]Xiangming Meng and Yoshiyuki Kabashima. Diffusion model based posterior sampling for noisy linear inverse problems. In Proceedings of the 16th Asian Conference on Machine Learning, volume 260 of Proceedings of Machine Learning Research, pp. 623–638. PMLR, 2025. URL https://proceedings.mlr.press/v260/meng25a.html.
- [22]Severi Rissanen, Markus Heinonen, and Arno Solin. Generative modelling with inverse heat dissipation. In International Conference on Learning Representations, 2023. URL https://openreview.net/forum?id=4PJUBT9f2oI.arxiv.org/abs/2206.13397
- [23]Jiaming Song, Chenlin Meng, and Stefano Ermon. Denoising diffusion implicit models. In International Conference on Learning Representations, 2021a. URL https://openreview.net/forum?id=St1giarCHLP.arxiv.org/abs/2010.02502
- [24]Jiaming Song, Arash Vahdat, Morteza Mardani, and Jan Kautz. Pseudoinverse-guided diffusion models for inverse problems. In International Conference on Learning Representations, 2023. URL https://openreview.net/forum?id=9_gsMA8MRKQ.
- [25]Yang Song, Jascha Sohl-Dickstein, Diederik P. Kingma, Abhishek Kumar, Stefano Ermon, and Ben Poole. Score-based generative modeling through stochastic differential equations. In International Conference on Learning Representations, 2021b. URL https://openreview.net/forum?id=PxTIG12RRHS.
- [26]Phong Tran, Anh Tuan Tran, Quynh Phung, and Minh Hoai. Explore image deblurring via encoded blur kernel space. In 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 11951–11960. IEEE, 2021. doi: 10.1109/CVPR46437.2021.01178. URL https://doi.org/10.1109/CVPR46437.2021.01178.
- [27]Hengkang Wang, Xu Zhang, Taihui Li, Yuxiang Wan, Tiancong Chen, and Ju Sun. DMPlug: A plug-in method for solving inverse problems with diffusion models. In Advances in Neural Information Processing Systems, volume 37, pp. 117881–117916. Curran Associates, Inc., 2024. doi: 10.52202/079017-3744. URL https://proceedings.neurips.cc/paper_files/paper/2024/hash/d5c04aa72b92c53bda5b525b603958295–Abstract-Conference.html.DOI
- [28]Yinhuai Wang, Jiwen Yu, and Jian Zhang. Zero-shot image restoration using denoising diffusion null-space model. In International Conference on Learning Representations, 2023. URL https://openreview.net/forum?id=mRieQgMtNTQ.arxiv.org/abs/2212.00490
- [29]Zhou Wang, Alan C. Bovik, Hamid R. Sheikh, and Eero P. Simoncelli. Image quality assessment: From error visibility to structural similarity. IEEE Transactions on Image Processing, 13(4): 600–612, 2004. doi: 10.1109/TIP.2003.819861. URL https://doi.org/10.1109/TIP.2003.819861.
- [30]Yingzhi Xia, Setthakorn Tanomkiattikun, Liangli Zhen, and Zaiwang Gu. Noise-adaptive diffusion sampling for inverse problems without task-specific tuning. In International Conference on Learning Representations, 2026. URL https://proceedings.iclr.cc/paper_files/paper/2026/hash/1e45dc45f1649f880130169b2271129e–Abstract-Conference.html.arxiv.org/abs/2604.16919


