WorksComputer Science
GeoNaviDiff: Transferring Disentangled Semantic Controls to Diffusion Features via Local Riemannian Navigation
Abstract
Disentangled real-image manipulation requires factor-specific semantic control while preserving image fidelity and non-target content. StyleSpace provides interpretable controls but is limited by GAN inversion, whereas diffusion models offer stronger image realization without an explicit factorized control basis. We introduce GeoNaviDiff, an unsupervised cross-space framework that transfers disentangled StyleSpace interventions to local Riemannian trajectories in diffusion -space. GeoNaviDiff constructs reconstruction-decoupled supervision by extracting a spherical Log-map tangent from a matched StyleGAN reconstruction-edit pair and parallel-transporting it to the real-image diffusion state. A shared, factor-conditioned Navigator predicts this tangent at inference, while norm-preserving geodesic realization and source-anchored rollout stabilize the reverse process without edited references or factor-specific models. Experiments across multiple datasets show that GeoNaviDiff outperforms the compared methods in fidelity, factor selectivity, edit locality, and trajectory smoothness.
Introduction
Disentangled Representation Learning (DRL) [1] seeks to factorize complex observations into semantically meaningful variables, providing a foundation for interpretable and controllable generation. For representation manipulation, its value lies in selective intervention: a target factor, such as shape, color, or expression, should change while identity, structure, and other non-target factors remain stable. This factor-specific controllability is essential for fine-grained editing, yet it depends on both an interpretable representation and a generative model capable of faithfully realizing the prescribed change.
Early DRL-based manipulation methods primarily relied on the structured latent spaces of Variational Autoencoders (VAEs) and Generative Adversarial Networks (GANs) [8, 14]. In particular, StyleGAN exposes increasingly fine-grained semantic controls through its latent hierarchy, with channel-level coordinates in StyleSpace supporting localized and interpretable interventions [15] (Wu, Lischinski, and Shechtman 2021). However, GAN-based real-image manipulation remains constrained by inversion fidelity and the fixed generator prior [27, 2, 19]. Diffusion models offer a stronger generative prior and high-quality image reconstruction, but their internal representations do not explicitly expose a factor-indexed semantic basis. This creates a fundamental tension: structured GAN representations provide factor-specific semantic controls, whereas diffusion priors favor high-fidelity reconstruction and synthesis.
To exploit the diffusion prior despite this missing factorized control space, existing conditional diffusion manipulation methods introduce semantic controls externally through text, attribute labels, or auxiliary guidance. Their controllable granularity, however, remains tied to predefined conditions and may cause unintended changes when those conditions are coarse or misaligned [20, 26] (Hu et al. 2023). An intrinsic alternative is to manipulate the U-Net bottleneck feature space, known as -space, which encodes rich high-level semantics without such external controls [18, 11]. Yet -space does not expose these semantics as explicit, reusable control coordinates. Therefore, prior work trains a separate shift predictor for each prescribed semantic attribute and injects its output as an additive Euclidean residual [18]. This direction-specific design prevents reuse across factors and ignores the geometry and feature statistics of -space. As illustrated in Figure 1, its straight ambient path departs from the spherical shell of normalized bottleneck states and changes the bottleneck norm, disrupting its correlation with skip-feature statistics and producing visible artifacts [11]. Remaining on the hyperspherical shell alone is insufficient: an arbitrary geodesic may be geometrically valid while reaching a semantically incorrect endpoint. Therefore, stable disentangled manipulation requires a local tangent direction conditioned on an explicit semantic factor and adapted to the source image and diffusion timestep.

Figure 1. Conceptual comparison of Euclidean, arbitrary geodesic, and GeoNaviDiff trajectories in diffusion -space.
Motivated by this insight, we propose GeoNaviDiff, an unsupervised DRL framework for cross-space semantic transfer via Geodesic Navigation in Diffusion -space. Rather than disentangling diffusion -space from scratch, GeoNaviDiff transfers unsupervised -space controls into it, enabling high-fidelity manipulation of individual semantic factors while preserving non-target content. A shared cross-space Navigator conditions on the -space displacement, source bottleneck state, and timestep to predict the corresponding local tangent direction in -space. Geometry-aware learning and source-anchored inference then realize this prediction as a stable manifold-preserving diffusion trajectory without requiring an edited reference or a separate Navigator for each factor at inference. Our main contributions are:
We introduce a cross-space paradigm that maps interpretable -space directions to stable semantic trajectories along the local hyperspherical geometry of diffusion -space. This paradigm decouples semantic representation from image realization, with -space defining the semantics and the diffusion prior realizing them beyond GAN reconstruction fidelity.
We develop a local Riemannian navigation mechanism with reconstruction-decoupled tangent supervision, norm-preserving geodesic realization, and source-anchored inference. This design aligns the transferred semantic direction with the real-image diffusion state while suppressing radial drift and cumulative rollout error.
We conduct extensive evaluations across multiple datasets and diverse object categories. The results demonstrate that GeoNaviDiff generalizes robustly across object categories and achieves state-of-the-art performance across all reported metrics of image fidelity, representation disentanglement, edit locality, and trajectory smoothness.
Related Work
Disentanglement in VAEs and GANs
Early disentangled representation learning primarily relied on variational autoencoders (VAEs), which separate generative factors by regularizing the latent distribution or encouraging factorized representations [3, 16, 22]. GAN-based approaches subsequently showed that interpretable semantic directions can be identified in pretrained generators through principal components, closed-form factorization, or unsupervised direction discovery [8, 23, 28]. Moving beyond the dense directions of and , StyleSpace Analysis exposed the channel-wise modulation coefficients of StyleGAN and showed that selected coordinates provide localized controls with stronger disentanglement and completeness under its evaluation protocols [15] (Wu, Lischinski, and Shechtman 2021). Fantastic Style Channels further selects representative and diverse channel directions from their generated image changes without using attribute labels [24]. These advances provide fine-grained semantic controls, but realizing them on real images remains constrained by GAN inversion and the fixed generator prior [31, 27].
Disentanglement–Fidelity Trade-off
The tension between semantic editability and image fidelity is particularly evident in real-image manipulation. In StyleGAN, latent codes that remain close to the native distribution are generally more editable, whereas representations with greater freedom can reconstruct finer details at the cost of less stable manipulation; e4e, CLCAE, and SFE address different aspects of this trade-off through editability-aware inversion, cross-space guidance, or feature editing [27, 19, 2]. Diffusion-based DRL methods approach the complementary side of the problem by learning factorized representations while retaining the generative capacity of diffusion models: InfoDiffusion maximizes information in an auxiliary semantic latent variable, DisDiff learns factor-conditioned representations without supervision, and EncDiff uses cross-attention as an inductive bias for factor separation [29, 33, 32]. These methods require training or modifying the diffusion model to learn a disentangled representation, rather than reusing an established semantic basis with a frozen denoiser. Inspired by these complementary advances, GeoNaviDiff uses -space to provide factor-specific semantic controls and the high-dimensional -space of a pretrained U-Net denoiser as the realization space for their semantic shifts. This cross-space formulation combines the disentanglement of with diffusion reconstruction fidelity without explicit conditioning or predefined -space directions.
Semantic Manipulation in Diffusion Models
Diffusion models can be controlled through text, attribute labels, or auxiliary guidance, but the resulting editing granularity remains tied to the conditioning interface and may cause unintended changes when the condition is coarse or misaligned [20, 26] (Hu et al. 2023). Intrinsic feature manipulation provides an alternative: Asyrp identifies the U-Net bottleneck -space as semantically editable and learns a direction-specific predictor whose output is injected as an additive Euclidean residual [18], while subsequent work discovers semantic directions across diffusion timesteps without attribute supervision [21]. InjectFusion further demonstrates that direct replacement or addition can disrupt bottleneck feature statistics, and improves content injection through norm-matched spherical interpolation and latent calibration ([11]). These approaches establish the editability of diffusion features and the importance of preserving their geometry, but do not provide a shared factor-conditioned mechanism that maps an external disentangled control to a source- and timestep-adaptive tangent trajectory. GeoNaviDiff addresses this gap by learning a shared Navigator from -space displacements to local Riemannian navigation in diffusion -space.
Background
DDIM Sampler
The Denoising Implicit Diffusion Model (DDIM) sampler ([25]) is a deterministic sampler that maintains consistency between forward and reverse process trajectories. This property enables it to map Gaussian noise back to generated images via smooth denoising trajectories:
where , is a hyperparameter that controls the stochasticity of the sampling process. In the deterministic form (e.g., ), DDIM is expected to recover the same noise across all sampling steps as in the corresponding denoising steps, thereby achieving consistent inversion of the diffusion process.
Asymmetric Reverse Process
Asymmetric Reverse Process (Asyrp) ([18]) enables image editing by injecting offset priors into the semantically editable -space during the denoising process. Let be the original latent matrix corresponding to timestep . From the unconditional form of Eq. (1):
Asyrp uses a simulated diffusion process via DDIM inversion to obtain the semantically manipulated and defines the following three-stage editing process. For compactness, let , , and denote the three timestep intervals by , , and :
The editing process is performed within the interval . It injects the modified only into to prevent the injected semantics from being canceled out by .
Methodology
Overview
As shown in Figure 2, GeoNaviDiff transfers unsupervised, factor-specific -space controls into diffusion -space to enable high-fidelity, disentangled manipulation of real images. Given a source image and an intervention , the StyleGAN branch constructs a matched reconstruction–edited reference pair, and a frozen U-Net extracts bottleneck states for the source and both references under shared noising. The Riemannian displacement between the reference states defines a semantic tangent, which is parallel-transported to the real-image source state to form the Navigator target. The Navigator predicts this target from ; norm-preserving geodesic realization and source-anchored inference then turn the prediction into a stable diffusion trajectory.
Figure 2. Training framework of GeoNaviDiff. (a) Unsupervised semantic discovery and disentangled control construction in -space, followed by cross-space navigation into diffusion -space. (b) The four-step parallel-transport procedure is used to construct the tangent navigation target.
Disentangled Semantic Basis in -space
GeoNaviDiff uses StyleGAN2’s StyleSpace as its factorized semantic basis. Given an inverted code , the layer-wise affine transforms map to , where each coordinate modulates a synthesis channel ([15] (Wu, Lischinski, and Shechtman 2021)). Selected coordinates provide localized controls; the resulting displacement both conditions the Navigator and generates the matched reconstruction–edit pair used for tangent supervision.
Since -space contains thousands of channels with redundant effects, we adopt the unsupervised Fantastic Style Channels method ([24]) to discover representative and diverse candidate directions. It evaluates axis-aligned channel perturbations through their generated image changes and groups channels with similar effects into candidate clusters. As shown in Figure 2(a), a pretrained vision-language model (VLM) filters these clusters by inspecting their traversal sequences to retain semantically meaningful directions; the same filtering can instead be performed manually. Let denote the retained Fantastic Style Channels indices and , the corresponding coordinate basis vector. During Navigator training, a sampled direction and strength specify and , where the sign and magnitude of determine the traversal direction and extent, respectively.
For a real image , a pretrained and frozen e4e inversion encoder ([27]) produces , and the fixed affine transforms above yield . The frozen StyleGAN generator then produces the matched pair and . This pair shares the same inverted code and generator pathway and differs only in the prescribed -space intervention. It therefore externalizes the factor-specific change encoded by as a matched visual reference for constructing the diffusion-space navigation target in § 4.3. In GeoNaviDiff, thus supplies both the factor-indexed control descriptor and its visual supervision.
Cross-Space Riemannian Navigation
Existing -space editors commonly inject an ambient Euclidean residual, ([18], ignoring bottleneck geometry and feature statistics:
so Euclidean injection incurs radial leakage and, even for a tangent residual satisfying , increases the squared norm by . This is consequential because bottleneck and skip-feature norms are correlated, and disrupting this relation produces visible artifacts [11]. Moreover, the linear interpolation between two distinct normalized states passes through the interior of the sphere rather than following its surface, producing an off-shell trajectory.
To the best of our knowledge, GeoNaviDiff is the first framework to perform local Riemannian navigation in diffusion -space conditioned on disentangled -space factors. It replaces this geometry-agnostic residual with cross-space navigation from -space to diffusion -space. Here, each factor is indexed by an unsupervised -space direction , and its signed magnitude is specified by . Rather than claiming that the complete -space is globally spherical, we locally model normalized bottleneck states at each timestep on the unit hypersphere . The resulting navigation target is sample-dependent and timestep-dependent, and explicitly conditioned on .
Matched semantic triple. As described in § 4.2, we construct an unedited StyleGAN reconstruction and its edited reference for each real source image . We apply the forward noising process to all three images using the same sampled timestep and noise realization :
Shared noising removes stochastic differences from the comparison. More importantly, and share the same inversion and synthesis path and differ only by ; their difference therefore isolates the prescribed semantic intervention, whereas supplies the real-image state encountered by the Navigator at deployment. With the frozen U-Net bottleneck extractor , we obtain
Together, these three bottleneck states separate the StyleGAN semantic change from the real-to-reconstruction gap before transferring it into diffusion -space.
Spherical normalization and semantic Log map.
Let . We normalize each bottleneck state as
We first measure the semantic edit entirely within the matched reconstruction domain. Define
Here is the unit direction of the shortest great-circle arc from to , and is its exact geodesic angle rather than an arbitrary Euclidean residual norm. The logarithmic map is therefore
When , we define by the continuous limit of Eq. (9); the local -space interventions considered here exclude the antipodal case. By construction, and . Thus, the direction of specifies the local semantic trajectory and its norm has the explicit meaning of geodesic arc length. This avoids the ambiguity of treating an ambient residual magnitude as semantic strength.
Parallel transport to the real-image anchor. Although isolates the edit from the reconstruction gap, it belongs to the tangent space at the reconstructed reference , while the Navigator should act at the real source point . Directly reusing at is unreasonable because . We therefore parallel-transport along the shortest geodesic from to the real-image anchor and denote the resulting tangent vector by . On the unit sphere, it has the closed form
Because the locally paired source and reconstruction states are non-antipodal, the denominator in Eq. (10) is nonzero. The transported vector satisfies and . A target defined directly at the source, , would mix the intended semantic displacement with the StyleGAN reconstruction gap: even when and , it remains nonzero because . In contrast, our target first isolates the edit as and then transports it to . Consequently, , while nonzero edits remain tangent at the real-image state and retain their semantic geodesic length.
Navigator Learning and Stable Inference
Tangent-field learning. The Cross-space Navigator learns a shared conditional mapping to the geometric target constructed above. Conditioned on the factorized -space displacement, timestep, and unedited source feature, it predicts . The Navigator learns a shared, factor-conditioned tangent field in diffusion -space without requiring an edited endpoint at inference. Whereas Asyrp learns a separate additive residual predictor for each prescribed semantic direction (Kwon, Jeong, and Uh [18]), is shared across -space factors and directly predicts the required local trajectory from . At inference, it requires neither an edited reference nor a direction-specific model.
The target is strictly tangent at , whereas the raw network output need not be. We train only while keeping the inversion encoder, StyleGAN generator, and diffusion U-Net frozen:
Sampling procedures for the semantic factor and intervention strength are detailed in Supplementary Appendix A. Because , this loss admits the orthogonal decomposition
where
Hence, the objective aligns the semantic tangent and penalizes radial leakage. At inference, we explicitly apply Eq. (13) and denote , ensuring that the final displacement remains tangent despite Navigator errors.
Geodesic realization. We realize the predicted tangent through the exponential map:
We then restore the source radius as , thereby preserving the source bottleneck scale and its correlation with the source skip-feature statistics and avoiding the norm-induced artifacts of unconstrained residual injection [11]. When , as expected for the identity edit , the normalized direction in Eq. (14) is undefined. We therefore use the continuous limit , so the bottleneck remains unchanged. For , is a unit tangent orthogonal to . Together, these cases ensure , , and . Therefore, GeoNaviDiff neither introduces radial norm drift nor follows a straight chord through the shell interior. No additional geometric scaling is introduced: specifies the requested semantic factor and strength, while adapts the corresponding tangent displacement to the source state and timestep.
Source-anchored rollout. During training, we sample timesteps independently and always condition on an unedited source feature. During a reverse process, however, recursively querying with the edited feature would expose it to unseen states. Earlier prediction errors would alter subsequent queries, and repeated residuals would cause semantic, identity, and structural drift, as verified by the ablation in Sec. 5.4. To remove this train–inference mismatch, GeoNaviDiff uses a source-anchored rollout (Alg. 1, Appendix B). After DDIM inversion, we evolve an unedited source trajectory in parallel with the edited trajectory . At each step, the source branch extracts and normalizes it as . It then queries and constructs the absolute endpoint
| Method | FFHQ | AFHQ-v2 | Stanford Cars | |||||||||
| FID↓ | PPL↓ | OFlow↓ | DCI↑ | FID↓ | PPL↓ | OFlow↓ | DCI↑ | FID↓ | PPL↓ | OFlow↓ | DCI↑ | |
| -TCVAE (Chen et al. [4]) | ||||||||||||
| FactorVAE (Kim and Mnih [16]) | ||||||||||||
| e4e (Tov et al. [27]) | ||||||||||||
| SFE (Bobkov et al. [2]) | ||||||||||||
| NaviGAN (Cherepkov, Voynov, and Babenko [5]) | ||||||||||||
| Asyrp† (Kwon, Jeong, and Uh [18]) | – | – | – | – | – | – | ||||||
| EncDiff (Yang et al. [32]) | ||||||||||||
| InfoDiffusion (Wang et al. [29]) | ||||||||||||
| PreciseControl (Parihar et al. [20]) | ||||||||||||
| DisDiff (Yang et al. [33]) | ||||||||||||
| GeoNaviDiff (Ours) |
Table 1. Comparison with existing methods across VAE-, GAN-, and diffusion-based generative models. † denotes our baseline, bold indicates the best result, and “–” denotes not measured. Asyrp lacks fixed latent codes for PPL and DCI.
We inject the source-anchored endpoint into the decoder processing and apply InjectFusion’s latent calibration (Jeong, Kwon, and Uh [11]) to preserve bottleneck–state compatibility, yielding . This update avoids recursive residual accumulation on edited features, limiting train–inference mismatch and cumulative navigation error.
Experiments
Experimental Setup
Datasets. We evaluate GeoNaviDiff on FFHQ (Karras, Laine, and Aila [14]), CelebA-HQ (Karras et al. [13]),
AFHQ-v2 (Choi et al. [6]), and Stanford Cars (Krause et al. [17]), spanning human faces, animal faces, and vehicles. Details on preprocessing, data splits, hardware, and computational cost are provided in Supplementary Appendix G.
Metrics. For all four datasets, we report FID (Heusel et al. [9]) for distributional fidelity, Perceptual Path Length (PPL) (Karras, Laine, and Aila [14]) for perceptual smoothness along semantic traversals, OFlow (Jin et al. [12]) for spatial editing leakage, and the disentanglement component of DCI (Eastwood and Williams [7]) to measure how selectively individual representation dimensions encode semantic factors. The PPL computation protocol and dataset-specific DCI factor definitions are provided in Supplementary Appendix A. Lower FID, PPL, and OFlow are better, whereas higher DCI is better.
Comparison with Existing Methods
Table 1 compares GeoNaviDiff with representative VAE-, GAN-, and diffusion-based methods, and Figure 3 provides a visual comparison on smile manipulation. GeoNaviDiff achieves the best results on all reported metrics across the evaluated datasets: lower FID and PPL indicate better image fidelity and smoother semantic traversals, while lower OFlow and higher DCI show reduced non-target leakage and stronger factor-wise disentanglement. The visual comparison is consistent with these trends, where GeoNaviDiff produces more monotonic semantic changes while better preserving identity and unrelated facial attributes. These improvements support our central design: supplies factor-selective semantic controls, while diffusion -space provides the high-fidelity realization space; Riemannian navigation and source-anchored inference further reduce feature-geometry mismatch and accumulated non-target drift. More qualitative comparisons are provided in Supplementary Appendix E.

Figure 3. Qualitative comparison on smile manipulation across traversal levels.
Qualitative results and Source-Space Analysis
Figure 4 shows GeoNaviDiff traversals across FFHQ, CelebA-HQ, AFHQ-v2, and Stanford Cars, covering both localized and globally coordinated semantic factors. Across traversal levels, GeoNaviDiff produces smooth semantic changes while preserving identity, structure, and unrelated content, indicating that the controls discovered in remain interpretable after being transferred to diffusion -space. Additional GeoNaviDiff traversals across datasets and semantic factors are provided in Supplementary Appendix F. A quantitative comparison of semantic source spaces and transformation strategies is provided in Supplementary Appendix C.
Figure 4. Qualitative traversals of GeoNaviDiff across datasets and semantic factors.
Ablation Study
Figure 5 presents a stepwise ablation using matched source images and semantic strengths. All GeoNaviDiff variants share the same Navigator architecture and inference settings. Starting from Asyrp’s direction-specific Euclidean residual, the variants successively introduce the -conditioned Navigator, Riemannian realization, and source-anchored rollout. The progression shows that the Navigator improves target-attribute consistency, Riemannian realization better preserves identity and non-target appearance, and source anchoring yields the most stable trajectories at stronger edits by suppressing cumulative drift. The corresponding quantitative ablation results are reported in Supplementary Appendix D.
Figure 5. Stepwise ablation of cross-space navigation, Riemannian realization, and source-anchored rollout.
Conclusion
We presented GeoNaviDiff, an unsupervised cross-space framework that maps interpretable -space directions to local Riemannian trajectories in diffusion -space, decoupling semantic representation from image realization. Across multiple datasets, GeoNaviDiff improves representation disentanglement, image fidelity, and trajectory smoothness while preserving non-target content, supporting semantic-basis transfer as an alternative to disentangling diffusion features from scratch.
References
- [1]Bengio, Y.; Courville, A.; and Vincent, P. 2013. Representation learning: A review and new perspectives. IEEE transactions on pattern analysis and machine intelligence, 35(8): 1798–1828.
- [2]Bobkov, D.; Titov, V.; Alanov, A.; and Vetrov, D. 2024. The Devil is in the Details: StyleFeatureEditor for Detail-Rich StyleGAN Inversion and High Quality Image Editing. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.arxiv.org/abs/2406.10601
- [3]Burgess, C. P.; Higgins, I.; Pal, A.; Matthey, L.; and Watters, N. 2018. Understanding disentangling in β-VAE. arXiv preprint.DOI
- [4]Chen, T. Q.; Li, X.; Grosse, R. B.; and Duvenaud, D. 2018. Unsupervised Sources of Disentanglement in Variational Autoencoders. In Advances in Neural Information Processing Systems, volume 31, 2615–2625.
- [6]Choi, Y.; Uh, Y.; Yoo, J.; and Ha, J.-W. 2020. StarGAN v2: Diverse Image Synthesis for Multiple Domains. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 8188–8197.arxiv.org/abs/1912.01865
- [7]Eastwood, C.; and Williams, C. K. 2018. A framework for the quantitative evaluation of disentangled representations. In International conference on learning representations.
- [8]Härkönen, E.; Hertzmann, A.; Lehtinen, J.; and Paris, S. 2020. GANSpace: Discovering interpretable GAN controls. In Larochelle, H., ed., Advances in neural information processing systems, volume 33, 9841–9850. Curran Associates, Inc.arxiv.org/abs/2004.02546
- [9]Heusel, M.; Ramsauer, H.; Unterthiner, T.; Nessler, B.; and Hochreiter, S. 2017. Gans trained by a two time-scale update rule converge to a local nash equilibrium. In Advances in neural information processing systems, 6626–6637.
- [11]Jeong, J.; Kwon, M.; and Uh, Y. 2024. Training-Free Content Injection Using H-Space in Diffusion Models. In Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision, 5151–5161.arxiv.org/abs/2303.15403
- [12]Jin, X.; Li, B.; Xie, B.; Zhang, W.; Liu, J.; Li, Z.; Yang, T.; and Zeng, W. 2024. Closed-Loop Unsupervised Representation Disentanglement with β-VAE Distillation and Diffusion Probabilistic Feedback. In European Conference on Computer Vision.DOI
- [13]Karras, T.; Aila, T.; Laine, S.; and Lehtinen, J. 2017. Progressive Growing of GANs for Improved Quality, Stability, and Variation. arXiv preprint arXiv:1710.10196.arxiv.org/abs/1710.10196
- [14]Karras, T.; Laine, S.; and Aila, T. 2019. A style-based generator architecture for generative adversarial networks. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 4401–4410.DOI
- [15]Karras, T.; Laine, S.; Aittala, M.; Hellsten, J.; and Lehtinen, J. 2020. Analyzing and improving the image quality of stylegan. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 8110–8119.arxiv.org/abs/1912.04958
- [16]Kim, H.; and Mnih, A. 2018. Disentangling by Factorising. In Proceedings of the 35th International Conference on Machine Learning, Proceedings of Machine Learning Research, 2654–2663. PMLR.
- [17]Krause, J.; Stark, M.; Deng, J.; and Fei-Fei, L. 2013. 3D Object Representations for Fine-Grained Categorization. In Proceedings of the IEEE International Conference on Computer Vision Workshops, 554–561.DOI
- [18]Kwon, M.; Jeong, J.; and Uh, Y. 2022. Diffusion Models already have a Semantic Latent Space. https://arxiv.org/abs/2210.10960v2.
- [19]Liu, H.; Song, Y.; and Chen, Q. 2023. Delving StyleGAN Inversion for Image Editing: A Foundation Latent Space Viewpoint. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.arxiv.org/abs/2211.11448
- [20]Parihar, R.; Sachidanand, V. S.; Mani, S.; Karmali, T.; and Venkatesh Babu, R. 2024. PreciseControl: Enhancing Text-to-Image Diffusion Models withnbsp;Fine-Grained Attribute Control. In Computer Vision – ECCV 2024: 18th European Conference, Milan, Italy, September 29–October 4, 2024, Proceedings, Part LXXXIII, 469–487. Berlin, Heidelberg: Springer-Verlag. ISBN 978-3-031-73006-1.arxiv.org/abs/2408.05083
- [21]Park, Y.-H.; Kwon, M.; Jo, J.; and Uh, Y. 2023. Unsupervised Discovery of Semantic Latent Directions in Diffusion Models. arXiv preprint, (arXiv:2302.12469).arxiv.org/abs/2302.12469
- [22]Rolinek, M.; Zietlow, D.; and Martius, G. 2019. Variational autoencoders pursue pca directions (by accident). In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 12406–12415.arxiv.org/abs/1812.06775
- [23]Shen, Y.; and Zhou, B. 2021. Closed-form factorization of latent semantics in gans. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 1532–1540.arxiv.org/abs/2007.06600
- [24]Simsar, E.; Kocasari, U.; Er, E. G.; and Yanardag, P. 2023. Fantastic Style Channels and Where To Find Them: A Sub-modular Framework for Discovering Diverse Directions in GANs. In Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision, 4731–4740.arxiv.org/abs/2203.08516
- [25]Song, J.; Meng, C.; and Ermon, S. 2020. Denoising Diffusion Implicit Models. In International Conference on Learning Representations, 1–12.arxiv.org/abs/2010.02502
- [26]Sun, T.; Jiang, Y.; Jin, Y.; Guo, H.; and Zhang, Z. 2026. Context-preserving dermoscopic editing: Mask-guided lesion-aware diffusion for attribute modification. In Proceedings of the IEEE/CVF winter conference on applications of computer vision, 5364–5373.DOI
- [27]Tov, O.; Alaluf, Y.; Nitzan, Y.; Patashnik, O.; and Cohen-Or, D. 2021. Designing an Encoder for StyleGAN Image Manipulation. ACM Transactions on Graphics, 40(4).
- [28]Voynov, A.; and Babenko, A. 2020. Unsupervised discovery of interpretable directions in the gan latent space. In International conference on machine learning, 9786–9796. PMLR.
- [29]Wang, Y.; Schiff, Y.; Gokaslan, A.; Pan, W.; Wang, F.; De Sa, C.; and Kuleshov, V. 2023. InfoDiffusion: Representation Learning Using Information Maximizing Diffusion Models. In Proceedings of the 40th International Conference on Machine Learning, volume 202 of Proceedings of Machine Learning Research, 36336–36354. PMLR.arxiv.org/abs/2306.08757
- [31]Xia, W.; Zhang, Y.; Yang, Y.; Xue, J.-H.; and Zhou, B. 2023. GAN Inversion: A Survey. IEEE Transactions on Pattern Analysis and Machine Intelligence, 45(3): 3121–3138.DOI
- [32]Yang, T.; Lan, C.; Lu, Y.; and Zheng, N. 2024. Diffusion Model with Cross Attention as an Inductive Bias for Disentanglement. In Advances in Neural Information Processing Systems, volume 37, 82465–82492.arxiv.org/abs/2402.09712
- [33]Yang, T.; Wang, Y.; Lu, Y.; and Zheng, N. 2023. DisDiff: Unsupervised disentanglement of diffusion probabilistic models. In Oh, A., ed., Advances in neural information processing systems, volume 36, 69130–69156. Curran Associates, Inc.arxiv.org/abs/2301.13721


