betaFeedback

WorksComputer Science

NitroFusion2: Bringing Adversarial Loss to the Text Stream of Multimodal Diffusion Transformers

Abstract

Adversarial diffusion distillation has conventionally relied on image features for discrimination. We revisit this choice for multimodal diffusion transformers (MMDiTs), whose text stream becomes image-dependent through joint attention. We introduce Text-Stream Adversarial Distillation (TSAD), which exploits intermediate text-token states as a new adversarial representation. Because the text stream has already read the image while remaining tied to the text condition, changing that condition changes what information it extracts from the image. Building on this property, we introduce Aspect-Cued Discrimination (ACD), which conditions the discriminator on different aspects of the sample, such as typography, objects, or style, to steer which properties are emphasized during adversarial training. Building on the expert-discriminator design of NitroFusion, we integrate TSAD and ACD in NitroFusion2. NitroFusion2 brings few-step distillation from the conventional 4-8-step regime down to just 1-2 steps at comparable quality. At one step, it produces sharp rendered text and rich fine-grained details, making one-step generation practical rather than merely a stress test for distillation. At two steps, it remains competitive across the evaluated benchmarks. These results establish the MMDiT text stream as a powerful and steerable representation for adversarial diffusion distillation.

Two-step samples from NitroFusion2

Figure 1. Two-step samples from NitroFusion2. Best viewed with zoom.

Introduction

Adversarial diffusion distillation is an effective approach to few-step generation [75]: discriminator heads distinguish reference samples from student samples using intermediate features of a pretrained backbone, and the student is trained to fool them [6, 32, 58, 59]. The backbone may be an external encoder or the diffusion model itself. Nearly every part of that recipe has been revisited, from the objectives [74, 75] and training strategies [8, 53] to the discriminator design [6, 33, 58], except one: what the discriminator heads read. They read image features. We revisit this choice for multimodal diffusion transformers (MMDiTs).

This choice was natural for earlier diffusion architectures. In a cross-attention UNet [2, 49, 54, 55], the text embeddings used for conditioning remain image-independent throughout the denoising network. The architecture therefore does not maintain text-token hidden states that depend on the sample being processed. MMDiTs [9] change this premise. Through joint attention, intermediate text-token states repeatedly interact with image tokens and become dependent on the particular sample being processed [1, 11, 64]. The MMDiT text stream therefore exposes a representation that conventional adversarial distillation has largely left unused.

We exploit this representation with Text-Stream Adversarial Distillation (TSAD), which attaches lightweight discriminator heads to intermediate text-token states of the discriminator backbone. These heads operate on text-token representations that have already interacted with the image. This turns the text stream itself into a discriminator representation.

In joint attention, text tokens query image features, and what they gather is written back into their own states [11, 30, 64], so changing the text condition changes what the text stream extracts from the image. If the reference faithfully presents a queried property, such as clear rendered text, the correct object colour, or a particular visual style, the student must reproduce it well enough to fool the discriminator under the same emphasis. Building on this property, we introduce Aspect-Cued Discrimination (ACD). For each reference image, we construct an image-grounded structured caption with six fields: typography, object, style, background, action, and layout. At each training step, the discriminator is conditioned on either one valid aspect field or the full structured caption, while the student keeps its original prompt. The cue therefore steers what the text stream queries from the image and which aspects are emphasized by the adversarial signal.

Building on the expert-discriminator design of NitroFusion [6], we introduce NitroFusion2, distilled from Z-Image-Turbo [77], extending adversarial discrimination to the MMDiT text stream through TSAD and ACD.

Controlled ablations test these two design choices. Text-stream discrimination outperforms conventional image-stream discrimination across all evaluated benchmarks, while combining the two streams performs best on most metrics. Aspect cues further turn the discriminator into an expert on the selected aspect, improving performance on that property. Together, these designs enable a substantial leap in one-step generation. At two steps, NitroFusion2 is competitive with alternatives [37] that use separate parameter sets for their two-step trajectories.

In summary, our contributions are:

  • We identify the text stream of MMDiTs as a discriminative representation for adversarial diffusion distillation and introduce Text-Stream Adversarial Distillation, which applies discriminator heads to intermediate text-token states.

  • We introduce Aspect-Cued Discrimination, which uses the discriminator’s text conditioning to steer which properties are emphasized by the text stream.

  • We show that text-stream discrimination outperforms conventional image-stream discrimination across all evaluated benchmarks, and that aspect cues yield aspect-specific gains. Together, these advances bring few-step distillation from the conventional 4–8-step regime down to 1–2 steps at comparable quality.

If this paper has one message, it is this: in an MMDiT, the text stream is no longer only conditioning. Once it reads the image, it becomes a discriminative representation, opening a new direction for adversarial diffusion distillation and allowing that discrimination to be steered toward specific aspects.

Related Work

Few-Step Diffusion Models. Reducing diffusion sampling to a few network evaluations has motivated a large body of distillation work. Progressive Distillation [56] pioneered a curriculum that halves the step count iteratively, later generalised to multistep targets [16]. Consistency models [61] and their variants [7, 24, 41, 42, 53, 60, 65] enforce self-consistency along the sampling trajectory, mapping any point on it directly to the endpoint. Distribution Matching Distillation (DMD) [43, 75, 76] minimises a divergence between student and teacher outputs, and has since been extended in several directions [3, 10, 20, 25, 29, 38, 40, 66, 68, 69, 74]. MeanFlow [12, 13] learns the average velocity across an interval. Self-adversarial fine-tuning has the model supply its own adversarial target [8, 36]. Despite this progress, one- and two-step generation remains challenging [8, 37].

Adversarial Diffusion Distillation. Adversarial objectives recover fidelity lost at low step counts. ADD [59] attaches lightweight discriminator heads to a frozen DINOv2 encoder [47] in pixel space. LADD [58] moves discrimination into latent space, applying heads to the token sequence the teacher diffusion model emits after each attention block. NitroFusion [6] organises the critic as an ensemble of specialised expert heads in place of a single scorer. Subsequent methods develop these designs across backbones and head architectures [3, 6, 7, 22, 32, 33, 66, 73, 75], and several train the critic on teacher generations in place of real images [3, 6, 22, 32, 37, 58]. Text-conditioned discrimination was developed earlier in text-to-image GANs [28, 45, 52, 57, 63, 72, 78]. GigaGAN [21] brings it to large-scale models, conditioning its discriminator on a pooled global descriptor while its generator uses word-level cross-attention. Across these designs the text conditions the judgement while the features the discriminator reads come from the image.

Text-Image Representations in Diffusion Models. Diffusion models develop rich text-image correspondences. In cross-attention UNets, word-level attention maps support attribution [35, 62], editing [18, 48], inference-time correction [5, 51], and segmentation [46, 70], while the text representation itself does not vary with the image. Joint attention in multimodal diffusion transformers [9] changes this. ConceptAttention [17] localizes concepts in attention outputs, while recent analyses show that text-stream positions absorb image content [30, 64], including in image-conditioned in-context generation [11], causally steer outputs [27], and support concept prediction from partially denoised states [1]. These representations have been used for analysis and inference-time control, attention-map supervision [23], and preference rewards [39], but not directly as the feature space for adversarial supervision.

Approach

Preliminaries: Adversarial Diffusion Distillation

A few-step student Gθ(xt,t,p)G_{\theta}(x_t,t,p) maps a latent xtx_t at noise level tt and original prompt pp to a clean latent. For one-step generation, x^=Gθ(z,1,p)\hat{x}=G_{\theta}(z,1,p) with z∼N(0,I)z\sim\mathcal{N}(0,I). To compare a reference sample xx and a student sample x^\hat{x} at the same noise level, we use the flow-matching interpolant [34]

xt=(1−t)x+tϵ,x^t=(1−t)x^+tϵ,ϵ∼N(0,I).(1)x_t=(1-t)x+t\epsilon,\qquad\hat{x}_t=(1-t)\hat{x}+t\epsilon,\qquad\epsilon\sim\mathcal{N}(0,I). \tag*{(1)}

We denote the resulting reference and student distributions by prealp_{\mathrm{real}} and pfakep_{\mathrm{fake}}.

Following adversarial diffusion distillation [58, 59], we reuse a pretrained text-conditioned diffusion model as a frozen discriminator backbone and attach lightweight trainable heads to its intermediate states. Writing DD for the composition of the frozen backbone with a trainable head, the adversarial objective separates reference from student samples,

LGAN=Ext∼preal[log⁡D(xt)]+Ex^t∼pfake[log⁡(1−D(x^t))],(2)\mathcal{L}_{\mathrm{GAN}}=\mathbb{E}_{x_t\sim p_{\mathrm{real}}}[\log D(x_t)]+\mathbb{E}_{\hat{x}_t\sim p_{\mathrm{fake}}}[\log(1-D(\hat{x}_t))], \tag*{(2)}

and the student is trained to raise the value DD assigns to its own samples.

Text-Stream Adversarial Distillation

We refer to the evolving image-token and text-token hidden states in an MMDiT as the image and text streams. Existing adversarial distillation reads representations from the image stream [3, 6, 33, 58, 75]. Text-Stream Adversarial Distillation (TSAD) instead extends adversarial discrimination to the text-stream attention outputs.

In a cross-attention UNet [54], the text representation E(p)E(p) is computed independently of the image and supplied to the image network as keys and values. Although the resulting cross-attention weights depend on image features, the text representation itself remains fixed, with ∂E(p)/∂x^t=0\partial E(p)/\partial\hat{x}_t = 0. A discriminator attached directly to these text states therefore cannot provide an adversarial gradient to the student.

In an MMDiT [9], text and image tokens instead interact through joint attention, whether the two streams carry separate weights or share them as in Z-Image [77]. Consider one layer with incoming text states HT∈Rm×dH_T \in\mathbb{R}^{m \times d}. Let QT=HTWQQ_T = H_T W_Q denote the text queries, and let K=[KI;KT]K = [K_I; K_T] and V=[VI;VT]V = [V_I; V_T] collect the image and text keys and values. The text-query attention weights are

A=softmax⁡(QTK⊤d),A=[AI AT].(3)A = \operatorname{softmax}\left(\frac{Q_T K^\top}{\sqrt{d}}\right), \qquad A = [A_I\ A_T]. \tag*{(3)}

The corresponding attention output is UT=AIVI+ATVTU_T = A_I V_I + A_T V_T, and UIU_I denotes the image-stream attention output of the same block, followed by HT′=ψ(HT+UTWO)H'_T = \psi(H_T + U_T W_O), where ψ\psi denotes the remaining token-wise operations of the block.

The image contribution AIVIA_I V_I makes the text attention output directly dependent on image features [30, 64]. Intuitively, each text token acts as a query into the image: it selects image information through AIA_I, which contributes directly to its attention output. This gives sample-dependent text representations whose positions remain associated with the conditioning text [1]. Where image tokens describe local appearance at fixed spatial positions, the text stream summarizes the sample along the axes the prompt names, so the adversarial signal is organized by those axes rather than by local texture alone. TSAD attaches discriminator heads directly to these attention outputs; image-to-text attention maps AIA_I serve for visualization and for the layer selection in Section A.2.

Equation (3) establishes the property required for discrimination, namely that the text attention outputs depend on the image. § 4 tests whether they suffice as an adversarial signal.

As illustrated in Figure 2, we attach lightweight discriminator heads [33] to text-stream attention outputs at selected layers of the frozen MMDiT backbone, with image-stream heads attached to the corresponding image attention outputs. We denote their logits by ℓqt/ext(xt)\ell^{\mathrm{t}/\mathrm{ext}}_q(x_t) and ℓqimg(xt)\ell^{\mathrm{img}}_q(x_t), where qq is the text conditioning supplied to the discriminator backbone. Both sets of heads read attention outputs from the same backbone pass and provide adversarial signals to the student.

Figure 2. Architecture of Text-Stream Adversarial Distillation (TSAD) and Aspect-Cued Discrimination (ACD). TSAD adds discriminator heads to intermediate text-token states alongside conventional image-stream heads. ACD builds image-grounded aspect fields, then samples one cue per training step. The cue conditions the MMDiT discriminator backbone and selects the corresponding text-stream head, steering discrimination toward that aspect.

Aspect-Cued Discrimination

Because the discriminator reuses a text-conditioned diffusion backbone, its conditioning prompt can be chosen independently of the original prompt pp used by the student. We exploit this flexibility with Aspect-Cued Discrimination (ACD), which conditions the discriminator on one structured aspect of the sample at a time. Because the backbone is frozen and the cue enters only as its text input, each cue turns the same network into a different critic at no additional cost: rather than using a separate discriminator per property, we re-query one shared backbone for the property we want to emphasize.

For each reference image, we construct six image-grounded aspect fields indexed by

A={typography,object,style,background,action,layout}.\mathcal{A} = \{\text{typography},\text{object},\text{style},\text{background},\text{action},\text{layout}\}.

We denote the text associated with aspect kk by aka_k. Their combination forms the full structured caption cfullc_{\mathrm{full}}. Fields whose content is absent from the image are left empty. The valid cue categories for a sample are

K(a)={full}∪{k∈A:ak≠∅}.\mathcal{K}(a) = \{\text{full}\} \cup\{k \in\mathcal{A}: a_k \ne\varnothing\}.

At each training step, we sample k∼Uniform⁡(K(a))k \sim\operatorname{Uniform}(\mathcal{K}(a)). The discriminator cue qq is cfullc_{\mathrm{full}} when k=fullk = \text{full} and aka_k otherwise. The student remains conditioned on the original prompt pp, while the frozen discriminator backbone is conditioned on qq. The same cue is used for the corresponding reference and student samples. Following the expert-head design of NitroFusion [6], the text-stream discriminator uses heads specific to cue categories. A typography cue is scored by typography heads, an object cue by object heads, and likewise for the remaining aspects and the full caption. The image-stream heads remain shared across cues, while their input states still depend on qq through the conditioned MMDiT backbone.

The sampled cue therefore affects text-stream discrimination in two coupled ways. It changes the text queries and hence the image information written into the text-token states, and it selects the corresponding aspect-specific text-stream heads. A typography cue, for example, conditions the backbone on the rendered-text description and routes the resulting states to the typography heads, while an object cue uses the object description and object heads.

Figure 3 qualitatively illustrates this cue-dependent attention. With the same image fixed, different aspect cues produce different image-to-text attention patterns; for example, the typography and object cues emphasize different regions associated with rendered text and foreground objects, the background cue shifts attention away from the foreground toward the surrounding scene, and the full caption spreads attention more broadly across the image. These patterns are consistent with ACD steering image-to-text attention through the discriminator cue. ACD requires no additional backbone evaluation and only selects the corresponding lightweight text-stream heads.

Qualitative cue-dependent image-to-text attention maps

Figure 3. Qualitative cue-dependent image-to-text attention maps.

Dataset Construction

We construct a synthetic dataset of 100k reference images [3, 6, 22, 32, 37, 58] using Z-Image-Turbo [77] with twelve sampling steps, split evenly between English and Chinese prompts. Images are generated at a fixed budget of roughly 1024×10241024 \times1024 pixels across a range of aspect ratios. We denote the original prompt by pp. For each reference image, the multimodal model Qwen3.5-35B-A3B [50] receives only the image and generates six image-grounded fields describing typography, object, style, background, action, and layout. These fields are combined to form the full structured caption cfullc_{\mathrm{full}}.

A field is left empty when the corresponding content is absent from the image. For example, the typography field is populated only when visible text is present. We additionally verify that the resulting structured caption is consistent with the original prompt pp. During training, the student remains conditioned on pp, while the discriminator cue is sampled uniformly from cfullc_{\mathrm{full}} and the available non-empty aspect fields. The cue categories are listed in Section A.1.

Training Objective

We alternate between updating the discriminator heads and the student while keeping the discriminator backbone frozen. For each stream s∈{text,img}s \in\{\text{text},\text{img}\} we use a hinge loss [31] for adversarial training,

LDs=12Eq[Ext∼prealmax⁡(0,1−ℓqs(xt))+Ex^t∼pfakemax⁡(0,1+ℓqs(x^t))](4)\mathcal{L}_{D}^{s} = \frac{1}{2}\mathbb{E}_{q}\left[\mathbb{E}_{x_t\sim p_{\mathrm{real}}}\max\left(0,1-\ell_{q}^{s}(x_t)\right) + \mathbb{E}_{\hat{x}_t\sim p_{\mathrm{fake}}}\max\left(0,1+\ell_{q}^{s}(\hat{x}_t)\right)\right] \tag*{(4)}

where qq is sampled according to the ACD procedure in § 3.3.

The student is trained to increase the discriminator logits assigned to its own samples. The text-stream and image-stream adversarial losses are

Ltext−adv=−EqEx^t∼pfake[ℓqtext(x^t)],\mathcal{L}_{\mathrm{text-adv}} = -\mathbb{E}_{q}\mathbb{E}_{\hat{x}_t\sim p_{\mathrm{fake}}}\left[\ell_{q}^{\mathrm{text}}(\hat{x}_t)\right],
Limg−adv=−EqEx^t∼pfake[ℓqimg(x^t)].(5)\mathcal{L}_{\mathrm{img-adv}} = -\mathbb{E}_{q}\mathbb{E}_{\hat{x}_t\sim p_{\mathrm{fake}}}\left[\ell_{q}^{\mathrm{img}}(\hat{x}_t)\right]. \tag*{(5)}

At low noise levels the student is additionally regressed toward the reference sample,

Lfm=Et≤tfm[w(t)∥Gθ(xt,t,p)−x∥22](6)\mathcal{L}_{\mathrm{fm}} = \mathbb{E}_{t\leq t_{\mathrm{fm}}}\left[w(t)\left\|G_{\theta}(x_t,t,p)-x\right\|_{2}^{2}\right] \tag*{(6)}

where tfmt_{\mathrm{fm}} specifies the regression range and w(t)w(t) weights the corresponding noise levels. The student objective combines the three terms,

LG=(1−λimg)Ltext−adv+λimgLimg−adv+λfmLfm,(7)\mathcal{L}_{\mathrm{G}} = (1-\lambda_{\mathrm{img}})\mathcal{L}_{\mathrm{text-adv}} + \lambda_{\mathrm{img}}\mathcal{L}_{\mathrm{img-adv}} + \lambda_{\mathrm{fm}}\mathcal{L}_{\mathrm{fm}}, \tag*{(7)}

where λimg\lambda_{\mathrm{img}} controls the balance between text-stream and image-stream adversarial discrimination. We use λimg=0.1\lambda_{\mathrm{img}} = 0.1, λfm=0.1\lambda_{\mathrm{fm}} = 0.1 and tfm=0.75t_{\mathrm{fm}} = 0.75.

Experiments

Both our student and our discriminator backbone are initialized from Z-Image-Turbo [77], and the discriminator backbone is kept frozen throughout training. We evaluate NitroFusion2 on LongText-Bench [14] in English and Chinese, OneIG-Bench [4], GenEval [15], and DPG-Bench [19]. We compare against few-step students of Z-Image: Z-Image-Turbo [77], TwinFlow [8], and Z-Image-Turbo++ [37]. Z-Image-Turbo++ uses step-decoupled weights, with a separate model for each of its two steps. Its weights are not released, so we report its published two-step metrics but cannot evaluate it at one step or include it in our qualitative comparisons. Training details are given in Section A and per-dimension benchmark breakdowns in Section B. All qualitative samples in this section are generated at 1024×10241024 \times1024.

Qualitative Results

Figure 4 compares NitroFusion2 with Z-Image-Turbo and TwinFlow at one and two sampling steps. The clearest difference is in rendered text. At one step, NitroFusion2 already produces a sharp, legible title, “The Old Man and the Sea,” while both baselines blur or distort the lettering. At two steps, NitroFusion2 also renders the much smaller author name, “Ernest Hemingway,” clearly. Because the discriminator is conditioned on the described text, the student must reproduce the glyphs it names, not merely produce sharp lettering.

Qualitative comparison of NitroFusion2, TwinFlow, and Z-Image-Turbo across text-rendering and image-generation examples

Figure 4. Qualitative comparison. NitroFusion2 preserves rendered text and fine image detail markedly better than Z-Image-Turbo and TwinFlow.

Beyond typography, NitroFusion2 already produces realistic, fine-grained details at one step, including sharp structure in hair, fur, foliage, water, and reflections. Figure 5 further shows that high-quality generation is available from the first step and remains stable as the sampling budget increases. One-step generation can still struggle with complex scenes, but these errors are progressively alleviated with more steps; in these examples the visual differences beyond eight steps are small.

Qualitative results across multiple steps

Figure 5. Qualitative results across multiple steps.

Quantitative Results

Table 1 compares few-step students of Z-Image at one and two sampling steps. At one step, NitroFusion2 leads all evaluated baselines across all five benchmarks. Compared with TwinFlow, it substantially improves LongText-EN and LongText-CN by 14.2 and 10.9 points, respectively, while also improving GenEval, DPG-Bench, and OneIG. The GenEval breakdown in Table 2 further shows that this advantage extends across compositional skills. NitroFusion2 leads five of six categories, with particularly strong results on single- and two-object generation, colors, and color attribution.

MethodParamsNFELongText-ENLongText-CNGenEvalDPG-BenchOneIG
NitroFusion2 (ours)6B143.3447.7875.8686.4847.63
Z-Image-Turbo [77]6B111.7212.7057.0877.2332.43
TwinFlow [8]6B129.1836.8566.3485.1742.20
NitroFusion2 (ours)6B276.0381.9574.4686.2151.45
Z-Image-Turbo [77]6B272.8978.4876.5385.7850.94
TwinFlow [8]6B271.9978.6572.4185.9851.38
Z-Image-Turbo++ [37]6B+6B289.8891.6275.7085.8652.50
Z-Image-Turbo [77]6B891.7492.5675.0184.8652.84

Table 1. Few-step students of Z-Image.

MethodParamsNFEOverallSingleTwoCountingColorsPositionColor attr.
NitroFusion2 (ours)6B175.86100.0096.9762.1991.2232.2572.50
Z-Image-Turbo [77]6B157.0897.8151.2655.3176.8631.7529.50
TwinFlow [8]6B166.3497.5077.0255.3182.4536.7549.00
NitroFusion2 (ours)6B274.46100.0096.4656.8890.1631.2572.00
Z-Image-Turbo [77]6B276.5399.3889.3974.3887.7750.5057.75
TwinFlow [8]6B272.4199.6987.1267.8185.1140.0054.75
Z-Image-Turbo++ [37]6B+6B275.7099.6987.6369.0684.5748.7564.50
Z-Image-Turbo [77]6B875.0199.6988.8971.8885.1145.7558.75

Table 2. Per-task breakdown on GenEval.

At two steps, NitroFusion2 remains strong overall. It leads four of six GenEval categories and outperforms TwinFlow on both LongText splits. Z-Image-Turbo++ achieves higher scores on some metrics and uses two step-specific 6B parameter sets, 12B parameters in total, whereas a single 6B NitroFusion2 model is used at any sampling step.

Most notably, NitroFusion2 leads all evaluated benchmarks at one step. At that single step it also surpasses the eight-step Z-Image-Turbo reference on DPG-Bench (86.48 against 84.86) and is on par with it on GenEval (75.86 against 75.01), at one eighth the sampling cost, while a substantial gap to that reference remains on text rendering. One step is also where the adversarial signal matters most, since the student cannot revise its output over later steps and must place all structure in a single pass.

Ablation Study

We ablate the two components: first, which stream provides the adversarial representation; second, which cue conditions the shared discriminator backbone. All ablation runs are trained for 1,000 steps.

Which stream should the discriminator read? Table 3 compares image-stream, text-stream, and joint discrimination. Text-stream discrimination alone outperforms conventional image-stream discrimination on every benchmark. Combining both streams further improves four of the five metrics, including both LongText splits, DPG-Bench, and OneIG. GenEval is the exception, where the text-only model performs best.

SettingLongText-ENLongText-CNGenEvalDPG-BenchOneIG
Text22.3124.3766.7184.3938.45
Image17.8619.2666.0082.8735.79
Text + image24.4726.6364.3984.8640.02

Table 3. Which stream the heads read. Trained for 1,000 steps and evaluated at 1 NFE.

These results isolate the contribution of extending adversarial discrimination to the text stream. Text-stream supervision is stronger than image-stream supervision across all five metrics. Our approach retains both because the image-stream signal provides an additional gain on most metrics.

Which cue should condition the discriminator? We next fix the joint text- and image-stream discriminator and vary only the cue supplied to its shared backbone. Table 4 compares models trained with a single typography, style, or object cue, the full structured caption, and ACD with all cues sampled uniformly. All settings use the same training data and discriminator architecture. Where Figure 3 shows that the cue changes where the text stream reads, Table 4 asks whether that shows up in what the student learns.

CueLT-ENLT-CNOneIG-StyleGenEval-SingleDPG-EntityOneIG-Align.DPG-Global
Typography45.0653.0132.6699.3892.5278.4879.33
Style16.0919.2833.7598.4492.3676.6279.60
Object20.8225.1932.67100.0092.9479.1478.72
Full caption17.2919.5530.8899.0692.6476.9679.33
All cues24.4726.6335.7998.4493.2179.6980.85

Table 4. Which cue conditions the discriminator? Trained for 1,000 steps and evaluated at 1 NFE.

Among the single-aspect models, each cue performs best on the evaluation category associated with the aspect it names. The typography cue gives by far the strongest LongText scores, the style cue gives the strongest OneIG-Style score, and the object cue gives the strongest single-aspect results on both object-focused metrics. The full structured caption does not lead any targeted category. This targeted pattern indicates that changing the cue changes which properties receive the strongest adversarial supervision. Typography alone, for instance, exceeds the final model on LongText, because all of its adversarial supervision is spent on rendered text.

Sampling across all cues produces a broader effect. Rather than specializing in a single property, the mixed cue policy balances supervision across different aspects. It does not maximize every targeted category, but gives the strongest OneIG-Style, DPG-Entity, and both alignment scores in the table. More importantly, the full ACD mixture outperforms the full structured prompt on six of seven metrics, supporting the benefit of decomposing the prompt into specialized aspect cues rather than conditioning on the full caption alone. In particular, the two alignment metrics are highest under the mixed cue policy rather than any single-aspect specialization.

The qualitative ablations in Figure 6 illustrate the same trends. On the left, image-stream discrimination struggles with rendered text and complex structure: it duplicates “KYOTO” and introduces artifacts around the cat, while text-stream and joint discrimination produce cleaner results. On the right, the effect of different ACD cues is visible across aspects. The typography cue produces the clearest menu text, while the object cue best preserves the requested sequence of colored balloons. Sampling across all cues performs well in both cases, illustrating the broader balance of the full ACD mixture.

Two-step ablative samples

Figure 6. Two-step ablative samples. Left: image-stream, text-stream, and joint discrimination. Right: models trained with individual typography, style, or object cues compared with the full seven-cue ACD mixture.

Conclusion and Limitations

Our experiments show that MMDiT text-token states can serve as an effective adversarial representation. Text-Stream Adversarial Distillation (TSAD) exploits these states for supervision, with particularly strong gains in text rendering, while Aspect-Cued Discrimination (ACD) provides targeted control and a better overall balance than full-prompt conditioning. Together, they enable NitroFusion2 to substantially narrow the gap between one-step and multi-step generation. The text stream is useful here not only because it carries image information, but because what it carries can be redirected by the conditioning, making it a steerable representation rather than a fixed one.

Several limitations remain. Complex scenes are still challenging, particularly at one step, and sample diversity is reduced. ACD also exhibits a seesaw effect across cues, where emphasizing one aspect can improve that property while weakening others. Our layer selection is supported empirically rather than established as optimal.

These observations suggest several directions for future work. Better balancing the seesaw effect across cues may further improve ACD, while studying where and how text-stream information evolves across depth could lead to more effective discriminator designs. Which aspects make effective cues also remains an open question; the six fields used here are a design choice. More broadly, text-stream states may provide useful supervision beyond adversarial distillation, opening a wider direction for training and controlling multimodal diffusion models.

AI Use Statement

In this work, we used generative AI tools and LLMs to generate synthetic data sets, implement methods, provide feedback on research methodology and experiments, and interpret results. We also used them to draft and edit parts of this paper and to create and modify its figures. We did not use them to propose or refine the hypotheses of this work or to develop its conceptual framework. We have reviewed all AI-assisted work: every reported number comes from a run the authors launched and verified. The authors are responsible for all content in this paper, including anything produced with AI assistance.

Reproducibility Statement

The method is defined in § 3.2 and § 3.3 and the training objective in § 3.5. Section A gives the training setup. Section A.1 lists the seven cue categories and Section A.2 the layers each set of heads reads. Section C sets out one full training step as pseudo-code. Dataset construction, including the annotation model and the six structured-caption fields, is described in § 3.4. NitroFusion2 will be released publicly upon acceptance.

Implementation Details

We use Adam with β1=0.0\beta_{1}=0.0, β2=0.9\beta_{2}=0.9, no weight decay, a learning rate of 5×10−55 \times10^{-5} and a batch size of 256, on eight H100 GPUs. The final model is trained for 20,000 steps in two stages. The first 5,000 steps are off-policy. The remaining 15,000 are on-policy, where the student’s input is a state rolled out along its own trajectory, and we set λfm=0\lambda_{\mathrm{fm}}=0, dropping the flow-matching term.

The discriminator heads follow the design of APT [33]. Following NitroFusion [6], the image stream and each cue carry a pool of three heads rather than a single head, and one head is drawn at random per step. We also refresh the heads periodically by re-initializing their weights, which reduces overfitting.

The Cue List

Table 5 lists the seven cue categories and the text each one supplies to the discriminator. The structured caption they are drawn from is written by Qwen3.5-35B-A3B [50] from the reference image itself, so each field is detailed and closely aligned with that image.

CueText the discriminator is conditioned on
Full captionEvery field concatenated: the complete specification of the image.
TypographyThe rendered text, transcribed line by line with each line’s position and lettering. Populated only when the image contains visible text.
ObjectThe subject: what is depicted, with the counts and identities of the entities preserved.
StyleThe palette, artistic medium and rendering treatment, describing how the image is rendered rather than what it shows.
BackgroundThe setting the subject sits in: surroundings, surfaces, weather and ambient detail, excluding the subject itself.
ActionWhat the subject is doing, or an explicit statement that the scene is static.
LayoutWhere elements sit in the frame and how they are placed relative to one another.

Table 5. The seven cue categories.

Choosing Where the Heads Read

We score each layer of the frozen backbone by how far a cue’s attention map departs from the full caption’s. The full caption itself is scored by its mean departure from the other six cues. Cues separate more after layer 20, so the four best-scoring layers all fall in one band. We keep the two strongest and replace the others with the best-separating layer of the mid and of the early range, so a head also reads coarser shared structure (Table 6). The image stream gets no such selection: its states are not indexed by the cue, so there is no per-cue attention map to rank. We spread its taps evenly across depth instead, at layers 5, 13, 21 and 29.

CueTop four, best firstSelected
Full caption[22, 21, 23, 20][22, 21, 17, 10]
Typography[22, 21, 20, 24][22, 21, 17, 10]
Object[21, 20, 22, 24][21, 20, 17, 10]
Style[21, 22, 20, 25][21, 22, 17, 10]
Background[21, 22, 20, 23][21, 22, 17, 10]
Action[22, 21, 20, 24][22, 21, 17, 10]
Layout[22, 21, 20, 25][22, 21, 17, 10]

Table 6. Read layers per cue. Indices into the backbone’s 30 joint-attention layers.

Table 7 compares the selected taps against the four best-scoring band layers and against the even spacing the image stream uses. The selected taps lead on four of the five metrics, most clearly on text rendering; GenEval is the exception. We did not sweep it further, so the choice is supported empirically rather than established as optimal.

Text-stream tapsLongText-ENLongText-CNGenEvalDPG-BenchOneIG
Selected (Table 6)24.4726.6364.3984.8640.02
Top four21.2625.1764.9183.4036.53
Evenly spaced, [5, 13, 21, 29]22.5624.6767.6284.7438.71

Table 7. Where the text-stream heads read. Trained for 1,000 steps and evaluated at 1 NFE.

Additional Results

Table 8 breaks OneIG-Bench down by dimension and Table 9 breaks DPG-Bench down by category. Figure 8 and Figure 9 show further two-step and single-step samples.

MethodParamsNFEOverallAlignmentTextDiversityStyleReasoning
NitroFusion26B147.6385.1376.288.5043.0025.24
Z-Image-Turbo6B132.4365.5729.7912.6831.3722.75
TwinFlow6B142.2081.6854.1314.9736.1024.12
NitroFusion26B251.4585.4191.349.6344.2026.68
Z-Image-Turbo6B250.9483.9292.8513.8536.2527.86
TwinFlow6B251.3885.2690.6115.4938.0327.52
Z-Image-Turbo++6B+6B252.5085.6597.0911.7537.8730.12
Z-Image-Turbo6B852.8484.0399.3213.8536.8130.19

Table 8. Per-dimension breakdown on OneIG-Bench. Results on the five dimensions that form the overall score.

MethodParamsNFEOverallEntityAttributeRelationGlobalOther
NitroFusion26B186.4892.3689.6294.7484.1988.00
Z-Image-Turbo6B177.2384.8583.0891.0376.9082.80
TwinFlow6B185.1790.9988.5694.4383.8987.20
NitroFusion26B286.2192.4788.9493.8183.2886.00
Z-Image-Turbo6B285.7891.7388.7894.1684.1989.60
TwinFlow6B285.9891.8389.0294.1681.4687.60
Z-Image-Turbo++6B+6B285.8691.8489.3094.5883.8989.60
Z-Image-Turbo6B884.8689.5990.1492.1691.2988.68

Table 9. Per-category breakdown on DPG-Bench. Results on the five categories that form the overall score.

Additional two-step samples from NitroFusion2

Figure 8. Additional two-step samples from NitroFusion2, at 1024 × 1024.

Additional single-step samples from NitroFusion2

Figure 9. Additional single-step samples from NitroFusion2, at 1024×10241024 \times1024.

On the OneIG diversity dimension (Table 8), NitroFusion2 scores below both baselines at one and two steps. This suggests a trade-off between diversity and fidelity [32].

Beyond the few-step students of Z-Image, we compare with two recent open-weight models using their published two-step Turbo LoRAs: Krea 2 Turbo [26, 44] at 12B parameters and Qwen-Image-2512 Turbo [67, 71] at 20B.

Figure 7 shows the qualitative comparison. At one step, only NitroFusion2 produces consistently sharp outputs across all three examples, preserving fine detail in the cherry-blossom branches, facial hair, and ornate headdresses. At two steps, the differences become smaller, while NitroFusion2 continues to produce fine-grained detail with a 6B model, half the size of Krea 2 Turbo and less than a third of Qwen-Image-2512 Turbo. Table 10 reports the quantitative results. At one step, NitroFusion2 leads four of the five benchmarks, trailing only on LongText-CN. At two steps, Qwen-Image-2512 Turbo leads on text rendering and Krea 2 Turbo on GenEval, while the three models are close on DPG-Bench and OneIG, leaving NitroFusion2 competitive with both larger models.

Additional qualitative comparison at one and two steps

Figure 7. Additional qualitative comparison at one and two steps.

MethodParamsNFEText renderingOverall
LongText-ENLongText-CNGenEvalDPG-BenchOneIG
NitroFusion2 (ours)6B143.3447.7875.8686.4847.63
Qwen-Image-turbo-2steps20B140.4451.5069.3486.0640.03
Krea2-turbo-2steps12B113.863.6751.2474.6230.47
TwinFlow6B129.1836.8566.3485.1742.20
NitroFusion2 (ours)6B276.0381.9574.4686.2151.45
Qwen-Image-turbo-2steps20B289.4293.0075.2886.2650.79
Krea2-turbo-2steps12B286.7850.2885.5286.6752.59
TwinFlow6B271.9978.6572.4185.9851.38

Table 10. Comparison against recent open-weight models at one and two steps. Every row was sampled by us under identical settings. Parameter counts are denoiser weights.

Pseudo-code

Algorithm 1 One training step of NitroFusion2. ACD draws the cue and routes the heads (lines 4–5). TSAD reads the text stream (line 9). Everything else is a standard adversarial distillation step.

Require: Frozen MMDiT backbone FF; student GθG_{\theta}; text-stream head groups {Dtxtk}\{D_{\mathrm{txt}}^{k}\}, one per cue category; image-stream heads DimgD_{\mathrm{img}}; reference set D\mathcal{D} of pairs (x,cfull)(x,c_{\mathrm{full}}) with original prompt pp

  1. while not converged do

  2. (x,cfull,p)∼D,z∼N(0,I)(x,c_{\mathrm{full}},p) \sim\mathcal{D},\quad z \sim\mathcal{N}(0,I)

  3. Student output: x^←Gθ(z,1,p)\hat{x} \leftarrow G_{\theta}(z,1,p)

  4. ACD, draw the cue: k∼Uniform⁡(K(a)),q←field k of cfullk \sim\operatorname{Uniform}(\mathcal{K}(a)),\quad q \leftarrow\text{field }k\text{ of }c_{\mathrm{full}}

  5. ACD, route the heads: draw DtxtD_{\mathrm{txt}} from the group DtxtkD_{\mathrm{txt}}^{k}

  6. t∼U,ϵ∼N(0,I),form xt and x^tt \sim U,\quad\epsilon\sim\mathcal{N}(0,I),\quad\text{form }x_t\text{ and }\hat{x}_t

  7. One frozen pass per sample, both conditioned on qq:

  8. UT,UI←F(xt,q),U^T,U^I←F(x^t,q)U_T,U_I \leftarrow F(x_t,q),\quad\hat{U}_T,\hat{U}_I \leftarrow F(\hat{x}_t,q)

  9. TSAD, read the text stream: ℓqext←Dtxt(UT),ℓ^qtext←Dtxt(U^T)\ell_q^{\mathrm{ext}} \leftarrow D_{\mathrm{txt}}(U_T),\quad\hat{\ell}_q^{\mathrm{text}} \leftarrow D_{\mathrm{txt}}(\hat{U}_T)

  10. Image stream, as usual: ℓqimg←Dimg(UI),ℓ^qimg←Dimg(U^I)\ell_q^{\mathrm{img}} \leftarrow D_{\mathrm{img}}(U_I),\quad\hat{\ell}_q^{\mathrm{img}} \leftarrow D_{\mathrm{img}}(\hat{U}_I)

  11. Update the heads: descend LD\mathcal{L}_D on Dtxt,DimgD_{\mathrm{txt}},D_{\mathrm{img}} with x^t\hat{x}_t detached

  12. Update the student: descend LG=(1−λimg)Ltext-adv+λimgLimg-adv+λfmLfm\mathcal{L}_G=(1-\lambda_{\mathrm{img}})\mathcal{L}_{\mathrm{text\text{-}adv}}+\lambda_{\mathrm{img}}\mathcal{L}_{\mathrm{img\text{-}adv}}+\lambda_{\mathrm{fm}}\mathcal{L}_{\mathrm{fm}} on GθG_{\theta}

  13. end while

  14. return trained student GθG_{\theta}

References

  1. [1]Kanghyun Baek, Jaihyun Lew, Chaehun Shin, Jungbeom Lee, and Sungho Yoon. Diagnosing and correcting concept omission in multimodal diffusion transformers. In ICML, 2026. 2, 3, 4arxiv.org/abs/2605.14270
  2. [2]Yogesh Balaji, Seungjun Nah, Xun Huang, Arash Vahdat, Jiaming Song, Qinsheng Zhang, Karsten Kreis, Miika Aittala, Timo Aila, Samuli Laine, Bryan Catanzaro, Tero Karras, and Ming-Yu Liu. eDiff-I: Text-to-image diffusion models with an ensemble of expert denoisers. arXiv preprint arXiv:2211.01324, 2022. 2arxiv.org/abs/2211.01324
  3. [3]Hmrishav Bandyopadhyay, Rahim Entezari, Jim Scott, Reshinth Adithyan, Yi-Zhe Song, and Varun Jampani. SD3.5-Flash: Distribution-guided distillation of generative flows. arXiv preprint arXiv:2509.21318, 2025. 3, 5arxiv.org/abs/2509.21318
  4. [4]Jingjing Chang, Yixiao Fang, Peng Xing, Shuhan Wu, Wei Cheng, Rui Wang, Xianfang Zeng, Gang Yu, and Hai-Bao Chen. OneIG-Bench: Omni-dimensional nuanced evaluation for image generation. In NeurIPS, 2025. 7arxiv.org/abs/2506.07977
  5. [5]Hila Chefer, Yuval Alaluf, Yael Vinker, Lior Wolf, and Daniel Cohen-Or. Attend-and-excite: Attention-based semantic guidance for text-to-image diffusion models. In SIGGRAPH, 2023. 3arxiv.org/abs/2301.13826
  6. [6]Dar-Yen Chen, Hmrishav Bandyopadhyay, Kai Zou, and Yi-Zhe Song. NitroFusion: High-fidelity single-step diffusion through dynamic adversarial training. In CVPR, 2025. 2, 3, 5, 15arxiv.org/abs/2412.02030
  7. [7]Junsong Chen, Shuchen Xue, Yuyang Zhao, Jincheng Yu, Sayak Paul, Junyu Chen, Han Cai, Song Han, and Enze Xie. SANA-Sprint: One-step diffusion with continuous-time consistency distillation. In ICCV, 2025. 3arxiv.org/abs/2503.09641
  8. [8]Zhenglin Cheng, Peng Sun, Jianguo Li, and Tao Lin. TwinFlow: Realizing one-step generation on large models with self-adversarial flows. In ICLR, 2026. 2, 3, 7arxiv.org/abs/2512.05150
  9. [9]Patrick Esser, Sumith Kulal, Andreas Blattmann, Rahim Entezari, Jonas Müller, Harry Saini, Yam Levi, Dominik Lorenz, Axel Sauer, Frederic Boesel, Dustin Podell, Tim Dockhorn, Zion English, Kyle Lacey, Alex Goodwin, Yannik Marek, and Robin Rombach. Scaling rectified flow transformers for high-resolution image synthesis. In ICML, 2024. 2, 3, 4arxiv.org/abs/2403.03206
  10. [10]Xiangyu Fan, Zesong Qiu, Zhuguanyu Wu, Fanzhou Wang, Zhiqian Lin, Tianxiang Ren, Dahua Lin, Ruihao Gong, and Lei Yang. Phased DMD: Few-step distribution matching distillation via score matching within subintervals. In CVPR, 2026. 3arxiv.org/abs/2510.27684
  11. [11]Chris Ge, Rohit Gandikota, Antonio Torralba, and Tamar Rott Shaham. Vision-language binding in in-context image generation. In ICML Workshops, 2026. 2, 3arxiv.org/abs/2605.24624
  12. [12]Zhengyang Geng, Mingyang Deng, Xingjian Bai, J. Zico Kolter, and Kaiming He. Mean flows for one-step generative modeling. In NeurIPS, 2025. 3arxiv.org/abs/2505.13447
  13. [13]Zhengyang Geng, Yiyang Lu, Zongze Wu, Eli Shechtman, J. Zico Kolter, and Kaiming He. Improved mean flows: On the challenges of fastforward generative models. In CVPR, 2026. 3arxiv.org/abs/2512.02012
  14. [14]Zigang Geng, Yibing Wang, Yeyao Ma, Chen Li, Yongming Rao, Shuyang Gu, Zhao Zhong, Qinglin Lu, Han Hu, Xiaosong Zhang, Di Wang, and Jie Jiang. X-Omni: Reinforcement learning makes discrete autoregressive image generative models great again. arXiv preprint arXiv:2507.22058, 2025. 7arxiv.org/abs/2507.22058
  15. [15]Dhruba Ghosh, Hanna Hajishirzi, and Ludwig Schmidt. GenEval: An object-focused framework for evaluating text-to-image alignment. In NeurIPS, 2023. 7arxiv.org/abs/2310.11513
  16. [16]Jonathan Heek, Emiel Hoogeboom, and Tim Salimans. Multistep consistency models. arXiv preprint arXiv:2403.06807, 2024. 3arxiv.org/abs/2403.06807
  17. [17]Alec Helbling, Tuna Han Salih Meral, Ben Hoover, Pınar Yanardağ, and Duen Horng Chau. ConceptAttention: Diffusion transformers learn highly interpretable features. In ICML, 2025. 3arxiv.org/abs/2502.04320
  18. [18]Amir Hertz, Ron Mokady, Jay Tenenbaum, Kfir Aberman, Yael Pritch, and Daniel Cohen-Or. Prompt-to-prompt image editing with cross attention control. In ICLR, 2023. 3arxiv.org/abs/2208.01626
  19. [19]Xiwei Hu, Rui Wang, Yixiao Fang, Bin Fu, Pei Cheng, and Gang Yu. ELLA: Equip diffusion models with LLM for enhanced semantic alignment. arXiv preprint arXiv:2403.05135, 2024. 7arxiv.org/abs/2403.05135
  20. [20]Dengyang Jiang, Dongyang Liu, Zanyi Wang, Qilong Wu, Liuzhuozheng Li, Hengzhuang Li, Xin Jin, David Liu, Changsheng Lu, Zhen Li, Bo Zhang, Mengmeng Wang, Steven Hoi, Peng Gao, and Harry Yang. Distribution matching distillation meets reinforcement learning. In ECCV, 2026. 3arxiv.org/abs/2511.13649
  21. [21]Minguk Kang, Jun-Yan Zhu, Richard Zhang, Jaesik Park, Eli Shechtman, Sylvain Paris, and Taesung Park. Scaling up GANs for text-to-image synthesis. In CVPR, 2023. 3arxiv.org/abs/2303.05511
  22. [22]Minguk Kang, Richard Zhang, Connelly Barnes, Sylvain Paris, Suha Kwak, Jaesik Park, Eli Shechtman, Jun-Yan Zhu, and Taesung Park. Distilling diffusion models into conditional GANs. In ECCV, 2024. 3, 5arxiv.org/abs/2405.05967
  23. [23]Chaehyun Kim, Heeseong Shin, Eunbeen Hong, Heeji Yoon, Anurag Arnab, Paul Hongsuck Seo, Sunghwan Hong, and Seungryong Kim. Seg4Diff: Unveiling open-vocabulary semantic segmentation in text-to-image diffusion transformers. In NeurIPS, 2025. 3
  24. [24]Dongjun Kim, Chieh-Hsin Lai, Wei-Hsiang Liao, Naoki Murata, Yuhta Takida, Toshimitsu Uesaka, Yutong He, Yuki Mitsufuji, and Stefano Ermon. Consistency trajectory models: Learning probability flow ODE trajectory of diffusion. In ICLR, 2024. 3arxiv.org/abs/2310.02279
  25. [25]Youngjoong Kim, Deokyeong Lee, and Jaesik Park. Distribution matching distillation without fake score network. arXiv preprint arXiv:2605.19256, 2026. 3arxiv.org/abs/2605.19256
  26. [26]Krea AI. Krea 2 Turbo. https://huggingface.co/krea/Krea-2-Turbo, 2026. 16
  27. [27]Binglei Li, Mengping Yang, Zhiyu Tan, Junping Zhang, and Hao Li. TextTailor: Inference-time textual guidance tailoring for multimodal diffusion transformers. In ECCV, 2026. 3DOI
  28. [28]Bowen Li, Xiaojuan Qi, Thomas Lukasiewicz, and Philip H. S. Torr. Controllable text-to-image generation. In NeurIPS, 2019. 3arxiv.org/abs/1909.07083
  29. [29]Haoyu Li, Tingyan Wen, Lin Qi, Zhe Wu, Yihuang Chen, Xing Zhou, Lifei Zhu, Xueqian Wang, and Kai Zhang. 1.x-distill: Breaking the diversity, quality, and efficiency barrier in distribution matching distillation. arXiv preprint arXiv:2604.04018, 2026. 3arxiv.org/abs/2604.04018
  30. [30]Maohua Li, Qirui Li, Yanke Zhou, Yiduo Li, Zhaosheng Chi, Chao Xu, Cuifeng Shen, Yixuan Xu, Hanlin Tang, Kan Liu, Tao Lan, Lin Qu, and Shao-Qun Zhang. Text template tokens are implicit semantic registers in diffusion transformers. arXiv preprint arXiv:2607.19139, 2026.arxiv.org/abs/2607.19139
  31. [31]Jae Hyun Lim and Jong Chul Ye. Geometric GAN. arXiv preprint arXiv:1705.02894, 2017.arxiv.org/abs/1705.02894
  32. [32]Shanchuan Lin, Anran Wang, and Xiao Yang. SDXL-Lightning: Progressive adversarial diffusion distillation. arXiv preprint arXiv:2402.13929, 2024.arxiv.org/abs/2402.13929
  33. [33]Shanchuan Lin, Xin Xia, Yuxi Ren, Ceyuan Yang, Xuefeng Xiao, and Lu Jiang. Diffusion adversarial post-training for one-step video generation. In ICML, 2025.arxiv.org/abs/2501.08316
  34. [34]Yaron Lipman, Ricky T. Q. Chen, Heli Ben-Hamu, Maximilian Nickel, and Matt Le. Flow matching for generative modeling. In ICLR, 2023.arxiv.org/abs/2210.02747
  35. [35]Bingyan Liu, Chengyu Wang, Tingfeng Cao, Kui Jia, and Jun Huang. Towards understanding cross and self-attention in stable diffusion for text-guided image editing. In CVPR, 2024.arxiv.org/abs/2403.03431
  36. [36]Deyuan Liu, Peng Sun, Yansen Han, Zhenglin Cheng, Chuyan Chen, and Tao Lin. Self-adversarial one step generation via condition shifting. arXiv preprint arXiv:2604.12322, 2026.arxiv.org/abs/2604.12322
  37. [37]Dongyang Liu, Ruoyi Du, David Liu, Dengyang Jiang, Liangchen Li, Qilong Wu, Zhen Li, Steven C. H. Hoi, Hongsheng Li, and Peng Gao. High-fidelity two-step image generation via teacher-aligned end-to-end distillation. arXiv preprint arXiv:2606.12575, 2026.arxiv.org/abs/2606.12575
  38. [38]Dongyang Liu, Peng Gao, David Liu, Ruoyi Du, Zhen Li, Qilong Wu, Xin Jin, Sihan Cao, Shifeng Zhang, Hongsheng Li, and Steven Hoi. Decoupled DMD: CFG augmentation as the spear, distribution matching as the shield. In ICLR, 2026.arxiv.org/abs/2511.22677
  39. [39]Gongye Liu, Bo Yang, Yida Zhi, Zhizhou Zhong, Lei Ke, Didan Deng, Han Gao, Yongxiang Huang, Kaihao Zhang, Hongbo Fu, and Wenhan Luo. Beyond VLM-Based rewards: Diffusion-native latent reward modeling. In ICML, 2026.arxiv.org/abs/2602.11146
  40. [40]Tao Liu, Hao Yan, Mengting Chen, Taihang Hu, Zhengrong Yue, Zihao Pan, Jinsong Lan, Xiaoyong Zhu, Ming-Ming Cheng, Bo Zheng, and Yaxing Wang. Continuous-time distribution matching for few-step diffusion distillation. arXiv preprint arXiv:2605.06376, 2026.arxiv.org/abs/2605.06376
  41. [41]Cheng Lu and Yang Song. Simplifying, stabilizing and scaling continuous-time consistency models. In ICLR, 2025.arxiv.org/abs/2410.11081
  42. [42]Simian Luo, Yiqin Tan, Longbo Huang, Jian Li, and Hang Zhao. Latent consistency models: Synthesizing high-resolution images with few-step inference. arXiv preprint arXiv:2310.04378, 2023.arxiv.org/abs/2310.04378
  43. [43]Weijian Luo, Tianyang Hu, Shifeng Zhang, Jiacheng Sun, Zhenguo Li, and Zhihua Zhang. Diff-instruct: A universal approach for transferring knowledge from pre-trained diffusion models. In NeurIPS, 2023.arxiv.org/abs/2305.18455
  44. [44]Ivladikov. Krea 2 Turbo distill 2-step LoRA. https://huggingface.co/ivladikov/Krea2-Turbo-Distill-2step-LoRA, 2026.
  45. [45]Takeru Miyato and Masanori Koyama. cGANs with projection discriminator. In ICLR, 2018.
  46. [46]Quang Nguyen, Truong Vu, Anh Tran, and Khoi Nguyen. Dataset diffusion: Diffusion-based synthetic dataset generation for pixel-level semantic segmentation. In NeurIPS, 2023.
  47. [47]Maxime Oquab, Timothée Darcet, Théo Moutakanni, Huy Vo, Marc Szafraniec, Vasil Khalidov, Pierre Fernandez, Daniel Haziza, Francisco Massa, Alaeddin El-Nouby, Mahdi Assran, Nicolas Ballas, Wojciech Galuba, Russell Howes, Po-Yao Huang, Shang-Wen Li, Ishan Misra, Michael Rabbat, Vasu Sharma, Gabriel Synnaeve, Hu Xu, Hervé Jegou, Julien Mairal, Patrick Labatut, Armand Joulin, and Piotr Bojanowski. DINOv2: Learning robust visual features without supervision. TMLR, 2024.arxiv.org/abs/2304.07193
  48. [48]Gaurav Parmar, Krishna Kumar Singh, Richard Zhang, Yijun Li, Jingwan Lu, and Jun-Yan Zhu. Zero-shot image-to-image translation. In SIGGRAPH, 2023. 3arxiv.org/abs/2302.03027
  49. [49]Dustin Podell, Zion English, Kyle Lacey, Andreas Blattmann, Tim Dockhorn, Jonas Müller, Joe Penna, and Robin Rombach. SDXL: Improving latent diffusion models for high-resolution image synthesis. In ICLR, 2024. 2
  50. [50]Qwen Team. Qwen3.5: Towards native multimodal agents. https://qwen.ai/blog?id=qwen3.5, 2026. 5, 15
  51. [51]Royi Rassin, Eran Hirsch, Daniel Glickman, Shauli Ravfogel, Yoav Goldberg, and Gal Chechik. Linguistic binding in diffusion models: Enhancing attribute correspondence through attention map alignment. In NeurIPS, 2023. 3arxiv.org/abs/2306.08877
  52. [52]Scott Reed, Zeynep Akata, Xinchen Yan, Lajanu gen Logeswaran, Bernt Schiele, and Honglak Lee. Generative adversarial text to image synthesis. In ICML, 2016. 3arxiv.org/abs/1605.05396
  53. [53]Yuxi Ren, Xin Xia, Yanzuo Lu, Jiacheng Zhang, Jie Wu, Pan Xie, Xing Wang, and Xuefeng Xiao. Hyper-SD: Trajectory segmented consistency model for efficient image synthesis. In NeurIPS, 2024. 2, 3arxiv.org/abs/2404.13686
  54. [54]Robin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser, and Björn Ommer. High-resolution image synthesis with latent diffusion models. In CVPR, 2022. 2, 4arxiv.org/abs/2112.10752
  55. [55]Chitwan Saharia, William Chan, Saurabh Saxena, Lala Li, Jay Whang, Emily Denton, Seyed Kamyar Seyed Ghasemipour, Burcu Karagol Ayan, S. Sara Mahdavi, Rapha Gontijo Lopes, Tim Salimans, Jonathan Ho, David J. Fleet, and Mohammad Norouzi. Photorealistic text-to-image diffusion models with deep language understanding. In NeurIPS, 2022. 2arxiv.org/abs/2205.11487
  56. [56]Tim Salimans and Jonathan Ho. Progressive distillation for fast sampling of diffusion models. In ICLR, 2022. 3arxiv.org/abs/2202.00512
  57. [57]Axel Sauer, Tero Karras, Samuli Laine, Andreas Geiger, and Timo Aila. StyleGAN-T: Unlocking the power of GANs for fast large-scale text-to-image synthesis. In ICML, 2023. 3arxiv.org/abs/2301.09515
  58. [58]Axel Sauer, Frederic Boesel, Tim Dockhorn, Andreas Blattmann, Patrick Esser, and Robin Rombach. Fast high-resolution image synthesis with latent adversarial diffusion distillation. In SIGGRAPH Asia, 2024. 2, 3, 5arxiv.org/abs/2403.12015
  59. [59]Axel Sauer, Dominik Lorenz, Andreas Blattmann, and Robin Rombach. Adversarial diffusion distillation. In ECCV, 2024. 2, 3arxiv.org/abs/2311.17042
  60. [60]Yang Song and Prafulla Dhariwal. Improved techniques for training consistency models. In ICLR, 2024. 3arxiv.org/abs/2310.14189
  61. [61]Yang Song, Prafulla Dhariwal, Mark Chen, and Ilya Sutskever. Consistency models. In ICML, 2023. 3arxiv.org/abs/2303.01469
  62. [62]Raphael Tang, Linqing Liu, Akshat Pandey, Zhiying Jiang, Gefei Yang, Karun Kumar, Pontus Stenetorp, Jimmy Lin, and Ferhan Ture. What the DAAM: Interpreting stable diffusion using cross attention. In ACL, 2023. 3arxiv.org/abs/2210.04885
  63. [63]Ming Tao, Hao Tang, Fei Wu, Xiao-Yuan Jing, Bing-Kun Bao, and Changsheng Xu. DF-GAN: A simple and effective baseline for text-to-image synthesis. In CVPR, 2022. 3arxiv.org/abs/2008.05865
  64. [64]Michael Toker, Ido Galil, Hadas Orgad, Rinon Gal, Yoad Tewel, Gal Chechik, and Yonatan Belinkov. Padding tone: A mechanistic analysis of padding tokens in T2I models. In NAACL, 2025. 2, 3, 4
  65. [65]Fu-Yun Wang, Zhaoyang Huang, Alexander William Bergman, Dazhong Shen, Peng Gao, Michael Lingelbach, Keqiang Sun, Weikang Bian, Guanglu Song, Yu Liu, Xiaogang Wang, and Hongsheng Li. Phased consistency models. In NeurIPS, 2024. 3arxiv.org/abs/2405.18407
  66. [66]Xu Wang, Zexian Li, Litong Gong, Tiezhen Ge, and Zhijie Deng. AdvDMD: Adversarial reward meets DMD for high-quality few-step generation. arXiv preprint arXiv:2604.28126, 2026. 3arxiv.org/abs/2604.28126
  67. [67]Chenfei Wu, Jiahao Li, Jingren Zhou, Junyang Lin, Kaiyuan Gao, and Kun Yan. Qwen-image technical report. arXiv preprint arXiv:2508.02324, 2025. 16arxiv.org/abs/2508.02324
  68. [68]Junyi Wu, Weijian Luo, Haoyang Zheng, Ruizhe Zhang, and Guang Lin. Diff-instruct with diffused reward: Towards principled one-step generator RL. arXiv preprint arXiv:2605.24001, 2026. 3arxiv.org/abs/2605.24001
  69. [69]Tianhe Wu, Ruibin Li, Lei Zhang, and Kede Ma. Diversity-preserved distribution matching distillation for fast visual synthesis. In ICML, 2026. 3arxiv.org/abs/2602.03139
  70. [70]Weijia Wu, Yuzhong Zhao, Mike Zheng Shou, Hong Zhou, and Chunhua Shen. DiffuMask: Synthesizing images with pixel-level annotations for semantic segmentation using diffusion models. In ICCV, 2023. 3arxiv.org/abs/2303.11681
  71. [71]Wuli-art. Qwen-Image-2512 turbo LoRA, 2 steps. https://huggingface.co/Wuli-art/Qwen-Image-2512-Turbo-LoRA-2-Steps, 2026. 16
  72. [72]Tao Xu, Pengchuan Zhang, Qiuyuan Huang, Han Zhang, Zhe Gan, Xiaolei Huang, and Xiaodong He. AttnGAN: Fine-grained text to image generation with attentional generative adversarial networks. In CVPR, 2018. 3arxiv.org/abs/1711.10485
  73. [73]Yanwu Xu, Yang Zhao, Zhisheng Xiao, and Tingbo Hou. UFOGen: You forward once large scale text-to-image generation via diffusion GANs. In CVPR, 2024. 3arxiv.org/abs/2311.09257
  74. [74]Yilun Xu, Weili Nie, and Arash Vahdat. One-step diffusion models with f-divergence distribution matching. arXiv preprint arXiv:2502.15681, 2025. 2, 3arxiv.org/abs/2502.15681
  75. [75]Tianwei Yin, Michaël Gharbi, Taesung Park, Richard Zhang, Eli Shechtman, Fredo Durand, and William T. Freeman. Improved distribution matching distillation for fast image synthesis. In NeurIPS, 2024. 2, 3arxiv.org/abs/2405.14867
  76. [76]Tianwei Yin, Michaël Gharbi, Richard Zhang, Eli Shechtman, Fredo Durand, William T. Freeman, and Taesung Park. One-step diffusion with distribution matching distillation. In CVPR, 2024. 3arxiv.org/abs/2311.18828
  77. [77]Z-Image Team, Huangjia Cai, Sihan Cao, Ruoyi Du, Peng Gao, and Aiming Hao. Z-image: An efficient image generation foundation model with single-stream diffusion transformer. arXiv preprint arXiv:2511.22699, 2025. 2, 4, 5, 7arxiv.org/abs/2511.22699
  78. [78]Han Zhang, Jing Yu Koh, Jason Baldridge, Honglak Lee, and Yinfei Yang. Cross-modal contrastive learning for text-to-image generation. In CVPR, 2021. 3arxiv.org/abs/2101.04702

Paper details

vlnc:W_thmyr6wx
Version
v1 · latest
Published
Fresh — added to the Hub within the last 30 days
Added
License
CC BY 4.0
Usage

views · 0

downloads · 0

A view counts once per browser per day, a download each time the PDF is requested.

  • Computer Science

generative AI tools and LLMs

View statement
Looking for related papers…
Contents