betaFeedback

WorksComputer Science

Trait Collapse in Text-to-Image Generation: Evaluating and Mitigating Personality Inconsistency in Visual Storytelling

Abstract

In visual storytelling, a believable character must not only look consistent across scenes but also behave in ways that reflect their personality. Current text-to-image (T2I) models preserve visual appearance effectively, yet consistently fail to maintain personality-relevant behavior—a failure we term trait collapse. We show that conventional metrics (CLIP Score, DINO similarity) are blind to this failure, and that abstract personality descriptors and scene-level emotion labels do not produce consistent improvements over neutral prompts across models. To systematically diagnose trait collapse, we introduce ViStoryBench-Personality, a story-level benchmark combining an expert-validated Visual Cues Lexicon (Fleiss' κ=0.757κ= 0.757) with a six-dimensional metric suite covering personality alignment, cross-scene stability, and behavioral coherence. Evaluating seven T2I systems, we confirm a persistent semantic gap between abstract trait labels and visual evidence, and find that visual identity consistency does not imply personality consistency. To bridge this gap, we propose Trait-Behavior-Visual (TBV), a training-free prompting framework that decomposes personality traits into renderable visual constraints. TBV improves Personality Alignment Score by up to +22.1%+22.1\%, with larger gains in models with stronger language-conditioning capacity.

Introduction

In visual storytelling, character consistency extends beyond appearance. Personality psychology treats traits as stable behavioral dispositions rather than transient emotional states (McCrae and John, 1992), and observers readily infer personality from visible cues such as posture, gaze, and facial expression (Naumann et al., 2009). A convincing generated character should therefore not only remain visually recognizable across scenes, but also sustain behavior that is consistent with their underlying personality profile—a property we term visual personality consistency.

Current T2I models largely fail to maintain this property. Existing personalization methods [6] (Ruiz et al. 2022; Ye et al. 2023; Li et al. 2023) and story-level approaches (Zhou et al., 2024) address the question of what a character looks like, with little attention to how a character acts. A model may faithfully preserve facial identity across frames while repeatedly producing generic smiles, rigid postures, or scene-driven emotional reactions, collapsing personality expression into a uniform behavioral default. We term this failure trait collapse, and attribute it to a semantic grounding gap: models receive abstract descriptors such as “friendly” or “reserved” as input, but cannot translate them into observable, context-stable visual behavior. This is distinct from general prompt non-compliance, as the failure is localized to personality-specific semantics rather than scene understanding. Conventional metrics offer no signal here—CLIP score does not improve, and sometimes decreases, under personality-grounded prompting, while DINO similarity changes only marginally (mean signed change = +0.014; maximum ∣Δ∣=0.032|\Delta| = 0.032; Table 1)—and existing story visualization benchmarks (Zhuang et al., 2025) similarly do not isolate personality-relevant behavior as an evaluation target.

ModelCLIP Score ↑ C1CLIP Score ↑ C4CLIP Score ↑ Δ\DeltaDINO Sim. ↑ C1DINO Sim. ↑ C4DINO Sim. ↑ Δ\Delta
SDXL.274.262−.012.443.475+.032
FLUX.1-dev.256.187−.069.501.504+.003
SD3.5-Large.260.252−.008.467.497+.030
StoryDiff..259.256−.003.378.392+.014
Qwen-2512.263.259−.004.644.631−.013
GPT Image 2.279.254−.025.496.504+.008
Nano Banana.276.259−.017.487.509+.022
Mean.267.247−.020.488.502+.014

Table 1. CLIP Score and DINO similarity under C1 (baseline) and C4 (TBV). CLIP Score decreases under TBV prompting, likely due to prompt-length effects on CLIP-based text encoders; DINO similarity changes only marginally, with a mean signed change of +0.014 and a maximum absolute change of 0.032. Neither metric captures the personality alignment improvements detected by our benchmark metrics (Table 2).

To address this gap, we introduce ViStoryBench-Personality. The benchmark represents character personality through OCEAN profiles (McCrae and John, 1992), connects traits to observable visual manifestations via an expert-validated Visual Cues Lexicon (κ=0.757\kappa= 0.757), and quantifies performance along six dimensions covering personality alignment, cross-scene stability, visual readability, consistency, drift, and narrative coherence. Our evaluation shows that abstract personality descriptors and scene-level emotion labels do not produce consistent improvements over the neutral baseline across tested architectures, confirming that trait collapse is a systematic rather than incidental failure.

Trait collapse versus trait expression: scene description only compared with TBV visual cues injected; OCEAN Profile O=7, C=3, E=5, A=4, N=3; Behavior Curious, exploratory; Visual cues Gaze, posture, gesture; T2I prompt Scene + anchors

Figure 1. Trait collapse vs. trait expression. Given the same narrative scene, baseline prompts (C1, left) produce generic or emotionally dominated behavior, while TBV prompts (C4, right) translate the OCEAN profile into concrete visual constraints, maintaining personality-consistent expression. Bottom: the TBV framework decomposes abstract personality traits into behavioral tendencies and then into renderable visual cues via an expert-validated lexicon.

To mitigate trait collapse without retraining, we propose the Trait-Behavior-Visual (TBV) framework. TBV decomposes personality grounding into three sequential stages: anchoring the character’s OCEAN profile, deriving context-sensitive behavioral tendencies, and mapping those tendencies to concrete visual constraints drawn from the lexicon. TBV improves Personality Alignment Score by up to +22.1%, with greater gains observed in models with stronger text-encoding capacity.

Related Work

Character Consistency in Story Visualization

Character preservation is a central requirement for visual narrative generation. T2I personalization methods preserve subject identity through test-time adaptation [6] (Ruiz et al. 2022) or zero-shot visual adapters (Ye et al., 2023; Li et al., 2023). Story-level methods extend this objective to multi-shot narratives: StoryDiffusion promotes cross-frame coherence through consistent self-attention (Zhou et al., 2024), while recent multi-character systems introduce region-level control for identity stability [1, 4].

However, these methods primarily address who the character looks like, not how the character behaves. A character may remain visually recognizable while becoming behaviorally generic, with personality-relevant posture, gaze, and interaction patterns overridden by scene-level emotion. This gap is consistent with findings that pretrained models often rely on broad social stereotypes rather than fine-grained trait reasoning in personality-related tasks [8] (Hausladen et al. 2024; Yang et al. 2026).

Controllable Action and Emotion Generation

Controllable generation methods improve control over character pose, layout, motion, and affective expression, using spatial conditions such as edges, depth, segmentation maps, or human poses (Zhang et al., 2023), decoupled text-to-pose or motion-to-video pipelines [7] (Wang et al. 2025), or emotion-conditioned signals such as valence-arousal values (He et al., 2025). However, these methods mainly specify what a character is doing or what emotion is shown in a particular scene; they do not directly evaluate whether the same character maintains stable personality expression across changing contexts. A model may render the requested action or emotion correctly while still producing generic, scene-driven, or personalityinconsistent behavior. We therefore view trait collapse as a previously under-specified failure mode: prior work has improved identity preservation, action controllability, and affective expression, but rarely examines whether characters continue to behave like the same psychological individual across scenes.

Evaluation Benchmarks for T2I Generation

T2I evaluation has progressed from single-image prompt adherence ((Saharia et al., 2022; Huang et al., 2023)) to compositional reasoning ([3, 5]) and story-level coherence ((Zhuang et al., 2025)). Existing story-level benchmarks assess narrative content, appearance consistency, and cross-frame identity, but do not isolate whether the same character remains psychologically coherent across scenes. Likewise, standard metrics such as CLIP-based text–image similarity and DINO-based appearance similarity can measure prompt alignment or visual identity, but provide no direct evidence that traits such as cautiousness, sociability, agreeableness, or emotional stability are expressed through visible behavior. This motivates a dedicated evaluation protocol for visual personality consistency.

Personality Theory and Visual Behavior

We adopt the Big Five (OCEAN) model ((McCrae and John, 1992)), which represents stable individual differences along Openness, Conscientiousness, Extraversion, Agreeableness, and Neuroticism. This trait-level representation is useful because it separates enduring dispositions from transient emotions, a distinction that current T2I models often blur. The Brunswik Lens Model ([2]) further explains how observers infer psychological attributes from observable cues: for example, extraversion is associated with open posture, active approach, and direct gaze; agreeableness with softened expression and reduced interpersonal distance; and neuroticism with tense posture, avoidant gaze, and self-protective gestures. This cue-based view provides the theoretical basis for our benchmark, which evaluates personality through observable visual evidence, and for TBV, which inverts this process by translating personality profiles into concrete visual generation constraints.

Problem Formulation

Let cc denote a character with a predefined OCEAN personality profile v∈[1,7]5\mathbf{v} \in[1, 7]^5, and let {I1,…,IT}\{I_1, \ldots, I_T\} denote an image sequence generated for cc across TT narrative scenes.

Visual personality consistency. A generated sequence exhibits visual personality consistency if: (i) each image ItI_t contains observable personality cues—posture, gaze, facial expression, and interpersonal distance—that align directionally with v\mathbf{v}; (ii) this alignment remains stable across scenes without systematic drift; and (iii) the alignment is legible from visual cues alone, without access to personality labels. This does not require the same emotion in every scene: a character may react differently across contexts while still retaining personality-consistent cues such as gaze, posture, or interaction style. § 4.4 operationalizes these requirements as automatic metrics.

Trait collapse. Trait collapse occurs when visual identity consistency is maintained but visual personality consistency fails: personality-relevant cues are degraded, suppressed, or replaced by generic scene-driven reactions. It is distinct from identity drift, where appearance changes, and from general prompt non-compliance, where scene understanding fails broadly; the failure is localized to the abstract-to-visual mapping of personality traits. § 6 provides empirical evidence for this mechanism.

ViStoryBench-Personality

We introduce ViStoryBench-Personality, a diagnostic benchmark for evaluating visual personality consistency in sequential T2I generation. Built on ViStoryBench ((Zhuang et al., 2025)), it spans 80 stories and 1,317 sequential shots, and provides four components: structured OCEAN profiles, an expert-validated Visual Cues Lexicon, controlled prompt conditions, and a six-dimensional metric suite.

Dataset Construction

Each story features a focal character represented by an OCEAN vector v∈[1,7]5\mathbf{v} \in[1, 7]^5. From the full corpus, we sample 213 evaluation shots balanced across five affective scene categories derived from Russell’s Circumplex Model ((Russell, 1980)): Neutral (20.7%), Low-arousal positive (19.2%), Low-arousal negative (19.7%), High-arousal positive (18.8%), and High-arousal negative (21.6%). Each shot is also labeled as Direct (71.8%) or Indirect (28.2%) depending on whether personality cues are expressed through explicit facial/gestural signals or more implicit proxemic and spatial cues. Full dataset statistics are provided in Appendix § 17.

Ablation conditions. Each evaluation shot is generated under four prompt conditions: C1 uses only the narrative scene and character appearance; C2 adds abstract OCEAN trait labels; C3 further adds a deduced scene-level emotion label; and C4 injects explicit TBV-derived visual constraints. C1–C3 test whether non-visual textual personality information can reduce trait collapse, while C4 tests whether concrete visual grounding is necessary. A prompt example is provided in Appendix § 18.

Visual Cues Lexicon

The Visual Cues Lexicon Lvisual\mathcal{L}_{\mathrm{visual}} maps OCEAN dimensions to 150 observable cues across 10 trait poles and five signal types: facial expression, gaze behavior, body posture, clothing/color palette, and scene environment. Cues are assigned to three activation tiers: Core (≥5\ge5 or ≤3\le3), Extended (≥6\ge6 or ≤2\le2), and Fine-grained (=7= 7 or =1= 1), allowing visual constraint density to scale with trait extremity while avoiding over-specification for moderate profiles. The full lexicon is provided in Appendix § 16.

Expert Validation

We validate the Visual Cues Lexicon with 18 psychology-trained raters. Experts completed three tasks: OCEAN-pole mapping, trait–behavior concordance rating, and end-to-end scenario coherence judgment. The lexicon achieves substantial agreement in 10-way dimension mapping (Fleiss’ κ=0.757\kappa= 0.757), high trait–behavior concordance (S-CVI/Ave =0.978= 0.978), and strong scenario-level coherence (S-CVI/Ave =0.975= 0.975). Full task formats, per-pole statistics, and effect-size analyses are provided in Appendix § 14.

Evaluation Metrics

We organize evaluation into two complementary levels: snapshot-level metrics assess personality expression within a single image, while temporal-level metrics assess consistency across a narrative sequence. All metrics use GPT-4o as the VLM judge with structured JSON outputs; the exact judge prompts and decoding parameters are provided in Appendix § 12. We validate this judge against human annotations (Spearman ρ=0.611\rho= 0.611, polarity agreement =86.6%;= 86.6\%; Appendix § 20).

Snapshot-Level Metrics

Personality Alignment Score (PAS). PAS measures how faithfully a generated image reflects the intended personality. Given the preset OCEAN profile v\mathbf{v} and the VLM-inferred profile v^\hat{\mathbf{v}}, we compute centered cosine similarity as PAS

PAS=(v^−m)⋅(v−m)∥v^−m∥2⋅∥v−m∥2,\mathrm{PAS} = \frac{(\hat{\mathbf{v}}-\mathbf{m})\cdot(\mathbf{v}-\mathbf{m})}{\lVert\hat{\mathbf{v}}-\mathbf{m}\rVert_{2}\cdot\lVert\mathbf{v}-\mathbf{m}\rVert_{2}},

where m=[4,4,4,4,4]\mathbf{m}=[4,4,4,4,4] is the neutral midpoint. Centering ensures that alignment reflects directional personality evidence rather than neutral-scale bias.

Personality Consistency Score (PCS). PCS measures stochastic stability under repeated generation. For the same prompt, we generate N=3N=3 images and compute

PCS=1−15∑d∈DVar⁡({v^d(i)}i=1N)σmax⁡2,\mathrm{PCS}=1-\frac{1}{5}\sum_{d\in\mathcal{D}}\frac{\operatorname{Var}\left(\{\hat{v}_{d}^{(i)}\}_{i=1}^{N}\right)}{\sigma_{\max}^{2}},

where σmax⁡2=(U−L)2/4=9\sigma_{\max}^{2}=(U-L)^{2}/4=9 by Popoviciu’s inequality. High PCS indicates stable rendering, but not necessarily correct personality alignment, so we interpret PCS jointly with PAS.

Readability Score (RS). RS evaluates whether personality is inferable from visual cues alone. The VLM receives only the image and plot context, with all personality descriptors removed, and infers v~\tilde{\mathbf{v}}. RS uses the same centered cosine formulation as PAS between v~\tilde{\mathbf{v}} and the target profile v\mathbf{v}. High RS indicates that the generated image itself carries visually readable personality evidence. Although RS shares the centered-cosine formulation with PAS, the two capture related but distinct signals; across all evaluated shots they correlate only moderately (Pearson r=.66r=.66), confirming that RS is not a near-duplicate of PAS. Full inter-metric correlations are reported in Appendix § 21.

Temporal-Level Metrics

Character Consistency Score (CCS). CCS measures cross-situational stability of personality expression. For shots {I1,…,In}\{I_{1},\ldots,I_{n}\} depicting the same character, CCS is the mean pairwise centered cosine similarity,

CCS=1(n2)∑i<j(v^i−m)⋅(v^j−m)∥v^i−m∥2⋅∥v^j−m∥2.\mathrm{CCS}=\frac{1}{\binom{n}{2}}\sum_{i<j}\frac{(\hat{\mathbf{v}}_{i}-\mathbf{m})\cdot(\hat{\mathbf{v}}_{j}-\mathbf{m})}{\lVert\hat{\mathbf{v}}_{i}-\mathbf{m}\rVert_{2}\cdot\lVert\hat{\mathbf{v}}_{j}-\mathbf{m}\rVert_{2}}.

High CCS indicates internally stable expression, but does not guarantee correctness; we therefore interpret it together with PAS and PDS.

Personality Drift Score (PDS). PDS quantifies whether personality expression systematically deviates over a narrative sequence. For each shot tt, we compute the normalized distance dt=15∑d∈D∣v^d(t)−vd∣U−Ld_t = \frac{1}{5}\sum_{d\in D}\frac{|\hat{v}^{(t)}_d-v_d|}{U-L} and fit dt=β0+β1t~d_t = \beta_0 + \beta_1\tilde{t} over normalized time t~=(t−1)/(T−1)\tilde{t}=(t-1)/(T-1). PDS is the slope β1\beta_1: a positive value indicates progressive personality erosion, while a value near zero suggests no systematic drift.

Story Coherence Score (SCS). SCS evaluates whether the generated image aligns with both the preset personality and the behavioral logic implied by the narrative: SCS =α⋅= \alpha\cdot PAS +(1−α)⋅+(1-\alpha)\cdot SCSreasoning_{\text{reasoning}}, where SCSreasoning∈[0,1]_{\text{reasoning}}\in[0,1] is a VLM-assigned score measuring how well the image matches the personality-conditioned behavioral trace from Phase B. We set α=0.4\alpha=0.4 to emphasize context-specific behavioral coherence while retaining global trait alignment; a sensitivity analysis (Appendix § 15) confirms that model rankings are stable across α∈[0.2,0.8]\alpha\in[0.2,0.8].

Trait-Behavior-Visual (TBV) Framework

The ablation design of ViStoryBench-Personality (§ 4.1) isolates whether abstract personality descriptors can reduce trait collapse by comparing conditions C1–C3. As our experiments confirm (§ 6), C2 and C3 do not yield consistent improvements over C1 across models, pointing to a systematic gap between abstract personality information and visual rendering. To mitigate trait collapse without model retraining, we propose the Trait-Behavior-Visual (TBV) framework, a training-free prompting intervention that explicitly decomposes this gap into three tractable phases. As illustrated in Figure 2, TBV translates abstract OCEAN profiles into concrete visual generation constraints through: Phase T (Trait Anchoring), Phase B (Behavioral Deduction), and Phase V (Vision Mapping). Unless otherwise stated, all LLM-based operations in TBV, including trait anchoring, behavioral deduction, reverse inference, and visual-cue selection, are implemented with GPT-4o using structured JSON outputs. Implementation settings are provided in Appendix § 19.

Overview of the Trait-to-Behavior-to-Visual (TBV) framework

Figure 2. Overview of the Trait-Behavior-Visual (TBV) framework. Phase T anchors the character’s OCEAN personality profile; Phase B derives context-sensitive behavioral tendencies via a self-correcting loop; Phase V maps behaviors into concrete visual constraints through the expert-validated Visual Cues Lexicon.

Phase T: Trait Anchoring

Phase T establishes a stable OCEAN personality anchor for each character. To mitigate the inherent variance of LLM-based trait extraction, we employ a multi-sample self-consistency strategy (Wang et al. (2022)): we sample kk independent inferences and measure their agreement using a Normalized Disagreement Index, defined as NDI =15k∑i=1k∑d∈D∣vi,d−vˉd∣U−L= \frac{1}{5k}\sum_{i=1}^{k}\sum_{d\in D}\frac{|v_{i,d}-\bar{v}_d|}{U-L}, where D={O,C,E,A,N}D=\{O,C,E,A,N\}, U=7U=7, L=1L=1, and vˉd\bar{v}_d is the mean inferred score for dimension dd across the kk samples. A three-tier routing mechanism determines the outcome: if NDI <0.15<0.15, the mean vector vˉ\bar{v} is accepted as the personality anchor v^\hat{v}; if 0.15≤0.15\leq NDI ≤0.33\leq0.33, a multi-agent debate is triggered to reconcile divergent estimates; otherwise, the system falls back to a population-norm baseline. This mechanism reduces the propagation of unstable personality anchors to subsequent phases.

Phase B: Behavioral Deduction

Given the anchored personality profile v^\hat{v} and a narrative scene description, Phase B generates a behavioral reasoning trace rr describing how the character would act in this context. The key challenge is ensuring that the character’s response reflects their stable personality rather than defaulting to a generic reaction driven by the scene’s emotional content.

To address this, we introduce a self-correcting loop inspired by iterative refinement methods (Madaan et al. (2023)). An independent critic agent performs reverse inference on the reasoning trace to reconstruct the implied personality profile v~=Inf⁡(r)\tilde{v}=\operatorname{Inf}(r). We then compute a behavioral deviation score s=15∑d∈D∣v~d−v^d∣U−Ls=\frac{1}{5}\sum_{d\in D}\frac{|\tilde{v}_d-\hat{v}_d|}{U-L}. If s>τs>\tau (we set τ=0.15\tau=0.15, equivalent to a mean deviation of 0.9 points per dimension on the 7-point scale), the trace is rejected as out-of-character and regenerated with corrective feedback. This mechanism ensures that the behavioral description remains personality-consistent even under emotionally charged narrative contexts.

Phase V: Vision Mapping

Phase V translates behavioral descriptions into explicit visual constraints. Following an inverse application of the Brunswik Lens Model (Brunswik [2])—mapping known personality traits to the observable cues through which they become visible—we draw from the expert-validated Visual Cues Lexicon Lvisual\mathcal{L}_{\text{visual}} (§ 4.2). For each character, the lexicon selects cues matching the character’s OCEAN profile at the appropriate tier level (Core, Extended, or Fine-grained).

To reduce semantic collisions (e.g., simultaneous “clenched jaw” from high Neuroticism and “gentle smile” from high Agreeableness), we apply a priority-based suppression rule: facial expression and gaze cues take precedence over posture cues, which in turn override clothing and scene-level signals. This hierarchy reflects evidence that facial behavior is the most salient channel for personality perception (Ryumina et al., 2026). The resulting conflict-reduced constraint set CvisualC_{\mathrm{visual}} is injected directly into the T2I prompt as the C4 condition in our ablation design.

Experiments

Experimental Setup

Evaluated models. We evaluate seven T2I systems spanning three groups: (1) open-source generative models—SDXL (Podell et al., 2023), FLUX.1-dev (Labs, 2024), SD3.5-Large (Stability AI, 2024), and Qwen-Image-2512 (Wu et al., 2025)—covering representative UNet-, DiT-, MMDiT-, and LLM-conditioned architectures; (2) a visual consistency method, StoryDiffusion (Zhou et al., 2024), which builds on SDXL with Consistent Self-Attention; and (3) two closed-source APIs, GPT Image 2 and Gemini 3.1 Flash Image Preview (Nano Banana). Open-source models are evaluated in full diagnostic mode (C1–C4); closed-source APIs in benchmarking mode (C1 vs C4 only) due to internal prompt rewriting.

VLM judge. We employ GPT-4o with structured JSON output as the automated evaluator, validated against human annotations (Spearman ρ=0.611\rho= 0.611, polarity agreement = 86.6%; Appendix § 20) and further verified for robustness to the choice of judge in § 6.4. Detailed generation and evaluation settings are provided in Appendix § 19.

Limitations of Conventional Metrics

Before presenting our benchmark results, we first demonstrate that conventional T2I metrics are blind to personality dimensions. Table 1 reports CLIP Score (text–image alignment) and DINO similarity (cross-frame appearance consistency) under baseline (C1) and TBV (C4) conditions across all seven models.

CLIP Score shows no meaningful improvement under personality-grounded prompting—and in several cases decreases, most notably on FLUX.1-dev (Δ=−0.069\Delta= -0.069), where TBV produces the largest PAS gains. DINO similarity changes only marginally across conditions (mean signed Δ\Delta = +.014; mean ∣Δ∣|\Delta| = .017; maximum ∣Δ∣|\Delta| = .032). These results confirm that existing evaluation infrastructure cannot distinguish between personality-grounded and personality-absent generations, motivating the dedicated metrics introduced in § 4.4.

Main Results

Table 2 reports evaluation results across six metrics. Qualitative case studies in Appendix § 27 further illustrate this pattern using the same representative story shot across models and prompting conditions (Figure 4 and Figure 5). Baseline models show consistently low personality alignment, with PAS ranging from 0.446 (SDXL) to 0.542 (Nano Banana). Applying TBV increases PAS numerically across all seven systems, with statistically significant gains concentrated in models with stronger text encoders, as further analyzed in § 6.5. Qwen-Image-2512 (LLM-conditioned) and GPT Image 2 both exceed +20% relative PAS improvement, while SDXL (CLIP-only encoder) shows the smallest gain.

Model / SettingPAS ↑PCS ↑RS ↑CCS ↑PDS ↓SCS ↑
Open-source models: baseline
SDXL0.4460.6860.4290.357+0.0010.585
StoryDiffusion0.4800.7630.4670.499+0.0000.587
FLUX.1-dev0.4640.7310.4690.385+0.0030.614
SD3.5-Large0.4660.7430.4930.478+0.0030.605
Qwen-Image-25120.5180.7900.5460.456+0.0010.665
Open-source models: +TBV
SDXL + TBV0.4670.6550.4230.406-0.0020.560
StoryDiffusion + TBV0.5020.6850.5080.527-0.0010.564
FLUX.1-dev + TBV0.5220.7340.5520.511+0.0020.642
SD3.5-Large + TBV0.4720.7480.4880.449+0.0030.603
Qwen-Image-2512 + TBV0.6330.8160.6410.558-0.0000.701
Closed-source models: baseline
GPT Image 20.5380.7930.5560.504-0.0020.702
Nano Banana0.5420.7540.5510.459+0.0020.707
Closed-source models: +TBV
GPT Image 2 + TBV0.6480.8150.6590.606-0.0030.740
Nano Banana + TBV0.6380.7480.6610.505+0.0020.730

Table 2. Personality consistency evaluation across seven T2I models. TBV yields up to +22.1% relative PAS improvement on Qwen-Image-2512, with larger gains observed in models equipped with stronger text encoders.

Qualitative case study across five open-source systems

Figure 4. Qualitative case study across five open-source systems on the same representative story shot. C1 uses only the base narrative prompt; C2 adds abstract OCEAN trait labels; C3 adds a deduced scene-level emotion label; C4 injects explicit TBV-derived visual constraints. Across models, C1–C3 often preserve the broad scene layout but tend to produce generic, weakly visible, or emotion-dominated behavior. C4 more consistently introduces personality-relevant visual evidence, such as exploratory gaze, forward-leaning posture, and open gestures, illustrating the qualitative mechanism behind the PAS and RS gains in Table 2.

Figure 5. Qualitative case study for the two closed-source APIs. Because GPT Image 2 and Nano Banana perform internal prompt rewriting, we evaluate them only under C1 and C4 conditions. Compared with C1, C4 produces more explicit personality-relevant behavior, including more active body orientation, exploratory engagement with the environment, and less purely scene-driven affect. This qualitative shift is consistent with the quantitative PAS and RS gains reported in Table 2.

Notably, StoryDiffusion achieves the strongest baseline PCS (0.763) but only moderate PAS (0.480), confirming that visual identity consistency does not imply psychological consistency. After TBV, its PAS improves to 0.502, but the gain (+4.6%) is smaller than models with stronger language understanding, suggesting that personality grounding is bottlenecked by the text encoder rather than the visual consistency mechanism.

A related pattern emerges in PCS: TBV reduces PCS in two of the five open-source systems (SDXL: 0.686 → 0.655; StoryDiffusion: 0.763 → 0.685), and in three of the seven systems overall when the closed-source Nano Banana is included (0.754 → 0.748). One possible interpretation is that baseline PCS can be inflated by generic behavioral defaults that remain similar across seeds, whereas TBV introduces more personality-specific visual variation. Because our experiments do not directly identify the causal source of this PCS reduction, we treat this explanation as a hypothesis rather than a confirmed mechanism. PCS and PAS should therefore be interpreted jointly: a high-PCS/low-PAS profile may indicate stable but weakly personality-aligned generation, whereas a moderate-PCS/high-PAS profile may indicate stronger personality expression with greater stochastic variation. We note that PDS remains near zero across all models and conditions (all ∣PDS∣≤0.003|\mathrm{PDS}| \le0.003), indicating no systematic personality drift over the evaluated sequences. Because our evaluation subset samples relatively few shots per story, the temporal span may be insufficient to expose gradual drift; we therefore retain PDS in Table 2 for completeness but treat it as exploratory, noting it may become more informative for longer narrative sequences.

Robustness to Judge Choice

Because all personality metrics rely on GPT-4o, a natural concern is whether the observed TBV gains reflect genuine improvements in personality expression or an artifact of the judge sharing priors with the cue-to-trait mappings used in TBV construction. To test this, we re-evaluated PAS and RS using Gemini 2.5 Flash, a judge from a different model family that played no role in constructing TBV, the Visual Cues Lexicon, or the benchmark. For each of SDXL, FLUX.1-dev, and Qwen-Image-2512, we sampled 80 matched story shots generated under both C1 and C4, yielding 80 paired observations per model.

As shown in Table 3, TBV gains replicate in direction on all three models and remain statistically significant on Qwen-Image-2512 (p=.021p = .021) and FLUX.1-dev (p=.040p = .040; paired one-sided Wilcoxon signed-rank test, testing the pre-specified directional hypothesis that TBV improves PAS over C1), preserving the ordering in which the largest gain occurs on the LLM-conditioned model. Inter-judge agreement on per-shot PAS (Pearson r=.60r = .60) is comparable to our VLM–human agreement (ρ=.61\rho= .61; Appendix § 20), indicating that ∼\sim0.6 reflects the intrinsic difficulty of single-image personality inference rather than judge-specific bias. Under this independent judge, the Readability Score—which withholds all personality information from the judge—shows even larger gains than PAS (+0.11 on Qwen-Image-2512, +0.10 on FLUX.1-dev), which is inconsistent with a keyword-recognition explanation. Full per-model statistics are provided in Appendix § 13.

ModelC1C4Δpp
Qwen-Image-25120.5340.607+0.073.021
FLUX.1-dev0.5400.599+0.059.040
SDXL0.4260.481+0.065n.s.

Table 3. TBV gains (C4 vs. C1 PAS) under an independent judge (Gemini 2.5 Flash). Results are based on 80 matched C1–C4 story-shot pairs per model. Gains replicate in direction across all three models, with the largest gain preserved on Qwen-Image-2512. pp from paired one-sided Wilcoxon signed-rank tests; n.s. = not significant.

Ablation Study

We further examine whether trait collapse can be mitigated by adding non-visual textual information alone. Across the five open-source models, abstract OCEAN descriptors (C2) and scene-level emotion labels (C3) produce inconsistent effects: FLUX.1-dev slightly improves under C2 (+0.019), whereas SDXL decreases by 0.054. Paired Wilcoxon tests and TOST equivalence tests further support this pattern: 9 of 10 C1 vs. C2/C3 comparisons show no significant PAS improvement, and 6 of 10 fall within a practically negligible margin (δ=0.05\delta= 0.05; Appendix § 24). In contrast, C4 yields significant PAS gains for models with stronger text encoders, including FLUX.1-dev, Qwen-Image-2512, GPT Image 2, and Nano Banana. These results indicate that concrete visual grounding, rather than richer abstract labels, is the key factor for mitigating trait collapse, with efficacy modulated by text-encoding capacity. Full ablation results are provided in Appendix § 22.

Emotion Override Effect

We further examine whether affective scene context interferes with personality expression. Across valid generated images, PAS differs significantly across affective scene categories (ANOVA: F(4,5076)=20.06F(4, 5076) = 20.06, p<.001p < .001; Kruskal–Wallis: H=82.00H = 82.00, p<.001p < .001; Appendix § 25). Neutral scenes obtain the highest mean PAS, while all emotionally salient categories show lower PAS, suggesting that current T2I models tend to prioritize transient scene emotion over stable personality cues when the two signals compete. For example, a highly open character may be rendered primarily as anxious or withdrawn in a tense scene, even when the intended personality profile implies exploratory gaze or forward-leaning engagement. This finding supports our central claim that trait collapse is not merely an identity-preservation problem, but a semantic grounding problem: personality must remain visually legible even when emotional context changes. We also test whether personality alignment differs between direct and indirect visual-expression shots, but find no significant gap; this null result is reported in Appendix § 26.

Discussion and Conclusion

This paper identifies and formalizes trait collapse, a failure mode in which T2I models preserve visual identity while losing personality-relevant behavior. Through ViStoryBench-Personality, we show that this failure is systematic across seven T2I systems: abstract OCEAN labels and scene-level emotion labels do not consistently improve personality alignment across models, while TBV yields numerical PAS gains across all systems, with significant gains concentrated in stronger language-conditioned models. These results suggest that the bottleneck is not simply that models lack personality words in the prompt, but that they fail to ground abstract psychological semantics into renderable visual evidence.

A key implication is that visual identity consistency and personality consistency should be evaluated separately. StoryDiffusion achieves the strongest baseline PCS, indicating strong visual stability, yet its PAS remains moderate. This demonstrates that mechanisms designed for appearance preservation do not automatically preserve psychological coherence. For narrative generation, this distinction matters: a character can remain visually recognizable while becoming behaviorally generic, emotionally overwritten, or inconsistent with their intended traits. Moreover, TBV’s improvement in PAS is accompanied by moderate PCS reductions in several systems, suggesting that personality expressiveness and stochastic consistency are not fully orthogonal objectives. Future architectures should aim to resolve this tension, generating images that are both personality-aligned and generation-stable rather than trading one for the other. Future story-level T2I benchmarks should therefore assess not only whether a character looks the same, but also whether they continue to behave like the same psychological individual.

Our results also reveal a model-capacity pattern. TBV produces the largest gains in systems with stronger language-conditioning pathways, such as Qwen-Image-2512 and GPT Image 2, while CLIP-based or visual-consistency-focused systems show smaller improvements. This suggests that TBV does not merely add more prompt tokens; it provides a structured semantic interface that stronger text encoders can exploit more effectively. At the same time, the limited gains on some open-source models indicate that prompt-level grounding has an upper bound: if the text-conditioning pathway cannot preserve fine-grained behavioral cues, explicit visual constraints may still be weakened during generation.

The Emotion Override Effect further clarifies why personality consistency is difficult. Emotionally salient scenes significantly reduce personality alignment, indicating that transient affective context can dominate stable trait expression. This interaction is important because narrative characters rarely appear in neutral scenes. A robust story-generation model should express personality through emotion rather than replacing personality with emotion: a cautious character and an exploratory character may both feel fear, but they should not display fear in the same visual way.

Overall, TBV suggests that abstract semantic attributes must often be decomposed into observable cues before they can be rendered reliably. We hope future T2I work moves beyond appearance-level consistency and evaluates characters as psychologically stable agents across narrative contexts.

Limitations

This work has several limitations. First, our evaluation relies on GPT-4o as a VLM judge for personality-related metrics. Although GPT-4o shows moderate agreement with human annotations and our Visual Cues Lexicon was validated by psychology-trained experts, larger-scale human evaluation is still needed across more visual styles, character types, and affective contexts.

Second, our framework is based on the Big Five (OCEAN) model, which is widely used but culturally situated. The visual expression of personality may vary across cultures, and some cues in the TBV Lexicon may not fully capture high-context or non-Western behavioral norms.

Third, our current evaluation focuses on one focal character per shot. Although the source stories may contain multiple characters, relational personality dynamics, such as dominance, avoidance, or interpersonal adaptation between characters, are not explicitly modeled.

Fourth, TBV depends on the model’s ability to interpret and preserve fine-grained visual cues in the prompt. Its gains may therefore be limited for smaller T2I models or models with weaker text encoders, where explicit behavioral constraints can still be weakened during generation.

Finally, our temporal metrics require multiple generations per prompt and per story shot. This makes the evaluation computationally expensive and may limit direct extension to long-form video generation models.

Code and Data Availability

The benchmark—including metadata, the Visual Cues Lexicon, prompt templates, evaluation scripts, and anonymized annotation data—is publicly available at https://github.com/Boiyaaa/ViStoryBench-Personality.

Ethical Considerations

This work studies how personality traits can be represented through visual behavior in generated images. Such capability has useful applications in storytelling, education, game design, and character-centered creative tools, but it also raises potential risks. More psychologically coherent generated characters may increase anthropomorphism or be misused in deceptive social interaction.

There is also a risk that mapping personality traits to visual cues could reinforce stereotypes. To reduce this risk, our Visual Cues Lexicon focuses on neutral and observable behavioral signals, such as posture, gaze, gesture, spatial positioning, and scene interaction. We avoid demographic-associated physical features and do not use protected attributes as personality indicators. All expert raters and human annotators participated voluntarily with informed consent. No monetary compensation was provided. No personally identifiable information was collected, and all annotations were used only in aggregate form for research evaluation.

We separately disclose the use of AI assistance in Appendix § 11. benchmark suite for story visualization. ArXiv, abs/2505.24862.

AI Assistance Disclosure

AI tools were used as auxiliary support during the preparation of this paper. Their use was limited to literature exploration, grammar and language checking, LaTeX formatting assistance, figure/table polishing suggestions, and code-related troubleshooting.

All research questions, benchmark design, experimental settings, data construction, metric definitions, result interpretation, and scientific claims were determined and verified by the authors. The authors reviewed, edited, and approved the final manuscript, and take full responsibility for its content.

No AI tool was used to generate experimental results, fabricate data, alter evaluation outcomes, or replace human expert judgments. All reported quantitative results are derived from the described experimental pipeline and validation procedures.

VLM Judge Prompts

This appendix lists the prompts and decoding parameters used for VLM-based evaluation. All prompts are sent as user messages together with the evaluated image; no separate system-role message is used. The API is called with response_format={"type": "json_object"} to enforce JSON-formatted outputs.

PAS Task: OCEAN Annotation

The PAS score is computed as the centered cosine similarity between the VLM-inferred OCEAN vector and the preset OCEAN vector.

You are a personality psychology expert analyzing
    a storybook illustration.
Scene: {scene_text}
Plot: {plot_text}
Focus on these character cues (even for non-human
    characters like animals):
- Interaction style: approaching vs retreating,
    embracing vs distant
- Spatial positioning: center/dominant vs
    peripheral/small
- Action energy: dynamic/expansive vs
    still/contained
- Emotional expression: open/warm vs closed/tense
    (in posture and gesture, not just face)
- Overall character demeanor conveyed by the
    illustration
Rate each Big Five dimension from 1 (very low) to
    7 (very high).
Do NOT default to 4 -- commit to a direction based
    on what you observe.
Respond ONLY with JSON:
{"observations": "...", "O": 4, "C": 4, "E": 4,
    "A": 4, "N": 4, "reasoning": "..."}

RS Task: Blind Personality Inference

The RS task evaluates whether personality can be inferred from the generated image without prior personality labels.

You are a personality psychology expert. Look at
    this storybook illustration.
WITHOUT any prior personality information, analyze
    ONLY the visual cues:
Plot context (NO personality labels): {plot_text}
Focus on:
- How the character interacts with others or the
    environment
- Body posture: open/closed, dynamic/static,
    approaching/retreating
- Spatial dominance: center vs edge, large vs small
- Emotional tone conveyed through gesture and
    composition
Infer Big Five traits from 1 (very low) to 7 (very
    high).
Do NOT default to 4 -- commit to a direction.
Respond ONLY with JSON:
{"visual_evidence": "...", "inferred_O": 4,
    "inferred_C": 4, "inferred_E": 4,
    "inferred_A": 4, "inferred_N": 4,
    "confidence": "medium", "reasoning": "..."}

SCS-Reasoning Task

The SCS-Reasoning prompt evaluates whether the generated image reflects the expected personality-driven behavior chain.

You are evaluating whether a generated image
    reflects a character’s personality-driven
    behavior chain.
Plot: {plot_text}
Scene: {scene_text}
Reasoning trace (personality -> behavior ->
    expected visual):
{reasoning_trace}
Check:
1. Does the character’s appearance match the
    predicted behavioral outcome?
2. Are specific visual manifestations from the
    trace present?
3. Rate alignment 0.0-1.0
Respond ONLY with JSON:
{"elements_found": ["..."], "elements_missing":
    ["..."], "alignment_score": 0.0, "rationale":
    "..."}

VLM Generation Parameters

All evaluations use gpt-4o with temperature T=0.2T=0.2, max_completion_tokens = 2000, n=1n=1, high image detail, JSON response format, streaming disabled, 120 s timeout, and up to 3 retries.

Phase T: Trait Anchoring Prompt

Used in Phase T for each of the k=5k=5 independent OCEAN inferences per character.

You are a personality psychology expert. Given the
    following character description and narrative context, infer the
    character’s Big Five (OCEAN)
    personality profile.
Character: {character_description}
Narrative context: {story_synopsis}
Rate each dimension from 1 (very low) to 7 (very
    high).
Do NOT default to 4 -- commit to a direction based
    on the narrative evidence.
Respond ONLY with JSON:
{"O": 4, "C": 4, "E": 4, "A": 4, "N": 4,
 "reasoning": "..."}

When NDI ∈[0.15,0.33]\in[0.15, 0.33], the following two-round debate critic prompt is appended:

The following OCEAN estimate was produced for this
character: {estimate}.
Identify any dimensions where the estimate seems
inconsistent with the
narrative evidence and propose corrections with
justification.
Respond ONLY with JSON:
{"revised_O": 4, ..., "revised_N": 4, "critique":
 "..."}

Phase B: Behavioral Deduction Prompt

Used in Phase B to generate the behavioral reasoning trace rr.

You are a character behavior analyst. Given a
character’s personality profile
and a narrative scene, describe specifically how
the character would behave
in this scene. Your description must reflect the
character’s stable
personality, not just the emotional tone of the
scene.
OCEAN profile: {ocean_vector}
Scene: {scene_description}
Respond ONLY with JSON:
{"behavioral_trace": "...", "key_behaviors":
 ["...", "..."],
 "reasoning": "..."}

The critic prompt for reverse inference (behavioral deviation check):

Given this behavioral description: {trace}, infer
the implied OCEAN profile
of the character exhibiting this behavior.
Respond ONLY with JSON:
{"O": 4, "C": 4, "E": 4, "A": 4, "N": 4,
 "reasoning": "..."}

Phase V: Vision Mapping Prompt

Used in Phase V to select and compose the final visual constraint string.

Given the following behavioral description and the
character’s OCEAN profile,
select the most relevant visual cues from the TBV
Lexicon and compose them
into a visual constraint string suitable for
injection into a T2I prompt.
Behavioral trace: {behavioral_trace}
OCEAN profile: {ocean_vector}
Available cues (tier-filtered): {lexicon_subset}
Apply the priority rule: facial/gaze cues >
 posture cues >
clothing/scene cues. Return 4–6 non-conflicting
cues.
Respond ONLY with JSON:
{"selected_cues": ["...", "..."],
 "constraint_string": "..."}

Independent-Judge Robustness

To assess whether our findings are specific to GPT-4o, we re-evaluated a stratified subset with Gemini 2.5 Flash as an alternative judge. For each of

SDXL, FLUX.1-dev, and Qwen-Image-2512, we sampled 80 matched story shots that were generated under both C1 and C4, yielding 80 paired observations per model. The sample was stratified by macro-emotion category to match the affective distribution of the full evaluation set. Every image was re-scored for PAS and RS using the same judge prompts as the primary evaluation (Appendix § 12); only the VLM judge was changed from GPT-4o to Gemini 2.5 Flash.

Table 4 reports paired PAS gains under both judges on the same shots. Gains agree in direction on all three models; the two significant gains under Gemini (Qwen-Image-2512, FLUX.1-dev) coincide with the models for which GPT-4o also reports the largest effects. Per-shot PAS scores from the two judges correlate at Pearson r=.601r = .601, close to the VLM–human agreement of ρ=.611\rho= .611 reported in Appendix § 20. This suggests that the moderate absolute agreement is characteristic of single-image personality inference in general, rather than a limitation specific to any one judge.

ModelGemini Δ\DeltappGPT-4o Δ\Deltann
Qwen-Image-2512+0.073.021+0.07580
FLUX.1-dev+0.059.040+0.09180
SDXL+0.065.133+0.06380

Table 4. PAS gains (C4−C1) on the same sampled shots under the independent judge (Gemini 2.5 Flash) and the primary judge (GPT-4o). pp from paired one-sided Wilcoxon signed-rank tests on the Gemini scores. Directions agree across all models.

This robustness analysis is a confirmatory test of the direction already established by our primary evaluation (§ 6.3): that TBV improves PAS over C1. We therefore use a one-sided Wilcoxon test, with the direction fixed before inspecting the Gemini scores.

Expert Validation of the Visual Cues Lexicon

We recruited 18 raters with graduate-level training in psychology, including Master’s and doctoral students specializing in personality or clinical psychology with demonstrated familiarity with the Big Five model and affective theories. Raters were recruited through academic research networks and psychology graduate student mailing lists. Experts completed three evaluation tasks independently without discussion.

Before participation, all raters were informed that their responses would be used for research purposes to validate the Visual Cues Lexicon and the TBV pipeline. The instructions explained that their judgments would be analyzed only in aggregate form and reported anonymously. Participation was voluntary, and no personally identifiable information was collected. By completing the validation tasks, raters provided informed consent for their anonymized responses to be used in this study.

Task 1: Dimension Mapping

Each expert was presented with a visual cue description (e.g., “character leans forward with open arms”) and asked to classify it into one of 10 OCEAN poles (O+, O−, C+, C−, E+, E−, A+, A−, N+, N−). The task format is illustrated below:

Task 1 Example Item
Visual cue: “The character stands with arms crossed, avoids eye contact, and maintains a large interpersonal distance.”
Question: Which OCEAN pole does this cue most strongly indicate?
Options: O+ O− C+ C− E+ E− A+ A− N+ N−

Table 11.

Aggregated results (n=18n = 18):

  • Exact-match hit rate: 56.7% (chance = 10%, lift = 5.7×)

  • Dimension-level accuracy (ignoring polarity): 58.3% (chance = 20%, lift = 2.9×)

  • Fleiss’ κ\kappa (10 categories): 0.757 (substantial agreement)

Table 5 reports per-pole accuracy.

PoleHit Rate (%)# CuesLift
O+68.8166.9×
O−20.3152.0×
C+78.3157.8×
C−74.2167.4×
E+67.2166.7×
E−68.8146.9×
A+67.0156.7×
A−34.4143.4×
N+51.0145.1×
N−33.7153.4×

Table 5. Per-pole exact-match accuracy (n=18n = 18). All poles exceed the 10% chance baseline. Low poles of O, A, and N show lower accuracy, reflecting genuine psychological overlap between conceptually adjacent dimensions (e.g., O− frequently mapped to C+).

Table 6 reports accuracy grouped by visual signal type.

Signal TypeHit Rate (%)# Cues
Facial expression48.426
Body posture59.025
Clothing63.234
Color palette61.415
Scene environment54.550

Table 6. Dimension mapping accuracy by signal type. Clothing cues show the highest discriminability; facial expression cues are most ambiguous.

Task 2: Trait-Behavior Concordance

Each expert rated the semantic fit between a personality trait and its corresponding behavioral description on a 5-point Likert scale. The task format:

Task 2 Example Item
Trait: High Agreeableness (A+)
Behavioral description: “The character approaches others with open posture, maintains warm eye contact, and positions themselves at close interpersonal distance.”
Question: How well does this behavioral description reflect the given personality trait?
Scale: 1 (Strongly Disagree) − 2 (Disagree) − 3 (Neutral) − 4 (Agree) − 5 (Strongly Agree)

Table 12.

Aggregated results (n=18n = 18, 50 items):

  • Mean rating: 4.85 (SD=0.40SD = 0.40)

  • Percentage rated ≥4\geq4 (Agree or Strongly Agree): 98.3%

  • S-CVI/Ave: 0.978 (excellent, threshold ≥0.80\geq0.80)

  • Items with I-CVI ≥0.78\geq0.78: 50/50 (100%)

Task 3: Scenario Coherence

Experts rated 30 representative scenarios—six per Russell’s macro-emotion quadrant (High-Arousal-Positive, High-Arousal-Negative, Low-Arousal-Positive, Low-Arousal-Negative) plus six Neutral—for end-to-end pipeline coherence. Each scenario presented a character’s OCEAN profile, a narrative scene, and the complete TBV-generated visual cue fragment. Experts rated whether the visual cues were psychologically plausible for the given character and context. The task format:

Task 3 Example Item

Character profile: O=5, C=3, E=6, A=5, N=2 (high extraversion, low neuroticism)

Scene (High-Arousal-Positive): “The character wins an unexpected award at a community gathering.”

TBV-generated visual cues: “The character steps forward with wide-open arms, beaming smile, upright and expansive posture, direct eye contact with the audience, animated hand gestures, relaxed facial muscles with no tension.”

Question: How well do these visual cues reflect a psychologically plausible response for this character in this scene?

Scale: 1 (Strongly Disagree) – 2 (Disagree) – 3 (Neutral) – 4 (Agree) – 5 (Strongly Agree)

Aggregated results (n=18n = 18, 30 scenarios):

  • Mean coherence rating: 4.80 (SD=0.46SD = 0.46)

  • Percentage rated ≥4\ge4: 97.5%

  • S-CVI/Ave: 0.975 (excellent)

All thirty scenarios received unanimous or near-unanimous endorsement, confirming that the TBV pipeline maintains psychological plausibility across diverse emotional contexts.

Effect Sizes

To contextualize the magnitude of expert agreement:

  • Task 1 vs. chance: Cohen’s h=1.068h = 1.068 (large effect), confirming that expert classification performance far exceeds random guessing.

  • Task 2 vs. neutral midpoint (3.0): One-sample tt-test: t(899)=138.9t(899) = 138.9, p<.001p < .001, Cohen’s d=4.63d = 4.63 (large effect), indicating concordance ratings are strongly skewed toward agreement.

SCS Weight Sensitivity

We set α=0.4\alpha= 0.4 in the SCS formula to emphasize context-specific behavioral coherence over global trait recovery, reflecting the principle that story-level personality evaluation should prioritize how a character behaves in a given scene over whether the overall trait profile is recovered.

To verify that this choice does not affect our conclusions, we swept α∈{0.2,0.3,0.4,0.5,0.6,0.7,0.8}\alpha\in\{0.2, 0.3, 0.4, 0.5, 0.6, 0.7, 0.8\} and recomputed model rankings. As shown in Table 7, model rankings remain identical for α∈[0.3,0.7]\alpha\in[0.3, 0.7] (Kendall’s τ=1.0\tau= 1.0, p<.001p < .001). At the extremes (α=0.2\alpha= 0.2 and 0.80.8), τ=0.905\tau= 0.905 (p<.01p < .01), with only the two lowest-ranked models (SDXL and StoryDiffusion) exchanging positions. These results confirm that our conclusions are not sensitive to the weighting choice.

α\alphaKendall’s τ\taupp
0.20.905.003
0.31.000<.001<.001
0.41.000—
0.51.000<.001<.001
0.61.000<.001<.001
0.71.000<.001<.001
0.80.905.003

Table 7. Kendall’s τ\tau between model rankings at each α\alpha and the paper’s α=0.4\alpha= 0.4. Rankings are fully stable across the central range.

Full Visual Cues Lexicon

This appendix presents the complete set of 150 visual cues used in our annotation framework, organized by OCEAN personality dimensions and polarity. Tier annotations are C = Core (≥5\ge5 / ≤3\le3), E = Extended (≥6\ge6 / ≤2\le2), and F = Fine (≥7\ge7 / =1). Cue types are Fa = facial expression, Bo = body posture, Cl = clothing, Co = color palette, and Sc = scene environment.

Openness to Experience

High Openness

TierTypeVisual cue
CFaAnimated or expressive facial micro-movements
CFaWide open or exploratory gaze
CBoForward-leaning curious posture
CBoRelaxed open hand gestures
CBoSlight head tilt suggesting interest
EClLayered or mixed-texture clothing
EClAsymmetric or flowing silhouettes
EClArtistic or handcrafted accessories
ECoWarm or vivid accent colors (mustard, rust, teal)
EClUnconventional or eclectic outfit combinations
FScBookshelf, map, or artwork in background
FScNatural outdoor light or dappled sunlight
FScCreative or slightly cluttered studio environment
FScPlants, cultural objects, or travel items as props
FScWarm diffuse ambient lighting

Table 13.

Low Openness

TierTypeVisual cue
CFaComposed neutral or flat facial expression
CFaForward-facing steady gaze, no exploratory movement
CBoUpright symmetrical stance
CBoArms close to body or hands clasped
CBoDeliberate controlled movements, no fidgeting
EClWell-fitted traditional or classic silhouette
EClNo accessories or minimal functional accessories
EClConventional or uniform-style clothing
ECoMuted neutral palette (navy, grey, beige, black)
ECoSingle-color or subtle pattern outfit
FScPlain or uniform background wall
FScOrderly indoor space with consistent lighting
FScMinimal props, no clutter
FScFlat even artificial lighting
FScNo decorative or cultural objects visible

Table 14.

Conscientiousness

High Conscientiousness

TierTypeVisual cue
CFaSubtle confident closed-lip expression, no tension
CFaFocused and direct gaze
CBoTall upright posture with engaged core
CBoDeliberate purposeful hand placement, no fidgeting
CBoStill body with minimal movement
EClNeatly pressed formal or semi-formal attire
EClClassic or professional silhouette
EClMinimal but purposeful accessories
ECoCoordinated color palette, no clashing tones
EClWell-maintained fabric with no wrinkles
FScClean organized desk or workspace in background
FScPlanner, checklist, or clock visible as prop
FScNeat filing or structured shelving in background
FScConsistent balanced overhead lighting
FScNothing out of place in background

Table 21.

Low Conscientiousness

TierTypeVisual cue
CFaRelaxed jaw, slightly open mouth, unfocused expression
CFaWandering or unfocused gaze
CBoSlouched or leaning posture
CBoHands fidgeting or in pockets
CBoWeight shifted to one side, asymmetric stance
EClWrinkled or untucked casual clothing
EClShirt untucked or collar askew
EClComfort-first athleisure or oversized fit
ECoMismatched or random color combinations
EClWorn or slightly disheveled items
FScCluttered or disorganized background
FScScattered objects or papers visible
FScUnmade surface or piled items in background
FScDim or inconsistent ambient lighting
FScItems visibly out of place in background

Table 22.

Extraversion

High Extraversion

TierTypeVisual cue
CFaBroad confident smile showing teeth (Duchenne smile)
CFaDirect sustained eye contact
CBoArms extended outward, open gesturing
CBoErect expansive posture occupying space
CBoBody oriented toward viewer or others
EClAttention-drawing patterns or prints
EClOpen necklines or expressive cuts
EClBold statement accessories
ECoBright warm colors (red, orange, yellow, warm pink)
EClFitted clothing that emphasizes physical presence
FScSocial gathering or crowd in background
FScBright high-key lighting
FScOpen spacious environment
FScStage, podium, or center-of-room position
FScLively colorful setting

Table 23.

Low Extraversion (Introversion)

TierTypeVisual cue
CFaMinimal facial expression, closed mouth, neutral affect
CFaDownward or averted gaze
CBoArms crossed or drawn close to body
CBoBody angled away from viewer
CBoWeight inward, occupying minimal space
EClClose-fitting minimal silhouette, no statement elements
EClCovered or layered clothing
EClNo statement accessories
ECoDark muted tones (charcoal, navy, deep grey)
EClUnderstated fabric textures
FScQuiet solitary corner or alcove
FScDim soft interior lighting
FScSingle chair or isolated seating
FScWindow with soft natural light, solitary setting
FScFew or no other people visible in background

Table 24.

Agreeableness

High Agreeableness

TierTypeVisual cue
CFaGentle closed-lip or soft open smile
CFaSlight head tilt indicating empathy
CBoOpen palms facing upward
CBoBody leaning slightly forward toward others
CFaSoft relaxed brow, no tension
EClComfortable relaxed-fit clothing
EClRounded gentle silhouettes, no sharp styling
EClNatural or organic fabric textures
ECoSoft warm tones (peach, cream, sage, dusty rose)
EClNo sharp or aggressive styling elements
FScWarm cozy interior with soft furnishings
FScPlants, flowers, or natural elements as props
FScWarm golden or candlelit ambient lighting
FScCollaborative or shared space in background
FScSoft textures like cushions or throws visible

Table 25.

Low Agreeableness

TierTypeVisual cue
CFaSharp sustained eye contact, unblinking
CFaTense jaw or clenched teeth visible
CFaFlat or downturned expression
CBoArms crossed high on chest or hands on hips
CBoBody square-on, space-assertive stance
EClSharp angular silhouettes or structured cuts
EClStiff formal or militaristic styling
EClPower-signaling or imposing accessories
ECoCold tones (black, steel grey, icy blue)
ECoHigh-contrast color blocking
FScStark industrial or minimal background
FScHard directional lighting creating strong shadows
FScEmpty impersonal space
FScNo decorative elements, bare walls
FScCool color temperature lighting

Table 26.

Neuroticism

High Neuroticism

TierTypeVisual cue
CFaFurrowed brow or creased forehead
CFaTight pressed lips or bitten lip
CFaDowncast or darting anxious gaze
CBoRaised and tensed shoulders
CBoHands wringing, fidgeting, or gripping
EClDisheveled or slightly unkempt presentation
EClClothing that looks pulled at or self-touched
EClSelf-concealing layered or oversized items
ECoDark or dull desaturated colors
ECoMismatched or incoherent outfit choices
FScDark shadowy or low-key environment
FScConfined or enclosed space
FScDramatic or harsh lighting with strong shadows
FScVisually chaotic or disordered background
FScIsolated setting with no comfort elements

Table 27.

Low Neuroticism (Emotional Stability)

TierTypeVisual cue
CFaCalm smooth brow with no creasing
CFaSteady unhurried gaze
CBoRelaxed dropped shoulders
CBoEasy natural hand placement at sides
CBoSlow deliberate composed movements
EClNeat but relaxed presentation
EClNo signs of self-touching or garment distortion
EClWell-coordinated comfortable outfit
ECoClean neutral or balanced tones (soft white, light grey, calm blue)
EClNatural fabric, nothing stiff or aggressive
FScBright airy open environment
FScNatural daylight or soft warm light
FScCalm water, greenery, or nature elements
FScClean uncluttered background
FScSpacious setting with comfortable proportions

Table 28.

Dataset Statistics

ViStoryBench-Personality is built on the narrative foundation of ViStoryBench (Zhuang et al., 2025), spanning 80 stories and 1,317 sequential shots. Table 8 (PDF p. 18) summarizes the key statistics.

StatisticValue
Total stories80
Total sequential shots1,317
Unique characters80
Mean shots per story16.5
Evaluation shots213
Conditions per shot4 (C1–C4)
T2I models evaluated7
Total generated images15,336

Table 8 (PDF p. 18). Overview of the ViStoryBench-Personality dataset.

Evaluation Subset. The 213 evaluation shots were selected via balanced sampling across five affective scene categories derived from Russell’s Circumplex Model (Russell, 1980). This design ensures that the evaluation covers both neutral and emotionally salient contexts, allowing us to analyze whether scene-level affect overrides personality-specific visual cues. Table 9 reports the affective category and visual difficulty distribution.

CategoryCount%
Neutral4420.7
Low-arousal positive4119.2
Low-arousal negative4219.7
High-arousal positive4018.8
High-arousal negative4621.6
Visual difficulty
Direct (facial/gestural)15371.8
Indirect (spatial/implicit)6028.2

Table 9. Distribution of affective scene categories and visual difficulty across 213 evaluation shots.

OCEAN Distribution. Figure 3 shows the Big Five personality distribution across unique characters. The distribution reflects the narrative archetypes in the source corpus: high Conscientiousness is overrepresented, corresponding to goal-driven protagonists in adventure stories, while extreme low-pole scores are less frequent. Neutral scores also appear across all dimensions, providing a natural control group for evaluating whether T2I models default to generic personality expression when no strong directional trait signal is present.

Big Five personality distribution across characters

Figure 3. Big Five personality distribution across unique characters. Red = low pole (1–3), grey = neutral (4), blue = high pole (5–7).

Prompt Construction Example

Table 10 shows a representative prompt construction example across the four ablation conditions.

Cond.Prompt content
C1Alice wishes she could shrink to fit through the small door. Daytime, inside the hall, disappointed and hopeful atmosphere. A curious girl with golden hair and blue eyes.
C2C1 + [Personality: High Openness, Low Conscientiousness, High Extraversion, Low Neuroticism]
C3C2 + feeling Disappointment
C4C1 + animated facial micro-movements | wide open exploratory gaze | forward-leaning curious posture | relaxed open hand gestures | slight head tilt suggesting interest

Table 10. Example prompt construction across four abstraction levels for Alice (O=7, C=3, E=5, A=4, N=3). C1–C3 test non-visual textual information, while C4 tests concrete visual grounding.

Implementation Details

T2I Model Configurations

Table 11 summarizes the generation parameters for all seven models. Open-source models were run locally; closed-source models were accessed via their respective APIs.

Hardware and Runtime

Open-source models were run on NVIDIA RTX 4090 (24 GB) or A100 (80 GB). Qwen-2512 and StoryDiffusion were run on A100 due to higher memory requirements; remaining open-source models used RTX 4090 with sequential_cpu_offload. Table 12 reports approximate per-image generation time.

ModelStepsCFGResolutionArch.
SDXL287.51024×10241024 \times1024UNet+CLIP
FLUX.1-dev283.51024×10241024 \times1024DiT+T5
SD3.5-Large284.51024×10241024 \times1024MMDiT+3Enc
Qwen-2512504.01328×13281328 \times1328MMDiT+LLM
StoryDiff.505.01024×10241024 \times1024SDXL+CSA
GPT Image 2——1254×12541254 \times1254Closed
Nano Banana——1408×7681408 \times768Closed

tbl:11: Generation parameters for the seven T2I models.

ModelDeviceTime/image
SDXLRTX 4090∼8\sim8 s
FLUX.1-devRTX 4090∼12\sim12 s
SD3.5-LargeRTX 4090∼15\sim15 s
Qwen-2512A100∼25\sim25 s
StoryDiffusionA100∼20\sim20 s
GPT Image 2API∼15\sim15 s
Nano BananaAPI∼15\sim15 s

tbl:12: Approximate per-image generation time.

Generation Protocol

Each of the 213 evaluation shots was generated under 4 ablation conditions (C1–C4). For the five open-source models (SDXL, FLUX.1-dev, SD3.5-Large, Qwen-2512, StoryDiffusion), each condition was generated 3 times with different random seeds, yielding 213×4×3×5=12,780213 \times4 \times3 \times5 = 12{,}780 images. For the two closed-source models (GPT Image 2, Nano Banana), a total of 1,278×2=2,5561{,}278 \times2 = 2{,}556 images were generated. The complete evaluation set comprises 15,336 generated images.

VLM Evaluation Configuration

Personality assessment was conducted using GPT-4o via API with the following parameters: temperature T=0.2T=0.2, max_completion_tokens = 2000, n=1n=1, high image detail, and JSON response format (response_format={"type": "json_object"}). Each generated image was evaluated on three tasks (PAS, RS, SCS-Reasoning), and consecutive shots within each story were evaluated for PCS.

TBV LLM Configuration

All LLM-based operations in TBV (Phase T, Phase B, and Phase V) are implemented using GPT-4o (gpt-4o-2024-11-20) with temperature T=0.2T=0.2 and max_completion_tokens = 1000. Phase T samples k=5k=5 independent OCEAN inferences per character. If the resulting NDI falls in [0.15,0.33][0.15, 0.33], a two-round multi-agent debate is triggered: a second GPT-4o instance critiques the initial estimate and proposes a revised anchor, after which the mean of non-outlier estimates is accepted. Phase B applies the self-correcting loop with a maximum of three regeneration attempts before falling back to the best-scoring trace. The full prompts for all three phases are listed in Appendix § 12 (Sections B.5–B.7).

Cost Estimation

Table 13 summarizes the estimated API and compute cost.

ComponentEst. Cost (USD)
GPT Image 2 generation∼$240\sim\$240
Nano Banana generation∼$240\sim\$240
VLM evaluation (GPT-4o)∼$180\sim\$180
RTX 4090 GPU hours∼200\sim200 h
A100 GPU hours∼20\sim20 h
Total API cost∼$660\sim\$660

tbl:13: Estimated cost breakdown for the full evaluation pipeline. GPU hours reported separately as institutional compute.

VLM-Human Agreement Details

To validate GPT-4o as an automated personality judge, we conducted a human agreement study. We sampled a stratified calibration subset of 100 generated images covering multiple T2I systems, all five affective scene categories, and both direct and indirect visual-expression shots. Six psychology-trained annotators, all Master’s or doctoral students in psychology-related fields, independently rated each image on the five OCEAN dimensions using the same 7-point scale as the VLM judge. Final human scores were computed as the mean rating per dimension per image. Annotators participated voluntarily with informed consent; no personally identifiable information was collected, and all ratings were analyzed only in aggregate form. We then compared GPT-4o predictions with the averaged human ratings using rank correlation, absolute error, within-one-point accuracy, and polarity agreement.

Overall Agreement

Table 14 reports aggregate agreement statistics. The moderate score-level correlation (Spearman ρ=0.611\rho= 0.611), together with 86.6% polarity agreement, supports the use of GPT-4o as a scalable

MetricValue
Spearman ρ\rho0.611
Pearson rr0.613
MAE (7-point scale)0.871
Within ±1\pm1 point81.3%
Polarity agreement86.6%

caption: tbl:14: VLM-human agreement on personality evaluation. Polarity agreement measures whether VLM and humans assign the same trait direction (above vs. below neutral); chance = 50%.

proxy for directional personality evaluation. However, the remaining disagreement indicates that automated judgments should not be interpreted as a replacement for human evaluation.

Per-Dimension Polarity Agreement

Table 15 reports polarity agreement by OCEAN dimension. GPT-4o and human annotators agreed on trait direction in 86.6% of cases overall, with per-dimension agreement ranging from 77.3% (Extraversion) to 97.6% (Openness).

DimensionAgreementChance
Openness (O)97.6%50%
Conscientiousness (C)86.8%50%
Extraversion (E)77.3%50%
Agreeableness (A)81.2%50%
Neuroticism (N)89.1%50%
Overall86.6%50%

Table 15. Polarity agreement between VLM and human annotators by OCEAN dimension (chance = 50%). Neutral ratings (= 4) are excluded.

The relatively lower agreement on Extraversion may reflect the difficulty of distinguishing stable social-energy cues from transient emotional expressions in narrative illustrations, consistent with the Emotion Override Effect observed in our main analysis.

Score-Level vs. Directional Agreement

The moderate score-level agreement (ρ=0.611\rho= 0.611) combined with high polarity agreement (86.6%) indicates that GPT-4o reliably captures the direction of personality expression while showing greater variability in exact magnitude estimates. This pattern is well-suited to our evaluation framework, which uses centered cosine similarity and is therefore more sensitive to directional agreement than to exact score magnitude.

Inter-Metric Correlations

To assess whether the six metrics provide nonredundant signals, we compute their pairwise Pearson correlations across all per-shot records with complete values on all six metrics (n=5,056n = 5{,}056; Table 16). Excluding SCS, which is a deterministic composite (SCS = 0.4 · PAS + 0.6 · SCSreasoning_{\text{reasoning}} by definition), pairwise correlations range from .13 to .66. PAS and RS correlate moderately (r=.66r = .66; 43% shared variance), while PCS and the reasoning channel are nearly independent of the alignment metrics (r≤.20r \leq.20). This indicates that the suite measures distinct facets of personality expression rather than repackaging a single inference. CCS and PDS are sequence-level metrics and are reported per model and condition in Table 2.

PASPCSRSSCSr_rSCS
PAS1.00.16.66.14.83
PCS.161.00.13.14.20
RS.66.131.00.17.59
SCSr_r.14.14.171.00.66
SCS.83.20.59.661.00

Table 16. Pearson correlations among per-shot metrics (n=5,056n = 5{,}056). SCSr_r = SCS reasoning component. SCS’s high correlation with PAS and SCSr_r is constructional (weighted composite).

Full Ablation Results

Table 17 reports the complete C1–C4 ablation results for the five open-source models.

Table 17: Full ablation study results. C1 = base narrative prompt (plot + appearance); C2 = C1 + raw OCEAN trait tags; C3 = C2 + deduced scene-level emotion labels; C4 (Full TBV) = C1 + explicit visual cues from the TBV lexicon. Appending abstract psychological vocabulary (C2, C3) yields marginal or negative effects, confirming the semantic gap. Only concrete visual grounding (C4) produces consistent gains. n=213n = 213 per condition for open-source models.

SDXLStoryDiffusionFLUX.1-devSD3.5-LargeQwen-2512
CondPASRSPASRSPASRSPASRSPASRS
C10.4460.4290.4800.4670.4640.4690.4660.4930.5180.546
C20.3920.3820.4620.4490.4830.4750.4520.4690.5450.560
C30.4080.4000.4710.4440.4840.4600.4600.4710.5400.575
C40.4670.4230.5020.5080.5220.5520.4720.4880.6330.641
Δ\Delta(C4–C1)+4.8%−1.4%+4.6%+8.8%+12.6%+17.7%+1.5%−1.0%+22.1%+17.4%

Table 17. Full ablation study results.

Per-Dimension Gain Decomposition

Some lexicon poles are less reliably mapped by experts than others (Appendix § 14), raising the question of whether TBV’s benefit also holds for these weaker poles. To examine this, we decompose the C4–C1 improvement by OCEAN dimension and polarity. For each dimension dd, we use its contribution to the centered-cosine numerator, (vd−m)(v^d−m)(v_d-m)(\hat{v}_d-m), as a per-dimension alignment diagnostic aggregated across all evaluated shots. Because this quantity is a product of centered scores rather than a cosine similarity, it is not on the PAS scale and is reported only as a relative decomposition of where gains arise.

All ten trait poles show positive C4–C1 gains. Critically, the weakest-mapped poles in the expert study, low Openness (expert hit rate 20.3%) and low Neuroticism (33.7%), show gains comparable to or larger than the most reliably mapped pole (high Conscientiousness, 78.3%). TBV’s benefit therefore does not depend on the most discriminable cues: even weakly mapped dimensions gain from explicit visual grounding. This is consistent with the view that concrete rendering, rather than lexicon reliability alone, drives the improvement, and both closed-source models (p<.001p < .001). SDXL and SD3.5-Large show non-significant C4 gains (p=.160p = .160 and .634.634), consistent with the text-encoder capacity pattern discussed in § 6.3.

Statistical Tests for Ablation Conditions

To test whether abstract personality descriptors and additional scene-level emotion labels produce consistent PAS improvements over the baseline prompt, we conducted paired Wilcoxon signed-rank tests between C1 and each of C2, C3, and C4 across all models (n=213n = 213 per pair for open-source models). We additionally applied two one-sided tests (TOST; δ=0.05\delta= 0.05) to the C1–C2 and C1–C3 comparisons to assess practical equivalence. Table 18 reports the full results.

ModelComparisonΔ\DeltaPASWilcoxon pprrTOST ppEquiv.
FLUX.1-devC1 vs C2+0.015.1610.13.009✓
C1 vs C3+0.020.3720.08.045✓
C1 vs C4+0.059.0050.24——
SDXLC1 vs C2−0.054.054−0.17.561×
C1 vs C3−0.038.134−0.13.279×
C1 vs C4+0.021.1600.12——
SD3.5-LargeC1 vs C2−0.014.703−0.03.018✓
C1 vs C3−0.005.9960.00.002✓
C1 vs C4+0.007.6340.04——
StoryDiffusionC1 vs C2−0.018.436−0.07.043✓
C1 vs C3−0.009.478−0.06.012✓
C1 vs C4+0.022.1480.12——
Qwen-Image-2512C1 vs C2+0.027.027*0.21.051×
C1 vs C3+0.021.3070.10.054×
C1 vs C4+0.115<.0010.43——
GPT Image 2C1 vs C4+0.108<.0010.50——
Nano BananaC1 vs C4+0.094<.0010.39——

Table 18. Paired Wilcoxon signed-rank tests and TOST equivalence tests (δ=0.05\delta= 0.05) for PAS across ablation conditions. rr = rank-biserial correlation. Equiv. = TOST equivalence at δ=0.05\delta= 0.05: ✓ confirmed, × not confirmed, — not applicable. TOST is reported only for C1 vs. C2/C3 comparisons, which are the focus of the equivalence claim; C1 vs. C4 is tested as the intervention condition. *Significant at p<.05p < .05. Closed-source models are evaluated under C1 and C4 only.

Of the ten C1 vs. C2/C3 comparisons across open-source models, nine show no significant improvement (Wilcoxon p>.05p > .05). The single exception is Qwen-Image-2512 under C2 (p=.027p = .027, r=0.21r = 0.21), where the gain (Δ=+0.027\Delta= +0.027) is small in magnitude and inconsistent across models—SDXL shows a decrease of comparable magnitude under C2 (Δ=−0.054\Delta= -0.054, p=.054p = .054). TOST equivalence is confirmed for 6 of 10 comparisons; the remaining four involve either a borderline positive shift (Qwen-Image-2512 C2/C3, TOST p=.051/.054p = .051/.054) or a negative shift exceeding the equivalence margin (SDXL C2/C3). This pattern indicates that abstract descriptors produce inconsistent rather than uniformly absent effects—neither constitutes reliable trait grounding.

In contrast, C1 vs. C4 yields significant improvements for FLUX.1-dev (p=.005p = .005, r=0.24r = 0.24), Qwen-Image-2512 (p<.001p < .001, r=0.43r = 0.43), and both closed-source models (p<.001p < .001). SDXL and SD3.5-Large show non-significant C4 gains (p=.160p = .160 and .634.634), consistent with the text-encoder capacity pattern discussed in § 6.3.

Emotion Override Statistical Analysis

We analyze PAS across five affective scene categories: Neutral, Low-Arousal Positive, Low-Arousal Negative, High-Arousal Positive, and High-Arousal Negative. After removing records with missing PAS or affective labels, the analysis contains 5,081 valid observations. Table 19 reports descriptive statistics for each category.

CategoryNMeanSDMedian
Neutral10530.5750.3110.655
High-Arousal Positive9520.5070.3370.571
Low-Arousal Negative9980.4980.3380.541
High-Arousal Negative10970.4770.3740.567
Low-Arousal Positive9810.4460.3510.474

Table 19. PAS distribution across affective scene categories. Neutral scenes obtain the highest mean PAS, while all emotionally salient categories show lower mean PAS.

A one-way ANOVA shows a significant effect of affective category on PAS, F(4,5076)=20.06F(4, 5076) = 20.06, p<.001p < .001. Because Levene’s test indicates unequal variances across groups (p<.001p < .001), we also conduct a non-parametric Kruskal–Wallis test, which confirms the same pattern (H=82.00H = 82.00, p<.001p < .001). Tukey HSD post-hoc comparisons show that Neutral differs significantly from all four emotionally salient categories, while several comparisons among emotional categories are not significant. This supports the Emotion Override Effect: emotionally salient contexts tend to reduce visually readable personality alignment relative to neutral contexts.

Indirect Expression Gap (Null Result)

We hypothesized that shots requiring indirect personality expression (e.g., proxemics, spatial positioning, implicit behavioral cues) would yield lower personality alignment than shots with direct expression channels (e.g., facial expression, overt gestures). To test this, we compared PAS between direct and indirect shots using independent-samples Welch’s tt-tests for each model, pooling across all four conditions. Table 20 reports the direct–indirect PAS comparison for each model.

ModelDirectIndirectttpp
SDXL.430.423+0.24.812
FLUX.1-dev.497.467+1.15.253
SD3.5-Large.461.466−0.19.847
StoryDiffusion.477.484−0.29.770
Qwen-2512.551.580−1.25.212
GPT Image 2.590.601−0.32.749
Nano Banana.596.576+0.55.584

Table 20. Direct vs. indirect PAS comparison (Welch’s tt-test). No model shows a significant difference (p<.05p < .05).

No model showed a significant difference between direct and indirect scenes (all p>.20p > .20). The mean PAS gap across seven models was ∣Δ∣=0.016\lvert\Delta\rvert= 0.016, with the direction inconsistent (three positive, four negative).

Interpretation. This null result admits several explanations. First, current T2I models may not produce sufficiently fine-grained differences in indirect personality channels (e.g., interpersonal distance, spatial dominance) for VLM-based evaluation to detect. Second, the VLM judge itself may lack sensitivity to subtle proxemic and compositional cues, attending primarily to facial and gestural signals regardless of scene type. Third, the direct/indirect distinction may be less categorical than hypothesized: even “indirect” scenes often contain some facial or postural information that the VLM can exploit. Future work should design stronger indirect manipulations (e.g., scenes depicting only environmental or object-level personality cues without any character face visible) and employ more fine-grained evaluation metrics targeting specific visual channels.

Per-Model Qualitative and Quantitative Analysis

This appendix complements Table 2 with model-wise qualitative analysis. Figure 4 and Figure 5 visualize the same representative story shot across systems: open-source models are compared under C1–C4, while closed-source APIs are compared only under C1 and C4 because they perform internal prompt rewriting.

Overall, C1–C3 usually preserve scene layout and character identity but often produce generic or emotion-dominated behavior. By contrast, C4 more often introduces TBV-specified cues such as exploratory gaze, forward-leaning posture, open gesture, and active environmental engagement. This qualitative shift mirrors the PAS and RS gains in Table 2, especially for models with stronger language-conditioning pathways.

SDXL

SDXL exhibits the weakest response to TBV among the evaluated systems. Its PAS increases only from 0.446 to 0.467, while RS slightly decreases from 0.429 to 0.423. This pattern suggests that CLIP-based text conditioning can partially absorb explicit visual cues, but remains limited in grounding abstract personality semantics into stable visual behavior. Qualitatively, SDXL often preserves the requested scene and character appearance, but the personality-relevant cues remain generic or emotionally dominated.

StoryDiffusion

StoryDiffusion provides a useful contrast between visual identity consistency and personality consistency. It achieves the strongest baseline PCS among open-source systems, but its baseline PAS remains moderate. This indicates that consistent self-attention improves cross-frame visual stability without necessarily preserving personality-relevant behavior. After TBV prompting, PAS improves from 0.480 to 0.502, but the gain remains smaller than models with stronger language understanding. This supports our claim that personality grounding is not solved by visual consistency mechanisms alone.

FLUX.1-dev

FLUX.1-dev shows a stronger response to TBV than SDXL and StoryDiffusion. PAS increases from 0.464 to 0.522, and RS increases from 0.469 to 0.552. This suggests that FLUX can better exploit concrete visual constraints once personality is translated into renderable cues. Qualitatively, TBV prompts tend to produce clearer posture, gaze, and interaction cues, although the model still occasionally prioritizes scene-level affect over stable personality expression.

SD3.5-Large

SD3.5-Large shows only marginal improvement under TBV, with PAS increasing from 0.466 to 0.472 and RS slightly decreasing from 0.493 to 0.488. This indicates that a stronger generative architecture does not automatically yield stronger personality grounding. One possible explanation is that the model may normalize or weaken fine-grained prompt details during generation, reducing the effect of additional visual constraints. Its results suggest that architectural sophistication alone is insufficient unless the text-conditioning pathway preserves personality-relevant behavioral cues.

Qwen-Image-2512

Qwen-Image-2512 is the strongest open-source responder to TBV. PAS increases from 0.518 to 0.633, RS from 0.546 to 0.641, and SCS from 0.665 to 0.701. This model benefits most from the TBV decomposition, suggesting that LLM-conditioned T2I systems are better able to use explicit visual constraints derived from abstract traits. Qualitatively, Qwen-Image-2512 more reliably renders exploratory gaze, forward-leaning posture, and spontaneous gestures when these cues are explicitly specified.

GPT Image 2

GPT Image 2 shows the strongest improvement among closed-source systems. PAS increases from 0.538 to 0.648, while RS increases from 0.556 to 0.659. This result supports the broader trend that models with stronger language understanding are more responsive to TBV prompting. However, because GPT Image 2 performs internal prompt rewriting, we evaluate it only under C1 and C4 conditions and do not use it for full C1–C4 ablation analysis.

Nano Banana

Nano Banana starts from a relatively strong baseline and still benefits substantially from TBV. PAS increases from 0.542 to 0.638, and RS increases from 0.551 to 0.661. PCS slightly decreases, suggesting that TBV may introduce more personality-specific variation across scenes while improving snapshot-level personality alignment. This trade-off reinforces the need to evaluate both alignment and stability rather than relying on a single consistency metric.

Summary

Across models, the largest TBV gains occur in LLM-conditioned or stronger language-conditioned systems, while CLIP-only or visual-consistency-focused systems show smaller gains. These model-wise patterns support two conclusions. First, visual identity preservation does not imply personality preservation. Second, the key bottleneck in trait collapse lies primarily in semantic grounding: models require concrete visual constraints before abstract personality traits become reliably renderable.

References

  1. [1]Ayan Banerjee, Josep Llad’os, Umapada Pal, and Anjan Dutta. 2025. Talediffusion: Multi-character story generation with dialogue rendering. ArXiv, abs/2509.04123.arxiv.org/abs/2509.04123
  2. [2]Egon Brunswik. 1957. Perception and the representative design of psychological experiments. American Journal of Psychology, 70:480.
  3. [3]Kaijie Chen, Zihao Lin, Zhiyang Xu, Ying Shen, Yuguang Yao, Joy Rimchala, Jiaxin Zhang, and Lifu Huang. 2025. R2i-bench: Benchmarking reasoning-driven text-to-image generation. In Conference on Empirical Methods in Natural Language Processing.arxiv.org/abs/2505.23493
  4. [4]Kai Cheng, Mingzhe Yu, Lei Wu, Manyi Li, and Yajie Xu. 2025. Storyweaver: Consistent multi-character open-ended story generation. In International Conference on Intelligent Computing.
  5. [5]Xueqing Deng, Linjie Yang, Qihang Yu, Chenglin Yang, and Liang-Chieh Chen. 2025. Leveraging panoptic scene graph for evaluating fine-grained text-to-image generation. 2025 IEEE/CVF International Conference on Computer Vision (ICCV), pages 15107–15116.DOI
  6. [6]Rinon Gal, Yuval Alaluf, Yuval Atzmon, Or Patashnik, Amit H. Bermano, Gal Chechik, and Daniel Cohen-Or. 2022. An image is worth one word: Personalizing text-to-image generation using textual inversion. ArXiv, abs/2208.01618.arxiv.org/abs/2208.01618
  7. [7]Yuwei Guo, Ceyuan Yang, Anyi Rao, Yaohui Wang, Y. Qiao, Dahua Lin, and Bo Dai. 2023. Animatediff: Animate your personalized text-to-image diffusion models without specific tuning. ArXiv, abs/2307.04725.arxiv.org/abs/2307.04725
  8. [8]Kimia Hamidieh, Haoran Zhang, Walter Gerych, Tom Hartvigsen, and Marzyeh Ghassemi. 2024. Identifying implicit social biases in vision-language models. ArXiv, abs/2411.00997.arxiv.org/abs/2411.00997

Paper details

vlnc:W_dbsrac7v
Version
v1 · latest
Published
Fresh — added to the Hub within the last 30 days
Added
License
CC BY 4.0
Usage

views · 2

downloads · 0

A view counts once per browser per day, a download each time the PDF is requested.

  • Computer Science

AI tools

View statement
Looking for related papers…
Contents