betaFeedback

WorksComputer Science

Lines Are Ideas: Visual Creativity Assessment in Hyperbolic Space

Abstract

Assessing human creativity from drawings provides a scalable way to evaluate human creative ability. However, existing approaches either rely on costly expert annotation or treat creativity as a single regression target, overlooking its underlying structure. Psychological theories have long emphasized that creativity emerges from balancing novelty and appropriateness. Motivated by this principle, we recast creativity as structured semantic deviation between paired drawings, where novelty measures the extent of departure from the original base sketch, and appropriateness determines whether such departures remain meaningful. This formulation naturally leads to a hyperbolic representation, in which novelty is quantified by geodesic distance and appropriateness is evaluated conditionally via a learned decision boundary, further regulated by an abstraction-conditioned adaptive constraint. Experiments on AuDrA-Drawings demonstrate state-of-the-art alignment with expert judgments and strong robustness under rater and task shifts. Beyond performance gains, our framework reveals an interpretable radial organization of creative variation, offering a principled geometric foundation for automatic creativity assessment.

Introduction

Creativity is central to human intelligence, yet remains difficult to assess objectively [11, 15]. Existing approaches often rely on subjective and time-consuming human evaluations [1, 13, 23], motivating the need for more intuitive and perception-grounded alternatives. Psychophysical evidence [3, 7] suggests that creativity can manifest in remarkably simple settings: given the same sparse drawing composed of only a few lines, individuals may produce highly diverse reinterpretations, ranging from literal reproductions to abstract and imaginative transformations. Such variability enables creativity to be assessed by directly comparing an original sketch with its creative outcome. Following this vein, several psychophysics studies [2, 5, 19] collected original–creative image pairs with overall creativity scores, which subsequently inspired computational models for automatic creativity assessment [16, 18, 24, 25].

A critical advantage of the paired setting is that it turns creativity into a measurable transformation: the creative outcome should deviate from the original one to exhibit novelty (i.e., originality and unexpectedness), while preserving enough semantic interpretability to remain appropriate within the context. This novelty–appropriateness view is consistent with classic theories of creativity [21]. However, turning this principle into a robust computational metric is non-trivial. Most computational approaches implicitly assume that creative artifacts reside in a Euclidean latent space [8, 9], and measure deviation using Euclidean distances, e.g., Δ2=∥x−y∥2\Delta_2 = \lVert x-y\rVert_2. This assumption conflicts with the structure of conceptual knowledge: conceptual spaces are non-uniform, with dense regions around prototypical concepts and sparse regions for rare or abstract realizations; moreover, conceptual organization is inherently hierarchical (e.g., animal →\to mammal →\to cat), which Euclidean geometry with its polynomial volume growth struggles to represent. As a result, the same Euclidean displacement may correspond to qualitatively different conceptual shifts – as shown in Figure 1, it may flip a dense prototype from cat to dog, but in a sparse abstract region it may only alter rendering style while preserving the concept.

Motivations: Euclidean and hyperbolic space representations

Figure 1. Motivations. (a) Euclidean geometry is struggles to model the non-uniform, hierarchical concept spaces; (b) hyperbolic geometry provides structure-aware representations via radius- and geodesic-based deviation.

In this work, we argue that hyperbolic geometry provides a suitable inductive bias for creativity assessment: its negative curvature yields exponential volume growth, aligning naturally with hierarchical and non-uniform conceptual organization, and has been effective for modeling taxonomies and semantic hierarchies [10, 17]. We argue that the creative visual concepts share this structure, with prototypical cores and increasingly diverse yet sparser realizations toward the periphery. Accordingly, we formulate creativity through novelty and appropriateness in hyperbolic space: novelty is measured as the hyperbolic geodesic distance between the original and creative embeddings, while appropriateness is determined by whether such deviation remains semantically coherent, conditioned on semantic uncertainty and implemented via a hyperbolic decision boundary. We then map this appropriateness signal to the final creativity score, since creativity should reward novelty only when it is semantically meaningful rather than arbitrary distortion.

Our contribution can be summarized as follows:

  • Hyperbolic-space creativity assessment. We propose a hyperbolic creativity assessment framework that models creative transformation as structured semantic deviation and operationalizes creativity through a novelty–appropriateness formulation.

  • Style-aware constrained hyperbolic representation. We introduce an style-conditioned adaptive constraint in a Poincaré ball, enabling controlled deviation that accommodates stylistic variation while preventing semantically incoherent drift.

  • Hyperbolic novelty–appropriateness assessment. We measure novelty via hyperbolic geodesic distance and estimate appropriateness by combining novelty with semantic uncertainty and a hyperbolic decision boundary, yielding a final creativity score that rewards novelty only when it is semantically coherent.

Related Work

Psychological Foundations of Creativity Assessment

Creativity is most commonly defined in psychology as the ability to produce outcomes that are both novel and appropriate to task constraints. This dual-criterion formulation has been consistently emphasized in influential theories, notably by Sternberg and Lubart [21], and has become the dominant conceptual basis for creativity assessment. Visual creativity evaluations largely operationalize this definition through task-based drawing or imagery paradigms. The figural Torrance Tests of Creative Thinking (TTCT) [23] assess how individuals transform given shapes into meaningful drawings, scoring originality and task-relevant elaboration. Similarly, the Test of Creative Imagery Abilities (TCIA) [13] evaluates originality and the meaningful development of mental images. More recent tablet-based protocols such as Multi-Trial Creative Ideation (MTCI) [3] further capture fine-grained drawing behaviors across multiple trials, but still evaluate creative products primarily along originality and appropriateness-related dimensions. Beyond specific task designs, the Consensual Assessment Technique (CAT) [1] formalizes creativity evaluation via expert agreement, where judgments implicitly reflect both originality and contextual suitability. Despite diverse experimental settings and scoring schemes, these paradigms consistently converge on novelty and appropriateness as the core evaluative dimensions, motivating our explicit two-factor formulation for image creativity assessment.

Computational Modeling of Visual Creativity

Recent studies explore automatic visual creativity assessment using deep networks trained to predict human ratings from drawings or paintings, motivated by divergent thinking theories. Early CNN-based models were developed for TTCT-style tasks [4], with later extensions using deeper backbones and explainability tools [18, 25]. More scalable systems predict continuous creativity scores from large annotated datasets, such as AuDrA [19], or combine stylistic descriptors with content embeddings to improve interpretability, as in Pencils-to-Pixels [16]. This content–style perspective inspires our use of semantic category alignment and stylistic abstraction cues for creativity assessment.These methods demonstrate that visual creativity can be learned from data, but mainly rely on global score regression in Euclidean latent spaces.

Despite progress, three limitations remain. First, Euclidean embeddings poorly capture hierarchical and unevenly distributed conceptual structures, where novel ideas lie in sparse peripheral regions. Second, generalization across different creative prompts and semantic contexts remains limited [19]. Third, visual deviation is often rewarded without explicit constraints on semantic or functional appropriateness, conflating novelty with arbitrary variation and neglecting a core criterion of creativity [21].

Methodology

Herein, we introduce the Hyperbolic-Space-based Creativity Assessment framework (denoted as HSCA). Our core idea is to model creativity as a form of structured semantic deviation: a creative image should exhibit sufficient novelty while remaining semantically interpretable. Accordingly, creativity is assessed as a conditional judgment in which appropriateness determines whether a novel deviation constitutes meaningful creativity. As shown in Figure 2, the framework proceeds in four stages: (1) multimodal feature extraction for obtaining content representations; (2) semantic and stylistic alignment to ground creative transformations; (3) constrained hyperbolic representation to regulate allowable deviation, and (4) novelty–appropriateness assessment to derive the final creativity score.

Hyperbolic-space creativity assessment framework

Figure 2. Hyperbolic-space creativity assessment framework. The pipeline consists of four stages: (1) multimodal feature extraction using CLIP encoders to obtain visual features (Fv\mathcal{F}_v, F~v\widetilde{\mathcal{F}}_v) and semantic anchors Ft\mathcal{F}_t; (2) semantic category alignment via cosine similarity to produce content logits zcz_c and abstraction level alignment via an MLP head to obtain zsz_s; (3) constrained hyperbolic representation by exponential mapping into a Poincaré ball with an abstraction-conditioned adaptive constraint; and (4) creativity scoring via novelty Dnov=dH(h,h~)D_{\mathrm{nov}} = d_{\mathbb{H}}(\mathbf{h}, \widetilde{\mathbf{h}}) and appropriateness computed from (Dnov,Hsem)(D_{\mathrm{nov}}, H_{\mathrm{sem}}), yielding the final creativity score.

Creativity Representation Grounding

Creativity assessment over original-creative image pairs is inherently comparative, requiring a shared representational reference to quantify how creative image deviates from the original one. We therefore encode the original and creative images with a pretrained CLIP image encoder EvE_v, obtaining paired visual embeddings Fv\mathcal{F}_v, F~v∈RD\widetilde{\mathcal{F}}_v \in\mathbb{R}^{D} in a shared visual-semantic space. To further ground the comparison in an interpretable semantic context, we introduce a small set of high-level content prompts: We construct prompts T(c)\mathcal{T}(c) by filling the template “a photo of {c}”, c∈C={“plant”,“animal”,“human”,“object”,“other”}c \in\mathcal{C} = \{\textit{“plant”}, \textit{“animal”}, \textit{“human”}, \textit{“object”}, \textit{“other”}\}. These prompts serve as semantic anchors that partition the embedding space into coarse conceptual regions. We then encode these prompts using the CLIP text encoder EtE_t:

Ft=Et(T(c)),∀c∈C,(1)\mathcal{F}_t = E_t\left(\mathcal{T}(c)\right), \quad\forall c \in\mathcal{C}, \tag*{(1)}

where the Ft∈R∣C∣×D\mathcal{F}_t \in\mathbb{R}^{|\mathcal{C}| \times D} denotes the textual embeddings.

Semantic and Stylistic Alignment

Following the content–style perspective [16], we extract two complementary alignment signals from each original and creative image pair to ground subsequent deviation modeling: a coarse semantic alignment to high-level content anchors; and a stylistic cue in terms of abstraction level, which indicates how the concept is rendered.

Semantic Category Alignment. To ensure interpretability, we align the creative image with a set of coarse semantic categories that serve as conceptual anchors in the shared CLIP embedding space. After ℓ2\ell_2-normalizing the visual and textual embeddings, we compute cosine similarity to measure semantic alignment:

zc=cos⁡(F~v,Ft),(2)z_c = \cos\left(\widetilde{\mathcal{F}}_v,\mathcal{F}_t\right), \tag*{(2)}

where the logits zcz_c form a soft semantic alignment distribution, characterizing the content consistency and semantic uncertainty in creative transformations.

Stylistic Abstraction Alignment. Beyond semantic content, creativity is also affected by how an idea is visually expressed. In particular, the abstraction level indicates whether creative deviation arises primarily from stylistic transformation rather than semantic change. To capture this factor, we introduce a stylistic abstraction alignment branch to estimate the abstraction level as a proxy for stylistic deviation. More specifically, we predict abstraction from the feature norm ∥F~v∥\lVert\widetilde{\mathcal{F}}_v\rVert, motivated by evidence that the magnitude of CLIP image embeddings encodes informative cues that are suppressed by cosine similarity due to ℓ2\ell_2 normalization [14]. Empirically, we observe that the ∥F~v∥\lVert\widetilde{\mathcal{F}}_v\rVert increases with the abstraction level (see § 5). This suggests that ∥F~v∥\lVert\widetilde{\mathcal{F}}_v\rVert provides a simple yet informative cue for stylization. Accordingly, we apply a lightweight classification head to the creative image embedding:

zs=MLP⁡(∥F~v∥),(3)z_s = \operatorname{MLP}\left(\lVert\widetilde{\mathcal{F}}_v\rVert\right), \tag*{(3)}

which outputs three abstraction categories: abstract, general, and concrete. This branch provides auxiliary supervision during training and yields a stylistic signal used to regulate the allowable extent of creative deviation in subsequent hyperbolic modeling.

Constrained Hyperbolic Representation

The semantic and stylistic alignment signals specify where creative deviation occur and how an idea is visually expressed. However, they do not determine how far a creative representation is allowed to deviate. Without explicit regulation, large deviations in latent space may correspond to arbitrary distortions rather than meaningful creative transformation. We therefore embed representations in a hyperbolic space and impose a style-conditioned constraint to regulate the allowable deviation range.

Euclidean-to-Hyperbolic Projection. Given the creative visual embedding F~v\widetilde{\mathcal{F}}_v, we map it into a dd-dimensional Poincaré ball with curvature κ>0\kappa> 0. We first apply a learnable linear transformation W\mathbf{W}, followed by the exponential map at the origin point o\mathbf{o}:

h=exp⁡oκ(WF~v).(4)\mathbf{h} = \exp_{\mathbf{o}}^{\kappa}\left(\mathbf{W}\widetilde{\mathcal{F}}_v\right). \tag*{(4)}

In the Poincaré ball model, the norm ∥h∥\lVert\mathbf{h}\rVert corresponds to the radial distance from the semantic center, providing a natural geometric measure of conceptual deviation: larger radial indicate greater departure from prototypical representations.

Style-conditioned Adaptive Constraint. Conceptual spaces are inherently non-uniform: concrete creations concentrate near dense cores, whereas abstract ones occupy sparser peripheral regions. Consequently, applying a uniform deviation constraint would either over-penalize abstract creations which legitimately require larger stylistic shifts, or under-constrain concrete depictions which should remain close to the semantic core for interpretability. To address this, we introduce an adaptive geometric constraint conditioned on the stylistic alignment signal, which modulates the allowable hyperbolic radius according to abstraction. Specifically, the style logits zsz_s are mapped to a continuous coefficient α∈(0,1)\alpha\in(0, 1) via a lightweight gating function:

α=σ(g(zs)),(5)\alpha= \sigma\left(g(z_s)\right), \tag*{(5)}

where g(⋅)g(\cdot) denotes a learnable multilayer perceptron and σ(⋅)\sigma(\cdot) is the sigmoid function. The hyperbolic representation is then constrained as:

∥h∥≤(1−α)1κ,(6)\lVert\mathbf{h} \rVert\le(1-\alpha)\frac{1}{\sqrt{\kappa}}, \tag*{(6)}

which adaptively regulates the allowable deviation radius according to stylistic abstraction. The resulting constrained hyperbolic representations define a structured space in

which novelty and appropriateness are subsequently evaluated.

Creativity Scoring via Novelty-Appropriateness

Inspired by the creativity theories [21], we model creativity through two coupled factors: novelty measures how far the creative result deviates from its reference, whereas appropriateness determines whether this deviation remains semantically coherent and thus constitutes meaningful creativity.

Novelty Assessment. Given the hyperbolic embeddings h\mathbf{h} and h~\widetilde{\mathbf{h}} for the original and creative images, we quantify novelty by the hyperbolic geodesic distance [6, 10, 16, 17]:

Dnov=dH(h,h~).(7)D_{\mathrm{nov}} = d_{\mathbb{H}}(\mathbf{h}, \widetilde{\mathbf{h}}). \tag*{(7)}

In the exponential metric expansion of hyperbolic space, this distance naturally captures large yet structured deviations.

Appropriateness Assessment. Appropriateness is not an absolute property but depends on the degree of novelty: as deviation increases, the criterion for being “reasonable” shifts from literal similarity to conceptual interpretability. Therefore, we assess appropriateness by combining novelty with a measure of semantic coherence derived from semantic alignment. Specifically, we measure the semantic uncertainty from the content logits zcz_c:

Hsem=−∑c∈Cpclog⁡pc,(8)H_{\mathrm{sem}}=-\sum_{c\in\mathcal{C}}p_c\log p_c, \tag*{(8)}

where pc=Softmax⁡(zc)p_c=\operatorname{Softmax}(z_c). The lower uncertainty indicates concentrated semantic alignment, and higher uncertainty reflects semantic ambiguity. We then form a joint descriptor u=[Dnov,Hsem]\mathbf{u}=[D_{\mathrm{nov},H_{\mathrm{sem}}}] and map it into hyperbolic space:

ha=exp⁡0c(Wau),(9)\mathbf{h}_a=\exp_{0}^{c}(\mathbf{W}_a\mathbf{u}), \tag*{(9)}

with a learnable projection Wa\mathbf{W}_a. As such, appropriateness is defined as the signed distance to a hyperbolic hyperplane H\mathcal{H} parameterized by (p0,w)(\mathbf{p}_0,\mathbf{w}):

Dapp=sign⁡(⟨w,log⁡p0(ha)⟩)⋅dH(ha,H),(10)D_{\mathrm{app}}=\operatorname{sign}\left(\langle\mathbf{w},\log_{\mathbf{p}_0}(\mathbf{h}_a)\rangle\right)\cdot d_{\mathcal{H}}(\mathbf{h}_a,\mathcal{H}), \tag*{(10)}

which indicates whether the creative deviation falls within the region of meaningful conceptual expansion. For the Poincaré ball model [10], this signed distance admits a closed-form expression.

Creativity Assessment. Finally, we map the appropriateness signal to a bounded creativity score:

S=σ(Dapp+b),(11)S=\sigma(D_{\mathrm{app}}+b), \tag*{(11)}

where bb is a learnable bias term. This formulation ensures that creativity is rewarded only when novelty is justified by semantic coherence, penalizing both trivial reproductions and semantically incoherent deviations.

Experiments

Experimental Settings

To comprehensively assess both in-domain performance and cross-condition robustness, we conduct experiments under a unified evaluation protocol on the AuDrA benchmark [19]. This benchmark enables systematic analysis of creativity assessment models under controlled variations of rater composition and task formulation, allowing us to disentangle standard fitting ability from true generalization capability. The evaluations along three axes: (i) performance on held-out samples with consistent rater distributions, (ii) robustness to unseen annotators, and (iii) joint generalization to novel raters and task domains.

Model training and primary evaluation are performed on the Primary Dataset (PD), which contains 11,075 abstract drawings annotated on a five-point creativity scale. The data are randomly partitioned into training, validation, and test splits with ratios of 70%, 10%, and 20%, respectively. All reported in-domain results are measured on the held-out test split. Each sample is scored by 50 trained annotators,

resulting in highly consistent ratings with an intraclass correlation coefficient (ICC) exceeding 0.89, which provides a stable supervision signal for learning.

Beyond standard evaluation, we further assess generalization using three auxiliary subsets that are excluded from training. Two subsets, namely Rater Generalization 1 (RG1) and Rater Generalization 2 (RG2), share the same abstract drawing domain as PD but are annotated by independent rater groups, enabling evaluation of robustness to rater shift. RG1 consists of 670 samples rated by three new annotators (ICC = 0.73), while RG2 contains 722 samples rated by six new annotators (ICC = 0.90). In addition, a more challenging subset, referred to as Rater & Task Generalization (FG), includes 679 drawings depicting concrete object categories rather than abstract patterns, and is rated by three unseen annotators (ICC = 0.63). This subset jointly probes both rater and task transferability. Statistical summaries of all subsets are provided in Table 1.

SubsetType#SamplesRatersICC
PDAbstract11,07550>0.89>0.89
RG1Abstract6703 new raters0.73
RG2Abstract7226 new raters0.90
FGObjects6793 new raters0.63

Table 1. Summary of the AuDrA dataset [19].

We follow the official training protocol of the AuDrA benchmark, with a batch size of 16, a learning rate of 1×10−51\times10^{-5}, and a maximum of 136 training epochs. We adopt ViT-L/14 as the visual encoder and keep it frozen throughout training. All images are resized to 224×224224\times224. Model performance is evaluated using Spearman Rank Correlation Coefficient (SRCC) and Pearson Linear Correlation Coefficient (PLCC) between predicted creativity scores and the normalized Joint Rater Truth (JRT) annotations.

Experimental results

Performance on the Primary Set. We evaluate our HSCA on the primary test split against a diverse set of baselines, including CLIP-based scoring models built upon ViT-B/32, ViT-B/16, ViT-L/14, RN50, and RN101 under the CLIPIQA+ formulation [24], which scores images via similarity to predefined text prompts (“a photo of good creativity” and “a photo of bad creativity”). We further compare with recent creativity and image quality assessment (IQA) approaches, including AuDrA [19], Pencils-to-Pixels [16], and AGIQA [22]. As shown in Table 2, HSCA achieves the highest SRCC/PLCC of 0.87/0.88, surpassing classical CNNs (VGG16 [20]: 0.52/0.04; ResNet50 [12]: 0.78/0.79), all CLIP-based variants including CLIP-RN101 (0.81/0.81), and prior creativity assessment models such as AuDrA (0.80/0.79) and Pencils-to-Pixels (0.79/-). These results suggest that HSCA more effectively captures the interplay of novelty and appropriateness in drawings, yielding predictions that better align with human judgments.

GroupModelYearSRCCPLCC
VGGVGG1620140.520.04
ResNetResNet3420160.790.81
ResNetResNet5020160.780.79
CLIPIQA+CLIP (ViT-B/32)20230.630.65
CLIPIQA+CLIP (ViT-B/16)20230.670.68
CLIPIQA+CLIP (ViT-L/14)20230.670.69
CLIPIQA+CLIP (RN50)20230.800.81
CLIPIQA+CLIP (RN101)20230.810.81
OthersAudra20240.800.79
OthersAGIQA20250.790.80
OthersPencils-to-Pixels20250.79-
OursHSCA-0.870.88

Table 2. Performance comparison on the primary test set.

Generalization on the other Three Sets. We further evaluate the cross-set generalization of different methods on RG1, RG2, and FG, and report the results in Table 3. It is worth noting that reference images are unavailable in RG2; therefore, following a unified input protocol, we use a blank white image as the reference input. Overall, HSCA consistently achieves the best performance across all three subsets, demonstrating strong robustness under both rater shifts and task variations. Specifically, on RG1, HSCA attains competitive SRCC/PLCC scores of 0.79/0.77, comparable to the strongest CLIP-based and learning-based baselines. More importantly, the performance gap becomes more evident on the more challenging RG2 and FG subsets, where HSCA surpasses all competing methods by clear margins. On RG2, HSCA improves PLCC from 0.67 (Audra and AGIQA) to 0.71, indicating better stability under increased annotation variance. On FG, which involves cross-task generalization, HSCA achieves 0.55/0.56 in SRCC/PLCC, outperforming the best baseline by over 10% relative improvement in correlation. These results suggest that HSCA generalizes more reliably to unseen rating distributions and task settings, validating the effectiveness of our hierarchical creativity inference design for cross-domain deployment.

GroupModelYearRG1RG2FG
SRCCPLCCSRCCPLCCSRCCPLCC
VGGVGG1620140.580.560.390.320.210.12
ResNetResNet3420160.780.750.680.660.450.47
ResNetResNet5020160.800.770.670.650.460.47
CLIPIQA+CLIP (ViT-B/32)20230.690.650.410.430.430.44
CLIPIQA+CLIP (ViT-B/16)20230.730.700.460.470.370.39
CLIPIQA+CLIP (ViT-L/14)20230.720.690.470.480.350.36
CLIPIQA+CLIP (RN50)20230.770.750.670.650.430.45
CLIPIQA+CLIP (RN101)20230.790.760.680.660.370.38
OthersAuDrA20240.780.750.680.670.440.46
OthersAGIQA20250.780.770.680.670.440.45
OursHSCA20250.790.770.720.710.550.56

Table 3. Generalization performance on the three unseen subsets in terms of SRCC and PLCC.

Ablation Study

We conduct ablation experiments to verify the necessity of each component in our framework. Specifically, the ablations aim to disentangle three key aspects of our design: (i) the dual-factor novelty–appropriateness formulation, (ii) the abstraction-conditioned adaptive radius constraint, and (iii) hyperbolic geometric modeling.

Novelty and Appropriateness Decomposition. To analyze the complementary roles of novelty and appropriateness, we independently ablate each component. Disabling the Novelty branch removes explicit measurement of feature deviation between reference and drawing images, leaving only entropy-guided appropriateness estimation. This variant fails across all datasets, yielding near-zero or negative correlations (e.g., PD: −0.01/−0.01, RG1: −0.06/−0.06, FG: 0.05/0.05), indicating that semantic uncertainty alone cannot capture creative variation. In contrast, removing the Appropriateness branch preserves novelty but discards conditional semantic entropy, replacing signed hyperbolic distances with direct regression of DnovD_{\mathrm{nov}}. While performance remains relatively stable on PD and RG1, it collapses on FG (from 0.55/0.56 to −0.25/−0.20), suggesting that novelty without semantic conditioning easily degenerates into unstructured deviation that is poorly aligned with human creativity judgments. These results highlight that novelty provides the necessary stimulus for creativity, whereas appropriateness is essential for constraining novel deviations into meaningful creative outcomes.

Effect of Adaptive Radius. Removing the abstraction-conditioned adaptive radius eliminates style-aware regulation on the allowable deviation range and enforces a fixed geometric boundary for all samples. As shown in Table 4, this leads to consistent and notable performance degradation across all three evaluation sets. The performance loss is particularly evident under generalization settings, indicating that a uniform constraint fails to accommodate varying abstraction levels in creative expressions. These results verify that dynamically adjusting the deviation radius according to abstraction cues is essential for maintaining stable creativity assessment across diverse styles and tasks.

Nov.App.Adaptive RadiusHyperbolicPDRG1FG
SRCC / PLCCSRCC / PLCCSRCC / PLCC
✓✓✓✓0.87 / 0.880.79 / 0.770.55 / 0.56
✗✓✓✓−0.01 / − 0.01−0.06 / − 0.060.05 / 0.05
✓✗✓✓0.86 / 0.850.78 / 0.76−0.25 / − 0.20
✓✓✗✓0.84 / 0.850.78 / 0.760.49 / 0.51
✓✓✗✗0.86 / 0.860.78 / 0.760.50 / 0.50

Table 4. Ablation study results on PD, RG1, and FG. “Nov.” and “App.” denote novelty and appropriateness, respectively.

Role of Hyperbolic Geometry. Replacing hyperbolic modeling with standard Euclidean regression removes both geodesic novelty measurement and signed distance evaluation in hyperbolic space. While PD and RG1 remain relatively stable, FG performance degrades notably (from 0.55/0.56 to 0.50/0.50), indicating that hyperbolic geometry provides additional representational capacity for organizing large and hierarchical semantic deviations, which becomes particularly important under distribution shifts.

Overall, the full model consistently achieves the best performance across all subsets, with particularly strong gains on FG where semantic shifts and task variations are most pronounced. This demonstrates that integrating novelty and appropriateness through adaptive constraints in hyperbolic space is critical for robust creativity assessment under distribution changes.

Visualization of Creativity Assessment

Novelty and Conditional Appropriateness. We analyze how novelty (the hyperbolic geodesic distance DnovD_{\mathrm{nov}}) and appropriateness (the signed distance DappD_{\mathrm{app}} conditioned on the novelty) jointly relate to human creativity judgments in

Figure 3. Specifically, Figure 3 (a) shows the relationship between creativity and novelty. Mean human creativity ratings with ±1\pm1 standard deviation shading are plotted over 20 equal-width bins, excluding bins with fewer than 10 samples. Although creativity generally increases with novelty, the trend is clearly non-linear and less discriminative, indicating that deviation magnitude alone cannot distinguish meaningful creative transformations from arbitrary ones. To account for this, we further evaluate the conditional appropriateness in Figure 3(c), which models whether a novel deviation remains structurally valid. Samples are binned using the same strategy as in (a). In contrast to novelty alone, creativity exhibits a near-monotonic and more linear increase with DappD_{\mathrm{app}}, indicating that once novelty is present, appropriateness becomes the dominant factor in determining perceived creativity.

Figure 3. Correlation between creativity, novelty, and conditional appropriateness. (a) and (b): Correlations of novelty and appropriateness. (b) and (d): Example drawings illustrating how creativity and appropriateness tend to increase with novelty. Under similar novelty levels, higher conditional appropriateness leads to substantially higher creativity scores. “App.” denotes the appropriateness.

Qualitative examples are presented in Figure 3 (b) and (d). Figure 3 (b) illustrates that human creativity ratings generally increase with novelty. In contrast, Figure 3 (d) shows that for drawings with comparable novelty, higher conditional appropriateness leads to substantially higher creativity scores. These observations support our formulation that creativity is not determined by novelty in isolation, but by whether novel deviations remain semantically and structurally coherent.

Abstraction Level via Feature Norm.

To analyze how stylistic abstraction is reflected in visual representations, we visualize the norm of CLIP image embeddings for drawings grouped by abstraction level.

Figure 4 (a) reports the mean embedding norm for each style group, revealing that more abstract drawings tend to exhibit slightly larger representation norms. This suggests that abstraction influences how far samples deviate from the semantic center even before hyperbolic projection.

Figure 4. Representation magnitude versus abstraction level. (a) Mean norm of CLIP visual embeddings for drawings grouped by abstraction level. (b) Example drawings corresponding to each abstraction category.

Figure 4 (b) shows representative examples from each style category. These results provide diagnostic evidence that abstraction information is implicitly encoded in the visual feature space, motivating our design of abstraction-conditioned adaptive constraints in the subsequent hyperbolic modeling stage. We emphasize that this analysis is intended to reveal representation tendencies rather than to claim large effect sizes.

Euclidean vs. Hyperbolic Feature Organization.

To examine how hyperbolic projection reshapes the representation geometry, Figure 5 visualizes both Euclidean and hyperbolic features of drawings from the primary test set using two-dimensional dimensionality reduction. For fair comparison, we visualize the penultimate-layer features used for creativity regression in both cases: (i) Euclidean features obtained after the MLP mapping from CLIP embeddings, and (ii) their corresponding hyperbolic projections in the Poincare ball (i.e., hh in Eqn. (3)). Each point represents a drawing, colored by its ground-truth creativity rating.

Euclidean features and corresponding hyperbolic embeddings colored by creativity rating

Figure 5. Feature geometry in Euclidean vs. hyperbolic space. (a) Euclidean features (b) corresponding hyperbolic embeddings.

As shown in Figure 5 (a), Euclidean features exhibit no clear global organization with respect to creativity scores, and samples with different ratings are largely intermingled. In contrast, Figure 5 (b) reveals a clear radial structure in hyperbolic space: higher creativity scores tend to concentrate farther from the center, while lower scores cluster closer to the origin. This hierarchical arrangement is consistent with the exponential volume growth property of hyperbolic geometry and supports our design that models creative deviation as increasing radial distance from semantic prototypes.

Conclusion

We presented HSCA, a hyperbolic-space framework that models creativity as structured semantic deviation by jointly quantifying novelty and appropriateness. An abstraction-conditioned adaptive radius is further introduced to regulate semantic drift while preserving stylistic flexibility. Extensive experiments on AuDrA-Drawings demonstrate state-of-the-art alignment with human judgments and improved robustness under distribution shifts, with ablations validating the role of each component and the advantage of hyperbolic geometry. These results suggest hyperbolic representations offer a principled and interpretable basis for creativity assessment. Future work will extend this formulation to richer semantic conditioning and broader creative domains.

References

  1. [1]Teresa M Amabile. Social psychology of creativity: A consensual assessment technique. Journal of Personality and Social Psychology, 43(5):997–1013, 1982. 1, 2DOI
  2. [2]Wilma A Bainbridge. A tutorial on capturing mental representations through drawing and crowd-sourced scoring. Behavior Research Methods, 54(2):663–675, 2022. 1DOI
  3. [3]Baptiste Barbot. The dynamics of creative ideation: Introducing a new assessment paradigm. Frontiers in Psychology, 9:2529, 2018. 1, 2DOI
  4. [4]David H Cropley and Rebecca L Marrone. Automated scoring of figural creativity using a convolutional neural network. Psychology of Aesthetics, Creativity, and the Arts, 2022. 2
  5. [5]David H Cropley and Rebecca L Marrone. Automated scoring of figural creativity using a convolutional neural network. Psychology of Aesthetics, Creativity, and the Arts, 19(1):77, 2025. 1
  6. [6]Karan Desai, Maximilian Nickel, Tanmay Rajpurohit, Justin Johnson, and Ramakrishna Vedantam. Hyperbolic image-text representations. In Proceedings of the 40th International Conference on Machine Learning, pages 7694–7731. PMLR, 2023. 4arxiv.org/abs/2304.09172
  7. [7]Ronald A Finke, Steven Pinker, and Martha J Farah. Reinterpreting visual patterns in mental imagery. Cognitive Science, 13(1):51–78, 1989. 1
  8. [8]Adam Foster. Creativity and machine learning: A survey. ACM Computing Surveys, 52(3):1–38, 2019. 2
  9. [9]Giulia Franceschelli and Mirco Musolesi. Deepcreativity: Measuring creativity with deep learning techniques. IEEE Transactions on Artificial Intelligence, 3(6):872–883, 2022. 2DOI
  10. [10]Octavian-Eugen Ganea, Gary Béćigneul, and Thomas Hofmann. Hyperbolic neural networks. In Proceedings of the International Conference on Neural Information Processing Systems, page 5350–5360, 2018. 2, 4, 5arxiv.org/abs/1805.09112
  11. [11]J. P. Guilford. Creativity. American Psychologist, 5(9):444–454, 1950. 1pubmed.ncbi.nlm.nih.gov/14771441
  12. [12]Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pages 770–778, 2016.arxiv.org/abs/1512.03385
  13. [13]Dominika M Jankowska and Maciej Karwowski. Measuring creative imagery abilities. Frontiers in Psychology, 6:1591, 2015.DOI
  14. [14]Zhicheng Liao, Dongxu Wu, Zhenshan Shi, Sijie Mai, Hanwei Zhu, Lingyu Zhu, Yuncheng Jiang, and Baoliang Chen. Beyond cosine similarity magnitude-aware clip for no-reference image quality assessment, 2025.
  15. [15]Haiying Long and Jue Wang. Dissecting reliability and validity evidence of subjective creativity assessment: A literature review. Educational Psychology Review, 34(3):1399–1443, 2022.DOI
  16. [16]S. S. Nath, G. del Cuvillo y Schröder, and C. Stevenson. Pencils to pixels: A systematic study of creative drawings across children, adults and ai. In Proceedings of the 47th Annual Meeting of the Cognitive Science Society, pages 1–12, 2025. Peer-reviewed version.
  17. [17]Maximilian Nickel and Douwe Kiela. Poincaré embeddings for learning hierarchical representations. In Advances in Neural Information Processing Systems, pages 6338–6347, 2017.arxiv.org/abs/1705.08039
  18. [18]Anastasia S Panfilova, Ekaterina A Valueva, and Ivan Y Ilyin. The application of explainable artificial intelligence methods to models for automatic creativity assessment. Frontiers in Artificial Intelligence, 7:1310518, 2024.DOI
  19. [19]John D Patterson, Baptiste Barbot, James Lloyd-Cox, and Roger E Beaty. Audra: An automated drawing assessment platform for evaluating creativity. Behavior research methods, 56(4):3619–3636, 2024.DOI
  20. [20]Karen Simonyan and Andrew Zisserman. Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556, 2014.DOI
  21. [21]R. J. Sternberg and T. I. Lubart. The concept of creativity: Prospects and paradigms. Handbook of Creativity, 1999.DOI
  22. [22]Zhenchen Tang, Zichuan Wang, Bo Peng, and Jing Dong. Clip-agiqa: Boosting the performance of ai-generated image quality assessment with clip. In International Conference on Pattern Recognition, pages 48–61. Springer, 2025.arxiv.org/abs/2408.15098
  23. [23]E Paul Torrance. Torrance tests of creative thinking. Educational and psychological measurement, 1966.
  24. [24]Jianyi Wang, Kelvin CK Chan, and Chen Change Loy. Exploring clip for assessing the look and feel of images. In Proceedings of the AAAI conference on artificial intelligence, pages 2555–2563, 2023.arxiv.org/abs/2207.12396
  25. [25]Zhehan Zhang, Meihua Qian, Li Luo, Ripon Saha, Qianyi Gao, and Xinxin Song. Using a cnn model to assess visual artwork’s creativity. arXiv preprint arXiv:2408.01481, 2024.arxiv.org/abs/2408.01481

Paper details

vlnc:W_wdak9gj8
Version
v1 · latest
Published
Fresh — added to the Hub within the last 30 days
Added
License
CC BY-SA 4.0
Usage

views · 11

downloads · 2

A view counts once per browser per day, a download each time the PDF is requested.

  • Computer Science

Not recorded for this paper

View statement
Looking for related papers…
Contents