betaFeedback

Reading v1View latest version

WorksComputer Science

CropReward: A Human-Preference Benchmark and Reward Model for Aesthetic Image Cropping

Abstract

Aesthetic image cropping (AIC) aims to improve image composition and aesthetic quality by removing extraneous or distracting content. Over the past decade, AIC methods have evolved from specialized vision models to multimodal large language models(MLLMs). Reliable evaluation that reflects human preferences is essential for benchmarking AIC methods and guiding model optimization. However, the current AIC evaluation relies largely on geometry-based metrics such as intersection over union (IoU), as well as image aesthetic assessment(IAA) models. Although inconsistencies with human preferences have long been observed, the robustness and reliability of these evaluation criteria remain underexplored. To bridge this gap, we first construct CropBench, a large-scale benchmark comprising 106,995 human preference pairs for 1,019 images, with each candidate set containing the original image and candidate crops produced by 14 AIC methods. A systematic study on CropBench reveals that the existing criteria, ranging from IoU to off-the-shelf IAA assessment models, only exhibit limited alignment with human preferences. Building upon CropBench, we further propose CropReward, an MLLM-based reward model that evaluates a candidate crop by comparing with the original uncropped image and outputs a score indicating explicit aesthetic improvement or degradation relative to the original. In addition, we employ CropReward to construct CropReward-300k, the largest AIC dataset to date, and further develop CropAlign, a preference-aligned AIC model trained solely with CropReward supervision, without human-annotated crop boxes. Experimental results demonstrate that CropReward aligns with human preferences significantly better than AIC existing criteria. CropAlign also surpasses the state-of-the-art AIC methods, demonstrating the advantage of CropReward in guiding AIC model optimization.

Introduction

Aesthetic image cropping (AIC) aims to improve the composition and aesthetic quality of an image by removing extraneous or distracting content [1], [2]. AIC has widespread applications in photography, content creation and editing, and thumbnail generation [1], [3]. Over the past decade, AIC has made substantial progress through deep learning, with methods evolving from specialized vision models [2], [4] to multimodal large language models (MLLMs) [5]–[7]. For the same image, different methods may produce multiple plausible crops with subtle differences in content and composition. Reliable evaluation that reflects human preferences over cropping results is therefore essential for benchmarking AIC methods and guiding model optimization.

Xiangfei Sheng, Xiaofeng Pan and Leida Li are with the School of Artificial Intelligence, Xi'an Jiaotong University, Xi'an 710071, China (e-mails: [email protected]; [email protected]; [email protected]).

Qian Zhang and Biao Wang are with Huawei Technologies Co., Ltd., Shenzhen 518129, China (e-mails: [email protected]; [email protected]).

Johan Wagemans is with the Laboratory of Experimental Psychology, Department of Brain and Cognition, KU Leuven, 3000 Leuven, Belgium (email: johan.wagemans@ kuleuven.be).

Weisi Lin is with the College of Computing and Data Science, Nanyang Technological University, Singapore (e-mail: [email protected]).

In the literature, AIC evaluation has relied heavily on geometry-based metrics [4], [5], [8], among which intersection over union (IoU) is the most representative, although its inconsistency with human preferences has long been observed [2]. As illustrated in Figure 1(a), metrics like IoU require expert-annotated reference boxes and measure the spatial alignment between a predicted crop and these references. An image may admit multiple pleasing crops with different compositions, so deviating from the reference box does not necessarily indicate a bad crop. Moreover, these metrics only consider box coordinates and may assign similar scores to a crop that preserves the main subject and another one that cuts off part of it. Recent work has also explored using image aesthetic assessment (IAA) models to evaluate cropping results directly [5], [9]. However, scoring a crop in isolation does not directly account for what has been removed or how the composition has changed relative to the original image. A high aesthetic score therefore does not necessarily mean that people prefer the crop to the original. In the example at the bottom of Figure 1, VILA [10] ranks crop C first, although annotators prefer the original image to this crop. These limitations motivate us to rethink existing evaluation criteria and raise a central question: How should we comprehensively and fairly measure the performance of AIC models?

Existing evaluation criteria versus the proposed CropReward

Figure 1. Existing evaluation criteria versus the proposed CropReward. (a) Geometry-based metrics compare the coordinates of predicted and expert reference boxes, while image aesthetic assessment (IAA) models score each crop in isolation. (b) CropReward takes the original image and a crop as input and outputs a score relative to the original image, with positive and negative values indicating predicted improvement and degradation, respectively. Bottom: An example from CropBench. IoUmean_{\mathrm{mean}} is computed over the three expert reference boxes shown on the left. Numbers in parentheses denote ranks.

We argue that reliable evaluation of AIC methods should meet two requirements. (1) Assessing the effectiveness of cropping. Cropping may improve or degrade the aesthetic quality of the original image. Evaluation should therefore assess whether people prefer the resulting crop to the original image or vice versa. (2) Distinguishing subtle differences among candidate crops. Crops of the same image may differ slightly in their boundaries, yet these differences can affect the content and composition of the resulting crops. Evaluation model should faithfully reflect human preferences among similar crops. However, how well existing evaluation criteria meet the above requirements remains unclear.

To address the above challenges, we first construct CropBench, a large-scale human preference benchmark for AIC task. It comprises 106,995 human-annotated preference pairs of crops produced by 14 AIC methods on 1,019 images covering both general and portrait photography. The original image is also included when forming the preference pairs, and all candidate pairs are annotated with an explicit option for ties. We further calculate preference scores using a tie-aware Bradley–Terry (BT) model, with the score of the original image anchored at zero within each candidate set. Based on CropBench, we conduct a systematic study of existing AIC evaluation criteria, ranging from IoU to state-of-the-art IAA models, revealing that all existing criteria achieve only limited consistency with human preferences. CropBench also supports benchmarking of current AIC methods. The results reveal a phenomenon that is often overlooked in AIC: even the top-ranked models sometimes produce crops that people prefer less than the original image.

Building on the above findings, we further propose CropReward, an MLLM-based reward model trained on the preference annotations of CropBench, which satisfies the two aforementioned requirements. As illustrated in Figure 1(b), CropReward takes both the original image and a candidate crop as input, allowing it to consider what is retained and what is removed without requiring expert-annotated reference boxes. Its output is expressed relative to the original image, with positive and negative scores indicating predicted improvement and degradation in aesthetic quality, respectively. To distinguish similar crops, we further introduce a pairwise difference

learning objective, based on which the model is trained to predict the difference in human preference scores between two crops. We further explore the potential of CropReward for guiding AIC model optimization. We first use it to select crops generated by existing AIC methods on a large number of unlabeled images, based on which we build CropReward-300K, a large-scale AIC dataset containing over 300,000 original images, each paired with a CropReward-selected crop box. We then develop CropAlign, an MLLM-based cropping model trained through supervised fine-tuning on this dataset and further optimized through reinforcement learning with CropReward as the reward.

The contributions of this work are threefold:

  • We build CropBench, a large-scale human preference benchmark for AIC task, using a hybrid annotation strategy that determines the number of human annotators per pair based on agreement among five MLLM judges. The benchmark contains 106,995 pairwise labels covering outputs from 14 AIC models and the corresponding original images, supporting systematic evaluation of both existing criteria and AIC methods.

  • We propose CropReward, an MLLM-based reward model that learns fine-grained cropping preferences to assess whether cropping improves or degrades the original composition, which aligns substantially better with human preferences than existing criteria.

  • We construct CropReward-300K, a large-scale AIC dataset curated by CropReward without the need of human annotation, and develop CropAlign, an advanced cropping model optimized with CropReward that achieves the state-of-the-art performance on multiple benchmarks, including CropBench, and existing cropping datasets, FLMS and FCDB.

Related Work

Aesthetic Image Cropping

Early AIC methods searched for crop windows using handcrafted cues such as saliency, composition rules, and boundary simplicity [11]. Two common paradigms in deep learning-based AIC are crop regression and candidate ranking, as illustrated in Figure 2(a) and Figure 2(b). Crop regression methods directly predict a crop box from the input image [4, 16, 17]. The composition-aware cropping network (CACNet) [4] recognizes composition patterns to guide crop prediction. To alleviate reliance on expert annotations, Hong et al. [16] outpainted professional photographs, treating the original image as the target crop of a larger outpainted image. By contrast, candidate ranking methods score a set of candidate crops and select the highest-scoring one [2, 13, 14, 15, 19, 20, 21, 22]. Wei et al. [13] trained a crop scoring network using human judgments of relative crop quality. Zeng et al. [2, 14] proposed grid anchor-based image cropping (GAIC), which uses grid anchors to generate candidate crops and a lightweight model to score them. In crop regression, training against a target box penalizes deviations from that box, even when alternative crops are equally good. Candidate ranking can learn human preferences among crops. However, when the original image is excluded from the training comparisons, these preferences do not establish whether a crop is preferred to the original.

Three training paradigms for AIC

Figure 2. Three training paradigms for AIC. (a) Crop regression learns to predict a target crop box. (b) Candidate ranking learns to score candidate crops. (c) Reward-guided exploration uses CropReward to evaluate each generated crop by comparing with the uncropped original image. The resulting reward is used to optimize the cropping policy toward human preferences without relying on human-annotated crop boxes.

Beyond direct regression and ranking, Li et al. [23] introduced aesthetics-aware reinforcement learning (A2-RL), an early attempt to optimize cropping through a sequence of window-adjustment actions. Its reward was derived from an image aesthetic classifier rather than learned from human preferences over crop decisions. More recently, MLLMs have been applied to AIC [5, 6, 7]. Sheng et al. [6] applied instruction tuning to MLLMs for AIC. Du et al. [7] first trained an MLLM to identify aesthetic problems and suggest improvements, then fine-tuned it using chain-of-thought rationales to predict crop boxes and explain the cropping decisions. In this work, we train CropReward on human preferences among candidate crops with the original image included. Then the score of CropReward naturally serves as a better reward for optimizing a cropping model without human-annotated crop boxes, as illustrated in Figure 2(c).

AIC Datasets and Evaluation Protocols

Table I summarizes representative AIC datasets categorized by their candidate sources and annotation types. Expert-crop datasets [3, 11, 12] provide one or several human-annotated crop boxes for each image. These boxes serve as training targets and as references for geometry-based evaluation. Candidate-scoring datasets [2, 13, 14, 15] collect human judgments of crop quality over candidates generated by existing algorithms, grid anchors, or random sampling. These annotations support training and evaluation of candidate ranking models. Synthetic-crop datasets [16, 17] construct training pairs automatically through outpainting and pseudo-crop refinement. FGAesthetics [18] collects pairwise preferences among visually similar images for fine-grained aesthetic assessment. Its cropping subset contains 1,702 series derived from CPC and GAICD datasets, comprising 10,554 crops and 25,644 preference pairs.

DatasetVenueImagesCandidate viewsAnnotation signalCandidate sourceExpert cropsOriginal imageExplicit pairsDomain
Expert-crop datasets
ICDB [3]CVPR 20139502,8503 expert crops/imageExpert crops✓✗✗General
FLMS [11]ACM MM 20145005,00010 expert crops/imageExpert crops✓✗✗General
FCDB [12]WACV 20171,743–34,130 pairwise prefs.Expert crops + random subviews✓✗✓General
Candidate-scoring datasets
CPC [13]CVPR 201810,800259,200Per-annotator candidate labels (0–4)Algorithm-generated + random views✗✗✗General
GAICD-v1 [14]CVPR 20191,236106,8605-level MOSGrid anchors✗✗✗General
GAICD-v2 [2]TPAMI 20203,336288,0695-level MOSGrid anchors✗✗✗General
UGCrop5K [15]AAAI 20245,000450,0005-level MOSGrid anchors✗✗✗UGC
Synthetic-crop datasets
GenCrop [16]AAAI 202488K290KOutpainting-derived crop pairsOutpainted views✗✗✗Subject-aware
ProCrop [17]AAAI 2026242K1.936M8 refined pseudo crops/imageOutpainting + refinement✗✗✗General
Fine-grained preference datasets
FGAesthetics-Crop [18]CVPR 202610,554–25,643 pairwise prefs.Crop series✗✗✓General
CropBench–1,01915,2853 expert crops/image + 106,995 pairwise prefs. + 15,285 BT scores10 AIC models + 4 MLLMs + original image✓✓✓General + Portrait

Table I. Comparison of CropBench with representative AIC datasets. ✓: included; ✗: unavailable. Images denote the number of source images. “Original image” indicates whether the original image is included as a candidate in the comparisons, and “explicit pairs” indicates whether candidate-pair labels are included in the public release.

Evaluation protocols depend on the types of annotations. IoU and boundary displacement error (Disp) measure the geometric alignment between predicted and reference crop boxes, whereas ranking metrics such as AccK/NAcc_{K/N} and SRCC compare the predicted scores of candidate crops with their mean opinion scores (MOS) [2]. However, these protocols do not accurately assess whether people prefer the predicted crops relative to the original image or vice versa. CropBench comprises crops of diverse AIC models and the original image in each candidate set, with human preference annotations for all candidate pairs and an explicit option for ties. Expert-annotated crop boxes are also provided for computing geometric metrics. These annotations support various AIC evaluation tasks, including benchmarking AIC methods, evaluating how well existing criteria reflect human preferences, and training a reward model.

Image Aesthetic and Composition Assessment

IAA predicts the aesthetic quality of an image, typically as a score or a distribution of human ratings [24]. To preserve composition and fine details during feature extraction, some methods adopt multi-scale image representations [25], [26]. Beyond visual features alone, vision-language-based methods learn aesthetic representations from images paired with aesthetic comments [10], [27], and MLLM-based models go a step further by producing natural-language explanations of aesthetic judgments [28], [29]. More recently, learning from relative rankings has been explored to distinguish aesthetic differences among similar images [18].

Image composition assessment (ICA) focuses on the spatial arrangement of visual elements. Composition scoring methods model salient regions and their arrangement under different composition patterns [30]. Recent MLLM-based work further explores explanations of composition quality and guidance for improving composition [31], [32].

IAA and ICA models have also been used to evaluate cropping results [5], [9]. However, the discriminative ability of the existing IAA/ICA models are typically limited. In addition, an absolute aesthetic or composition score does not directly indicate whether a crop is preferred to the original image. In this work, we propose CropReward to learn this kind of comparison from human cropping preferences, using both the original image and the crop as input.

Reward Models for Visual Preference Alignment

Reward models learn to predict which outputs people prefer and can be used to evaluate generative models and optimize them through reinforcement learning. They have been studied in text-to-image generation [33, 34, 35, 36], with subsequent applications to image editing [37], [38], photo retouching [39], and image restoration [40]. In this work, CropReward is trained on human preferences among candidate crops and between crops and their original uncropped images. It evaluates each crop together with the original image and provides a positive/negative score relative to the original, which can serve as both an evaluation criterion and a reward for AIC model optimization.

CropBench: A Human-Preference Benchmark for AIC

CropBench provides human preference annotations for benchmarking AIC methods, which is the foundation for assessing existing evaluation criteria and training a reward model. It consists of candidate crop sets and each candidate set contains both the outputs of AIC models and the original uncropped image. We annotate all candidate pairs with an explicit option for ties, allowing comparisons both among crops and with the original image. Figure 3 illustrates the four stages of dataset construction, and Figure 4 shows examples of candidate crop sets from different categories, along with the number of sets in each category.

Four-stage construction pipeline of CropBench

Figure 3. Four-stage construction pipeline of CropBench: image collection, candidate crop generation, preference annotation, and BT-score calculation. Each image has 14 model-generated crops and the original uncropped image as a candidate crop set. Agreement among five MLLM judges determines the number of human annotators assigned to each pair. BT scores are calculated from the final human preference labels, with the score of the original uncropped image anchored at zero.

Overview and statistics of CropBench

Figure 4. Overview and statistics of CropBench. The sunburst chart reports the number of source images (inner ring) and pairwise comparisons (outer ring) for each category, where the portrait domain (left, blue) covers single, group, and environmental portraits, and the general domain (right, pink) covers eight scenarios. For each example, the original image and three representative candidates are shown, ranked by the derived BT scores.

Image Collection

CropBench covers images from both general scenes and portrait photography. For general scenes, eight common categories are considered, including buildings, animals, food, indoor scenes, scenery, night scenes, still life, and plants. For portrait photography, single, group, and environmental portraits are included. Images are drawn from the PARA dataset [41], supplemented by 160 self-collected portrait photographs. We focus on images whose composition has potential for improvement through cropping. An MLLM is first filters out that are already well-composed, would benefit only marginally, or would be harmed by cropping. Three aesthetic experts then review the remaining images. This screening removes 50.4% of the initial general pool and 55.0% of the portrait pool.

We sample the remaining images across aesthetic levels, image orientations, and scene/subject categories. Three aesthetic levels are defined using the ratings provided by PARA for general images and HumanAesExpert [28] scores for portraits. The final benchmark contains 510 general images and 509 portrait images, with median shorter-side lengths of 1,475 and 1,627 pixels, respectively.

Candidate Crop Generation

The candidate crop pool is built from the outputs of real cropping models that span the paradigm spectrum of Sec. II. Specifically, we deploy 10 specialized AIC models, including the regression-based CACNet [4], the ranking-based VFN [19], VEN [13], GAIC [2], HCIC [22], CGS [21], and S2CNet [15], the RL-based A2-RL [23], and the MLLM-based InstructCrop [6] and Venus [7], together with 4 general-purpose MLLMs, namely GPT-5.5 [42], Qwen3.5-4B [43], Qwen3.6-27B [44], and Qwen3.7-Plus [45]. Each model contributes one crop per image. All specialized AIC models are applied with their officially released weights. For candidate ranking methods, we select the top-ranked crop; for other methods, we use the crop they produce directly. The four general-purpose MLLMs use the same prompt, which requests a single crop box in normalized coordinates. Including the original uncropped image produces 15 candidates per image and 15,285 candidates in total. Comparing all (152)=105\binom{15}{2}=105 pairs per image yields 106,995 pairs for annotation.

Hybrid Preference Annotation

Collecting human preferences for 106,995 candidate pairs requires substantial annotation effort. To address this challenge, we design a human-machine collaborative annotation (HMCA) paradigm. Specifically, we use MLLM votes to determine how many human annotators assess each pair, while humans provide all final labels. For each comparison, the judge is shown the original image followed by two candidates and asked to choose candidate A, candidate B, or equivalent (E). Five MLLMs first judge every pair independently, including Gemini 3.5 Flash [46], Claude Opus 4.8 [47], Doubao-Seed-2.0-Pro [48], Kimi K2.5 [49], and MiMo-V2.5 [50]. These judges are different from the candidate-generating models in Sec. III-B. Agreement among the five MLLM votes determines the number of human annotators assigned to each pair. Pairs with unanimous votes (5:0:0) are assigned to two annotators, pairs with vote counts of 4:1:0 or 3:1:1 to four annotators, and pairs with vote counts of 3:2:0 or 2:2:1 to six annotators. Human annotators do not see the MLLM votes. If the assigned human annotators disagree, an additional annotator reviews the pair in a second round. Final labels are determined by majority voting. All 106,995 pairs are annotated by a pool of twenty graduate students specializing in image aesthetics and composition assessment.

We additionally collect three expert-annotated crop boxes per image for geometric evaluation. Three annotators independently select one crop box for each image, aiming to improve overall composition while preserving important visual content and removing distracting regions. The annotation is performed directly on the original images, without referring to model-generated candidates. These reference boxes are separate from the 15 candidates used for preference annotation.

BT-score Calculation

We calculate a preference score for each candidate crop from the pairwise annotations. Let {c0,c1,…,c14}\{c_0,c_1,\ldots,c_{14}\} denote the candidate crop set of an image, where c0c_0 denotes the original image and uiu_i is the preference score of cic_i, i=0,1,2,…,14i=0,1,2,\ldots,14. To account for ties, we use the Davidson extension of the Bradley–Terry model [51, 52]. For a pair of crops (ci,cj)(c_i,c_j), the model defines

P(ci≻cj)=euiZij,P(ci≡cj)=2νe(ui+uj)/2Zij,(1)P(c_i \succ c_j)=\frac{e^{u_i}}{Z_{ij}}, \qquad P(c_i \equiv c_j)=\frac{2\nu e^{(u_i+u_j)/2}}{Z_{ij}}, \tag*{(1)}

where Zij=eui+euj+2νe(ui+uj)/2Z_{ij}=e^{u_i}+e^{u_j}+2\nu e^{(u_i+u_j)/2} and ν≥0\nu\ge0 controls the probability of a tie, and ≡\equiv denotes an equivalent preference between two candidate crops. Given ν\nu, we estimate the scores separately for each image by maximizing the regularized loglikelihood of its 105 annotated outcomes,

max⁡{ui}∑(i,j)log⁡P(yij∣ui,uj,ν)−12σ2∑i≠0ui2,s.t. u0=0,(2)\max_{\{u_i\}} \sum_{(i,j)} \log P\left(y_{ij}\mid u_i,u_j,\nu\right)-\frac{1}{2\sigma^2}\sum_{i\ne0}u_i^2,\qquad\text{s.t. }u_0=0, \tag*{(2)}

where yijy_{ij} is the annotated label. The Gaussian prior with σ=3\sigma=3 limits extreme scores for candidate crops that consistently win or lose. We anchor the score of the original image at zero, so that positive and negative scores indicate improvement and degradation relative to the original image, respectively. CropBench is split by image into a training set of 819 images (85,995 pairs) and a test set of 200 images (21,000 pairs). All candidate crops and comparisons from an image belong to the same split.

Benchmark Analysis

We compare the 14 AIC models using their BT scores. Figure 5(a) shows the score distributions for general and portrait images. To examine the relationship between cropping extent and human preferences, Figure 5(b) shows the mean retained-area ratio for each AIC model. We have three observations.

Split violin plots of image-level Crop BT scores and mean retained-area ratio

Figure 5. Performance and cropping extent of the 14 AIC models on CropBench. (a) Distributions of per-image BT scores for general (blue) and portrait (purple) images, with methods ordered by their overall mean scores. Diamonds denote mean BT scores, and the dashed line marks the original image score of zero. (b) Mean retained-area ratio, defined as the crop area divided by the original image area.

Observation 1: A general-purpose MLLM outperforms specialized AIC models. GPT-5.5 achieves the highest mean BT score for both image categories under zero-shot evaluation, exceeding all ten evaluated specialized AIC models. Venus achieves the second-highest mean score. Significant performance variations have also been observed across MLLMs.

These results motivate us to study whether human preference supervision can further improve AIC models.

Observation 2: Cropping does not always improve the composition of the original image. Several methods have negative mean BT scores. Even the highest-ranked methods may produce some crops with negative scores. These results highlight the need to assess a crop relative to its original, even when the method performs well on average.

Observation 3: Methods differ substantially in cropping extent. A2-RL retains an average of 86.9% of the original image area for general images and 86.0% for portraits, whereas Qwen3.5-4B retains only 25.4% and 23.6%, respectively. GPT-5.5 achieves higher mean BT scores than the above two methods while retaining approximately 72% of the image area for each image category. Retained area alone is thus not informative about crop quality, which also depends on what is kept and how it is composed.

CropReward: A Human-Aligned Reward Model for AIC

Formulation

CropReward learns a scoring function sθ(I,c)s_\theta(I,c) that takes an original image II and a candidate crop cc as input and returns a scalar score. For each training image, let CI={c0,c1,…,c14}C_I=\{c_0,c_1,\ldots,c_{14}\} denote the corresponding candidate crop set, where c0=Ic_0=I is the original image. Each candidate cic_i has a BT preference score uiu_i estimated from human annotations, with u0=0u_0 = 0 as defined in Sec. III-D. We train the model to match differences in these preference scores:

sθ(I,ci)−sθ(I,cj)≈ui−uj,0≤i<j≤14.(3)s_\theta(I,c_i) - s_\theta(I,c_j) \approx u_i-u_j,\qquad0 \leq i < j \leq14. \tag*{(3)}

This objective includes comparisons among candidate crops and between each crop and the original image. We implement it using the normalized pairwise difference (NPD) loss in Sec. IV-C. Expert-annotated reference crop boxes are not required for training or inference.

Model Architecture

We build CropReward on Qwen3.5-4B [43]. As illustrated in Figure 6(a), each candidate crop is scored independently by comparing with the original image with an evaluation prompt. The prompt asks the model to assess composition improvement and content preservation. We append a learnable <AES> token to the prompt and use its final-layer hidden state, denoted by hi\mathbf{h}_i, to predict the candidate score through a two-layer MLP head Rω\mathcal{R}_\omega:

Framework of CropReward

Figure 6. Framework of CropReward. (a) Candidate scoring: an MLLM takes the original image and one candidate crop as input. A regression head predicts a score from the final-layer representation of the <AES> token. (b) Pairwise difference learning: the model is trained to match predicted score differences to BT preference score differences over all candidate pairs, including comparisons with the original image.

si=sθ(I,ci)=Rω(hi).(4)s_i = s_\theta(I,c_i) = \mathcal{R}_\omega(\mathbf{h}_i). \tag*{(4)}

We train the visual patch merger, low-rank adaptation (LoRA) adapters with rank 16 in the language model, the <AES> embedding, and the MLP head. The remaining pretrained parameters are frozen, giving 62M trainable parameters in total.

Pairwise Difference Learning

To implement the learning objective in Eq. (3), we use the NPD loss to compare predicted and BT score differences over all candidate pairs, as illustrated in Figure 6(b):

L=S∣P∣∑(i,j)∈Pℓδ(si−sjS,ui−ujS),(5)\mathcal{L} = \frac{S}{|\mathcal{P}|}\sum_{(i,j)\in\mathcal{P}}\ell_\delta\left(\frac{s_i-s_j}{S},\frac{u_i-u_j}{S}\right), \tag*{(5)}

where P\mathcal{P} contains all (152)=105\binom{15}{2}=105 unordered pairs, ℓδ\ell_\delta is the smooth-ℓ1\ell_1 loss with transition parameter δ\delta, and S>0S>0 is a scale estimated from the training set and fixed throughout training. The transition point δ\delta is defined in normalized units. Unlike a ranking loss that uses only preference order, NPD also supervises the difference in BT preference scores. All candidate pairs contribute to the loss, including those annotated as equivalent. We train CropReward jointly on general and portrait images from the CropBench training split. Optimization settings are provided in Sec. VI-A.

Inference

The NPD loss supervises differences between candidate scores. At inference, we score the original image as a candidate, obtaining sθ(I,I)s_\theta(I,I). The final score of a crop is computed relative to the original image:

rθ(I,c)=sθ(I,c)−sθ(I,I),(6)r_\theta(I,c) = s_\theta(I,c) - s_\theta(I,I), \tag*{(6)}

where cc is a candidate crop of the original image II. A positive score predicts a preference for the crop, while a negative score predicts a preference for the original image. Subtracting the original image score preserves the ranking of candidates from the same image.

Optimizing AIC Models with CropReward

In this section, we use CropReward to select training crops from a large number of unlabeled images and to optimize a cropping model through reinforcement learning.

Construction of CropReward-300K Dataset

To obtain training data without additional human annotation, we use CropReward to select crops generated by existing AIC models on unlabeled images. The selected crops serve as labels for CropReward-300K. We start with 517,889 Unsplash images, comprising 249,797 general images and 268,092 portrait images. For each of the general and portrait domains, we selected the eight top-ranked AIC models on CropBench to generate eight candidate crops per image. We evaluate these eight crops using the relative score rθ(I,c)r_{\theta}(I,c) defined in Eq. (6) and select the highest-scoring crop as the pseudo label. We then rank images by the scores of their selected crops and retain the top 60% within each domain. The resulting dataset contains 310,735 images, including 149,879 general images and 160,856 portraits. Each image is paired with the selected crop, its CropReward score, and the method that produced it. Figure 7 shows the mean CropReward scores of the eight models in each domain.

Mean CropReward scores of the eight AIC models in the general and portrait domains

Figure 7. Mean CropReward scores of the eight AIC models used to generate candidates in each domain, computed on the corresponding general or portrait images used to construct CropReward-300K. Scores are computed relative to the original image.

Reward-Guided Cropping

Based on CropReward-300K, we first apply supervised fine-tuning (SFT) to Qwen3.5-4B to predict a single crop box in normalized coordinates, producing CropAlign-SFT. We then train CropAlign by optimizing CropAlign-SFT with group relative policy optimization (GRPO) [53], using CropReward to evaluate the crops it generates, as illustrated in Figure 8. During this stage, the prompt asks for a textual rationale followed by a crop box, and CropReward remains frozen.

Reward-guided cropping with CropReward

Figure 8. Reward-guided cropping with CropReward. The LoRA-adapted policy generates a group of GG responses containing a textual rationale followed by a crop box. The frozen CropReward scores each valid crop relative to the original image. These scores are used to construct rewards, which are normalized within each group to compute advantages for the GRPO update.

Given an original image II and a task prompt qq, the policy πϕ\pi_{\phi} samples GG responses {o(1),…,o(G)}\{o^{(1)}, \ldots, o^{(G)}\}. A response is valid if it follows the required output format and contains coordinates defining a valid crop of II. For each valid response, we extract the box b(i)b^{(i)} and apply it to II to obtain the crop c(i)c^{(i)}. We use the relative score from CropReward to construct the reward:

R(i)={σ(rθ(I,c(i)))+λf,if o(i) is valid,0,otherwise,(7)R^{(i)} = \begin{cases} \sigma\left(r_{\theta}(I,c^{(i)})\right) + \lambda_f, & \text{if } o^{(i)} \text{ is valid},\\ 0, & \text{otherwise,} \end{cases} \tag*{(7)}

where σ(⋅)\sigma(\cdot) is the sigmoid function, which maps the relative crop score to (0,1)(0,1), and λf\lambda_f is a format bonus. Rewards are normalized within each group to compute relative advantages. GRPO then updates the policy using a clipped policy-gradient objective with a KL penalty relative to a frozen reference policy. The RL stage optimizes the policy with these rewards without target crop boxes, as illustrated in Figure 2(c). Neither stage requires additional human annotation.

Experiments

In this section, we conduct extensive comparisons on CropBench and popular AIC datasets to validate the performance of the proposed model from the following four aspects.

  • Alignment with Human Preferences: We evaluate how well existing AIC evaluation criteria agree with human cropping preferences and whether CropReward achieves better alignment (see Sec. VI-B).

  • Generalization: We examine whether CropReward generalizes to datasets beyond CropBench (see Sec. VI-C).

  • Ablation Studies: We examine the effects of the training objective and the inclusion of the original image as input on the performance of CropReward (see Sec. VI-D).

  • Effectiveness of Reward: We assess the effectiveness of CropReward in guiding AIC model optimization by comparing CropAlign with state-of-the-art AIC models (see Sec. VI-E).

Experimental Setup

Datasets. We use five datasets for evaluation.

  • CropBench is used to evaluate agreement with human cropping preferences. It contains 819 training images and 200 test images (100 per domain), with 85,995 and 21,000 annotated pairs, respectively. We report agreement results on the test split.

  • GAICD-v2 [2] and FGAesthetics-Crop [18] are used to evaluate model generalization. We use the 500-image test split of GAICD-v2. FGAesthetics-Crop is the cropping subset of FGAesthetics, and we use the official test split, which contains 168 image series, 990 candidate crops, and 2,088 preference pairs.

  • FLMS [11] and FCDB [12], together with the test set of CropBench, are used to evaluate cropping models. We use all 500 FLMS images, with up to ten expert crops per image, and the 345 valid FCDB test images, each with a single expert crop.

Evaluation protocols. On CropBench, we compute metrics for each set of 15 candidates with the original image included, and average the results over images within each domain. We measure agreement between predicted scores and BT preference scores using the Pearson linear correlation coefficient (PLCC) and Spearman rank correlation coefficient (SRCC). ACCpair_{\mathrm{pair}} measures the accuracy of predicting a preference for A, a preference for B, or equivalence (E) over the 105 annotated pairs of each image. ACCtop1_{\mathrm{top1}} and ACCtop3_{\mathrm{top3}} measure how often the candidate with the highest predicted score is among the top one or top three candidates ranked by their BT preference scores, respectively. On FGAesthetics-Crop, ss-ACC measures the accuracy of selecting the most preferred crop in each series, while ss-SRCC measures the rank correlation within each series.

Implementation details. We train CropReward for three epochs using AdamW, with a learning rate of 2.5×10−52.5 \times10^{-5} and a weight decay of 0.01. The learning rate is linearly warmed up over the first 3%3\% of training steps and then decayed to zero with a cosine schedule. The original image and candidate crop are resized independently while preserving their aspect ratios, with each image containing at most 512×512512 \times512 pixels.

LoRA adapters with rank 16, scaling factor 16, and dropout 0.05 are applied to the attention and feed-forward projection layers of the language model. The scale SS in the NPD loss (5) is estimated from the training split and fixed at 10.38. For CropAlign, we first fine-tune Qwen3.5-4B on the full CropReward-300K for two epochs using LoRA with rank 16. GRPO training then runs for one epoch with a group size of G=4G=4, a KL coefficient of 0.01, a format bonus of λf=0.05\lambda_{\mathrm{f}}=0.05, and a sampling temperature of 1.0. All training runs use two NVIDIA RTX PRO 6000 Blackwell GPUs.

Alignment with Human Preferences

Table II reports agreement with human cropping preferences on CropBench. The comparison includes geometry-based metrics, off-the-shelf models for IAA, ICA and human preference modeling, three existing evaluators fine-tuned on CropBench, and CropReward. We have the following observations.

MethodVenue#Params (B)PLCCSRCCACCpair_{\mathrm{pair}}ACCtop1_{\mathrm{top1}}ACCtop3_{\mathrm{top3}}PLCCSRCCACCpair_{\mathrm{pair}}ACCtop1_{\mathrm{top1}}ACCtop3_{\mathrm{top3}}
Geometry-based metrics (three expert crop references)GeneralPortrait
IoUmin⁡_{\min}–n/a0.5770.5090.6720.1900.3900.6840.6090.7030.2000.430
IoUmean_{\mathrm{mean}}–n/a0.6840.6230.7140.2100.4900.7550.6570.7210.2300.480
IoUmax⁡_{\max}–n/a0.6740.5980.7050.1800.3900.7030.5680.6910.2300.370
Image aesthetic assessment models
NIMA [24]TIP 20180.0540.2950.1920.5550.0600.2200.3570.2550.5860.0800.210
MUSIQ [25]ICCV 20210.0270.1070.0260.5060.0300.0900.2300.1560.5450.0800.190
VILA [10]CVPR 20230.1050.4090.2750.5920.1200.2800.3550.2290.5740.1300.290
AesCLIP [27]ACM MM 20230.1500.4770.3540.6130.0300.2200.4970.3510.6140.0700.260
EAT [54]ACM MM 20230.0870.3170.2110.5600.0700.1600.3730.2550.5850.1100.260
Q-Align [55]ICML 20248.2050.4570.3290.6080.1000.2800.4770.3390.6100.1100.300
Charm [26]CVPR 20250.3030.4010.2390.5770.0500.2000.4070.2290.5710.0700.220
HumanAesExpert [28]arXiv 20258.075-0.014-0.0080.4860.0500.1200.0380.0250.4970.0400.130
ArtiMuse [29]CVPR 20267.9440.3540.2230.5690.0300.1600.4670.3010.5950.1200.290
FGAesQ [18]CVPR 20260.1500.5220.3680.6190.0500.1400.5470.3730.6170.0500.180
UniPercept [56]ICML 20267.9440.3710.2680.5580.0400.1900.4530.2790.5710.0700.230
Composition and crop scoring models
GAIC evaluator [2]TPAMI 20200.0030.5360.4100.6320.1200.3100.5910.4460.6470.0800.310
SAMP-Net [30]BMVC 20210.0460.1790.1260.5380.0600.1500.1830.1340.5430.0800.230
PhotoFramer [31]CVPR 20268.2920.4680.3450.4990.0800.2500.5660.4080.5340.1300.300
PortraitCraft [32]arXiv 20264.4380.4530.3660.3830.1500.3300.5320.4260.4180.0600.260
Human preference-aligned reward models
ImageReward [33]NeurIPS 20230.4470.2900.2080.5600.0300.2300.3710.2420.5780.0500.190
HPSv3 [36]ICCV 20258.2920.3160.1840.5550.0600.1100.3830.2690.5860.0600.220
EditReward [37]ICLR 20268.2970.4000.2650.5810.0700.2200.5290.3800.6250.1000.260
Fine-tuned on CropBench
GAIC evaluator [2]TPAMI 20200.0030.7090.6280.7110.1600.4000.7230.6170.7080.2000.400
Charm [26]CVPR 20250.3030.5060.4160.6230.1300.2800.5750.4490.6390.1100.270
FGAesQ [18]CVPR 20260.1500.5620.4320.6330.1300.2500.6060.4420.6360.0900.240
CropReward–4.6040.8330.7630.7610.3000.6000.8650.7870.7770.3200.590

Table II. Agreement with human cropping preferences on the CropBench test split. For each candidate, IoU is computed against three expert crop boxes. The subscripts min, mean, and max indicate the minimum, mean, and maximum of these three values, respectively. Bold indicates the best result within each group in each column.

Expert crop boxes remain valuable references for AIC evaluation. IoUmean_{\mathrm{mean}} outperforms all evaluated off-the-shelf models on every metric for both image categories, demonstrating the value of high-quality expert crop boxes for evaluating cropping results. Among the three IoU variants, it also gives

MethodGAICD-v2 [2]FGAesthetics-Crop [18]
PLCCSRCCACCF1s-ACCs-SRCC
NIMA [24]0.2320.2100.6580.6530.3030.323
MUSIQ [25]0.1840.1640.7530.7530.4060.499
VILA [10]0.3510.3320.7330.7330.4060.458
AesCLIP [27]0.2950.2730.6790.6740.3250.374
ArtiMuse [29]0.4130.3860.6820.6820.3540.387
FGAesQ [18]0.2940.2750.7750.7750.4730.555
GAIC evaluator [2]0.8730.8490.6290.6280.2450.307
ImageReward [33]0.2380.2230.5610.5570.2400.145
CropReward0.7660.7160.8220.8220.5260.662

Table 3. Generalization to two external benchmarks, GAICD-v2 [2] and FGAesthetics-Crop [18], with all models applied without adaptation.

Note: PLCC and SRCC are computed within each image and macro-averaged; ACC and F1 are pair-level, whereas the s-prefixed metrics are series-level. Grey cells mark in-domain results. Bold and underline indicate the best and second-best generalization results in each column.

the best or joint-best results. Averaging IoU over all three expert crop boxes reduces dependence on any single reference. Nevertheless, agreement with reference boxes does not fully reflect human preferences. An image can have multiple well-composed crops, and a crop that differs from the reference boxes may still be preferred to one with higher IoU. These IoU scores also require expert-annotated reference boxes, limiting their use as rewards on unlabeled images.

Off-the-shelf models perform worse than geometry-based metric. FGAesQ [18] achieves the highest PLCC, SRCC, and pairwise accuracy among the IAA models. Its training on relative rankings of visually similar images, including crops, may help it distinguish subtle aesthetic differences between candidates. The GAIC evaluator [2] performs best on these three metrics among the off-the-shelf composition and crop scoring models. It was trained on mean opinion scores for predefined crop candidates. This result suggests that crop-specific supervision is useful for learning human cropping preferences. Among the reward models, EditReward [37] performs best on most metrics. Unlike ImageReward and HPSv3, EditReward takes both the original image and the edited result as input, which may help explain its stronger agreement with human cropping preferences than the other two reward models. Across all off-the-shelf models, however, top-1 accuracy reaches at most 0.150 on general images and 0.130 on portraits, showing that they rarely select the candidate most preferred by annotators.

CropReward aligns most closely with human preferences. To compare models trained on the same preference annotations, we also fine-tune the GAIC evaluator, Charm, and FGAesQ on the CropBench training split following their official implementations. As shown in Table II, fine-tuning improves all three models, but CropReward still outperforms all evaluated criteria on every metric for both image categories. Without using any expert-annotated crop boxes as references, CropReward achieves state-of-the-art performance, with SRCC of 0.763 and 0.787 on general and portrait images, respectively, exceeding IoUmean_{\mathrm{mean}} by 0.140 (22.47%) and 0.130 (19.79%). It also exceeds the strongest fine-tuned baseline, the GAIC evaluator, by 0.135 (21.50%) and 0.170 (27.55%) in SRCC, respectively. Pairwise accuracy reaches 0.761 and 0.777, while top-3 accuracy reaches 0.600 and 0.590. We examine the effects of the model input and training objective through ablation studies in Sec. VI-D.

Qualitative analysis. Figure 9 compares existing AIC evaluation criteria with CropReward on four test examples. Existing criteria can disagree with human preferences both when comparing crops with the original image and when ranking alternative crops. In the first general scene example, FGAesQ ranks the original image above crops A, B, and C, although annotators prefer all three crops to the original. Selecting its highest-scoring candidate would retain the original image rather than a crop preferred by annotators. In the second general scene example, Charm assigns its highest score to crop D, which annotators rank below the original image and all other displayed crops. In contrast, CropReward aligns more closely with human preferences than the compared evaluation criteria in these examples. In the first portrait scene example, CropReward assigns negative scores to all four crops, correctly reflecting the annotators’ preference for the original image. Even with three expert reference boxes, IoUmean_{\mathrm{mean}} can misrank visually similar candidates: in the second portrait scene example, it places crop B above A, contrary to human preferences. Higher overlap with expert boxes therefore does not necessarily indicate a more preferred crop.

Qualitative comparison of predicted and human preference rankings on CropBench test images

Figure 9. Qualitative comparison of predicted and human preference rankings on CropBench test images from (a) the portrait domain and (b) the general domain.

Generalization to External Benchmarks

We evaluate CropReward on GAICD-v2 and FGAesthetics-Crop to examine its generalization beyond CropBench. The two benchmarks differ from CropBench in their candidate crops and annotation types. GAICD-v2 provides MOS for grid-anchor candidates, whereas FGAesthetics-Crop provides pairwise preferences among visually similar crops derived from GAICD and CPC [13]. We use CropReward trained on CropBench without further fine-tuning. Table III compares its performance with representative existing models, including models trained on the corresponding benchmark. On GAICD-v2, CropReward achieves PLCC of 0.766 and SRCC of 0.716, outperforming all compared out-of-domain models. The strongest of these baselines, ArtiMuse, achieves 0.413 and 0.386, respectively. On FGAesthetics-Crop, CropReward achieves pair-level ACC and F1 of 0.822 and series-level ss-ACC and ss-SRCC of 0.526 and 0.662. It even surpasses the in-domain FGAesQ on all four metrics without fine-tuning on FGAesthetics. These results indicate that CropReward, trained on CropBench, aligns with both human quality ratings and fine-grained crop preferences on the two external benchmarks.

Ablation Studies

We examine two design choices of CropReward on the CropBench test split.

Training objective. Table IV compares the NPD loss in Eq. (5) with pointwise score regression, Lscore\mathcal{L}_{\mathrm{score}}, and the pairwise logistic ranking loss, Lrank\mathcal{L}_{\mathrm{rank}}, commonly used to train reward models from human preferences [33, 34]. All three variants take both the original image and the candidate crop as input. Lscore\mathcal{L}_{\mathrm{score}} supervises individual BT preference scores, whereas our ranking baseline uses preference order and excludes pairs annotated as equivalent. NPD directly matches predicted score differences to BT preference score differences over all candidate pairs. It achieves the best results on nine of the ten metrics across the two domains.

OriginalLscore\mathcal{L}_{\mathrm{score}}Lrank\mathcal{L}_{\mathrm{rank}}LNPD\mathcal{L}_{\mathrm{NPD}}General PLCCGeneral SRCCGeneral ACCpair_{\mathrm{pair}}General ACCtop1_{\mathrm{top1}}General ACCtop3_{\mathrm{top3}}Portrait PLCCPortrait SRCCPortrait ACCpair_{\mathrm{pair}}Portrait ACCtop1_{\mathrm{top1}}Portrait ACCtop3_{\mathrm{top3}}
✓✓0.8240.7540.7550.2600.5600.8540.7580.7640.2500.600
✓✓0.8320.7570.7550.2800.5700.8510.7770.7700.2600.570
✓0.7150.6070.7060.1800.4500.7780.6240.7100.1300.450
✓✓0.8330.7630.7610.3000.6000.8650.7870.7770.3200.590

Table IV. Ablation on the training objective and the input protocol of CropReward. All variants use Qwen3.5-4B and are trained for three epochs under identical settings. Original indicates whether the original image accompanies the candidate crop as input.

Original image input. It can also be observed from Table IV that removing the original image from the input while retaining the NPD loss lowers all ten metrics. SRCC drops by 0.156 and 0.163 on general and portrait images, respectively. ACCtop1\mathrm{ACC}_{\mathrm{top1}} falls from 0.300 to 0.180 on general images and from 0.320 to 0.130 on portraits. These results show that original image input helps CropReward predict human cropping preferences.

Cropping Performance of CropAlign

We next evaluate the effectiveness of CropReward in guiding AIC model optimization by comparing the proposed CropAlign with existing AIC methods.

Quantitative comparison. Table V compares CropAlign and its SFT-only variant, CropAlign-SFT, with nine representative AIC methods, including specialized models and MLLMs. We evaluate these methods on the CropBench and FCDB test set and on the full FLMS dataset, following prior AIC studies. On CropBench, IoU and Disp are averaged over the three expert-annotated reference boxes. On FLMS, both metrics are computed against the reference box with the highest IoU, whereas on FCDB, they are computed against the single reference box. Each crop is also scored by seven trained evaluation criteria. For Overall, we normalize Disp as 1−Disp1-\mathrm{Disp} and average it with the normalized values of the other eight metrics; the CropReward score is reported separately and excluded from this average. Even when evaluated using existing criteria, CropAlign achieves the best Overall score on all three benchmarks. Trained on CropReward-300K, CropAlign-SFT is already competitive with the strongest baselines, supporting the use of crops selected by CropReward as training supervision. GRPO further improves the Overall score on each benchmark. On CropBench, IoU also increases from 0.675 to 0.698 after GRPO. The CropReward scores increase as well, consistent with the reward used for optimization.

MethodTraining dataIoUDispVILA [10]AesCLIP [27]Charm [26]ArtiMuse [29]FGAesQ [18]PhotoFramer [31]EditReward [37]OverallCropReward
CropBench
A2-RL [23]AVA [57]0.6230.1090.4575.0255.09553.654.7032.9770.5400.54941.28
CACNet [4]FCDB + KU-PCP [12, 58]0.6410.0980.4575.0135.07453.774.6642.9620.5770.55241.34
CGS [21]GAICD-v1 [14]0.6220.1010.4535.0165.04952.634.6392.9890.5160.54681.12
GAIC [2]GAICD-v2 [2]0.6390.0970.4545.0395.06353.184.6652.9920.5590.55191.42
HCIC [22]CPC [13]0.6550.0930.4595.0145.06153.584.6752.9950.5480.55471.81
InstructCrop [6]FCDB [12]0.6340.0960.4535.0055.05753.274.6432.9300.5610.54891.09
S2CNet [15]GAICD-v1 [14]0.6320.0970.4545.0415.05353.004.6602.9850.5570.55031.43
Venus [7]CPC+GAICD-v2+FCDB [2, 12, 13]0.6600.0910.4585.0195.10153.844.6702.9810.3830.55161.69
GPT-5.5 [42]–0.6650.0890.4565.0275.05953.314.6642.9990.5350.55541.83
CropAlign-SFTCropReward-300K (no additional human annotation)0.6750.0850.4595.0295.06053.634.7023.0040.5450.55852.55
CropAlign0.6980.0760.4615.0475.04853.764.7333.0430.5310.56353.05
FLMS [11]
A2-RLAVA0.8210.0450.4725.1085.14859.045.0833.1090.6020.59781.77
CACNetFCDB + KU-PCP0.8410.0370.4715.0985.14559.105.0933.1660.6360.60331.70
CGSGAICD-v10.7970.0470.4635.0615.13658.295.0623.0450.6080.59041.35
GAICGAICD-v20.8210.0430.4695.1095.14258.795.1023.2810.6200.60302.06
HCICCPC0.8400.0370.4715.0965.14559.235.0983.0940.6280.60122.07
InstructCropFCDB0.8270.0400.4695.0915.14159.085.0893.1440.6360.60041.40
S2CNetGAICD-v10.8100.0450.4685.1105.14558.585.0953.2030.6210.59891.89
VenusCPC + GAICD-v2 + FCDB0.8640.0300.4745.0965.15259.425.0943.0900.5670.60371.65
GPT-5.5–0.8410.0370.4725.1225.14359.155.1073.1660.6480.60422.30
CropAlign-SFTCropReward-300K0.8410.0370.4735.1185.14259.205.1183.1560.6230.60362.52
CropAlign(no additional human annotation)0.8410.0370.4735.1275.14359.325.1123.1670.6230.60422.82
FCDB [12]
A2-RLAVA0.6650.0890.4324.8514.96851.104.8682.9080.3680.54271.72
CACNetFCDB + KU-PCP0.6960.0750.4274.7954.96651.274.8292.9080.3830.54651.63
CGSGAICD-v10.6570.0860.4144.7174.89050.344.7822.8330.3150.53201.22
GAICGAICD-v20.6780.0820.4264.8294.94650.864.8263.0240.3720.54621.88
HCICCPC0.7000.0750.4284.7994.95551.134.8742.9310.3690.54751.93
InstructCropFCDB0.6870.0770.4234.7784.94751.034.8072.8540.3770.54221.48
S2CNetGAICD-v10.6750.0830.4214.8114.93050.614.8132.9620.3620.54231.73
VenusCPC + GAICD-v2 + FCDB0.6820.0800.4244.8054.93650.544.8452.9900.3250.54381.88
GPT-5.5–0.6970.0760.4274.8234.94851.064.8642.9370.3660.54722.14
CropAlign-SFTCropReward-300K0.7050.0740.4314.8464.95750.964.8672.9720.3700.55012.39
CropAlign(no additional human annotation)0.7060.0730.4294.8464.94551.094.8753.0020.3610.55092.60

Table V. Comparison of cropping models on CropBench, FLMS, and FCDB. Best results within each benchmark are bolded. CropReward-300K requires no additional human annotation.

User study. We further compare CropAlign with six representative AIC methods through a user study. Each comparison covers 500 images: all 200 CropBench test images, 150 images randomly sampled from FLMS, and 150 from the FCDB test set. Five distinct annotators from a pool of ten judge each pair, with the left/right order randomized. Their votes are aggregated by majority. As reported in Table VI, CropAlign wins 75.7% of the 3,000 pairs. Its win rates range from 73.2% against GPT-5.5 to 78.6% against InstructCrop, and all six comparisons are significant at p<0.001p < 0.001 under a binomial test. These results show that users prefer crops from CropAlign over those of the compared specialized models and MLLMs.

ComparisonWin (%)Tie (%)Lose (%)
vs. GPT-5.5 [42]73.21.425.4
vs. Venus [7]74.20.625.2
vs. HCIC [22]75.60.623.8
vs. GAIC [2]76.20.623.2
vs. CACNet [4]76.40.223.4
vs. InstructCrop [6]78.60.221.2
Overall75.70.623.7

Table VI. User study comparing CropAlign with six competing methods.

Interpretability. When prompted to explain its cropping decisions, CropAlign can generate a textual rationale followed by a crop box. Figure 10 compares its explanations and cropping results with those of Venus and GPT-5.5. In the person-and-drone example, CropAlign identifies excess sky and grass in the original and reduces these regions while retaining both the person and the drone. In the bridge example, it reduces the sky and lower foreground as described in its rationale, while GPT-5.5 makes smaller adjustments to these regions. These examples illustrate that CropAlign can provide explanations consistent with its crop boxes without additional supervision from human-written rationales during SFT or GRPO.

Comparison of explanations for cropping decisions

Figure 10. Comparison of explanations for cropping decisions. Green and red highlight selected crop-related phrases from CropAlign and GPT-5.5, respectively.

Qualitative comparison. Figure 11 compares CropAlign with representative AIC methods. In the statue example, CropAlign preserves the statue and its base, whereas VFN removes the lower part of the subject. Overall, CropAlign produces better-composed crops in these examples, preserving the main subjects while removing unnecessary surroundings. In the fourth column, CropAlign crops out more of the empty foreground than GPT-5.5 while retaining the entrance and the people in front of it. This tighter framing places greater emphasis on the entrance and the surrounding activity.

Qualitative comparison of cropping results

Figure 11. Qualitative comparison of cropping results.

Conclusion

In this paper, we have introduced CropReward, an MLLM-based reward model for AIC task that assesses improvement or degradation relative to the original image and distinguishes fine-grained preferences among crops. To examine how well existing AIC evaluation criteria reflect human cropping preferences, we contributed CropBench, which provides pairwise preference annotations among candidate crops and between crops and their original images. Experiments show that CropReward aligns more closely with human preferences than the compared evaluation criteria and generalizes well to external benchmarks. We further employed CropReward to build a new large-scale AIC dataset CropReward-300K, and further used it to guide the reinforcement learning of CropAlign, a new AIC model. This training process does not require any human annotation. CropAlign delivers the state-of-the-art performance under existing evaluation criteria and is preferred over the specialized models and MLLMs in a user study. It is expected that our …

References

  1. [1]W. Wang, J. Shen, and H. Ling, “A deep network solution for attention and aesthetics aware photo cropping,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 41, no. 7, pp. 1531–1544, 2019.DOI
  2. [2]H. Zeng, L. Li, Z. Cao, and L. Zhang, “Grid anchor based image cropping: A new benchmark and an efficient model,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 44, no. 3, pp. 1304–1319, 2020.
  3. [3]J. Yan, S. Lin, S. B. Kang, and X. Tang, “Learning the change for automatic image cropping,” in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2013, pp. 971–978.DOI
  4. [4]C. Hong, S. Du, K. Xian, H. Lu, Z. Cao, and W. Zhong, “Composing photos like a photographer,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2021, pp. 7057–7066.DOI
  5. [5]S. H. Lee, J. Jiang, X. Yu, Z. Li, J. Ke, Y. Li, J. He, S. Hickson, K. Datsenko, S. Kim, M.-H. Yang, I. Essa, and F. Yang, “Cropper: Vision-language model for image cropping through in-context learning,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2025, pp. 30010–30019.arxiv.org/abs/2408.07790
  6. [6]X. Sheng, P. Xie, W. Zou, P. Chen, T. Zhu, and L. Li, “Instructcrop: Teaching multimodal large language models to crop aesthetic images,” in Proceedings of the 33rd ACM International Conference on Multimedia, 2025, pp. 6830–6839.DOI
  7. [7]T. Du, H. He, and Y. Peng, “Venus: Benchmarking and empowering multimodal large language models for aesthetic guidance and cropping,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2026, pp. 37766–37776.arxiv.org/abs/2602.23980
  8. [8]Z. Dong, C. Li, J. Yu, and H. Chen, “Crop: Expert-aligned image cropping via compositional reasoning and optimizing preference,” arXiv preprint arXiv:2605.12545, 2026.arxiv.org/abs/2605.12545
  9. [9]D. Kong, L. Lei, Z. Zheng, C. Wu, A. Zhang, X. Qin, T. Ma, J. Xu, Z. Wang, Z. Chen et al., “ShotCrop3”: Cropping human-centric images into cinematic triple-shot compositions,” arXiv:2606.05635, 2026.arxiv.org/abs/2606.05635
  10. [10]J. Ke, K. Ye, J. Yu, Y. Wu, P. Milanfar, and F. Yang, “Vila: Learning image aesthetics from user comments with vision-language pretraining,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2023, pp. 10041–10051.arxiv.org/abs/2303.14302
  11. [11]C. Fang, Z. Lin, R. Mech, and X. Shen, “Automatic image cropping using visual composition, boundary simplicity and content preservation models,” in Proceedings of the 22nd ACM International Conference on Multimedia, 2014, pp. 1105–1108.DOI
  12. [12]Y.-L. Chen, T.-W. Huang, K.-H. Chang, Y.-C. Tsai, H.-T. Chen, and B.-Y. Chen, “Quantitative analysis of automatic image cropping algorithms: A dataset and comparative study,” in 2017 IEEE Winter Conference on Applications of Computer Vision (WACV). IEEE, 2017, pp. 226–234.arxiv.org/abs/1701.01480
  13. [13]Z. Wei, J. Zhang, X. Shen, Z. Lin, R. Mech, M. Hoai, and D. Samaras, “Good view hunting: Learning photo composition from dense view pairs,” in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2018, pp. 5437–5446.DOI
  14. [14]H. Zeng, L. Li, Z. Cao, and L. Zhang, “Reliable and efficient image cropping: A grid anchor based approach,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2019, pp. 5949–5957.arxiv.org/abs/1904.04441
  15. [15]Y. Su, Y. Cao, J. Deng, F. Rao, and Q. Wu, “Spatial-semantic collaborative cropping for user generated content,” in Proceedings of the AAAI Conference on Artificial Intelligence, vol. 38, no. 5, 2024, pp. 4988–4997.
  16. [16]J. Hong, L. Yuan, M. Gharbi, M. Fisher, and K. Fatahalian, “Learning subject-aware cropping by outpainting professional photos,” in Proceedings of the AAAI Conference on Artificial Intelligence, vol. 38, no. 3, 2024, pp. 2175–2183.arxiv.org/abs/2312.12080
  17. [17]K. Zhang, T. Ding, J. Jiang, T. Chen, I. Zharkov, V. M. Patel, and L. Liang, “Procrop: Learning aesthetic image cropping from professional compositions,” in Proceedings of the AAAI Conference on Artificial Intelligence, vol. 40, no. 15, 2026, pp. 12 600–12 608.arxiv.org/abs/2505.22490
  18. [18]Z. Yang, J. Wang, Z. Zhang, P. Xie, X. Sheng, P. Chen, and L. Li, “Fine-grained image aesthetic assessment: Learning discriminative scores from relative ranks,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2026, pp. 145–155.arxiv.org/abs/2603.03907
  19. [19]Y.-L. Chen, J. Klopp, M. Sun, S.-Y. Chien, and K.-L. Ma, “Learning to compose with professional photographs on the web,” in Proceedings of the 25th ACM International Conference on Multimedia, 2017, pp. 37–45.arxiv.org/abs/1702.00503
  20. [20]W. Lu, X. Xing, B. Cai, and X. Xu, “Listwise view ranking for image cropping,” IEEE Access, vol. 7, pp. 91 904–91 911, 2019.DOI
  21. [21]D. Li, J. Zhang, K. Huang, and M.-H. Yang, “Composing good shots by exploiting mutual relations,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2020, pp. 4213–4222.DOI
  22. [22]B. Zhang, L. Niu, X. Zhao, and L. Zhang, “Human-centric image cropping with partition-aware and content-preserving features,” in European Conference on Computer Vision. Springer, 2022, pp. 181–197.arxiv.org/abs/2207.10269
  23. [23]D. Li, H. Wu, J. Zhang, and K. Huang, “Aesthetics aware reinforcement learning for image cropping,” in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2018, pp. 8193–8201.
  24. [24]H. Talebi and P. Milanfar, “Nima: Neural image assessment,” IEEE transactions on image processing, vol. 27, no. 8, pp. 3998–4011, 2018.
  25. [25]J. Ke, Q. Wang, Y. Wang, P. Milanfar, and F. Yang, “MUSIQ: Multi-scale image quality transformer,” in Proceedings of the IEEE/CVF International Conference on Computer Vision, 2021, pp. 5148–5157.arxiv.org/abs/2108.05997
  26. [26]F. Behrad, T. Tuytelaars, and J. Wagemans, “Charm: The missing piece in ViT fine-tuning for image aesthetics assessment,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2025, pp. 7815–7824.
  27. [27]X. Sheng, L. Li, P. Chen, J. Wu, W. Dong, Y. Yang, L. Xu, Y. Li, and G. Shi, “AesCLIP: Multi-attribute contrastive learning for image aesthetics assessment,” in Proceedings of the 31st ACM International Conference on Multimedia, 2023, pp. 1117–1126.DOI
  28. [28]Z. Liao, X. Liu, W. Qin, Q. Li, Q. Wang, P. Wan, D. Zhang, L. Zeng, and P. Feng, “HumanAesExpert: Advancing a multi-modality foundation model for human image aesthetic assessment,” arXiv preprint arXiv:2503.23907, 2025.arxiv.org/abs/2503.23907
  29. [29]S. Cao, N. Ma, J. Li, X. Li, L. Shao, K. Zhu, Y. Zhou, Y. Pu, J. Wu, J. Wang, B. Qu, W. Wang, Y. Qiao, D. Yao, and Y. Liu, “ArtiMuse: Fine-grained image aesthetics assessment with joint scoring and expert-level understanding,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2026, pp. 15 313–15 322.arxiv.org/abs/2507.14533
  30. [30]B. Zhang, L. Niu, and L. Zhang, “Image composition assessment with saliency-augmented multi-pattern pooling,” arXiv preprint arXiv:2104.03133, 2021.arxiv.org/abs/2104.03133
  31. [31]Z. You, K. Wang, H. Zhang, X. Cai, J. Gu, T. Xue, C. Dong, and Z. Zhang, “Photoformer: Multi-modal image composition instruction,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2026, pp. 10 197–10 207.
  32. [32]Y. Sha, Z. Lou, Y. Tang, X. Qu, Z. Qu, B. Xia, H. Li, T. Liu, and L. Liu, “PortraitCraft: A benchmark for portrait composition understanding and generation,” arXiv preprint arXiv:2604.03611, 2026.arxiv.org/abs/2604.03611
  33. [33]J. Xu, X. Liu, Y. Wu, Y. Tong, Q. Li, M. Ding, J. Tang, and Y. Dong, “Imagereward: Learning and evaluating human preferences for text-to-image generation,” Advances in Neural Information Processing Systems, vol. 36, pp. 15 903–15 935, 2023.arxiv.org/abs/2304.05977
  34. [34]Y. Kirk, A. Polyak, U. Singer, S. Matiana, J. Penna, and O. Levy, “Pick-a-pic: An open dataset of user preferences for text-to-image generation,” in Advances in Neural Information Processing Systems, vol. 36, 2023, pp. 36 652–36 663.
  35. [35]X. Wu, Y. Hao, K. Sun, Y. Chen, F. Zhu, R. Zhao, and H. Li, “Human preference score v2: A solid benchmark for evaluating human preferences of text-to-image synthesis,” arXiv preprint arXiv:2306.09341, 2023.arxiv.org/abs/2306.09341
  36. [36]Y. Ma, X. Wu, K. Sun, and H. Li, “Hpsv3: Towards wide-spectrum human preference score,” in Proceedings of the IEEE/CVF International Conference on Computer Vision, 2025, pp. 15 086–15 095.arxiv.org/abs/2508.03789
  37. [37]K. Wu, S. Jiang, M. Ku, P. Nie, M. Liu, and W. Chen, “Editreward: A human-aligned reward model for instruction-guided image editing,” arXiv preprint arXiv:2509.26346, 2025.arxiv.org/abs/2509.26346
  38. [38]X. Luo, J. Wang, C. Wu, S. Xiao, X. Jiang, D. Lian, J. Zhang, D. Liu, and Z. Liu, “Editscore: Unlocking online rl for image editing via high-fidelity reward modeling,” in International Conference on Learning Representations, vol. 2026, 2026, pp. 33 027–33 056.arxiv.org/abs/2509.23909
  39. [39]J. Yang, X. Lin, Y. Dong, Z. Zheng, X. Liu, H. Gu, and Y. Fang, “Beautygraph: Aesthetic alignment for face retouching via dynamic path guidance and fine-grained preference modeling,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2026, pp. 25 110–25 120.arxiv.org/abs/2603.01163
  40. [40]L. Liu, H. Duan, C. Zhu, J. Lu, H. Jiang, L. Yang, Q. Hu, G. Zhai, and X. Zhang, “LL-Bench: Rethinking low-level vision evaluation in the era of large-scale generative models,” arXiv preprint arXiv:2606.02535, 2026.arxiv.org/abs/2606.02535
  41. [41]Y. Yang, L. Xu, L. Li, N. Qie, Y. Li, P. Zhang, and Y. Guo, “Personalized image aesthetics assessment with rich attributes,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2022, pp. 19 861–19 869.arxiv.org/abs/2203.16754
  42. [42]OpenAI, “GPT-5.5 system card,” https://openai.com/index/gpt-5-5-system-card/, Apr. 2026.
  43. [43]Qwen Team, “Qwen3.5: Towards native multimodal agents,” https://qwen.ai/blog?id=qwen3.5, Feb. 2026.
  44. [44]——, “Qwen3.6-27B: Flagship-level coding in a 27B dense model,” https://qwen.ai/blog?id=qwen3.6-27b, Apr. 2026.
  45. [45]——, “Qwen3.7-Plus: Multimodal agent intelligence,” https://qwen.ai/blog?id=qwen3.7-plus, Jun. 2026.
  46. [46]Google DeepMind, “Gemini 3.5 Flash model card,” https://deepmind.google/models/model-cards/gemini-3-5-flash/, May 2026, accessed: August 2, 2026.
  47. [47]Anthropic, “Claude Opus 4.8 system card,” https://www.anthropic.com/system-cards, May 2026, released May 28, 2026; accessed August 2, 2026.
  48. [48]ByteDance Seed, “Seed2.0 model card: Towards intelligence frontier for real-world complexity,” arXiv preprint arXiv:2607.00248, 2026.arxiv.org/abs/2607.00248
  49. [49]Kimi Team, T. Bai, Y. Bai, Y. Bao, S. H. Cai, Y. Cao, Y. Charles, H. S. Che, C. Chen, G. Chen et al., “Kimi K2.5: Visual agentic intelligence,” arXiv preprint arXiv:2602.02276, 2026.
  50. [50]Xiaomi MiMo Team, “MiMo-V2.5,” https://huggingface.co/XiaomiMiMo/MiMo-V2.5, Apr. 2026, model card, accessed August 2, 2026.
  51. [51]R. A. Bradley and M. E. Terry, “Rank analysis of incomplete block designs: I. the method of paired comparisons,” Biometrika, vol. 39, no. 3/4, pp. 324–345, 1952.DOI
  52. [52]R. R. Davidson, “On extending the bradley-terry model to accommodate ties in paired comparison experiments,” Journal of the American Statistical Association, vol. 65, no. 329, pp. 317–328, 1970.DOI
  53. [53]Z. Shao, P. Wang, Q. Zhu, R. Xu, J. Song, X. Bi, H. Zhang, M. Zhang, Y. Li, Y. Wu et al., “Deepseekmath: Pushing the limits of mathematical reasoning in open language models,” arXiv preprint arXiv:2402.03300, 2024.arxiv.org/abs/2402.03300
  54. [54]S. He, A. Ming, S. Zheng, H. Zhong, and H. Ma, “EAT: An enhancer for aesthetics-oriented transformers,” in Proceedings of the 31st ACM International Conference on Multimedia, 2023, pp. 1023–1032.DOI
  55. [55]H. Wu, Z. Zhang, W. Zhang, C. Chen, L. Liao, C. Li, Y. Gao, A. Wang, E. Zhang, W. Sun, Q. Yan, X. Min, G. Zhai, and W. Lin, “Q-align: Teaching LMMs for visual scoring via discrete text-defined levels,” in Proceedings of the 41st International Conference on Machine Learning, ser. Proceedings of Machine Learning Research, vol. 235. PMLR, 2024, pp. 54 015–54 029.arxiv.org/abs/2312.17090
  56. [56]S. Cao, J. Li, X. Li, Y. Pu, K. Zhu, Y. Gao, S. Luo, Y. Xin, Q. Qin, Y. Zhou, X. Chen, W. Zhang, B. Fu, Y. Qiao, and Y. Liu, “UniPercept: Towards unified perceptual-level image understanding across aesthetics, quality, structure, and texture,” in Proceedings of the International Conference on Machine Learning, 2026.arxiv.org/abs/2512.21675
  57. [57]N. Murray, L. Marchesotti, and F. Perronnin, “AVA: A large-scale database for aesthetic visual analysis,” in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2012, pp. 2408–2415.DOI
  58. [58]J.-T. Lee, H.-U. Kim, C. Lee, and C.-S. Kim, “Photographic composition classification and dominant geometric element detection for outdoor scenes,” Journal of Visual Communication and Image Representation, vol. 55, pp. 91–105, 2018.DOI

Paper details

vlnc:W_aqbwxyyd
Published
Fresh — added to the Hub within the last 30 days
Added
License
CC BY 4.0
Usage

views · 0

downloads · 0

A view counts once per browser per day, a download each time the PDF is requested.

  • Computer Science

Not recorded for this paper

View statement
Looking for related papers…
Contents