betaFeedback

WorksComputer Science

VLM-as-a-Judge for Person Re-Identification

Abstract

Cloth-changing person re-identification (CC-ReID) is still very challenging, and no method clearly dominates: methods that lead on one benchmark collapse on the others, because they rest on different identity cues. We show that a general-purpose vision-language model (VLM), used zero-shot as a judge for reranking a short candidate list, beats the expert retrieval models it reranks by a wide and consistent margin. On the four scenarios of CHIRLA, a long-term CC-ReID benchmark that no publicly released Re-ID model is trained on, reranking the candidates of two frozen experts raises rank-1 on every scenario, by 12.9 points on average over the best expert and 9.4 over the best naive ensemble of the two, with no component fine-tuned on the target data. Merging both experts' shortlists matches or beats reranking the stronger expert's shortlist alone, at lower cost. Introducing a VLM does, however, come at a cost: almost all of the pipeline's FLOPs are spent on it. We therefore borrow a criterion from ensembling and invoke the VLM judge only where the two experts disagree at rank 1. This threshold-free gate removes 40% of the calls, and a comparable share of total compute, with no significant drop in rank-1, trading 1.8 to 3.8 points of mAP. Judging remains the dominant cost, but on a benchmark where dedicated experts stall, we find a frozen general-purpose model to be the strongest judge of identity. The code is available at https://github.com/bdager/JudgeReID.

Introduction

Person re-identification (ReID) matches images of the same individual across camera views and locations [1, 2]. Most methods address the short-term setting, where clothing and overall appearance remain unchanged (SC-ReID) [3, 4, 5, 6, 7, 8, 9]. However, practical deployments are long-term. Individuals reappear after weeks or months, with considerable changes in clothing, appearance, and environment. This is “cloth-changing ReID” (CC-ReID), where clothing cues are unreliable by construction and methods must rely on identity-intrinsic evidence such as facial structure [10, 11, 12], body shape [13, 14, 15, 16], or gait [17, 18]. In this setting, accuracy remains far from the saturation reached in SC-ReID, and there is no consistent winner across benchmarks. For example, under the cloth-changing (CC) protocol, SapiensID [12] achieves state-of-the-art mAP on PRCC [19] (72.6%), yet drops to 17.8% on LTCC [20]. In contrast, DIFFER [21] reaches 31.6% on LTCC but only 64.7% on PRCC. Such cross-benchmark reversals suggest that CC-ReID experts exploit different identity cues and thus make complementary errors.

This complementarity can be exploited at inference time, rather than committing to a single model. We study this on SapiensID and DIFFER, the two experts mentioned above. In Figure 1 we show that for this pair, an oracle selecting the better expert per query exceeds the stronger of the two by 13.5 rank-1 (R-1) points on the multi-camera scenario of CHIRLA [22], a CC-ReID benchmark recorded over seven months. In addition, we observe that agreement between their rank-1 predictions is a strong correctness signal, holding for 85% of those agreements on this scenario. When they disagree, neither prediction is reliable, yet the true identity is often present in the union of their top-kk candidates.

Figure 1. State-of-the-art CC-ReID experts make different mistakes: We consider here DIFFER and SapiensID on CHIRLA [22], a challenging multi-camera scenario. Left: two queries on which the experts disagree, with their top-3 candidates; green marks correct identities, red incorrect ones. Each model succeeds where the other fails. Middle: an oracle selecting the better model per query gains 13.5 rank-1 points over the best expert (dashed). Right: queries split by top-1 agreement and by which model is correct. Agreement is a reliable correctness signal, and in the disagreement column only 13% of queries have no correct candidate in either top-6 list. In this paper, we introduce and evaluate different approaches to rerank the union of both shortlists with a VLM judge, on every query or, to save compute, only where the two disagree.

We therefore build a training-free ensemble in which a vision-language model (VLM) arbitrates between two heterogeneous CC-ReID experts, and show that this frozen, general-purpose model is a better judge of identity than either expert it reranks. Both models retrieve from the gallery independently. Almost all of the pipeline’s compute is spent on the judge, so we invoke it only where the two experts disagree at rank 1, which the agreement signal above justifies. Gating this way removes 40% of the reranker calls and a comparable share of the total FLOPs, with no significant drop in R-1, trading 1.8 to 3.8 points of mAP. Rather than arbitrating only between the two rank-1 predictions, the judge chooses from the union of both experts’ top-kk candidates.

VLMs are generalists: their web-scale multimodal pretraining yields fine-grained visual understanding that transfers to biometric recognition [23]. They are ill-suited as retrieval engines, since exhaustively scanning a large gallery is infeasible and their standalone accuracy trails task-specific models. As judges over short candidate lists, however, VLMs make strong comparative decisions [24], echoing the LLM-as-a-judge paradigm in the visual domain [25]. Standard ensembling falls short here: score fusion [26, 27] assumes that the two similarity scores are directly comparable, which independently trained embedding spaces do not provide, and rank aggregation such as reciprocal rank fusion (RRF) [28] averages the disagreement rather than resolving it.

The contributions of this work are as follows:

  • A zero-shot VLM judge that outperforms both experts and every naive ensemble of the two by a wide and consistent margin on all four CHIRLA scenarios, with no component trained or fine-tuned on the evaluated data.

  • A threshold-free disagreement gate that skips the reranker on the queries where the experts agree, saving their compute with no significant drop in R-1 at the price of 1.8 to 3.8 points of mAP.

  • An empirical study of how the candidate pool should be presented to the judge, covering pool size, pool ordering, and how the prompt binds each image to its role.

  • Evidence on pool composition: merging both experts’ shortlists matches or beats reranking a single expert’s own shortlist at lower cost, even though deduplication often leaves the merged pool smaller.

Related Work

Clothing-Change Re-ID. CC-ReID methods remove clothing information from the identity representation at training time. One line uses language as a clothing-invariant supervisory signal, through cloth-agnostic CLIP alignment [29] or prompt learning over clothing and identity semantics [30, 31]. A related line factors identity from clothing in feature space, with DIFFER [21] disentangling identity features from semantic cues over a frozen vision-language backbone and DRDnet [32] modeling the relations between the resulting factors. Others synthesize clothing or pose variation at the feature [33, 34, 35] or image level [36, 37, 38], or ground identity in cues that survive a change of clothes, such as gait [18], implicit 3D shape [13, 14] and skeleton dynamics [39]. Unsupervised variants pursue the same invariance without identity labels [40, 41, 42] but remain far behind, with ICSM [42] reaching 13.5% mAP on LTCC under the clothing-change protocol against 31.6% for DIFFER [21].

SapiensID [12] takes a different route. Rather than modeling body structure explicitly, it unifies face and body recognition in one model, with identity supervision on WebBody, a web-scale corpus spanning diverse poses, scales and capture conditions. It transfers to CC-ReID off the shelf and, unlike the shape and gait methods above, exploits facial cues when visible. We build on DIFFER and SapiensID as our two experts.

VLMs in person Re-ID. VLMs have already been used to some extent for ReID in two ways that differ in where the model intervenes. In the first one, language is a training-time signal only. The methods above, DIFFER [21] among them, use text to shape a clothing-invariant embedding, as do pseudo-prompt optimization [7], caption-guided inversion [43], language-guided feature enhancement [44, 45, 46] and diffusion-based augmentation [47] outside the clothing-change setting. Retrieval then stays nearest-neighbor search over frozen features, and no language model sees a query at test time. VLM-ReID [48] runs the model at test time, but only to emit an identity token used as the retrieval feature, so language still shapes the embedding rather than the ranking.

In the second way, the VLM is introduced in the retrieval loop. Text-to-image retrieval aligns freeform descriptions with gallery images [49, 50], with VLMs supplying transferable captions [51], instruction-conditioned queries [8], interactive refinement [52] and dialogue-based retrieval [53, 54]. Closest to us, Duan et al. [23] evaluate six off-the-shelf VLMs directly as ReID matchers under angle, illumination and clothing variation, and find that the prompt template moves the result. They score the VLM as a standalone matcher, while we invoke it as an arbiter over a short candidate list that two experts have already produced, and only where those experts disagree.

Re-Ranking and model complementarity. Re-ranking refines a ranked list using gallery structure. k-reciprocal encoding [55] remains the standard training-free baseline, revisited through adaptive graph-based neighbor search [56], while learned alternatives attend jointly over query and gallery [57]. Pose2ID [58] instead centralizes neighbor features as a training-free post-processing stage, validated only where clothing stays constant. All of these refine the neighborhood structure of a single feature space, which is what clothing change destabilizes, and none recovers a match that the embedding misses entirely. Re-ranking is therefore orthogonal to our question rather than an alternative to it: it could be applied on top of either expert or on the union of both, and we leave that combination to future work. The methods we measure against are instead those that combine rankings from different models.

Combining heterogeneous rankers is much less explored in ReID. Score- and rank-level fusion such as RRF [28] treats models symmetrically and aggregates them on every query, whether or not they agree. Our correctness cross-tabulation shows that this spends effort where there is little to gain. On agreement queries the second model adds little, while disagreement queries carry nearly all of the oracle gap. Disagreement-gated arbitration turns that asymmetry into an invocation policy.

Method

Overview

In our training-free arbitration ensemble, MM frozen ReID experts retrieve independently, and a frozen, general-purpose VLM judges the candidates they jointly propose. Throughout, we use M=2M = 2. We first select pretrained experts that present complementary error profiles. They succeed and fail under different conditions, such as whether the face is visible or whether pose changes between query and gallery. All models are benchmarked off the shelf on datasets other than the ones they were trained on, so no component is fine-tuned on the target data. Given a query qq, each model m∈{1,…,M}m \in\{1,\ldots,M\} independently ranks the gallery G={g1,…,gN}\mathcal{G} = \{g_1,\ldots,g_N\} by similarity to qq. When all models predict the same identity for their top-ranked match, we return the ranking of a designated default model m∗m^* unchanged. When they disagree, we merge their top-kk matches into a candidate pool and ask the VLM to reorder it. The final ranking places the kHk_H top-ranked candidates from the reordered pool at the head, followed by the tail of the model that contributed the majority of that head. We detail individual steps in the following subsections.

Selective reranking

Disagreement gating. Reranking every query with a VLM is expensive, and on queries the models already resolve it rarely changes the outcome while risking the demotion of a correct rank 1, as previously shown in Figure 1. We therefore invoke the VLM reranker only where the models disagree. We assume an enrolled gallery whose identity labels are known at inference time, while the query identity is unknown. Let y^m(q)\hat{y}_m(q) denote the enrolled identity label of the rank-1 gallery match returned by model mm for query qq, and define the disagreement indicator

δ(q)=1[∣{y^m(q):m=1,…,M}∣>1],(1)\delta(q) = \mathbb{1}\left[\left|\left\{\hat{y}_m(q):m=1,\ldots,M\right\}\right|>1\right], \tag*{(1)}

which fires whenever the models do not all agree on the identity of their rank-1 match. Let Qδ={q∈Q:δ(q)=1}Q_\delta=\{q\in Q:\delta(q)=1\} denote the gated subset of the query set QQ. The reranker is applied to QδQ_\delta and to no other query; for q∉Qδq\notin Q_\delta we return the ranking of the default model m⋆m^\star unchanged.

Candidate pool. Given a gated query, we pool the top-kk gallery items retrieved by each model:

C(q)=⋃m=1M{πm(r)(q)}r=1k,k≤∣C(q)∣≤P,(2)C(q)=\bigcup_{m=1}^{M}\left\{\pi_m^{(r)}(q)\right\}_{r=1}^{k},\quad k\leq|C(q)|\leq P, \tag*{(2)}

where πm(q)\pi_m(q) is model mm’s ranking of the gallery, πm(r)(q)\pi_m^{(r)}(q) its item at rank rr and P=MkP=Mk. Each candidate carries the tag σ(c)⊆{1,…,M}\sigma(c)\subseteq\{1,\ldots,M\} recording which models retrieved it; a candidate retrieved by several models carries all of them. The pool is presented to the reranker under an ordering ρ\rho, which we treat as a design choice rather than a fixed component. The reranker’s sensitivity to ρ\rho is itself a property worth measuring, and we report it in Table 5. Merging rather than extending a single model’s list to MkMk items is what allows the pool to contain the correct match when one model ranks it highly and the other does not retrieve it at all.

Table 5: Sensitivity to ρ\rho at P=6P = 6, with two orderings of C(q)C(q). Δ\Delta is the second order minus the first. Agreement is the fraction of gated queries on which the two orders return the same identity sequence, at rank 1, over the retained head (kH=3k_H = 3), and over the whole pool, whereas R-1 and mAP are over the full query set. In parentheses, chance agreement under random permutations of the same pool.

Scenario(DIFFER, SapiensID)(SapiensID, DIFFER)Δ\DeltaAgreement % (chance)
R-1mAPR-1mAPR-1mAP@1@kHk_H@PP
LT44.9739.5945.9439.88+0.98+0.2969.6 (31.2)42.9 (4.9)31.2 (2.3)
MC-LT56.3554.4358.5055.11+2.15+0.6869.2 (33.6)49.7 (6.1)39.7 (3.6)
MC73.2564.8773.2164.93−0.04+0.0679.4 (33.2)51.5 (5.6)39.2 (3.0)
Reapp.73.7265.2873.4365.01−0.30−0.2782.1 (34.2)55.4 (5.9)41.1 (2.9)

Table 5.

Prompt construction. We prompt the reranker to order C(q)C(q), from which the head of the final ranking is assembled. Reranking requires the VLM to compare one query against several candidates in a single multi-image prompt. In this setting, VLMs are susceptible to image position and recency effects [59, 60]. The VLM’s answer is influenced by an image’s position in the sequence and not only by its content. Thus, image identity becomes unreliable, with descriptions of one image applied to another. We therefore build the prompt so that each image declares what it is, instead of leaving the model to infer it from where the image appears. To do so, before any image is shown, the prompt gives all the instructions, including an anchor sentence stating each image’s role as query or candidate, and which images are not the query. Then, each image carries a label written into the image itself rather than only in the surrounding text, following evidence that marks placed on an image are more reliably grounded than textual references to image order [61]. The pool is presented in the order ρ\rho mentioned above. § 4.3 evaluates the contribution of each prompt-construction choice.

Final ranking

The reranker orders the pool C(q)C(q) but leaves the remaining N−∣C(q)∣N-|C(q)| gallery images unranked, so a full ranking is assembled from the reranked head and one model’s ranking. We select that model per query rather than fixing it in advance.

Tail selection. Of the ordering returned by the reranker we retain the first kHk_H elements as the head H(q)=(h1,…,hkH)H(q)=(h_1,\ldots,h_{k_H}) and discard the rest. Writing

cm(q)=∣{i≤kH:m∈σ(hi)}∣(3)c_m(q)=\left|\left\{i\leq k_H:m\in\sigma(h_i)\right\}\right| \tag*{(3)}

for the number of head elements retrieved by model mm, the majority contributor m^(q)=arg⁡max⁡mcm(q)\hat{m}(q)=\arg\max_m c_m(q) supplies the tail, with ties resolved in favor of m⋆m^\star. The assembled ranking R(q)R(q) is constructed from π^=πm^(q)(q)\hat{\pi}=\pi_{\hat{m}(q)}(q) by replacing the first kHk_H elements with H(q)H(q) and resolving duplicates as described below. For ungated queries no pool exists and R(q)R(q) is the full ranking of m⋆m^\star.

Duplicate resolution. An image hi∈H(q)h_i\in H(q) contributed by another model may sit at some position p>kHp>k_H in π^\hat{\pi}, in which case it would appear twice in R(q)R(q). Symmetrically, images that π^\hat{\pi} originally placed in its own top-kHk_H may have been displaced out of H(q)H(q) by the reranker. Let D(q)D(q) be the sequence of displaced images {π^(r)}r=1kH∖H(q)\{\hat{\pi}^{(r)}\}_{r=1}^{k_H} \setminus H(q) in order of original rank, and V(q)V(q) the vacated tail positions {p>kH:π^(p)∈H(q)}\{p > k_H : \hat{\pi}^{(p)} \in H(q)\} in ascending order. Since π^\hat{\pi} is a permutation of G\mathcal{G}, every element of H(q)H(q) occupies exactly one position in it, and ∣D(q)∣=∣V(q)∣|D(q)| = |V(q)|. Pairing them in order, the jj-th vacated position receives the jj-th displaced image,

R(r)(q)={hrif r≤kH,D(q)jif r=V(q)j,π^(r)otherwise,(4)R^{(r)}(q)= \begin{cases} h_r & \text{if } r \le k_H,\\ D(q)_j & \text{if } r = V(q)_j,\\ \hat{\pi}^{(r)} & \text{otherwise,} \end{cases} \tag*{(4)}

so R(q)R(q) contains every gallery image exactly once and has length NN.

Experiments

Dataset and metrics. We evaluate our approach on CHIRLA [22], a long-term Re-ID benchmark recorded over seven months in an indoor office with seven cameras and 22 identities, where participants changed clothing between sessions. We select it for several reasons. It is an evaluation-only benchmark, with no publicly released Re-ID model trained on it, so neither expert has seen its identities, cameras, or outfits. Its crops are high enough in resolution to preserve facial evidence. It is far from saturated, so the disagreement regime our gate targets is well populated. Its four scenarios separate clothing change from viewpoint change. Reappearance (Reapp.) and multi-camera (MC) stay within a session, while long-term (LT) and multi-camera long-term (MC-LT) span different days. We follow the benchmark protocol and compute metrics per subset before averaging. We adopt the closed-set setting and report R-1 and mAP. When comparing two methods, we call a difference significant when an exact paired sign-flip test over identities gives p<0.05p < 0.05, and give 95% confidence intervals (CI) from a paired bootstrap over identities; Section A.5 describes both, and Table 9 reports them for every comparison in this section. Table 7 gives the query and gallery sizes per scenario.

ScenarioSubsetsQuery AllQuery ClosedQuery IDsGallery Imgs.Gallery IDsCams.
LT64903369210368136
MC-LT92207113411252197
MC94454431119305197
Reapp.91251125121258214

Table 7.

ComparisonR-1mAP
Δ\Delta [95% CI]ppkkΔ\Delta [95% CI]ppkk
Against SapiensID
Union + VLM (gated) P=16P=16 vs. SapiensID+12.9 [+9.3, +16.8]< 0.00118+9.5 [+7.1, +11.7]< 0.00120
Union + VLM (gated) P=6P=6 vs. SapiensID+10.6 [+7.0, +14.4]< 0.00119+5.8 [+3.4, +8.1]< 0.00120
Score Fusion vs. SapiensID+3.6 [+0.3, +7.0]0.08419+3.7 [+1.5, +5.9]0.01221
RRF vs. SapiensID+1.9 [−1.8, +5.8]0.42619+2.9 [+0.3, +5.3]0.07821
Voting (Borda) vs. SapiensID+0.5 [−3.2, +4.3]0.82319+1.5 [−1.1, +4.0]0.36221
DIFFER vs. SapiensID−6.4 [−12.6, +0.2]0.10520−3.0 [−8.0, +1.7]0.31021
Against Score Fusion
Union + VLM (gated) P=16P=16 vs. Score Fusion+9.4 [+7.6, +10.7]< 0.00119+5.7 [+4.4, +6.7]< 0.00121
Union + VLM (gated) P=6P=6 vs. Score Fusion+7.1 [+5.5, +8.1]< 0.00120+2.1 [+0.9, +3.1]0.00421
Pool, gate, and budget
Pool, union vs. SapiensID only, (all) P=6P=6+3.0 [+0.5, +5.1]0.05420+3.9 [+1.4, +6.0]0.00621
Pool, union vs. SapiensID only, (all) P=16P=16+1.0 [−0.6, +2.6]0.26417+1.8 [−0.6, +4.0]0.26420
Pool, union vs. SapiensID only, (all) P=40P=40−0.2 [−1.3, +0.8]0.62119−0.7 [−1.7, +0.5]0.21220
Gate, (gated) vs. (all) P=6P=6−1.1 [−1.8, −0.2]0.16117−1.8 [−2.1, −1.4]< 0.00121
Gate, (gated) vs. (all) P=16P=16−0.7 [−1.8, +0.6]0.18618−3.3 [−4.0, −2.4]< 0.00120
Gate, (gated) vs. (all) P=40P=40+0.1 [−1.2, +1.6]0.90520−3.8 [−4.6, −2.7]< 0.00121
Budget, (gated) P=16P=16 vs. P=6P=6+2.3 [+1.5, +3.1]< 0.00119+3.6 [+3.1, +4.2]< 0.00120
Budget, (gated) P=40P=40 vs. P=16P=16−0.4 [−1.8, +0.8]0.55016+2.5 [+1.5, +3.4]< 0.00120
Tail rule, pool order, and judge
Tail, majority vs. DIFFERidentical by construction+1.2 [+0.6, +1.9]0.00320
Tail, majority vs. SapiensIDidentical by construction+1.3 [+0.6, +1.9]0.00219
Order, ρ\rho (SapiensID, DIFFER) vs. (DIFFER, SapiensID)+0.7 [−0.0, +1.6]0.12117+0.2 [−0.2, +0.6]0.43620
Judge, Qwen3.6-27B vs. Qwen3.6-35B-A3B+1.4 [+0.4, +2.5]0.01318+1.0 [+0.5, +1.5]020
Prompt ablations (Reapp.)
Binding, +anchor (images before)+4.8 [+3.9, +5.7]< 0.00116+2.2 [+1.7, +2.6]< 0.00120
Binding, +anchor (images after)+8.5 [+5.3, +13.3]0.00117+3.3 [+1.5, +5.0]< 0.00120
Binding, +label+0.7 [−1.1, +2.6]0.63316+1.6 [+1.0, +2.0]< 0.00117
Binding, +anchor +label (images after)+9.3 [+5.0, +12.7]< 0.00116+4.8 [+2.8, +6.8]< 0.00120
Position, after vs. before (no anchor)−1.5 [−4.5, +1.6]0.51017−0.1 [−1.3, +1.0]0.87720
Position, after vs. before (anchor)+2.2 [−0.6, +4.8]0.32315+1.0 [−0.1, +1.9]0.10918
Removal, attribute list (system)−1.2 [−3.4, +0.2]0.21713−0.8 [−1.8, +0.1]0.22217
Removal, attribute list (user)−1.0 [−3.3, +0.9]0.52217−0.7 [−1.7, +0.3]0.53219
Removal, clothing prohibition and escape hatch−0.6 [−1.6, +0.6]0.72813−0.5 [−1.2, +0.2]0.94215
Removal, escape hatch only−1.7 [−3.5, −0.1]0.11613−0.8 [−1.7, +0.0]0.21518
Removal, step-by-step directive−0.2 [−1.3, +1.4]0.86911−0.4 [−1.0, +0.5]0.74315

Table 9. Paired uncertainty for every comparison in § 4. Δ\Delta is the first method minus the second, in points; for Binding and Removal rows it is the change from adding or removing the named prompt component. Values are on the Avg. column, except the prompt ablations, which were run on Reapp. only. Intervals are 95% from the identity-level paired bootstrap. pp is the exact sign-flip test over identities and kk the number of identities whose share of Δ\Delta is non-zero, so the smallest attainable pp is 2/2k2/2^k. p<0.05p < 0.05 in bold, uncorrected for multiple comparisons.

Implementation details. All weights are frozen and nothing is trained or fine-tuned on CHIRLA. The prompt configuration, m⋆m^\star and kHk_H were selected on the designated validation subset and then fixed for all evaluation subsets; ρ\rho was fixed arbitrarily, without consulting any performance number. § 4.3 and § 4.4 therefore measure the effect of these choices on test. The two experts are DIFFER [21] and SapiensID [12], using their released checkpoints, pre-trained on Celeb-ReID-light [62] and WebBody12M [12] respectively. We set m⋆=SapiensIDm^\star= \text{SapiensID}, ρ\rho to the (DIFFER, SapiensID) block order, and kH=kk_H = k. The judge is Qwen3.6-27B [63], a dense VLM served with vLLM [64] behind an OpenAI-compatible API on two NVIDIA L40S GPUs, decoding greedily (T=0T = 0) with reasoning mode disabled. Outputs that are not a valid permutation of the pool are re-prompted at most twice, after which we fall back to m⋆m^\star. Section A.7 gives the prompt templates and Figure 4 an example pool. § 4.4 repeats the pipeline with Qwen3.6-35B-A3B [65], a mixture-of-experts model.

Figure 4. A query and its P=6P = 6 pool. The images are sent as P+1P + 1 separate entries after the instructions, in the order ρ\rho. Each crop carries its role in a white banner burned into the pixels, Query or the candidate number, which is the Label intervention of Table 3. Without it the role survives only in the surrounding text, and the judge has to infer which crop is which from position alone.

Main results

Table 1 extends the oracle and error analysis of Figure 1 to all four scenarios. On average, the experts disagree at R-1 on 60.4% of queries. Where they agree, the shared prediction is correct 74.9% of the time, above either expert's overall R-1, so suppressing the judge there should cost little. Agreement also fixes both experts to the same answer, so the entire oracle gap, 51.4 to 65.5 R-1 on average, lies on the gated queries. There, a merged P=16P = 16 pool holds the correct identity 90.8% of the time. Hence the two choices the pipeline makes: invoke the judge only where the experts disagree, and give it the merged union, since it holds the correct identity for the large majority of gated queries.

Arbitration beats aggregation. The VLM here is not only refining one model’s ranked list. It decides which of two models’ proposals to accept, acting as an arbitration ensemble method. In

ScenarioGated (% all)Correct (% agree)Oracle (or.) R-1 m⋆→m^\star\rightarrow or.Pool recall (% gated)
LT74.664.235.5 →\rightarrow 50.183.9
MC-LT65.270.943.4 →\rightarrow 61.894.0
MC54.985.561.3 →\rightarrow 74.790.2
Reapp.47.079.165.5 →\rightarrow 75.595.2
Avg.60.474.951.4 →\rightarrow 65.590.8

Table 1. Gate analysis. Gated: the experts’ R-1 identities differ, so the judge is invoked. Correct: agreeing queries whose shared R-1 is right. Oracle: the better expert m⋆m^\star against a per-query oracle. Pool recall: gated queries whose GT identity is in the merged P=16P=16 pool; the judge’s R-1 ceiling.

Table 2, we compare against standard ensembling over the experts’ full rankings, so those baselines see the whole gallery where our judge sees PP candidates; Section A.3 gives the three formulations. The best of them reaches 55.0 average R-1, 3.6 points above the better expert, a gain that is not significant. The gated pipeline at P=16P = 16 reaches 64.4, 12.9 points above SapiensID and 9.4 above score fusion, both significant. Even treating each person as the unit of analysis, the 12.9-point gain has a 95% CI of [9.3, 16.8]. The margin holds scenario by scenario rather than only on the average, at least 11.4 R-1 over the better expert and 6.0 over the best ensemble on that scenario, with the same pattern on mAP, and it is significant in every scenario against both SapiensID and score fusion. We attribute this to how the baselines combine the experts. All three commit in advance to a fixed rule for combining the two lists, and score fusion must also combine scores that were never calibrated against each other, which min–max normalising does not make commensurable. The judge instead looks at the crops and can decide differently on every query.

MethodLT R-1LT mAPMC-LT R-1MC-LT mAPMC R-1MC mAPReapp. R-1Reapp. mAPAvg. R-1Avg. mAPΔ R-1 [95% CI]
DIFFER [21]30.8931.2042.5648.5152.6753.7954.1555.4545.0747.24−6.4 [−12.6, +0.2]
SapiensID [12]35.5035.0143.4446.6361.2857.9465.5061.2251.4350.20ref.
Voting (Borda) [66]38.6336.1745.8150.2760.3359.2762.8461.0051.9051.68+0.5 [−3.2, +4.3]
RRF [28]39.6037.4149.4952.1461.0660.4763.2062.3153.3453.08+1.9 [−1.8, +5.8]
Score Fusion [27]40.9538.3148.6051.7864.4761.7565.9363.9054.9953.94+3.6 [+0.3, +7.0]
Union + VLM (gated) P=6P = 644.9739.5956.3554.4373.2564.8773.7265.2862.0756.04+10.6* [+7.0, +14.4]
Union + VLM (gated) P=16P = 1646.9242.9156.9957.4976.1069.1677.4169.1164.3559.67+12.9* [+9.3, +16.8]

Table 2. Main results on CHIRLA. Our pipeline against the two experts and standard ensembling. Per column, the best and second-best results, in bold and underlined, respectively. Δ\Delta is the Avg. R-1 difference relative to SapiensID (ref.) with its 95% confidence interval (CI) from a paired bootstrap over identities; * marks p<0.05p < 0.05 under an exact sign-flip test (Section A.5).

What the union and the gate contribute

The second expert pays for itself twice. Dropping it and reranking SapiensID’s own top-PP is the natural alternative, plotted as SapiensID + VLM in Figure 2. At matched PP and with that gate removed, the union costs less at every budget, 905 PFLOPs against 954, 1409 against 1592, and 2594 against 3079. At P=6P = 6 it is ahead by 3.0 R-1 and 3.9 mAP; the mAP gain is significant and the R-1 gain borderline (p=0.054p = 0.054). At P=16P = 16 and P=40P = 40 the two are indistinguishable. Pool size does not explain the gain, since the union leaves the merged pool smaller than the budget, on average 5.1 candidates against a full 6.0 at P=6P = 6, so the judge does at least as well while seeing fewer crops, and that is also what makes it cheaper. The advantage is only resolved at P=6P = 6, likely because a single expert’s longer shortlist already contains most of what the merge would add. The second expert also supplies the disagreement signal, without which there is nothing to gate on, and gating is what brings the union down to 594 PFLOPs at P=6P = 6.

Figure 2. Accuracy against compute as PP grows. R-1 is averaged over the four scenarios and compute is the total FLOPs to run all four benchmarks once. All three pipelines sit above the SapiensID embedding-only baseline (dashed). The gated pipeline traces the same accuracy range at a fraction of the cost, since it calls the judge only where the experts disagree.

The gate trades mAP for compute. Against the same pipeline without it, gating has no significant effect on R-1 at any of the three budgets (P=6P = 6: −1.1, P=16P = 16: −0.7 and P=40P = 40: +0.1). In exchange the judge is skipped on the 40% of queries where the experts agree, removing 35% of the compute, which is the whole operating point, since the embedding stage is under 0.5% of every pipeline’s total. Those two figures differ because the skipped queries are the cheaper ones: agreeing shortlists overlap more, so deduplication cuts deeper, leaving 4.5 candidates against 5.5 on the queries the judge does see. The cost in mAP is larger, grows with the budget, and is significant at every budget: 1.8, 3.3 and 3.8 points (p≤2×10−4p \le2 \times10^{-4}, see Table 9). On the queries the gate skips, the pipeline returns SapiensID’s ranking unchanged, so nothing below rank 1 is reordered there, and the deeper the judge reorders elsewhere the more that untouched remainder costs. A gate defined on rank-1 labels protects R-1 and leaves the rest of the list alone.

Accuracy saturates before cost does. R-1 rises significantly from P=6P = 6 to P=16P = 16 and then flattens while cost keeps growing, and mAP keeps improving significantly to the largest budget tested. Enlarging PP adds candidates below the current head, which lifts mAP mechanically but moves R-1 only when an added candidate displaces a wrong rank 1. How the judge reorders the pool explains why R-1 stops rising. At P=6P = 6, restricted to queries whose ground truth is in the pool, the judge promotes it for 38.9 to 62.3% of queries and demotes it for 10.8 to 22.2%, and within that subset R-1 rises from 26.1% to 75.0% on MC. From P=16P = 16 to P=40P = 40 the demoted fraction grows in every scenario, by 1.9 to 10.1 points, while the promoted fraction falls by 0.7 to 5.4, so longer lists are reordered more aggressively without being reordered better. Reliability degrades on the same axis, with corrected outputs growing from 0.2% of queries at P≤10P \le10 to 32.0% at P=40P = 40 on LT under SapiensID + VLM (Table 10).

ScenarioP=6P=6P=10P=10P=16P=16P=20P=20P=30P=30P=40P=40
SapiensID + VLM
LT0.2 / 0.10.2 / 0.15.3 / 1.58.9 / 1.620.9 / 1.732.0 / 2.6
MC-LT0.2 / 0.20.1 / 0.03.4 / 0.14.3 / 0.07.1 / 0.19.6 / 0.4
MC0.1 / 0.10.1 / 0.14.6 / 0.07.2 / 0.07.5 / 0.422.7 / 1.4
Reapp.0.1 / 0.40.4 / 0.03.7 / 0.06.8 / 0.016.2 / 0.318.9 / 0.5
Union + VLM (gated)
LT0.1 / 0.10.5 / 0.62.5 / 0.15.2 / 0.214.3 / 0.222.2 / 0.5
MC-LT0.7 / 0.30.3 / 0.11.8 / 0.53.3 / 0.36.0 / 0.44.7 / 0.1
MC0.2 / 0.00.6 / 0.41.9 / 0.24.5 / 0.312.0 / 0.216.3 / 0.7
Reapp.0.1 / 0.10.3 / 0.92.1 / 0.35.4 / 0.08.8 / 0.414.2 / 0.3

Table 10. Output-contract failures as a function of PP. Each cell is corrected / unrecovered, as a percentage of the queries sent to the judge. Judge: Qwen3.6-27B. See Section A.6.

Presenting the pool to the judge

Query binding dominates. Table 3 isolates the three choices that bind an image to its role, on Reappearance at P=6P = 6. All five variants carry the same task description, so the differences come from binding alone. The anchor sentence adds 4.8 to 8.5 R-1 depending on image position; with the images before the instructions, all but one of the identities whose R-1 changed improved. Burning the role into the image adds a further 1.6 mAP, but its R-1 gain is not significant. Image position has no significant effect, with or without the anchor sentence. With the images after the instructions, the two interventions together add 9.3 R-1 and 4.8 mAP. This matches what the position and recency bias literature predicts [59, 60, 61], that the model needs to be told which of the P+1P + 1 images is the query rather than to be told the task earlier.

Img. beforeImg. afterAnchorLabelR-1mAP
✓65.9860.59
✓✓70.7562.76
✓64.4660.46
✓✓72.9963.73
✓✓✓73.7265.28

Table 3. Prompt binding (Reapp. scenario). Images placed before or after the instructions, Anchor: anchor sentence, Label: role in the image pixels.

Task wording does not. Removing one semantic component at a time costs between 0.2 and 1.7 R-1 and under 0.9 mAP, whether it is the attribute enumeration, the clothing phrasing and its escape hatch, or the step-by-step directive (Table 11), and none of these drops is significant. Every one of those variants still beats every variant lacking the anchor sentence by at least 6.1 R-1. The gains therefore come from binding the query rather than from engineering the task description, which is the more transferable finding.

Removed componentR-1Δ\DeltamAPΔ\Delta
None, full prompt73.7265.28
Attribute list, system message72.47−1.2564.46−0.82
Attribute list, user message72.74−0.9864.57−0.71
Clothing prohibition and escape hatch73.12−0.6064.82−0.46
Escape hatch only72.05−1.6864.44−0.84
Step-by-step directive73.56−0.1664.90−0.38

Table 11. Semantic removals from the full prompt, CHIRLA (Reappearance), P=6P = 6. Each row removes one component from the full prompt, the last row of Table 3, which is repeated here for reference. Δ\Delta is measured against it. No removal is significant under the sign-flip test (Table 9).

Sensitivity to the pool ordering. Table 5 varies ρ\rho, keeping C(q)\mathcal{C}(q) fixed and swapping the order of the per-expert top-kk blocks. The two orders agree on the rank-1 identity for 69.2 to 82.1% of gated queries and on the full pool for 31.2 to 41.1%, far above chance but with a large residual, consistent with concurrent work on order sensitivity in VLMs [60]. Aggregate accuracy is steadier, moving by −0.3 to +2.1 R-1 depending on the scenario, and the two orders are not significantly different in aggregate. The order we use throughout was fixed in advance and is nominally the weaker of the two by 0.7 R-1, so our reported results do not benefit from it.

Ablations and analysis

Tail rule. Table 4 compares fixing the tail to one expert against the per-query majority vote of Eq. (3). We report mAP only, since the tail rule applies only to gated queries, below the head the judge supplies, so it cannot move R-1, and ungated queries keep SapiensID’s ranking under every rule. The majority vote wins in every scenario, by a small margin that is significant on the average, 1.2 and 1.3 mAP over the DIFFER and SapiensID tails. Table 12 gives the breakdown over the ways of crediting a candidate that both models retrieved, which differ by at most 0.3 mAP.

TailLTMC-LTMCReapp.
DIFFER38.3254.2363.0963.61
SapiensID38.5152.9563.0564.39
Majority39.5954.4364.8765.28

Table 4. Ablation of tail selection at P=6P = 6 on Union + VLM (gated). All values are mAP (%) since R-1 is agnostic to the tail selection.

Tail ruleLTMC-LTMCReapp.
Fixed tail: DIFFER38.3254.2363.0963.61
Fixed tail: SapiensID38.5152.9563.0564.39
Majority tail
credit DIFFER39.4954.6464.7764.99
credit SapiensID39.5954.3564.6965.27
credit own-rank (tie DIFFER)39.5254.6264.8165.11
credit own-rank (tie SapiensID)39.5854.4764.7965.18
credit all (tie DIFFER)39.5654.6164.7865.04
credit all (tie SapiensID)39.5954.4364.8765.28

Table 12. Tail rule ablation. mAP (%) at P=6P = 6 with head size kH=k=3k_{\mathrm{H}} = k = 3, per-subset averages, SapiensID as the agreement source. Judge: Qwen3.6-27B. See Section A.8 for the rules.

A second VLM. Table 6 repeats the gated pipeline at P=6P = 6 with Qwen3.6-35B-A3B. It scores below Qwen3.6-27B in every scenario, significantly so on average (1.4 R-1 and 1.0 mAP) but not in each scenario on its own, and shows the same pattern of gains. It is also worse at following the output format, with higher correction and invalid-output rates.

Table 6: Results for two VLMs at P=6P = 6, gated pipeline. Format reports how often the response was not valid, with Corr. meaning repaired by the correction prompt, and Unrec. still invalid after the maximum of attempts, computed over the four Re-ID scenarios.

MethodLTMC-LTMCReapp.Format (%)
R-1 ↑\uparrowmAP ↑\uparrowR-1 ↑\uparrowmAP ↑\uparrowR-1 ↑\uparrowmAP ↑\uparrowR-1 ↑\uparrowmAP ↑\uparrowCorr. ↓\downarrowUnrec. ↓\downarrow
Qwen3.6-35B-A3B43.9638.7055.5853.5270.9263.8072.1364.336.791.76
Qwen3.6-27B44.9739.5956.3554.4373.2564.8773.7265.280.230.12

Table 6.

Qualitative results. Figure 3 shows two gated queries. The first is a recovery, where the judge promotes an identity that neither expert ranked first. The second is a failure, where the judge misjudges the gender of the candidates, treating long hair as an intrinsic female characteristic, and pushes the correct candidates down, from ranks 2 to 4 into positions 9 to 11.

Figure 3. Qualitative results on two gated queries. Query in gray, green marks a correct identity and red an incorrect one. For each query the upper row is the merged pool from DIFFER and SapiensID in the order shown to the judge, and the lower row is the order the judge returns. Above, the judge lifts four correct candidates to the head. Below, it demotes the three correct candidates.

Conclusions

We combine two frozen CC-ReID experts with complementary errors by having a general-purpose VLM rerank the union of their shortlists. On CHIRLA, a benchmark recorded over seven months, the VLM judges identity better than either expert it reranks, at 64.4 average R-1 and ahead of every naive ensemble of the two. Merging the two shortlists costs less than reranking a single expert’s list at the same budget and is not significantly worse at any budget, with a significant mAP gain at the smallest one. The prompt matters as well, and its largest single gain comes from telling the judge which image is the query. The judge dominates the pipeline’s cost, so we invoke it only where the experts disagree; elsewhere their agreement is a reliable enough prediction. That removes 40% of the calls with no significant loss in R-1, at a cost of 1.8 to 3.8 mAP. None of this requires training on the target data, calibrating one expert’s scores against the other’s, or a threshold to tune.

Limitations. Our evaluation rests on CHIRLA’s 22 identities. How often the two experts disagree will therefore differ on other data, and with it how much the gate saves. What the gate needs, though, is only that agreement predicts correctness. Even gated, reranking stays the dominant cost, and the saving is paid for in mAP. The judge is also order-sensitive, and its errors are not neutral: it sometimes groups candidates by coarse attributes such as apparent gender. Nothing here is trained, however, so stronger experts or a stronger judge can be swapped in directly, on CHIRLA or on other CC-ReID benchmarks.

Acknowledgments and Disclosure of Funding

We thank Christian Henning for many insightful discussions, valuable ideas, and continuous support during the development of this work.

Bessie Dominguez-Dager is supported by the FPU predoctoral grant FPU23/02247 from the Spanish Ministry of Science, Innovation and Universities. This work was carried out during a research stay at the Imagine group of the Laboratoire d’Informatique Gaspard-Monge (LIGM), École nationale des ponts et chaussées (France), funded by the FPU mobility grant FPUES23/00198 from the same ministry. This work is also part of the project I+D+i PID2022-138453OB-I00, funded by MCIN/AEI/10.13039/501100011033/ and by “ERDF, A way of making Europe”.

The authors declare no competing interests.

Technical Appendices and Supplementary Material

Dataset statistics

Table 7 sizes the four CHIRLA scenarios and reports how many traink/testk\mathrm{train}_k/\mathrm{test}_k subset pairs each one evaluates, since metrics are averaged over pairs rather than pooled over queries, and the pairs are uneven. Subset 0 is the designated validation subset used for inference-time configuration selection and is excluded from every reported metric.

Table 7: CHIRLA statistics. Subsets counts the traink/testk\mathrm{train}_k/\mathrm{test}_k pairs the protocol evaluates, excluding subset 0. Sizes are summed over the pairs; identity and camera counts are unions over them. Closed counts the queries whose identity is not a distractor and appears in the corresponding gallery, and the gap to all is what the closed-set protocol discards.

FLOPs calculation

We account for compute as

FLOPs≈FLOPsembed+2NactD,(5)\mathrm{FLOPs} \approx\mathrm{FLOPs}_{\mathrm{embed}} + 2N_{\mathrm{act}}D, \tag*{(5)}

the standard forward-pass count of one multiply-add per parameter per token [67], summing the experts’ forward passes over queries and gallery with the judge’s cost over the DD prompt and completion tokens it processes. NactN_{\mathrm{act}} is the judge’s active parameter count (27B for the dense model used throughout the compute analysis). Per-image forward costs for the experts are measured on CHIRLA crops.

Two terms are omitted. The first is attention’s context-dependent cost, given in the same reference as 2nlayernctxdattn2n_{\mathrm{layer}}n_{\mathrm{ctx}}d_{\mathrm{attn}} per token; for the served configuration (64 layers, dattn=6144d_{\mathrm{attn}} = 6144) at our measured token counts this is 2.2% of the parameter term at P=6P = 6, rising to 7.9% at P=40P = 40. The second is the vision tower that converts crops into image tokens; those tokens are counted once they reach the language model, but the encoder pass producing them is not. Both omissions scale with context and with the number of images, so at a fixed PP they inflate every pipeline near-equally and leave the ratios between them intact, and across PP they understate how fast cost grows. Under Eq. (5) cost is linear in PP, since DD is; the growth the omitted attention term would add is what makes true cost superlinear.

Ensemble baselines

The three aggregation baselines of Table 2 combine the two experts’ full rankings of the gallery, not a shortlist. Voting is a Borda count [66]: each expert awards a gallery item N−N-rank points and the totals are summed. Score Fusion min–max normalises each expert’s similarities to [0,1][0,1] and averages them [27]. RRF [28] sums 1/(k+rank)1/(k+\text{rank}) across experts with k=60k=60. All three are computed from the raw embeddings rather than the saved top-KK rankings, so no truncation is involved.

Full results over all pool budgets

Table 8 extends our evaluation to P∈{6,10,16,20,30,40}P \in\{6, 10, 16, 20, 30, 40\}, includes SapiensID + VLM and Union + VLM(all)_{\mathrm{(all)}} results, and FLOPs calculations.

MethodLT R-1LT mAPMC-LT R-1MC-LT mAPMC R-1MC mAPReapp. R-1Reapp. mAPAvg. R-1Avg. mAPPFLOPs
DIFFER [21]30.8931.2042.5648.5152.6753.7954.1555.4545.0747.241.9
SapiensID [12]35.5035.0143.4446.6361.2857.9465.5061.2251.4350.200.6
Voting (Borda) [66]38.6336.1745.8150.2760.3359.2762.8461.0051.9051.682.4
RRF [28]39.6037.4149.4952.1461.0660.4763.2062.3153.3453.082.4
Score Fusion [27]40.9538.3148.6051.7864.4761.7565.9363.9054.9953.942.4
SapiensID + VLM P=6P=642.8537.6053.4351.2271.6062.5472.5964.3060.1153.91954
SapiensID + VLM P=10P=1044.6339.7756.9255.2274.6066.9974.4166.7262.6457.181207
SapiensID + VLM P=16P=1644.8841.8257.3659.5377.6371.9476.2571.6664.0361.241592
SapiensID + VLM P=20P=2044.7642.7157.7962.0278.2173.6076.3874.0764.2863.101861
SapiensID + VLM P=30P=3044.2844.2858.7963.8878.3175.9875.9777.0064.3465.292475
SapiensID + VLM P=40P=4044.9845.7756.2963.2177.8278.9677.2978.5764.0966.633079
Union + VLM (gated) P=6P=644.9739.5956.3554.4373.2564.8773.7265.2862.0756.04594
Union + VLM (gated) P=10P=1045.9541.0259.0456.6674.3566.6075.1366.0463.6257.58728
Union + VLM (gated) P=16P=1646.9242.9156.9957.4976.1069.1677.4169.1164.3559.67921
Union + VLM (gated) P=20P=2047.0143.5156.0257.5375.4669.8476.6069.1663.7760.011057
Union + VLM (gated) P=30P=3046.3044.0955.7359.2177.3071.8876.4070.1563.9361.331397
Union + VLM (gated) P=40P=4046.0544.7555.4759.2477.6873.1476.5371.4963.9362.151694
Union + VLM (all) P=6P=645.7640.4358.2557.0873.5966.4974.8967.2063.1257.80905
Union + VLM (all) P=10P=1046.4042.4457.8159.0375.8369.9777.0069.7764.2660.301110
Union + VLM (all) P=16P=1646.2544.0056.6060.6178.6774.0378.6273.3065.0362.991409
Union + VLM (all) P=20P=2046.9345.1857.1661.4378.6575.3177.8573.8065.1563.931622
Union + VLM (all) P=30P=3044.9845.6455.5561.9179.1577.4576.5875.2364.0765.062147
Union + VLM (all) P=40P=4044.6945.8954.7662.7578.9378.2077.0077.0063.8465.962594

Table 8. CHIRLA Results over PP. VLM: Qwen3.6-27B. In bold best result per column and methods grouped. PFLOPs is the total forward compute to run all four benchmarks once, summed over scenarios: backbone passes over the closed-set queries and gallery, plus 2NactD2N_{\mathrm{act}}D for the DD tokens the VLM processes (Nact=27BN_{\mathrm{act}}=27\mathrm{B} active parameters).

Uncertainty estimates

The pipeline is deterministic, with only variability involved in the set of queries evaluated. These are video frames from tracklets of CHIRLA’s 22 identities, and frames and tracklets of one person are strongly correlated. For this reason, we resample identities rather than queries. Each of 10,000 bootstrap replicates draws identities with replacement, shares that draw across all subsets and scenarios, and recomputes each metric as reported; replicates that leave a subset empty are redrawn, and comparisons are paired on the same draw. Since a bootstrap over so few clusters can give intervals that are too narrow, we also report an exact sign-flip test over identities and call a difference significant only when it gives p<0.05p<0.05. Paired intervals are much narrower than single-method ones, a median half-width of 1.5 against 5.0 points on Avg. R-1, because per-identity difficulty cancels in the difference. Table 9 lists every comparison made in § 4.

Output-contract failures

Table 10 breaks the reliability trend of § 4.2 down by scenario, pipeline and pool budget. A response is corrected when the first attempt was not a valid permutation of 1..P1..P, and the correction prompt repaired it, and unrecovered when it was still invalid after both attempts, in which case the output is discarded and the ranking of m⋆m^\star is kept. From P=16P=16 the rate grows steeply in every row, the one exception being MC-LT under Union + VLM (gated), which falls at P=40P=40. Below P=16P=16 every rate is under 1% and the small non-monotonicities are within noise. Unrecovered failures stay at most 2.6% throughout, so the correction step absorbs nearly all of the growth, at the price of a second and sometimes third call on up to a third of queries.

Prompt templates

The reranker is driven by three templates. Placeholders in braces are filled at call time: {N} is the pool size PP, and the sentence about banners, shown filled in below, is present only when burned-in labels are used. The example line is a fixed rotation of 1..P1..P by two positions, identical for every query, so that it demonstrates the output format without suggesting an ordering. The anchor sentence ablated in Table 3 is the second sentence of the user message, “The Query is the FIRST image; the last image is Candidate {N}, not the Query.” The third sentence, which announces the burned-in banners, is the separate Label intervention. The banner is a 32 px white strip prepended above the crop, with the label centred in bold (see Figure 4).

Prompt Template: System Message

You are an expert in person re-identification across long-term,
person-occluded, cloth-changing, multi-camera surveillance scenarios. The
user will show you a Query person crop and several numbered Candidate crops
retrieved by a Re-ID system.

Analyze each person using features that remain stable across clothing changes:
body shape, build, skin tone, gender, and apparent age. Do not rely on
clothing color or type as primary evidence. Nevertheless, if you are unsure,
then you can pay attention to the fashion style as help.

Find similarities among the candidates and group them by high probability of
being the same person.

Reason step by step for each candidate before giving your final answer.

Prompt Template: User Message

Below you will see a Query person followed by the numbered Candidates
retrieved by a cloth-changing Re-ID system. The Query is the FIRST image;
the last image is Candidate \{N\}, not the Query. Each image has its label
printed in a white banner at the top: “Query” for the Query person, and its
number (1–\{N\}) for each candidate.

Reason step by step about each candidate’s similarity to the Query, focusing
on body shape, build, skin tone, gender, and age -- features that remain
stable across clothing changes.

Then output a final line with ALL candidates re-ordered from most to least
likely to be the same person as the Query, as a comma-separated list of
numbers.

Example for \{N\} candidates: RANKING: 3, 4, ..., \{N\}, 1, 2

Appended to the same conversation when the response does not end in a valid permutation of 1..PP, for at most two attempts:

Prompt Template: Correction Message

Your previous response could not be parsed. Reason: \{REASON\} Please end
your answer with a line in exactly this format: RANKING: followed by all \{N\}
candidate numbers as a comma-separated permutation of 1..\{N\}. Example for \{N\}
candidates:  RANKING: 3, 4, ..., \{N\}, 1, 2

The prompt variants ablated in Table 11 are obtained by removing individual components of these templates: the stable-attribute enumeration in either message, the clothing prohibition and its “if unsure” escape hatch, and the step-by-step reasoning directive. The anchor sentence and the banner-label note are ablated separately, in Table 3.

Tail-rule ablation

Table 12 extends the tail-rule ablation of § 4.4 with every way of counting model influence. The first two rows fix the tail to one model. The rest use the per-query majority vote and differ only in who is credited for a candidate both models retrieved, since the merge keeps a single copy and by position it is always attributed to the first-listed model. “credit own-rank” credits the model that ranked the candidate higher, and “credit all” is the rule Eq. (3) states, where every retriever counts, which is the only setting in which cmc_m can tie; “tie” names the model that wins such a tie. We report mAP only, since the head comes from the judge and the tail starts below it, so no tail rule can move R-1. Every majority variant beats both fixed tails in all four scenarios, and the six differ from each other by at most 0.3 mAP.

References

  1. [1]M. Ye, J. Shen, G. Lin, T. Xiang, L. Shao, and S. C. H. Hoi, “Deep learning for person re-identification: A survey and outlook,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 44, no. 6, pp. 2872–2893, 2022.DOI
  2. [2]H. Lee, J. Park, J. Oh, and C. Eom, “Domain generalization for person re-identification: A survey towards domain-agnostic person matching,” Neurocomputing, vol. 649, p. 130763, 2025.arxiv.org/abs/2506.12413
  3. [3]H. Luo, Y. Gu, X. Liao, S. Lai, and W. Jiang, “Bag of tricks and a strong baseline for deep person re-identification,” in 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), pp. 1487–1495, 2019.arxiv.org/abs/1903.07071
  4. [4]S. He, H. Luo, P. Wang, F. Wang, H. Li, and W. Jiang, “Transreid: Transformer-based object re-identification,” in 2021 IEEE/CVF International Conference on Computer Vision (ICCV), pp. 14993–15002, 2021.arxiv.org/abs/2102.04378
  5. [5]K. Zhu, H. Guo, T. Yan, Y. Zhu, J. Wang, and M. Tang, “Pass: Part-aware self-supervised pre-training for person re-identification,” in Computer Vision – ECCV 2022 (S. Avidan, G. Brostow, M. Cissé, G. M. Farinella, and T. Hassner, eds.), (Cham), pp. 198–214, Springer Nature Switzerland, 2022.arxiv.org/abs/2203.03931
  6. [6]W. Chen, X. Xu, J. Jia, H. Luo, Y. Wang, F. Wang, R. Jin, and X. Sun, “Beyond appearance: A semantic controllable self-supervised learning framework for human-centric visual tasks,” in 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 15050–15061, 2023.arxiv.org/abs/2303.17602
  7. [7]S. Li, L. Sun, and Q. Li, “Clip-reid: exploiting vision-language model for image re-identification without concrete text labels,” in Proceedings of the Thirty-Seventh AAAI Conference on Artificial Intelligence and Thirty-Fifth Conference on Innovative Applications of Artificial Intelligence and Thirteenth Symposium on Educational Advances in Artificial Intelligence, AAAI’23/IAAI’23/EAAI’23, AAAI Press, 2023.arxiv.org/abs/2211.13977
  8. [8]W. He, Y. Deng, S. Tang, Q. Chen, Q. Xie, Y. Wang, L. Bai, F. Zhu, R. Zhao, W. Ouyang, D. Qi, and Y. Yan, “Instruct-reid: A multi-purpose person re-identification task with instructions,” in 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 17521–17531, 2024.arxiv.org/abs/2306.07520
  9. [9]V. Somers, A. Alahi, and C. D. Vleeschouwer, “Keypoint promptable re-identification,” in Computer Vision – ECCV 2024 (A. Leonardis, E. Ricci, S. Roth, O. Russakovsky, T. Sattler, and G. Varol, eds.), (Cham), pp. 216–233, Springer Nature Switzerland, 2025.DOI
  10. [10]D. Arkushin, B. Cohen, S. Peleg, and O. Fried, “Geff: Improving any clothes-changing person reid model using gallery enrichment with face features,” in 2024 IEEE/CVF Winter Conference on Applications of Computer Vision Workshops (WACVW), pp. 143–153, 2024.arxiv.org/abs/2211.13807
  11. [11]Z. Wu, J. Ding, and Q. Zhang, “FaceCC: facial feature combination network for cloth-changing person re-identification,” Journal of Electronic Imaging, vol. 33, no. 1, p. 013045, 2024.DOI
  12. [12]M. Kim, D. Ye, Y. Su, F. Liu, and X. Liu, “Sapiensid: Foundation for human recognition,” in 2025 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 13937–13947, 2025.arxiv.org/abs/2504.04708
  13. [13]H. Zhu, P. Budhwant, Z. Zheng, and R. Nevatia, “Seas: Shape-aligned supervision for person re-identification,” in 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 164–174, 2024.DOI
  14. [14]F. Liu, M. Kim, Z. Ren, and X. Liu, “Distilling clip with dual guidance for learning discriminative human body shape representation,” in 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 256–266, 2024.DOI
  15. [15]J. Chen, X. Jiang, F. Wang, J. Zhang, F. Zheng, X. Sun, and W.-S. Zheng, “Learning 3d shape feature for texture-insensitive person re-identification,” in 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 8142–8151, 2021.DOI
  16. [16]P. Hong, T. Wu, A. Wu, X. Han, and W.-S. Zheng, “Fine-grained shape-appearance mutual learning for cloth-changing person re-identification,” in 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 10508–10517, 2021.DOI
  17. [17]X. Jin, T. He, K. Zheng, Z. Yin, X. Shen, Z. Huang, R. Feng, J. Huang, Z. Chen, and X.-S. Hua, “Cloth-changing person re-identification from a single image with gait prediction and regularization,” in 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 14258–14267, 2022.arxiv.org/abs/2103.15537
  18. [18]W. Li, S. Hou, C. Zhang, C. Cao, X. Liu, Y. Huang, and Y. Zhao, “An in-depth exploration of person re-identification and gait recognition in cloth-changing conditions,” in 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 13824–13833, 2023.DOI
  19. [19]Q. Yang, A. Wu, and W.-S. Zheng, “Person Re-Identification by Contour Sketch Under Moderate Clothing Change,” IEEE Transactions on Pattern Analysis & Machine Intelligence, vol. 43, pp. 2029–2046, June 2021.DOI
  20. [20]X. Qian, W. Wang, L. Zhang, F. Zhu, Y. Fu, T. Xiang, Y.-G. Jiang, and X. Xue, “Long-term cloth-changing person re-identification,” in Computer Vision – ACCV 2020 (H. Ishikawa, C.-L. Liu, T. Pajdla, and J. Shi, eds.), (Cham), pp. 71–88, Springer International Publishing, 2021.arxiv.org/abs/2005.12633
  21. [21]X. Liang and Y. S. Rawat, “Differ: Disentangling identity features via semantic cues for clothes-changing person re-id,” in 2025 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 13980–13989, 2025.arxiv.org/abs/2503.22912
  22. [22]B. Dominguez-Dager, F. Escalona, F. Gomez-Donoso, and M. Cazorla, “Chirla: Comprehensive high-resolution identification and re-identification for large-scale analysis,” Scientific Data, vol. 13, no. 109, 2026.
  23. [23]M. Duan, H. Li, and M. Ye, “Mllms meet person re-identification,” in Proceedings of the 33rd ACM International Conference on Multimedia, MM ’25, (New York, NY, USA), p. 12247–12256, Association for Computing Machinery, 2025.DOI
  24. [24]D. Chen, R. Chen, S. Zhang, Y. Wang, Y. Liu, H. Zhou, Q. Zhang, Y. Wan, P. Zhou, and L. Sun, “Mllm-as-a-judge: assessing multimodal llm-as-a-judge with vision-language benchmark,” in Proceedings of the 41st International Conference on Machine Learning, ICML’24, JMLR.org, 2024.arxiv.org/abs/2402.04788
  25. [25]L. Zheng, W.-L. Chiang, Y. Sheng, S. Zhuang, Z. Wu, Y. Zhuang, Z. Lin, Z. Li, D. Li, E. P. Xing, H. Zhang, J. E. Gonzalez, and I. Stoica, “Judging llm-as-a-judge with mt-bench and chatbot arena,” in Proceedings of the 37th International Conference on Neural Information Processing Systems, NIPS ’23, (Red Hook, NY, USA), Curran Associates Inc., 2023.arxiv.org/abs/2306.05685
  26. [26]J. Kittler, M. Hatef, R. Duin, and J. Matas, “On combining classifiers,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 20, no. 3, pp. 226–239, 1998.DOI
  27. [27]A. Jain, K. Nandakumar, and A. Ross, “Score normalization in multimodal biometric systems,” Pattern Recognition, vol. 38, no. 12, pp. 2270–2285, 2005.
  28. [28]G. V. Cormack, C. L. A. Clarke, and S. Büttcher, “Reciprocal rank fusion outperforms condorcet and individual rank learning methods,” in Proceedings of the 32nd International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR ’09, (New York, NY, USA), p. 758–759, Association for Computing Machinery, 2009.DOI
  29. [29]S. Li, J. Leng, G. Li, J. Gan, X. Gao, et al., “Clip-driven cloth-agnostic feature learning for cloth-changing person re-identification,” arXiv preprint arXiv:2406.09198, 2024.arxiv.org/abs/2406.09198
  30. [30]K. Osamura, H. Uchida, S. Nie, and N. Abe, “Multi-masked prompt learning for clothing-change person re-identification,” in 2024 IEEE International Joint Conference on Biometrics (IJCB), pp. 1–8, 2024.DOI
  31. [31]S. Wei, Z. Gao, C. Ma, Y. Zhao, W. Guan, and S. Chen, “Multiple information prompt learning for cloth-changing person re-identification,” IEEE Transactions on Image Processing, vol. 34, pp. 801–815, 2025.DOI
  32. [32]S. Huang, H. Ling, Z. Li, X. Li, and Z. Lv, “Dual-stream relation-modeling disentanglement for cloth-changing person re-identification,” in Proceedings of the AAAI Conference on Artificial Intelligence, 2026.
  33. [33]K. Han, S. Gong, Y. Huang, L. Wang, and T. Tan, “Clothing-change feature augmentation for person re-identification,” in Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp. 22066–22075, 2023.
  34. [34]J. Zhang, X. Li, S. Wu, Y. Xu, and Y. Wang, “Prior-free augmentation for cloth-changing person re-identification,” in Proceedings of the 33rd ACM International Conference on Multimedia, MM ’25, (New York, NY, USA), p. 10612–10621, Association for Computing Machinery, 2025.
  35. [35]L. Jiang, C. Zhang, L. Wu, Z. Li, Z. Wang, and C. Wei, “Joint feature augmentation and posture label for cloth-changing person re-identification: L. jiang et al.,” Multimedia Systems, vol. 31, no. 2, p. 103, 2025.DOI
  36. [36]F. Liu, M. Ye, and B. Du, “Cloth-aware augmentation for cloth-generalized person re-identification,” in Proceedings of the 32nd ACM International Conference on Multimedia, MM ’24, (New York, NY, USA), p. 4053–4062, Association for Computing Machinery, 2024.DOI
  37. [37]V. D. Nguyen and S. K. Shah, “Ccpa: Long-term person re-identification via contrastive clothing and pose augmentation,” arXiv preprint arXiv:2402.14454, 2024.arxiv.org/abs/2402.14454
  38. [38]V. D. Nguyen, P. Mantini, and S. K. Shah, “Contrastive clothing and pose generation for cloth-changing person re-identification,” in 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), pp. 7541–7549, 2024.DOI
  39. [39]A. Joseph and S. Peleg, “Clothes-changing person re-identification based on skeleton dynamics,” arXiv preprint arXiv:2503.10759, 2025.arxiv.org/abs/2503.10759
  40. [40]Z. Pang, L. Zhao, and C. Wang, “Clothing-invariant contrastive learning for unsupervised person re-identification,” Neural Networks, vol. 178, p. 106477, 2024.DOI
  41. [41]Z. Pang, L. Zhao, Y. Liu, G. Sharma, and C. Wang, “Joint augmentation and part learning for unsupervised clothing change person re-identification,” IEEE Transactions on Information Forensics and Security, vol. 20, pp. 2944–2956, 2025.DOI
  42. [42]Z. Pang, J. Wang, L. Zhao, and C. Wang, “Identity-clothing similarity modeling for unsupervised clothing change person re-identification,” in 2025 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 19251–19260, 2025.DOI
  43. [43]Q. Han, X. He, Z. Liu, S. Liu, Y. Zhang, and J. Xiang, “Clip-scgi: synthesized caption-guided inversion for person re-identification,” arXiv preprint arXiv:2410.09382, 2024.arxiv.org/abs/2410.09382
  44. [44]Z. Yang, D. Wu, C. Wu, Z. Lin, J. Gu, and W. Wang, “A pedestrian is worth one prompt: Towards language guidance person re-identification,” in 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 17343–17353, 2024.DOI
  45. [45]C. Wang, X. Gao, M. Wu, S.-K. Lam, S. He, and P. Tiwari, “Looking clearer with text: A hierarchical context blending network for occluded person re-identification,” IEEE Transactions on Information Forensics and Security, vol. 20, pp. 4296–4307, 2025.DOI
  46. [46]Y. Wang, Y. Lv, P. Zhang, and H. Lu, “Idea: Inverted text with cooperative deformable aggregation for multi-modal object re-identification,” in 2025 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 29701–29710, 2025.arxiv.org/abs/2503.10324
  47. [47]K. Niu, H. Yu, X. Qian, T. Fu, B. Li, and X. Xue, “Synthesizing efficient data with diffusion models for person re-identification pre-training,” Mach. Learn., vol. 114, Feb. 2025.arxiv.org/abs/2406.06045
  48. [48]Q. Wang, B. Li, and X. Xue, “When large vision-language models meet person re-identification,” in ICASSP 2026-2026 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 10497–10501, IEEE, 2026.DOI
  49. [49]D. Jiang and M. Ye, “Cross-modal implicit relation reasoning and aligning for text-to-image person retrieval,” in 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 2787–2797, 2023.arxiv.org/abs/2303.12501
  50. [50]Z. Shao, X. Zhang, C. Ding, J. Wang, and J. Wang, “Unified pre-training with pseudo texts for text-to-image person re-identification,” in 2023 IEEE/CVF International Conference on Computer Vision (ICCV), pp. 11140–11150, 2023.arxiv.org/abs/2309.01420
  51. [51]W. Tan, C. Ding, J. Jiang, F. Wang, Y. Zhan, and D. Tao, “Harnessing the power of mllms for transferable text-to-image person reid,” in 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 17127–17137, 2024.arxiv.org/abs/2405.04940
  52. [52]Y. Qin, C. Chen, Z. Fu, D. Peng, X. Peng, and P. Hu, “Human-centered interactive learning via mllms for text-to-image person re-identification,” in 2025 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 14390–14399, 2025.arxiv.org/abs/2506.11036
  53. [53]Y. Bai, Y. Ji, M. Cao, J. Wang, and M. Ye, “Chat-based person retrieval via dialogue-refined cross-modal alignment,” in 2025 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 3952–3962, 2025.DOI
  54. [54]H. Zou, R. Zhang, J. Ding, X. Zhou, J. Zou, and M. Cai, “Tackling alignment ambiguity in person retrieval through conversational attribute mining,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 9689–9698, June 2026.
  55. [55]Z. Zhong, L. Zheng, D. Cao, and S. Li, “Re-ranking person re-identification with k-reciprocal encoding,” in 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 3652–3661, 2017.arxiv.org/abs/1701.08398
  56. [56]J. Yang, H. Li, B. Du, and M. Ye, “Cheb-gr: Rethinking k-nearest neighbor search in re-ranking for person re-identification,” in 2025 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 19261–19270, 2025.DOI
  57. [57]F. Tan, J. Yuan, and V. Ordonez, “Instance-level image retrieval using reranking transformers,” in 2021 IEEE/CVF International Conference on Computer Vision (ICCV), pp. 12085–12095, 2021.arxiv.org/abs/2103.12236
  58. [58]C. Yuan, G. Zhang, C. Ma, T. Zhang, and G. Niu, “From poses to identity: Training-free person re-identification via feature centralization,” in 2025 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 24409–24418, 2025.arxiv.org/abs/2503.00938
  59. [59]X. Tian, S. Zou, Z. Yang, and J. Zhang, “Identifying and mitigating position bias of multi-image vision-language models,” in 2025 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 10599–10609, 2025.
  60. [60]A. Paruchuri, S. Koyejo, and E. Adeli, “Same evidence, different answer: Auditing order sensitivity in multimodal large language models,” arXiv preprint arXiv:2606.26079, 2026.arxiv.org/abs/2606.26079
  61. [61]J. Yang, H. Zhang, F. Li, X. Zou, C. Li, and J. Gao, “Set-of-mark prompting unleashes extraordinary visual grounding in gpt-4v,” arXiv preprint arXiv:2310.11441, 2023.arxiv.org/abs/2310.11441
  62. [62]Y. Huang, Q. Wu, J. Xu, and Y. Zhong, “Celebrities-reid: A benchmark for clothes variation in long-term person re-identification,” in 2019 International Joint Conference on Neural Networks (IJCNN), pp. 1–8, 2019.DOI
  63. [63]Qwen Team, “Qwen3.6-27B: Flagship-level coding in a 27b dense model,” April 2026.
  64. [64]W. Kwon, Z. Li, S. Zhuang, Y. Sheng, L. Zheng, C. H. Yu, J. Gonzalez, H. Zhang, and I. Stoica, “Efficient memory management for large language model serving with pagedattention,” in Proceedings of the 29th Symposium on Operating Systems Principles, SOSP ’23, (New York, NY, USA), p. 611–626, Association for Computing Machinery, 2023.arxiv.org/abs/2309.06180
  65. [65]Qwen Team, “Qwen3.6-35B-A3B: Agentic coding power, now open to all,” April 2026.
  66. [66]J. A. Aslam and M. Montague, “Models for metasearch,” in Proceedings of the 24th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR ’01, (New York, NY, USA), p. 276–284, Association for Computing Machinery, 2001.DOI
  67. [67]J. Kaplan, S. McCandlish, T. B. Brown, B. Chess, R. Child, S. Gray, A. Radford, J. Wu, and D. Amodei, “Scaling laws for neural language models,” arXiv preprint arXiv:2001.08361, 2020.arxiv.org/abs/2001.08361

Paper details

vlnc:W_3spbbwys
Version
v1 · latest
Published
Fresh — added to the Hub within the last 30 days
Added
License
CC BY 4.0
Usage

views · 5

downloads · 0

A view counts once per browser per day, a download each time the PDF is requested.

  • Computer Science

Not recorded for this paper

View statement
Looking for related papers…
Contents