betaFeedback

WorksComputer Science

Vision-Grounded Semantic Learning and Alignment for Scalable Multilingual Text-Based Person Retrieval

Abstract

Multilingual Text-Based Person Retrieval (TBPR) aims to retrieve individuals with texts in multiple languages. Despite its practical importance, it has been overlooked by existing research, which mainly focuses on English-only retrieval. The only prior attempt at multilingual TBPR suffers from (1) the absence of a large-scale, multilingual pretraining dataset and (2) a suboptimal model architecture for multilingual text encoding and cross-modal alignment, which employs a shared encoder that overlooks linguistic heterogeneity and relies on English as a pivot for cross-modal alignment, introducing English-centric bias. For this, we contribute MultiPedes, the first large-scale, pedestrian-centric multilingual pretraining dataset. It contains 10 million image-text pairs across four languages, constructed by a multilingual quality-aware data construction pipeline. We also propose ViSeLA (Vision-grounded Semantic Learning and Alignment), a novel framework featuring: (1) a semantic-aware multilingual learning module that extends the mixture-of-experts architecture by routing language-invariant semantics to specialized experts for improved multilingual feature learning; and (2) a vision-grounded cross-modal alignment module that employs a semantic probe to capture fine-grained semantics across modalities, enabling direct cross-modal alignment without relying on a pivot language. Extensive experiments on both multilingual and English-only TBPR datasets demonstrate the effectiveness of ViSeLA. The dataset and code are available at https://github.com/Flame-Chasers/ViSeLA

CCS Concepts

• Information systems → Multimedia and multimodal retrieval; Multimedia and multimodal retrieval.

This work is licensed under a Creative Commons Attribution 4.0 International License.

MM ’26, Rio de Janeiro, Brazil

© 2026 Copyright held by the owner/author(s).

ACM ISBN 979-8-4007-2213-4/2026/11

https://doi.org/10.1145/3767308.3836472

ACM Reference Format:

Xinyu Zhou, Fan Li, Shasha Chen, Min Cao, Ahtamjan Ahmat, Qiaoming Zhu, and Mang Ye. 2026. Vision-Grounded Semantic Learning and Alignment for Scalable Multilingual Text-Based Person Retrieval. In Proceedings of the 34th ACM International Conference on Multimedia (MM ’26), November 10–14, 2026, Rio de Janeiro, Brazil. ACM, New York, NY, USA, 10 pages. https://doi.org/10.1145/3767308.3836472

Introduction

Text-based person retrieval (TBPR) [12] aims to identify target individuals from an image gallery using natural language descriptions as queries. Compared with person re-identification (Re-ID) [27], which typically relies on image-based queries, TBPR leverages more accessible and flexible textual descriptions, making it more suitable for real-world scenarios—such as intelligent surveillance and public security—where query images are often unavailable, thereby attracting growing research interest [2, 9].

The broad applicability of TBPR in real-world scenarios naturally motivates multilingual TBPR [4] (Figure 1(a)), which enables retrieval with textual queries in multiple languages—a necessity for serving linguistically diverse users. However, research in this task remains scarce and faces two major challenges. ❶ There is a lack of large-scale, pedestrian-centric pretraining datasets with multilingual textual annotations. While recent works [3, 9, 21] highlight the effectiveness of pretraining on such datasets in boosting TBPR performance, their annotations are almost exclusively in English, rendering them inadequate for multilingual pretraining. ❷ For multilingual TBPR, effective multilingual text encoding and cross-modal alignment are pivotal. However, the current method, Bi-IRRA [4], exhibits limitations in these regards. In text encoding, it adopts a shared encoder under a homogeneity assumption of a unified cross-lingual space, neglecting intrinsic linguistic heterogeneity (e.g., divergent syntactic structures) and thus failing to capture language-specific features vital for robust multilingual performance. In cross-modal alignment, it uses English text–image pairs as a teacher in knowledge distillation to align non-English texts with visual content. This imposes English-centric semantic granularity and structural priors on other languages, introducing an English-centric bias that undermines cross-lingual fairness.

Figure 1. (a) Multilingual TBPR, where person images are retrieved with texts in multiple languages. (b) Existing method adopts a shared text encoder for all languages and relies on an English-centered knowledge transfer paradigm for cross-lingual cross-modal alignment. (c) Our ViSeLA framework introduces Se-L module for multilingual learning and Vi-A module for vision-grounded cross-modal alignment.

To handle the first challenge, we propose MultiPedes, a large-scale multilingual pedestrian-centric dataset comprising 10 million image–text pairs across four typologically diverse languages (i.e., English, Chinese, French, and German). To ensure high-quality cross-modal alignment while scaling to multiple languages at low cost, we design a multilingual quality-aware data construction pipeline. This pipeline first employs a consensus-guided filtering strategy to establish reliable semantic consistency in English-centric data. Building upon this, we perform machine translation—an increasingly robust and cost-effective process enabled by recent advances in large language models—to obtain multilingual descriptions, ensuring strong alignment between images and the translated texts. As a result, MultiPedes is a high-quality and scalable multilingual dataset, providing a strong foundation for learning robust and generalizable pedestrian features across languages.

In response to the second challenge, we propose a Vision-Grounded Semantic Learning and Alignment (ViSeLA) framework, comprising two components: a Semantic-aware multilingual learning (Se-L) module for self-adaptive multilingual encoding, and a Vision-grounded Cross-modal Alignment (Vi-A) module for fine-grained cross-modal alignment. Se-L extends the classical Mixture-of-Experts (MoE) architecture with semantic-aware specialization. It employs

a routing mechanism that dynamically assigns textual tokens to experts based on underlying semantics. This ensures that each expert processes semantically coherent yet linguistically diverse inputs, implicitly aligning equivalent concepts across languages. Vi-A operates on paired image–text data, where each image is paired with a caption in an arbitrary language. The image serves as a semantic anchor. Based on it, Vi-A introduces a semantic probe to capture fine-grained cues from both visual and textual modalities. By directly aligning multilingual textual features to the shared visual anchor, Vi-A implicitly enforces cross-modal alignment centered on image semantics, effectively mitigating English-centric bias.

Our key contributions are: (1) We introduce MultiPedes, the first large-scale pedestrian-centric multilingual pretraining dataset, containing 10 million image–text pairs across four languages, constructed via a multilingual quality-aware data construction pipeline to support scalable multilingual TBPR. (2) We propose ViSeLA, a framework that addresses linguistic heterogeneity and English-centric bias through two key components: a Se-L module for self-adaptive multilingual encoding, and a Vi-A module for fine-grained cross-modal alignment. (3) Extensive experiments on multiple multilingual TBPR benchmarks validate the effectiveness and generality of ViSeLA, with consistent state-of-the-art performance.

Related Work

Text-based Person Retrieval

Text-based person retrieval (TBPR) [12] aims to retrieve pedestrian images from natural language descriptions. Early methods [6, 33] extract global visual and textual features using separate backbones and align them in a shared space, but often overlook fine-grained attributes critical for discrimination. Later works [10, 24] introduce local-matching with external supervision (e.g., human parsing) to align fine-grained cross-modal features, improving retrieval performance. With the advent of Vision-Language Pretraining (VLP) models [18], their strong cross-modal alignment largely supersedes earlier models, prompting research on effectively leveraging VLP capabilities [2]. Recently, the domain gap between generic corpora used in VLP pretraining and pedestrian-centric data for TBPR has drawn increasing attention. In response, a growing body of work [21, 26] has focused on constructing large-scale, person-specific pretraining datasets to enhance both retrieval performance and generalization.

Moreover, multilingual TBPR has recently emerged as a practical research direction. Bi-IRRA [4], the first work in this setting, transfers alignment knowledge from English–image pairs to non-English data through cross-lingual distillation, but remains English-centric bias and does not address scalability. In contrast, we introduce the scalable MultiPedes pretraining dataset and the ViSeLA framework to jointly improve multilingual representation learning and cross-modal alignment.

Multilingual Image-Text Retrieval

Multilingual Image–Text Retrieval (MITR) [13] extends cross-modal retrieval by enabling visual retrieval with queries in multiple languages. A major challenge is the scarcity of large-scale multilingual image–text data. Existing approaches generally follow two directions: some methods [7, 15] combine heterogeneous data, including English image–text pairs and multilingual parallel text corpora, while others [34] use machine translation (MT) to generate non-English captions from existing English image–text pairs. These data sources lead to different alignment strategies: heterogeneous-data methods typically use English text as an anchor to bridge languages and modalities, whereas MT-based methods often use images as a shared anchor for cross-lingual and cross-modal alignment.

Unlike general-purpose MITR, multilingual TBPR requires more fine-grained semantic alignment to distinguish visually similar pedestrians. Accordingly, we propose ViSeFA, which employs fine-grained visual semantics as the alignment anchor to jointly facilitate multilingual feature learning and precise cross-modal alignment.

Dataset

In this section, we introduce the proposed multilingual pedestrian-centric pretraining dataset MultiPedes, including its construction pipeline and key statistics.

Construction Pipeline

To efficiently construct high-quality multilingual textual annotations at scale, we design a multilingual quality-aware data construction pipeline built upon existing English-centric TBPR data. Leveraging recent advances in machine translation, the pipeline enables scalable and cost-effective multilingual data generation while

preserving semantic fidelity. The pipeline comprises two stages: (1) data curation with consensus-guided filtering, and (2) multilingual text translation as shown in Figure 2.

Figure 2. Multilingual quality-aware data construction pipeline consisting of two stages: (1) data curation with consensus-guided filtering, and (2) multilingual text translation. In the first stage, consensus-guided filtering leverages both domain-specific and domain-agnostic evaluators to identify and remove noisy samples from large-scale image–text pairs collected from public datasets, resulting in higher-quality data. In the second stage, large language models are employed to perform machine translation at scale, generating multilingual descriptions and constructing the MultiPedes dataset.

Data Curation with Consensus-Guided Filtering. We first collect English image–text pairs from publicly available pedestrian-centric pretraining datasets [9, 32] as the basis for multilingual expansion. To ensure high semantic consistency between images and the translated multilingual texts, we introduce a consensus-guided filtering strategy to remove potentially noisy pairs.

For each collected image–text pair (I,Ten)(I,T^{\mathrm{en}}), multiple domain-specific evaluators independently assess semantic consistency and assign similarity scores sis_i. The evaluators are executed in parallel, incurring minimal additional runtime, while the extra computation devoted to noise filtering leads to higher-quality pretraining data, constituting a favorable quality–efficiency trade-off, as further evidenced by the supplementary material. Then, given the predefined thresholds θ+\theta_+ and θ−\theta_-, the ii-th evaluator casts a positive vote if si>θ+s_i > \theta_+ and a negative vote if si<θ−s_i < \theta_-. Let sˉ\bar{s} denote the mean similarity score across evaluators. A sample pair is retained if it receives at least two positive votes and sˉ>θ+\bar{s} > \theta_+, and is discarded if it receives at least two negative votes and sˉ<θ−\bar{s} < \theta_-. Through consensus among domain-specific evaluators, the majority of samples can be reliably determined, while the remaining ambiguous cases are forwarded for secondary verification by a domain-agnostic evaluator. We implement this evaluator using a VQA model [14] to make the final decision, prompting it with: “Does this figure <img> show <text>? Please answer yes or no.”, where the placeholder <img> and <text> correspond to the image II and its description TenT^{\mathrm{en}}, respectively. Samples receiving a “yes” response are retained, while those receiving a “no” response are discarded. Ultimately, we retain 2.5M high-quality image–text pairs for subsequent dataset construction.

Overall, the consensus-guided filtering prioritizes domain-specific evaluators as the primary filter applied to all samples, where their rich domain knowledge and consensus mechanism enable reliable and fine-grained semantic assessment. A domain-agnostic evaluator is then invoked for a small subset of ambiguous cases to provide complementary judgment, thereby fully exploiting domain knowledge for reliable decisions while mitigating potential biases introduced by domain-specific modeling.

Multilingual Text Translation. Due to the high semantic consistency of the curated English image–text pairs, we can reliably extend the dataset to multiple languages via a simple yet effective translation procedure. We select three widely used languages beyond English—Chinese, French, and German—as target languages.

To enhance linguistic diversity and avoid homogenized expressions, we employ multiple translation models [22, 31] and randomly select one for each translation instance. Concretely, for each English description TenT^{\mathrm{en}}, we prompt the translation model with the following instruction: Translate the following English person description into <lang_name>. Requirements: • Faithfully translate all details about clothing, colors, accessories, etc. • Preserve the original descriptive order and logical structure. • Use natural and fluent <lang_name> expressions. Here, <lang_name> denotes the target language name (e.g., Chinese, French, German). Given the strong semantic consistency of the translated texts (shown in § 3.2), we do not apply additional post-translation filtering.

As a result, each English description is expanded into corresponding multilingual versions in all three target languages, leading to the construction of MultiPedes, a large-scale multilingual dataset comprising 10 million image–text pairs. We provide illustrative examples in the supplementary material.

Statistics

We present the statistics of the MultiPedes dataset from two perspectives: dataset properties and data quality, and compare it with other mainstream pedestrian-centric pretraining datasets.

In terms of dataset properties, MultiPedes exhibits two prominent characteristics: large scale and multilingual coverage. MultiPedes contains 10 million image–text pairs, making it one of the largest pedestrian-centric pretraining dataset for TBPR. Moreover, unlike prior datasets limited to English-only annotations, MultiPedes is the first to provide large-scale multilingual descriptions spanning English, Chinese, French, and German, facilitating effective and scalable pretraining for multilingual TBPR.

In terms of data quality, we analyze MultiPedes from three aspects: textual diversity, image–text alignment, and cross-lingual consistency. Textual diversity is measured using the Type–Token Ratio (TTR), defined as the ratio of unique tokens to the total number of tokens, which reflects the richness of vocabulary usage. Image–text alignment is evaluated on the image–text pairs of MultiPedes with CLIPScore [18], measuring the semantic consistency between images and their corresponding English descriptions. As shown in Table 1, MultiPedes achieves decent performance in both TTR and CLIPScore, indicating good textual diversity and solid image–text semantic alignment. For cross-lingual consistency, we compute COMET-Wiki [19] scores between English and its translations in Chinese, French, and German. COMET-Wiki is a reference-free metric for assessing semantic equivalence across languages. As shown in Figure 3, we compare the score distributions of MultiPedes with those of COCO-35L [23], a widely used public dataset with parallel multilingual text descriptions, where scores are averaged across languages. The results indicate that MultiPedes exhibits stronger cross-lingual consistency.

Dataset#Images#TextsAvg. LenLanguageTTRCLIPScore
LUPerson-T [20]1.30M1.30M27.39En0.880.22
LUPerson-M [21]1.00M4.00M28.61En0.800.36
HAM-PEDES [9]1.00M2.00M26.30En0.800.40
SynTBPR [3]1.63M6.62M34.10En0.810.43
WebPerson [32]5M10M23.34En0.810.40
MultiPedes1.25M10.00M38.11En, ZH, Fr, De0.870.40

Table 1. Comparison with other mainstream pretraining datasets for TBPR. # denotes the number of samples, and Avg. Len indicates the average text length.

Figure 3. Comparison of COMET-Wiki score distributions between MultiPedes and COCO-35L [23]. The scores are averaged over three target languages for each sample.

Method

In this section, we elaborate the proposed ViSeLA, which comprises a Se-L module for improved multilingual learning and a Vi-A module for fine-grained cross-modal alignment, as illustrated in Figure 4.

Figure 4. Overview of our proposed ViSeLA framework. It consists of two key submodules: (1) the Se-L module, which leverages semantic information to route input text features to specialized experts, thereby extracting language-invariant textual features; and (2) the Vi-A module, which employs the semantic probe to capture fine-grained cross-modal semantics and enables image-grounded cross-modal alignment.

Baseline

We adopt X2^{2}-VLM [29] as our baseline model, which comprises an image encoder, a text encoder, and a multimodal interaction encoder. Both the image and text encoders are implemented as 12-layer Transformer, responsible for extracting unimodal visual and textual features, respectively. The multimodal interaction encoder consists of 6-layer Transformer and leverages cross-attention mechanisms to model cross-modal interactions.

The model takes image–text pairs (I,Tℓ)(I,T^{\ell}) as input, where TℓT^{\ell} denotes a caption written in language ℓ\ell, where ℓ∈A={en,zh,fr,de}\ell\in\mathcal{A} = \{\mathrm{en}, \mathrm{zh}, \mathrm{fr}, \mathrm{de}\}, corresponding to English, Chinese, French, and German, respectively. Given an image II, it is first partitioned into NpN_{p} non-overlapping patches and encoded by a vision encoder to produce a sequence of visual features Fv={v1,…,vNp}F_{v} = \{v_{1}, \ldots, v_{N_{p}}\}. The textual input TℓT^{\ell} is augmented with a code-switching strategy [15], in which words are randomly replaced with their counterparts from other languages with a certain probability. This augmentation introduces cross-lingual lexical variations and encourages the model to learn language-invariant semantic features, thereby improving multilingual generalization.

The augmented text is then processed by the text encoder to yield textual features Ft={tcls,t1,…,tL}F_{t} = \{t_{\mathrm{cls}}, t_{1}, \ldots, t_{L}\}. The global image feature vclsv_{\mathrm{cls}} and the global text feature tclst_{\mathrm{cls}} are subsequently used to compute a global image–text similarity score SℓS^{\ell} via cosine similarity. Based on this score, we optimize a normalized image–text contrastive loss (N-ITC) [2], denoted as LN-ITC\mathcal{L}_{N\text{-}ITC}. The unimodal features FvF_{v} and FtF_{t} are fed into a multimodal interaction encoder to facilitate cross-modal learning, which is optimized jointly via the image–text matching loss (ITM), denoted as LITM\mathcal{L}_{ITM} and the masked language modeling loss (MLM), denoted as LMLM\mathcal{L}_{MLM}.

Semantic-aware multilingual learning

To enhance multilingual modeling capacity and promote language-invariant textual features, we propose a Semantic-aware multilingual Learning (Se-L) module. Se-L integrates a semantic-aware MoE into selected ViT blocks of the text encoder, referred to as Se-L blocks. It consists of NN semantic-specialized experts E={ϵj∣j∈[1,N]}\mathcal{E} = \{\epsilon_j \mid j \in[1,N]\} and the semantic probe from the Vi-A module (detailed in Section 4.3), which are composed of NN learnable queries and a cross-attention layer, serving as a semantic-aware router that dynamically selects and combines experts based on textual semantics.

Specifically, given the textual features Ft={t1,…,tL}F_t = \{t_1,\ldots,t_L\} output by the self-attention layer within an Se-L block, the semantic-aware router computes a cross-attention map P∈RL×NP \in\mathbb{R}^{L \times N}, where each entry Pi,jP_{i,j} denotes the attention weight of the jj-th query of the semantic probe on the ii-th token. Since each probe corresponds to a distinct semantic concept, PP effectively represents the relevance between tit_i and each semantic cue.

For each textual token tit_i, we route it to its most relevant experts based on PP. First, we sort the attention scores {Pi,j}j=1N\{P_{i,j}\}_{j=1}^{N} between token tit_i and all queries in descending order, and select the smallest index set Ki⊆{1,…,N}\mathcal{K}_i \subseteq\{1,\ldots,N\} such that:

∑k∈KiPi,k≥δ,(1)\sum_{k \in\mathcal{K}_i} P_{i,k} \ge\delta, \tag*{(1)}

where δ∈(0,1]\delta\in(0,1] is a pre-defined threshold that controls the sparsity and semantic coverage of expert selection. Subsequently, we compute normalized routing weights over the selected experts as:

wi,j={exp⁡(Pi,j)∑k∈Kiexp⁡(Pi,k)if j∈Ki0otherwise(2)w_{i,j} = \begin{cases} \frac{\exp(P_{i,j})}{\sum_{k \in\mathcal{K}_i} \exp(P_{i,k})} & \text{if } j \in\mathcal{K}_i \\ 0 & \text{otherwise} \end{cases} \tag*{(2)}

The output feature for token tit_i is then obtained as a weighted combination of the activated experts:

ti=∑jwi,j⋅ϵj(ti).(3)t_i = \sum_j w_{i,j} \cdot\epsilon_j(t_i). \tag*{(3)}

During encoding, the same semantic probe captures semantically similar components across texts TlT^l in different languages and routes them to the corresponding expert for processing. This design pulls features of shared semantics closer in the feature space, thereby facilitating the learning of language-invariant textual features.

Vision-grounded Cross-modal Alignment

The Vision-grounded Semantic Alignment (Vi-SA) is a lightweight module for visual-grounded fine-grained cross-modal alignment.

The core of this module is the semantic probe, which consists of NN learnable queries Q={q1,q2,…,qN}Q = \{q_1,q_2,\ldots,q_N\} (matching the number of experts in the Se-L module) and a multi-head cross-attention (MCA) layer, enabling each query to extract the visual or textual features it attends to via cross-attention. Specifically, given visual features FvF_v, the cross-attention is performed as follows:

F^v=MCA⁡(Q,Fv,Fv),(4)\hat{F}_v = \operatorname{MCA}(Q,F_v,F_v), \tag*{(4)}

where F^v={v^1,v^2,…,v^N}\hat{F}_v = \{\hat{v}_1,\hat{v}_2,\ldots,\hat{v}_N\}. Each v^i\hat{v}_i captures a distinct visual semantic concept (e.g. object parts, attributes). In parallel, the same mechanism is applied to the textual features, yielding F^t={t^1,t^2,…,t^N}\hat{F}_t = \{\hat{t}_1,\hat{t}_2,\ldots,\hat{t}_N\}. Visual and textual semantics attended by the same query are regarded as corresponding pairs. Then, we compute the cosine similarity for each semantic pair and aggregate them as follows:

Sf=log⁡∑i=1Nexp⁡(v^iTt^i∥v^i∥⋅∥t^i∥).(5)S^{f}=\log\sum_{i=1}^{N}\exp\left(\frac{\hat{v}_{i}^{\mathsf{T}}\hat{t}_{i}}{\lVert\hat{v}_{i}\rVert\cdot\lVert\hat{t}_{i}\rVert}\right). \tag*{(5)}

Finally, the fine-grained similarity score SfS^{f} is used to optimize a normalized image–text contrastive loss, denoted as LN−ITCf\mathcal{L}^{f}_{\mathrm{N-ITC}}, thereby enabling effective fine-grained cross-modal alignment. During alignment, each image II is associated with multilingual captions TℓT^{\ell}, allowing all language-specific texts to align directly to the same visual instance. In this process, the image acts as a semantic anchor, enabling the semantic probe to capture fine-grained cues across modalities and effectively enforcing vision-grounded cross-modal alignment, which mitigates English-centric bias.

Optimization Objectives

During training, we jointly optimize multiple objectives to encourage both cross-modal alignment and robust textual feature learning:

L=LN−ITCc+LN−ITCf+LMLM+λLITM,(6)\mathcal{L}=\mathcal{L}^{c}_{\mathrm{N-ITC}}+\mathcal{L}^{f}_{\mathrm{N-ITC}}+\mathcal{L}_{\mathrm{MLM}}+\lambda\mathcal{L}_{\mathrm{ITM}}, \tag*{(6)}

where λ\lambda is a hyper-parameter.

Experiments

Datasets

We conduct experiments on both traditional English-only TBPR and multilingual TBPR tasks. For English-only TBPR, the evaluations are performed on three widely used benchmarks, including CUHK-PEDES [12], ICFG-PEDES [5], and UFineBench [37]. For multilingual TBPR, we conduct experiments on their multilingual counterparts (i.e., CUHK-PEDES(M), ICFG-PEDES(M), and UFineBench(M)), recently proposed in [4]. Details description of these datasets, evaluation metrics and implementation details are provided in the supplementary material.

Comparisons with SOTA Methods

In this section, we comprehensively evaluate the proposed ViSeLA against state-of-the-art methods under both multilingual TBPR and traditional English-only TBPR tasks.

Comparison on Multilingual TBPR

Table 2 reports the results on CUHK-PEDES(M), ICFG-PEDES(M), and UFineBench(M). Given the substantial gains from large-scale pedestrian-centric pretraining, we categorize methods based on whether such pretraining is employed—as reported in their original papers—and perform comparisons within each group to ensure a fair evaluation.

DatasetMethodEnglish R1English R10English mAPChinese R1Chinese R10Chinese mAPFrench R1French R10French mAPGerman R1German R10German mAPAvg R1Avg R10Avg mAP
CUHK-PEDE(M)Without Pre-training on Large-scale Person Data:
CUHK-PEDE(M)CCLM [30]74.6893.4265.7870.8392.8563.1471.1792.3062.8970.1992.2462.4771.7292.7063.57
CUHK-PEDE(M)X²-VLM [29]76.9794.9667.8674.8194.1766.0075.1894.1866.1774.7194.3065.7375.4294.4066.44
CUHK-PEDE(M)CCRK [16]70.1192.5362.1068.3191.9160.6968.2991.3660.3367.0190.7459.5468.4391.6460.67
CUHK-PEDE(M)Bi-IRRA [4]78.8295.4769.6876.4394.7967.7976.4694.3567.2675.5794.3167.0776.8294.7367.95
CUHK-PEDE(M)ViSeLA78.6595.2170.3376.0894.1768.3076.6594.2368.3575.9294.1867.8776.8394.4568.71
CUHK-PEDE(M)With Pre-training on Large-scale Person Data:
CUHK-PEDE(M)Bi-IRRA [4]79.4395.6870.5176.5594.4968.0576.6094.3167.6575.7994.3867.8977.0994.7268.53
CUHK-PEDE(M)ViSeLA79.3795.1171.6877.2993.9469.7277.6694.1069.7177.4594.0269.5377.9494.2970.16
ICFG-PEDES(M)Without Pre-training on Large-scale Person Data:
ICFG-PEDES(M)CCLM [30]64.1485.5035.5361.8383.9834.0160.9583.5833.1661.4283.7233.8462.0984.2034.14
ICFG-PEDES(M)X²-VLM [29]68.3987.5840.5766.5486.2839.1365.7485.6938.5966.3486.0238.7766.7586.3939.27
ICFG-PEDES(M)CCRK [16]60.3183.3732.3257.9881.9930.9157.5781.6530.2056.5280.6329.2858.1081.9130.68
ICFG-PEDES(M)Bi-IRRA [4]68.5387.7941.8266.7986.4440.2666.9086.4039.4467.0586.6239.9167.3286.8140.36
ICFG-PEDES(M)ViSeLA70.2887.8043.5768.2186.4941.9767.6086.4741.4568.1186.7141.7968.5586.8742.20
ICFG-PEDES(M)With Pre-training on Large-scale Person Data:
ICFG-PEDES(M)Bi-IRRA [4]70.6388.4743.1567.8186.6141.2467.5486.8641.0067.5186.8641.0968.3787.2041.62
ICFG-PEDES(M)ViSeLA71.3588.5144.8369.2687.0343.3768.8087.1642.5569.2387.1043.0269.6687.4543.45
UFineBench(M)Without Pre-training on Large-scale Person Data:
UFineBench(M)CCLM [30]85.8696.6284.1984.9896.4483.3783.5895.8481.8083.4295.7781.4984.4696.1782.71
UFineBench(M)X²-VLM [29]89.3298.0287.8288.2097.9087.1287.9897.3986.2186.8697.2985.5288.0997.6586.67
UFineBench(M)CCRK [16]81.0695.1479.2178.5994.4977.9878.6194.2076.8477.6393.9875.8779.2294.4577.48
UFineBench(M)Bi-IRRA [4]90.4598.1889.6689.9898.0589.2289.3097.7388.3289.3997.7588.0289.7897.9388.81
UFineBench(M)ViSeLA91.4598.1990.1890.4198.0589.3489.9797.8988.8789.8797.6688.6190.4297.9589.25
UFineBench(M)With Pre-training on Large-scale Person Data:
UFineBench(M)Bi-IRRA [4]91.2698.2690.0190.6798.1389.7889.9397.8889.0389.3497.9288.3290.3098.0589.29
UFineBench(M)ViSeLA92.2798.3591.3491.5598.2090.6091.1798.0990.2091.1097.9990.0891.5298.1690.56

Table 2. Performance comparison with state-of-the-art methods on multilingual TBPR datasets. We categorize these methods into two groups based on whether they are pre-trained on large-scale person data (per their original papers): Bi-IRRA uses an English-only dataset (LUPerosn-M [21]), while ViSeLA leverages our proposed MultiPedes dataset. Results are reported for four languages and their average. The best results are highlighted in bold, and the second-best results are underlined.

Under both settings, ViSeLA consistently achieves the best performance across all datasets. Specifically, without pretraining, ViSeLA outperforms Bi-IRRA by 0.01/0.76, 1.23/1.84, and 0.64/0.44 in average R@1/mAP across languages on CUHK-PEDES(M), ICFG-PEDES(M), and UFineBench(M), respectively. With large-scale pre-training, the performance margins are further enlarged to 0.85/1.63, 1.29/1.83, and 1.22/1.27, demonstrating the strong effectiveness and robustness of ViSeLA in multilingual scenarios.

Comparison on English-only TBPR

Although our proposed ViSeLA targets multilingual TBPR, it naturally supports English-only inputs under the traditional setting. We evaluate it in this setting against state-of-the-art English-only TBPR methods. Following prior practice, the methods are grouped based on whether they leverage large-scale pedestrian-centric pretraining (as reported in their original papers).

As shown in Table 3, ViSeLA consistently achieves the best performance with and without pretraining, showing its robustness across different settings. Specifically, without pretraining, ViSeLA outperforms the current best method, RASA [1], by 1.11/0.08 in terms of R@1/mAP on CUHK-PEDES and also surpasses the state-of-the-art method RDE [17] on ICFG-PEDES and CFAM [37] on UFineBench. With pretraining, it further surpasses HAM [9], which is pretrained on HAM-PEDES, by 1.43/1.81 in terms of R@1/mAP on CUHK-PEDES. This improvement is well-motivated: the multilingual training corpus provides richer semantic diversity, and the joint alignment across languages and modalities implicitly enhances the cross-modal alignment, thereby boosting performance on English-only TBPR.

MethodsCUHK-PEDESICFG-PEDESUFineBench
R@1R@5R@10mAPR@1R@5R@10mAPR@1R@5R@10mAP
Without large-scale person-centric pretraining:
IRRA [8]73.3889.9393.7166.1363.4680.2585.8238.0683.5392.9495.9582.79
RaSa [1]76.5190.2994.2569.3865.2880.4085.1241.2986.1394.5596.7384.17
TBPS-CLIP [2]73.5488.1992.3565.3865.0580.3485.4739.8376.2188.9293.0975.07
CFAM [37]75.6090.5394.3667.2765.3881.1786.3539.4288.5195.5897.4987.09
RDE [17]75.9490.1494.1267.5667.6882.4787.3640.0685.3194.1596.7284.05
TAG-CLIP [35]74.3888.3092.5967.1866.7881.3686.2343.60----
ViSeLA77.6291.2695.0069.4667.9481.9986.7941.7290.1096.3497.8588.76
With large-scale person-centric pretraining:
PLIP [36]75.3690.8694.87-66.1783.3788.94-78.8991.0294.6576.89
APTM [26]76.5390.0494.1566.9168.5182.9987.5641.2287.5995.4297.2285.75
AUL [11]77.2390.4394.41-69.1683.3288.37-84.6094.2896.6983.06
MLLM+IRRA [21]76.8291.1694.4669.5567.0582.1687.3341.5189.1396.1097.9088.38
HAM [9]77.9991.3495.0369.7269.9583.8888.3942.7290.9496.7798.2490.13
CAMeL [28]77.2491.8095.1668.3268.7083.1188.3241.5878.8692.7996.1778.87
MRA [25]77.2190.6694.4668.5068.9383.4688.0741.38----
ViSeLA79.4292.1195.4871.5370.5383.5288.1044.6591.6597.0098.2690.83

Table 3. Performance comparison on English TBPR with state-of-the-art methods on CUHK-PEDES, ICFG-PEDES, and UFineBench. Methods are grouped by whether they use large-scale person-centric pretraining. The best results are highlighted in bold, and the second-best results are underlined.

Ablation Study

Effectiveness of MultiPedes

To validate the effectiveness of our proposed pretraining dataset, we train both Bi-IRRA and ViSeLA under three settings: (i) without pretraining, (ii) with pretraining on LUPerson-M [21], and (iii) with pretraining on MultiPedes.

Results are reported in Table 4, from which we draw two key observations. First, across both architectures, pretraining on MultiPedes consistently yields higher average retrieval performance than pretraining on LUPerson-M. This confirms that MultiPedes provides more effective supervision for multilingual feature learning. Second, pretraining on LUPerson-M leads to imbalanced performance gains across languages for Bi-IRRA, whereas ViSeLA exhibits consistently balanced improvements. Specifically, Bi-IRRA achieves a notable gain of +0.61 R@1 on English, but only marginal improvements on Chinese (+0.12), French (+0.14), and German (+0.22). In contrast, ViSeLA obtains gains of +0.30, +0.28, +0.24, and +0.31 in R@1 on English, Chinese, French, and German, respectively—demonstrating more uniform cross-lingual transfer. This discrepancy stems from the fact that LUPerson-M contains annotations exclusively in English, already introducing a language resource imbalance. The English-centric alignment mechanism in Bi-IRRA amplifies this bias during pretraining, while the vision-grounded multimodal alignment in ViSeLA anchors all languages to shared visual semantics, thereby mitigating English dominance and promoting balanced multilingual performance.

MethodPretraining DatasetEnglishChineseFrenchGermanAvg
R@1R@10mAPR@1R@10mAPR@1R@10mAPR@1R@10mAPR@1R@10mAP
Bi-IRRA [4]-78.8295.4769.6876.4394.7967.7976.4694.3567.2675.5794.3167.0776.8294.7367.95
LUPerson-M [21]79.4395.6870.5176.5594.4968.0576.6094.3167.6575.7994.3867.8977.0994.7268.53
MultiPedes79.6495.5570.6076.8694.5768.5676.7794.5468.3876.6894.5768.0577.4994.8168.90
ViSeLA-78.6595.2170.3376.0894.1768.3076.6594.2368.3575.9294.1867.8776.8394.4568.71
LUPerson-M [21]78.9595.1370.7676.3694.2068.5776.8994.2268.5476.2393.8668.4177.1194.3569.07
MultiPedes79.3795.1171.6877.2993.9469.7277.6694.1069.7177.4594.0269.5377.9494.2970.16

Table 4. Ablation study on different pretraining datasets. "-" indicates no pretraining. Results are reported on CUHK-PEDES.

Ablation on ViSeLA

We conduct ablation studies to validate the effectiveness of the two key components in ViSeLA, namely the Vi-A and the Se-L module in Table 5.

No.Vi-ASe-LR@1R@5R@10mAP
S-MoEV-MoEL-MoE
1✓77.6790.9794.3969.54
2✓77.2190.7394.2069.56
3✓✓77.4991.0094.3669.78
4✓✓77.3790.9194.4269.61
5✓✓77.9490.9494.2970.16

Table 5. Ablation study on key components of the proposed ViSeLA framework. S-MoE, V-MoE and L-MoE denote our proposed semantic-aware MoE, vanilla MoE, and language-aware MoE, respectively. Results are averaged over the CUHK-PEDES dataset. Results are averaged on CUHK-PEDES.

Effectiveness of Vi-A. Removing the Vi-A module (No.1 vs. No.5) leads to the performance drop, confirming its effectiveness. Vi-A serves two critical functions in ViSeLA: (i) it extracts and aligns fine-grained semantic cues across visual and textual modalities, (ii) it leverages image semantics to anchor shared semantic concepts from multilingual texts, which guides the semantic-aware routing in Se-L. In the absence of Vi-A, the model resorts to coarse global alignment alone, which not only weakens cross-modal alignment but also undermines the effectiveness of semantic-aware expert routing, ultimately degrading performance.

Effectiveness of Se-L. Similarly, removing the Se-L module (No.2 vs. No.5)—which incorporates a semantic-aware MoE (S-MoE)—also leads to the performance drop, confirming its effectiveness. Se-L assigns semantically similar tokens from different languages to the same expert, enabling more expressive modeling and facilitating the learning of language-invariant features. Without Se-L, the model struggles to disentangle shared semantics across languages, leading to degraded performance.

Additionally, Se-L is built upon S-MoE, we compare it against two alternative MoE designs—vanilla MoE (V-MoE) and language-aware MoE (L-MoE)—to further validate its design. V-MoE employs a simple linear router for expert assignment, while L-MoE routes tokens solely based on language identity, assigning all tokens from the same language to a shared expert. First, comparing V-MoE with S-MoE (No.4 vs. No.5) reveals a performance gap, indicating that increasing model capacity via the vanilla MoE is insufficient for multilingual TBPR. Semantic-aware routing is essential to effectively leverage the MoE architecture in this setting. Second, S-MoE also consistently outperforms L-MoE (No.3 vs. No.5), demonstrating that routing based on semantic similarity is more effective than language-based assignment. These results underscore a key insight: effective multilingual modeling requires disentangling and specializing shared semantic concepts across languages, rather than treating each language independently.

Furthermore, we provide more comprehensive experiments in the supplementary material.

Conclusion

We present MultiPedes, the first large-scale multilingual pretraining dataset for TBPR, comprising 10M image–text pairs to support large-scale pretraining. To ensure data quality, we design a multilingual quality-aware data construction pipeline. In addition, we propose ViSeLA, a vision-grounded and semantic-aware framework for multilingual retrieval. By jointly addressing pretraining data scarcity and model limitations, ViSeLA enables effective language-invariant representation learning and mitigates English-centric alignment bias. Extensive experiments on both multilingual and English-only benchmarks demonstrate the superiority of our framework. We expect this work to provide a strong foundation for future research in multilingual TBPR.

Acknowledgments

This work is supported by the National Natural Science Foundation of China under Grants 62476188.

References

References

  1. [1]Yang Bai, Min Cao, Daming Gao, Ziqiang Cao, Chen Chen, Zhenfeng Fan, Liqiang Nie, and Min Zhang. 2023. Rasa: Relation and sensitivity aware representation learning for text-based person search. arXiv preprint arXiv:2305.13653 (2023).DOI
  2. [2]Min Cao, Yang Bai, Ziyin Zeng, Mang Ye, and Min Zhang. 2024. An empirical study of clip for text-based person search. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 38. 465–473.arxiv.org/abs/2308.10045
  3. [3]Min Cao, ZiYin Zeng, YuXin Lu, Mang Ye, Dong Yi, and Jingqiao Wang. 2025. An Empirical Study of Validating Synthetic Data for Text-Based Person Retrieval. arXiv preprint arXiv:2503.22171 (2025).arxiv.org/abs/2503.22171
  4. [4]Min Cao, Xinyu Zhou, Ding Jiang, Bo Du, Mang Ye, and Min Zhang. 2025. Multi-lingual Text-to-Image Person Retrieval via Bidirectional Relation Reasoning and Aligning. IEEE Transactions on Pattern Analysis and Machine Intelligence (2025).
  5. [5]Zefeng Ding, Changxing Ding, Zhiyin Shao, and Dacheng Tao. 2021. Semantically self-aligned network for text-to-image part-aware person re-identification. arXiv preprint arXiv:2107.12666 (2021).arxiv.org/abs/2107.12666
  6. [6]Ammarah Farooq, Muhammad Awais, Fei Yan, Josef Kittler, Ali Akbari, and Syed Safwan Khalid. 2020. A convolutional baseline for person re-identification using vision and language descriptions. arXiv preprint arXiv:2003.00808 (2020).arxiv.org/abs/2003.00808
  7. [7]Aashi Jain, Mandy Guo, Krishna Srinivasan, Ting Chen, Sneha Kudugunta, Chao Jia, Jinfei Yang, and Jason Baldridge. 2021. Mural: multimodal, multitask retrieval across languages. arXiv preprint arXiv:2109.05125 (2021).
  8. [8]Ding Jiang and Mang Ye. 2023. Cross-modal implicit relation reasoning and aligning for text-to-image person retrieval. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2787–2797.arxiv.org/abs/2303.12501
  9. [9]Jiayu Jiang, Changxing Ding, Wentao Tan, Junhong Wang, Jin Tao, and Xiangmin Xu. 2025. Modeling Thousands of Human Annotators for Generalizable Text-to-Image Person Re-identification. In Proceedings of the Computer Vision and Pattern Recognition Conference. 9220–9230.arxiv.org/abs/2503.09962
  10. [10]Yifeng Jing, Chao Si, Jing Wang, Chen Chen, Zhenfeng Fan, and Liqiang Nie. 2020. Pose-guided multi-granularity attention network for text-based person search. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 34. 11189–11196.arxiv.org/abs/1809.08440
  11. [11]Shenshen Li, Chen He, Xing Xu, Fumin Shen, Yang Yang, and Heng Tao Shen. 2024. Adaptive uncertainty-based learning for text-based person retrieval. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 38. 3172–3180.
  12. [12]Shuang Li, Tong Xiao, Hongsheng Li, Bolei Zhou, Dayu Yue, and Xiaogang Wang. 2017. Person search with natural language description. In Proceedings of the IEEE conference on computer vision and pattern recognition. 1970–1979.
  13. [13]Zejun Li, Zhihang Fan, Jingjing Chen, Qi Zhang, Xuan-Jing Huang, and Zhongyu Wei. 2023. Unifying cross-lingual and cross-modal modeling towards weakly supervised multilingual vision-language pre-training. In Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). 5939–5958.
  14. [14]Zhiqiu Lin, Deepak Pathak, Baiqi Li, Jiayao Li, Xide Xia, Graham Neubig, Pengchuan Zhang, and Deva Ramanan. 2024. Evaluating text-to-visual generation with image-to-text generation. In European Conference on Computer Vision. Springer, 366–384.arxiv.org/abs/2404.01291
  15. [15]Minheng Ni, Haoyang Huang, Lin Su, Edward Cui, Taroon Bharti, Lijuan Wang, Dongdong Zhang, and Nan Duan. 2021. M3P: Learning universal representations via multitask multilingual multimodal pre-training. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition. 3977–3986.arxiv.org/abs/2006.02635
  16. [16]Zhijie Nie, Richong Zhang, Zhangchi Feng, Hailang Huang, and Xudong Liu. 2024. Improving the Consistency in Cross-Lingual Cross-Modal Retrieval with 1-to-K Contrastive Learning. In Proceedings of the 30th ACM SIGKDD Conference on Knowledge Discovery and Data Mining. 2272–2283.DOI
  17. [17]Yang Qin, Yingke Chen, Dezhong Peng, Xi Peng, Joey Tianyi Zhou, and Peng Hu. 2024. Noisy-correspondence learning for text-to-image person re-identification. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 27197–27206.arxiv.org/abs/2308.09911
  18. [18]Alec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh, Gabriel Goh, Sandhini Agarwal, Girish Sastry, Amanda Askell, Pamela Mishkin, Jack Clark, et al. 2021. Learning transferable visual models from natural language supervision. In International conference on machine learning. PMLR, 8748–8763.
  19. [19]Ricardo Rei, Nuno M Guerreiro, Daan Van Stigt, Marcos Treviso, Luís Coheur, José GC de Souza, André FT Martins, et al. 2023. Scaling up CometKiwi: Unbabel-IST 2023 submission for the quality estimation shared task. In Proceedings of the Eighth Conference on Machine Translation. 841–848.
  20. [20]Zhiyin Shao, Xinyu Zhuang, Changxing Ding, Jian Wang, and Jingdong Wang. 2023. Unified pre-training with pseudo texts for text-to-image person re-identification. In Proceedings of the IEEE/CVF international conference on computer vision. 11174–11184.arxiv.org/abs/2309.01420
  21. [21]Wentan Tan, Changxing Ding, Jiayu Jiang, Fei Wang, Yibing Zhan, and Dapeng Tao. 2024. Harnessing the Power of MLLMs for Transferable Text-to-Image Person ReID. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 17127–17137.
  22. [22]GLM Team, Aohan Zeng, Xin Lv, Qinkai Zheng, Zhenyu Hou, Bin Chen, Chengxing Xie, Cunxiang Wang, Da Yin, Hao Zeng, Jiajie Zhang, Kedong Wang, Lucen Zhong, Mingdao Liu, Rui Lu, Shulin Cao, Xiaohan Zhang, Xuancheng Huang, Yao Wei, Yean Cheng, Yifan An, Yilin Niu, Yuanhao Wen, Yushi Bai, Zhengxiao Du, Zihan Wang, Zilin Zhu, Bohan Zhang, Bosi Wen, Bowen Wu, Bowen Xu, Can Huang, Casey Zhao, Changpeng Cai, Chao Yu, Chen Li, Chendi Ge, Chenghua Huang, Chenhui Zhang, Chenxi Xu, Chenzheng Zhu, Chuang Li, Congfeng Yin, Daoyan Lin, Dayong Yang, Dazhi Jiang, Ding Ai, Erle Zhu, Fei Wang, Gengzheng Pan, Guo Wang, Hailong Sun, Haitao Li, Haiyang Li, Haiyi Hu, Hanyu Zhang, Hao Peng, Hao Tai, Haoke Zhang, Haoran Wang, Haoyu Yang, He Liu, He Zhao, Hongwei Liu, Hongxi Yan, Huan Liu, Huilong Chen, Ji Li, Jiajing Zhao, Jiamin Ren, Jian Jiao, Jiani Zhao, Jianyang Yan, Jiaq Wang, Jiayi Cui, Jiayue Zhao, Jie Liu, Jijie Li, Jing Li, Jing Lu, Jingsen Wang, Jingwei Yuan, Jingsuan Li, Jingzhao Du, Jinhua Du, Jinxin Liu, Junkai Zhi, Junli Gao, Ke Wang, Lekang Yang, Liang Xu, Lin Fan, Lindong Wu, Lintao Ding, Lu Wang, Man Zhang, Mingshao Li, Minghuan Xu, Mingming Zhao, Mingshu Zhai, Pengfan Du, Qian Dong, Shangde Lei, Shangqing Tu, Shangtong Yang, Shaoyou Lu, Shuang Li, Shuang-Li, Shuxun Yang, Sibo Yi, Tianshu Yu, Wei Tian, Weihan Wang, Wenbo Yu, Weng Lam Tam, Wenjie Liang, Wentao Liu, Xiao Wang, Xiaohan Jia, Xiaotao Gu, Xiaoying Ling, Xin Wang, Xing Fan, Xingru Pan, Xinyuan Zhang, Xinze Zhang, Xiuqing Fu, Xunkai Zhang, Yabo Xu, Yandong Wu, Yida Lu, Yidong Wang, Yilin Zhou, Yiming Pan, Ying Zhang, Yingli Wang, Yingru Li, Yinpei Su, Yipeng Geng, Yitong Zhu, Yongkun Yang, Yuhang Li, Yuhao Wu, Yujiang Li, Yunan Liu, Yunqing Wang, Yuntao Li, Yuxuan Zhang, Zezhen Liu, Zhen Yang, Zhengda Zhou, Zhongpei Qiao, Zhuofer Feng, Zhuorui Liu, Zichen Zhang, Zihan Wang, Zijun Yao, Zikang Wang, Ziqiang Liu, Ziwei Chai, Zixuan Li, Zuodong Zhao, Wenguang Chen, Jidong Zhai, Bin Xu, Minlie Huang, Hongning Wang, Juanzi Li, Yuxiao Dong, and Jie Tang. 2025. GLM-4.5: Agentic, Reasoning, and Coding (ARC) Foundation Models. arXiv:2508.06471 [cs.CL] https://arxiv.org/abs/2508.06471
  23. [23]Ashish V Thapliyal, Jordi Pont Tuset, Xi Chen, and Radu Soricut. 2022. Crossmodal-3600: A massively multilingual multimodal evaluation dataset. In Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing. 715–729.
  24. [24]Zheng Wang, Zhiyong Fang, Jing Wang, Yi Zhang, Yichao Zhang, Yi Liu, and Yizhou Wang. 2020. VITAA: Visual-textual attributes alignment in person search by natural language. In European Conference on Computer Vision. Springer, 402–420.arxiv.org/abs/2005.07327
  25. [25]Shuyu Yang, Yaxiong Wang, Yongrui Li, Li Zhu, and Zhedong Zheng. 2026. Minimizing the pretraining gap: Domain-aligned text-based person retrieval. Pattern Recognition (2026), 113511.
  26. [26]Shuyu Yang, Yinan Zhou, Zhedong Zheng, Yaxiong Wang, Li Zhu, and Yujiao Wu. 2023. Towards unified text-based person retrieval: A large-scale multi-attribute and language search benchmark. In Proceedings of the 31st ACM International Conference on Multimedia. 4492–4501.
  27. [27]Mang Ye, Jianbing Shen, Gaojie Lin, Tao Xiang, Ling Shao, and Steven CH Hoi. 2021. Deep learning for person re-identification: A survey and outlook. IEEE transactions on pattern analysis and machine intelligence 44, 6 (2021), 2872–2893.DOI
  28. [28]Hang Yu, Jiahao Wen, and Zhedong Zheng. 2025. CAMeL: Cross-modality Adaptive Meta-Learning for Text-based Person Retrieval. IEEE Transactions on Information Forensics and Security (2025).arxiv.org/abs/2504.18782
  29. [29]Yan Zeng, Xinsong Zhang, Hang Li, Jiawei Wang, Jipeng Zhang, and Wangchun-shu Zhou. 2023. X 2-vlm: All-in-one pre-trained model for vision-language tasks. IEEE Transactions on Pattern Analysis and Machine Intelligence (2023).
  30. [30]Yan Zeng, Wangchunshu Zhou, Ao Luo, Ziming Cheng, and Xinsong Zhang. 2022. Cross-view language modeling: Towards unified cross-lingual cross-modal pre-training. arXiv preprint arXiv:2206.00621 (2022).arxiv.org/abs/2206.00621
  31. [31]Mao Zhang, Zheng Li, Bingxin Qu, Mingyang Song, Yang Du, Mingrui Sun, and Di Wang. 2025. Hunyuan-MT Technical Report. arXiv:2509.05209 [cs.CL] https://arxiv.org/abs/2509.05209
  32. [32]Tianlu Zheng, Yifan Zhang, Xiang An, Ziyong Feng, Kaicheng Yang, and Qichuan Ding. 2025. Gradient-Attention Guided Dual-Masking Synergetic Framework for Robust Text-based Person Retrieval. In Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing. 259–271.
  33. [33]Zhedong Zheng, Liang Zheng, Matthew Garrett, Yifan Shen, Jing Shao, and Xiaohui Xie. 2020. Dual-path convolutional image-text embeddings with instance loss. ACM Transactions on Multimedia Computing, Communications, and Applications 16, 2 (2020), 1–23.DOI
  34. [34]Mingyang Zhou, Lei Zhou, Shuai Wang, Jiani Wang, and Xirong Li. 2021. UC2: Universal cross-lingual cross-modal vision-and-language pre-training. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 4155–4165.arxiv.org/abs/2104.00332
  35. [35]Xinyu Zhou, Yu Wu, Jia yao Ma, Wenhao Wang, Min Cao, and Mang Ye. 2026. Text-based Aerial-Ground Person Retrieval. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 40. 29035–29043.
  36. [36]Jialong Zuo, Jiahao Hong, Feng Zhang, Changqian Yu, Hanyu Zhou, Changxin Gao, Nong Sang, and Jingdong Wang. 2023. Plip: Language-image pre-training for person representation learning. arXiv preprint arXiv:2305.08386 (2023).arxiv.org/abs/2305.08386
  37. [37]Jialong Zuo, Hanyu Zhou, Ying Nie, Feng Zhang, Tianyu Guo, Nong Sang, Yunhe Wang, and Changxin Gao. 2024. UniFineBench: Towards Text-based Person Retrieval with Ultra-fine Granularity. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 22010–22019.DOI

Paper details

vlnc:W_fxwdcun5
Version
v1 · latest
Published
Fresh — added to the Hub within the last 30 days
Added
License
CC BY 4.0
Usage

views · 10

downloads · 0

A view counts once per browser per day, a download each time the PDF is requested.

  • Computer Science

Not recorded for this paper

View statement
Looking for related papers…
Contents