WorksComputer Science
IIT Patna at "ICPR 2026 TVRID Competition on Privacy-Preserving Person Re-Identification from Top-View RGB-Depth Camera"
Abstract
Privacy-aware person re-identification (Re-ID) from top-view cameras replaces frontal appearance with anthropometric shape, while depth sensing further reduces color-based identity cues. The ICPR 2026 TVRID competition evaluates this setting using 86 identities captured by four synchronized Intel RealSense D455 cameras with RGB and Depth streams across flat, ascent, descent, and oblique viewpoints. Performance is measured using mAP and CMC@1 across within-camera in/out, ascent-descent, and flat-oblique scenarios. The competition had 147 registered participants and 33 final submissions. Three teams from IIT Patna participated: 'abhinavkumar03' and 'sjkdgfhl_' ranked 5th and 7th among 31 ranked participants, and 'vivek katuri' reached 77.67% CMC@1 / 85.20% mAP on the RGB track. This paper presents the methods of the two top-10 teams. Methodology 1 (abhinavkumar03) achieves 93.51% mAP and 90.42% CMC@1 on Depth, ranking 4th of 28, while Methodology 2 (sjkdgfhl_) reaches 99.63%/99.35% on RGB and 86.26%/80.34% on Depth. Both substantially outperform the 57.19% track-average Depth mAP, with Methodology 1 yielding a 7.3-point gain over Methodology 2. These results demonstrate the importance of depth representation and supervision for privacy-preserving Re-ID.
Introduction
Person re-identification (Re-ID) determines whether observations from different cameras belong to the same person and is widely used in surveillance, retail analytics, and crowd analysis [1]. While most Re-ID methods rely on side-view RGB images and appearance cues such as clothing color and texture, overhead cameras provide a more privacy-aware alternative by reducing facial visibility, while depth sensors further reduce appearance information by capturing 3D body geometry without color [2]. However, limited silhouettes, variable scale, short 2-3 second observations, and fewer color and texture cues make re-identification challenging. The ICPR 2026 TVRID competition [3] evaluates this setting using synchronized RGB and depth data from four overhead cameras with different viewpoints. Three teams from IIT Patna participated, with two reaching the top 10. Methodology 1 (M1: abhinavkumar03) converts depth maps into JET colorized images and uses OSNet [4], while Methodology 2 (M2: sjkdgfhl_) uses separate CNNs backbone for RGB and depth and mean-pools frame-level features to form a tracklet representation. Both methods use only the official TVRID training data and achieve strong performance on the competition benchmarks.
Task formulation. For each modality , a tracklet is the set of person crops from one camera pass, where is the crop at frame . Using the labeled training identities, each method learns an embedding with ( for M1, for M2). At test time, the identities are unseen. Each query tracklet is compared with every gallery tracklet using and gallery tracklets are ranked by increasing distance.
Methodology 1
Depth colorization: Since raw depth images are single-channel and lack the color and texture cues used by ImageNet-pretrained CNNs, M1 converts each depth frame into a three-channel JET pseudo-color image using a fixed colormap [6]:
This converts depth variations into color gradients and highlights structures such as the head and shoulders without adding learnable parameters.
OSNet backbone: The colorized image is resized to 256128 and processed using OSNet x1_0 [4]. Its omni-scale blocks capture features at different spatial scales, helping handle changes in viewpoint, elevation, and body scale in top-view images. Global average pooling and a fully connected layer produce a 512-dimensional frame feature . The backbone has only 2.2M parameters.
Training and Inference
The network is trained to classify each frame into one of the training identities. For a mini-batch of frames, let be the embedding of frame , its identity label, and the weights of a linear classifier. The loss is label-smoothed cross-entropy:
where the smoothed target is , equals 1 when and 0 otherwise, and . Training uses only the official TVRID training data, starting from ImageNet weights. We use Adam for 60 epochs with batch size 32, an initial learning rate of and weight decay , and reduce the learning rate by at epochs 30 and 50.

Figure 1. Methodology 1 (abhinavkumar03): Depth frames are JET-colorized and encoded by OSNet [4]

Figure 2. Methodology 2 (sjkdgfhl_): Modality-specific CNN backbone encodes frames, followed by mean pooling for tracklet retrieval [5]
For augmentation, each image is flipped horizontally with probability 0.5. With probability 0.5 it is also enlarged to 288×144 and randomly cropped back to 256×128; otherwise it is resized directly to 256×128.
During inference, the classifier is removed and each frame feature is -normalized: . The resulting frame embeddings are used to represent the tracklets, and query-gallery pairs are ranked using .
Methodology 2
Modality-specific backbones: For each modality , every frame of a tracklet is resized to 256×128 and encoded independently by its own backbone , a convolutional network with its ImageNet classification head removed. We use ResNeSt-50d [7] for RGB () and ResNet-50 [5] for depth (). Both start from ImageNet weights, and depth frames are read as grayscale images replicated to three channels so that they match the RGB input format. The backbone outputs a feature map , where is its spatial size. Global average pooling (GAP), which averages this map over all positions, gives a 2048-dimensional frame feature:
Tracklet aggregation: At test time the classifier is removed. A tracklet contains frames, which are short and unordered, so instead of modeling time we average the frame features from Eq. (3) and scale the result to unit length:
where is the Euclidean () norm. For depth, the BN layer of the training head is kept, so each is batch-normalized before averaging. Averaging adds no parameters, does not depend on frame order or on , and smooths out frame-level noise such as motion blur, partial views and detector errors. The tracklet embedding is then compared across query and gallery tracklets with .
Training Strategy
Score-level fusion: When both RGB and depth are available, their query-gallery distances are averaged:
This provides RGB+Depth matching using both modalities for the query and gallery.
Training Strategy
Each modality branch is trained independently to classify frames into the training identities. For a mini-batch of frame–label pairs , the frame feature (Eq. (3)) passes through a BN layer and a linear classifier , trained with cross-entropy:
| Track | Metric | Average | Median | M1 | M2 |
| RGB | mAP | 89.66 | 93.35 | 99.88 | 99.63 |
| CMC@1 | 85.73 | 91.92 | 99.84 | 99.35 | |
| Depth | mAP | 57.19 | 49.82 | 93.51 | 86.26 |
| CMC@1 | 47.10 | 30.55 | 90.42 | 80.34 |
Table II. Our entries against the official aggregate statistics [3]

Figure 3. Official Depth-track mAP for 28 entries [3], sorted in decreasing order. Our entries are in the top tier, above the track average
We use only TVRID training data with ImageNet initialization and train with Adam (constant learning rate , batch size 64). Augmentation includes horizontal flipping, rotation (), color jitter and random erasing [8]. During inference, the BatchNorm layer and classifier are removed. Frame features are mean-pooled using Eq. (4) to obtain the -normalized tracklet embedding. When both RGB and depth are available, their distances are fused using Eq. (5).
Experimental Setup
Common protocol: Both methods use ImageNet initialization and train only on the 62 official TVRID training identities. We evaluate final rankings on the blind Codabench server using CMC@1 and mAP [3].
Implementation: Table I summarizes the two configurations. M1 & M2 are implemented and trained on the Aryabhatta Paramrudra Server.
| M1 (abhinavkumar03) | M2 (sjkdgfhl_) | |
| Input | Depth → JET pseudo-RGB | RGB / raw depth |
| Backbone | OSNet x1_0 (2.2M) | ResNeSt-50d (27M) / ResNet-50 (26M) |
| Embedding | 512-d, | 2048-d, mean-pooled, |
| Loss | ||
| Optimizer | Adam, lr | Adam, lr |
| Schedule | 60 ep., batch 32; at 30, 50 | — |
| Augmentation | Flip; crop from | Flip, rotation , jitter, erasing |
Table I. Implementation details of the two methods.
Dataset Analysis:
TVRID [3] contains 86 identities recorded by four synchronized overhead Intel RealSense D455 cameras at 15 FPS (), covering flat, ascent, descent, and oblique views. Each passage is observed twice (IN/OUT), giving eight observation sets, with aligned RGB and depth data and depth-based person crops. The dataset uses 62 identities for training, with disjoint test identities. The main challenges are short 2-3 sec tracklets, viewpoint and scale changes, and limited color and texture in depth images. Evaluation considers within-camera IN↔OUT, ascent↔descent, and flat↔oblique scenarios using CMC@1 and mAP. The competition had 147 registered participants, 732 development submissions, and 33 final submissions, with average RGB mAP/CMC@1 of 89.66%/85.73% compared with 57.19%/47.10% for depth,
89.66%/85.73% compared with 57.19%/47.10% for depth, highlighting the greater difficulty of depth-based Re-ID.
Result Analysis:
M1 and M2 achieve strong performance across both tracks, obtaining 99.88% and 99.63% RGB mAP with 99.84% and 99.35% CMC@1, respectively, and 93.51% and 86.26% Depth mAP with 90.42% and 80.34% CMC@1. Both exceed the official Depth-track averages of 57.19% mAP and 47.10% CMC@1 [3]. On Depth, M1 outperforms M2 by 7.25 mAP and 10.08 CMC@1 points despite using a much smaller backbone (2.2M vs. 26M parameters), securing 4th rank among 28 submissions. This highlights the effectiveness of JET-based depth colorization with lightweight multi-scale OSNet. Both methods use only official TVRID training data and standard CNN-based training; while M1 provides a lightweight depth solution, M2 employs modality-specific backbones and tracklet-level feature aggregation. Both process RGB and Depth independently without requiring cross-modal alignment during training. However, the lack of controlled ablations and differences in training settings limit the attribution of performance gains to individual components.
Conclusion
We presented two IIT Patna entries in the ICPR 2026 TVRID competition using only the official training data. M1 combines JET depth colorization with a lightweight 2.2M-parameter OSNet, while M2 uses modality-specific backbones (ResNeSt-50d & ResNet-50) with tracklet aggregation. They achieve up to 99.88% mAP on RGB and 93.51% on Depth, with M1 ranking 5th overall and 4th on the Depth track, while M2 ranks 7th overall. The results show that effective depth representation and simple feature aggregation can provide strong Re-ID performance without large models or external data.
Acknowledgment: The organizers of the ICPR 2026 TVRID Competition and the Aryabhatta Supercomputing Centre (ASC), IIT Patna, established under NSM, Govt. of India, for providing computational resources, are gratefully acknowledged.
References
- [1]M. Ye et al., “Deep Learning for Person Re-Identification: A Survey and Outlook,” IEEE TPAMI, vol. 44, no. 6, pp. 2872–2893, 2022.DOI
- [2]R. Delécluse et al., “Privacy-Preserving Person Re-Identification from Temporal Sequences with Transformer and Hungarian Optimization,” in IEEE FG, 2025, pp. 1–10.DOI
- [3]R. Delécluse et al., “ICPR 2026 competition on privacy-preserving person re-identification from top-view rgb-depth camera (tvrid),” in Pattern Recognition, 2027, pp. 229–242.
- [4]K. Zhou, Y. Yang, A. Cavallaro, and T. Xiang, “Omni-scale feature learning for person re-identification,” in ICCV, 2019.arxiv.org/abs/1905.00953
- [5]K. He et al., “Deep Residual Learning for Image Recognition,” in CVPR, 2016.arxiv.org/abs/1512.03385
- [6]A. Eitel et al., “Multimodal Deep Learning for Robust RGB-D Object Recognition,” in IEEE IROS, 2015, pp. 681–687.arxiv.org/abs/1507.06821
- [7]H. Zhang et al., “ResNeSt: Split-Attention Networks,” in IEEE CVPRW, 2022, pp. 2735–2745.arxiv.org/abs/2004.08955
- [8]Z. Zhong, L. Zheng, G. Kang, S. Li, and Y. Yang, “Random erasing data augmentation,” in AAAI, 2020.arxiv.org/abs/1708.04896