betaFeedback

WorksComputer Science

Feature Recovery for Object Understanding After Irreversible Fire Damage

Abstract

Objects in post-fire environments often undergo irreversible physical transformations that change their geometry, material state, and visual appearance. Detecting and identifying these remnants is critical for locating hazards, reconstructing pre-incident contents, and inventorying losses. Unlike standard image corruptions, these degradations affect the physical structure of the object itself. To study this setting, we introduce TRACE, a transformation-aware benchmark for post-fire object understanding. TRACE contains 21.4K real-image-grounded synthetic scenes and paired object-level pristine-to-degraded progressions spanning 499 object identities across 189 categories. We define five tasks targeting localization and pre-degradation understanding: degraded-object detection, pristine-state recovery and retrieval, original material recovery, pristine description generation, and functional reasoning. Existing models degrade sharply with severity. From the least to the most severe level, RF-DETR mAP decreases by 71% relative, while InternVL3.5 retrieval R@1 falls from 93.85 to 28.11. To address this, we propose the Feature Recovery Module (FRM), a plug-and-play module that maps degraded encoder features to pristine-aligned representations while keeping the host frozen. Trained only with paired feature supervision, FRM improves scene-level detection, CLIP/SigLIP2 feature recovery, and all four object-level VLM tasks, with larger gains under more severe degradation. Across VLM hosts and severity levels, relative gains average 12.5% for retrieval, 20.1% for material recovery, 13.2% for description generation, and 12.4% for functional reasoning.

Introduction

Real-world post-disaster environments present a fundamental challenge for visual perception. Unlike classical image corruptions, post-fire degradation is physical and irreversible. Wood chars, plastic warps, metal oxidizes, and glass fractures, jointly altering geometry, material state, and surface appearance. Recovering object identity, material, and function from such remnants is critical across post-disaster workflows, including firefighters locating hazardous items, investigators reconstructing pre-incident contents, and adjusters inventorying damaged property from partial remains.

Existing benchmarks do not capture this setting. Standard object detection benchmarks [22, 14, 48, 37] contain mostly pristine object instances, while robustness suites [39, 24] perturb appearance over a fixed geometric scaffold, leaving object shape and material identity largely intact. In contrast, post-fire transformation changes structure, material, and appearance together. Across RF-DETR [35], CLIP [30], SigLIP2 [43], and five VLMs, Qwen3-VL [4], Qwen2.5-VL [5], InternVL3.5 [45], Molmo2 [12], and LLaVA-OV-1.5 [2], we observe consistent failure. From the least (L0) to the most severe degradation (L4) level, RF-DETR mAP drops by 71%, and 92.9% of boxes localized at IoU≥\geq0.5 are misclassified (Figure 1). VLMs, despite access to world knowledge, exhibit the same

Figure 1. RF-DETR failures under post-fire degradation. RF-DETR consistently mislabels detected objects in real post-fire scenes (a-c) and synthetic degradations (d-f), as post-fire transformations alter object structure, material, and surface appearance in ways not seen by the model. This highlights the need for benchmarks that explicitly link pristine objects to their degraded counterparts, which are not available in current datasets.

Preprint. degradation pattern: InternVL3.5 retrieval R@1 falls from 93.85 to 28.11, and Qwen2.5-VL falls from 76.92 to 32.31. Similar drift in frozen encoder features indicates a systematic limitation of current visual representations rather than a model-specific deficiency.

To study this gap, we introduce TRACE, a transformation-aware benchmark for post-fire object understanding. TRACE provides 21.4K real-image-grounded synthetic post-fire scenes with bounding boxes, material labels, and degradation-severity captions (Figure 2a). It also provides object degradation trajectories for 499 instances across 189 object types, each with a pristine reference and five progressively degraded states annotated at the part level (Figure 2b). On TRACE, we define five tasks spanning localization and pre-degradation understanding (Table 1). These are degraded-object detection, pristine-state recovery and retrieval, original material recovery, pristine description generation, and functional reasoning.

Pixel-space restoration is a natural baseline, but physical degradation makes pristine reconstruction ambiguous. Irreversible changes can destroy object parts and material cues that cannot be uniquely inferred. We fine-tune Restormer [51] on TRACE degraded-pristine pairs and use it before frozen RF-DETR and VLM retrieval, but even with paired supervision, Restormer gives only modest gains and remains below feature recovery. We instead train a lightweight residual Feature Recovery Module (FRM) at the host feature interface, leaving all host weights frozen. FRM maps degraded features toward pristine counterparts in the host representation space, leveraging semantics already encoded by pretrained models. Across detectors, encoders, and VLMs, FRM yields severity-scaled gains: RF-DETR detection improves by 30.8% relative, while InternVL3.5 and Qwen3-VL improve by 27% and 12% on average across the four VLM pristine-state tasks.

Contributions.

  • Benchmark. TRACE provides 21.4K real-image-grounded synthetic post-fire scenes with object-level annotations and 499 paired pristine-to-degraded object trajectories across 189 types, supporting five evaluation tasks (Table 1).

  • Findings. On TRACE, state-of-the-art detectors, encoders, and VLMs fail consistently under physical degradation, indicating a representational rather than model-specific limitation.

  • Method and release. FRM is a plug-and-play residual feature-recovery module that improves all five evaluation tasks in Table 1 across diverse hosts. RF-DETR detection improves by 30.8% relative, and the four VLM pristine-state tasks improve by 12.4% to 20.1% mean relative across five frozen VLMs. We release the dataset, generation and evaluation pipelines, and training code.

TaskGoalOutputMetric
Degraded-object detectionLocalize all objects of interest in scene-level post-fire imagesBounding boxes + mapped COCO classesCOCO-mapped [email protected]:0.95
Pristine-state recovery (feature)Recover CLIP/SigLIP2 features toward paired pristine targetsRecovered visual embeddingsMSE, cosine similarity
Pristine-state retrieval (gallery)Retrieve paired pristine reference from candidate gallery using VLM embeddingsRanked pristine galleryRecall@1
Original material recoveryPredict pre-degradation materials from degraded object imageMaterial label setMicro-F1 over normalized material classes
Pristine description generationDescribe object identity, material, and function before degradationSingle-sentence descriptionMean of identity accuracy, material micro-F1, and function accuracy
Functional reasoningPredict pre-degradation function and required restoration materialsFunction tags + restoration materialsMean of function-tag micro-F1 and restoration-material micro-F1

Table 1. Evaluation tasks in post-fire object understanding. We evaluate five tasks spanning detection, retrieval, and reasoning, with pristine-state recovery split into feature-space and gallery-retrieval protocols. Full prompts are provided in Appendix C.

TRACE dataset overview showing post-fire scenes and object degradation trajectories

Figure 2. TRACE dataset overview. TRACE contains real-image-grounded synthetic post-fire scenes and paired pristine-to-degraded object trajectories. Scene annotations include bounding boxes, material labels, and captions; object trajectories include part-level materials and progressive degradation states for tracking identity changes under physical transformation. Detailed object and scene statistics are provided in Appendix A.

Prior work on visual robustness studies models under image corruptions, domain shift, adverse conditions, synthetic distribution shifts, or pixel-level restoration. These settings assume the underlying object is intact and recoverable from the observation. i. Benchmarks. Robustness benchmarks [19, 6, 38, 3, 10, 27, 18, 39, 24] evaluate recognition under appearance shifts (noise, blur, weather, viewpoint) but preserve object structure and material identity. Natural-disaster benchmarks [17, 32, 31, 46, 29] target damage assessment from aerial or social-media imagery at the building or scene level, not at the level of individual objects undergoing irreversible transformation.

TRACE is the first benchmark to study object-level physical degradation with paired pristine-to-degraded trajectories, supporting severity-stratified evaluation and feature-space recovery. ii. Methods. The methods most relevant to FRM fall into three families, each with a different assumption about the nature of degradation. Domain adaptation aligns features between source and target distributions through covariance matching, pseudo-labeling, or prototype alignment [41, 47, 9, 20, 49, 33]. These methods assume a coherent target distribution to align to; under our setting, each degradation severity induces a different distribution, and the relevant supervision is paired pristine-degraded correspondences rather than aggregate distributional alignment. Test-time adaptation adapts models on unlabeled test data through pseudo-supervision, feature-distribution alignment, or dynamic class statistics [36, 23, 52]. These methods optimize at deployment time without paired pristine references; FRM instead trains once on paired data and applies without per-deployment optimization. Image restoration recovers high-quality images from degraded image quality observations [50, 21, 51, 11, 25, 13, 34, 49], and feature-quality methods characterize degradation-induced shifts in learned embeddings [8, 1, 7]. Restoration shares FRM’s motivation but operates in pixel space, where physical degradation makes inversion ill-posed and errors can propagate to downstream recognizers. Feature-quality methods quantify degradation without correcting it, whereas FRM uses paired supervision to recover pristine-aligned features in the host representation space while keeping all host weights frozen.

TRACE

Design Principles. TRACE is shaped by three constraints specific to physical transformations of the object. i. Pairing. Each object appears in both pristine and degraded states with instance-level correspondence. This enables direct measurement of representation drift under transformation, rather than end-task accuracy under shifted distributions alone. ii. Severity progression. Each object is rendered along a discrete five-level severity ladder (L0-L4), where L0 denotes mild surface damage and L4 denotes severe deformation or near-total destruction. This enables severity-stratified evaluation and exposes whether a method interpolates within a trained severity range or extrapolates beyond it (Sec. 5). iii. Real-world grounding. Synthetic generation is conditioned on real post-fire imagery [42], grounding visual statistics, material behavior, and scene composition in observed environments rather than free-form prompts alone. Each sample includes object class, material composition, degradation-state descriptions, failure modes, embeddings, and bounding boxes; see Appendix A. To verify annotation reliability, two authors independently assigned accept/reject labels on a stratified 300-object subset, yielding 93.4% agreement and Cohen’s κ=0.836\kappa= 0.836.

Object Inventory. The object inventory targets two post-fire response needs. The first covers hazardous items such as aerosol cans, gas cylinders, and chemical containers that responders must identify and secure. The second covers personal valuables and everyday objects, including electronics, furniture, bags, and medical equipment, that matter for insurance assessment and inventory reconstruction. Overall, TRACE spans 189 object types and 11 normalized material classes, with plastic (1,315 mentions), metal (948), fabric/textile (390), and wood (287) most represented.

Scene-Level Subset. Gemini 3 Pro Image [16] generates each scene from a structured prompt and two to four real post-fire references, sampled from approximately 700 images drawn primarily from Fire360 [42] and research-permissive web sources. References span residential, commercial, institutional, and outdoor environments. Scene prompts cover four environment groups and 30 scene types. A Gemini 3 Flash [15] vision-language judge scores each candidate for realism, material fidelity, structural plausibility, and consistency with the references. Candidates below 0.7 are rejected, yielding 21,400 accepted scenes from approximately 29,000 generations. Full prompts, judge criteria, filtering details, and licensing notes are in Appendix B.

Object-Level Subset. Each object trajectory contains one pristine render and five progressively degraded states (L0-L4) generated with material-aware prompts that capture wood charring, plastic melting, metal oxidation, and glass fracture. Trajectories span 499 distinct object identities across 189 object types, yielding 2,994 object-level images. Some object types include multiple subtypes or variants, which are treated as distinct identities when constructing train, validation, and test splits. The object-level subset is split 80/10/10 by object identity, ensuring that all renders of an identity remain in the same split.

Real Post-Fire Crops. To evaluate beyond synthetic data, we manually crop 500 objects from the pool of approximately 700 real post-fire reference images described above. Each crop is annotated with identity and severity labels following the same protocol as the synthetic subset. These real crops are included in the object-level test set.

Evaluation Tasks. TRACE defines five tasks spanning detection, retrieval, and reasoning in post-fire settings (Table 1). (1) Degraded-object detection. First responders must rapidly locate hazardous or structurally compromised objects in post-fire scenes. Given a scene-level image, the task is to detect and localize all objects of interest, evaluated with class-aware COCO-mapped [email protected]:0.95 at each degradation level. Only boxes with unambiguous COCO mappings [22] are included in mAP. The mapping covers 55 of the 80 COCO categories. (2) Pristine-state recovery and retrieval. Matching a damaged remnant to its undamaged counterpart is the foundation for downstream recovery. This retrieval setting is similar to TOR [42], but TOR defines transformed-object retrieval in video space, while TRACE evaluates paired pristine-to-degraded recovery at the object level. We evaluate this in two protocols. In feature space, CLIP and SigLIP2 features are recovered toward paired pristine targets and measured by MSE and cosine similarity. In gallery retrieval, VLM visual embeddings retrieve the paired pristine reference from a candidate gallery, measured by Recall@1. (3) Material recovery. Knowing original materials determines whether an object is restorable or requires replacement and helps environmental teams triage debris for safe disposal. Given a degraded object image, the model predicts the object’s pre-degradation materials. Outputs are mapped to our normalized material vocabulary and evaluated using micro-F1 over the 11 material classes. (4) Pristine description generation. Reconstruction planning and insurance documentation require a concise account of what the object was, its material composition, and its intended use. The model generates a one-sentence description of the object’s pre-degradation identity, materials, and function. We parse the description into identity, material, and function fields. Identity and function are scored by categorical accuracy after synonym normalization, with GPT5 [40] as LLM-judge fallback only for unresolved paraphrases. Materials are scored with micro-F1 over the normalized material vocabulary. The final description score is the unweighted mean of identity accuracy, material micro-F1, and function accuracy, reported on a 0–100 scale. (5) Functional reasoning. Fire investigators and restoration teams need structured judgments beyond description, such as whether an object could have served as an ignition source, fuel, or hazard, and what materials are needed for repair. The model predicts pre-degradation function tags and restoration materials, evaluated as the unweighted mean of micro-F1 over function tags and micro-F1 over restoration-material labels. Appendix C specifies the prompts, output normalization, label vocabularies, and exact score computations for all generation-based tasks.

Feature Recovery Module (FRM)

TRACE provides paired observations of each object instance before and after physical transformation (Figure 3). This pairing enables direct supervision of feature-space recovery: for any frozen visual encoder, the degraded image serves as input and the paired pristine image defines the target representation. We operate in feature space rather than pixel space because severe physical transformations alter geometry, material state, and surface structure in ways that make pixel-level inversion ambiguous. Since FRM modifies only the visual feature representations, the encoder, projector or merger, detector head, and language model remain frozen.

Figure 3. Feature Recovery Module (FRM). (a) FRM is a residual Transformer [44] over visual tokens, trained to recover pristine-aligned features from degraded ones with a zero-gated identity initialization; tap tt is the frozen host feature interface where FRM is inserted. (b) In RF-DETR, DINOv2 [28] feature maps from four tapped layers are flattened, corrected by a single shared FRM head, and reshaped before the unchanged detector. (c) In Qwen3-VL, FRM corrects post-merger visual tokens before they are consumed by the frozen language model. Dashed paths denote the no-FRM baseline.

Feature-Recovery Problem. Let xipx_i^p denote the pristine image of object instance ii, and let xiℓx_i^\ell denote a paired image of the same instance after transformation at degradation level ℓ∈{0,…,4}\ell\in\{0,\ldots,4\}. For a frozen encoder EE and a tap point tt (an intermediate interface where features can be read and written back to), let Et(x)∈RNt×DtE_t(x) \in\mathbb{R}^{N_t \times D_t} denote the features at tt. FRM learns a shape-preserving function hθ:RNt×Dt→RNt×Dth_\theta: \mathbb{R}^{N_t \times D_t} \to\mathbb{R}^{N_t \times D_t} that maps degraded features toward their pristine counterparts:

z^iℓ,t=hθ(Et(xiℓ))≈Et(xip).\hat{z}_i^{\ell,t} = h_\theta(E_t(x_i^\ell)) \approx E_t(x_i^p).

The corrected features z^iℓ,t\hat{z}_i^{\ell,t} are forwarded through the unchanged downstream pipeline. As detailed below, hθh_\theta is implemented as a residual correction hθ(z)=z+Δθ(z)h_\theta(z)=z+\Delta_\theta(z) with Δθ=0\Delta_\theta=0 at initialization.

Architecture. FRM is a residual Transformer (MM blocks, default M=4M=4 for VLMs, M=1M=1 for RF-DETR) with zero-gated initialization. For any tapped feature tensor z∈RB×N×Dz \in\mathbb{R}^{B \times N \times D} passed to FRM, let u0=zu^0=z. Block m∈{1,…,M}m \in\{1,\ldots,M\} applies

u^m=um−1+αattnm⊙MSA⁡(LN⁡(um−1)),um=u^m+αmlpm⊙MLP⁡(LN⁡(u^m)).\hat{u}^{m}=u^{m-1}+\alpha_{\mathrm{attn}}^{m}\odot\operatorname{MSA}(\operatorname{LN}(u^{m-1})), \qquad u^{m}=\hat{u}^{m}+\alpha_{\mathrm{mlp}}^{m}\odot\operatorname{MLP}(\operatorname{LN}(\hat{u}^{m})).

with HH attention heads, an MLP of hidden width rDrD, and learned channel-wise residual scales αattnm,αmlpm∈RD\alpha_{\mathrm{attn}}^{m},\alpha_{\mathrm{mlp}}^{m} \in\mathbb{R}^{D} initialized to zero. We define the residual correction Δθ(z):=uM−z\Delta_\theta(z):=u^M-z, so that hθ(z)=z+Δθ(z)h_\theta(z)=z+\Delta_\theta(z). Because the residual scales gate all MSA and MLP outputs to zero, Δθ(z)=0\Delta_\theta(z)=0 at initialization regardless of inner weights, and FRM acts as the identity on the host interface, which stabilizes early training. Unlike encoder fine-tuning, FRM never touches encoder weights, preserving the downstream model’s training-time feature distribution.

Tap-Point Selection. The tap point tt involves a tradeoff between spatial detail and downstream alignment. Earlier taps in the visual encoder preserve higher spatial resolution, making local degradation patterns easier to identify and correct at the patch level. Later taps, and in particular post-projector or post-merger interfaces, produce features in the same space that the downstream head was trained on, so corrections at these locations translate more directly into task performance. We select the tap point for each host based on this tradeoff and ablate the choice in Table 9.

ConfigurationScore
DeepStack, Qwen3-VL, ID acc.↑\uparrow
No FRM32.69
FRM, DeepStack off37.31
FRM, DeepStack on36.54
Pristine ceiling43.08
Tap point, retrieval R@1↑R@1\uparrow
Qwen3-VL post-merger85.28
Qwen3-VL pre-merger72.90
InternVL3.5 post-projector74.92
InternVL3.5 pre-projector63.84

Table 9. Additional FRM ablations. DeepStack correction does not improve Qwen3-VL identity accuracy. Downstream-facing taps, post-merger for Qwen3-VL and post-projector for InternVL3.5, outperform earlier visual-token taps for retrieval.

Training Objective. For a paired sample (xiℓ,xip)(x_i^\ell, x_i^p), the encoder extracts ziℓ,t=Et(xiℓ)z_i^{\ell,t}=E_t(x_i^\ell) and zip,t=Et(xip)z_i^{p,t}=E_t(x_i^p) at the same tap. The pristine branch is computed without gradient tracking, and FRM is applied only to the degraded branch, z~iℓ,t=hθ(ziℓ,t)\tilde{z}_i^{\ell,t}=h_\theta(z_i^{\ell,t}). Dropping indices, the recovery loss combines element-wise MSE with token-level cosine alignment:

LFRM(z~,zp)=1BND∥z~−zp∥22+λcos⁡(1−1BN∑b,ncos⁡(z~b,n,zb,np)),\mathcal{L}_{FRM}(\tilde{z},z^p)=\frac{1}{BND}\lVert\tilde{z}-z^p\rVert_2^2+\lambda_{\cos}\left(1-\frac{1}{BN}\sum_{b,n}\cos(\tilde{z}_{b,n},z^p_{b,n})\right),

with λcos⁡=0.1\lambda_{\cos}=0.1 selected on the validation split.(Sec. 5.3). The MSE term constrains token magnitudes in the downstream feature space, and the cosine term penalizes directional drift. Spatial augmentations are restricted to transformations that preserve patch-grid correspondence (horizontal flips, 90∘90^\circ rotations, and stride-aligned resizes). The same transformation is sampled once and applied to both xiℓx_i^\ell and xipx_i^p before encoding. Arbitrary-offset crops are excluded because they break paired token correspondence.

Training Cost and Data Extensibility. Because only FRM is trained and the encoder is frozen, encoder features can be precomputed once per dataset and reused across epochs. On a single NVIDIA A100, training an FRM head to convergence on approximately 2,000 paired examples takes approximately one hour with cached encoder features and approximately three hours when encoder forward passes are recomputed on the fly. Adding new transformation categories or object instances requires only encoding the additional images and continuing FRM training.

Instantiation in RF-DETR. RF-DETR uses a DINOv2 encoder, a multi-scale projector, a DETR transformer, and class/box heads. We insert FRM after the encoder and before the projector, and all other components remain frozen. For RF-DETR-Medium with 576×576576 \times576 inputs and patch size 1616, we extract features from four evenly spaced DINOv2-Small encoder layers s∈{3,6,9,12}s \in\{3,6,9,12\}, each producing a 36×3636 \times36 grid with zs∈RB×384×36×36z^s \in\mathbb{R}^{B \times384 \times36 \times36}. Each map is flattened to us=ϕ(zs)∈RB×1296×384u^s=\phi(z^s)\in\mathbb{R}^{B \times1296 \times384} and corrected by a single shared FRM head hθh_\theta applied to all four scales:

u~s=hθ(us),z~s=ϕ−1(u~s),s∈{3,6,9,12}.\tilde{u}^s=h_\theta(u^s),\qquad\tilde{z}^s=\phi^{-1}(\tilde{u}^s),\qquad s\in\{3,6,9,12\}.

Sharing hθh_\theta across scales is possible because all four layers produce the same hidden dimension (D=384D=384), and keeps the parameter count independent of the number of tapped layers. The recovery loss LFRM\mathcal{L}_{FRM} is applied to each scale independently and averaged over the four tapped layers.

Instantiation in Qwen3-VL. Qwen3-VL consists of a frozen vision transformer, a frozen merger that compresses each 2×22 \times2 spatial neighborhood into one token and projects visual features into the LLM-facing space, and a frozen language model. With 448×448448 \times448 inputs and patch size 1616, the post-merger visual features have shape zpost∈RB×196×2560z^{post}\in\mathbb{R}^{B \times196 \times2560}. We insert FRM at this post-merger interface, so the corrected tokens zpostz^{post} are passed directly to the frozen language model. This tap aligns FRM with the representation actually consumed by the LLM. Instantiation details for CLIP, SigLIP2, and the remaining VLM hosts follow the same recipe and are provided in Appendix D.

Plug-and-Play Scaling and Overhead. Only the token dimension DD, capacity (M,r)(M,r), and tap point are configured per host, where DD is determined by the selected tap point. The FRM head has approximately PFRM≈M(4+2r)D2P_{FRM}\approx M(4+2r)D^2 parameters (4D24D^2 from multi-head self-attention, 2rD22rD^2 from the MLP). Capacity can be selected from an overhead budget ε\varepsilon via M(4+2r)≤εPhost/D2M(4+2r)\leq\varepsilon P_{\mathrm{host}}/D^2. We instantiate FRM with a 1.77M-parameter head for RF-DETR-Medium (Phost=33.7P_{\mathrm{host}}=33.7M, D=384D=384, M=4M=4, r=4r=4, 5.25% overhead) and a 314.6K-parameter head for Qwen3-VL-4B (Phost=4.0P_{\mathrm{host}}=4.0B, D=2560D=2560, M=4M=4, r=4r=4, 7.86% overhead).

Inference and Deployment. At inference, FRM is inserted at its trained tap. The frozen encoder produces degraded features, FRM recovers pristine-aligned features, and the corrected features continue through the unchanged downstream pipeline. FRM weights are tied to a specific (encoder, tap, feature space) configuration, so each new host requires a separately trained module.

Experiments

Experimental setup. We evaluate on the scene-level and object-level TRACE subsets from Sec. 3. Degraded-object detection uses the synthetic scene-level test set, while the four object-level tasks use held-out degraded trajectories over L0–L4, with a separate 500-crop real post-fire evaluation in Table 5. Tasks and metrics follow Table 1, with prompts, normalization rules, and exact score computations specified in Appendix C. For detection, we compare FRM against RF-DETR fine-tuning, RF-DETR domain adaptation (SFA [47], DATR [9]), and pixel-restoration preprocessors before frozen RF-DETR, including WildIR [26] and Restormer [51] fine-tuned on TRACE. We also evaluate pixel restoration before frozen VLMs: Restormer for degraded-to-pristine gallery retrieval and WildIR for open-ended pristine-state object recovery. All trainable baselines use the TRACE training split; hosts remain frozen unless marked as fine-tuned. For feature-space alignment, we evaluate frozen CLIP ViT-L/14 and SigLIP2 encoders. For VLM tasks, the baseline is the frozen host on degraded inputs, and the pristine ceiling is the same host on pristine inputs. We evaluate five frozen VLM hosts, Qwen3-VL-4B, Qwen2.5-VL-3B, InternVL3.5-4B, Molmo2-4B, and LLaVA-OneVision-1.5-4B, using deterministic decoding and identical prompts, parsers, normalization rules, and scoring scripts with and without FRM. All experiments are run on NVIDIA A100 GPUs.

ConfigurationCos.↓\downarrowID↑\uparrowR@1↑\uparrow
Ablation 1: Loss formulation, Qwen3-VL post-merger
No FRM0.26032.6974.55
LN-MSE0.03036.4757.83
MSE only0.02736.8183.17
Huber + LcosL_{\mathrm{cos}}0.02637.0884.63
MSE + 0.1Lcos0.1L_{\mathrm{cos}}0.02537.3185.28
Ablation 2: Cosine weight λ\lambda, MSE+λLcos\lambda L_{\mathrm{cos}}
No FRM0.26032.6974.55
λ=0.01\lambda= 0.010.02636.9484.12
λ=0.10\lambda= 0.100.02537.3185.28
λ=0.50\lambda= 0.500.02437.1484.37
λ=1.00\lambda= 1.000.02736.5482.76
Real cropsBase+FRMΔ\Delta
Ablation 3: Real-crop transfer, Qwen3-VL
L2-L4 average:
Retrieval R@149.1653.03+3.87
Material F125.3129.98+4.67
Description gen.27.4732.53+5.06
Functional reasoning29.3133.80+4.49
L4 only:
Retrieval R@143.2846.03+2.75
Material F122.4726.88+4.41
Description gen.24.9327.84+2.91
Functional reasoning26.8430.63+3.79

Table 5. Ablations. We ablate the recovery loss, cosine weight, and real-crop transfer. Metrics are cosine distance to pristine, identity accuracy, and retrieval R@1. Additional FRM ablations are provided in Appendix G.

Degraded-Object Detection and Feature-Space Recovery

Detection on TRACE scenes. Table 2 compares adaptation paradigms on the scene-level test set, with severity trends shown in Figure 4. FRM improves the frozen RF-DETR by 30.8% and adds a further 13.1% on top of the fine-tuned host while preserving pristine performance within 0.001 mAP. The additive gain indicates that fine-tuning and FRM address different failure modes. Fine-tuning broadens the encoder’s input distribution to include degraded images, while FRM corrects residual feature misalignment that persists after fine-tuning. Statistics-only domain adaptation methods, including SFA and DATR, underperform the frozen baseline, confirming that marginal feature alignment is insufficient when degradation produces structured, per-instance drift requiring paired correction. Pixel restoration is insufficient for this setting. Restormer gives only a small detection gain (0.338→0.375 mAP), while WildIR reduces RF-DETR performance to 0.266 mAP. WildIR also yields low pristine-state object classification accuracy with frozen VLMs (0.364 on Qwen3-VL and 0.225 on InternVL3.5), suggesting that visually restoring local image quality does not reliably recover the pre-degradation identity cues needed for recognition.

ParadigmMethodScore↑\uparrow
Degraded-object detection, mAP@0.5:0.95[email protected]:0.95
No adapt.Base RF-DETR [35]0.338
PRRestormer [51] + RF-DETR0.375
PRWildIR [26] + RF-DETR0.266
DASFA [47]0.161
DADATR [9]0.293
FRBase + FRM0.442
Full FTRF-DETR FT0.572
FT + FRRF-DETR FT + FRM0.647
Pristine-State Recovery, top-1 accuracy (%)
PRWildIR [26] + Qwen3-VL36.44
PRWildIR + InternVL3.522.57
Degraded-to-pristine retrieval, R@1R@1
PRRestormer + Qwen3-VL74.55
FRQwen3-VL + FRM85.28
PRRestormer + LLaVA-OV-1.580.97
FRLLaVA-OV-1.5 + FRM86.09

Table 2. Baselines and adaptation paradigms. Detection reports COCO-mapped mAP, classification reports mapped VLM top-1 accuracy, and retrieval reports degraded-to-pristine R@1R@1. FT = fine-tune, DA = domain adaptation, FR = feature recovery, PR = pixel restoration.

Figure 4. RF-DETR detection across severity. FRM improves both frozen and fine-tuned RF-DETR.

Feature-space recovery generalizes across encoder families. To isolate feature-space recovery from detector-specific confounds, we apply the same FRM recipe to frozen CLIP and SigLIP2 features (Table 3). Despite different pretraining objectives, contrastive for CLIP and sigmoid contrastive for SigLIP2, FRM consistently moves degraded features toward paired pristine targets. It reduces MSE by 30.3% on CLIP and 43.4% on SigLIP2, with corresponding cosine similarity gains of +0.095 and +0.138. The effect carries through to pristine-state retrieval, where FRM improves SigLIP2 degraded-to-pristine Top-1 by +14.8 points and Top-5 by +18.9 points, with Top-5 nearly reaching the pristine-query ceiling of 100%. These gains support the view that fire-induced degradation produces structured displacement on the feature manifold across encoder families.

EncoderMSE↓\downarrowCos.↑\uparrowR@1R@1↑\uparrowR@5R@5↑\uparrow
CLIP ViT-L/14 [30]0.6719 → 0.46860.6537 → 0.7492--
SigLIP2 [43]2.4172 → 1.36930.6045 → 0.742124.2 → 39.077.3 → 96.2

Table 3. Frozen encoder feature recovery. Degraded-to-pristine recovery on object-level test set (Base → + FRM).

Pristine-State Recovery in VLMs

Retrieval gains concentrate at higher severity. FRM improves degraded-to-pristine Recall@1 across all evaluated VLM hosts (Table 4, Figure 5; full per-level results in Table 8). Averaged across hosts, retrieval gains are nearly flat at mild degradation (+0.73 points over L0-L1) but rise sharply at higher severity (+14.66 points over L2-L4). This pattern argues against a fixed correction bias and is consistent with FRM correcting feature displacement that grows with physical degradation. The gains are larger for weaker retrieval baselines and smaller for stronger ones, suggesting that FRM recovers pristine-state signal that weaker encoders lose while stronger encoders partially retain it without correction.

Per-level Qwen3-VL pristine-state recovery across severity levels L0-L4

Figure 5. Per-level Qwen3-VL pristine-state recovery. Baseline is shown in light color and FRM in dark color across L0-L4. Columns report pristine-state retrieval R@1, original material recovery F1, pristine-description score, and functional-reasoning mean F1. FRM gains are strongest at higher severity.

ModelBase+FRMΔ\Delta
Task: Pristine-state retrieval (R@1)
Qwen3-VL74.5585.28+10.73
Qwen2.5-VL60.2072.03+11.83
InternVL3.559.0974.92+15.83
Molmo285.0690.00+4.94
LLaVA-OV-1.583.9786.09+2.12
Task: Original material recovery (micro-F1)
Qwen3-VL36.0039.24+3.24
Qwen2.5-VL30.5036.78+6.28
InternVL3.526.1035.91+9.81
Molmo223.5627.52+3.96
LLaVA-OV-1.522.3126.89+4.58
Task: Pristine description generation (description score)
Qwen3-VL41.6745.15+3.48
Qwen2.5-VL40.5044.00+3.50
InternVL3.527.0135.42+8.41
Molmo233.8038.13+4.33
LLaVA-OV-1.535.4839.34+3.86
Task: Functional reasoning (mean micro-F1)
Qwen3-VL41.0246.96+5.94
Qwen2.5-VL38.1143.62+5.51
InternVL3.536.1340.48+4.35
Molmo242.6447.95+5.31
LLaVA-OV-1.539.7643.07+3.31

Table 4. VLM task performance across five frozen hosts. Base is mean performance of frozen VLM over L0-L4; Δ\Delta is the gain from FRM. Metrics are reported on a 0-100 scale, with per-level results in Appendix E.

ModelMean BaseMean +FRMMean Δ\DeltaΔ\DeltaL0Δ\DeltaL1Δ\DeltaL2Δ\DeltaL3Δ\DeltaL4
Pristine-state retrieval (R@1R@1)
Qwen3-VL74.5585.28+10.73−1.06+0.36+24.88+16.88+12.58
Qwen2.5-VL60.2072.03+11.83+0.90+4.36+17.33+19.78+16.78
InternVL3.559.0974.92+15.83−0.83+8.46+22.18+23.84+25.48
Molmo285.0690.00+4.94−3.07+0.00+5.00+10.23+12.53
LLaVA-OV-1.583.9786.09+2.12−0.77−1.09−1.54+8.85+5.15
Original material recovery (F1)
Qwen3-VL36.0039.24+3.24−0.13+1.39+2.19+5.22+7.53
Qwen2.5-VL30.5036.78+6.28+0.93+4.29+6.50+8.50+10.90
InternVL3.526.1035.91+9.81+6.06+9.70+9.79+11.14+12.39
Molmo223.5627.52+3.96+0.20+0.93+3.66+7.64+7.37
LLaVA-OV-1.522.3126.89+4.58−1.77−1.54+13.85+6.15+6.20
Pristine description generation (score)
Qwen3-VL41.6745.15+3.48−1.83+4.40+1.86+4.95+8.01
Qwen2.5-VL40.5044.00+3.50+1.43+3.45+2.00+4.87+6.90
InternVL3.527.0135.42+8.41+6.55+6.73+6.64+10.83+11.32
Molmo233.8038.13+4.33−0.37−0.87+4.91+11.24+6.72
LLaVA-OV-1.535.4839.34+3.86−3.83+1.70+5.41+8.93+7.09
Functional reasoning (mean F1)
Qwen3-VL41.0246.96+5.94+0.96+6.59+7.30+4.88+9.93
Qwen2.5-VL38.1143.62+5.51+1.12+5.60+4.68+7.70+8.45
InternVL3.536.1340.48+4.35+1.30+3.92+5.78+4.95+5.80
Molmo242.6447.95+5.31−0.36+4.67+3.12+9.11+10.01
LLaVA-OV-1.539.7643.07+3.31−1.40+0.29+3.33+6.60+8.27

Table 8. Per-level VLM pristine-state recovery. All scores are on a 0-100 scale. Mean Base and Mean +FRM report the average score over L0-L4. Mean Δ\Delta is the average improvement, while Δ\DeltaL0-Δ\DeltaL4 report per-level changes from adding FRM to the frozen host. Gains are strongest at L2-L4, while L0-L1 can show smaller gains, matched performance, or occasional drops.

Lower baseline performance leaves more room for recovery. The largest absolute gains on original material recovery and pristine description generation occur on InternVL3.5 (Table 4), which has the weakest degraded-input baseline on these tasks (material +9.81 points, description generation +8.41 points). FRM’s benefit is better explained by degradation sensitivity than by model capacity. It helps most when the frozen host loses more pristine-state information under physical transformation. Operationally, this suggests that FRM is most valuable for host-task pairs with large degradation-induced performance drops.

Pristine alignment transfers to functional reasoning. FRM improves the functional reasoning combined score on every host (Table 4), with a mean aggregate gain of +4.9 points across VLMs and larger gains at severe degradation levels (average +7.6 at L3-L4, Figure 5). FRM is trained only on paired features with no per-image task label, yet recovered features support reasoning about pre-degradation function and restoration needs. This suggests that the frozen language models already encode object-function knowledge, and FRM restores the visual evidence needed to invoke it. Without FRM, models often fall back to coarse functional guesses such as “seating,” or “container,” which can partially match broad tags without recovering the specific object. The high-severity gains suggest FRM recovers object-specific function rather than improving generic guessing.

Ablations

We ablate the recovery loss and test real-crop transfer under moderate and severe degradation, where FRM is most useful (Table 5, with additional ablations in Appendix G and Table 9). i. Loss formulation. All loss ablations use the Qwen3-VL post-merger tap. LN-MSE reduces cosine distance but drops retrieval below the no-FRM baseline, showing that cosine distance alone is not sufficient and that token magnitude matters for pooled retrieval. MSE alone restores retrieval, while MSE+Lcos⁡\mathcal{L}_{\cos} gives the best tradeoff across cosine distance, identity accuracy, and R@1R@1. Huber+Lcos⁡\mathcal{L}_{\cos} is close but does not exceed it, suggesting that the quadratic penalty on large deviations helps severe degradation tokens. ii. Cosine weight. R@1R@1 peaks at λ=0.1\lambda= 0.1 and changes smoothly around it. Although λ=0.5\lambda= 0.5 gives the lowest cosine distance, λ=0.1\lambda= 0.1 gives the best identity accuracy and retrieval. Across λ∈{0.01,0.1,0.5}\lambda\in\{0.01, 0.1, 0.5\}, R@1R@1 varies by only 1.16 points, so the joint loss is robust to the exact weight in this range. We use MSE+0.1Lcos⁡\mathcal{L}_{\cos} throughout. iii. Real-crop transfer. We evaluate Qwen3-VL on 500 real post-fire crops from classes present in TRACE at L2-L4, since real post-fire imagery is concentrated in moderate to severe damage and contains few reliable L0-L1 analogs. FRM improves every real-crop task on average and remains positive at L4, where near-total destruction leaves less recoverable evidence.

Conclusion & Discussion

Conclusion. We introduced TRACE, a transformation-aware benchmark for post-fire object understanding, comprising 21.4K real-image-grounded synthetic scenes and object-level pristine-to-degraded trajectories spanning 499 object identities across 189 categories. We also introduced Feature Recovery Module (FRM), a plug-and-play residual module that maps degraded features toward their pristine counterparts in a frozen feature space, enabling downstream models to reason about damaged objects in terms of their pre-degradation state. Across eight frozen hosts spanning RF-DETR, CLIP, SigLIP2, and five VLMs, FRM improves every task, with gains that concentrate at higher degradation severity, yielding 9.0–30.8% relative improvement across detection, retrieval, and reasoning. Unlike prior robustness work that targets image-quality degradation or distributional shift, TRACE and FRM address irreversible physical transformations where the object itself has changed material state, lost parts, or retained only partial structural evidence. This positions the framework as a step toward real-world post-fire applications, from identifying hazardous objects during emergency response to inventorying destroyed property for insurance claims and reconstructing pre-incident scene contents for investigation.

Limitations and Future Directions. The recovery direction is task-dependent: FRM recovers pristine-aligned features, which improves queries about original identity, materials, function, and restoration, but removes exactly the damage signal needed for queries about current state (e.g., “describe the fire damage”). FRM should be disabled for such queries, and a query-aware gating mechanism would allow a single host to serve both pristine-state and damage-state queries. The module is also tied to a specific (encoder, tap, feature space) configuration, so each new host requires a separately trained module. Adding a new object identity requires paired supervision from a pristine visual anchor and at least three degraded observations across severity levels; relaxing this requirement is an open direction. Real-crop gains remain positive but smaller than synthetic gains, reflecting residual synthetic-to-real gaps from generative-model limits, approximate real-image severity labels, cluttered post-fire conditions, and material failure modes not fully captured by generation. Finally, identity recovery is only one of the cues humans use under severe degradation: room layout, neighboring objects, and surviving structural parts all carry information that FRM currently ignores. Incorporating spatial context and part-level understanding is a natural next step, as is extending the paired-supervision recipe to other irreversible transformations such as flood damage, structural collapse, and weathering, wherever pre-event visual references exist.

Impact Statement. This work targets visual recognition under irreversible physical degradation, with applications in emergency response, forensic investigation, and insurance assessment. Reliable detection and identification of objects in post-fire environments could support firefighters in locating hazardous items in collapsed structures, assist investigators in reconstructing pre-incident scene contents, and reduce the manual effort required to inventory damaged property after disasters. Releasing TRACE and the FRM training pipeline lowers the barrier for further research on degraded-object understanding, including extensions to other irreversible transformations such as flood damage and weathering. The deployment risks are largely shared with general-purpose object recognition. Pristine-state predictions are inferences from incomplete physical evidence and can be wrong, particularly at high severity; using them as evidence in legal or insurance contexts requires uncertainty quantification and human oversight that this work does not provide. The benchmark consists of synthetic scenes grounded in real post-fire imagery; while we filter for realism, distributional gaps to specific deployment environments remain, and downstream users should validate on in-domain data before operational use. We are not aware of dual-use concerns specific to this work.

Appendix

The appendix is organized as follows:

  • Appendix A reports dataset statistics for the object-level and scene-level.

  • Appendix B describes the object and scene generation pipeline, including prompts, real-image grounding, and filtering.

  • Appendix C provides the evaluation prompts and scoring protocols for all tasks.

  • Appendix D details FRM instantiations across VLM and frozen-encoder hosts.

  • Appendix E reports full per-level VLM results and frozen-encoder recovery results.

  • Appendix G provides additional ablations on capacity, integration, and tap-point selection.

Dataset Statistics

This appendix summarizes the subset statistics, object and scene coverage, and degradation diagnostics for TRACE. Detailed generation prompts, grounding-judge criteria, and filtering protocol are provided in Appendix B.

Subset Statistics

Figures 6 and 7 summarize object-level and scene-level coverage. Figure 8 contrasts standard image corruptions with physical transformation. Figure 9 shows the effect of real-image grounding and VLM filtering.

Figure 6. Object inventory statistics. The object inventory spans 499 object identities, 189 object types, and 11 normalized material classes. Materials are long-tailed, with plastic, metal, fabric/textile, and wood most represented.

Degradation Severity Metadata

Each object trajectory is annotated with approximate severity metadata for soot coverage, surface or material failure, deformation, and structural integrity. These ranges guide generation and support severity-stratified evaluation. Each object trajectory is annotated with approximate severity metadata for soot coverage, surface or material failure, deformation, and structural integrity (Table 6).

MetricL0L1L2L3L4
Soot coverage (%)30-4545-6060-7572-8787-96
Surface/material failure (%)30-5030-4525-4040-6060-80
Deformation (%)5-1515-3035-5555-7575-92
Structural integrity (%)85-9565-8240-5815-354-13

Table 6. Degradation severity metrics by level. Approximate ranges used as object-level generation metadata across the five degradation levels.

Bar chart showing TRACE scene coverage across real-world, residential, outdoor, work/institutional, and commercial environments

Figure 7. TRACE scene coverage. TRACE contains 21,400 accepted synthetic post-fire scenes grounded by approximately 700 real post-fire reference images. Scenes span residential, outdoor, work/institutional, and commercial environments.

Comparison of pristine objects, standard image corruption, and object degradation

Figure 8. Physical transformation is not image corruption. Standard corruptions alter image appearance while preserving object state. Post-fire degradation changes material and structure, requiring recovery of pre-degradation identity and properties.

Annotation Summary

Object-level metadata includes part-level material composition, object-specific failure notes, and per-level degradation descriptions. Scene-level metadata includes bounding boxes, mapped object labels, visible materials, degradation states, scene captions, and generation metadata. Intended object and material inventories from the generation prompt are stored as metadata and are not used as ground truth for evaluation.

Generation Prompts and Filtering

This appendix provides the prompt templates used to generate the scene-level and object-level subsets of TRACE. All generation uses Gemini 3 Pro Image for image synthesis and Gemini 3 Flash as the grounding judge.

{
  "object": "dresser",
  "scene_category": "bedroom",
  "trajectory": "1 pristine + 5 degraded states",
  "split_unit": "object identity",
  "degradation_levels": ["L0", "L1", "L2", "L3", "L4"]
}
Effectiveness of the scene-generation pipeline, showing pipeline-grounded and prompt-only generations

Figure 9. Effectiveness of the scene-generation pipeline. Both rows use Gemini 3 Pro Image as the generator. The top row shows scenes produced by our pipeline, which conditions generation on 2-4 real post-fire reference images and applies a VLM judge for accept/reject filtering. The bottom row uses the same scene prompts but removes real-image grounding and judge-based filtering. Reference grounding and filtering improve scene realism, object grounding, and post-fire plausibility.

{
  "part_materials": [
    {"part": "top surface", "material": "MDF or hardwood with veneer"},
    {"part": "body panels", "material": "MDF laminate or hardwood"},
    {"part": "drawer fronts", "material": "MDF or hardwood"},
    {"part": "drawer boxes", "material": "MDF or plywood"},
    {"part": "drawer runners", "material": "steel slides"},
    {"part": "drawer pulls", "material": "brass, zinc alloy, or ABS plastic"},
    {"part": "base plinth", "material": "hardwood or MDF"},
    {"part": "back panel", "material": "thin MDF or hardboard"},
    {"part": "finish coating", "material": "polyurethane lacquer or paint"}
  ]
}

{
  "material_failure_notes": {
    "wood_MDF": "finish blisters and peels; MDF chars, swells, and crumbles",
    "hardware": "steel drawer slides and metal pulls survive longest",
    "late_stage": "dresser collapses into a charred structure with surviving hardware"
  }
}
{
  "severity_ladder": {
    "L0": "heavy soot, finish blistering, early surface char, structure intact",
    "L1": "deep surface char, cracking, stronger heat damage",
    "L2": "burn-through in weaker members, exposed hardware, partial failure",
    "L3": "collapsing charred skeleton with surviving metal components",
    "L4": "near-total destruction with weak identity cues in hardware and debris"
  }
}

Object-Level Generation

Each object trajectory is generated iteratively. The pristine image is generated first from a text-only prompt, and each subsequent degradation stage (L0-L4) is conditioned on the previous stage’s image. This ensures cumulative, physically grounded damage progression.

Pristine prompt. The pristine stage uses a studio product-photo prompt with explicit part-level material specifications and variant identity constraints to ensure distinct physical instances across variants of the same category.

Pristine Prompt Template

Single-object studio product photograph of a {obj}.
This exact object instance must be: {variant_style}.
Design language: {variant_manufacturing}.
Color / finish direction: {variant_colorway}.
The object is centered, fills roughly 70 percent of the frame, fully visible, isolated on a pure white seamless background. Soft even studio lighting, sharp focus, realistic shadows only under the object, no stylization, no watermark, no text overlay.
Exact part-level construction that must be visible:
{part_materials}
Hard constraints:
• Keep the object in a canonical product-photo orientation.
• Keep background unchanged across all stages.
• Do not add hands, props, shelves, tables, walls, flames, smoke clouds, or extra objects.
• Show realistic material texture and manufacturing details.
• This image must depict a DIFFERENT real-world variant than other versions of the same object category, not merely a recolor.
• The silhouette, proportions, detailing, and subtype cues should clearly distinguish this instance from sibling variants.

Degradation stage prompt. Each degradation stage is conditioned on the previous stage’s image and includes material-specific failure behavior, stage-level severity metrics, and strict constraints ensuring cumulative and spatially uneven damage.

Degradation Stage Prompt Template

Generate the next degradation image for a {obj} at stage {stage_level} using the provided reference image(s) as the SAME physical object instance.
{variant_identity_block}
{consistency_constraints}
{global_realism_rules}
Exact part-level construction that must remain physically grounded:
{part_materials}
Material-specific failure behavior that MUST be obeyed per part:
{material_behavior}
Object-specific failure notes:
{object_specific_failure_notes}
Stage description - THIS IS THE TARGET STATE:
{stage_description}

Critical image constraints:

  • Make stage {stage_level} CLEARLY and DRAMATICALLY different from the previous stage.

  • Every visible surface must show fire exposure - no pristine areas anywhere.

  • Keep the white studio background unchanged.

  • Do not add flames, smoke plumes, sparks, people, tables, or debris outside the object footprint.

  • Damage must be spatially uneven and material-aware - not a uniform dark overlay.

Consistency and realism constraints. The following constraints are injected into every degradation stage prompt to enforce material-aware failure behavior.

Material Failure and Realism Rules

Material-specific failure rates: Paper and cardboard. Among the first materials to fail. Curl and brown at edges, then char progressively inward. Thin sheets fragment into ash flakes. Cardboard delaminates at glue seams before charring. Final state is gray-white ash with occasional partially-surviving fragments in shielded regions.

Fabric and textile. Synthetic fabrics (polyester, nylon) melt, shrink, and fuse into hard irregular beads or films. Natural fabrics (cotton, linen) char and disintegrate into fragile ash. Blended fabrics show both behaviors simultaneously. Seams and hems often survive longer than flat panels. Collapse follows loss of structural fiber integrity.

Foam and padding. Melts, shrinks, and collapses rapidly. Exposed foam recedes from edges inward, leaving skeletal frames or springs visible underneath. Polyurethane foam produces sticky, re-solidified residue. Memory foam chars into brittle black mass.

Leather. Shrinks dramatically (up to 50% area loss), curls at edges, and develops deep surface cracking. Grain pattern distorts but remains partially visible. Blackens progressively from tan to dark brown to black. Does not melt or produce liquid residue.

Wood and MDF. Surface scorches first, producing alligator-skin char patterns. Deeper charring follows with visible char depth increasing per stage. MDF delaminates at adhesive layers. Structural wood cracks along grain lines. Final stages show brittle, crumbling charcoal with ash accumulation at the base.

Plastics (ABS, polycarbonate, polypropylene, PVC). Soften and deform at relatively low temperatures. ABS blisters and warps. Polycarbonate yellows, then browns, then deforms. Polypropylene melts and pools into irregular puddles. PVC blackens and becomes brittle. Re-solidified plastic forms irregular lumpy masses with frozen drip patterns. Thin-walled plastic containers collapse inward.

Rubber and silicone. Blacken and shrink. Rubber hardens and cracks into segments. Silicone maintains shape longer but eventually chars and crumbles. Tire-like rubber develops deep fissures before fragmenting. Rubber coatings on handles and grips peel and curl away from underlying metal or plastic.

Metal (steel, aluminum, copper, iron). Most durable common material. Steel heat-tints through straw, blue, and purple before developing surface oxide scale. Aluminum softens, sags, and can partially melt at extreme temperatures, losing structural rigidity. Copper and brass develop heavy green-black oxidation. Iron rusts rapidly in post-fire moisture. Thin sheet metal warps and buckles. Fasteners (screws, hinges) often survive intact and become identifying features. Metal does not become ash.

Glass. Shatters from thermal shock (rapid heating or cooling with water). Tempered glass produces small granular fragments. Plate glass cracks in radiating patterns before falling out of frames. At extreme temperatures, glass may soften and slump but does not melt into liquid. Soot deposits on surviving glass surfaces.

Ceramic and stone. Ceramic glazes craze (develop fine crack networks) and may spall. Unglazed ceramic and stone crack under thermal stress but maintain overall form. Neither material melts. Porcelain can shatter from thermal shock. Stone surfaces accumulate soot and may show heat-induced color changes (reddening of limestone, darkening of granite).

Electronics and composite materials. PCBs char and delaminate, exposing copper traces. Solder melts and beads on surfaces. LCD and LED screens crack and blacken. Battery cells swell, rupture, and may leave chemical residue. Wire insulation melts away, exposing bare copper conductors. Integrated circuits and ceramic chip packages may survive as identifiable components.

Gemstones. Diamond, sapphire, ruby, and similar crystalline stones survive fire temperatures and remain as intact loose stones among debris. Settings (typically metal) may deform or melt around them. Softer stones (opal, turquoise) may crack or discolor.

Failure rate ordering (earliest to latest): Paper and cardboard → thin fabric and foam → thick fabric and leather → wood and MDF → plastic and rubber → glass → ceramic and stone → metal → gemstones. Stage consistency: Damage must accumulate from the previous stage only. Each new stage must be clearly and dramatically worse. Viewpoint, framing, scale, and orientation are preserved until physical collapse makes it impossible. Do not invent parts not present in the pristine image. Different materials on the same object must fail at different rates, so a single object at intermediate stages will show a mix of material states (e.g., fabric seat cover charred while the metal frame beneath shows only heat-tinting).

Degradation stage definitions. Each object trajectory progresses through five degradation stages (L0-L4). The following definitions specify the target physical state at each stage and are injected into the stage prompt as {stage_description}.

Degradation Stage Definitions

L0 - Mild surface damage. Early-stage fire exposure. Light soot deposits on exposed surfaces. Minor discoloration or browning of heat-sensitive materials (paper, thin fabric). Plastic surfaces may show slight warping or surface bubbling. Metal shows no visible change or faint heat tinting. Object silhouette, proportions, and all parts remain fully intact. The object is immediately recognizable.

L1 - Moderate surface damage. Sustained heat exposure across all surfaces. Paper and thin fabric are partially charred or missing. Plastic shows visible warping, bubbling, or early melting. Wood surfaces show surface scorching and early char patterns. Metal begins to show heat-tint discoloration. Leather shrinks slightly and darkens. Foam begins to recede from edges. Object silhouette remains intact but surface appearance has changed substantially. Recognition requires attention to shape and remaining material cues.

L2 - Structural onset. Fire has begun to compromise structural integrity of weaker materials. Fabric and foam are largely gone or reduced to residue, exposing internal frames and components. Plastic has melted and re-solidified into deformed masses. Wood shows deep charring with visible char depth and cracking along grain. Rubber has hardened and cracked. Metal shows moderate oxidation and early warping of thin sections. Some parts may have detached or collapsed. Object is still recognizable from overall shape but individual material surfaces are heavily altered.

L3 - Severe degradation. Major structural failure of non-metallic materials. Wood is deeply charred and crumbling. Plastic has pooled or fused to other surfaces. Fabric, paper, foam, and leather are largely absent. Glass is shattered or missing. Metal components show heavy oxidation, soot coverage, and warping. Significant parts of the object may have collapsed, detached, or disintegrated. Object identity is recoverable primarily from surviving metal skeleton, overall proportions, and spatial arrangement of remaining components.

L4 - Near-total destruction. Approaching complete loss of original form. Non-metallic materials are reduced to ash, charred rubble, or re-solidified residue. Metal components are heavily deformed, oxidized, and may have partially melted (aluminum) or collapsed. Object silhouette is barely recognizable or unrecognizable without context. Identification requires expert-level inference from surviving fragments, hardware, and spatial cues. Some objects at this stage consist primarily of a debris pile with identifiable metal remnants.

Scene-Level Generation

Each scene is generated from a structured prompt conditioned on two to five real post-fire reference photographs. The prompt specifies scene type, damage level, material profile, clutter level, lighting, and socioeconomic band, with explicit instructions that references serve only as inspiration for realism and material fidelity.

Scene Generation Prompt Template (abbreviated)

You are generating a completely NEW, original real-world post-fire scene. The reference images are ONLY for inspiration about realism, material degradation fidelity, structural damage realism, and scene complexity. Do NOT copy, recreate, or closely match any specific layout, room geometry, viewpoint, object arrangement, composition, or damage pattern from the references. The generated scene must differ significantly in geometry, camera angle, and object placement from all references.

Generate a realistic {scene_type} after a fire incident. The image should be novel, physically grounded, hyper-realistic, and clearly distinct from the references.

TARGET SCENE CONTROL:

  • Scene type: {scene_type}

  • Damage level: {damage_level}

  • Material profile: {material_profile}

  • Clutter level: {clutter_level}

  • Lighting mode: {lighting}

  • Socioeconomic / aesthetic band: {wealth_style}

  • Layout style: {layout_variant}

PHYSICAL AND MATERIAL ACCURACY (CRITICAL): All visible materials must degrade according to real-world fire behavior.

  • Wood: charred, cracked, structurally weakened, sometimes partially collapsed. Load-bearing beams may sag or fracture. Exposed grain shows deep alligator-pattern charring. Ash accumulates at the base of vertical wooden surfaces.

  • Plastic: melted, warped, deformed, softened, pooled, or fused to adjacent surfaces. Thin-walled containers collapse inward. Re-solidified plastic forms irregular lumpy masses with frozen drip patterns on floors and shelving below.

  • Fabric and upholstery: burned away unevenly, collapsed, torn, or reduced to residue. Synthetic fabrics melt and fuse into hard beads or films. Natural fabrics char and fragment. Springs and frames become exposed as covering material fails.

  • Foam and padding: melted, collapsed, shrunken, missing in sections, or exposed beneath charred fabric. Polyurethane foam produces sticky re-solidified residue. Mattresses and cushions show deep cavities where foam has receded.

  • Metal: structurally present but heat-discolored, oxidized, soot-covered, or slightly warped. Steel shows straw-to-blue heat tinting. Aluminum may sag or partially melt. Thin sheet metal (appliance panels, ductwork) buckles and warps. Fasteners, hinges, and handles often survive intact.

  • Glass: shattered, fractured, partially missing, or heat-cracked. Window frames may retain jagged fragments. Tempered glass produces granular piles on the floor below. Mirrors crack in radiating patterns. Soot deposits on surviving glass surfaces.

  • Paper and cardboard: curled, charred, blackened, fragmented, reduced to ash, or partially surviving in shielded regions such as inside drawers or behind other objects.

  • Rubber: warped, softened, heat-damaged, partly melted, or degraded at edges. Cable insulation melts away exposing wire conductors. Rubber seals and gaskets shrink and crack.

  • Concrete, tile, and masonry: scorching, cracking, soot staining, and spalling where surfaces faced direct heat. Grout may crack and crumble. Floor tiles may lift or shatter from thermal expansion. Concrete walls show smoke staining gradients that indicate fire direction and intensity.

  • Insulation and ceiling materials: exposed fiberglass or mineral wool sags and discolors. Ceiling tiles collapse or hang partially detached. Drywall paper facing chars while the gypsum core remains as crumbling white residue.

SPATIAL DAMAGE CONSISTENCY:

  • Fire damage must be uneven and spatially coherent, with heavier damage near the likely fire origin and fading outward.

  • Upper surfaces, ceilings, and the tops of walls show heavier soot accumulation and heat damage than lower surfaces (hot gas layer rises).

  • Visible soot gradients and runoff streaking on vertical surfaces.

  • V-patterns and inverted-cone burn patterns on walls indicate upward fire spread from point sources.

  • Floors show debris accumulation from collapsed shelving, ceiling, and wall-mounted objects.

  • Adjacent rooms or hallways visible through doorways should show diminishing damage with distance from the fire origin.

SECONDARY EFFECTS:

  • Realistic firefighting residue including white or gray extinguisher powder and water pooling or streaking on floors.

  • Some surfaces may appear damp, washed, or partially streaked from hose water.

  • Debris, ash, and fragmented material accumulate naturally around collapse points, along walls, and at the base of furniture.

  • Electrical wiring may be exposed where wall or ceiling coverings have burned away.

  • Smoke detectors, light fixtures, and ceiling-mounted objects may hang partially detached.

OBJECT DISTRIBUTION:

  • Scene should feel asymmetric, naturally disturbed, and realistic.

  • Include a mix of partially recognizable objects and heavily degraded objects.

  • No central hero object and no staged or overly clean composition.

  • Natural occlusion and layering should occur (objects partially buried under debris, leaning against walls, fallen from shelves).

  • At least 2-3 objects should be identifiable to a trained observer despite damage.

STRUCTURAL DETAILS:

  • Possible partial collapse of ceilings, shelving, partition walls, door frames, or built-in cabinetry.

  • Exposed structural elements (studs, joists, wiring, plumbing) where wall and ceiling coverings have failed.

  • Doors may be open, partially burned, or missing. Door hardware (knobs, hinges) typically survives.

  • Windows may be broken out by thermal shock or firefighting ventilation. Curtain rods may remain while curtain fabric is gone.

CAMERA STYLE: Realistic handheld or inspection-style photograph, approximately 24-35mm equivalent, natural framing imperfections, documentary-like realism. No cinematic grading or artistic stylization.

STRICT CONSTRAINTS: No flames, no active smoke or haze effects, no stylization, no painterly or artistic rendering, no cinematic grading, no unrealistic symmetry, no pristine clean areas unless physically justified (e.g., shielded by another object), no duplicated obvious objects or synthetic visual artifacts.

{scene_specific}

The output must be indistinguishable from a real-world post-fire documentation photo.

To reduce visual homogeneity, scene prompts vary scene type, damage level, material profile, clutter, lighting, socioeconomic style, and layout, and explicitly prohibit copying the reference layout or viewpoint.

Grounding Judge and Filtering

After generation, each scene candidate is scored by a Gemini 3 Flash vision-language judge that compares the candidate against its real-image references on a 0-1 grounding scale.

Grounding Judge Prompt

You are a grounding judge. Compare the candidate post-fire scene image against its reference real-world images. Score grounding on a 0 to 1 scale based on: (1) realism, (2) material and fire-physics fidelity, (3) structural damage plausibility, and (4) overall consistency with real-world post-fire visual characteristics while preserving novelty.

Return strict JSON only:

{"grounding_score": <float>, "reasoning": "<short>", "pass": <bool>}

Set pass = true only if grounding_score ≥0.7\ge0.7.

Candidates scoring below 0.7 are rejected. This filtering yields 21,400 accepted scenes from approximately 29,000 generated candidates, for an acceptance rate of 73.8%. The grounding score is not used as an evaluation label. It is used only to filter generated scenes for realism, material and fire-physics fidelity, structural damage plausibility, and consistency with the real post-fire reference set while preserving novelty. Object boxes and labels are then handled as annotations for the detection task rather than as outputs of the grounding judge.

Initial object annotations are produced automatically and then verified or corrected during dataset quality control. For annotation reliability, two authors independently assigned accept/reject labels on a stratified 300-object subset, yielding 93.4% agreement and Cohen’s κ=0.836\kappa= 0.836.

Initial bounding boxes are produced automatically and then visually verified or corrected by the authors before evaluation.

Evaluation Task Details

This appendix specifies the five evaluation tasks from Sec. 3, namely degraded-object detection, pristine-state recovery and retrieval, original material recovery, pristine description generation, and functional reasoning.

Degraded-Object Detection

Given a scene-level post-fire image, the model detects and localizes objects of interest. This task evaluates whether a detector can recover object remnants in cluttered, physically degraded scenes.

We evaluate RF-DETR outputs using class-aware COCO-mapped [email protected]:0.95, reported overall and separately by degradation level. A manually constructed lookup table maps TRACE object classes to the nearest COCO category for compatibility with COCO-pretrained detectors. Only boxes with unambiguous COCO mappings are included in mAP computation. The mapping covers 55 of the 80 COCO categories. The 55 mapped COCO categories cover the most common indoor object types (furniture, electronics, containers, appliances). Excluded categories are primarily TRACE-specific items without clear COCO counterparts (e.g., aerosol cans, gas cylinders, specific tool subtypes). The full mapping table is released with the evaluation code. A prediction is counted as correct only when it satisfies both localization and mapped-category correctness. Detection is evaluated on the scene-level subset and no natural-language prompt is used.

Pristine-State Recovery and Retrieval

Given a degraded object image, the goal is to recover its paired pristine state. We evaluate this task with two complementary protocols: feature-space alignment and gallery retrieval.

Feature-space alignment. For frozen encoder diagnostics, CLIP ViT-L/14 and SigLIP2 features are recovered toward paired pristine targets. Given degraded features zdz^{d} and paired pristine features zpz^{p}, FRM produces recovered features z~d\tilde{z}^{d}. We report mean squared error (MSE) and mean token cosine similarity between z~d\tilde{z}^{d} and zpz^{p}. Lower MSE and higher cosine similarity indicate stronger pristine alignment.

Gallery retrieval. For VLM retrieval, the model retrieves the corresponding pristine reference from a gallery of pristine objects. For consistency with the VLM setting, we use the following natural-language query:

Find the pristine object image in the gallery that corresponds to
this physically degraded object.

The prompt defines the retrieval intent, but scoring is performed in feature space: the model’s visual encoder extracts features for the degraded query and all pristine gallery images, and gallery images are ranked by cosine similarity. Each degraded query has exactly one paired pristine target. We report Recall@1 as the main gallery-retrieval metric.

Original Material Recovery

Given a degraded object image, the model predicts the object’s pre-degradation materials. The prompt is:

What were the main materials of this object before degradation?
Reply with a comma-separated list of single-word materials only (for
example: wood, steel, plastic). Do not describe the damage.

Ground-truth materials are parsed from the object’s part-level material annotations and mapped to the 11 normalized material classes in TRACE. Model responses are lowercased, stripped of punctuation, singularized, and mapped to the same material vocabulary using a fixed synonym table. Let YimatY_i^{\mathrm{mat}} and Y^imat\hat{Y}_i^{\mathrm{mat}} denote the ground-truth and predicted material sets for object ii. We compute micro-F1 across all objects and material labels:

Pmat=∑i∣Y^imat∩Yimat∣∑i∣Y^imat∣,Rmat=∑i∣Y^imat∩Yimat∣∑i∣Yimat∣,P_{\mathrm{mat}} = \frac{\sum_i \left|\hat{Y}_i^{\mathrm{mat}} \cap Y_i^{\mathrm{mat}}\right|}{\sum_i \left|\hat{Y}_i^{\mathrm{mat}}\right|}, \qquad R_{\mathrm{mat}} = \frac{\sum_i \left|\hat{Y}_i^{\mathrm{mat}} \cap Y_i^{\mathrm{mat}}\right|}{\sum_i \left|Y_i^{\mathrm{mat}}\right|},
F1mat=2PmatRmatPmat+RmatF1_{\mathrm{mat}} = \frac{2P_{\mathrm{mat}}R_{\mathrm{mat}}}{P_{\mathrm{mat}} + R_{\mathrm{mat}}}

If a model predicts no labels for a task, precision is set to zero; if the ground-truth set is empty, recall is set to zero. In our benchmark, ground-truth material and function sets are non-empty. We report 100⋅F1mat100 \cdot F1_{\mathrm{mat}}.

Pristine Description Generation

Given a degraded object image, the model generates a one-sentence description of the object’s pre-degradation state. The prompt is:

Describe what this object most likely was before it was damaged.
Mention its object type, main material(s), and intended use.  Do not
focus on the damage.  Answer in one concise sentence.

Ground-truth identity is taken from the object manifest, materials from the part-level annotations, and function from the canonical function tag assigned to the object category. Each generated sentence is parsed into three fields: object identity, materials, and function. Identity and function predictions are lowercased, stripped of punctuation and articles, singularized, and matched to the canonical category or function vocabulary using fixed synonym tables. Materials are normalized as in Appendix C.3.

For object ii, identity is scored as

Siid=1[y^iid=yiid].S_i^{\mathrm{id}} = \mathbb{1}[\hat{y}_i^{\mathrm{id}} = y_i^{\mathrm{id}}].

where yiidy_i^{\mathrm{id}} is the ground-truth object category and y^iid\hat{y}_i^{\mathrm{id}} is the normalized predicted category. Function is scored analogously:

Sifunc=1[y^ifunc=yifunc].S_i^{\mathrm{func}} = \mathbb{1}[\hat{y}_i^{\mathrm{func}} = y_i^{\mathrm{func}}].

Materials are scored using micro-F1 over the normalized material vocabulary, following Appendix C.3. The final pristine-description score is the unweighted mean of identity accuracy, material micro-F1, and function accuracy:

Sdesc=100⋅13(1N∑i=1NSiid+F1mat+1N∑i=1NSifunc).S_{\mathrm{desc}} = 100 \cdot\frac{1}{3}\left(\frac{1}{N}\sum_{i=1}^{N}S_i^{\mathrm{id}} + F1_{\mathrm{mat}} + \frac{1}{N}\sum_{i=1}^{N}S_i^{\mathrm{func}}\right).

When deterministic synonym normalization cannot resolve a paraphrase, we use a deterministic LLM equivalence judge as a fallback. The judge receives only the predicted phrase, the ground-truth label, and the relevant synonym policy, and returns a binary equivalent/not-equivalent decision. It is run with temperature 0.0 and is used only for unresolved identity and function paraphrases, not for material scoring.

The synonym table resolves 5,562/6,250 identity predictions (89.0%) and 5,312/6,250 function predictions (85.0%) without invoking the judge. The GPT-5 fallback is triggered for 688/6,250 identity evaluations (11.0%) and 938/6,250 function evaluations (15.0%), mainly for paraphrases such as “writing surface” for “desk.” Replacing the fallback with a strict no-match rule changes the aggregate description score by less than 0.8 points.

Functional Reasoning

Given a degraded object image, the model answers two structured questions about the object’s pre-degradation function and restoration needs without being told its category.

Prompt.

You are looking at an object that has been damaged in a fire.
Reason about what the object originally was and answer two questions
about its pre-damage identity and restoration potential.

FUNCTION: In one short phrase (5 words or fewer), what was this
object’s original function or primary use?

REPLACEMENTS: List the main materials that would be needed
to restore this object to working condition.  Reply as a
comma-separated list of single-word items.

Respond in this exact format with no extra text: FUNCTION: <your answer> REPLACEMENTS: <comma-separated list>

The prompt is identical across all hosts and across FRM-on/off conditions. All calls use temperature 0.0 and a maximum of 150 output tokens.

Ground truth. i. Function labels. We define 20 canonical function tags, such as seating, lighting, cooking_appliance, food_storage, general_storage, safety_equipment, and communication_device. Each object type in TRACE is mapped to one or two function tags. The mapping is constructed with LLM assistance and verified by the authors. The full mapping is released as supplementary material.

ii. Restoration-material labels. The canonical material set annotated for each object type serves as the ground-truth restoration-material set. This reuses existing material annotations and introduces no additional task-specific labels.

Scoring. The FUNCTION response is normalized by lowercasing, stripping punctuation, singularizing, and mapping to the fixed function-tag vocabulary using keyword and synonym rules. When this deterministic mapping is ambiguous, we use the same deterministic LLM fallback described in Appendix C.4. The judge receives the model response and the fixed function-tag vocabulary, and returns one or more canonical tags. It is not given the ground-truth tag. Let YifuncY_i^{\mathrm{func}} and Y^ifunc\hat{Y}_i^{\mathrm{func}} denote the ground-truth and predicted function-tag sets for object ii. Function performance is computed as micro-F1:

Pfunc=∑i∣Y^ifunc∩Yifunc∣∑i∣Y^ifunc∣,Rfunc=∑i∣Y^ifunc∩Yifunc∣∑i∣Yifunc∣P_{\mathrm{func}} = \frac{\sum_i \left\lvert\hat{Y}_i^{\mathrm{func}} \cap Y_i^{\mathrm{func}} \right\rvert}{\sum_i \left\lvert\hat{Y}_i^{\mathrm{func}} \right\rvert}, \qquad R_{\mathrm{func}} = \frac{\sum_i \left\lvert\hat{Y}_i^{\mathrm{func}} \cap Y_i^{\mathrm{func}} \right\rvert}{\sum_i \left\lvert Y_i^{\mathrm{func}} \right\rvert}
F1func=2PfuncRfuncPfunc+Rfunc.F1_{\mathrm{func}} = \frac{2P_{\mathrm{func}}R_{\mathrm{func}}}{P_{\mathrm{func}} + R_{\mathrm{func}}}.

The REPLACEMENTS response is parsed as a comma-separated material set and normalized to the same 11 material classes used for material recovery. Let YirestY_i^{\mathrm{rest}} and Y^irest\hat{Y}_i^{\mathrm{rest}} denote the ground-truth and predicted restoration-material sets. Restoration-material performance is computed as micro-F1:

Prest=∑i∣Y^irest∩Yirest∣∑i∣Y^irest∣,Rrest=∑i∣Y^irest∩Yirest∣∑i∣Yirest∣P_{\mathrm{rest}} = \frac{\sum_i \left\lvert\hat{Y}_i^{\mathrm{rest}} \cap Y_i^{\mathrm{rest}} \right\rvert}{\sum_i \left\lvert\hat{Y}_i^{\mathrm{rest}} \right\rvert}, \qquad R_{\mathrm{rest}} = \frac{\sum_i \left\lvert\hat{Y}_i^{\mathrm{rest}} \cap Y_i^{\mathrm{rest}} \right\rvert}{\sum_i \left\lvert Y_i^{\mathrm{rest}} \right\rvert}
F1rest=2PrestRrestPrest+Rrest.F1_{\mathrm{rest}} = \frac{2P_{\mathrm{rest}}R_{\mathrm{rest}}}{P_{\mathrm{rest}} + R_{\mathrm{rest}}}.

The final functional-reasoning score is the unweighted mean of function-tag micro-F1 and restoration-material micro-F1:

Sfunc=100⋅12(F1func+F1rest).S_{\mathrm{func}} = 100 \cdot\frac{1}{2}\left(F1_{\mathrm{func}} + F1_{\mathrm{rest}}\right).

If the denominator of precision or recall is zero, the corresponding value is set to zero.

Baseline artifact. At high severity, models sometimes default to coarse answers such as “container” or “furniture.” Such responses may partially match broad function tags even when the predicted object identity is underspecified. We therefore interpret functional-reasoning results together with pristine-description and retrieval performance. FRM’s high-severity gains, when accompanied by improved identity and material recovery, indicate more specific pre-degradation recovery rather than only coarse functional guessing.

FRM Implementation Details

This appendix details the host-specific tap points used to instantiate FRM. All hosts follow the same formulation from Sec. 4: degraded features and paired pristine targets are extracted at the same frozen feature interface, FRM maps zℓ∈RN×Dz^{\ell} \in\mathbb{R}^{N \times D} to z~ℓ\tilde{z}^{\ell}, and only FRM is trained. The token dimension DD is determined by the selected tap point, while NN is the number of visual tokens at that interface.

Table 7 reports the resulting FRM sizes for VLM and frozen-encoder hosts. Qwen3-VL, InternVL3.5, Molmo2, and LLaVA-OV-1.5 use D=2560D=2560 at their LLM-facing post-merger or post-projector interfaces, yielding 314.57M FRM parameters. CLIP and SigLIP2 use earlier pre-projection vision tokens, giving 50.33M and 28.31M FRM parameters respectively. We omit percentage overhead for CLIP and SigLIP2 because the relevant denominator depends on whether one counts only the vision tower or the full contrastive model.

HostTapDDMMrrPFRMP_{\mathrm{FRM}}Overhead
Qwen3-VL-4Bpost-merger256044314.57M7.86%
Qwen2.5-VL-3Bpost-merger204844201.33M6.71%
InternVL3.5-4Bpost-projector256044314.57M7.86%
Molmo2-4Bpost-projector256044314.57M7.86%
LLaVA-OV-1.5-4Bpost-merger256044314.57M7.86%
CLIP ViT-L/14pre-projection10244450.33M–
SigLIP2-basepre-projection7684428.31M–

Table 7. Table 7: FRM parameter overhead across VLM and frozen-encoder hosts. For each host, DD is the hidden dimension at the selected tap point. All listed hosts use four Transformer blocks with MLP ratio r=4r=4, giving PFRM≈M(4+2r)D2P_{\mathrm{FRM}} \approx M(4+2r)D^2. Overhead is reported relative to the host parameter count where the host size is fixed in our experiments.

For SigLIP2 retrieval, the query is the degraded object image and the gallery contains candidate pristine object images (Figure 11).

Figure 11. SigLIP2 pristine-state retrieval. Given a degraded object query, SigLIP2 ranks candidate pristine gallery images by feature similarity. FRM improves degraded-to-pristine retrieval, increasing Top-1 from 24.2% to 39.0% and Top-5 from 73.3% to 96.2%, approaching the pristine-query ceiling of 100%.

FRM Instantiation in VLM Hosts

InternVL3.5-4B. For InternVL3.5, FRM is trained at the post-projector visual-token interface. The frozen InternVL visual encoder first produces image tokens, and the frozen multimodal projector maps them into the language-model input space. We apply FRM after this projector, so both degraded features and paired pristine targets have shape z∈RB×N×2560z \in\mathbb{R}^{B \times N \times2560}. With 448×448448 \times448 inputs, the token count NN is determined by the model preprocessing and projector configuration, and the feature dimension is the text hidden size D=2560D=2560. During training, pristine post-projector features are cached once, degraded images are encoded on the fly, and FRM is optimized with the same MSE plus cosine recovery loss used in Sec. 4. At inference, the InternVL host remains frozen and the wrapper replaces the live degraded post-projector tokens with FRM-corrected tokens before generation. The baseline and FRM conditions therefore differ only in the visual feature path consumed by the frozen language model.

LLaVA-OneVision-1.5-4B. For LLaVA-OneVision-1.5, FRM is trained at the post-merger visual-token interface. The frozen Rice ViT first produces patch tokens, and the frozen RicePatchMerger spatially downsamples and projects them into the LLM-facing hidden space. We insert FRM after this merger, so the tapped tensor has shape z∈RB×256×2560z \in\mathbb{R}^{B \times256 \times2560} for the standard 448×448448 \times448 input setting. Here N=256N=256 follows from (448/14/2)2(448/14/2)^2, and D=2560D=2560 is the merger output dimension. The implementation reads the exact token count and feature dimension from the model configuration. Pristine post-merger tokens are cached before training, degraded tokens are encoded on the fly, and FRM is trained with the same paired feature objective as in Sec. 4. At inference, the wrapper patches the visual forward pass only inside the FRM-enabled context, applies FRM independently to each packed image token sequence, and then restores the original path. Thus, LLaVA generation, prompting, processor behavior, and language-model weights remain unchanged.

Molmo2-4B. For Molmo2, FRM is trained at the post-projector visual-token interface used by the host before language generation. The frozen vision stack produces packed visual tokens, the frozen projector maps them into the LLM-facing feature space, and FRM is applied to those post-projector tokens. Thus, the tapped tensor has shape z∈RB×N×2560z \in\mathbb{R}^{B \times N \times2560}, where NN is the post-projector visual-token count and D=2560D=2560 is the LLM-facing hidden dimension read from the host configuration. We use the same VLM FRM configuration with M=4M=4, 8 attention heads, and MLP ratio r=4r=4.

Training follows the paired feature-recovery setup in Sec. 4. Pristine post-projector features are cached once, degraded images are encoded on the fly, and FRM is optimized with the same MSE plus cosine alignment loss against the paired pristine target. At inference, the wrapper enables FRM only inside the FRM-on condition. It runs the frozen visual path, splits packed visual features by image using runtime grid metadata, applies FRM independently to each image token sequence, and concatenates the corrected features before language generation. Baseline, FRM, and pristine-ceiling evaluations therefore share the same prompts, decoding, and frozen language model, differing only in whether degraded post-projector visual tokens are corrected before being consumed by the model.

FRM Instantiation in Frozen Encoders

CLIP ViT-L/14. For CLIP, FRM is trained on pre-projection visual tokens from the frozen CLIP vision tower. We tap the CLIPVisionModel last hidden state before the visual projection into the text-aligned embedding space. For CLIP only, we drop the CLS token so that FRM operates on spatial patch tokens. With 224×224224 \times224 inputs and patch size 14, the tapped feature tensor has N=256N=256 patch tokens and hidden dimension D=1024D=1024, giving z∈RB×256×1024z \in\mathbb{R}^{B \times256 \times1024}. Pristine patch-token features are cached once, degraded images are encoded on the fly, and FRM predicts recovered tokens in the same B×N×DB \times N \times D space. The frozen CLIP encoder is never updated, and evaluation compares recovered degraded tokens to paired pristine CLIP tokens using MSE, cosine similarity, and pooled-token retrieval.

SigLIP2. For SigLIP2, FRM is also trained at the pre-projection visual-token interface. We tap the frozen SigLIP2 vision model’s last hidden state and use patch tokens rather than pooled image embeddings or text-aligned outputs. With google/siglip2-base-patch16-224, the input size is 224×224224 \times224, the patch size is 16, and the visual grid is 14×1414 \times14. The tapped tensor therefore has N=196N=196 patch tokens and hidden dimension D=768D=768, giving z∈RB×196×768z \in\mathbb{R}^{B \times196 \times768}. As in Sec. 4, FRM is shape preserving: degraded features zℓz^\ell are mapped to recovered features z~ℓ\tilde{z}^\ell and supervised against cached paired pristine features zpz^p from the same tap. We keep the SigLIP2 encoder frozen and report feature-space recovery metrics as well as pristine-state retrieval using pooled visual features.

Integration and tap point. Correcting Qwen3-VL’s DeepStack stream slightly reduces identity accuracy, so we keep FRM at the primary visual-token interface. For tap-point selection, downstream-facing taps outperform earlier visual-token taps. Qwen3-VL improves from 72.90 R@1 with a pre-merger tap to 85.28 with a post-merger tap, while InternVL3.5 improves from 63.84 R@1 with a pre-projector tap to 74.92 with a post-projector tap (Appendix 9). These results support correcting the features consumed by the frozen language model.

Per-Level VLM Results

Figure 10 and Table 8 provide the full per-level breakdown of FRM gains across all five frozen VLM hosts and four object-level pristine-state tasks. Gains are small or occasionally negative at L0-L1, where degradation is mild and baseline features are already close to the pristine state. Gains concentrate at L2-L4, where physical transformation causes larger feature displacement and the learned correction becomes more useful. This pattern supports the view that FRM is most beneficial when degradation induces structured feature drift.

A heavily fire-damaged dresser

Figure 10.

Per-level VLM pristine-state recovery across additional hosts

Figure 10. Per-level VLM pristine-state recovery across additional hosts. Baseline models are shown in light colors and FRM-enabled models in dark colors across L0-L4. Columns report pristine-state retrieval (R@1), original material recovery (F1), pristine description generation (score), and functional reasoning (mean F1). FRM gains concentrate at higher severity across hosts.

Frozen-Encoder Feature Recovery

We evaluate FRM on frozen CLIP ViT-L/14 and SigLIP2 encoders to isolate feature-space recovery from detector and language-model effects. The input is a degraded object image, and the target is the paired pristine image of the same object. We compare recovered degraded features against paired pristine features at the encoder tap point.

For retrieval, the query is the degraded object image and the gallery contains candidate pristine object images. SigLIP2 ranks gallery images by visual-feature similarity, with one paired pristine target per query. The pristine-query ceiling is 100% because querying with the pristine image retrieves the identical reference from the gallery.

Additional FRM Ablations

DeepStack and tap-point selection. Table 9 reports additional integration ablations. For Qwen3-VL, applying FRM to the DeepStack stream slightly reduces identity accuracy compared with correcting only the primary visual-token interface. For tap-point selection, later LLM-facing interfaces outperform earlier visual-token interfaces. Qwen3-VL improves from 72.90 R@1 with a pre-merger tap to 85.28 with a post-merger tap, and InternVL3.5 improves from 63.84 R@1 with a pre-projector tap to 74.92 with a post-projector tap.

References

  1. [1]Lorenzo Agnolucci, Leonardo Galteri, Marco Bertini, and Alberto Del Bimbo. Arniqa: Learning distortion manifold for image quality assessment. In Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision, pages 189–198, 2024.arxiv.org/abs/2310.14918
  2. [2]Xiang An, Yin Xie, Kaicheng Yang, Wenkang Zhang, Xiuwei Zhao, Zheng Cheng, Yirui Wang, Songcen Xu, Changrui Chen, Didi Zhu, et al. Llava-onevision-1.5: Fully open framework for democratized multimodal training. arXiv preprint arXiv:2509.23661, 2025.arxiv.org/abs/2509.23661
  3. [3]Anastasios Arsenos, Vasileios Karampinis, Evangelos Petrongonas, Christos Sklīros, Dimitrios Kollias, Stefanos Kollias, and Athanasios Voulodimos. Common corruptions for evaluating and enhancing robustness in air-to-air visual object detection. IEEE Robotics and Automation Letters, 9(7):6688–6695, 2024. doi: 10.1109/LRA.2024.3408485.DOI
  4. [4]Shuai Bai, Yuxuan Cai, Ruizhe Chen, Keqin Chen, Xionghui Chen, Zesen Cheng, Lianghao Deng, Wei Ding, Chang Gao, Chunjang Ge, et al. Qwen3-vl technical report. arXiv preprint arXiv:2511.21631, 2025.arxiv.org/abs/2511.21631
  5. [5]Shuai Bai, Keqin Chen, Xuejing Liu, Jialin Wang, Wenbin Ge, Sibo Song, Kai Dang, Peng Wang, Shijie Wang, Jun Tang, Humen Zhong, Yuanzhi Zhu, Mingkun Yang, ZhaoHai Li, Jianqiang Wan, Pengfei Wang, Wei Ding, Zheren Fu, Yiheng Xu, Jiabo Ye, Xi Zhang, Tianbao Xie, Zesen Cheng, Hang Zhang, Zhibo Yang, Haiyang Xu, and Junyang Lin. Qwen2.5-vl technical report, 2025. URL https://arxiv.org/abs/2502.13923.
  6. [6]Andrei Barbu, David Mayo, Julian Alverio, William Luo, Christopher Wang, Dan Gutfreund, Josh Tenenbaum, and Boris Katz. Objectnet: A large-scale bias-controlled dataset for pushing the limits of object recognition models. In H. Wallach, H. Larochelle, A. Beygelzimer, F. d’Alché-Buc, E. Fox, and R. Garnett, editors, Advances in Neural Information Processing Systems, volume 32. Curran Associates, Inc., 2019. URL https://proceedings.neurips.cc/paper_files/paper/2019/file/97af07a14acba681feacf3012730892-Paper.pdf.
  7. [7]Stefan Becker, Simon Weiss, Wolfgang Hübner, and Michael Arens. Self-aware object detection via degradation manifolds. arXiv preprint arXiv:2602.18394, 2026.arxiv.org/abs/2602.18394
  8. [8]Simone Bianco, Luigi Celona, and Paolo Napoletano. Disentangling image distortions in deep feature space. Pattern Recognition Letters, 148:128–135, 2021. ISSN 0167-8655. doi: https://doi.org/10.1016/j.patrec.2021.05.008. URL https://www.sciencedirect.com/science/article/pii/S0167865521001859.
  9. [9]Liang Chen, Jianhong Han, and Yupei Wang. Datr: Unsupervised domain adaptive detection transformer with dataset-level adaptation and prototypical alignment. IEEE Transactions on Image Processing, 34:982–994, 2025.
  10. [10]Wenyue Chong. Towards robust semantic correspondence: A benchmark and insights. arXiv preprint arXiv:2508.00272, 2025.arxiv.org/abs/2508.00272
  11. [11]Xiaojie Chu, Liangyu Chen, and Wenqing Yu. Nafssr: Stereo image super-resolution using nafnet. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) Workshops, pages 1239–1248, June 2022.arxiv.org/abs/2204.08714
  12. [12]Christopher Clark, Jieyu Zhang, Zixian Ma, Jae Sung Park, Mohammadreza Salehi, Rohun Tripathi, Sangho Lee, Zhongzheng Ren, Chris Dongjoo Kim, Yinuo Yang, et al. Molmo2: Open weights and data for vision-language models with video understanding and grounding. arXiv preprint arXiv:2601.10611, 2026.arxiv.org/abs/2601.10611
  13. [13]Haoyou Deng, Zhiqiang Li, Feng Zhang, Qingbo Lu, Zisheng Cao, Yuanjie Shao, Shuhang Gu, Changxin Gao, and Nong Sang. Learning unpaired image dehazing with physics-based rehazy generation. arXiv preprint arXiv:2506.12824, 2025.arxiv.org/abs/2506.12824
  14. [14]Mark Everingham, Luc Van Gool, Christopher K. I. Williams, John Winn, and Andrew Zisserman. The pascal visual object classes (voc) challenge. International Journal of Computer Vision, 88(2):303–338, 2010. doi: 10.1007/s11263-009-0275-4. URL https://doi.org/10.1007/s11263-009-0275-4.
  15. [15]Google. Gemini 3 flash preview. https://ai.google.dev/gemini-api/docs/models/gemini-3-flash-preview, 2025. Accessed: 2026-05-06.
  16. [16]Google. Gemini 3 pro image preview. https://ai.google.dev/gemini-api/docs/models/gemini-3-pro-image-preview, 2025. Accessed: 2026-05-06.
  17. [17]Ritwik Gupta, Richard Hosfelt, Sandra Sajeev, Nirav Patel, Bryce Goodman, Jigar Doshi, Eric Heim, Howie Choset, and Matthew Gaston. xbd: A dataset for assessing building damage from satellite imagery. arXiv preprint arXiv:1911.09296, 2019.arxiv.org/abs/1911.09296
  18. [18]Xiangzhao Hao, Zefeng Zhang, Zhenyu Zhang, Linhao Yu, Yao Chen, Yiqian Zhang, Haiyun Guo, Shouhuan Wang, and Yu Sun. Clear: Unlocking generative potential for degraded image understanding in unified multimodal models, 2026. URL https://arxiv.org/abs/2604.04780.
  19. [19]Dan Hendrycks and Thomas Dietterich. Benchmarking neural network robustness to common corruptions and perturbations. arXiv preprint arXiv:1903.12261, 2019.
  20. [20]Marc-Antoine Lavoie, Anas Mahmoud, and Steven L Waslander. Large self-supervised models bridge the gap in domain adaptive object detection. arXiv preprint arXiv:2503.23220, 2025.
  21. [21]Jingyun Liang, Jiezhang Cao, Guolei Sun, Kai Zhang, Luc Van Gool, and Radu Timofte. Swinir: Image restoration using swin transformer. arXiv preprint arXiv:2108.10257, 2021.arxiv.org/abs/2108.10257
  22. [22]Tsung-Yi Lin, Michael Maire, Serge Belongie, James Hays, Pietro Perona, Deva Ramanan, Piotr Dollár, and C Lawrence Zitnick. Microsoft coco: Common objects in context. In European conference on computer vision, pages 740–755. Springer, 2014.arxiv.org/abs/1405.0312
  23. [23]Yabo Liu, Jinghua Wang, Chao Huang, Yiling Wu, Yong Xu, and Xiaochun Cao. MIfa: Toward realistic test time adaptive object detection by multi-level feature alignment. IEEE Transactions on Image Processing, 33:5837–5848, 2024. doi: 10.1109/TIP.2024.3473532.
  24. [24]Yuen Peng Loh and Chee Seng Chan. Getting to know low-light images with the exclusively dark dataset. Computer Vision and Image Understanding, 178:30–42, 2019. doi: https://doi.org/10.1016/j.cviu.2018.10.010.
  25. [25]Ziwei Luo, Fredrik K Gustafsson, Zheng Zhao, Jens Sjölund, and Thomas B Schön. Controlling vision-language models for universal image restoration. arXiv preprint arXiv:2310.01018, 2023.
  26. [26]Ziwei Luo, Fredrik K Gustafsson, Zheng Zhao, Jens Sjölund, and Thomas B Schön. Photo-realistic image restoration in the wild with controlled vision-language models. arXiv preprint arXiv:2404.09732, 2024.
  27. [27]Claudio Michaelis, Benjamin Mit zkus, Robert Geirhos, Evgenia Rusak, Oliver Bringmann, Alexander S. Ecker, Matthias Bethge, and Wieland Brendel. Benchmarking robustness in object detection: Autonomous driving when winter is coming. arXiv preprint arXiv:1907.07484, 2019.
  28. [28]Maxime Oquab, Timothée Darcet, Théo Moutakanni, Huy Vo, Marc Szafraniec, Vasil Khalidov, Pierre Fernandez, Daniel Haziza, Francisco Massa, Alaeldin El-Nouby, et al. DinoV2: Learning robust visual features without supervision. arXiv preprint arXiv:2304.07193, 2023.
  29. [29]Adiba Proma. Nadbenchmarks - a compilation of benchmark datasets for machine learning tasks related to natural disasters. In AAAI 2022 Fall Symposium: The Role of AI in Responding to Climate Challenges, 2022. URL https://www.climatechange.ai/papers/aaai fss2022/9.
  30. [30]Alec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh, Gabriel Goh, Sandhini Agarwal, Girish Sastry, Amanda Askell, Pamela Mishkin, Jack Clark, et al. Learning transferable visual models from natural language supervision. In International conference on machine learning, pages 8748–8763. PmLR, 2021.arxiv.org/abs/2103.00020
  31. [31]Maryam Rahnemoonfar, Tashnim Chowdhury, Argho Sarkar, Devbrat Varshney, Masoud Yari, and Robin Roberson Murphy. Floodnet: A high resolution aerial imagery dataset for post flood scene understanding. IEEE Access, 9:89644–89654, 2021.
  32. [32]Maryam Rahnemoonfar, Tashnim Chowdhury, and Robin Murphy. Rescuenet: a high resolution uav semantic segmentation dataset for natural disaster damage assessment. Scientific data, 10 (1):913, 2023.
  33. [33]Rindra Ramamonjison, Amin Banitalebi-Dehkordi, Xinyu Kang, Xiaolong Bai, and Yong Zhang. Simrod: A simple adaptation method for robust object detection. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pages 3570–3579, 2021.arxiv.org/abs/2107.13389
  34. [34]Bin Ren, Yawei Li, Xu Zheng, Yuqian Fu, Danda Pani Paudel, Hong Liu, Ming-Hsuan Yang, Luc Van Gool, and Nicu Sebe. Efficient degradation-agnostic image restoration via channel-wise functional decomposition and manifold regularization. In The Fourteenth International Conference on Learning Representations, 2026. URL https://openreview.net/forum?id=jDMAVoLsVj.arxiv.org/abs/2505.18679
  35. [35]Isaac Robinson, Peter Robicheaux, Matvei Popov, Deva Ramanan, and Neehar Peri. Rf-detr: Neural architecture search for real-time detection transformers, 2025. URL https://arxiv.org/abs/2511.09554.
  36. [36]Xiaoqian Ruan and Wei Tang. Fully test-time adaptation for object detection. In 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), pages 1038–1047, 2024. doi: 10.1109/CVPRW63382.2024.000110.DOI
  37. [37]Olga Russakovsky, Jia Deng, Hao Su, Jonathan Krause, Sanjeev Satheesh, Sean Ma, Zhiheng Huang, Andrej Karpathy, Aditya Khosla, Michael Bernstein, et al. ImageNet large scale visual recognition challenge. International journal of computer vision, 115(3):211–252, 2015.arxiv.org/abs/1409.0575
  38. [38]Christos Sakaridis, Dengxin Dai, and Luc Van Gool. ACDC: The adverse conditions dataset with correspondences for semantic driving scene understanding. In Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), October 2021.
  39. [39]Jenny Schmalfuss, Victor Oei, Lukas Mehl, Madlen Bartsch, Shashank Agnihotri, Margret Keuper, and Andrés Bruhn. Robustspring: Benchmarking robustness to image corruptions for optical flow, scene flow and stereo. arXiv preprint arXiv:2505.09368, 2025.arxiv.org/abs/2505.09368
  40. [40]Aaditya Singh, Adam Fry, Adam Perelman, Adam Tart, Adi Ganesh, Ahmed El-Kishky, Aidan McLaughlin, Aiden Low, Al Ostrow, Akhila Ananthram, et al. Openai gpt-5 system card. arXiv preprint arXiv:2601.03267, 2025.arxiv.org/abs/2601.03267
  41. [41]Baochen Sun and Kate Saenko. Deep coral: Correlation alignment for deep domain adaptation. In ECCV 2016 Workshops, 2016.arxiv.org/abs/1607.01719
  42. [42]Aditi Tiwari, Farzaneh Masoud, Dac Trong Nguyen, Jill Kraft, Heng Ji, and Klara Nahrstedt. Fire360: A benchmark for robust perception and episodic memory in degraded 360-degree firefighting videos. arXiv preprint arXiv:2506.02167, 2025.arxiv.org/abs/2506.02167
  43. [43]Michael Tschannen, Alexey Gritsenko, Xiao Wang, Muhammad Ferjad Naeem, Ibrahim Alabdulmohsin, Nikhil Parthasarathy, Talfan Evans, Lucas Beyer, Ye Xia, Basil Mustafa, Olivier Hén aff, Jeremiah Harmsen, Andreas Steiner, and Xiaohua Zhai. Siglip 2: Multilingual vision-language encoders with improved semantic understanding, localization, and dense features, 2025. URL https://arxiv.org/abs/2502.14786.
  44. [44]Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Lukasz Kaiser, and Illia Polosukhin. Attention is all you need, 2023. URL https://arxiv.org/abs/1706.03762.
  45. [45]Wеiyun Wang, Zhangwei Gao, Lixin Gu, Hengjun Pu, Long Cui, Xingguang Wei, Zhaoyang Liu, Linglin Jing, Shenglong Ye, Jie Shao, et al. InternV13. 5: Advancing open-source multimodal models in versatility, reasoning, and efficiency. arXiv preprint arXiv:2508.18265, 2025.
  46. [46]Ethan Weber, Dim P. Papadopoulos, Agata Lapiedra, Ferda Ofli, Muhammad Imran, and Antonio Torralba. Incidents1m: a large-scale dataset of images with natural disasters, damage, and incidents. IEEE transactions on pattern analysis and machine intelligence, 45(4):4768–4781, 2022.
  47. [47]Wang Wen, Cao Yang, Zhang Jing, He Fengxiang, Zha Zheng-Jun, Wen Yonggang, and Tao Dacheng. Exploring sequence feature alignment for domain adaptive detection transformers. In Proceedings of the 29th ACM International Conference on Multimedia, 2021.DOI
  48. [48]Jianxiong Xiao, James Hays, Krista A. Ehinger, Aude Oliva, and Antonio Torralba. Sun database: Large-scale scene recognition from abbey to zoo. In 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pages 3485–3492, 2010. doi: 10.1109/CVPR.2010.5539970.DOI
  49. [49]Jinquan Yan, Zhicheng Zhao, Zhengzheng Tu, Chenglong Li, Jin Tang, and Bin Luo. Compositional-degradation uav image restoration: Conditional decoupled moe network and a benchmark. arXiv preprint arXiv:2604.09313, 2026.arxiv.org/abs/2604.09313
  50. [50]Syed Waqas Zamir, Aditya Arora, Salman Khan, Munawar Hayat, Fahad Shahbaz Khan, Ming-Hsuan Yang, and Ling Shao. Multi-stage progressive image restoration. In CVPR, 2021.arxiv.org/abs/2102.02808
  51. [51]Syed Waqas Zamir, Aditya Arora, Salman Khan, Munawar Hayat, Fahad Shahbaz Khan, and Ming-Hsuan Yang. Restormer: Efficient transformer for high-resolution image restoration. In CVPR, 2022.arxiv.org/abs/2111.09881
  52. [52]Lihua Zhou, Mao Ye, Shuaifeng Li, Nianxin Li, Jinlin Wu, Xiatian Zhu, Lei Deng, Hongbin Liu, Jiebo Luo, and Zhen Lei. Bayesian test-time adaptation for object recognition and detection with vision-language models. arXiv preprint arXiv:2510.02750, 2025.arxiv.org/abs/2510.02750

Paper details

vlnc:W_uuwcajsd
Version
v1 · latest
Published
Added
License
CC BY 4.0
Usage

views · 0

downloads · 0

A view counts once per browser per day, a download each time the PDF is requested.

  • Computer Science

Not recorded for this paper

View statement
Looking for related papers…
Contents