betaFeedback

WorksComputer Science

Uncertainty-Aware Prototype Learning for Open-Set Test-Time Adaptation

Abstract

Open-set test-time adaptation (TTA) aims to adapt source-trained models to unlabeled test streams where covariate-shifted in-distribution (csID) samples and covariate-shifted out-of-distribution (csOOD) samples may coexist. Existing TTA methods are typically designed under a closed-set assumption and therefore lack explicit mechanisms for reliably distinguishing csID from csOOD samples. Consequently, csOOD samples may be mistakenly included in confidence-enhancing adaptation, producing harmful gradients that degrade known-class performance. To address this, we propose Uncertainty-Aware Prototype Learning for Open-Set Test-Time Adaptation (UAPA), a plug-and-play method for reliable open-set adaptation. Specifically, we first introduce Uncertainty-Driven ID/OOD Separation, which combines a classifier-prototype score with a mini-batch-normalized evidence-derived uncertainty score to distinguish csID from csOOD samples. We then propose a Dynamic Prototype Refinement strategy that periodically refines class-specific target prototypes using buffered csID features to progressively follow the estimated class directions. Lastly, we introduce Contrastive Prototype Entropy Adaptation, which applies entropy minimization to csID samples and entropy maximization to csOOD samples, while prototype-level contrastive learning aligns csID features with their corresponding target prototypes and reduces the maximum similarity between csOOD features and known-class prototypes. Empirically, UAPA outperforms the strongest baselines on the CIFAR benchmarks and Tiny-ImageNet-C, improving average OSCR by 2.08 and 1.28 percentage points, respectively.

Introduction

Deep neural networks have achieved remarkable progress in visual recognition tasks [1, 2, 3, 4, 5, 6], yet their reliability can substantially degrade when deployed in open-world environments [7, 8, 9, 10]. In real-world test streams, known-class samples may undergo appearance-level changes caused by weather variations, motion blur, sensor noise, or other visual corruptions while retaining the source label space, a setting known as covariate shift [11]. Meanwhile, test samples may also come from classes outside the source label space, leading to semantic shift [12]. In practice, these two shifts are often coupled: unknown-class samples may appear under the same degraded conditions as shifted known-class samples. For example, an autonomous driving system may encounter familiar vehicles under fog or motion blur, while also observing unseen obstacles or rare objects that were absent during training. A reliable deployed model is therefore expected not only to adapt to shifted known classes, but also to avoid being misled by shifted unknown classes [13, 14, 15, 16, 17].

To improve robustness under covariate shift, test-time adaptation (TTA) updates a source-trained model online using unlabeled test data [18, 19, 21, 22, 23]. Representative TTA methods combine unsupervised adaptation objectives, such as entropy minimization [18, 19] or prediction consistency [23, 24], with update strategies such as reliability-based sample selection [19, 22]. These designs enable the model to adapt to shifted test distributions without requiring access to the original source data. However, many TTA methods are developed under an implicit closed-set assumption, where each test sample is assumed to belong to one of the source classes despite possible changes in the test distribution. Under this assumption, encouraging confident predictions or selecting reliable samples can help the model adapt to shifted known-class samples.

In open-set test streams, this closed-set assumption no longer holds because the target stream may contain both known-class samples with appearance or quality shifts, referred to as covariate-shifted in-distribution (csID) samples, and unknown-class samples outside the source label space under similar shifts, referred to as covariate-shifted out-of-distribution (csOOD) samples [15, 16, 25]. This setting raises two key challenges. 1) Negative adaptation caused by csOOD samples. Entropy minimization encourages confident predictions for target samples. If csOOD samples are adapted in the same way as csID samples, they may be pushed toward overconfident known-class predictions, yielding harmful gradients that distort decision boundaries and cause negative adaptation. 2) Unreliable separation between csID and csOOD samples. The model must decide which samples can support known-class adaptation and which should be excluded from confidence-enhancing updates. This is difficult because severe covariate shifts can make csID samples uncertain, whereas some csOOD samples may appear confident. Thus, relying on a single confidence, entropy, or prototype-similarity score [15] can produce unreliable partitions and unstable adaptation.

To address these challenges, we propose Uncertainty-Aware Prototype Learning for Open-Set Test-Time Adaptation (UAPA), a plug-and-play method (see Figure 1) for reliability-aware adaptation in open-set test streams. The key idea of UAPA is to determine the adaptation role of each test sample according to both its geometric relation to known classes and an evidence-derived uncertainty score computed from the online-model logits. Specifically, UAPA first introduces Uncertainty-Driven ID/OOD Separation, which combines a classifier-prototype score with a mini-batch-normalized evidence-derived uncertainty score to partition incoming samples into csID and csOOD subsets. It then performs Dynamic Prototype Refinement (DPR), which accumulates selected csID features in class-wise buffers and periodically updates class-specific target prototypes. Finally, UAPA develops Contrastive Prototype Entropy Adaptation (CPEA), which applies different entropy objectives to the estimated csID and csOOD subsets and uses progressively initialized target prototypes to provide stage-dependent, prototype-relative regularization. In this way, UAPA jointly performs sample separation, prototype maintenance, and direction-aware adaptation to suppress negative adaptation in open-set test-time adaptation. Our main contributions are as follows:

Figure 1. OSCR comparison on CIFAR-100-C before and after incorporating UAPA into representative TTA methods [18, 19, 20, 21]. Values above the arrows denote absolute OSCR gains in percentage points.

  • We propose an uncertainty-driven ID/OOD separation mechanism for open-set test-time adaptation. By jointly considering a classifier-prototype score and a mini-batch-normalized evidence-derived uncertainty score, UAPA incorporates complementary geometric and uncertainty-related cues for csID/csOOD partitioning. We characterize the conditional separability and bounded-perturbation stability of the fused score, while clarifying the mini-batch dependence of the normalized uncertainty score and its distinction from GMM-based posterior gating.

  • We propose Dynamic Prototype Refinement and Contrastive Prototype Entropy Adaptation for open-set test-time adaptation. DPR periodically updates class-specific target prototypes using buffered csID features, while CPEA combines csID entropy minimization, csOOD entropy maximization, and prototype-level contrastive learning to suppress negative adaptation. We show that DPR induces one-step angular non-expansion toward the buffered class direction, while CPEA encourages pseudo-label-relative margin enlargement for selected csID samples and nearest-prototype separation for selected csOOD samples in the hyperspherical feature space.

  • Extensive experiments on CIFAR-C and Tiny-ImageNet-C benchmarks demonstrate that UAPA consistently improves open-set classification performance across different backbones and state-of-the-art TTA baselines. Further plug-and-play and efficiency analyses show that UAPA can be integrated into existing TTA methods with low additional computational cost.

Related Work

Test-Time Adaptation

Test-time adaptation (TTA) [17, 18, 19, 21, 22, 26, 27, 28, 29, 30, 31, 32] adapts a source-trained model during inference without accessing source data, using lightweight online updates that often restrict learning to normalization statistics or a small subset of parameters. It differs from test-time training (TTT), which performs an auxiliary self-supervised update before prediction and requires training-time modifications [33]. A foundational approach is entropy minimization, as in TENT [18], which updates the model batch by batch to increase prediction confidence under covariate or domain shift. EATA [19] selects reliable, non-redundant samples to avoid harmful updates and forgetting. COME [21] replaces plain entropy minimization with a conservative variant grounded in evidential or Dirichlet uncertainty to curb overconfidence. Self-Bootstrapping [26] proposes a versatile consistency objective that extends TTA beyond classification to tasks such as segmentation and detection. A2^{2}Memory [17] improves memory-based online TTA for vision-language models via attribute-centric soft assignment and class-wise associative memory, reducing memory contamination and enabling sample-adaptive prototype retrieval. Despite these advances, most TTA methods are designed for closed-set covariate or domain shifts, where test samples are assumed to belong to the source label space.

Open-Set Test-Time Adaptation

Open-set test-time adaptation (OSTTA) [15, 20, 34, 35, 36, 37] considers target streams that include unknown classes in addition to covariate-shifted known classes. Closed-set TTA often fails in this setting because uniform entropy minimization treats unknown inputs as trustworthy, which pushes them toward over-confident known predictions and degrades the decision boundary [20]. A common strategy is to separate target samples into covariate-shifted in-distribution (csID) and covariate-shifted out-of-distribution (csOOD) and to assign different updates. UniEnt [15] performs mixture-based posterior gating on a prototype-similarity or uncertainty score to mine pseudo-csID and pseudo-csOOD, then minimizes entropy for the former and maximizes entropy for the latter, with a weighted variant to reduce partition noise. STAMP [34] avoids risky mini-batch updates by optimizing over a stable memory bank that is refreshed with low-entropy and label-consistent samples, improving robustness under streaming conditions. AEO [35] proposes adaptive entropy-aware optimization for multimodal OSTTA, enlarging the entropy gap between known and unknown samples to better identify unknown classes under multimodal distribution shifts. ROSETTA [16] studies the ID-OOD trade-off in OSTTA and aims to improve csOOD detection while preserving csID classification performance.

Out-of-Distribution Detection

Out-of-distribution (OOD) detection aims to identify samples that deviate from the training distribution, preventing overconfident predictions on unseen or abnormal inputs [38, 39, 40, 41, 42, 43]. Maximum Softmax Probability (MSP) [38] uses the maximum softmax probability as a confidence score, providing a baseline for detecting misclassified and OOD samples. ODIN [39] introduces temperature scaling and input perturbations to enlarge the confidence gap between in-distribution and OOD samples, improving the reliability of softmax-based detection. Energy-based OOD detection [40] replaces softmax confidence with an energy score derived from logits, addressing the limitation that softmax probabilities may be poorly calibrated for OOD inputs. PRO [44] leverages perturbation robustness to construct more discriminative OOD scores, based on the observation that OOD confidence is more sensitive to adversarial perturbations. W-DOE [42] improves open-world OOD generalization by expanding auxiliary OOD coverage through implicit data synthesis and distribution-agnostic optimization. Unlike conventional OOD detection methods that mainly focus on post-hoc scoring for a fixed model, UAPA integrates OOD estimation with online adaptation, using prototype-based similarity and a mini-batch-normalized evidence-derived uncertainty score to separate csID/csOOD samples and suppress csOOD-induced negative adaptation.

Contrastive Learning

Contrastive learning learns discriminative representations by pulling semantically similar samples closer and pushing dissimilar samples apart in the embedding space [45, 46, 47, 48, 49, 50, 51, 52]. Sim-CLR [48] demonstrates that strong data augmentation, large batch sizes, and nonlinear projection heads enable contrastive representation learning. MoCo [49] introduces a momentum encoder and a dynamic queue to maintain a large and consistent dictionary of negative samples, alleviating the dependence on extremely large batches. Beyond negative-sample-based methods, BYOL [50] and SimSiam [51] adopt asymmetric Siamese architectures with prediction heads and stop-gradient operations, enabling representation learning without explicit negative pairs. ReSSL [47] extends instance-level contrastive learning by modeling inter-instance relations through similarity-distribution matching under weak augmentations. CHMatch [52] combines robust adaptive thresholding with contrastive hierarchical matching to select reliable samples and learn discriminative representations.

Problem Formulation

Let P(x)P(x) denote the distribution of the source training samples {xis}i=1Ns\{x_i^{s}\}_{i=1}^{N_s}, where xis∼P(x)x_i^{s} \sim P(x). The base model fθo(x)f_{\theta}^{o}(x) is trained on the labeled source dataset Ds={(xis,yis)}i=1Ns⊂X×Ys\mathcal{D}_s = \{(x_i^{s}, y_i^{s})\}_{i=1}^{N_s} \subset\mathcal{X} \times\mathcal{Y}_s, where Ys={1,…,Cs}\mathcal{Y}_s = \{1, \ldots, C_s\} is the set of CsC_s known classes. After training, the model fθo(x)f_{\theta^{o}}(x) is expected to fit the source data distribution. At inference time, the model is expected to perform well on in-distribution test data, namely, x∼P(x)x \sim P(x). However, in real-world deployments, due to possible distribution shifts between training and test data, we may encounter target samples drawn from a shifted distribution Q(x)Q(x), where Q(x)≠P(x)Q(x) \ne P(x). The types of distribution shifts that can occur during inference are as follows. 1) Covariate Shift: The samples share the same set of classes but differ in their distribution due to variations in style or domain. 2) Semantic Shift: The target domain contains novel classes that were not present during training on the source domain. In this case, the source label space is a strict subset of the target label space, i.e., Ys⊂Yt\mathcal{Y}_s \subset\mathcal{Y}_t, where Yt\mathcal{Y}_t denotes the target label space. These shifts partition the target data stream into two categories: 1) Covariate-shifted In-Distribution (csID). Samples xt∈Btx^{t} \in\mathcal{B}_t whose true labels yty^{t} belong to the known source classes, i.e., yt∈Ysy^{t} \in\mathcal{Y}_s. 2) Covariate-shifted Out-of-Distribution (csOOD). Samples xt∈Btx^{t} \in\mathcal{B}_t whose true labels yty^{t} are from novel, unknown classes, i.e., yt∈Yt∖Ysy^{t} \in\mathcal{Y}_t \setminus\mathcal{Y}_s. For csOOD samples, predictions over the known source classes can be unreliable, leading to poor open-set performance.

Test-time adaptation (TTA) [18, 19, 21, 53] seeks to improve model performance in the target domain by adapting the model using only test data. Specifically, given a set of target test samples {xj}j=1M\{x_j\}_{j=1}^{M}, where xj∼Q(x)x_j \sim Q(x) and Q(x)≠P(x)Q(x) \ne P(x), one needs to adapt fθo(x)f_{\theta^{o}}(x) to improve prediction performance on the target data. To achieve this, many methods update the model by minimizing an unsupervised objective defined on test samples:

min⁡θˉL(x;θ),x∼Q(x),(1)\min_{\bar{\theta}} \mathcal{L}(x;\theta), \qquad x \sim Q(x), \tag*{(1)}

where θˉ\bar{\theta} denotes the subset of parameters in θ\theta that is updated during TTA. The learning objective L(⋅)\mathcal{L}(\cdot) is often formulated as an entropy minimization problem.

However, in open-set scenarios where both csID and csOOD samples coexist, traditional TTA methods struggle to perform. If the same closed-set adaptation objective is applied to all target samples, csOOD samples may be forced toward overconfident predictions over known classes and generate harmful gradients during online updates. As a result, they can distort decision boundaries, contaminate adaptation statistics or prototypes, and degrade the performance on csID samples. The goal of open-set TTA is therefore to improve classification on latent csID samples, identify latent csOOD samples, and prevent the latter from inducing harmful adaptation updates.

Uncertainty-Aware Prototype Learning

In this paper, we propose Uncertainty-Aware Prototype Learning for Open-Set Test-Time Adaptation (UAPA), a plug-and-play method for open-set TTA, which adapts the model using samples selected as csID while limiting harmful updates from samples selected as csOOD. The overall framework is

Algorithm 1 Pipeline of the proposed UAPA

  1. Input: Test stream Dtest\mathcal{D}_{\mathrm{test}}, source model M0M_0, batch size BB, and hyperparameters λ\lambda, τ\tau, γ\gamma, α0\alpha_0, α1\alpha_1, ρ\rho, β\beta, η\eta, τ0\tau_0, and ϵ\epsilon.

  2. Initialize: Online model M1←M0M_1 \leftarrow M_0, reference model Mref←Copy⁡(M0)M_{\mathrm{ref}} \leftarrow\operatorname{Copy}(M_0), target prototypes μc←0\mu_c \leftarrow0, feature buffers Fc←∅\mathcal{F}_c \leftarrow\varnothing for all cc, and effective-batch counter k←0k \leftarrow0.

  3. for each incoming mini-batch Bt⊂Dtest\mathcal{B}_t \subset\mathcal{D}_{\mathrm{test}} do

  4. Obtain predictions and online features for samples in Bt\mathcal{B}_t.

  5. Compute SprotoS_{\mathrm{proto}} using MrefM_{\mathrm{ref}} and classifier prototypes.

  6. Compute the raw evidence-derived uncertainty score UEUU_{\mathrm{EU}} and its mini-batch-normalized score SEUS_{\mathrm{EU}} using online predictions.

  7. Compute S=λSproto+(1−λ)SEUS = \lambda S_{\mathrm{proto}}+(1-\lambda)S_{\mathrm{EU}} and split Bt\mathcal{B}_t into Bt,csID\mathcal{B}_{t,\mathrm{csID}} and Bt,csOOD\mathcal{B}_{t,\mathrm{csOOD}} using threshold τ\tau.

  8. Store csID features in class-wise buffers according to their pseudo-labels.

  9. Compute Lt,entropy\mathcal{L}_{t,\mathrm{entropy}} and Lt,contrast\mathcal{L}_{t,\mathrm{contrast}}.

  10. Update the online model by minimizing Lt,total=Lt,entropy+γLt,contrast\mathcal{L}_{t,\mathrm{total}}=\mathcal{L}_{t,\mathrm{entropy}}+\gamma\mathcal{L}_{t,\mathrm{contrast}}.

  11. if Bt,csID≠∅\mathcal{B}_{t,\mathrm{csID}}\ne\varnothing then

  12. k←k+1k \leftarrow k+1.

  13. if k mod η=0k\bmod\eta=0 then

  14. Update each target prototype with a non-empty buffer using momentum β\beta.

  15. Clear all class-wise feature buffers.

  16. Output: Pre-update predictions for all test samples.

illustrated in Figure 2, and the pipeline is summarized in Alg. 1. We first introduce Uncertainty-Driven ID/OOD Separation (cf. Sec. IV-A), which combines a classifier-prototype score with a mini-batch-normalized evidence-derived uncertainty score to partition incoming samples into csID and csOOD subsets. We then propose a Dynamic Prototype Refinement strategy (cf. Sec. IV-B), which accumulates selected csID features in class-wise buffers and periodically refines class-specific target prototypes. Lastly, we introduce Contrastive Prototype Entropy Adaptation (cf. Sec. IV-C), a unified objective that minimizes entropy for csID samples and maximizes entropy for csOOD samples, while further using contrastive learning to increase pseudo-label-relative similarity margins for csID features and reduce the maximum similarity between csOOD features and initialized target prototypes.

Figure 2. Overview of UAPA. For each incoming batch Bt\mathcal{B}_t, UAPA combines the classifier-prototype score SprotoS_{\mathrm{proto}} with the mini-batch-normalized evidence-derived uncertainty score SEUS_{\mathrm{EU}} to compute a separation score S(xt)S(x_t), which partitions samples into csID and csOOD subsets using threshold τ\tau. Contrastive Prototype Entropy Adaptation applies entropy minimization to csID samples, entropy maximization to csOOD samples, and prototype-level contrastive learning to regularize feature representations. Dynamic Prototype Refinement periodically updates class-specific target prototypes using buffered csID features.

Uncertainty-Driven ID/OOD Separation

In open-set test-time adaptation, distinguishing between csID and csOOD samples is crucial for ensuring robust adaptation. This is particularly important because minimizing entropy on unknown-class samples can push them toward overconfident known-class predictions and induce harmful updates. Therefore, we propose the Uncertainty-Driven ID/OOD Separation, which combines prototype similarity with an evidence-derived uncertainty score to distinguish csID from csOOD samples. Specifically, we design an ID/OOD separation score for each sample xtx_t, denoted by S(xt)S(x_t), based on two criteria: 1) the similarity of the sample to known-class classifier prototypes, and 2) an evidence-derived uncertainty score computed from the online-model logits.

Prototype-Based Similarity. To estimate whether a target sample is close to the known source classes, we use the class-wise classifier weights as known-class prototypes. Specifically, we maintain a non-optimized reference copy Mref=(gref,href)M_{\mathrm{ref}}=(g_{\mathrm{ref}},h_{\mathrm{ref}}) initialized from the source model. The learnable parameters of this reference model are not updated during test-time adaptation, and gref(xt)g_{\mathrm{ref}}(x_t) is used to extract features for prototype-based scoring. Let wcw_c denote the classifier weight corresponding to class cc in the reference prediction head, where c∈{1,…,C}c\in\{1,\ldots,C\}. Since each classifier weight encodes a class-specific decision direction, it can be regarded as a prototype of the corresponding known class. We compute the prototype-based score by measuring the maximum cosine similarity between the sample feature and all classifier prototypes:

Sproto(xt)=1−max⁡c(⟨gref(xt),wc⟩∥gref(xt)∥2∥wc∥2).(2)S_{\mathrm{proto}}(x_t)=1-\max_c\left(\frac{\langle g_{\mathrm{ref}}(x_t),w_c\rangle}{\lVert g_{\mathrm{ref}}(x_t)\rVert_2\lVert w_c\rVert_2}\right). \tag*{(2)}

where ⟨⋅,⋅⟩\langle\cdot,\cdot\rangle denotes the inner product and ∥⋅∥2\lVert\cdot\rVert_2 denotes the L2L_2 norm. A lower Sproto(xt)S_{\mathrm{proto}}(x_t) indicates that the sample feature is close to a known-class classifier prototype, whereas a higher value suggests that the sample is less aligned with known classes and is more likely to be csOOD.

Uncertainty Estimation. Inspired by Evidential Deep Learning [54, 55], we incorporate uncertainty estimation to assess model confidence in its predictions. Specifically, we estimate evidence-derived uncertainty from the online model logits h=hϕt(gθt(xt))\mathbf{h} = h_{\phi_t}(g_{\theta_t}(x_t)). We first transform the logits into Dirichlet concentration parameters:

αc(xt)=softplus⁡(hc(xt))+1,T(xt)=∑c=1Cαc(xt),(3)\alpha_c(x_t) = \operatorname{softplus}(h_c(x_t)) + 1,\qquad T(x_t) = \sum_{c=1}^{C} \alpha_c(x_t), \tag*{(3)}

where T(xt)T(x_t) denotes the total Dirichlet strength. The raw evidence-derived uncertainty score is computed as

UEU(xt)=CT(xt)+ϵ,U_{\mathrm{EU}}(x_t) = \frac{C}{T(x_t) + \epsilon},
SEU(xt)=UEU(xt)−min⁡x∈BtUEU(x)max⁡x∈BtUEU(x)−min⁡x∈BtUEU(x)+ϵ,(4)S_{\mathrm{EU}}(x_t) = \frac{U_{\mathrm{EU}}(x_t) - \min_{x\in B_t} U_{\mathrm{EU}}(x)}{\max_{x\in B_t} U_{\mathrm{EU}}(x) - \min_{x\in B_t} U_{\mathrm{EU}}(x) + \epsilon}, \tag*{(4)}

where ϵ>0\epsilon> 0 is a small constant for numerical stability. Before score fusion, the raw uncertainty values are min–max normalized within the current mini-batch to obtain a bounded, batch-relative score that is more compatible in scale with the classifier-prototype score. A larger SEU(xt)S_{\mathrm{EU}}(x_t) indicates greater relative uncertainty within the current mini-batch.

ID/OOD Separation. After computing the classifier-prototype score and the mini-batch-normalized evidence-derived uncertainty score, we compute the joint separation score as

S(xt)=λSproto(xt)+(1−λ)SEU(xt),(5)S(x_t) = \lambda S_{\mathrm{proto}}(x_t) + (1-\lambda)S_{\mathrm{EU}}(x_t), \tag*{(5)}

where λ∈[0,1]\lambda\in[0,1] controls the relative contribution of the geometric and the evidence-derived uncertainty score. Finally, a threshold τ\tau is applied to the combined score S(xt)S(x_t) to classify the sample as either csID or csOOD:

xt∈{csID,if S(xt)<τ,csOOD,if S(xt)≥τ.(6)x_t \in \begin{cases} \mathrm{csID}, & \text{if } S(x_t) < \tau,\\ \mathrm{csOOD}, & \text{if } S(x_t) \ge\tau. \end{cases} \tag*{(6)}

Dynamic Prototype Refinement Strategy

To better track the evolving csID distribution while reducing the influence of csOOD samples, we introduce a Dynamic Prototype Refinement (DPR) strategy. DPR maintains a set of class-specific target prototypes {μc}c=1C\{\mu_c\}_{c=1}^{C} in the feature space, which provide class-level anchors for the subsequent contrastive prototype adaptation. Unlike the classifier prototypes used for ID/OOD separation, these target prototypes are refined online from reliable csID samples. In our implementation, all target prototypes are initialized as zero vectors and are updated after every η\eta effective mini-batches, where an effective mini-batch contains at least one sample identified as csID. We set η=10\eta= 10 by default.

For each incoming mini-batch, we first identify the csID subset Bt,csIDB_{t,\mathrm{csID}} using the ID/OOD separation strategy (see Sec. IV-A). For each selected sample x∈Bt,csIDx \in B_{t,\mathrm{csID}}, we extract its feature representation from the feature extractor of the current online model before the final prediction head, i.e., zx=gθt(x)z_x = g_{\theta_t}(x). We then assign a pseudo-label according to the current model prediction:

y^=arg⁡max⁡c  hϕtc(gθt(x)),(7)\hat{y} = \underset{c}{\arg\max}\; h_{\phi_t}^{c}(g_{\theta_t}(x)), \tag*{(7)}

where hϕtc(⋅)h_{\phi_t}^{c}(\cdot) denotes the logit of class cc and y^\hat{y} is the pseudo-label assigned to sample xx. The extracted features are stored in class-wise buffers according to their pseudo-labels. Let Fc\mathcal{F}_c denote the feature buffer for class cc within the current update interval. When a sample x∈Bt,csIDx \in B_{t,\mathrm{csID}} is pseudo-labeled as class cc, its feature zxz_x is added to Fc\mathcal{F}_c. A prototype-update counter is advanced only when the current mini-batch contributes at least one selected csID feature. After η\eta such effective mini-batches, the normalized buffered mean is computed for each non-empty buffer:

μcbuf=1∣Fc∣∑z∈Fcz∥1∣Fc∣∑z∈Fcz∥2.(8)\mu_c^{\mathrm{buf}} = \frac{\frac{1}{|\mathcal{F}_c|}\sum_{z\in\mathcal{F}_c} z} {\left\lVert\frac{1}{|\mathcal{F}_c|}\sum_{z\in\mathcal{F}_c} z \right\rVert_2}. \tag*{(8)}

The prototype of class cc is updated with a momentum rule:

μc←βμc+(1−β)μcbuf,(9)\mu_c \leftarrow\beta\mu_c + (1-\beta)\mu_c^{\mathrm{buf}}, \tag*{(9)}

where β∈[0,1]\beta\in[0,1] is the momentum coefficient. Since prototypes are initialized as zero vectors, if μc\mu_c has not been initialized by any previous non-empty buffer, we directly set

μc←μcbuf.(10)\mu_c \leftarrow\mu_c^{\mathrm{buf}}. \tag*{(10)}

If Fc\mathcal{F}_c is empty during the current update interval, μc\mu_c remains unchanged. After each update, the prototype is normalized as

μc←μc∥μc∥2.(11)\mu_c \leftarrow\frac{\mu_c}{\lVert\mu_c\rVert_2}. \tag*{(11)}

Finally, all class-wise buffers are cleared for the next update interval. This effective-batch-based refinement allows the target prototypes to gradually follow the shifted csID distribution while avoiding prototype updates when no reliable csID features are available. These refined prototypes serve as reliable anchors for contrastive prototype entropy adaptation.

Contrastive Prototype Entropy Adaptation

To ensure effective adaptation on an unlabeled target stream that mixes csID and csOOD samples, we introduce Contrastive Prototype Entropy Adaptation (CPEA). CPEA combines sample-level entropy optimization with prototype-level contrastive learning to promote confident adaptation on csID samples while suppressing csOOD-induced negative adaptation. The overall objective is defined as

Lt,total=Lentropy+γLcontrast,(12)\mathcal{L}_{t,\mathrm{total}} = \mathcal{L}_{\mathrm{entropy}} + \gamma\mathcal{L}_{\mathrm{contrast}}, \tag*{(12)}

where γ>0\gamma> 0 is the trade-off hyperparameter.

Entropy Optimization. Inspired by previous work [15, 56], we apply different entropy objectives to samples separated by Eq. (6). Specifically, entropy minimization on csID samples encourages confident predictions for shifted known-class samples and supports known-class adaptation. In contrast, entropy maximization on csOOD samples discourages overconfident assignment to any known class, thereby reducing harmful updates induced by unknown-class samples. The entropy losses are defined as

Lt,csID=1∣Bt,csID∣∑x∈Bt,csIDH(fθ(x)),(13)\mathcal{L}_{t,\mathrm{csID}} = \frac{1}{|B_{t,\mathrm{csID}}|}\sum_{x\in B_{t,\mathrm{csID}}} H(f_{\theta}(x)), \tag*{(13)}
Lt,csOOD=1∣Bt,csOOD∣∑x∈Bt,csOODH(fθt(x)),(14)\mathcal{L}_{t,\mathrm{csOOD}}=\frac{1}{\lvert B_{t,\mathrm{csOOD}}\rvert}\sum_{x\in B_{t,\mathrm{csOOD}}}H(f_{\theta_t}(x)), \tag*{(14)}
Lt,entropy=Lt,csID−α0Lt,csOOD−α1H(fˉθt),(15)\mathcal{L}_{t,\mathrm{entropy}}=\mathcal{L}_{t,\mathrm{csID}}-\alpha_0\mathcal{L}_{t,\mathrm{csOOD}}-\alpha_1H(\bar{f}_{\theta_t}), \tag*{(15)}

where H(fθt(x))=−∑c=1Cfθtc(x)log⁡fθtc(x)H(f_{\theta_t}(x))=-\sum_{c=1}^{C}f_{\theta_t}^{c}(x)\log f_{\theta_t}^{c}(x) is entropy of the softmax output fθt(x)f_{\theta_t}(x), and fˉθt\bar{f}_{\theta_t} is average softmax output over the batch BtB_t. Here, α0\alpha_0 controls entropy maximization on selected csOOD samples, whereas α1\alpha_1 controls the diversity regularizer on the mean batch prediction, which discourages prediction collapse onto a small subset of known classes.

Contrastive Optimization. To refine the feature space for csID samples and improve csOOD detection, we employ a contrastive optimization that aligns csID features with their corresponding class prototypes while repelling csOOD features from all prototypes. For samples identified as csID by the ID/OOD separation module, we assign pseudo-labels using the online model prediction and apply an InfoNCE-style loss to pull their normalized features toward the corresponding dynamic prototype:

LInfoNCE=−1∣Bt,csID∣∑x∈Bt,csIDlog⁡exp⁡(cos⁡θ(z,μy^)/τ0)∑c=1Cexp⁡(cos⁡θ(z,μc)/τ0).(16)\mathcal{L}_{\mathrm{InfoNCE}}=-\frac{1}{\lvert B_{t,\mathrm{csID}}\rvert}\sum_{x\in B_{t,\mathrm{csID}}}\log\frac{\exp(\cos\theta(z,\mu_{\hat{y}})/\tau_0)}{\sum_{c=1}^{C}\exp(\cos\theta(z,\mu_c)/\tau_0)}. \tag*{(16)}

where zz is the normalized feature, μy^\mu_{\hat{y}} is the prototype for the pseudo-label y^\hat{y}, and cos⁡θ\cos\theta is the cosine similarity. For csOOD samples, we introduce a repulsion term that minimizes their maximum cosine similarity to any prototype, effectively pushing their features away from csID class representations:

LOOD−repulse=1∣Bt,csOOD∣∑x∈Bt,csOODmax⁡ccos⁡θ(z,μc).(17)\mathcal{L}_{\mathrm{OOD-repulse}}=\frac{1}{\lvert B_{t,\mathrm{csOOD}}\rvert}\sum_{x\in B_{t,\mathrm{csOOD}}}\max_c\cos\theta(z,\mu_c). \tag*{(17)}

The contrastive loss in Eq. (12) is as follows:

Lcontrast=LInfoNCE+ρLOOD−repulse,(18)\mathcal{L}_{\mathrm{contrast}}=\mathcal{L}_{\mathrm{InfoNCE}}+\rho\mathcal{L}_{\mathrm{OOD-repulse}}, \tag*{(18)}

where ρ>0\rho>0 controls the contribution of the csOOD repulsion term. We set ρ=0.1\rho=0.1 in all experiments. When the csID subset is empty, its entropy term and the entire contrastive loss are set to zero, whereas for an empty csOOD subset, only its entropy and OOD-repulsion terms are set to zero, with InfoNCE retained.

Theoretical Motivations and Geometric Interpretation

This subsection provides a theoretical characterization of the three principal mechanisms underlying UAPA. We first establish a sufficient margin condition for the separability of the fused ID/OOD score and analyze its stability under bounded score perturbations. We then prove the one-step angular non-expansion of DPR toward the current buffered class direction. Finally, through similarity-gradient analysis, we characterize the stage-dependent prototype-relative effects of CPEA under zero-initialized target prototypes and establish the full nearest-prototype max–min geometric equivalence once all target prototypes have been initialized.

a) Conditional interpretation of the evidence-derived score. Recall from Eqs. (3)–(4) that UAPA first computes the raw evidence-derived uncertainty score UEU(x)=C/(T(x)+ϵ)U_{\mathrm{EU}}(x)=C/(T(x)+\epsilon) and then applies mini-batch min–max normalization. The raw score is strictly decreasing with respect to the total Dirichlet strength:

∂UEU∂T=−C(T+ϵ)2<0.(19)\frac{\partial U_{\mathrm{EU}}}{\partial T}=-\frac{C}{(T+\epsilon)^2}<0. \tag*{(19)}

Consequently, if an ID–OOD pair satisfies T(xid)>T(xood)T(x_{\mathrm{id}})>T(x_{\mathrm{ood}}), then UEU(xid)<UEU(xood)U_{\mathrm{EU}}(x_{\mathrm{id}})<U_{\mathrm{EU}}(x_{\mathrm{ood}}). In particular, suppose that there exist constants midm_{\mathrm{id}} and moodm_{\mathrm{ood}} such that

T(xid)≥mid>mood≥T(xood)(20)T(x_{\mathrm{id}})\ge m_{\mathrm{id}}>m_{\mathrm{ood}}\ge T(x_{\mathrm{ood}}) \tag*{(20)}

for all csID and csOOD samples under consideration. This uniform strength gap is sufficient for the raw score to rank every csID sample below every csOOD sample. This result is conditional on the learned logits and does not imply that a source-trained classifier necessarily satisfies Eq. (20).

For a fixed mini-batch, the normalization in Eq. (4) applies the same strictly increasing affine transformation to all raw scores in the batch. It therefore preserves the ordering of unequal raw scores:

UEU(xi)<UEU(xj)⟹SEU(xi)<SEU(xj).(21)U_{\mathrm{EU}}(x_i)<U_{\mathrm{EU}}(x_j)\Longrightarrow S_{\mathrm{EU}}(x_i)<S_{\mathrm{EU}}(x_j). \tag*{(21)}

However, the extrema used in the normalization depend on the current mini-batch. A raw-score threshold τEU\tau_{\mathrm{EU}} is mapped in batch BtB_t to

τ~t=τEU−min⁡x∈BtUEU(x)max⁡x∈BtUEU(x)−min⁡x∈BtUEU(x)+ϵ,(22)\widetilde{\tau}_t=\frac{\tau_{\mathrm{EU}}-\min_{x\in B_t}U_{\mathrm{EU}}(x)}{\max_{x\in B_t}U_{\mathrm{EU}}(x)-\min_{x\in B_t}U_{\mathrm{EU}}(x)+\epsilon}, \tag*{(22)}

which is generally batch dependent. Moreover, although softmax⁡(h+a1)=softmax⁡(h)\operatorname{softmax}(h+a\mathbf{1})=\operatorname{softmax}(h), the corresponding value of UEUU_{\mathrm{EU}} generally changes under the transformation h↦h+a1h\mapsto h+a\mathbf{1}. Therefore, UEUU_{\mathrm{EU}} should be interpreted as an evidence-derived uncertainty score that depends on the logit parameterization, rather than as a calibrated estimate of epistemic uncertainty. The normalization validly yields SEU∈[0,1]S_{\mathrm{EU}}\in[0,1], whereas Sproto∈[0,2]S_{\mathrm{proto}}\in[0,2]. Accordingly, λ\lambda balances two cues defined over different numerical ranges. We next characterize the fused score used by UAPA in Eq. (5). For analysis only, let It\mathcal{I}_t and Ot\mathcal{O}_t denote the non-empty latent csID and csOOD subsets of BtB_t, respectively. For each pair (xi,xo)∈It×Ot(x_i,x_o)\in\mathcal{I}_t\times\mathcal{O}_t, define

Δproto(xo,xi)=Sproto(xo)−Sproto(xi),(23)\Delta_{\mathrm{proto}}(x_o,x_i)=S_{\mathrm{proto}}(x_o)-S_{\mathrm{proto}}(x_i), \tag*{(23)}
ΔEU(xo,xi)=SEU(xo)−SEU(xi),(24)\Delta_{\mathrm{EU}}(x_o,x_i)=S_{\mathrm{EU}}(x_o)-S_{\mathrm{EU}}(x_i), \tag*{(24)}

and define the minimum fused pairwise margin as

Mt(λ)=min⁡xi∈Itxo∈Ot[λΔproto(xo,xi)+(1−λ)ΔEU(xo,xi)].(25)M_t(\lambda)=\min_{\substack{x_i\in\mathcal{I}_t\\x_o\in\mathcal{O}_t}}\left[\lambda\Delta_{\mathrm{proto}}(x_o,x_i)+(1-\lambda)\Delta_{\mathrm{EU}}(x_o,x_i)\right]. \tag*{(25)}

Proposition 1 (Conditional separability of the fused score). If Mt(λ)>0M_t(\lambda)>0, then

max⁡xi∈ItS(xi)<min⁡xo∈OtS(xo).(26)\max_{x_i\in\mathcal{I}_t}S(x_i)<\min_{x_o\in\mathcal{O}_t}S(x_o). \tag*{(26)}

Consequently, every threshold

τt∈(max⁡xi∈ItS(xi), min⁡xo∈OtS(xo)](27)\tau_t\in\left(\max_{x_i\in\mathcal{I}_t}S(x_i),\ \min_{x_o\in\mathcal{O}_t}S(x_o)\right] \tag*{(27)}

separates the two subsets in batch tt according to Eq. (6).

Proof. By Eqs. (5) and (25), every (xi,xo)∈It×Ot(x_i,x_o) \in\mathcal{I}_t \times\mathcal{O}_t satisfies

S(xo)−S(xi)≥Mt(λ)>0.(28)S(x_o)-S(x_i) \ge M_t(\lambda) > 0. \tag*{(28)}

Taking the minimum over xox_o and the maximum over xix_i yields Eq. (26). The decision rule then gives Eq. (27). □

A single fixed threshold is valid over a stream whenever

sup⁡tmax⁡xi∈ItS(xi)<τ≤inf⁡tmin⁡xo∈OtS(xo).(29)\sup_{t}\max_{x_i\in\mathcal{I}_t} S(x_i) < \tau\le\inf_{t}\min_{x_o\in\mathcal{O}_t} S(x_o). \tag*{(29)}

This proposition also makes the role of cue complementarity explicit. If both pairwise cue margins are positive, every convex combination preserves the ordering; if one cue is reversed, separation depends on λ\lambda and the two margin magnitudes. If the two component scores are perturbed by at most δproto\delta_{\mathrm{proto}} and δEU\delta_{\mathrm{EU}} per sample, the ordering remains robust whenever Mt(λ)>2[λδproto+(1−λ)δEU]M_t(\lambda) > 2[\lambda\delta_{\mathrm{proto}} + (1-\lambda)\delta_{\mathrm{EU}}].

Compared with GMM-based gating, the raw evidence-derived score UEU(x)U_{\mathrm{EU}}(x) is computed directly from the sample logits without fitting additional mixture parameters. Its normalized counterpart SEU(x)S_{\mathrm{EU}}(x) remains batch-relative because it depends on the extrema of the current mini-batch. Nevertheless, the normalization does not require an additional distribution-fitting stage. Combined with the classifier-prototype score, it provides predictive and geometric cues for csID/csOOD partitioning in streaming test-time adaptation.

b) Directional alignment induced by DPR: Consider class cc with an initialized target prototype and a nonzero buffered feature mean. Let μc,μcbuf∈Sd−1\mu_c,\mu_c^{\mathrm{buf}} \in\mathbb{S}^{d-1} denote their normalized directions. Combining Eqs. (9)–(11) gives

vc=βμc+(1−β)μcbuf,μc+=vc∥vc∥2,β∈[0,1].(30)v_c = \beta\mu_c + (1-\beta)\mu_c^{\mathrm{buf}}, \qquad\mu_c^+ = \frac{v_c}{\lVert v_c\rVert_2}, \qquad\beta\in[0,1]. \tag*{(30)}

Proposition 2 (One-step angular non-expansion under DPR). Under Eq. (30), if μc≠−μcbuf\mu_c \ne-\mu_c^{\mathrm{buf}}, then

∠(μc+,μcbuf)≤∠(μc,μcbuf).(31)\angle(\mu_c^+,\mu_c^{\mathrm{buf}}) \le\angle(\mu_c,\mu_c^{\mathrm{buf}}). \tag*{(31)}

Proof. Let θ=∠(μc,μcbuf)∈[0,π)\theta= \angle(\mu_c,\mu_c^{\mathrm{buf}}) \in[0,\pi). For θ=0\theta= 0, the result is immediate. For θ∈(0,π)\theta\in(0,\pi), there exists a unit vector ee orthogonal to μcbuf\mu_c^{\mathrm{buf}} in the two-dimensional subspace spanned by the two directions such that

μc=cos⁡θ μcbuf+sin⁡θ e.(32)\mu_c = \cos\theta\,\mu_c^{\mathrm{buf}} + \sin\theta\,e. \tag*{(32)}

Substituting this expression into Eq. (30) gives

vc=[βcos⁡θ+(1−β)]μcbuf+βsin⁡θ e.(33)v_c = [\beta\cos\theta+ (1-\beta)]\mu_c^{\mathrm{buf}} + \beta\sin\theta\,e. \tag*{(33)}

Let ϕ=∠(μc+,μcbuf)\phi= \angle(\mu_c^+,\mu_c^{\mathrm{buf}}). The assumption μc≠−μcbuf\mu_c \ne-\mu_c^{\mathrm{buf}} ensures that vc≠0v_c \ne0, so ϕ\phi is well defined. Direct calculation yields

sin⁡(θ−ϕ)=(1−β)sin⁡θ∥vc∥2≥0.(34)\sin(\theta-\phi) = \frac{(1-\beta)\sin\theta}{\lVert v_c\rVert_2} \ge0. \tag*{(34)}

Because θ−ϕ∈(−π,π)\theta-\phi\in(-\pi,\pi), the above inequality implies θ−ϕ≥0\theta-\phi\ge0, and hence ϕ≤θ\phi\le\theta. This proves Eq. (31). □

Proposition 2 establishes one-step alignment toward the buffered class direction, rather than toward the unobserved target-class center. Therefore, interpreting DPR as tracking the target distribution requires that the ID/OOD separation and pseudo-label assignments yield a buffered direction μcbuf\mu_c^{\mathrm{buf}} that sufficiently approximates the csID class direction.

c) Prototype-relative geometry induced by CPEA: The entropy terms in Eqs. (13)–(15) operate on output probabilities and contain no explicit feature–prototype distance. Their prototype-relative geometric effect is therefore indirect. At adaptation step tt, let

Vt={c∈{1,…,C}:∥μc∥2>0}\mathcal{V}_t = \{c \in\{1,\ldots,C\} : \lVert\mu_c\rVert_2 > 0\}

denote the set of initialized target prototypes. In the implementation, the contrastive terms are evaluated over all CC prototype coordinates. Under the epsilon-stabilized row-wise normalization used in the implementation, every nonzero prototype is normalized whereas each zero prototype remains unchanged. Therefore, ∥μc∥2=1\lVert\mu_c\rVert_2 = 1 for c∈Vtc \in\mathcal{V}_t, whereas μc=0\mu_c = 0 for c∉Vtc \notin\mathcal{V}_t. Let z∈Sd−1z \in\mathbb{S}^{d-1} and sc=⟨z,μc⟩s_c = \langle z,\mu_c\rangle for c∈{1,…,C}c \in\{1,\ldots,C\}.

For a selected csID sample with pseudo-label y^\hat{y}, define

qc=exp⁡(sc/τ0)∑j=1Cexp⁡(sj/τ0).(35)q_c = \frac{\exp(s_c/\tau_0)}{\sum_{j=1}^{C}\exp(s_j/\tau_0)}. \tag*{(35)}

The single-sample InfoNCE term satisfies

∂ℓInfoNCE∂sy^=qy^−1τ0≤0,∂ℓInfoNCE∂sc=qcτ0≥0,c≠y^,(36)\frac{\partial\ell_{\mathrm{InfoNCE}}}{\partial s_{\hat{y}}} = \frac{q_{\hat{y}}-1}{\tau_0} \le0, \qquad\frac{\partial\ell_{\mathrm{InfoNCE}}}{\partial s_c} = \frac{q_c}{\tau_0} \ge0,\qquad c\ne\hat{y}, \tag*{(36)}

and the ambient Euclidean gradient with respect to the normalized coordinate zz is

∇zℓInfoNCE=1τ0(∑c=1Cqcμc−μy^).(37)\nabla_z\ell_{\mathrm{InfoNCE}} = \frac{1}{\tau_0}\left(\sum_{c=1}^{C}q_c\mu_c-\mu_{\hat{y}}\right). \tag*{(37)}

When y^∈Vt\hat{y}\in\mathcal{V}_t, minimizing the InfoNCE term favors a larger relative margin between the initialized pseudo-label prototype and its competitors. Since, for each c∈Vtc\in\mathcal{V}_t,

∥z−μc∥22=2−2⟨z,μc⟩,(38)\lVert z-\mu_c\rVert_2^2 = 2 - 2\langle z,\mu_c\rangle, \tag*{(38)}

increasing sy^s_{\hat{y}} reduces the corresponding Euclidean and angular distances on the unit sphere. With correct pseudo-labels and informative prototypes, this provides a prototype-centered regularization effect; it does not by itself guarantee global inter-class compactness. When y^∉Vt\hat{y}\notin\mathcal{V}_t, the pseudo-label prototype remains zero, so the loss provides no attraction toward that uninitialized prototype. If Vt=∅\mathcal{V}_t=\varnothing, all similarities are zero, and the InfoNCE loss equals log⁡C\log C with zero gradient with respect to zz. For a selected csOOD sample in a mini-batch where the contrastive loss is active, the implemented repulsion term is

ℓrep(z)=max⁡1≤c≤C⟨z,μc⟩.(39)\ell_{\mathrm{rep}}(z) = \max_{1\le c\le C}\langle z,\mu_c\rangle. \tag*{(39)}

When all target prototypes are initialized, i.e., Vt={1,…,C}\mathcal{V}_t=\{1,\ldots,C\}, Eq. (38) gives

arg⁡min⁡z∈Sd−1 max⁡1≤c≤C ⟨z,μc⟩=arg⁡max⁡z∈Sd−1 min⁡1≤c≤C ∥z−μc∥22.(40)\underset{z\in\mathbb{S}^{d-1}}{\arg\min}\ \underset{1\le c\le C}{\max}\ \langle z,\mu_c\rangle= \underset{z\in\mathbb{S}^{d-1}}{\arg\max}\ \underset{1\le c\le C}{\min}\ \lVert z-\mu_c\rVert_2^2. \tag*{(40)}

Thus, in the fully initialized regime, minimizing the repulsion term is equivalent to maximizing the minimum squared distance between a selected csOOD feature and the target prototype set.

If Vt=∅\mathcal{V}_t=\varnothing, all target prototypes are zero and ℓrep(z)=0\ell_{\mathrm{rep}}(z)=0. When ∅≠Vt⊊{1,…,C}\varnothing\ne\mathcal{V}_t\subsetneq\{1,\ldots,C\}, at least one target prototype remains uninitialized. The corresponding zero similarities yield

ℓrep(z)=max⁡{0,max⁡c∈Vt⟨z,μc⟩}.(41)\ell_{\mathrm{rep}}(z)=\max\left\{0,\max_{c\in\mathcal{V}_t}\langle z,\mu_c\rangle\right\}. \tag*{(41)}

The repulsion term therefore penalizes only the maximum positive similarity between the selected csOOD feature and the initialized prototypes. Together with InfoNCE, it provides stage-dependent, prototype-relative regularization for csID alignment and csOOD separation.

Experiments

Experimental Settings

Datasets. Our experimental setup is designed to construct open-set test streams containing both csID and csOOD samples, where the test data is a composite of both csID and csOOD samples. The csID component is sourced from three standard corruption benchmarks: CIFAR-10-C, CIFAR-100-C, and Tiny-ImageNet-C [59], where we consistently use the most severe corruption setting, level 5. To create the matching csOOD component, we adopt the protocol from OSTTA [20] and apply identical corruption functions to the original SVHN and ImageNet-O test sets, generating SVHN-C and ImageNet-O-C. The SVHN-C provides the csOOD samples for the CIFAR-C benchmarks, while ImageNet-O-C is paired with Tiny-ImageNet-C, thus forming the final mixed-distribution test sets. In addition, to evaluate robustness under small-gap settings, we follow the STAMP [34] and construct CIFAR-10/CIFAR-100 splits with an 8:2 ratio of ID to OOD classes.

Evaluation protocols. Following previous studies [20], the model adapts to sequentially arriving domains without parameter resets. For each mini-batch, predictions are made before the model is updated, ensuring no future information influences current outputs. In the main evaluation, each mini-batch contains equal numbers of csID and csOOD samples. Additional experiments evaluate varying csOOD ratios from 10% to 90%. Performance is quantified using four metrics. Accuracy (Acc) measures classification performance on csID samples. Open-set detection capability is evaluated via AUROC and FPR@95TPR. To assess the trade-off between classification and detection, we report the Open-Set Classification Rate (OSCR) for a balanced view.

Baselines. We compare UAPA with representative closed-set TTA methods, including BN Adapt [57], CoTTA [58], TENT [18], EATA [19], SAR [22], and COME [21], as well as open-set TTA methods, including OSTTA [20], UniEnt [15] and ROSETTA [16].

Implementation details. Following previous studies [20], experiments on CIFAR benchmarks adopt WideResNet-40-2 [60] pretrained from RobustBench [61]. For Tiny-ImageNet-C, we evaluate on two representative architectures, ResNet-50 [1] and ViT-Base [2], to verify architectural generality. ResNet-50 is trained on Tiny-ImageNet using SGD for 50 epochs, while ViT-Base is fine-tuned on the same dataset using Adam for 100 epochs. During TTA, all methods use the Adam optimizer with batch size 100. For CNN-based models, adaptation is applied to Batch Normalization affine parameters, while for ViT-based models we adapt Layer Normalization affine parameters, following standard practice in TTA. Learning rates for all baselines follow their official implementations or standard settings, including 0.001 for TENT, EATA, and OSTTA; 0.01 for CoTTA; and 0.0001 for SAR and COME. For UAPA, we use a learning rate of 0.001. The prototype momentum, contrastive temperature, OOD-repulsion coefficient, and prototype-update interval are fixed as β=0.9\beta= 0.9, τ0=0.1\tau_0 = 0.1, ρ=0.1\rho= 0.1, and η=10\eta= 10, respectively. The remaining trade-off parameters (λ\lambda, τ\tau, γ\gamma, α0\alpha_0, α1\alpha_1) are kept fixed within each benchmark. The configurations on Tiny-ImageNet-C with ResNet and ViT: (0.9, 0.65, 0.2, 1.0, 0.1) and (0.7, 0.9, 0.1, 1.0, 1.0). Experiments are conducted on an 80G memory-sized NVIDIA A800 GPU using PyTorch 1.12.1. We use a fixed random seed of 1 for all experiments. Unless otherwise specified, UAPA is instantiated with TENT as the base adaptation method in the main experiments.

Comparison Experiments

CIFAR benchmarks. As shown in Table I, UAPA consistently improves open-set detection performance over strong baselines on CIFAR-10-C and CIFAR-100-C. On CIFAR-10-C, UAPA achieves competitive classification accuracy (84.53%) while obtaining the best AUROC (96.18%) and the lowest FPR@95TPR (13.57%). Compared to UniEnt, this corresponds to a 63.6% relative reduction in false positives, indicating improved separation between csID and csOOD samples. On CIFAR-100-C, UAPA further achieves the best performance across all OOD detection metrics, reducing FPR@95TPR to 27.59%, which is 50.8% lower than EATA. These results demonstrate consistent improvements in open-set robustness under severe distribution shifts.

MethodCIFAR-10-CCIFAR-100-CAverage
Acc↑\uparrowAUROC↑\uparrowFPR@95TPR↓\downarrowOSCR↑\uparrowAcc↑\uparrowAUROC↑\uparrowFPR@95TPR↓\downarrowOSCR↑\uparrowAcc↑\uparrowAUROC↑\uparrowFPR@95TPR↓\downarrowOSCR↑\uparrow
Source81.7377.8979.4768.4453.2560.5594.9739.8767.4969.2287.2254.16
BN Adapt [57]84.2080.4076.8572.1357.1672.4584.2947.1070.6876.4380.5759.62
CoTTA [58]85.7485.8172.7777.1756.5077.0680.9849.0071.1281.4476.8863.09
TENT [18]79.1267.7995.7658.2750.1959.4293.5436.2564.6663.6194.6547.26
EATA [19]76.1755.4392.8846.6661.3487.0556.0657.2768.7671.2474.4751.97
SAR [22]78.4166.1796.1356.7959.6771.7083.5648.6869.0468.9489.8552.74
COME [21]85.3175.3484.0169.2958.0972.2879.2447.4971.7073.8181.6358.39
OSTTA [20]84.2472.6776.9864.9860.0375.0982.7851.2372.1473.8879.8858.11
UniEnt [15]84.3492.1537.2580.2459.0188.0757.1755.9571.6890.1147.2168.10
ROSETTA [16]84.9085.0666.0076.3459.5387.0261.6156.0772.2286.0463.8166.21
UAPA (Ours)84.5396.1813.5782.2760.1493.2627.5958.0872.3494.7220.5870.18

Table I. Performance comparison on CIFAR-10-C and CIFAR-100-C using a WideResNet-40-2 backbone. ↑\uparrow indicates higher is better, ↓\downarrow lower is better. Best in bold and second best in <u>underlined</u>. ‘Ours’ denotes TENT with our UAPA.

Tiny-ImageNet-C. As shown in Table II, UAPA achieves strong performance across both ResNet-50 and ViT-Base backbones. On ResNet-50, it attains the highest AUROC and OSCR, while maintaining competitive accuracy. On ViT-Base, UAPA achieves the best performance in accuracy and OSCR, with an OSCR of 21.70%, outperforming all compared methods. Overall, the results verify the effectiveness and generality of UAPA across architectures.

MethodResNet-50ViT-BaseAverage
Acc↑\uparrowAUROC↑\uparrowFPR@95TPR↓\downarrowOSCR↑\uparrowAcc↑\uparrowAUROC↑\uparrowFPR@95TPR↓\downarrowOSCR↑\uparrowAcc↑\uparrowAUROC↑\uparrowFPR@95TPR↓\downarrowOSCR↑\uparrow
Source22.3648.1190.8015.8122.0948.4594.8516.2922.2348.2892.8316.05
BN Adapt [57]33.7956.4387.8025.60--------
CoTTA [58]32.6847.6092.2722.4516.1740.9995.3810.3024.4344.3093.8316.38
TENT [18]25.4552.2294.2917.4826.4552.7095.1319.6525.9552.4694.7118.57
EATA [19]34.4655.8692.5225.9227.9552.6195.1421.3131.2154.2493.8323.62
SAR [22]34.4154.1893.7424.9922.3448.6494.8116.3728.3851.4194.2820.68
COME [21]34.2849.2793.9223.6522.4048.8094.7016.4128.3449.0494.3120.03
OSTTA [20]34.7553.0095.2925.5427.0249.2596.0620.1730.8951.1395.6822.86
UniEnt [15]34.4561.7791.5327.7524.2446.8696.1117.6729.3554.3293.8222.71
ROSETTA [16]34.0965.6287.2527.7523.8548.7896.4316.8428.9757.2091.8422.30
UAPA (Ours)33.8567.4781.0628.1028.5352.8795.3721.7031.1960.1788.2224.90

Table II. Performance comparison on Tiny-ImageNet-C across different backbones (ResNet-50 and ViT-Base). ‘-’ indicates the experiment was not applicable. Best in bold and second best in <u>underlined</u>. ‘Ours’ is TENT with our UAPA.

Ablation Studies

Effectiveness of Uncertainty-Driven ID/OOD Separation. We evaluate the contribution of the two components in

the proposed ID/OOD separation module by removing Uncertainty Estimation (w/o UE) and Prototype-based Similarity (w/o PS), respectively. As shown in Table III, removing either component degrades the overall performance. Without Uncertainty Estimation, the average AUROC decreases from 94.72% to 92.11%, and the average FPR@95TPR increases from 20.58% to 35.60%, indicating that evidence-derived uncertainty is important for identifying uncertain csOOD samples. Removing Prototype-based Similarity causes a larger drop in OSCR, from 70.18% to 59.69%, suggesting that classifier-prototype similarity provides complementary geometric cues for separating csID and csOOD samples.

MethodCIFAR-10-CCIFAR-100-CAverage
Acc↑AUROC↑FPR@95TPR↓OSCR↑Acc↑AUROC↑FPR@95TPR↓OSCR↑Acc↑AUROC↑FPR@95TPR↓OSCR↑
TENT79.1267.7995.7658.2750.1959.4293.5436.2564.6663.6194.6547.26
w/o PS78.4685.4036.2169.2253.6090.1427.1850.1666.0387.7731.7059.69
w/o UE84.8789.8845.1379.1056.9694.3326.0755.5170.9292.1135.6067.31
w/o DPR84.3593.5728.1080.9559.6486.7551.7055.3272.0090.1639.9068.14
w/o CL84.3893.2826.0580.6660.0389.5839.4056.5972.2191.4332.7368.63
Ours84.5396.1813.5782.2760.1493.2627.5958.0872.3494.7220.5870.18

Table III. Ablation experiments on CIFAR-10-C and CIFAR-100-C using a WideResNet-40-2 backbone. ‘PS’ denotes Prototype-based Similarity, ‘UE’ denotes Uncertainty Estimation, ‘DPR’ denotes Dynamic Prototype Refinement strategy, and ‘CL’ denotes Contrastive Learning Optimization.

Effectiveness of Dynamic Prototype Refinement Strategy. We further remove the DPR strategy (w/o DPR) to evaluate the role of online prototype updates. Compared with the complete method, w/o DPR reduces the average AUROC from 94.72% to 90.16% and increases FPR@95TPR from 20.58% to 39.90%. This indicates that periodically refining target prototypes with selected csID samples helps maintain reliable class anchors under distribution shifts and reduces prototype contamination from csOOD samples.

Effectiveness of Contrastive Prototype Entropy Adaptation. We evaluate the contribution of contrastive optimization by removing the contrastive learning term (w/o CL). From Table III, removing this term reduces the average OSCR from 70.18% to 68.63% and increases FPR@95TPR from 20.58% to 32.73%. These results suggest that prototype-level contrastive learning improves feature separation by pulling csID features toward class prototypes while reducing the similarity between csOOD features and known-class prototypes.

More Discussions

Robustness under small-gap settings. We evaluate UAPA under the small-gap setting, where ID and OOD classes are semantically closer and thus harder to distinguish. As shown in Table IV, UAPA achieves the best Acc, AUROC, and OSCR among the compared methods, while remaining competitive in FPR@95TPR. Specifically, UAPA improves AUROC by 1.38 percentage points and OSCR by 1.83 percentage points over the second-best methods. These results indicate that UAPA remains effective when ID and OOD classes are difficult to separate. The improvement is consistent with the design of uncertainty-driven csID/csOOD separation and contrastive prototype adaptation, which provide complementary cues for handling subtle open-set differences.

MethodAcc↑AUROC↑FPR@95TPR↓OSCR↑
Source66.8146.7593.9936.13
BN Adapt [57]72.7062.0691.3052.15
CoTTA [58]72.7461.6589.9651.42
TENT [18]73.6861.1694.7751.55
EATA [19]73.1661.3487.4950.52
SAR [22]73.5362.0191.8652.63
COME [21]72.6262.9290.8652.81
OSTTA [20]73.7559.4086.8850.32
UniEnt [15]73.7062.2186.6952.68
ROSETTA [16]71.7861.4493.0051.96
UAPA (Ours)74.4764.3088.0354.64

Table IV. Results under the small-gap classes setting, where CIFAR-10/CIFAR-100 classes are split into 8:2 (ID: OOD). This setting poses a more challenging scenario.

t-SNE visualization. To illustrate the effects of different methods on csID classification and csOOD detection, we visualize the feature representations of CIFAR-10-C test samples, with SVHN-C test samples serving as csOOD samples using t-SNE [62], as shown in Figure 3. As observed, after adaptation with TENT, the feature distributions of known-class (csID) and unknown-class (csOOD) samples are mixed. Although UniEnt shows some improvement in distinguishing csID and csOOD samples, there is still considerable overlap, with some csID samples being mixed with csOOD samples. In contrast, UAPA produces more compact csID clusters and a clearer visual separation between csID and csOOD samples. This qualitative observation is consistent with the prototype-relative feature regularization introduced by CPEA, which attracts csID features toward their corresponding target prototypes and reduces the maximum similarity between csOOD features and known-class prototypes.

t-SNE visualizations of Source, TENT, UniEnt, and UAPA features

Figure 3. t-SNE visualization of CIFAR-10-C and SVHN-C features, where SVHN-C samples are treated as csOOD. Yellow denotes csOOD samples, while the remaining colors denote different csID classes.

Comparison with GMM-based ID/OOD Separation. To evaluate our ID/OOD separation mechanism, we construct a variant that replaces it with a UniEnt-style Gaussian Mixture Model (GMM) gate, while keeping all other components unchanged. As shown in Table V, the GMM-based variant outperforms the Source and TENT baselines across all metrics, showing that the overall framework remains effective with an alternative separation strategy. Nevertheless, the full model achieves better results than the GMM-based variant across all metrics on both CIFAR-10-C and CIFAR-100-C. On average, the proposed separation mechanism reduces FPR@95TPR by 5.32 percentage points and improves OSCR by 0.76 percentage points over the GMM-based alternative. These results suggest that combining the classifier-prototype score with the mini-batch-normalized evidence-derived uncertainty score yields a more effective csID/csOOD partition than the evaluated GMM-based alternative under the current protocol.

MethodCIFAR-10-CCIFAR-100-CAverage
Acc↑\uparrowAUROC↑\uparrowFPR@95TPR↓\downarrowOSCR↑\uparrowAcc↑\uparrowAUROC↑\uparrowFPR@95TPR↓\downarrowOSCR↑\uparrowAcc↑\uparrowAUROC↑\uparrowFPR@95TPR↓\downarrowOSCR↑\uparrow
Source81.7377.8979.4768.4453.2560.5594.9739.8767.4969.2287.2254.16
TENT [18]79.1267.7995.7658.2750.1959.4293.5436.2564.6663.6194.6547.26
Ours (w/ GMM [15])84.4595.6718.1682.1259.2092.3033.6456.7271.8393.9925.9069.42
UAPA (Ours)84.5396.1813.5782.2760.1493.2627.5958.0872.3494.7220.5870.18

Table V. Performance comparison of different ID/OOD separation strategies on CIFAR-10-C and CIFAR-100-C using a WideResNet-40-2 backbone. “Ours (w/ GMM)” replaces the proposed Uncertainty-Driven ID/OOD Separation with a UniEnt-style GMM gate, while keeping all other components unchanged.

Robustness to varying csOOD ratios. To examine the sensitivity of UAPA to open-set stream composition, we vary the csOOD proportion in each test mini-batch from 10% to 90% on CIFAR-10-C while keeping the remaining settings unchanged. As shown in Figure 4, UAPA achieves the highest OSCR at every evaluated ratio. Its gains over the strongest competing method are 1.41, 1.62, 2.06, 3.28, and 0.61 percentage points at csOOD ratios of 10%, 30%, 50%, 70%, and 90%, respectively. The performance of UAPA remains stable from 10% to 70% csOOD. Although its OSCR decreases when csOOD samples dominate the stream at a ratio of 90%, it still performs best among the compared methods. These results show that UAPA remains effective across varying csID/csOOD compositions, including highly imbalanced test streams.

Figure 4. OSCR comparison on CIFAR-10-C under varying csOOD ratios. Values above UAPA denote its gains in percentage points over the strongest baseline at each ratio.

Plug-and-Play Compatibility of UAPA. To assess the plug-and-play compatibility of our proposed UAPA, we incorporate it into four representative adaptation methods, including TENT [18], EATA [19], OSTTA [20], and COME [21]. For each baseline, we retain its original adaptation objective, update strategy, and method-specific components, while incorporating UAPA’s sample separation, prototype refinement, and contrastive regularization, unless otherwise stated. As shown in Figure 1, Table VI and Table VII, incorporating UAPA improves open-set detection and OSCR across all evaluated baselines. On the CIFAR benchmarks, combining UAPA with TENT increases the average OSCR from 47.26% to 70.18% and reduces FPR@95TPR from 94.65% to 20.58%. It also improves the average OSCR of EATA, COME, and OSTTA by 17.68, 3.12, and 10.37 percentage points, respectively. Although the magnitude of improvement varies across baselines, the consistent gains indicate that UAPA is compatible with different adaptation objectives. On Tiny-ImageNet-C, UAPA also improves the OSCR of all four baselines while introducing only about 0.3 ms of additional processing time per image. In particular, when combined with TENT, it improves OSCR by 10.62 percentage points with an additional latency of 0.22 ms per image. These results indicate a favorable performance–latency trade-off and support the use of UAPA as a plug-in module for open-set test-time adaptation.

MethodCIFAR-10-C Acc↑CIFAR-10-C AUROC↑CIFAR-10-C FPR@95TPR↓CIFAR-10-C OSCR↑CIFAR-100-C Acc↑CIFAR-100-C AUROC↑CIFAR-100-C FPR@95TPR↓CIFAR-100-C OSCR↑Average Acc↑Average AUROC↑Average FPR@95TPR↓Average OSCR↑
TENT79.1267.7995.7658.2750.1959.4293.5436.2564.6663.6194.6547.26
+ UAPA84.5396.1813.5782.2760.1493.2627.5958.0872.3494.7220.5870.18
EATA76.1755.4392.8846.6661.3487.0556.0657.2768.7671.2474.4751.97
+ UAPA84.6992.7527.2480.2361.5192.1634.3059.0773.1092.4630.7769.65
COME85.3175.3484.0169.2958.0972.2879.2447.4971.7073.8181.6358.39
+ UAPA84.8779.5373.2871.5459.9376.5678.6151.4872.4078.0575.9561.51
OSTTA84.2472.6776.9864.9860.0375.0982.7851.2372.1473.8879.8858.11
+ UAPA84.5592.5826.1579.8160.5989.5438.4857.1572.5791.0632.3268.48

Table VI. Plug-and-play performance of UAPA on CIFAR-10-C, CIFAR-100-C, and their average results.

MethodAcc↑AUROC↑FPR@95TPR↓OSCR↑Time (ms)↓
TENT [18]25.4552.2294.2917.48-
+ UAPA33.8567.4781.0628.10+0.22
EATA [19]34.4655.8692.5225.92-
+ UAPA35.4756.9488.7227.43+0.26
OSTTA [20]34.7553.0095.2925.54-
+ UAPA34.8753.3492.9525.68+0.31
COME [21]34.2849.2793.9223.65-
+ UAPA35.1955.6188.8026.56+0.33

Table VII. Results of different methods on Tiny-ImageNet-C with ResNet-50 backbone. We report Accuracy (Acc), AUROC, FPR@95TPR, OSCR, and the per-image additional inference time introduced by UAPA (in milliseconds).

Robustness under the Single-Class-per-Batch Setting. We evaluate the proposed UAPA under a single-class-per-batch setting, where each test mini-batch contains samples from only one class. This setting represents an extreme form of batch-level class imbalance, in which each update observes only partial class information and lacks within-batch class diversity. In UAPA, prototype similarity is computed using the normalized weights of the pretrained classifier head, which provide class references independent of the class composition of the current mini-batch. Meanwhile, DPR accumulates features from samples identified as csID in class-wise buffers and leaves prototypes of unobserved classes unchanged, thereby avoiding unsupported prototype updates under incomplete batch observations. From Table VIII, UAPA achieves the highest Acc, AUROC, and OSCR in this setting. Nevertheless, FPR@95TPR remains high at 94.54%, indicating that reliable csOOD rejection is still challenging under the single-class-per-batch setting. Compared with the second-best results, UAPA improves Acc by 0.26 percentage points and OSCR by 0.63 percentage points. The results suggest that the combination of batch-independent classifier prototypes and buffered target-prototype refinement helps UAPA remain effective when each mini-batch contains only limited class information.

MethodAcc↑AUROC↑FPR@95TPR↓OSCR↑
Source22.0948.4594.8516.29
BN Adapt [57]22.0951.9694.5216.54
CoTTA [58]15.1342.0495.459.40
TENT [18]14.8647.9296.0510.07
EATA [19]22.2651.9894.6416.64
SAR [22]22.2451.7694.5816.50
COME [21]22.3452.0594.3416.61
OSTTA [20]23.0550.8395.3217.00
UniEnt [15]22.6352.0494.8316.76
ReTA [16]22.7149.3196.1216.24
UAPA (Ours)23.3152.6894.5417.63

Table VIII. Results on Tiny-ImageNet-C with ViT-Base under the single-class-per-batch setting.

Hyperparameter Analysis. We examine the effects of the score-balance weight λ\lambda, separation threshold τ\tau, and contrastive-loss weight γ\gamma on Tiny-ImageNet-C. As shown in Figure 5, UAPA maintains competitive performance over a reasonably broad range around the selected values. The contrastive-loss weight γ\gamma has a relatively mild effect on both backbones. The score-balance weight λ\lambda exhibits a broad high-performing range, although ResNet-50 benefits more from larger values. The separation threshold τ\tau shows backbone-dependent preferred ranges because it directly controls the csID/csOOD partition and the resulting score distributions differ across architectures. Overall, the selected configurations lie within stable operating regions rather than isolated optima.

Figure 5. Effect of key hyperparameters on OSCR on Tiny-ImageNet-C with ResNet-50 and ViT-Base backbones. We vary one hyperparameter at a time while keeping the others fixed at their selected values.

Conclusion

In this paper, we propose Uncertainty-Aware Prototype Learning for Open-Set Test-Time Adaptation (UAPA), a plug-and-play method for test streams containing both csID and csOOD samples. Specifically, UAPA combines a classifier-prototype score with a mini-batch-normalized evidence-derived uncertainty score to separate csID and csOOD samples. UAPA further employs Dynamic Prototype Refinement to update class-specific target prototypes from buffered features of selected csID samples. Contrastive Prototype Entropy Adaptation then combines class-conditional entropy optimization with prototype-level contrastive learning to increase pseudo-label-relative similarity margins for csID features and reduce the maximum similarity between csOOD features and initialized known-class prototypes. Experimental results on CIFAR-C and Tiny-ImageNet-C with both CNN and ViT backbones demonstrate the effectiveness of UAPA, consistently improving open-set classification and detection with limited additional computational cost.

References

  1. [1]K. He, X. Zhang, S. Ren, and J. Sun, “Deep residual learning for image recognition,” in 2016 IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2016, Las Vegas, NV, USA, June 27-30, 2016. IEEE Computer Society, 2016, pp. 770–778.arxiv.org/abs/1512.03385
  2. [2]A. Dosovitskiy, L. Beyer, A. Kolesnikov, D. Weissenborn, X. Zhai, T. Unterthiner, M. Dehghani, M. Minderer, G. Heigold, S. Gelly, J. Uszkoreit, and N. Houlsby, “An image is worth 16x16 words: Transformers for image recognition at scale,” in 9th International Conference on Learning Representations, ICLR 2021, Virtual Event, Austria, May 3-7, 2021. OpenReview.net, 2021.
  3. [3]A. Conti, E. Fini, M. Mancini, P. Rota, Y. Wang, and E. Ricci, “Vocabulary-free image classification and semantic segmentation,” IEEE Trans. Pattern Anal. Mach. Intell., vol. 48, no. 6, pp. 6127–6138, 2026.DOI
  4. [4]J. Wu, Z. Li, W. Sun, J. Yin, L. Nie, and Z. Lin, “Clustmatch: Improving deep clustering by unified positive and negative pseudo-label learning,” IEEE Trans. Pattern Anal. Mach. Intell., vol. 47, no. 11, pp. 9688–9701, 2025.DOI
  5. [5]Z. Zhuang, Z. Wang, S. Chen, L. Liu, H. Luo, and M. Tan, “Robust 3d semantic occupancy prediction with calibration-free spatial transformation,” IEEE Trans. Pattern Anal. Mach. Intell., pp. 1–16, 2026.DOI
  6. [6]Z. Wang, Z. Huang, Y. Gao, N. Wang, and S. Liu, “Mv2dfusion: Leveraging modality-specific object semantics for multi-modal 3d detection,” IEEE Trans. Pattern Anal. Mach. Intell., vol. 48, no. 1, pp. 609–623, 2026.DOI
  7. [7]K. Zhou, Z. Liu, Y. Qiao, T. Xiang, and C. C. Loy, “Domain generalization: A survey,” IEEE Trans. Pattern Anal. Mach. Intell., vol. 45, no. 4, pp. 4396–4415, 2023.DOI
  8. [8]Z. Feng, C. Xu, and D. Tao, “Open-set hypothesis transfer with semantic consistency,” IEEE Trans. Image Process., vol. 30, pp. 6473–6484, 2021.DOI
  9. [9]J. Wang, Y. Xu, J. Tang, Z. Gong, B. Tao, C. W. de Silva, and X. Bai, “Vicinal gaussian transform: Rethinking source-free domain adaptation through source-informed label consistency,” IEEE Trans. Pattern Anal. Mach. Intell., vol. 48, no. 2, pp. 2030–2047, 2026.DOI
  10. [10]P. Du, Y. Wang, Y. Sun, L. Wang, Y. Liao, G. Zhang, E. Ding, Y. Wang, J. Wang, and S. Liu, “Lami-detr: Open-vocabulary detection with language model instruction,” in Computer Vision - ECCV 2024 - 18th European Conference, Milan, Italy, September 29-October 4, 2024, Proceedings, Part XXIII, ser. Lecture Notes in Computer Science, vol. 15081. Springer, 2024, pp. time entropy optimization without collapse,” in International Conference on Learning Representations, 2026.
  11. [11]P. W. Koh, S. Sagawa, H. Marklund, S. M. Xie, M. Zhang, A. Balsubramani, W. Hu, M. Yasunaga, R. L. Phillips, I. Gao, T. Lee, E. David, I. Stavness, W. Guo, B. Earnshaw, I. S. Haque, S. M. Beery, J. Leskovec, A. Kundaje, E. Pierson, S. Levine, C. Finn, and P. Liang, “WILDS: A benchmark of in-the-wild distribution shifts,” in Proceedings of the 38th International Conference on Machine Learning, ICML 2021, 18-24 July 2021, Virtual Event, ser. Proceedings of Machine Learning Research, vol. 139. PMLR, 2021, pp. 5637–5664.arxiv.org/abs/2012.07421
  12. [12]C. Geng, S. Huang, and S. Chen, “Recent advances in open set recognition: A survey,” IEEE Trans. Pattern Anal. Mach. Intell., vol. 43, no. 10, pp. 3614–3631, 2021.DOI
  13. [13]H. Shi, M. Hayat, Y. Wu, and J. Cai, “Proposalclip: Unsupervised open-set-category object proposal generation via exploiting CLIP cues,” in IEEE/CVF Conference on Computer Vision and Pattern Recognition, CVPR 2022, New Orleans, LA, USA, June 18-24, 2022. IEEE, 2022, pp. 9601–9610.arxiv.org/abs/2201.06696
  14. [14]W. Zheng, S. Gong, and T. Xiang, “Towards open-world person re-identification by one-shot group-based verification,” IEEE Trans. Pattern Anal. Mach. Intell., vol. 38, no. 3, pp. 591–606, 2016.DOI
  15. [15]Z. Gao, X. Zhang, and C. Liu, “Unified entropy optimization for open-set test-time adaptation,” in IEEE/CVF Conference on Computer Vision and Pattern Recognition, CVPR 2024, Seattle, WA, USA, June 16-22, 2024. IEEE, 2024, pp. 23 975–23 984.arxiv.org/abs/2404.06065
  16. [16]W. Zhao, J. Li, X. Dong, Y. Tian, Y. Xiang, and Y. Guo, “Mitigating the id-ood tradeoff in open-set test-time adaptation,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) Findings, June 2026, pp. 6789–6798.arxiv.org/abs/2604.01589
  17. [17]Y. Zhang, H. Wang, F. Zhang, Q. Mi, M. Yang, Y. Wang, J. Wang, H. Li, and Z. Lin, “Learning to memorize with attributive and associative memory for online test-time adaptation of vision-language models,” in Forty-third International Conference on Machine Learning, 2026.
  18. [18]D. Wang, E. Shelhamer, S. Liu, B. A. Olshausen, and T. Darrell, “Tent: Fully test-time adaptation by entropy minimization,” in 9th International Conference on Learning Representations, ICLR 2021, Virtual Event, Austria, May 3-7, 2021. OpenReview.net, 2021.arxiv.org/abs/2006.10726
  19. [19]S. Niu, J. Wu, Y. Zhang, Y. Chen, S. Zheng, P. Zhao, and M. Tan, “Efficient test-time model adaptation without forgetting,” in International Conference on Machine Learning, ICML 2022, 17-23 July 2022, Baltimore, Maryland, USA, ser. Proceedings of Machine Learning Research, vol. 162. PMLR, 2022, pp. 16 888–16 905.arxiv.org/abs/2204.02610
  20. [20]J. Lee, D. Das, J. Choo, and S. Choi, “Towards open-set test-time adaptation utilizing the wisdom of crowds in entropy minimization,” in IEEE/CVF International Conference on Computer Vision, ICCV 2023, Paris, France, October 1-6, 2023. IEEE, 2023, pp. 16 380–16 389.arxiv.org/abs/2308.06879
  21. [21]Q. Zhang, Y. Bian, X. Kong, P. Zhao, and C. Zhang, “COME: test-time adaptation by conservatively minimizing entropy,” in The Thirteenth International Conference on Learning Representations, ICLR 2025, Singapore, April 24-28, 2025. OpenReview.net, 2025.arxiv.org/abs/2410.10894
  22. [22]S. Niu, J. Wu, Y. Zhang, Z. Wen, Y. Chen, P. Zhao, and M. Tan, “Towards stable test-time adaptation in dynamic wild world,” in The Eleventh International Conference on Learning Representations, ICLR 2023, Kigali, Rwanda, May 1-5, 2023. OpenReview.net, 2023.arxiv.org/abs/2302.12400
  23. [23]M. Tan, G. Chen, J. Wu, Y. Zhang, Y. Chen, P. Zhao, and S. Niu, “Uncertainty-calibrated test-time model adaptation without forgetting,” IEEE Trans. Pattern Anal. Mach. Intell., vol. 47, no. 8, pp. 6274–6289, 2025.DOI
  24. [24]G. Chen, S. Niu, D. Chen, J. Yang, Z. Zhang, M. Tan, P. Wu, and Z. Shen, “Zerosiam: An efficient asymmetry for test-time entropy optimization without collapse,” in International Conference on Learning Representations, 2026.arxiv.org/abs/2509.23183
  25. [25]X. Xia, B. Han, N. Wang, J. Deng, J. Li, Y. Mao, and T. Liu, “Extended $st$: Learning with mixed closed-set and open-set noisy labels,” IEEE Trans. Pattern Anal. Mach. Intell., vol. 45, no. 3, pp. 3047–3058, 2023.
  26. [26]S. Niu, G. Chen, P. Zhao, T. Wang, P. Wu, and Z. Shen, “Self-bootstrapping for versatile test-time adaptation,” in Forty-second International Conference on Machine Learning, ICML 2025, Vancouver, BC, Canada, July 13-19, 2025, ser. Proceedings of Machine Learning Research. PMLR / OpenReview.net, 2025, pp. 46 611–46 628.arxiv.org/abs/2504.08010
  27. [27]M. Yang, Y. Li, C. Zhang, P. Hu, and X. Peng, “Test-time adaptation against multi-modal reliability bias,” in The Twelfth International Conference on Learning Representations, ICLR 2024, Vienna, Austria, May 7-11, 2024. OpenReview.net, 2024.
  28. [28]C. Fuchs, M. Zanella, and C. D. Vleeschouwer, “Online gaussian test-time adaptation of vision-language models,” in IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, CVPR Workshops 2025, Nashville, TN, USA, June 11-15, 2025. Computer Vision Foundation / IEEE, 2025, pp. 128–137.arxiv.org/abs/2501.04352
  29. [29]Q. Deng, S. Niu, R. Zhang, Y. Chen, R. Zeng, J. Chen, and X. Hu, “Learning to generate gradients for test-time adaptation via test-time training layers,” in AAAI-25, Sponsored by the Association for the Advancement of Artificial Intelligence, February 25 - March 4, 2025, Philadelphia, PA, USA. AAAI Press, 2025, pp. 16 235–16 243.arxiv.org/abs/2412.16901
  30. [30]L. Zhou, M. Ye, S. Li, N. Li, X. Zhu, L. Deng, H. Liu, and Z. Lei, “Bayesian test-time adaptation for vision-language models,” in IEEE/CVF Conference on Computer Vision and Pattern Recognition, CVPR 2025, Nashville, TN, USA, June 11-15, 2025. Computer Vision Foundation / IEEE, 2025, pp. 29 999–30 009.
  31. [31]Z. Deng, G. Chen, S. Niu, H. Luo, S. Zhang, Y. Yang, R. Chen, W. Luo, and M. Tan, “Test-time model adaptation for quantized neural networks,” in Proceedings of the 33rd ACM International Conference on Multimedia, 2025, pp. 7258–7267.arxiv.org/abs/2508.02180
  32. [32]J. Hu, Z. Zhang, G. Chen, X. Wen, C. Shuai, W. Luo, B. Xiao, Y. Li, and M. Tan, “Test-time learning for large language models,” in Forty-second International Conference on Machine Learning, ICML 2025, Vancouver, BC, Canada, July 13-19, 2025. OpenReview.net, 2025.arxiv.org/abs/2505.20633
  33. [33]Y. Sun, X. Wang, Z. Liu, J. Miller, A. A. Efros, and M. Hardt, “Test-time training with self-supervision for generalization under distribution shifts,” in Proceedings of the 37th International Conference on Machine Learning, ICML 2020, 13-18 July 2020, Virtual Event, ser. Proceedings of Machine Learning Research, vol. 119. PMLR, 2020, pp. 9229–9248.arxiv.org/abs/1909.13231
  34. [34]Y. Yu, L. Sheng, R. He, and J. Liang, “STAMP: outlier-aware test-time adaptation with stable memory replay,” in Computer Vision - ECCV 2024 - 18th European Conference, Milan, Italy, September 29-October 4, 2024, Proceedings, Part LXXXI, ser. Lecture Notes in Computer Science, vol. 15139. Springer, 2024, pp. 375–392.arxiv.org/abs/2407.15773
  35. [35]H. Dong, E. N. Chatzi, and O. Fink, “Towards robust multimodal open-set test-time adaptation via adaptive entropy-aware optimization,” in The Thirteenth International Conference on Learning Representations, ICLR 2025, Singapore, April 24-28, 2025. OpenReview.net, 2025.arxiv.org/abs/2501.13924
  36. [36]X. Wang, J. Lin, C. Chen, L. Tang, Y. Huang, C. Wang, L. Ye, and Y. Yao, “Activate and adapt: A two-stage framework for open-set model adaptation,” Trans. Mach. Learn. Res., vol. 2025, 2025.
  37. [37]M. Sreenivas and S. Biswas, “Efficient open set single image test time adaptation of vision language models,” Trans. Mach. Learn. Res., vol. 2025, 2025.arxiv.org/abs/2406.00481
  38. [38]D. Hendrycks and K. Gimpel, “A baseline for detecting misclassified and out-of-distribution examples in neural networks,” in 5th International Conference on Learning Representations, ICLR 2017, Toulon, France, April 24-26, 2017, Conference Track Proceedings. OpenReview.net, 2017.
  39. [39]S. Liang, Y. Li, and R. Srikant, “Enhancing the reliability of out-of-distribution image detection in neural networks,” in 6th International Conference on Learning Representations, ICLR 2018, Vancouver, BC, Canada, April 30 - May 3, 2018, Conference Track Proceedings. OpenReview.net, 2018.arxiv.org/abs/1706.02690
  40. [40]W. Liu, X. Wang, J. D. Owens, and Y. Li, “Energy-based out-of-distribution detection,” in Advances in Neural Information Processing Systems 33: Annual Conference on Neural Information Processing Systems 2020, NeurIPS 2020, December 6-12, 2020, virtual, 2020.arxiv.org/abs/2010.03759
  41. [41]X. Cheng, X. Jiang, and Z. Li, “A unified interpretation of training-time out-of-distribution detection,” in IEEE/CVF International Conference on Computer Vision, ICCV 2025, Honolulu, HI, USA, October 19-25, 2025. IEEE, 2025, pp. 2142–2151.DOI
  42. [42]Q. Wang, B. Han, Y. Liu, C. Gong, T. Liu, and J. Liu, “W-DOE: wasserstein distribution-agnostic outlier exposure,” IEEE Trans. Pattern Anal. Mach. Intell., vol. 47, no. 5, pp. 3530–3545, 2025.DOI
  43. [43]Z. Hu, Q. Wang, X. Liu, L. Pan, and B. Han, “On the two facets to conquer wild out-of-distribution detection,” IEEE Trans. Pattern Anal. Mach. Intell., vol. 48, no. 7, pp. 8060–8074, 2026.DOI
  44. [44]W. Chen, R. A. Yeh, S. Moo, and Y. Gu, “Leveraging perturbation robustness to enhance out-of-distribution detection,” in IEEE/CVF Conference on Computer Vision and Pattern Recognition, CVPR 2025, Nashville, TN, USA, June 11-15, 2025. Computer Vision Foundation / IEEE, 2025, pp. 4724–4733.arxiv.org/abs/2503.18784
  45. [45]C. Du, Y. Wang, S. Song, and G. Huang, “Probabilistic contrastive learning for long-tailed visual recognition,” IEEE Trans. Pattern Anal. Mach. Intell., vol. 46, no. 9, pp. 5890–5904, 2024.arxiv.org/abs/2403.06726
  46. [46]J. Li, Y. Wang, X. Zhang, D. Jiang, W. Dai, C. Li, H. Xiong, and Q. Tian, “Contrastive learning via variational information bottleneck,” IEEE Trans. Pattern Anal. Mach. Intell., vol. 47, no. 9, pp. 7410–7427, 2025.DOI
  47. [47]M. Zheng, S. You, F. Wang, C. Qian, C. Zhang, X. Wang, and C. Xu, “Weak augmentation guided relational self-supervised learning,” IEEE Trans. Pattern Anal. Mach. Intell., vol. 46, no. 12, pp. 8502–8516, 2024.DOI
  48. [48]T. Chen, S. Kornblith, M. Norouzi, and G. E. Hinton, “A simple framework for contrastive learning of visual representations,” in Proceedings of the 37th International Conference on Machine Learning, ICML 2020, 13-18 July 2020, Virtual Event, ser. Proceedings of Machine Learning Research, vol. 119. PMLR, 2020, pp. 1597–1607.arxiv.org/abs/2002.05709
  49. [49]K. He, H. Fan, Y. Wu, S. Xie, and R. B. Girshick, “Momentum contrast for unsupervised visual representation learning,” in 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition, CVPR 2020, Seattle, WA, USA, June 13-19, 2020. Computer Vision Foundation / IEEE, 2020, pp. 9726–9735.arxiv.org/abs/1911.05722
  50. [50]J. Grill, F. Strub, F. Altché, C. Tallec, P. H. Richemond, E. Buchatska, C. Doersch, B. Ć. Pâris, Z. Guo, M. G. Azar, B. Piot, K. Kavukcuoglu, R. Munos, and M. Valko, “Bootstrap your own latent - A new approach to self-supervised learning,” in Advances in Neural Information Processing Systems 33: Annual Conference on Neural Information Processing Systems 2020, NeurIPS 2020, December 6-12, 2020, virtual, 2020.arxiv.org/abs/2006.07733
  51. [51]X. Chen and K. He, “Exploring simple siamese representation learning,” in IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2021, virtual, June 19-25, 2021. Computer Vision Foundation / IEEE, 2021, pp. 15 750–15 758.arxiv.org/abs/2011.10566
  52. [52]J. Wu, H. Yang, T. Gan, N. Ding, F. Jiang, and L. Nie, “CHMATCH: contrastive hierarchical matching and robust adaptive threshold boosted semi-supervised learning,” in IEEE/CVF Conference on Computer Vision and Pattern Recognition, CVPR 2023, Vancouver, BC, Canada, June 17-24, 2023. IEEE, 2023, pp. 15 762–15 772.DOI
  53. [53]Y. Chen, S. Niu, Y. Wang, S. Xu, H. Song, and M. Tan, “Towards robust and efficient cloud-edge elastic model adaptation via selective entropy distillation,” in The Twelfth International Conference on Learning Representations, ICLR 2024, Vienna, Austria, May 7-11, 2024. OpenReview.net, 2024.arxiv.org/abs/2402.17316
  54. [54]M. Sensoy, L. M. Kaplan, and M. Kandemir, “Evidential deep learning to quantify classification uncertainty,” in Advances in Neural Information Processing Systems 31: Annual Conference on Neural Information Processing Systems 2018, NeurIPS 2018, December 3-8, 2018, Montréal, Canada, 2018, pp. 3183–3193.arxiv.org/abs/1806.01768
  55. [55]H. Ma, J. Chen, J. T. Zhou, G. Wang, and C. Zhang, “Estimating llm uncertainty with evidence,” arXiv preprint arXiv:2502.02900, 2025.
  56. [56]J. Katz-Samuels, J. B. Nakhleh, R. D. Nowak, and Y. Li, “Training OOD detectors in their natural habitats,” in International Conference on Machine Learning, ICML 2022, 17-23 July 2022, Baltimore, Maryland, USA, ser. Proceedings of Machine Learning Research, vol. 162. PMLR, 2022, pp. 10 848–10 865.
  57. [57]Y. Li, N. Wang, J. Shi, J. Liu, and X. Hou, “Revisiting batch normalization for practical domain adaptation,” in 5th International Conference on Learning Representations, ICLR 2017, Toulon, France, April 24-26, 2017, Workshop Track Proceedings. OpenReview.net, 2017.arxiv.org/abs/1603.04779
  58. [58]Q. Wang, O. Fink, L. V. Gool, and D. Dai, “Continual test-time domain adaptation,” in IEEE/CVF Conference on Computer Vision and Pattern Recognition, CVPR 2022, New Orleans, LA, USA, June 18-24, 2022. IEEE, 2022, pp. 7191–7201.arxiv.org/abs/2203.13591
  59. [59]D. Hendrycks and T. G. Dietterich, “Benchmarking neural network robustness to common corruptions and perturbations,” in 7th International Conference on Learning Representations, ICLR 2019, New Orleans, LA, USA, May 6-9, 2019. OpenReview.net, 2019.
  60. [60]S. Zagoruyko and N. Komodakis, “Wide residual networks,” in Proceedings of the British Machine Vision Conference 2016, BMVC 2016, York, UK, September 19-22, 2016. BMVA Press, 2016.arxiv.org/abs/1605.07146
  61. [61]F. Croce, M. Andriushchenko, V. Sehwag, E. Debenedetti, N. Flammarion, M. Chiang, P. Mittal, and M. Hein, “RobustBench: a standardized adversarial robustness benchmark,” in Proceedings of the Neural Information Processing Systems Track on Datasets and Benchmarks 1, NeurIPS Datasets and Benchmarks 2021, December 2021, virtual, 2021.arxiv.org/abs/2010.09670
  62. [62]L. v. d. Maaten and G. Hinton, “Visualizing data using t-sne,” Journal of machine learning research, vol. 9, no. Nov, pp. 2579–2605, 2008.

Paper details

vlnc:W_zqzxqjr8
Version
v1 · latest
Published
Fresh — added to the Hub within the last 30 days
Added
License
CC BY 4.0
Usage

views · 7

downloads · 2

A view counts once per browser per day, a download each time the PDF is requested.

  • Computer Science

Not recorded for this paper

View statement
Looking for related papers…
Contents