alphaFeedback

WorksComputer Science

Out-of-Distribution Detection in Continual Learning

AI contributions
Not recorded for this paper
View details
Ancillary data
1 code link
View

Abstract

Out-of-distribution detection in continual learning (OOD-CL) is highly challenging, as it requires (i) learning a sequence of tasks without catastrophic forgetting, and (ii) identifying unknown samples (OOD) without access to known (in-distribution (ID)) data from past tasks, where standard confidence-based OOD scores tend to degrade. Existing methods largely rely on a rehearsal buffer of past data or assume closed-world settings, limiting their scalability and reliability in real-world scenarios. In this paper, we propose a novel OOD detection framework for rehearsal-free continual learning, inspired by Kolmogorov-Arnold Networks (KAN), which mitigate catastrophic forgetting via their inherent local neuroplasticity. To better leverage KAN in OOD-CL, we introduce a task-adaptive classifier architecture, TA-KAN, which mitigates recency bias and enhances ID–OOD separability through task-specific control of activation locality. Furthermore, we propose a geometry-guided OOD score that complements TA-KAN classifier confidence without relying on past ID data. Our method significantly improves OOD detection while maintaining strong ID classification performance, achieving state-of-the-art results in OOD-CL.

Introduction

Continual learning (CL) [2, 7] aims to enable AI models to mimic human-level cognitive abilities by allowing them to learn continuously from evolving data streams. Despite extensive research in this area [13, 37, 43, 44, 51, 61], most existing methods operate under the closed-world assumption, where test data are drawn from the observed training distribution (in-distribution, ID). However, in real-world deployments, models inevitably encounter unknown inputs (out-of-distribution, OOD), often leading to overconfident and potentially misleading predictions [16, 30]. This limitation underscores the importance of robust OOD detection in continual learning systems (OOD-CL) for trustworthy deployment in open-world scenarios. In particular, OOD-CL is highly challenging, as it requires (i) learning a sequence of tasks without catastrophic forgetting—i.e., a significant deterioration in performance on previously learned tasks—and (ii) identifying OOD samples without access to known (ID) data of past tasks. This necessitates the model to maintain reliable decision boundaries between inter-task classes as new classes are continuously introduced, while also preserving a clear separation between OOD samples and previously learned classes, which becomes particularly challenging for older ID classes.

To address the first challenge, widely adopted rehearsal-based CL [37, 44, 63] stores a subset of past training data in a memory buffer to mitigate catastrophic forgetting. However, such approaches have limited practical applicability due to privacy and memory constraints [60, 61]. In contrast, recent advancements in pre-trained models and large language models (LLMs) [52] have enabled prompt-based methods, which have emerged as state-of-the-art [13, 48, 51, 60, 61] and provide a rehearsal-free alternative for CL. Instead of directly modifying encoder weights on newly arriving data, these methods introduce a small set of learnable parameters (prompts) to instruct the model on sequential tasks, thereby reducing forgetting and encoding task-specific knowledge in a more succinct way. However, they are largely developed and evaluated in closed-world settings. Meanwhile, addressing OOD detection is non-trivial, as naively adopting existing methods that assume a static in-distribution is challenging and insufficient in the CL setting. Standard OOD detection methods, which are largely based on the confidence scoring of the classifier (e.g., MSP [16], entropy [46], energy [33], MaxLogit [19]), can degrade in the CL setting, as they may assign low confidence to ID samples due to the objective of improving generalizability for new data [15]. Moreover, the absence of past data makes a large class of OOD detection [17, 29, 39, 45, 50, 58, 63] non-scalable, as they rely on access to full training in-distribution or require modifications to the training procedure. Nonetheless, the few works that attempt to address OOD-CL either naively couple standard OOD methods with CL models [23, 25, 30] or still assume access to past data [23, 24, 34]. In contrast, in this paper, we propose a novel method for OOD detection in rehearsal-free continual learning.

Our study is motivated by the recent success of Kolmogorov–Arnold Networks (KAN) [35] in mitigating catastrophic forgetting, owing to their distinctive architecture. Unlike traditional multi-layer perceptrons (MLP), KAN incorporates trainable activation functions instead of shared weights with fixed activations, thereby exhibiting the property of local neuroplasticity [35] (see Figure 4 in the Appendix for an illustration). This suggests that learning a new task primarily affects only the regions of the network relevant to the current input, while leaving distant regions largely unaffected. Hence, KANs are naturally effective in mitigating catastrophic forgetting [35] and consistently outperform their linear counterparts in the closed-world [22]. However, upon closer examination of KAN’s behavior in the open-world setting, we observe that OOD detection is heavily biased toward new classes (Figure 1). In particular, KAN struggles to distinguish OOD samples from older ID classes, causing a large fraction of them to be misclassified as OOD and resulting in a high false positive rate. This suggests that the increased ID performance comes at the expense of a bias toward new tasks.

FPR of a trained CIL model across task-wise ID settings

Figure 1. FPR of a trained CIL model on ImageNet-R (5-task), evaluated across task-wise ID settings. KAN-Head exhibits significantly higher FPR when older tasks are treated as ID compared to recently learned tasks, revealing a bias toward new-task classes. The proposed TA-KAN mitigates this bias, thereby reducing the average FPR.

Simplified illustration of KAN and MLP architectures

Figure 4. Simplified illustration of KAN [35] and MLP [20] architectures. (a) MLP uses globally shared weights with fixed activation functions, where all parameters are equally updated across all tasks, resulting in updates on irrelevant regions during new task learning. (b) In contrast, KAN employs learnable activation functions, enabling localized responses where only input-relevant regions are activated and updated, thereby preventing impact on other regions and mitigating catastrophic forgetting.

To address this, we introduce a novel task-adaptive architecture (TA-KAN) for RBF-KAN-based classifiers [22], tailored for OOD-CL. RBF-KANs [31] replace the B-spline basis functions in original KANs [35] with radial basis functions (RBFs) [41] to better address the curse of dimensionality, and improve locality [5, 22]. Specifically, TA-KAN introduces a task-adaptive width selection for RBF bases, where each task is associated with a distinct width that defines its activation range of interest. Locality is then adaptively controlled based on task recency, improving separability between ID and OOD samples in more ambiguous regions, thereby improving overall OOD-CL performance. Importantly, the proposed adaptive RBF classifier retains the same parameterization, preserving the parsimony required for CL [59].

Furthermore, to address the degradation of confidence-based scoring in the proposed classifier, we introduce complimentary geometric guidance for its classifier derived OOD scores, thereby proposing a novel OOD score tailored for CL. Since the KAN-based CL model is optimized for improving generalizability to mitigate catastrophic forgetting, this can also induce lower confidence for ID data compared to the static setting [15], leading to increased overlap between ID and OOD scores, reducing their separability. Specifically, traditional geometry-based OOD methods (e.g., KNN [50], NNGuide [40], LID [53]) require access to the full training distribution. In contrast, our proposed guidance is rehearsal-free and operates in the prompt space, which encodes higher-level task semantics compared to the lower-level embedding space used by conventional methods. Therefore, it jointly considers both class-level and task-level manifolds, thereby introducing a two-level manifold constraint for OOD-CL. The resulting OOD score further enhances the performance of the TA-KAN classifier, achieving SOTA results by a large margin.

We summarize our key contributions as follows. We propose (i) a novel OOD detection framework for rehearsal-free CL, addressing practical constraints such as memory, privacy, and reliability; (ii) a task-adaptive KAN classifier that better leverages the neuroplasticity of KAN in the open-world by mitigating recency bias and enhancing ID–OOD separability, while preserving parsimony; and (iii) a geometry-guided OOD scoring function that complements classifier confidence, thereby formulating OOD-CL as a two-level manifold constraint, without reliance on full in-distribution.

Preliminaries and Notations

Out-of-distribution (OOD) detection. Let Din={(xi,yi)}i=1n\mathcal{D}_{\mathrm{in}} = \{(x^{i}, y^{i})\}_{i=1}^{n} denote the training dataset, where each input xi∈Xx^{i} \in\mathcal{X} is associated with a label yi∈Y={1,2,…,C}y^{i} \in\mathcal{Y} = \{1, 2, \ldots, C\}, with CC denoting the total number of classes. Let f:X→RCf : \mathcal{X} \to\mathbb{R}^{C} be a neural network trained on Din\mathcal{D}_{\mathrm{in}}. At test time, the objective is twofold: (i) to correctly classify samples from known classes in Y\mathcal{Y} (in-distribution (ID) classes), and (ii) to effectively identify samples that do not belong to any class in Y\mathcal{Y}, i.e., out-of-distribution (OOD) samples. To this end, a scoring function S:X→RS : \mathcal{X} \to\mathbb{R} is defined, where higher scores indicate a higher likelihood of a sample being in-distribution. Given a threshold η∈R\eta\in\mathbb{R}, the decision rule is defined as:

Decision⁡(x)={ID,if S(x)≥η,OOD,otherwise.(1)\operatorname{Decision}(x) = \begin{cases} \mathrm{ID}, & \text{if } S(x) \ge\eta,\\ \mathrm{OOD}, & \text{otherwise.} \end{cases} \tag*{(1)}

The scoring function SS can be derived either from the classifier outputs h(x)h(x) (e.g., confidence-based scores [16, 19, 33, 46]) or from the geometry of the embedding space g(x)g(x) [40, 50, 53, 55], where f:=h∘gf := h \circ g.

Class-incremental learning (CIL) is a setting in continual learning that considers learning a sequence of NN tasks {T1,T2,…,TN}\{\mathcal{T}_{1}, \mathcal{T}_{2}, \ldots, \mathcal{T}_{N}\} over (N−1)(N - 1) incremental steps. Let TT denote the number of tasks learned so far. Each task Tt\mathcal{T}_{t} (1≤t≤T1 \le t \le T) is associated with a training dataset Dt={(xit,yit)}i=1nt\mathcal{D}_{t} = \{(x_{i}^{t}, y_{i}^{t})\}_{i=1}^{n_{t}}, where ntn_{t} is the number of samples in task Tt\mathcal{T}_{t}, xit∈Xx_{i}^{t} \in\mathcal{X} is an input, and yit∈Yt={1,2,…,Ct}y_{i}^{t} \in\mathcal{Y}_{t} = \{1, 2, \ldots, C_{t}\} is its class label, with CtC_{t} denoting the number of classes in task Tt\mathcal{T}_{t}. The class sets are mutually disjoint, i.e., Yt∩Yt′=∅\mathcal{Y}_{t} \cap\mathcal{Y}_{t'} = \varnothing, ∀t≠t′\forall t \ne t', and ⋃t=1TYt=Y\bigcup_{t=1}^{T} \mathcal{Y}_{t} = \mathcal{Y}, where Y={1,2,…,C}\mathcal{Y} = \{1, 2, \ldots, C\} and C=∑t=1TCtC = \sum_{t=1}^{T} C_{t} denotes the total number of classes observed up to task TT. The goal of CIL is to learn a single predictive model f:X→RCf : \mathcal{X} \to\mathbb{R}^{C} that can correctly predict the label y∈Yy \in\mathcal{Y} for any test sample xx drawn from the classes observed up to task TT.

Kolmogorov–Arnold Networks (KAN). KAN [35] is a neural network with a unique architecture that replaces shared weights and fixed activation functions in traditional multi-layer perceptrons (MLPs) [20] with trainable activation functions. This imparts KANs with the property of local neuroplasticity. As a result, learning a new task primarily impacts the localized regions of the network activated by the training data, while preserving the integrity of distant regions. This property makes KANs naturally effective in mitigating catastrophic forgetting [22].

KANs are founded on the Kolmogorov–Arnold representation theorem (KAT) [27], which states that any multivariate continuous function f(x)f(x) defined on a bounded domain can be represented as a finite composition of univariate continuous functions combined through addition. Formally, the theorem can be written as:

f(x)=f(x1,x2,…,xn)=∑q=12n+1Φq(∑p=1nϕq,p(xp)),(2)f(x) = f(x_{1}, x_{2}, \ldots, x_{n}) = \sum_{q=1}^{2n+1} \Phi_{q}\left(\sum_{p=1}^{n} \phi_{q,p}(x_{p})\right), \tag*{(2)}

where Φq\Phi_{q} and ϕq,p\phi_{q,p} are univariate continuous functions. In KAN, the functions ϕq,p\phi_{q,p} and Φq\Phi_{q} are parameterized using learnable coefficients over predefined basis functions, typically implemented as B-spline bases [42].

Radial basis function Kolmogorov–Arnold Networks (RBF-KAN). Several recent studies [5, 31] have shown that the B-spline basis functions used in the original KAN [35] can be replaced by radial basis functions (RBF) [41] to more effectively represent high-dimensional data, thus reducing the curse of dimensionality (COD). Furthermore, [22] shows that the limited fitting capacity of B-spline functions on high-dimensional data can sometimes further increase forgetting when introduced into CIL. Therefore, we study RBF-KAN in the OOD-CL setting, in place of the original KAN.

Specifically, an RBF-KAN layer can be expressed as:

f(x)=∑p=1nΦp(∑i=1Gωp,iϕ(∥xp−ci∥)),(3)f(x) = \sum_{p=1}^{n} \Phi_{p}\left(\sum_{i=1}^{G} \omega_{p,i} \phi(\lVert x_{p} - c_{i} \rVert)\right), \tag*{(3)}

where ci∈Rc_{i} \in\mathbb{R} denotes a set of center points evenly distributed within a specific range, and G∈N+G \in\mathbb{N}^{+} is the total number of such center points. The function ϕ(⋅):R→R+\phi(\cdot) : \mathbb{R} \to\mathbb{R}^{+} is an RBF kernel serving as the basis function, whose value depends only on the distance between the input xpx_{p} and the center cic_{i}. The coefficients ωp,i\omega_{p,i} are learnable weights associated with each basis function.

A common choice for ϕ\phi is the Gaussian kernel [31], defined as:

ϕ(∥xp−ci∥)=exp⁡(−(xp−ci)22σi2),(4)\phi(\lVert x_p-c_i\rVert)=\exp\left(-\frac{(x_p-c_i)^2}{2\sigma_i^2}\right), \tag*{(4)}

where σi>0\sigma_i > 0 controls the width (or spread) of the kernel. This formulation imparts locality to the network: the response is highest near the center cic_i and decays rapidly with distance. Such localized behavior enables RBF-KAN to effectively capture local structures and adapt efficiently to local changes in the data [5].

RBF-KAN as a classifier. Following [22], we can construct an RBF-expanded classifier inspired by KAN operating on the normalized embedding g(x)=z=[z1,…,zD]∈RDg(x)=z=[z_1,\ldots,z_D]\in\mathbb{R}^D, where DD is the embedding dimension. If we define Φp\Phi_p in Eq. (3) as a learnable linear weight for each dimension and consolidate these weights with those corresponding to ϕ\phi into a single learnable weight matrix W∈RC×(D×G)W\in\mathbb{R}^{C\times(D\times G)}, the KAN-based classifier hKANh_{\mathrm{KAN}} can be expressed as:

hKAN(g(x))=W⋅vec⁡(Φ(g(x))),(5)h_{\mathrm{KAN}}(g(x))=W\cdot\operatorname{vec}(\Phi(g(x))), \tag*{(5)}

where Φ(g(x))∈RD×G\Phi(g(x))\in\mathbb{R}^{D\times G} is the RBF expansion matrix, which can be calculated as:

Φ(g(x))=[ϕ(∥z1−c1∥)ϕ(∥z1−c2∥)⋯ϕ(∥z1−cG∥)ϕ(∥z2−c1∥)ϕ(∥z2−c2∥)⋯ϕ(∥z2−cG∥)⋮⋮⋱⋮ϕ(∥zD−c1∥)ϕ(∥zD−c2∥)⋯ϕ(∥zD−cG∥)],\Phi(g(x))= \begin{bmatrix} \phi(\lVert z_1-c_1\rVert) & \phi(\lVert z_1-c_2\rVert) & \cdots& \phi(\lVert z_1-c_G\rVert) \\ \phi(\lVert z_2-c_1\rVert) & \phi(\lVert z_2-c_2\rVert) & \cdots& \phi(\lVert z_2-c_G\rVert) \\ \vdots& \vdots& \ddots& \vdots\\ \phi(\lVert z_D-c_1\rVert) & \phi(\lVert z_D-c_2\rVert) & \cdots& \phi(\lVert z_D-c_G\rVert) \end{bmatrix},

and vec⁡(⋅)\operatorname{vec}(\cdot) flattens the D×GD\times G matrix into a vector for compatibility with WW.

Prompt-Based CIL Models. Due to recent advancements in pre-trained models and large language models (LLMs), prompt learning methods have been widely recognized as the state-of-the-art [13, 48, 51, 60, 61] in the challenging CIL setting, owing to their scalability and ability to mitigate catastrophic forgetting without buffering past examples [22]. These methods keep the pre-trained backbone gg (typically a sequence model such as ViT [9]) frozen for improved knowledge transfer and attach a small set of learnable parameters, called prompts, to instruct the classifier hh in learning tasks that arrive sequentially. Thus, each task Tt\mathcal{T}_t is associated with a set of prompt parameters pt={pti}i=1M\mathbf{p}_t=\{p_t^i\}_{i=1}^{M}, where pti∈RLp×Dp_t^i\in\mathbb{R}^{L_p\times D}, with LpL_p denoting the prompt length and MM the number of prompts. These prompts are prepended to the embedding features to perform classification. In addition, each pt\mathbf{p}_t is associated with a corresponding set of keys kt={kti}i=1M\mathbf{k}_t=\{k_t^i\}_{i=1}^{M}, where kti∈RDk_t^i\in\mathbb{R}^{D}; these are also learnable parameters designed to capture representative features of each task. Then, to select the best matching prompts for a given sample, a query–key matching mechanism [61] is employed. Commonly, the backbone gg is used as a frozen feature extractor to obtain a query representation q(x)=g(x)[0]q(x)=g(x)[0], corresponding to the [CLS] token [9], and cosine similarity γ\gamma is employed as the matching score. During training, for samples arriving in each task, a matching loss is then employed to pull the query features closer to the corresponding task-specific keys:

Lmatch(x,kt)=γ(q(x),kt),x∈Dt.(6)\mathcal{L}_{\mathrm{match}}(x,k_t)=\gamma(q(x),k_t),\quad x\in\mathcal{D}_t. \tag*{(6)}

Methodology

Problem Formulation

Out-of-distribution detection in continual learning (OOD-CL). We define OOD-CL as the CIL setting with the OOD detection capability. At any time, the learned CIL model is required to (i) correctly classify test samples belonging to the classes observed in the T\mathcal{T} tasks learned so far, and (ii) detect samples that do not belong to any of the learned classes so far, i.e., OOD samples. Importantly, OOD samples may correspond to classes that will be introduced in future tasks. As learning progresses, these samples eventually become in-distribution, requiring the model to correctly incorporate them without forgetting previously learned knowledge.

We adopt an evaluation protocol based on standard CIL [43], following prior works [15, 25, 30], where OOD detection is evaluated before each incremental learning step. Formally, let {S1,…,SN}\{\mathcal{S}_1,\ldots,\mathcal{S}_N\} denote the test datasets for each task. At the beginning of the learning step for the new task TT+1\mathcal{T}_{T+1}, the test data from previously learned tasks {St}t=1T\{\mathcal{S}_t\}_{t=1}^{T} are treated as ID, while the test data from the incoming task TT+1\mathcal{T}_{T+1} are treated as OOD, where OOD detection is performed a total of (N−1)(N-1) times while continually learning the sequence of NN tasks {T1,…,TN}\{\mathcal{T}_1,\ldots,\mathcal{T}_N\}.

Note that OOD-CL differs from the traditional static OOD detection setting, which has access to the full ID data at once. In contrast, in OOD-CL, ID data arrive incrementally across tasks, and the training data available for OOD detection prior to learning TT+1\mathcal{T}_{T+1} are restricted to the training dataset DT\mathcal{D}_T. Moreover, unlike other methods [24, 25, 34], we do not assume any form of rehearsal buffer.

Motivation

Recent continual learning methods, including prompt-based CIL approaches [13, 48, 60, 62], typically employ an expandable linear classifier hh on top of the frozen backbone to accommodate newly encountered classes. Even though they freeze encoder weights, forgetting can still occur in downstream components, suggesting that careful design of the classifier head is important [22]. Recent work [22] has shown that the conventional linear classifier can be effectively replaced by a KAN-based classifier, owing to its inherent local plasticity, which helps mitigate catastrophic forgetting. Building on this, we adopt a KAN-based classifier in the OOD-CL setting, aiming to improve both ID classification and OOD detection, on a generic prompt-based CIL model.

In the open-world setting, we observe that KAN also improves OOD detection performance alongside its gains in ID classification (Figure 2). However, despite its strong resistance to catastrophic forgetting, the improvement in OOD detection over a linear classifier remains limited relative to the gains observed in ID performance, where we believe something degrades the model’s ability to reliably distinguish OOD samples. To investigate this, we analyze a trained CIL model after learning N−1N-1 tasks and evaluate its OOD detection performance with respect to each task from 11 to N−1N-1 as ID in turn. As shown in Figure 1, OOD detection performance is considerably lower when older tasks are treated as ID compared to when recently learned tasks are considered as ID. This observation indicates that OOD discrimination remains biased toward classes from newly learned tasks, which in turn degrades the model’s ability to reliably distinguish OOD samples. A natural way to address this bias is to adapt the model behavior across tasks. However, explicitly maintaining task-specific models or parameters violates the CIL setting [43, 59], which requires a single shared model without access to task identity at inference time. Therefore, we propose task-adaptive KAN (TATA-KANKAN), which preserves parsimony while enabling task-dependent behavior.

Relative improvement of KAN and TA-KAN heads over linear heads

Figure 2. Relative improvement (Δ\Delta) of the KAN head over a linear head in a SOTA CIL model. The improvement in OOD detection is limited compared to ID performance. The proposed TA-KAN significantly improves OOD performance while maintaining comparable ID performance.

Task Adaptive KAN (TA-KAN)

We employ a CIL model with a KAN-based classifier head hh as defined in Eq. (5). It utilizes an RBF-KAN layer consisting of GG Gaussian radial basis functions uniformly centered at c=[c1,c2,⋯ ,cG]\mathbf{c}=[c_1,c_2,\cdots,c_G] to approximate the activation function for each hidden feature dimension. Typically, the width of each RBF, σ\sigma, is set proportional to the step size s=b−aG−1s=\frac{b-a}{G-1}, which yields uniform coverage over the input range [a,b]⊂R[a,b]\subset\mathbb{R}. However, we observe that the RBF width directly controls the locality of the response: narrower widths produce sharper, more localized activations, while wider widths yield smoother, more generalized responses. Therefore, in our TA-KAN, we adaptively assign RBF widths across the activation region, using narrower RBFs in regions relevant to old classes compared to those for relatively newer tasks. This encourages older classes to form sharper and more distinct activation regions, making them easier to separate from nearby OOD samples.

To illustrate this effect, we provide a toy example in Figure 3, where an ID region is characterized by a narrow Gaussian activation (σ=0.25×s\sigma= 0.25 \times s), and an OOD sample is located close to this region. Narrower RBF bases can better approximate the sharp local structure of the ID region than wider RBFs, resulting in more distinct activations and reduced overlap between ID and OOD responses while using similar weights in both cases.

Comparison of RBF approximations using wide and narrow basis functions

Figure 3. Comparison of RBF approximations using wide and narrow basis functions. (a) RBF bases with different widths, 1×s1 \times s (top) and 0.5×s0.5 \times s (bottom). (b) Approximation of a target ID activation using wide bases yields a coarse approximation and produces similar responses for both ID and nearby OOD samples. (c) Approximation using narrower bases with similar weights, results a more accurate reconstruction and better captures localized responses.

However, naively adopting a uniformly narrower RBF width across the entire activation region can make the model sensitive to intra-class variations and reduce its generalization ability, potentially degrading the ID classification performance (cf. § 4.3). Instead, we adapt the RBF width to focus the model’s capacity on harder, older tasks while maintaining sufficient generalization for relatively easier, newly learned tasks.

Identifying the activation ranges of interest. A key challenge in implementing the adaptive RBF network is how to identify the activation range of interest for a given sample—particularly for OOD inputs—in order to select its desired RBF width. To address this, we repurpose how the prompt based CIL model employs the similarity-based estimation for a sample to select its most relevant prompts [13, 22, 60, 61] or to reweight prompts [48, 51] without introducing additional complexity or parameters specifically for OOD detection. The model incorporates query-key matching to identify task specific prompts, which we leverage to estimate the task affinity of a sample and localize its corresponding activation region of interest. Specifically, given the query representation q(x)q(x) and similarity measure γ(⋅,⋅)\gamma(\cdot,\cdot), we estimate the task affinity by selecting the task whose key exhibits the highest alignment with the query:

t^(x)=arg max⁡t∈{1,…,T} max⁡i∈{1,…,M} γ(q(x),kti).\hat{t}(x) = \underset{t \in\{1,\ldots,T\}}{\operatorname{arg\,max}}\ \underset{i \in\{1,\ldots,M\}}{\max}\ \gamma\left(q(x), k_{t}^{i}\right).

For ID samples, the inferred t^(x)\hat{t}(x) corresponds to their true task, whereas for OOD samples, it reveals the ID task whose feature manifold they most closely resemble. Importantly, for OOD samples, this mechanism allows us to identify the region of the ID feature space where the model is most likely to exhibit ambiguity, i.e., the task whose decision boundaries are most relevant—and potentially most vulnerable—for distinguishing xx from ID data. We therefore use t^(x)\hat{t}(x) to guide the adaptive RBF width to improve separability in that region.

TA-KAN classifier. In our proposed TA-KAN classifier, the activation range of each task is approximated using RBF bases of unique width assigned to it. To achieve this, we parameterize the Gaussian basis using a task-specific scaling factor. Specifically, let αt\alpha_t denote the width factor associated with task Tt\mathcal{T}_t. At inference, the width is selected based on the inferred task affinity t^(x)\hat{t}(x), i.e., αt^(x)\alpha_{\hat{t}(x)}. Accordingly, the Gaussian basis in Eq. (4) is defined as

ϕ(∥zp−ci∥;αt^(x))=exp⁡(−(zp−ci)22(αt^(x)s)2).(7)\phi\left(\left\lVert z_p-c_i\right\rVert;\alpha_{\hat{t}(x)}\right)=\exp\left(-\frac{(z_p-c_i)^2}{2\left(\alpha_{\hat{t}(x)}s\right)^2}\right). \tag*{(7)}

This yields a task-conditioned RBF expansion matrix Φ(g(x);αt^(x))\Phi\left(g(x);\alpha_{\hat{t}(x)}\right), and the classifier is expressed as

hA−KAN(g(x);αt^(x))=W⋅vec⁡(Φ(g(x);αt^(x))).(8)h_{\mathrm{A-KAN}}\left(g(x);\alpha_{\hat{t}(x)}\right)=W\cdot\operatorname{vec}\left(\Phi\left(g(x);\alpha_{\hat{t}(x)}\right)\right). \tag*{(8)}

Importantly, the classifier shares a single RBF layer across all tasks, thereby preserving model parsimony. Instead, task adaptivity is introduced solely through a sample-dependent basis expansion via adaptive width selection.1

Furthermore, we define the task-specific width factors {αt}t=1N\{\alpha_t\}_{t=1}^{N} as

αt=αmin⁡+t−1N−1(αmax⁡−αmin⁡),(9)\alpha_t = \alpha_{\min} + \frac{t-1}{N-1}(\alpha_{\max} - \alpha_{\min}), \tag*{(9)}

where 0<αmin⁡≤αt≤αmax⁡≤10 < \alpha_{\min} \le\alpha_t \le\alpha_{\max} \le1. Note that αt\alpha_t increases monotonically with task recency, such that earlier tasks are assigned smaller widths, resulting in sharper and more localized activations, while more recent tasks retain relatively wider responses to preserve generalization.

During training, we use the ground-truth task identity tt to select the corresponding width factor αt\alpha_t, and optimize the model end-to-end. The overall objective is given by

L=LCE(hA-KAN(g(x);αt),y)+λLmatch(x,kt),x∈Dt,(10)\mathcal{L} = \mathcal{L}_{\mathrm{CE}}\left(h_{\mathrm{A\text{-}KAN}}(g(x); \alpha_t), y\right) + \lambda\mathcal{L}_{\mathrm{match}}(x, k_t), \quad x \in\mathcal{D}_t, \tag*{(10)}

where LCE\mathcal{L}_{\mathrm{CE}} is the cross-entropy loss, Lmatch\mathcal{L}_{\mathrm{match}} is the matching loss defined in Eq. (6), and λ\lambda is a balancing coefficient.

Geometry-Based Guidance for OOD-CL

Furthermore, since the KAN-based CIL model is optimized for improving generalizability to mitigate catastrophic forgetting, this can also induce lower confidence for ID data compared to the static setting [15]. Since standard OOD scoring functions (e.g., MSP [16], MaxLogit [19]) rely solely on the confidence associated with the classifier, this can lead to increased overlap between ID and OOD scores, reducing their separability. Moreover, these methods are known to suffer from the overconfidence issue [16, 40], which further limits their reliability. To mitigate the overconfidence associated with such classifier-derived OOD scores, recent OOD methods turn to non-classifier signals, such as distance- and geometry-based measures in the feature space (KNN [50], Mahalanobis [29]) or combine both types of information (NNGuide [40], LID [53], VIM [55]). However, these geometry-based approaches typically require access to the full training in-distribution, making them inapplicable in the CIL setting. In this section, we propose a novel geometry-based guidance mechanism tailored for OOD-CL. Specifically, instead of modeling the geometry of the data manifold in the feature space, we exploit the prompt space, which captures higher-level task semantics beyond the lower-level embedding representations.

Following [40], a geometry-based guidance can be introduced to SS as

SGuided(x)=S(x)⋅Γ(x),(11)S_{\mathrm{Guided}}(x) = S(x) \cdot\Gamma(x), \tag*{(11)}

where Γ(x)\Gamma(x) represents a distance-based guidance score. We choose Γ(x)\Gamma(x) as the average similarity to the kk-nearest neighbors in the ID prompt space,

Γ(x)=1k∑p∈Nk(x)sim⁡(q(x),p)(12)\Gamma(x) = \frac{1}{k} \sum_{p \in\mathcal{N}_k(x)} \operatorname{sim}(q(x), p) \tag*{(12)}

where Nk(x)\mathcal{N}_k(x) denotes the set of kk nearest prompts to sample xx. To determine the set of prompts for a given input, we leverage the learned key representations. A natural choice for kk is either MM, the number of prompts allocated per task, or 11, corresponding to selecting the single most similar prompt. In practice, we find that the latter yields slightly better performance. Accordingly, we define the guidance score as the maximum similarity across all keys:

Γ(x)=max⁡t∈{1,…,N},i∈{1,…,M}γ(q(x),kti).(13)\Gamma(x) = \max_{\substack{t \in\{1,\ldots,N\},\\ i \in\{1,\ldots,M\}}} \gamma(q(x), k_t^i). \tag*{(13)}

Unless otherwise stated, we adopt MSP [16] as the default classifier-based confidence score S(x)∈[0,1]S(x) \in[0,1], owing to its generality. Since cosine similarity γ(⋅,⋅)∈[−1,1]\gamma(\cdot,\cdot) \in[-1,1], we further rescale Γ(x)\Gamma(x) to [0,1][0,1] as Γ~(x)=Γ(x)+12\widetilde{\Gamma}(x) = \frac{\Gamma(x)+1}{2}, so that the guided score remains bounded, i.e., SGuided(x)=S(x)⋅Γ~(x)∈[0,1]S_{\mathrm{Guided}}(x) = S(x) \cdot\widetilde{\Gamma}(x) \in[0,1].

In the proposed SGuidedS_{\mathrm{Guided}} score, SS mostly captures intra-task discrimination, while Γ\Gamma captures inter-task structure to guide OOD detection. Importantly, Γ\Gamma provides complementary guidance that helps further reduce the bias and overconfidence associated with classifier-based confidence scores.

Two-level manifold constraint for OOD-CL. Moreover, the proposed SGuidedS_{\mathrm{Guided}} can be interpreted as enforcing a two-level manifold constraint for continual OOD detection. To illustrate this, let wc∈RDw_c \in\mathbb{R}^{D} denote the weight vector corresponding to class cc in the classifier, and consider a simplified setting where M=1M=1. Then, the proposed score can be written as

SGuided:=max⁡c∈{1,…,C}wcTz⏟class alignment⋅max⁡t∈{1,…,N}ktTz⏟task alignment.(14)S_{\mathrm{Guided}} := \underbrace{\max_{c\in\{1,\ldots,C\}} w_c^{\mathsf{T}}z}_{\text{class alignment}}\cdot\underbrace{\max_{t\in\{1,\ldots,N\}} k_t^{\mathsf{T}}z}_{\text{task alignment}}. \tag*{(14)}

In fact, each weight wcw_c can be viewed as a learned class prototype, while each key ktk_t serves as a task-level prototype, since under Lmatch\mathcal{L}_{\mathrm{match}} it is optimized to align with features of its corresponding task. The first term measures the alignment between the feature representation and learned class prototypes, while the second term captures alignment with learned task-level prototypes. Consequently, a sample is considered in-distribution only if it aligns well with both a class manifold and a task manifold, thereby improving OOD robustness by suppressing samples that fail to align at either level.

Evaluation

Experimental Settings

Datasets and Tasks. We evaluate the proposed OOD-CL method across diverse CIL settings using three widely adopted benchmarks [22, 48, 60]: ImageNet-R [18], CUB-200 [54] and CIFAR-100 [28]. For CUB-200 and CIFAR-100, we consider 5-task (40 classes per task), 10-task (20 classes per task), and 20-task (10 classes per task) settings. For ImageNet-R, we adopt 5-task, 10-task, 20-task and 40-task settings. All experiments are conducted in a non-exemplar setting, where no samples from previous tasks are stored for future training. Following standard CIL, results are averaged over multiple random seeds with randomly shuffled task orders.

Evaluation Metrics. We use widely adopted metrics for OOD-CL [24, 30]: the area under the receiver operating characteristic curve (AUCLAUC_L), false positive rate at 95% true positive rate (FPRLFPR_L), and average precision for ID and OOD samples (AUPLInAUPL_{\mathrm{In}} and AUPLOutAUPL_{\mathrm{Out}}, respectively), measured after learning the last task and averaged over all seen tasks. These metrics provide a comprehensive measure of OOD detection performance across all tasks. To evaluate ID classification performance, we adopt the average final accuracy (ACCLACC_L),—i.e., the accuracy after learning the last task, averaged over all seen tasks, which is a widely used metric in CIL, capturing both plasticity and forgetting [13, 48]. We also report the average incremental performance over all learned tasks for both OOD detection (AUCAAUC_A, FPRAFPR_A) and ID classification (ACCAACC_A).

Baselines and configuration. We evaluate our method using five OOD detection methods: MSP [16], MaxLogit [19], Energy [33], Entropy [4], KL [19] and three OOD-CL methods: MORE [24], MSP-BC-CE [15] and Pro-KT [30]. To evaluate the effectiveness of our method, we adopt CO-DAPrompt [48] as the backbone prompt model, following [22], while noting that our approach generalizes to other prompt-based models (see App. E.5). CODAPrompt employs a linear classifier as hh (Linear-Head). Following [22], we first replace this classifier with a KAN (KAN-Head) [22], and then with our proposed TA-KAN classifier (TA-KAN). We additionally consider two canonical classifier alternatives for mitigating classifier bias: a cosine-normalized classifier (Cosine-Head) [21] and a nearest-class-mean classifier (NCM Readout) [43]. All classifier variants are evaluated within the same prompt-learning framework under otherwise consistent configurations to ensure a fair comparison of OOD-CL performance. See App. C for further details.

Experimental Results

We report results on the CUB-200 dataset in Tab. 1 and ImageNet-R in Tab. 2 across all task settings. In addition to various classifier settings, we include SOTA OOD-CL methods, while comparisons with standard OOD detection methods are provided in App. E.3. For both datasets, replacing the linear classifier with a KAN-based classifier improves overall CIL performance, with particularly strong gains in ID classification accuracy. We then replace the standard KAN with the proposed TA-KAN classifier—designed specifically for OOD-CL—which significantly improves OOD detection performance in terms of both FPR and AUC, while preserving the ID performance gains achieved by KAN. Further incorporating the proposed guidance into the TA-KAN scoring function yields additional improvements in OOD performance. Notably, TA-KAN yields particularly large gains on CUB-200, a challenging benchmark for OOD-CL due to its fine-grained nature, reducing FPR by 12.57% on average (up to 18.31%) and improving AUC by 2.96% on average (up to 3.55%). On ImageNet-R, even in scenarios where the KAN classifier degrades OOD detection performance relative to the linear baseline, TA-KAN recovers and improves performance. Furthermore, our method significantly outperforms other OOD-CL methods, including MORE [24], which relies on a rehearsal buffer. Additional datasets and analyses are provided in App. § 10.

Different OOD difficulty regimes. The different performance gains observed on CUB-200 and ImageNet-R can be understood through two difficulty regimes directly related to the locality-based design of TA-KAN: (i) fine-grained semantic ambiguity, where increased locality can improve ID–OOD separability, and (ii) high intra-class variation, where increased locality may reduce invariance. CUB-200 represents the former, where classes exhibit subtle inter-class differences and are often close to near-OOD samples. Here, the increased locality induced by TA-KAN, particularly for older tasks, helps capture fine-grained deviations and improve ID-OOD separability, explaining its substantially larger gains over the standard KAN. In contrast, ImageNet-R exhibits high intra-class diversity, with each class containing significant variations in style (e.g., cartoon, sketch, graffiti, origami). While increased locality can improve discrimination in ambiguous regions, it can also reduce invariance to such intra-class variations, resulting in comparatively smaller gains. This highlights an inherent trade-off between locality and generalizability: narrower RBFs improve fine-grained discrimination, whereas wider RBFs provide smoother responses that better accommodate large variations. Overall, these results support the central design hypothesis of TA-KAN: adaptive locality improves fine-grained ID-OOD discrimination where needed while retaining sufficient generalizability to intra-class variation.

Ablation Study and Analysis

We evaluate the contribution of each component of our method in Table 3. Importance of TA-KAN. To evaluate the effect of the proposed TA-KAN classifier, we first compare it with the standard KAN head. As shown, TA-KAN—even without guidance Γ\Gamma—significantly improves OOD detection performance over the standard KAN, while preserving the ID performance gains over the linear head. This highlights the importance of a task-adaptive classifier architecture for OOD-CL, where adaptive control of locality improves the separation between ID and OOD samples, particularly for older tasks, thereby reducing bias and enhancing overall performance. However, there exists an inherent trade-off between locality and generalizability in CIL classifiers. For example, using a KAN with uniformly narrower RBF bases (with σ=αmin⁡\sigma= \alpha_{\min}s and indicated as KAN-Head αmin⁡\alpha_{\min}) across all tasks—thereby increasing locality over the entire activation range—yields only marginal improvements over the standard KAN head, while degrading ID classification performance due to reduced generalization ability. Moreover, simply varying α\alpha does not yield consistent improvements; see Table 4. To further control for classifier capacity, we compare against a parameter-matched MLP-Head, since KAN and TA-KAN introduce additional parameters over a linear head due to the RBF expansion. Its inferior OOD performance compared with both KAN and TA-KAN indicates that increased parameter count alone does not account for the observed gains, further supporting the benefit of the KAN architecture.

MethodFPRLFPR_LFPRAFPR_AAUCLAUC_LAUCAAUC_AACCLACC_LACCAACC_A
MLP-Head77.4664.0971.1677.7254.8270.49
Linear-Head68.6759.1778.7682.4067.9679.42
Linear-Head+Guidance67.0360.8179.0682.5467.9679.42
KAN-Head (Baseline)63.4856.0081.9685.1678.3685.37
KAN-Head αmin⁡\alpha_{\min}60.1254.2882.2785.8076.1184.52
KAN-Head trainable σ\sigma64.6956.3081.5385.0478.1685.36
KAN-Head+Guidance58.4654.1382.7585.8378.3685.37
TA-KAN Head58.0355.1683.9485.6478.0285.24
TA-KAN+Guidance (ours)55.8352.1884.3986.1878.0285.24

Table 3. Ablation study of different components. Results are averaged over all task settings on CUB-200 dataset.

α\alphaMethodFPRLFPR_LAUCLAUC_LACCLACC_L
1KAN59.6583.4881.55
1KAN+Guidance54.6484.1881.55
0.75KAN58.0783.8781.54
0.75KAN+Guidance54.3184.4781.54
0.75TA-KAN55.7884.6181.47
0.75TA-KAN+Guidance51.4685.2881.47
0.5KAN57.8584.2380.78
0.5KAN+Guidance54.4784.7680.78
0.5TA-KAN52.1185.8680.86
0.5TA-KAN+Guidance48.7386.4280.86
0.25KAN57.9083.7577.33
0.25KAN+Guidance57.0184.0377.33
0.25TA-KAN50.2285.8278.43
0.25TA-KAN+Guidance49.1386.1578.43

Table 4. Effect of α\alpha on KAN and TA-KAN on the CUB-200 dataset. Lower FPR and higher AUC/ACC are better.

Comparison with trainable RBF bases. We also consider a variant of the KAN classifier where the RBF width is treated as a task-wise trainable parameter (KAN-Head trainable σ\sigma), inspired by Free-KAN [6] architecture. However, this variant underperforms even the standard KAN. We attribute this to the fact that the learned RBF bases become overly adapted to ID task characteristics, limiting generalizability to unseen tasks. This highlights the importance of the design principle in Eq. (9) for TA-KAN.

Importance of Guidance. Applying the proposed guidance across classifier heads improves OOD detection, highlighting its role in complementing classifier confidence scores, which degrade in the absence of past data and are prone to overconfidence. The gains are particularly pronounced for KAN, where stronger task-age-dependent confidence degradation (Figure 1) creates greater ambiguity that the task-manifold guidance helps resolve. While TA-KAN mitigates much of this bias through adaptive locality, the guidance provides further complementary gains (cf. App. § 11.§ 4).

Effect of fixed α\alpha in standard KAN. We compare the performance of the standard KAN with a fixed RBF width (controlled by α\alpha) across different values, as shown in Table 4. We observe that simply tuning α\alpha does not lead to consistent improvements in OOD detection or ID classification performance. For a fair comparison, we also report the performance of TA-KAN using the same values as αmin⁡\alpha_{\min}. In contrast to the standard KAN, TA-KAN consistently improves performance across all settings. These results indicate that globally adjusting the RBF width is insufficient; instead, task-adaptive control of locality is crucial. This highlights that the performance gains of TA-KAN stem from its ability to dynamically modulate locality across tasks, rather than from a particular choice of α\alpha. See App. E for detailed results and additional ablation studies.

Conclusion

We studied OOD detection in rehearsal-free continual learning, where both catastrophic forgetting and lack of past data make reliable OOD detection challenging. We showed that standard KAN classifiers suffer from recency bias, degrading OOD performance for older tasks. To address this, we proposed TA-KAN, a task-adaptive classifier that improves ID–OOD separability via adaptive locality, together with a geometry-guided OOD score that leverages prompt-space structure without requiring past data. Our method consistently improves OOD detection while preserving ID accuracy, achieving state-of-the-art performance with negligible overhead.

Acknowledgments and Disclosure of Funding

This research used the LIEF HPC-GPGPU Facility at the University of Melbourne, established with LIEF Grant LE170100200. Sarah Erfani is in part supported by Australian Research Council (ARC) Discovery Early Career Researcher Award (DECRA) DE220100680.

Reproducibility

The experimental settings and implementation details of our method are reported in § 4.1 and App. § 9. Our code is publicly available at https://github.com/hdnugit/TAKAN/. All experiments are conducted on an NVIDIA A100 GPU. Detailed information on the hardware and software environment is also provided in the repository.

Related Work

Class-Incremental Learning (CIL) aims to learn a sequence of classification tasks, requiring the model to perform prediction over all previously encountered classes. However, catastrophic forgetting [38] remains a fundamental challenge in CIL. To address this, prior methods typically employ rehearsal-based strategies, which retain a small subset of past data [37, 44] or generate synthetic samples [12, 26, 47], and combine them with new-task data to train the model. However, such approaches raise practical limitations, as long-term storage of training data will violate data privacy and incur high memory costs [61]. In contrast, recent advancements in pre-trained models and large language models (LLMs) [52] have enabled prompt-based methods, which have emerged as state-of-the-art [13, 48, 51, 60, 61] and provide a rehearsal-free alternative for CIL. Instead of directly modifying encoder weights on newly arriving data, these methods introduce a small set of learnable parameters (prompts) to instruct the model on sequentially arriving tasks, thereby reducing forgetting and encoding task-specific knowledge in a more succinct way. Originally introduced in Natural Language Processing (NLP), prompt learning was first adapted to vision-based CIL by L2P [61], while DualPrompt [60] further demonstrates that such methods can outperform advanced continual learning approaches that rely on relatively large rehearsal buffers. Subsequent works, including S-Prompts [57], CODA-Prompt [48], HiDe-Prompt [56], Bicecle [51] and CPrompt [13], explore diverse prompt learning strategies to improve knowledge retention and robustness in CIL.

Nevertheless, almost all existing CIL approaches [44, 48, 60, 61] operate under the closed world assumption, wherein test samples are assumed to be drawn independently and identically distributed (i.i.d.) from the training distribution observed so far. However, it is inevitable that continual learning systems encounter novel, unknown samples (OOD)—when deployed in open-world settings. As a crucial first step, the model should reliably detect such samples rather than misclassifying them as one of the known classes, especially in safety-critical deployments such as healthcare [11]. Then, in a future task, when the model approaches their ground truth, these samples should be incrementally incorporated as in-distribution without forgetting previously learned knowledge [25, 30].

Out-of-Distribution (OOD) Detection. A standard approach to OOD detection is to leverage confidence scores derived from deep neural classifiers, such as the maximum softmax probability (MSP) [16], Energy [33]—which also mirrors the class-conditional probability—Entropy (Entropy) [4], and the maximum of logit (MaxLogit) [19]. However, classifier-based scores may suffer from overconfidence issues: while they assign low scores to samples near decision boundaries (useful for near-OOD), they can assign high confidence to far-OOD samples [40]. In contrast, methods such as kNN [50], Mahalanobis [29], and LID [53] rely on geometry-based metrics in feature space for OOD detection. Since these approaches are based on the distance to ID data or local density in the feature space, they can reliably assign low scores to far-OOD regions [40]. NNGuide [40] integrates both classifier-based and geometry-based signals to improve the robustness of OOD detection. In contrast to the above post-hoc methods, retraining-based approaches [10, 17] aim to enhance representations for better ID–OOD separability.

However, all these methods are primarily developed and evaluated in static settings. Directly incorporating these methods into the CL setting is fundamentally challenging and insufficient due to several limitations. On the one hand, these methods do not address the challenges arising from catastrophic forgetting. Maintaining reliable decision boundaries for both inter-task class separation and OOD detection becomes difficult as the notion of the distribution evolves over time; what was previously OOD may become ID as new tasks are learned. On the other hand, the absence of training data from previous tasks makes a large class of methods—including geometry-based and retraining-based approaches—inapplicable, as they rely on access to all training data or require modifications to the training procedure.

Out-of-distribution detection in Class-Incremental Learning (OOD-CL) is a synergistic integration of continual learning and out-of-distribution detection [30]. It aims to deploy CIL models to operate in an open-world setting where the model must (i) identify samples that do not belong to the currently learned classes and (ii) incrementally incorporate such novel data into its knowledge base, while mitigating catastrophic forgetting. In practice, incorporating detected unknowns requires access to labeled training data, which can be obtained through interaction with the environment or human users [25]. Following prior work [23, 24, 25, 30, 34], we do not consider this data acquisition process [32], as it lies outside the scope of this study. Instead, we focus on the core learning challenges of OOD detection and class-incremental learning.

Although there exists a large body of work addressing OOD detection and CIL separately, only a few studies attempt to address OOD-CL. In particular, [25] theoretically demonstrates the necessity of OOD detection in CIL. ORE [23] proposes a contrastive clustering to enhance the separability between ID and OOD samples. However, it maintains a feature buffer for each past class to compute class prototypes at every iteration, which violates the parsimony [59] in CIL [59]. Moreover, it relies on a standard energy-based score [33] for OOD identification and adopts a rehearsal-based CIL framework to mitigate catastrophic forgetting. Similarly, ProKT [30] applies the MaxLogit [19] score to a generic prompt-based CIL model, without explicitly addressing the challenges of OOD-CL, instead combining an existing post-hoc score with a generic prompt-based CIL framework that maintains MM task-specific prompts. Different from the standard CIL setting, MORE [24] employs a multi-headed classifier and trains each task-specific model to distinguish between ID and OOD samples. However, it relies on stored samples in a rehearsal buffer as explicit OOD data to improve current task learning. Different from these approaches, H2ST [34] addresses OOD detection in the task-incremental learning (TIL) setting [8], but similarly maintains a separate model for each task and relies on a rehearsal buffer to train TSC [36] classifiers for each task head. Moreover, MSP-BC-CE [15] formulates OOD detection in unsupervised CIL (UCL) [14] as a post-hoc confidence calibration problem, and relies solely on classifier outputs whereas we address it through model-level design and geometric guidance, enabling more robust OOD detection in CIL.

Overall, existing approaches either naively couple standard OOD methods with CIL models [23, 25, 30] without addressing the core challenges of applying OOD methods in the continual setting, or depend on rehearsal buffers containing past data [23, 24, 34]. In particular, as rehearsal-free CIL emerges as the de facto standard due to its scalability and privacy advantages, enabling reliable OOD detection in this setting is crucial for real-world deployment. Therefore, we develop a novel method for OOD detection in rehearsal-free continual learning and propose a new OOD-CL scoring function.

Kolmogorov–Arnold Networks (KAN) [35] are a novel neural architecture based on the Kolmogorov–Arnold representation theorem (KAT) [27]. Unlike traditional multi-layer perceptrons (MLPs) [20], KANs incorporate learnable activation functions instead of fixed activations with shared weights, thereby exhibiting a distinctive property of local neuroplasticity [3]. The original KAN [35] employs nonlinear B-spline basis functions [42] for function approximation, while subsequent studies [1, 5, 31] explore alternative basis functions to improve performance. RBF-KAN [31] leverages univariate radial basis functions (RBFs) [41] within the superpositional structure of the KAT to approximate multivariate functions. They enhance the geometric interpretability and scalability of KAN, and more effectively address the curse of dimensionality in high-dimensional settings [5, 22]. While many works explore KAN across various domains [49], KAC [22] is the first to study KAN for mitigating catastrophic forgetting in CIL frameworks, demonstrating improved closed-world CIL performance over MLP-based networks. Motivated by this, we extend the study of KAN to the open-world CIL setting and propose a framework that can be integrated into generic rehearsal-free prompt-based models to improve their robustness. It is worth noting that [3] leverages KAN as a post-hoc OOD detector, whereas our usage is fundamentally different. Specifically, their method operates independently of the backbone by comparing activations of a trained and an untrained KAN to derive an OOD score. Moreover, it relies on multiple KAN models (one per class) and aggregates their scores via a max operation. In contrast, we study KAN within the continual learning setting as an integral network component (i.e., the classifier head), enabling end-to-end learning without maintaining multiple detectors. This distinction is critical, as the post-hoc multi-model design is computationally expensive and does not scale to CIL, where the number of tasks or classes grows over time.

Baselines and Configuration

We evaluate our method using five OOD detection methods: MSP [16], MaxLogit [19], Energy [33], Entropy [4], KL [19] and three OOD-CL methods: MORE [24], MSP-BC-CE [15] and Pro-KT [30]. For MORE, which employs multi-head classifiers, we replace the linear heads with KAN-based heads to construct a stronger baseline. Since MORE uses a rehearsal buffer as OOD training data for the current task, we implement it with a buffer size of 1000 across all datasets. Similarly, for ProKT, which is also prompt-based, we replace its linear classifier with a KAN-based classifier of the same size as ours. For MSP-BC-CE, originally proposed for OOD detection in unsupervised continual learning (UCL) [14], we implement it on the same prompt-based model with the KAN head to establish a strong and fair baseline. This provides a strong bias-correction baseline by explicitly compensating for class-weight norm imbalance in the KAN classifier. We additionally consider two canonical classifier alternatives for mitigating classifier bias: a cosine-normalized classifier (Cosine-Head) [21] and a nearest-class-mean classifier (NCM Readout) [43], both implemented within the same prompt-learning framework. For Cosine-Head, we replace the linear classifier with a cosine-normalized classifier, where the feature and class-weight vectors are ℓ2\ell_2-normalized and classification is performed based on their cosine similarity [21]. For NCM Readout, prompts are trained using the same cosine-normalized classification objective, while inference is performed using cosine similarity to stored class prototypes [43]. All reported results are averaged over three independent trial runs for each setting. Following prior CL work [22, 48], each trial uses a different random class-order shuffle generated with a trial-specific seed (set to the loop index), from which the task sequence is constructed. Within each trial, the class order and all other sources of randomness, including model initialization, are kept identical across methods to ensure a fair comparison. Furthermore, we follow the original hyperparameter settings for each method where applicable, and keep all remaining hyperparameters consistent to ensure a fair comparison. For TA-KAN, the hyperparameter αmin⁡\alpha_{\min} is selected as 0.5 from the set {0.25,0.5,0.75}\{0.25, 0.5, 0.75\} using a small held-out validation set, following [23], for all task settings except the 40-task setting, where we set αmin⁡=0.25\alpha_{\min}=0.25. We set αmax⁡=1\alpha_{\max}=1 (default step-size width) to allow sufficient generalization for newer tasks. All experiments are conducted using a ViT-B/16 backbone, following prior work [22, 48, 60].

More Experimental Results and Analysis

Comparison with bias-mitigation classifier heads. We further analyze the Cosine-Head and NCM Readout baselines in Table 1 and Table 2, which provide alternative mechanisms for mitigating classifier bias in CIL. While the Cosine Head consistently improves over the linear head, particularly in ID classification and often in OOD detection, both Cosine-Head and NCM Readout remain overall inferior to the KAN head on OOD detection, particularly on the challenging CUB-200 benchmark. We also compare with MSP-BC-CE, which addresses classifier bias in OOD-CL and is implemented on top of the KAN-Head in our experiments. Although MSP-BC-CE improves OOD detection over the standard KAN-Head in several settings, TA-KAN achieves stronger overall OOD detection, with particularly substantial gains on fine-grained CUB-200. Importantly, these results indicate that neither replacing the linear classifier with normalized or prototype-based decision rules nor applying bias correction to the standard KAN classifier is sufficient to explain the improvements achieved by TA-KAN. Instead, TA-KAN modifies the classifier function itself through task-adaptive control of RBF locality, preserving KAN’s local plasticity while improving ID–OOD separability for older tasks affected by recency bias.

Method5 Tasks10 Tasks20 Tasks
FPRLFPR_LAUCLAUC_LAUPLinAUP_{L\mathrm{in}}AUPLoutAUP_{L\mathrm{out}}ACCLACC_LFPRLFPR_LAUCLAUC_LAUPLinAUP_{L\mathrm{in}}AUPLoutAUP_{L\mathrm{out}}ACCLACC_LFPRLFPR_LAUCLAUC_LAUPLinAUP_{L\mathrm{in}}AUPLoutAUP_{L\mathrm{out}}ACCLACC_L
Linear-Head [48]66.1679.3077.0880.4373.8571.9377.4174.7879.6468.3567.9179.5677.4481.5761.69
Cosine-Head [21]60.6784.1381.2085.2480.0869.4080.3076.1182.1273.1763.1979.1478.1180.1462.24
NCM Readout [43]77.2177.8373.4179.9680.5478.1274.1969.7176.6777.1376.4176.2873.3278.2781.42
KAN-Head (Baseline) [22]59.6583.4880.5184.2781.5571.1180.5376.6982.3078.2959.6981.8681.1882.9375.24
ProKT [30]65.4180.8577.7881.6277.3973.5577.7973.7879.1471.3461.6178.9379.0278.9264.52
MORE [24]66.9680.0676.8780.9174.4779.4677.1571.9279.0571.0565.8779.2977.8080.1170.90
MSP-BC-CE [15]58.0184.6081.1785.3481.5567.8880.6677.6682.3678.2960.6580.2079.2881.7775.24
TA-KAN52.1185.8683.4986.7180.8670.6381.5578.4783.5277.4951.3584.4284.4584.7975.70
TA-KAN + Guidance48.7386.4285.5986.9680.8668.2881.9980.2583.8777.4950.4884.7784.8585.1075.70

Table 1. Results on CUB-200 [54] dataset under different task settings. Lower FPR is better; higher AUC, AUP and ACC are better.

Method5 Tasks10 Tasks20 Tasks40 Tasks
FPRLFPR_LAUCLAUC_LACCLACC_LFPRLFPR_LAUCLAUC_LACCLACC_LFPRLFPR_LAUCLAUC_LACCLACC_LFPRLFPR_LAUCLAUC_LACCLACC_L
Linear-Head [48]42.7485.4477.9645.6986.2676.5153.4985.2873.9053.2181.5768.80
Cosine-Head [21]41.8784.6280.7342.3286.7379.2245.6485.5077.9150.1783.2774.01
NCM Readout [43]43.3385.3877.9845.4385.3677.3247.2684.5976.8649.3783.1974.38
KAN-Head (Baseline) [22]42.5284.8179.2543.0485.6478.7644.0085.4077.4244.8084.6373.95
ProKT [30]48.5981.2672.8250.1881.6371.7252.1980.5269.1551.9480.9165.97
MORE [24]45.8280.7478.6349.2180.1274.2953.6780.3171.8259.6179.3270.45
MSP-BC-CE [15]40.6585.5079.2542.1286.8478.7644.8885.7877.4247.2184.8173.95
TA-KAN40.0785.7778.8340.2586.7677.7642.5785.9977.0344.1686.4872.38
TA-KAN + Guidance39.7285.9278.8339.9886.8777.7642.6186.1077.0344.0386.4172.38

Table 2. Results on ImageNet-R [18] dataset under different task settings. Lower FPR is better; higher AUC and ACC are better.

Results on CIFAR-100. We report results on CIFAR-100 dataset in Table 5 across all task settings. Consistent with other datasets, replacing the standard KAN head with the proposed TA-KAN classifier improves OOD detection performance in terms of both FPR and AUC, while preserving the ID performance gains of KAN. Incorporating the proposed guidance into the TA-KAN scoring function further yields additional improvements in OOD performance. Note that the improvement in ID performance of the standard KAN over the linear head is relatively small compared to other datasets, and a similar trend is observed for TA-KAN. This trend is consistent with prior observations in KAN-based classifiers [22], where performance gains tend to saturate on low-resolution datasets such as CIFAR-100 when using pre-trained backbones.

Method5 Tasks10 Tasks20 Tasks
FPRLFPR_L ↓AUCLAUC_L ↑ACCLACC_L ↑FPRLFPR_L ↓AUCLAUC_L ↑ACCLACC_L ↑FPRLFPR_L ↓AUCLAUC_L ↑ACCLACC_L ↑
Linear-Head [48]36.4590.6788.7141.5889.3086.5549.9286.2782.96
KAN-Head (Baseline) [22]37.2889.7387.9242.7988.3486.7145.0686.8484.83
ProKT [30]45.9186.4483.7252.9783.6279.2764.2077.4372.54
MORE [24]36.9589.1785.6748.1086.9485.4351.3279.2474.27
MSP-BC-CE [15]33.9692.2287.9241.7789.9886.7146.5387.3484.83
TA-KAN35.9690.8587.6340.9289.5586.5345.6887.1284.04
TA-KAN+Guidance34.5091.3287.6339.6690.0286.5343.9487.8784.04

Table 5. Results on CIFAR-100 [28] dataset under different task settings.Lower FPR is better; higher AUC and ACC are better.

Analysis of variance across trials. For each experimental setting, the main results report the mean over multiple independent trial runs. We additionally report the corresponding standard deviations for ImageNet-R in Table 6 to assess performance stability across trials. Each trial uses a different random class order and task partition, in addition to optimization randomness. Consequently, the reported standard deviations reflect robustness to both optimization variability and changes in the continual learning setting itself. The consistently low standard deviations in AUROC and classification accuracy indicate stable OOD detection and continual learning performance across trials. A modest increase in variance is observed as the number of tasks increases, which is expected as the continual learning setting becomes more challenging [48]. FPR exhibits comparatively higher variability due to its greater sensitivity to the operating threshold, while this trend is observed across methods rather than being specific to TA-KAN.

Method5 Tasks10 Tasks20 Tasks
FPRLFPR_LAUCLAUC_LACCLACC_LFPRLFPR_LAUCLAUC_LACCLACC_LFPRLFPR_LAUCLAUC_LACCLACC_L
Linear-Head [48]42.74 ± 1.2985.44 ± 0.3977.96 ± 0.2645.69 ± 2.7186.26 ± 0.7176.51 ± 0.3253.49 ± 6.5985.28 ± 1.6373.90 ± 0.32
KAN-Head (Baseline) [22]42.52 ± 1.2884.81 ± 0.3279.25 ± 0.3843.04 ± 3.0685.64 ± 0.2878.76 ± 0.2644.00 ± 7.7985.40 ± 1.1777.42 ± 0.30
MSP-BC-CE [15]40.65 ± 1.5285.50 ± 0.2179.25 ± 0.3842.12 ± 2.9186.84 ± 0.7478.76 ± 0.2644.88 ± 7.0485.78 ± 1.2177.42 ± 0.30
TA-KAN40.07 ± 1.1885.77 ± 0.2978.83 ± 0.2240.25 ± 3.0086.76 ± 0.4877.76 ± 0.4942.57 ± 8.1685.99 ± 1.3877.03 ± 0.10
TA-KAN + Guidance39.72 ± 1.3585.92 ± 0.3578.83 ± 0.2239.98 ± 2.9086.87 ± 0.4877.76 ± 0.4942.61 ± 8.3986.10 ± 1.5577.03 ± 0.10

Table 6. Results on ImageNet-R [18] under different task settings (mean ± standard deviation over random trials). Lower FPR is better; higher AUC and ACC are better.

Ablation Study and Analysis

Detailed Ablation Study Results of Different Components

We present detailed ablation results in Table 7, analyzing the contribution of each component of our method across all task settings.

Method5 Tasks5 Tasks5 Tasks5 Tasks5 Tasks5 Tasks10 Tasks10 Tasks10 Tasks10 Tasks10 Tasks10 Tasks20 Tasks20 Tasks20 Tasks20 Tasks20 Tasks20 TasksAverageAverageAverageAverageAverageAverage
FPRLFPR_LFPRAFPR_AAUCLAUC_LAUCAAUC_AACCLACC_LACCAACC_AFPRLFPR_LFPRAFPR_AAUCLAUC_LAUCAAUC_AACCLACC_LACCAACC_AFPRLFPR_LFPRAFPR_AAUCLAUC_LAUCAAUC_AACCLACC_LACCAACC_AFPRLFPR_LFPRAFPR_AAUCLAUC_LAUCAAUC_AACCLACC_LACCAACC_A
MLP-Head68.4055.5577.7183.4670.7981.2583.7766.3767.7877.1453.4669.7180.2070.3467.9872.5740.2160.5277.4664.0971.1677.7254.8270.49
Linear-Head66.1654.1379.3084.4673.8582.9771.9360.0077.4182.4568.3580.5167.9163.3779.5680.2861.6974.7868.6759.1778.7682.4067.9679.42
Linear-Head+Guidance62.2258.6479.2083.7873.8582.9772.0862.2777.6782.4068.3580.5166.7861.5180.3281.4561.6974.7867.0360.8179.0682.5467.9679.42
KAN B-spline67.1560.9678.1781.2068.7377.8075.3768.0473.5577.5159.1370.4768.8265.0078.6581.2853.5567.3970.4564.6776.7980.0060.4771.89
KAN B-spline+Guidance65.5661.8278.7881.7668.7377.8071.6766.5674.4878.4259.1370.4768.5564.1479.2681.9853.5567.3968.5964.1777.5180.7260.4771.89
KAN-Head(Baseline)59.6553.8483.4886.3781.5587.1871.1157.7780.5384.8978.2985.8759.6956.3881.8684.2275.2483.0563.4856.0081.9685.1678.3685.37
KAN-Head αmin⁡\alpha_{\min}57.8553.4484.2386.8980.7886.6768.5156.2380.4685.1873.9583.5554.0153.1782.1185.3373.6083.3560.1254.2882.2785.8076.1184.52
KAN-Head trainable σ\sigma60.2954.4182.9786.1581.1087.0071.5258.0080.3184.7778.2285.8562.2756.4981.3184.2175.1583.2264.6956.3081.5385.0478.1685.36
KAN-Head+Guidance54.6451.8984.1886.8081.5587.1863.2054.2881.5985.6078.2985.8757.5356.2182.4985.0875.2483.0558.4654.1382.7585.8378.3685.37
TA-KAN Head52.1152.1985.8687.5380.8686.8070.6358.3181.5584.9277.4985.1051.3554.9884.4284.4875.7083.8258.0355.1683.9485.6478.0285.24
TA-KAN+Guidance(ours)48.7348.5286.4288.0680.8686.8068.2854.9481.9985.5177.4985.1050.4853.0784.7784.9675.7083.8255.8352.1884.3986.1878.0285.24

Table 7. Detailed ablation study results of different components. Results are reported over all task settings on CUB-200 dataset. Lower FPR is better; higher AUC and ACC are better.

Comparison with B-spline KAN. In addition to the ablations of different components presented in Table 3 of the main paper, we evaluate the effect of the RBF basis by comparing with the original cubic B-spline KAN [35, 42] (KAN B-spline in Table 7) under the same experimental setting, using a capacity-comparable configuration with G=13G = 13 grid points and spline order k=3k = 3. The B-spline KAN underperforms the fixed-width RBF-KAN (KAN-Head) in OOD detection, while applying guidance improves both variants. These results support the use of RBF bases for OOD-CL, consistent with their advantages in high-dimensional settings [5, 22, 31]. Importantly, TA-KAN further improves upon the fixed-width RBF-KAN, isolating the additional benefit of the proposed task-adaptive locality mechanism.

Hyperparameter Analysis

Effect of αmin⁡\alpha_{\min}: We analyze the impact of the hyperparameter αmin⁡\alpha_{\min} in TA-KAN in Table 8, considering values from {0.25,0.5,0.75}\{0.25, 0.5, 0.75\}, where αmin⁡=1\alpha_{\min} = 1 corresponds to the standard KAN without adaptive locality. We observe that moderate values of αmin⁡\alpha_{\min} yield the best overall performance. As αmin⁡\alpha_{\min} decreases, the RBF responses become increasingly localized, which initially improves OOD detection by enhancing fine-grained separability between ID and OOD samples. However, excessive reduction in αmin⁡\alpha_{\min} leads to overly sharp responses, making the model sensitive to intra-class variations and thereby degrading both OOD detection gains and ID classification performance. This behavior highlights an inherent trade-off between locality and generalizability: while increased locality improves discrimination in ambiguous regions, sufficient smoothness is required to preserve robustness to intra-class variability.

αmin⁡\alpha_{\min}FPRLFPR_LFPRAFPR_AAUCLAUC_LAUCAAUC_AACCLACC_LACCAACC_A
159.6553.8483.4886.3781.5587.18
1 + Guidance54.6451.8984.1886.8081.5587.18
0.7555.7853.1184.6186.9081.4787.10
0.75 + Guidance51.4649.4085.2887.4281.4787.10
0.552.1152.1985.8687.5380.8686.80
0.5 + Guidance48.7348.5286.4288.0680.8686.80
0.2550.2252.8785.8286.9378.4384.57
0.25 + Guidance49.1350.9686.1587.4478.4384.57

Table 8. Results on CUB-200 dataset for different αmin⁡\alpha_{\min} values. Lower FPR is better; higher AUC and ACC are better.

Assumptions on NN. We assume the number of tasks NN is known when defining the schedule in Eq. (9), following standard practice in class-incremental and prompt-based continual learning methods [13, 48, 60]. While we consider such a known (or bounded) set of tasks, this does not limit practical applicability, as new tasks can be accommodated by incrementally introducing additional task prototypes, with the corresponding width factor initialized to 1 (i.e., the default, most general setting).

Threshold selection in continual learning. In practical deployment, OOD detection requires selecting a decision threshold. Following prior work, a practical approach is to estimate the threshold using statistics of the current task data (e.g., average-based thresholding), or to use a small held-out validation set when available [25, 30]. Our method is fully compatible with such strategies at deployment time. For evaluation, following prior work [15, 23, 25, 30], we do not perform explicit threshold tuning and instead adopt threshold-independent metrics, namely AUC and FPR, which enable fair and consistent comparison across methods.

Comparison with Various Post-Hoc OOD Scores

Table 9: Results on the CUB-200 [54] dataset using various post-hoc OOD scoring methods across task settings. Lower FPR is better; higher AUC and ACC are better. Values in parentheses denote changes relative to the corresponding Linear-Head scores.

Table 10: Results on the ImageNet-R [18] dataset using various post-hoc OOD scoring methods across task settings. Lower FPR is better; higher AUC and ACC are better. Values in parentheses denote changes relative to the corresponding Linear-Head scores.

We compare our method with standard post-hoc OOD scoring methods on CUB-200 (Table 9) and ImageNet-R (Table 10), including MSP [16], MaxLogit [19], Energy [33], Entropy [4], and KL [19].

MethodScore5 tasks FPR_L5 tasks AUC_L5 tasks ACC_L10 tasks FPR_L10 tasks AUC_L10 tasks ACC_L20 tasks FPR_L20 tasks AUC_L20 tasks ACC_L
Linear-HeadMSP [16]66.1679.3073.8571.9377.4168.3567.9179.5661.69
Linear-HeadMaxLogit [19]59.3684.1673.8566.4180.9168.3570.7178.0861.69
Linear-HeadEnergy [33]59.6683.7573.8566.1379.9068.3576.8973.4261.69
Linear-HeadEntropy [4]64.4382.4073.8568.3481.4968.3565.0280.6361.69
Linear-HeadKL [19]60.5382.8973.8567.5678.7368.3578.4372.7161.69
Linear-HeadMSP-BC-CE [15]64.7080.3673.8567.9778.2968.3574.2876.0461.69
KAN-Head (Baseline)MSP [16]59.65 (-6.51)83.48 (+4.18)81.5571.11 (-0.82)80.53 (+3.12)78.2959.69 (-8.22)81.86 (+2.30)75.24
KAN-Head (Baseline)MaxLogit [19]54.17 (-5.19)85.38 (+1.22)81.5556.97 (-9.44)82.70 (+1.79)78.2959.65 (-11.06)80.67 (+2.59)75.24
KAN-Head (Baseline)Energy [33]56.57 (-3.09)84.47 (+0.72)81.5557.15 (-8.98)81.68 (+1.78)78.2963.47 (-13.42)78.30 (+4.88)75.24
KAN-Head (Baseline)Entropy [4]55.38 (-9.05)85.20 (+2.80)81.5566.39 (-1.95)82.41 (+0.92)78.2954.84 (-10.18)82.33 (+1.70)75.24
KAN-Head (Baseline)KL [19]58.53 (-2.00)84.04 (+1.15)81.5558.16 (-9.40)81.42 (+2.69)78.2963.30 (-15.13)78.37 (+5.66)75.24
KAN-Head (Baseline)MSP-BC-CE [15]58.01 (-6.69)84.60 (+4.24)81.5567.88 (-0.09)80.66 (+2.37)78.2960.65 (-13.63)80.20 (+4.16)75.24
TA-KAN HeadMSP [16]52.11 (-14.05)85.86 (+6.56)80.8670.63 (-1.30)81.55 (+4.14)77.4951.35 (-16.56)84.42 (+4.86)75.70
TA-KAN HeadMaxLogit [19]52.91 (-6.45)85.77 (+1.61)80.8657.75 (-8.66)82.25 (+1.34)77.4955.34 (-15.37)82.17 (+4.09)75.70
TA-KAN HeadEnergy [33]58.69 (-0.97)84.15 (+0.40)80.8661.86 (-4.27)80.35 (+0.45)77.4962.36 (-14.53)77.65 (+4.23)75.70
TA-KAN HeadEntropy [4]52.22 (-12.21)85.77 (+3.37)80.8666.49 (-1.85)81.62 (+0.13)77.4957.27 (-7.75)81.35 (+0.72)75.70
TA-KAN HeadKL [19]58.25 (-2.28)83.67 (+0.78)80.8667.13 (-0.43)77.57 (-1.16)77.4966.18 (-12.25)76.55 (+3.84)75.70
TA-KAN HeadMSP-BC-CE [15]54.27 (-10.43)85.24 (+4.88)80.8667.96 (-0.01)80.32 (+2.03)77.4958.29 (-15.99)81.86 (+5.82)75.70
TA-KAN+GuidanceMSP [16]48.73 (-17.43)86.42 (+7.12)80.8668.28 (-3.65)81.99 (+4.58)77.4950.48 (-17.43)84.77 (+5.21)75.70
TA-KAN+GuidanceMaxLogit [19]50.51 (-8.85)86.03 (+1.87)80.8658.37 (-8.04)82.38 (+1.47)77.4957.57 (-13.14)82.07 (+3.99)75.70
TA-KAN+GuidanceEnergy [33]58.32 (-1.34)84.71 (+0.96)80.8668.17 (+2.04)79.56 (-0.34)77.4967.00 (-9.89)76.65 (+3.23)75.70
TA-KAN+GuidanceEntropy [4]52.94 (-11.49)85.24 (+2.84)80.8667.25 (-1.09)81.97 (+0.48)77.4957.31 (-7.71)79.85 (-0.78)75.70
TA-KAN+GuidanceKL [19]56.37 (-4.16)83.90 (+1.01)80.8669.26 (+1.70)77.59 (-1.14)77.4967.47 (-10.96)76.49 (+3.78)75.70
TA-KAN+GuidanceMSP-BC-CE [15]52.92 (-11.78)85.00 (+5.14)80.8667.67 (-0.30)80.54 (+2.25)77.4958.38 (-15.90)81.99 (+5.95)75.70

Table 9. Results on the CUB-200 [54] dataset using various post-hoc OOD scoring methods across task settings. Lower FPR is better; higher AUC and ACC are better. Values in parentheses denote changes relative to the corresponding Linear-Head scores.

MethodScore5 tasks FPR_L5 tasks AUC_L5 tasks ACC_L10 tasks FPR_L10 tasks AUC_L10 tasks ACC_L20 tasks FPR_L20 tasks AUC_L20 tasks ACC_L
Linear-HeadMSP [16]42.7485.4477.9645.6986.2676.5153.4985.2873.90
Linear-HeadMaxLogit [19]47.1387.3677.9653.6387.0976.5163.6484.2473.90
Linear-HeadEnergy [33]48.0487.2777.9655.1286.4376.5166.6582.0673.90
Linear-HeadEntropy [4]41.9887.2177.9644.9587.9576.5152.6286.5273.90
Linear-HeadKL [19]52.6986.5177.9659.1184.9876.5168.9580.7673.90
Linear-HeadMSP-BC-CE [15]43.3786.3977.9647.2686.4676.5155.6284.9973.90
KAN-Head (Baseline)MSP [16]42.52 (-0.22)85.41 (-0.63)79.2543.04 (-2.65)85.64 (-0.62)78.7644.00 (-9.49)85.40 (+0.12)77.42
KAN-Head (Baseline)MaxLogit [19]39.76 (-7.37)87.29 (-0.07)79.2540.37 (-13.26)87.47 (+0.38)78.7641.88 (-21.76)86.79 (+2.55)77.42
KAN-Head (Baseline)Energy [33]39.99 (-8.05)85.57 (-0.27)79.2540.60 (-14.52)87.65 (+1.22)78.7642.47 (-24.18)86.92 (+4.86)77.42
KAN-Head (Baseline)Entropy [4]41.84 (-0.14)85.88 (-1.33)79.2541.75 (-3.20)86.82 (-1.13)78.7642.98 (-9.64)86.44 (-0.08)77.42
KAN-Head (Baseline)KL [19]40.85 (-11.84)86.97 (+0.46)79.2540.89 (-18.22)87.60 (+2.62)78.7642.47 (-26.48)87.01 (+6.25)77.42
KAN-Head (Baseline)MSP-BC-CE [15]40.65 (-2.72)85.50 (-0.89)79.2542.12 (-5.14)86.84 (+0.38)78.7644.88 (-10.74)85.78 (+0.79)77.42
TA-KAN HeadMSP [16]40.07 (-2.67)85.77 (+0.33)78.8340.25 (-5.44)86.76 (+0.50)77.7642.57 (-10.92)85.99 (+0.71)77.03
TA-KAN HeadMaxLogit [19]38.64 (-8.49)87.37 (+0.01)78.8338.87 (-14.76)87.67 (+0.58)77.7642.06 (-21.58)86.76 (+2.52)77.03
TA-KAN HeadEnergy [33]39.51 (-8.53)87.36 (+0.09)78.8340.37 (-14.75)87.00 (+0.57)77.7645.43 (-21.22)85.62 (+3.56)77.03
TA-KAN HeadEntropy [4]39.57 (-2.41)87.52 (+0.31)78.8339.60 (-5.35)87.98 (+0.03)77.7642.76 (-9.86)86.87 (+0.35)77.03
TA-KAN HeadKL [19]40.47 (-12.22)86.58 (+0.07)78.8339.87 (-19.24)86.76 (+2.78)77.7643.99 (-24.96)86.69 (+5.93)77.03
TA-KAN HeadMSP-BC-CE [15]40.27 (-3.10)86.70 (+0.31)78.8340.48 (-6.78)87.22 (+0.76)77.7643.84 (-11.78)85.99 (+1.00)77.03
TA-KAN+GuidanceMSP [16]39.72 (-3.02)85.92 (+0.48)78.8339.98 (-5.71)86.87 (+0.61)77.7642.61 (-10.88)86.10 (+0.82)77.03
TA-KAN+GuidanceMaxLogit [19]38.64 (-8.49)87.58 (+0.22)78.8339.03 (-14.60)87.64 (+0.55)77.7642.82 (-20.82)86.61 (+2.37)77.03
TA-KAN+GuidanceEnergy [33]39.77 (-8.27)87.29 (+0.02)78.8343.15 (-11.97)85.72 (-0.71)77.7656.82 (-9.83)81.81 (-0.25)77.03
TA-KAN+GuidanceEntropy [4]39.99 (-1.99)87.24 (+0.03)78.8340.14 (-4.81)87.41 (-0.54)77.7644.14 (-8.48)86.63 (+0.11)77.03
TA-KAN+GuidanceKL [19]39.79 (-12.90)86.91 (+0.40)78.8339.91 (-19.20)87.61 (+2.63)77.7645.10 (-23.85)86.16 (+5.40)77.03
TA-KAN+GuidanceMSP-BC-CE [15]39.61 (-3.76)87.14 (+0.75)78.8340.35 (-6.91)87.35 (+0.89)77.7643.78 (-11.84)85.95 (+1.06)77.03

Table 10. Results on the ImageNet-R [18] dataset using various post-hoc OOD scoring methods across task settings. Lower FPR is better; higher AUC and ACC are better. Values in parentheses denote changes relative to the corresponding Linear-Head scores.

Across both datasets, we observe a consistent trend similar to MSP: replacing the standard KAN with the proposed TA-KAN consistently improves OOD detection performance in terms of both FPR and AUC, while preserving the ID performance gains over the linear head, across all considered confidence-based scores. Furthermore, incorporating the proposed guidance into TA-KAN yields additional improvements.

Comparison with Geometry-Based OOD Scores

We compare the proposed geometry-guided OOD score with existing geometry-based OOD methods that operate in the embedding space, as shown in Table 11. These methods typically require access to past ID data; therefore, for a fair comparison, we equip them with a rehearsal buffer of size 1000. Our proposed guidance consistently outperforms these approaches. In particular, NNGuide combines embedding-space geometry with classifier confidence (e.g., MSP), whereas our method provides geometry guidance in the task (prompt) space without requiring access to past ID data. Despite operating in a rehearsal-free setting, our approach achieves significantly better performance, highlighting the effectiveness of proposed geometry guided score for OOD-CL.

MethodFPRLFPR_LFPRAFPR_AAUCLAUC_LAUCAAUC_AACCLACC_LACCAACC_A
MSP53.5050.8085.7087.6181.4186.97
KNN85.3371.4357.1669.4781.4186.97
NNGuide55.1651.6986.0187.8981.4186.97
Guidance (Ours)50.3047.2186.2088.1581.4186.97

Table 11. Comparison of different geometry-based scoring methods on the CUB-200 dataset. Lower FPR is better; higher AUC and ACC are better.

Backbone and Prompt-Based Model

We adopt a prompt-based continual learning model with a frozen backbone gg (e.g., ViT) as the feature extractor, following prior work [13, 22, 48, 60]. Our proposed method is orthogonal to the choice of backbone and prompt-learning strategy. Therefore, it can be seamlessly integrated with different prompt-based CIL frameworks without modifying the backbone or prompt-learning procedure. In our main experiments, we use CODAPrompt [48] as the default model, while here we evaluate generalization using DualPrompt [60]. As shown in Table 12, we observe a consistent trend across models. Replacing the standard KAN head with TA-KAN improves OOD detection performance and ID performance. Further incorporating the proposed geometry-based guidance yields additional improvements.

Method\multicolumn{3}{c}{CUB-200}\multicolumn{3}{c}{ImageNet-R}
FPRLFPR_LAUCLAUC_LACCLACC_LFPRLFPR_LAUCLAUC_LACCLACC_L
Linear-Head79.1576.6070.4350.8483.1672.62
KAN-Head (Baseline)71.8180.1679.2846.9383.3074.34
TA-KAN67.0981.8679.5146.4384.1275.10
TA-KAN+Guidance62.8380.6779.5144.9884.8075.10

Table 12. Results on the CUB-200 and ImageNet-R datasets on 10-tasks setting using DualPrompt as the backbone prompt-based model. Lower FPR is better; higher AUC and ACC are better.

Efficiency Analysis

We further assess the performance–efficiency trade-off by measuring the average training time per epoch and inference latency per sample under identical experimental settings on an NVIDIA A100 GPU. As shown in Table 13, TA-KAN increases training time by only 0.67% and inference latency by 0.50% relative to the Linear-Head, while substantially reducing FPR from 66.16% to 52.11% (a 21.2% relative reduction) and improving AUC from 79.30% to 85.86%. The small runtime overhead is expected because all methods share the same ViT backbone and prompt-learning module, which dominate the overall computation, whereas the architectural differences are confined to the lightweight classifier head. Importantly, TA-KAN introduces no additional task-specific classifier parameters; instead, it maintains the same number of learnable parameters as the standard KAN-Head while adaptively modulating the RBF width factor, with nearly identical runtime. The proposed geometry-guided OOD score is also computationally efficient, as it is computed post hoc using prompt alignment. Since the size of the prompt bank is much smaller than the number of training samples, this incurs substantially lower cost than conventional geometry-based OOD methods such as KNN or NNGuide, which require nearest-neighbor search over stored ID features.

MethodFPRL↓FPR_L \downarrowAUCL↑AUC_L \uparrowTrain Time / Epoch (s) ↓\downarrowInference Time / Sample (ms) ↓\downarrow
Linear-Head66.1679.3011.60624.5659
KAN-Head59.6583.4811.64494.5895
TA-KAN52.1185.8611.68384.5887

Table 13. Performance–efficiency comparison on the CUB-200 5-task setting.

Discussion

Limitations and Future Work. Our method is developed within prompt-based continual learning, where the downstream classifier plays an important but relatively underexplored role in continual OOD detection. TA-KAN specifically addresses task-recency bias at the classifier level through adaptive RBF locality, rather than modifying the underlying feature representations. While this design is well suited to scalable continual learning with pre-trained backbones, extending the proposed task-adaptive mechanism and geometry-guided scoring to other classifier architectures and non-prompt-based frameworks remains an interesting direction for future work.

Broader Impact. This work advances out-of-distribution detection in continual learning (OOD-CL), enabling more reliable deployment of machine learning systems in open-world environments. By improving detection of unseen inputs without storing past data, the proposed rehearsal-free framework enhances safety and reduces overconfidence in applications such as healthcare, autonomous driving, and surveillance. Additionally, its privacy-preserving and scalable design makes it well-suited for real-world systems with evolving data streams.

References

  1. [1]Alireza Afzal Aghaei. fkan: Fractional kolmogorov–arnold networks with trainable jacobi basis functions. Neurocomputing, 623:129414, 2025.
  2. [2]Eden Belouadah, Adrian Popescu, and Ioannis Kanellos. A comprehensive study of class incremental learning algorithms for visual tasks. Neural Networks, 135:38–54, 2021.arxiv.org/abs/2011.01844
  3. [3]Alessandro Canevaro, Julian Schmidt, Mohammad Sajad Marvi, Hang Yu, Georg Martius, and Julian Jordan. Advancing out-of-distribution detection via local neuroplasticity. In ICLR, 2025. URL https://openreview.net/forum?id=1F8xTfv6ah.arxiv.org/abs/2502.15833
  4. [4]Robin Chan, Matthias Rottmann, and Hanno Gottschalk. Entropy maximization and meta classification for out-of-distribution detection in semantic segmentation. In ICCV, pages 5128–5137, 2021.arxiv.org/abs/2012.06575
  5. [5]Zengfu Chao, Xinran Liu, Zheyu Wu, and Xiaoping Li. Rbf-kan: Radial basis function-kolmogorov-arnold networks. IEEE Internet of Things Journal, 2026.DOI
  6. [6]Shao-Ting Chiu, Siu Wun Cheung, Ulisses Braga-Neto, Chak Shing Lee, and Rui Peng Li. Free-rbf-kan: Kolmogorov-arnold networks with adaptive radial basis functions for efficient function learning. arXiv preprint arXiv:2601.07760, 2026.arxiv.org/abs/2601.07760
  7. [7]Matthias De Lange, Rahaf Aljundi, Marc Masana, Sarah Parisot, Xu Jia, Aleš Leonardis, Gregory Slabaugh, and Tinne Tuytelaars. A continual learning survey: Defying forgetting in classification tasks. IEEE transactions on pattern analysis and machine intelligence, 44(7):3366–3385, 2021.DOI
  8. [8]Matthias De Lange, Rahaf Aljundi, Marc Masana, Sarah Parisot, Xu Jia, Aleš Leonardis, Gregory Slabaugh, and Tinne Tuytelaars. A continual learning survey: Defying forgetting in classification tasks. IEEE transactions on pattern analysis and machine intelligence, 44(7):3366–3385, 2021.DOI
  9. [9]Alexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, Dirk Weissenborn, Xiaohua Zhai, Thomas Unterthiner, Mostafa Dehghani, Matthias Minderer, Georg Heigold, Sylvain Gelly, et al. An image is worth 16x16 words: Transformers for image recognition at scale. arXiv preprint arXiv:2010.11929, 2020.arxiv.org/abs/2010.11929
  10. [10]Xuefeng Du, Zhaoning Wang, Mu Cai, and Yixuan Li. Vos: Learning what you don’t know by virtual outlier synthesis. arXiv preprint arXiv:2202.01197, 2022.arxiv.org/abs/2202.01197
  11. [11]Olga Fink, Qin Wang, Markus Svensen, Pierre Dersin, Wan-Jui Lee, and Melanie Ducoffe. Potential, challenges and future directions for deep learning in prognostics and health management applications. Engineering Applications of Artificial Intelligence, 92:103678, 2020.
  12. [12]Rui Gao and Weiwei Liu. Ddgr: Continual learning with deep diffusion-based generative replay. In ICML, pages 10744–10763. PMLR, 2023.
  13. [13]Zhanxin Gao, Jun Cen, and Xiaobin Chang. Consistent prompting for rehearsal-free continual learning. In CVPR, pages 28463–28473, 2024.arxiv.org/abs/2403.08568
  14. [14]Jiangpeng He and Fengqing Zhu. Unsupervised continual learning via pseudo labels. In International Workshop on Continual Semi-Supervised Learning, pages 15–32. Springer, 2021.arxiv.org/abs/2104.07164
  15. [15]Jiangpeng He and Fengqing Zhu. Out-of-distribution detection in unsupervised continual learning. In CVPRW, pages 3850–3855, 2022.arxiv.org/abs/2204.05462
  16. [16]Dan Hendrycks and Kevin Gimpel. A baseline for detecting misclassified and out-of-distribution examples in neural networks. In ICLR, 2017.
  17. [17]Dan Hendrycks, Mantas Mazeika, and Thomas G. Dietterich. Deep anomaly detection with outlier exposure. In ICLR, 2019.
  18. [18]Dan Hendrycks, Steven Basart, Norman Mu, Sauav Kadavath, Frank Wang, Evan Dorundo, Rahul Desai, Tyler Zhu, Samyak Parajuli, Mike Guo, et al. The many faces of robustness: A critical analysis of out-of-distribution generalization. In ICCV, pages 8340–8349, 2021.
  19. [19]Dan Hendrycks, Steven Basart, Mantas Mazeika, Andy Zou, Joseph Kwon, Mohammadreza Mostajabi, Jacob Steinhardt, and Dawn Song. Scaling out-of-distribution detection for real-world settings. In ICML, pages 8759–8773, 2022.
  20. [20]Kurt Hornik, Maxwell Stinchcombe, and Halbert White. Multilayer feedforward networks are universal approximators. Neural networks, 2(5):359–366, 1989.DOI
  21. [21]Saihui Hou, Xinyu Pan, Chen Change Loy, Zilei Wang, and Dahua Lin. Learning a unified classifier incrementally via rebalancing. In CVPR, pages 831–839, 2019.DOI
  22. [22]Yusong Hu, Zichen Liang, Fei Yang, Qibin Hou, Xiailei Liu, and Ming-Ming Cheng. Kac: Kolmogorov-arnold classifier for continual learning. In CVPR, pages 15297–15307, 2025.arxiv.org/abs/2503.21076
  23. [23]KJ Joseph, Salman Khan, Fahad Shahbaz Khan, and Vineeth N Balasubramanian. Towards open world object detection. In CVPR, pages 5830–5840, 2021.arxiv.org/abs/2103.02603
  24. [24]Gyuhak Kim, Bing Liu, and Zixuan Ke. A multi-head model for continual learning via out-of-distribution replay. In Conference on lifelong learning agents, pages 548–563. PMLR, 2022.arxiv.org/abs/2208.09734
  25. [25]Gyuhak Kim, Changnan Xiao, Tatsuya Konishi, Zixuan Ke, and Bing Liu. Open-world continual learning: Unifying novelty detection and continual learning. Artificial Intelligence, 338:104237, 2025.arxiv.org/abs/2304.10038
  26. [26]Junsu Kim, Hoseong Cho, Jihyeon Kim, Yi halem Yimolal Tiruneh, and Seungryul Baek. Sddgr: Stable diffusion-based deep generative replay for class incremental object detection. In CVPR, pages 28772–28781, 2024.arxiv.org/abs/2402.17323
  27. [27]Andrei Nikolaevich Kolmogorov. On the representation of continuous functions of several variables by superpositions of continuous functions of a smaller number of variables. American Mathematical Society, 1961.DOI
  28. [28]Alex Krizhevsky, Geoffrey Hinton, et al. Learning multiple layers of features from tiny images. 2009.
  29. [29]Kimin Lee, Kibok Lee, Honglak Lee, and Jinwoo Shin. A simple unified framework for detecting out-of-distribution samples and adversarial attacks. In NeurIPS, 2018.
  30. [30]Yujie Li, Xin Yang, Hao Wang, Xiangkun Wang, and Tianrui Li. Learning to prompt knowledge transfer for open-world continual learning. In AAAI, volume 38, pages 13700–13708, 2024.arxiv.org/abs/2312.14990
  31. [31]Ziyao Li. Kolmogorov-arnold networks are radial basis function networks. arXiv preprint arXiv:2405.06721, 2024.arxiv.org/abs/2405.06721
  32. [32]Bing Liu, Sahisnu Mazumder, Eric Robertson, and Scott Grigsby. Ai autonomy: Self-initiated open-world continual learning and adaptation. AI Magazine, 44(2):185–199, 2023.arxiv.org/abs/2203.08994
  33. [33]Weitang Liu, Xiaoyun Wang, John Owens, and Yixuan Li. Energy-based out-of-distribution detection. In NeurIPS, pages 21464–21475, 2020.arxiv.org/abs/2010.03759
  34. [34]Yuhang Liu, Wenjie Zhao, and Yunhui Guo. H2st: Hierarchical two-sample tests for continual out-of-distribution detection. In CVPR, pages 15413–15423, 2025.arxiv.org/abs/2503.14832
  35. [35]Ziming Liu, Yixuan Wang, Sachin Vaidya, Fabian Ruehle, James Halverson, Marin Soljačić, Thomas Y Hou, and Max Tegmark. Kan: Kolmogorov-arnold networks. In ICLR, 2025.arxiv.org/abs/2404.19756
  36. [36]David Lopez-Paz and Maxime Oquab. Revisiting classifier two-sample tests. arXiv preprint arXiv:1610.06545, 2016.
  37. [37]David Lopez-Paz and Marc’Aurelio Ranzato. Gradient episodic memory for continual learning. NeurIPS, 30, 2017.
  38. [38]Michael McCloskey and Neal J Cohen. Catastrophic interference in connectionist networks: The sequential learning problem. In Psychology of learning and motivation, volume 24, pages 109–165. Elsevier, 1989.DOI
  39. [39]Jay Nandy, Wynne Hsu, and Mong Li Lee. Towards maximizing the representation gap between in-domain & out-of-distribution examples. NeurIPS, 33:9239–9250, 2020.
  40. [40]Jaewoo Park, Yoon Gyo Jung, and Andrew Beng Jin Teoh. Nearest neighbor guidance for out-of-distribution detection. In ICCV, pages 1686–1695, 2023.arxiv.org/abs/2309.14888
  41. [41]Michael JD Powell. Radial basis functions for multivariable interpolation: a review. Algorithms for approximation, pages 143–167, 1987.
  42. [42]Kaihuai Qin. General matrix representations for b-splines. In Proceedings Pacific Graphics’ 98. Sixth Pacific Conference on Computer Graphics and Applications (Cat. No. 98EX208), pages 37–43. IEEE, 1998.
  43. [43]Sylvestre-Alvise Rebuffi, Alexander Kolesnikov, Georg Sperl, and Christoph H Lampert. icarl: Incremental classifier and representation learning. In CVPR, pages 2001–2010, 2017.
  44. [44]David Rolnick, Arun Ahuja, Jonathan Schwarz, Timothy Lillicrap, and Gregory Wayne. Experience replay for continual learning. NeurIPS, 32, 2019.
  45. [45]Chandramouli Shama Sastry and Sageev Oore. Detecting out-of-distribution examples with gram matrices. In ICML, pages 8491–8501. PMLR, 2020.
  46. [46]Claude E Shannon. A mathematical theory of communication. The Bell system technical journal, 27(3): 379–423, 1948.
  47. [47]Hanul Shin, Jung Kwon Lee, Jaehong Kim, and Jiwon Kim. Continual learning with deep generative replay. NeurIPS, 30, 2017.arxiv.org/abs/1705.08690
  48. [48]James Seale Smith, Leonid Karlinsky, Vyshnavi Gutta, Paola Cascante-Bonilla, Donghyun Kim, Assaf Arbelle, Rameswar Panda, Rogerio Feris, and Zsolt Kira. Coda-prompt: Continual decomposed attention-based prompting for rehearsal-free continual learning. In CVPR, pages 11909–11919, 2023.arxiv.org/abs/2211.13218
  49. [49]Shriyank Somvanshi, Syed Aaqib Javed, Md Monzurul Islam, Diwas Pandit, and Subasish Das. A survey on kolmogorov-arnold network. ACM Computing Surveys, 58(2):1–35, 2025.
  50. [50]Yiyou Sun, Yifei Ming, Xiaojin Zhu, and Yixuan Li. Out-of-distribution detection with deep nearest neighbors. In ICML, pages 20827–20840. PMLR, 2022.arxiv.org/abs/2204.06507
  51. [51]Yue Tan, Xiaoqian Hu, Hao Xue, Celso De Melo, and Flora D Salim. Bisecele: Binding and separation in continual learning for video language understanding. arXiv preprint arXiv:2507.00469, 2025.arxiv.org/abs/2507.00469
  52. [52]Hugo Touvron, Thibaut Lavril, Gautier Izacard, Xavier Martinet, Marie-Anne Lachaux, Timothée Lacroix, Baptiste Rozière, Naman Goyal, Eric Hambro, Faisal Azhar, et al. Llama: Open and efficient foundation language models. arXiv preprint arXiv:2302.13971, 2023.arxiv.org/abs/2302.13971
  53. [53]Nimeshika Udayangani, Sarah Erfani, and Christopher Leckie. Suplid: Geometrical guidance for out-of-distribution detection in semantic segmentation. In Proceedings of the 34th ACM International Conference on Information and Knowledge Management, pages 2905–2914, 2025.
  54. [54]Catherine Wah, Steve Branson, Peter Welinder, Pietro Perona, and Serge Belongie. The caltech-ucsd birds-200-2011 dataset. 2011.
  55. [55]Haoqi Wang, Zhizhong Li, Litong Feng, and Wayne Zhang. Vim: Out-of-distribution with virtual-logit matching. In CVPR, pages 4921–4930, 2022.arxiv.org/abs/2203.10807
  56. [56]Liyuan Wang, Jingyi Xie, Xingxing Zhang, Mingyi Huang, Hang Su, and Jun Zhu. Hierarchical decomposition of prompt-based continual learning: Rethinking obscured sub-optimality. NeurIPS, 36:69054–69076, 2023.arxiv.org/abs/2310.07234
  57. [57]Yabin Wang, Zhiwu Huang, and Xiaopeng Hong. S-prompts learning with pre-trained transformers: An occam’s razor for domain incremental learning. NeurIPS, 35:5682–5695, 2022.arxiv.org/abs/2207.12819
  58. [58]Yezhen Wang, Bo Li, Tong Che, Kaiyang Zhou, Ziwei Liu, and Dongsheng Li. Energy-based open-world uncertainty modeling for confidence calibration. In ICCV, pages 9302–9311, 2021.arxiv.org/abs/2107.12628
  59. [59]Zifeng Wang, Tong Jian, Kaushik Chowdhury, Yanzhi Wang, Jennifer Dy, and Stratis Ioannidis. Learn-prune-share for lifelong learning. In ICDM, pages 641–650. IEEE, 2020.arxiv.org/abs/2012.06956
  60. [60]Zifeng Wang, Zizhao Zhang, Sayna Ebrahimi, Ruoxi Sun, Han Zhang, Chen-Yu Lee, Xiaoqi Ren, Guolong Su, Vincent Perot, Jennifer Dy, et al. Dualprompt: Complementary prompting for rehearsal-free continual learning. In ECCV, pages 631–648. Springer, 2022.arxiv.org/abs/2204.04799
  61. [61]Zifeng Wang, Zizhao Zhang, Chen-Yu Lee, Han Zhang, Ruoxi Sun, Xiaoqi Ren, Guolong Su, Vincent Perot, Jennifer Dy, and Tomas Pfister. Learning to prompt for continual learning. In CVPR, pages 139–149, 2022.arxiv.org/abs/2112.08654
  62. [62]Haitao Wen, Lili Pan, Yu Dai, Heqian Qiu, Lanxiao Wang, Qingbo Wu, and Hongliang Li. Class incremental learning with multi-teacher distillation. In CVPR, pages 28443–28452, 2024.DOI
  63. [63]Jingyang Zhang, Nathan Inkawich, Randolph Linderman, Yiran Chen, and Hai Li. Mixture outlier exposure: Towards out-of-distribution detection in fine-grained environments. In WACV, pages 5531–5540, 2023.arxiv.org/abs/2106.03917

Paper details

vlnc:W_mje47hj7
v1 · latestHistory (1)

published · Fresh — added to the Hub within the last 30 days

added ·

Usage

views · 0

downloads · 0

A view counts once per browser per day, a download each time the PDF is requested.

CC BY 4.0

Original source

  • Computer Science

Not recorded for this paper · View statement →

Looking for related papers…
Contents