WorksComputer Science
DRAP: Dynamics-Risk Adaptive Plasticity for Continual Learning in Physical AI
Abstract
Continual learning in physical AI differs from conventional continual learning because small per-step policy errors can accumulate over a trajectory. Each deviation may move the agent outside the training distribution, increase subsequent prediction errors, and ultimately cause closed-loop task failure. This work introduces Dynamics-Risk Adaptive Plasticity (DRAP), a replay-free method that estimates the historical importance of adaptable model tensors from sample-level action gradients weighted by local trajectory-amplification risk. A ridge-regularized local linear model is fitted to expert state-action transitions, and the largest singular value of its state-transition matrix provides a policy-independent, Lyapunov-inspired estimate of one-step perturbation amplification. After each task, risk-weighted squared gradients are accumulated in a tensor-level importance memory. During subsequent tasks, DRAP uses normalized cumulative importance to scale the effective AdamW learning rate of each tensor, immediately reducing the plasticity of components that supported previous behavior at dynamically sensitive trajectory points. We instantiate DRAP on a fixed KappaTune-selected subnetwork of OpenVLA and evaluate replay-free sequential adaptation across the LIBERO Spatial, Object, and Goal suites. Compared with standard AdamW fine-tuning and EWC, the results show substantially improved retention of previously learned behaviors while preserving strong new-suite acquisition.
Introduction
Continual learning in physical AI differs from conventional continual learning because small changes in a policy can alter future observations and amplify into closed-loop task failure. In embodied control, an action error changes the next physical state, modifies the next observation, and may place the policy outside the training distribution. Subsequent errors can therefore compound over the remainder of the trajectory [1, 2].
Vision-language-action (VLA) models combine visual perception, language grounding, and low-level control within a single pretrained policy. OpenVLA provides an open 7B VLA with tokenized actions and a pretrained vision-language backbone [3]. OpenVLA-OFT later demonstrated that continuous actions, action chunking, and optimized decoding can substantially improve success and inference efficiency [4]. These advances strengthen task acquisition, but do not remove the continual-learning problem: sequential fine-tuning can overwrite behavior required by earlier manipulation skills.
Existing continual-learning strategies offer complementary trade-offs. Replay remains a strong baseline but requires storing or regenerating previous observations. Expansion and routing methods isolate tasks but add modules or routing mechanisms. Parameter-regularization methods preserve a previous solution but can restrict acquisition. Direct update-suppression methods reduce future plasticity according to past update history, but can become too restrictive for large heterogeneous models.
This work develops a replay-free mechanism based on a physical observation: parameters supporting correct behavior at dynamically sensitive trajectory regions should become less plastic in later tasks.
Unlike reference-based consolidation methods, the proposed Dynamics-Risk Adaptive Plasticity (DRAP) does not penalize parameter displacement from a previously stored checkpoint. Instead, similar to CLASSP [5], it uses accumulated historical importance to directly regulate future plasticity. Protection is therefore active from the first update of each subsequent learning stage and does not require storing reference copies of the adaptable parameters.
This work contributes a local policy-independent dynamics-risk estimator derived from expert state-action trajectories. The resulting risk scores weight the historical importance of adaptable tensors, which is then used to regulate their future plasticity through tensor-specific AdamW learning rates. This mechanism suppresses the actual optimizer step rather than merely scaling raw gradients.
The remainder of this paper is organized as follows. Section II reviews related work on continual learning for vision-language-action models and on importance-based plasticity control. Section III describes the sequential LIBERO evaluation protocol. Section IV motivates the dynamics-risk signal from the compounding-error perspective of imitation learning, and Section V formalizes the replay-free continual learning problem. Section VI presents the DRAP method, including the KappaTune-based subnetwork selection, the local dynamics-risk estimator, the risk-weighted tensor importance, and the tensor-specific learning-rate control. Section VII reports the experimental results, including ablations of KappaTune selection and of dynamics-risk weighting. Finally, Section VIII concludes and outlines directions for future work.
Related Work
Recent continual-learning methods for vision-language-action models primarily rely on architectural modularity, routing, replay, or parameter regularization. CLARE [6] autonomously expands and routes lightweight adapters, allowing new manipulation tasks to be learned without requiring task identifiers at deployment. Stellar VLA [7] instead models task and skill relationships in a learned knowledge space and uses knowledge-guided expert routing, with limited replay, to reduce interference between sequentially learned behaviors. These approaches obtain stability by separating or routing task-specific capacity, whereas DRAP retains a fixed model architecture and controls the plasticity of an existing trainable subnetwork.
Among replay-free regularization methods, EWC [8], Synaptic Intelligence [9], Memory Aware Synapses [10], and RWalk [11] estimate the historical importance of model parameters and restrict subsequent changes to important parameters. EWC and RWalk employ reference-based quadratic penalties, while Synaptic Intelligence accumulates optimization-path contributions and Memory Aware Synapses measures the sensitivity of the learned output function. Despite their different motivations, these importance estimators have been shown to be closely related to Fisher-information-based quantities [12]. DRAP differs by weighting sample-level action-gradient responsibility according to the estimated physical consequence of errors along the demonstrated trajectory.
DRAP is most closely related to continual-learning methods that regulate future parameter plasticity according to historical importance. CLASSP [5] suppresses future updates using accumulated gradient magnitudes and optionally applies a gradient threshold to promote sparse adaptation. Bayesian approaches such as uncertainty-guided continual learning [13], [14] similarly use parameter uncertainty to determine which model components should remain stable and which should retain greater plasticity. DRAP follows this general principle of importance-dependent plasticity, but replaces generic update history or posterior uncertainty with dynamics-risk-weighted, sample-level behavioral responsibility. The accumulated importance is defined at tensor level and directly scales tensor-specific AdamW learning rates. Thus, DRAP is inspired by CLASSP’s adjustment-suppression principle, but uses a different importance signal and optimizer interface.
Reference-based methods adopt a different protection mechanism. Elastic Weight Consolidation (EWC) [8] estimates parameter importance using a diagonal Fisher approximation and penalizes displacement from a previous optimum. In contrast, DRAP does not store reference parameters or apply a displacement penalty. Historical importance regulates plasticity immediately from the first update of each subsequent learning stage.
Liu et al. [15] investigate continual learning with large pretrained VLAs by sequentially training across the ten tasks of each LIBERO suite. Their main finding is that pretrained models such as and GR00T N1.5 can achieve little forgetting when combined with experience replay, and retain comparatively low forgetting even when the replay buffer contains only a small fraction of the previous-task data. However, their zero-replay Sequential and EWC baselines on LIBERO-Object and LIBERO-10 still exhibit substantial negative backward transfer, indicating that pretraining alone does not prevent forgetting when earlier demonstrations are unavailable.
Their protocol differs from ours in three respects. First, they train a separate continual model for each LIBERO suite and learn the ten tasks within that suite sequentially, whereas our protocol updates one checkpoint across complete suites in the order Spatial, Object, and Goal. Second, their strongest retention results store transitions from previous tasks, while DRAP is evaluated without storing any previous-suite demonstrations. Third, they use different VLA architectures with LoRA-based or partially frozen fine-tuning, whereas we adapt a KappaTune-selected subnetwork of OpenVLA. The two settings therefore address complementary questions: their results show that pretrained VLAs exploit small replay buffers particularly well, whereas DRAP targets retention under a strictly replay-free sequence of suite-level shifts. Since the replay-free setting is already difficult in both protocols, and our sequence additionally requires retention across suites that differ in layout, object identity, and goal semantics, we consider it a demanding test of forgetting.
KappaTune [16] uses the matrix condition number as a scale-invariant proxy for information encoding in neural tensors. Its central hypothesis is that tensors with larger condition numbers contain more strongly differentiated singular directions and are therefore more likely to encode specialized pretrained information. KappaTune preserves these tensors and concentrates adaptation on tensors with smaller condition numbers, which are treated as safer sources of plasticity.
Evaluation Protocol
LIBERO provides a benchmark for knowledge transfer and lifelong robot learning across Spatial, Object, Goal, and Long-Horizon suites [17]. LIBERO results depend strongly on the training protocol. OpenVLA-OFT reports a 97.1% average success rate using four independently fine-tuned policies, one for each of the Spatial, Object, Goal, and Long-Horizon suites [4]. It also reports 96.8% for a single policy jointly trained on data from all four suites. These settings evaluate suite-specific or joint multi-suite acquisition. This work instead evaluates sequential continual learning without replay. A single checkpoint is trained successively on Spatial, Object and Goal, with only the current suite available at each stage. After every stage, the checkpoint is evaluated on all suites observed so far. The resulting lower-triangular success matrix therefore measures both new-suite acquisition and backward retention under closed-loop control.
As shown by the standard sequential-training baseline, this protocol presents a challenging catastrophic-forgetting setting, with performance on earlier suites degrading substantially after adaptation to subsequent suites.
Compounding Errors and Dynamics-Risk Motivation
Behavior cloning is affected by covariate shift because policy-generated actions modify future states and observations [1, 2]. A small action error can move the robot away from the demonstrated trajectory, expose the policy to unfamiliar observations, and increase the probability of subsequent errors. In physical AI, these deviations can compound over a closed-loop rollout and cause task failure even when the per-step prediction error remains small. DRAP addresses this problem by assigning greater importance to demonstration samples at which the local physical dynamics are more likely to amplify a state perturbation. The risk estimator is inspired by Lyapunov’s indirect method, which studies nonlinear systems locally through linearization [18], and by contraction analysis, which examines the local convergence or divergence of neighboring trajectories [19]. DRAP uses this local differential perspective to rank demonstration samples according to their estimated one-step perturbation amplification.
The resulting dynamics-risk score is a relative sensitivity indicator, its purpose is to identify trajectory regions where preserving accurate policy behavior may be particularly important because small deviations can have larger downstream physical consequences.
Problem Formulation
Tasks arrive sequentially as . Each task dataset consists of expert transitions:
where is the visual-language observation, is a logged robot state, is the expert action, and identifies the episode. The VLA policy is with parameters .
A fixed set of trainable tensors, selected using KappaTune, is denoted by . For tensor , denotes cumulative importance after task . The objective is to learn task while regulating each tensor’s plasticity according to all previous task importance, without storing previous demonstrations.
Method
KappaTune selection
For each eligible matrix , KappaTune computes a regularized condition number
Within each architectural group (vision, language and action head), a fixed budget of low- tensors is selected from the pretrained checkpoint. Selection is computed once and reused throughout the task sequence. Parameters outside remain frozen. Therefore, KappaTune defines where adaptation may occur, while DRAP determines how much future plasticity each selected tensor retains.
Local linear dynamics identification
State and action dimensions are robustly standardized using suite-level statistics. For a sliding window contained within one episode, ridge regression estimates
where is the local state-transition matrix, is the local control matrix, is an intercept, and is the residual. The model is local and trajectory-conditioned; it is not a global linear model of manipulation dynamics. See Figure 1.

Figure 1. Dynamics-risk computation from expert demonstrations. Local linear dynamics are estimated over sliding windows of logged state-action transitions. The largest singular value defines a local one-step perturbation-amplification score, which is robustly normalized and stored as a sample-level risk weight aligned with the training dataset.
Lyapunov-inspired dynamics risk
For a small state perturbation under the locally fixed logged action,
define the quadratic perturbation energy:
Then the following upper-bound holds:
Accordingly, we define the raw one-step dynamics sensitivity:
Let denote the set of demonstration samples in suite . The corresponding training weight is obtained by normalizing with respect to the median raw dynamics sensitivity over and clipping the result:
where ensures numerical stability, and and denote the lower and upper clipping bounds, respectively1.
This dynamics-risk score does not constitute a formal proof or certificate of closed-loop stability. Even if the policy-feedback contribution were included, the resulting closed-loop Jacobian would remain a first-order local approximation of the nonlinear robot–policy system around the expert trajectory. To clarify this limitation, consider the local dynamics model in (3), where describes the sensitivity of the standardized next state to the standardized current state , describes the sensitivity of to the standardized action , and is an affine offset. Let denote the observation generated from the standardized state, and let denote the policy expressed in standardized action coordinates. The local sensitivity of the policy action to the state is
The corresponding first-order closed-loop Jacobian is:
The raw dynamics-risk score captures only the direct state-sensitivity term and does not include the policy-feedback term . However, even would describe perturbation evolution only locally, near the linearization point and within the fitted operating regime. It would not account for higher-order nonlinearities, contact-mode transitions, observation aliasing, local-model estimation error, or trajectories that leave the neighborhood of the expert demonstration. A formal stability analysis would require additional conditions, such as a valid Lyapunov function over a specified region and a corresponding decrease condition along the actual nonlinear closed-loop dynamics.
Accordingly, the normalized score is interpreted only as a relative, policy-independent indicator of potential one-step physical perturbation amplification along the expert trajectory.
Sample-Level Risk-Weighted Tensor Importance
After completing task , tensor importance is estimated from a deterministic subset of demonstration samples. A demonstration sample is a training example containing the policy observation , the corresponding expert action , and the aligned normalized dynamics-risk score . The state-action transition used to estimate is associated with the same time step.
The importance-estimation loader uses a batch size of one. Consequently, the gradient produced by each sample is squared before being combined with the contributions of other samples. This prevents gradients associated with different samples, episodes, task phases, or action directions from canceling one another before the importance is calculated.
In the evaluated VLA, the continuous expert action is represented by a short sequence of discrete action tokens. Let denote the set of output-sequence positions associated with the expert action for sample . An action-token position in the model output sequence represents one component of the discretized expert action. Positions corresponding to image patches, language instructions, prompt tokens, padding tokens, or other non-action content are excluded from .
The sample-level imitation loss is defined as
where is the cross-entropy loss between the target action token and the token distribution predicted at position , and denotes the model parameters.
Let be an adaptable parameter tensor, where denotes the set of tensors selected via KappaTune for continual training. Let denote the number of scalar parameters contained in . The gradient has the same shape as and measures the sensitivity of the sample-level action loss to changes in that tensor.
Since is precomputed from the demonstration trajectory and is independent of the model parameters,
where denotes the Frobenius norm. Accordingly, the raw new-task importance of tensor after task is
The quantity is the mean squared gradient over all scalar elements of tensor . Division by prevents larger tensors from receiving greater importance solely because they contain more parameters.
The estimator therefore contains three distinct reductions. First, the cross-entropy losses are averaged over the supervised action-token positions of each sample through (12). Second, the squared gradient is averaged over the scalar elements of tensor . Third, the resulting risk-weighted contributions are averaged over the demonstration samples. The estimator produces one scalar raw importance coefficient for each adaptable tensor.
To express the normalization applied to both the new-task and cumulative importance, we define the normalization of a nonnegative tensor-level quantity as:
where is a small constant that ensures numerical stability.
Accordingly, the new-task importance is normalized before being added to the cumulative memory:
This normalization removes the task-dependent global scale while preserving the relative importance distribution across tensors.
Algorithm 1 KappaTune + DRAP
Require: Pretrained policy , task stream
Select fixed trainable tensor set with KappaTune
Initialize for all
for do
Compute by (18) and by (19)
Create AdamW groups with
for each optimization step on do
Compute imitation loss and accumulated gradient
Apply AdamW update using tensor-specific
end for
Compute by (14) and by (16)
Merge cumulative importance by (17)
Save checkpoint, fixed tensor set
Save cumulative importance
end for
The normalized new-task contribution is then merged into the cumulative importance memory:
where contains the importance accumulated from previous tasks and controls the retention of this historical importance. The default setting preserves contributions from all earlier tasks.
Before training task , the cumulative importance is normalized using the operator (15):
DRAP converts this normalized cumulative importance into the tensor-specific plasticity multiplier
where controls the suppression strength and controls its curvature. The effective AdamW learning rate assigned to tensor during task is
where is the base learning rate.
Thus, directly regulates the future plasticity of tensor : tensors with larger historical importance receive smaller AdamW steps from the beginning of the next training stage, whereas tensors with lower importance remain comparatively plastic. Algorithm 1 summarizes the method, and Figure 2 illustrates its overall workflow.

Figure 2. Overview of DRAP. Expert trajectories provide a local dynamics-risk signal. Sample-level action gradients identify tensor responsibility at risky samples. Cumulative importance directly scales future AdamW learning rates; no previous tensor reference or displacement penalty is required.
Experimental Results
We evaluate five sequential-training configurations on the task order Spatial Object Goal: standard sequential fine-tuning, KappaTune+EWC, KappaTune+DRAP, KappaTune+DRAP with uniform risk, and DRAP without KappaTune. The uniform-risk ablation sets for every sample while retaining sample-level gradient importance, cumulative importance memory, and tensor-specific AdamW learning rates2.
| Dimension | CLASSP | EWC | Proposed DRAP |
| Historical signal | Powered gradient/update accumulation | Diagonal Fisher information estimated from previous-task gradients | Dynamics-risk-weighted sample-level gradients |
| Physical grounding | None | None | Local trajectory-amplification risk |
| Protection mechanism | Update denominator and gradient threshold | Fisher-weighted quadratic displacement penalty | Tensor-specific AdamW learning rate |
| Reference weights | Not required | Required, | Not required |
| Onset of protection | Immediate | Zero at the new-task initial point; increases with displacement from | Immediate |
| Optimizer | Custom CLASSP optimizer | AdamW plus EWC regularization loss | AdamW with per-tensor learning-rate groups |
| Threshold | Core sparsity mechanism | None | None |
| Importance granularity | Usually parameter-level accumulated adjustment | Parameter-level diagonal Fisher | Tensor-level cumulative importance from sample-level gradients |
| Primary risk | Excessive suppression can block new-task acquisition | Inaccurate Fisher estimates or excessive regularization can restrict plasticity | Important tensors can still accumulate drift through repeated reduced updates |
| Replay | Not required | Not required after Fisher estimation | Not required after importance estimation |
| Stored continual-learning state | Accumulated adjustment statistics | Diagonal Fisher and reference parameters | Cumulative tensor importance only |
Table 1. Comparison of CLASSP, EWC, and the proposed DRAP.
Each checkpoint is evaluated after every training stage on all suites observed up to that point. To reduce finite-rollout variability, this experiment pools 6 Gym evaluation runs, each comprising 50 episodes. These repeated evaluations quantify rollout variability for fixed checkpoints.
Evaluation Metrics
Let denote the pooled success rate on suite after training stage . The average success over all suites observed by stage is
For a previous suite , forgetting is measured relative to its best earlier performance:
A positive value indicates forgetting.
Average forgetting after stage is
Sequential Success and Forgetting Rates
Table II reports the pooled lower-triangular success matrix for each method. Each row corresponds to a training stage, and each column reports closed-loop success on an observed LIBERO suite.
| Method | Checkpoint | Spatial | Object | Goal |
| Standard fine-tuning | After Spatial | 0.77 | – | – |
| After Object | 0.11 | 0.83 | – | |
| After Goal | 0.00 | 0.07 | 0.71 | |
| KappaTune+EWC | After Spatial | 0.76 | – | – |
| After Object | 0.41 | 0.82 | – | |
| After Goal | 0.03 | 0.30 | 0.64 | |
| KappaTune+DRAP | After Spatial | 0.77 | – | – |
| After Object | 0.75 | 0.80 | – | |
| After Goal | 0.34 | 0.61 | 0.71 | |
| KappaTune+Uniform-risk DRAP | After Spatial | 0.78 | – | – |
| After Object | 0.64 | 0.80 | – | |
| After Goal | 0.29 | 0.57 | 0.66 | |
| DRAP without KappaTune | After Spatial | 0.78 | – | – |
| After Object | 0.71 | 0.82 | – | |
| After Goal | 0.11 | 0.08 | 0.66 |
Table II. Sequential Libero success rates across repeated Gym evaluations.
Table III summarizes average success and forgetting after Object and Goal training.
| Method | After Object: Avg. success | After Object: Spatial forget. | After Goal: Avg. success | After Goal: Spatial forget. | After Goal: Object forget. | After Goal: Avg. forget. |
| Standard fine-tuning | 0.47 | 0.66 | 0.26 | 0.77 | 0.76 | 0.77 |
| KappaTune+EWC | 0.62 | 0.35 | 0.32 | 0.73 | 0.52 | 0.63 |
| KappaTune+DRAP | 0.77 | 0.02 | 0.55 | 0.43 | 0.19 | 0.31 |
| KappaTune+Uniform-risk DRAP | 0.72 | 0.14 | 0.51 | 0.49 | 0.23 | 0.36 |
| DRAP without KappaTune | 0.77 | 0.07 | 0.28 | 0.67 | 0.74 | 0.71 |
Table III. Average success and forgetting derived from the pooled sequential evaluation matrices. Forgetting is measured relative to the best earlier checkpoint for each previously learned suite.
Standard sequential fine-tuning exhibits strongly recency-dominated behavior. Each newly introduced suite is acquired successfully, while performance on earlier suites rapidly approaches zero.
KappaTune+EWC provides partial protection during the first task transition, but its retention deteriorates substantially after Goal adaptation. EWC preserves more of the immediately preceding Object suite than standard fine-tuning, but offers little protection for the earliest Spatial suite. This result indicates that Fisher-weighted anchoring improves short-term retention but remains insufficient over the complete evaluated sequence.
KappaTune+DRAP achieves the strongest overall stability-plasticity balance. The resulting success matrix yields both the highest average success and the lowest average forgetting after Object and Goal training.
Ablation of KappaTune Selection
DRAP without KappaTune initially exhibits strong plasticity and performs competitively through the Object stage. However, after Goal adaptation, performance on both previous suites approaches the standard fine-tuning baseline. The broader adaptable parameter space permits effective short-term acquisition but exposes more pathways for destructive interference. The experiment indicates that KappaTune and DRAP
provide complementary forms of protection. KappaTune restricts adaptation to a structurally selected subnetwork, while DRAP allocates plasticity within that subnetwork according to accumulated historical responsibility.
Ablation of Dynamics-Risk Weighting
The uniform-risk ablation sets for every sample while preserving all other elements of DRAP, including sample-level squared-gradient importance, cumulative importance memory, tensor-wise normalization, and tensor-specific AdamW learning rates. It therefore isolates the contribution of the demonstration-derived physical-risk signal from the broader adaptive-plasticity mechanism.
Uniform-risk DRAP retains much of the improvement over standard fine-tuning and EWC, showing that historical tensor importance and tensor-specific learning rates account for a substantial part of DRAP’s performance. Nevertheless, dynamics-risk DRAP provides better retention of both Spatial and Object. New-suite acquisition remains comparable, indicating that the additional retention does not result from simply preventing the model from learning the current suite.
These initial results suggest that physics-informed plasticity control is a promising direction and motivate extending the dynamics-risk estimator beyond the state-transition term to include control-path sensitivity, multi-step perturbation gains, and contact-aware or learned local dynamics, potentially yielding a stronger stability-plasticity balance.
Conclusion
This work takes a first step toward physics-informed plasticity control by introducing DRAP, a replay-free method for continual learning in physical AI. DRAP estimates tensor importance from sample-level action gradients weighted by local trajectory-amplification risk and uses the accumulated importance to regulate tensor-specific AdamW learning rates during subsequent adaptation. Intuitively, DRAP suppresses future updates to tensors that were important for predicting expert actions at samples where errors are more strongly amplified by the physical dynamics.
Sequential LIBERO experiments showed that standard fine-tuning suffers severe catastrophic forgetting, while the physically ungrounded method, EWC, provides only partial retention. DRAP achieved the strongest stability-plasticity balance when combined with KappaTune. KappaTune restricts adaptation to a structurally selected subnetwork, while DRAP distributes plasticity within that subnetwork according to historical, dynamics-risk-weighted responsibility. The ablation without KappaTune confirmed that broader plasticity improves initial acquisition but increases later interference.
Sequential LIBERO experiments showed that standard fine-tuning suffers severe catastrophic forgetting, while EWC provides only partial retention. KappaTune+DRAP achieved the strongest stability-plasticity balance. KappaTune restricts adaptation to a selected subnetwork, while DRAP regulates plasticity within that subnetwork according to accumulated historical importance. The ablation without KappaTune showed that a broader adaptable parameter space supports strong initial acquisition but substantially increases later interference. The uniform-risk ablation showed that importance-dependent plasticity accounts for most of DRAP’s benefit, while dynamics-risk weighting provides an additional improvement in retention without impairing new-suite acquisition.
These results support the hypothesis that continual learning in physical AI should consider both model sensitivity and the physical consequences of behavioral errors. Future work will improve the dynamics-risk estimator by incorporating the control pathway, online estimation, multi-step perturbation propagation, and contact-aware dynamics. It will also investigate the CLASSP-inspired update threshold and evaluate DRAP over longer continual-learning sequences.
References
- [1]S. Ross and D. Bagnell, “Efficient reductions for imitation learning,” in Proceedings of the Thirteenth International Conference on Artificial Intelligence and Statistics, 2010.
- [2]S. Ross, G. J. Gordon, and D. Bagnell, “A reduction of imitation learning and structured prediction to no-regret online learning,” in Proceedings of the Fourteenth International Conference on Artificial Intelligence and Statistics, 2011.arxiv.org/abs/1011.0686
- [3]M. J. Kim et al., “OpenVLA: An open-source vision-language-action model,” arXiv preprint arXiv:2406.09246, 2024.arxiv.org/abs/2406.09246
- [4]M. J. Kim, C. Finn, and P. Liang, “Fine-tuning vision-language-action models: Optimizing speed and success,” in Robotics: Science and Systems, 2025.
- [5]O. Ludwig, “CLASSP: A biologically-inspired approach to continual learning through adjustment suppression and sparsity promotion,” arXiv preprint arXiv:2405.09637, 2024.arxiv.org/abs/2405.09637
- [6]R. Römer, Y. Zhang, Y. Li, and A. P. Schoellig, “CLARE: Continual learning for vision-language-action models via autonomous adapter routing and expansion,” IEEE Robotics and Automation Letters, 2026.DOI
- [7]Y. Wu, G. Wang, Z. Yang, T. Deng, M. Yao, B. Sheil, and H. Wang, “Continually evolving skill knowledge in vision language action model,” arXiv preprint arXiv:2511.18085, 2025.arxiv.org/abs/2511.18085
- [8]J. Kirkpatrick et al., “Overcoming catastrophic forgetting in neural networks,” Proceedings of the National Academy of Sciences, vol. 114, no. 13, pp. 3521–3526, 2017.DOI
- [9]F. Zenke, B. Poole, and S. Ganguli, “Continual learning through synaptic intelligence,” in Proceedings of the 34th International Conference on Machine Learning, ser. Proceedings of Machine Learning Research, vol. 70, 2017, pp. 3987–3995.arxiv.org/abs/1703.04200
- [10]R. Aljundi, F. Babiloni, M. Elhoseiny, M. Rohrbach, and T. Tuytelaars, “Memory aware synapses: Learning what (not) to forget,” in Proceedings of the European Conference on Computer Vision, 2018, pp. 139–154.arxiv.org/abs/1711.09601
- [11]A. Chaudhry, P. K. Dokania, T. Ajanthan, and P. H. S. Torr, “Riemannian walk for incremental learning: Understanding forgetting and intransigence,” in Proceedings of the European Conference on Computer Vision, 2018, pp. 532–547.DOI
- [12]F. Benzing, “Unifying importance based regularisation methods for continual learning,” in Proceedings of the 25th International Conference on Artificial Intelligence and Statistics, ser. Proceedings of Machine Learning Research, vol. 151, 2022, pp. 2372–2396.DOI
- [13]S. Ebrahimi, M. Elhoseiny, T. Darrell, and M. Rohrbach, “Uncertainty-guided continual learning with bayesian neural networks,” in International Conference on Learning Representations, 2020.arxiv.org/abs/1906.02425
- [14]H. Ahn, S. Cha, D. Lee, and T. Moon, “Uncertainty-based continual learning with adaptive regularization,” in Advances in Neural Information Processing Systems, vol. 32, 2019.arxiv.org/abs/1905.11614
- [15]H. Liu, C. Kim, B. Liu, M. Liu, and Y. Zhu, “Pretrained vision-language-action models are surprisingly resistant to forgetting in continual learning,” arXiv preprint arXiv:2603.03818, 2026.arxiv.org/abs/2603.03818
- [16]O. Ludwig, “The condition number as a scale-invariant proxy for information encoding in neural units,” arXiv preprint arXiv:2506.16289, 2025.arxiv.org/abs/2506.16289
- [17]B. Liu et al., “LIBERO: Benchmarking knowledge transfer for lifelong robot learning,” in Advances in Neural Information Processing Systems, 2023.arxiv.org/abs/2306.03310
- [18]H. K. Khalil, Nonlinear Systems, 3rd ed. Upper Saddle River, NJ, USA: Prentice Hall, 2002.
- [19]W. Lohmiller and J.-J. E. Slotine, “On contraction analysis for non-linear systems,” Automatica, vol. 34, no. 6, pp. 683–696, 1998.DOI