WorksComputer Science
SLiDE: Structured Linear Dynamics for Forecasting with Exogenous Inputs
Abstract
Accurate time series forecasting with exogenous inputs is critical across domains, including energy and retail, yet modern deep learning models often overfit to correlations that do not generalize under shifts in these inputs. We propose SLiDE, a Koopman-inspired architecture for forecasting with exogenous inputs that imposes structure on latent temporal dynamics. SLiDE approximates nonlinear system evolution using a learned linear operator in a latent space, combining (i) a history encoder that reconstructs the current latent state from past targets and inputs with (ii) a shared linear rollout driven by future exogenous variables. By enforcing a common linear recurrence across encoding and prediction, SLiDE aligns how past information is encoded with how future states evolve, reducing parameterization and preventing reliance on spurious correlations in the input history. Empirically, SLiDE achieves state-of-the-art accuracy on real-world benchmarks, including electricity price forecasting and retail demand, while maintaining a computational footprint comparable to lightweight MLP architectures. SLiDE is especially effective at generalizing to shifted exogenous inputs, reducing MSE by 20% on electricity price samples with out-of-range exogenous values and MAE by 30% in a synthetic transfer setting where the same dynamical system is driven by an unseen exogenous process. Ablations confirm the importance of both the structured history encoder and the linear latent rollout, suggesting that structured latent linear dynamics provide a useful inductive bias for forecasting with exogenous inputs.
Introduction
Time series forecasting supports decision-making across energy [14], economics [42], healthcare [12], transportation [45], and retail. In many settings, accurate forecasts depend on exogenous inputs [3]: electricity prices depend on load and renewable generation forecasts [49, 44], while retail demand depends on promotions, holidays, and product- or store-level context [9]. These inputs are often forecasted, noisy, or generated by changing external processes, making robustness to shifted exogenous inputs important for deployment. Modern deep forecasting models incorporate exogenous information through cross-attention [47], graph encoding [26], or MLP feature stacking [7]. While effective, they typically rely on flexible
Preprint. feature fusion rather than structured input-driven temporal evolution. This can let models exploit input-history correlations that do not reflect the underlying input-response behavior. Attention and graph modules add computational overhead, while lightweight MLPs may lack temporal structure.
Koopman-inspired modeling provides a useful architectural bias. For autonomous nonlinear systems, Koopman theory represents nonlinear evolution as linear dynamics over observables, i.e., scalar-valued functions of the state. Learning nonlinear lifting with linear latent transport may be easier to learn than a nonlinear latent transition directly. Recent applications such as Zhang et al. [2025] suggest that this provides a suitable bias for the forecasting setting.
Motivated by this, we propose SLiDE (Structured Linear Dynamics with Exogenous inputs), a lightweight Koopman-inspired architecture for multi-step forecasting with exogenous inputs. Rather than implementing an exact finite-dimensional Koopman model, SLiDE uses learned latent linear evolution as a practical forecasting bias. It reconstructs a forecast-start latent state from past targets and inputs, then rolls it forward with future-known exogenous variables through two constraints: a lag-invariant recurrent encoder and a shared linear rollout with additive exogenous forcing.
SLiDE achieves strong forecasting performance while remaining computationally efficient. Across electricity price and retail demand benchmarks, it attains the best average rank with cost comparable to lightweight MLP architectures. Its advantage is clearest under shifted exogenous inputs, including out-of-range (OOR) values and unseen test-time input processes. Figure 1a shows shifted-input examples from EPF-DE and Favorita. In EPF-DE, the future wind forecast falls outside the training range, and SLiDE tracks the ground-truth price while the baseline deviates. In Favorita, the number of promoted items is OOR, and SLiDE better tracks sales. Figure 1b shows that SLiDE reduces Mean Squared Error (MSE) by 20% on OOR EPF-DE samples and Mean Absolute Error (MAE) by 30% in Bouc-Wen transfer, where the same nonlinear system is driven by an unseen forcing process at test time. SLiDE achieves an 18% lower Root Mean Squared Logarithmic Error (RMSLE) than ablations without the structured encoder or linear latent rollout on OOR Favorita samples.
Figure 1. SLiDE generalizes well to shifted exogenous inputs, including out-of-range (OOR) input values and unseen test-time input processes. Left: top, an EPF-DE sample in which the wind forecast exceeds the maximum training value, and bottom, a Favorita sample in which the number of related promoted items (log-scale) exceeds the training range. In both cases, SLiDE stays closer to the ground truth than the baselines. Right: SLiDE reduces MSE by 20% on OOR EPF-DE samples and MAE by 30% on the Bouc-Wen transfer task, where models are tested on an unseen forcing process. Ablations show that the structured encoder and linear rollout are critical for shifted-input performance, as shown by an 18% lower RMSLE relative to ablations on OOR Favorita samples.
Our contributions are as follows: We introduce SLiDE, a lightweight architecture for multi-step forecasting with exogenous inputs that replaces unconstrained feature fusion with a Koopman-inspired latent recurrence. Its key constraints are a lag-invariant recurrent encoder for forecast-start state reconstruction and a shared linear rollout with additive exogenous forcing. Empirically, SLiDE achieves state-of-the-art performance across electricity price, retail demand, and nonlinear dynamical-system benchmarks, with the largest gains under shifted exogenous inputs. The code is publicly available.3
Related work
Deep learning has become a dominant paradigm for time series forecasting, and due to its practical importance, incorporating exogenous variables is an active area of research. Approaches to forecasting with exogenous variables include attention-based architectures such as TFT and TimeXer [27, 47], lightweight feedforward models such as TiDE, TSMixer, and N-BEATSx [7, 5, 33, 34], and graph-based models such as GCGNet [26]. In contrast to attention-, graph-, and MLP-based approaches that primarily rely on flexible feature fusion, SLiDE imposes a constrained input-driven latent dynamics model, which we show improves accuracy and efficiency while promoting generalization under shifted input processes.
A related line of work studies structured latent models with inputs from the perspective of nonlinear system identification and control, including Koopman-Subnet [16], CT-Subnet [2], and MamKO [25], the latter combining Koopman-style latent operators with Mamba-based sequence modeling [10]. These models are related in spirit to our work in that they impose structure on latent dynamics, but they are primarily motivated by modeling, identification, or control rather than exogenous multi-step forecasting. SLiDE deviates from exact Koopman theory where necessary, incorporating deliberate design choices that make the technique specifically suitable for forecasting with known future exogenous inputs.
More broadly, SLiDE is related to Koopman-with-input works [37, 22], Koopman-inspired forecasting models that do not incorporate exogenous variables [28] (Zhang et al. 2025), and structured state space models such as S4 and Mamba [11, 10]. Additional discussion of related work is provided in Appendix § 17.
Problem setting
We consider a discrete-time target series of real-valued observations . At forecast origin , we observe the past target trajectory , where denotes the index set , and the past exogenous trajectory for an input that affects the target but is not affected by it. We also assume access to the values available at time for the next forecast steps, denoted by . The double index indicates forecast origin and lead time . These future exogenous values may themselves be forecasts and need not coincide with the values that are later observed. For example, the value available at origin for lead time two, , may differ from both the realized value and from a later updated forecast .
The forecasting task is to generate a point estimate from the conditional distribution of the target random variable :
where are the model parameters. Our desired point forecast of the target is denoted by . Given training samples of the form , our goal is to learn the model parameters by minimizing a task-dependent risk . The exact risks are given in Appendix § 14.§ 1.
Background: Koopman theory
We model the observed time-series as a nonlinear system with state variable at time index , and a nonlinear transition map :
We assume that the model state is (in general) not fully observable. Instead, we observe an output obtained from a nonlinear output map .
The Koopman operator framework [21, 4] provides a means of representing nonlinear dynamical systems as evolving linearly in an infinite-dimensional lifted state. Let be a scalar measurement function that is an element of an infinite-dimensional Hilbert space . For the corresponding zero-input autonomous system, define . The linear infinite-dimensional Koopman operator acts on the measurement functions and satisfies
or equivalently . In practice, we approximate by a finite dimensional subspace with and associated approximate operator .
When there are inputs , it becomes more complicated to preserve the linearity inherent to the Koopman framework. Following Iacob et al. [ [17], we introduce the concept of a lifted state where . We assume that , implying that there exists a matrix such that
We also assume that our output map can be exactly represented by a linear combination of the observables , so:
While this can be achieved by including the output functions among the observables, requiring their span to also be Koopman-invariant is generally restrictive in finite dimensions. Under these assumptions, Iacob et al. [2025] show that there exists an exact finite-dimensional Koopman form
where and is, in general, a nonlinear state- and input-dependent map. SLiDE uses the input-dependent Koopman form as architectural motivation and adopts a practical forecasting-oriented parameterization of the input effect.
Methodology
In SLiDE, a structured encoder maps past targets and exogenous inputs to a forecast-start latent state, which a shared linear operator rolls forward using additive forcing from future-known inputs (see Figure 2). A nonlinear output map maps the latent trajectory back to the target space, and multiple block forecasts are summed. We now proceed with the design principles, first motivating them based on Koopman theory, and then introducing the important adjustments for forecasting success.
Figure 2. SLiDE Architecture: (1) MLPs project past targets and exogenous inputs to a series of hidden states inside the encoder . (2) The encoder is parametrized by a matrix , which is applied recurrently to impose linear latent dynamics. The encoder estimates the present lifted state . (3) The prediction module uses and future exogenous inputs to forecast the next targets. It shares the same matrix and exogenous input projection map, with an additional MLP to project back to the target dimension. independently parametrized SLiDE blocks are jointly trained to learn complementary dynamics. The final output is taken as the sum of block forecasts.
Koopman-inspired forecasting formulation
Following Iacob et al. [2025] we can write our model as
Here the matrix-valued input function may be chosen simpler than in the exact formulation to trade off accuracy with model simplicity e.g. by choosing a linear, bilinear or input affine model structure [Iacob et al., 2025]. Allowing an unrestricted lifted state dependence in could introduce nonlinear dynamics in the lifted state via the input term. In our case we restrict the input function to be independent of the lifted state (Appendix § 10.§ 1 provides further context on the implications of our choice). We use this model as a motivation and treat it as a structural prior for forecasting rather than aiming at finding an exact Koopman realization.
One challenge of implementing this model is determining the initial condition of the lifted state . Iacob et al. [2025] introduce a reconstructability concept and discuss its relationship with local observability. The observability map can be used to compute the lifted state at the start of a window from consecutive output values and the corresponding inputs. Relying on this, a reconstructability map can be derived to determine the initial condition from past (lagged) outputs and the inputs that follow the first observation, given sufficiently large . We provide the derivation in the context of our method in Appendix § 9.
In order to estimate this model in practice, we parameterize , , . We collect these parameters in . Since an analytical solution for is impractical, we introduce a learned approximation with parameters , which additionally receives for alignment (Appendix § 9). All parameters are learned jointly with the goal of minimizing a general risk function .
In practice, the future values available at forecast origin allow us to estimate future lifted states using the same indexing. Our estimation approach for multi-step forecasting is then:
Defining a structure on the reconstructability map
Beyond establishing its theoretical existence, prior work gives little guidance on the practical form of and typically treats it as a generic black-box encoder, implemented as a dense MLP learned directly from data [Iacob et al., 2025]. For forecasting, this approach has a number of practical challenges: a dense MLP ignores the sequential structure of the past trajectory, its parameterization grows with the available context length, and its computational cost can dominate the relatively lightweight latent rollout. We therefore impose additional structure on the learned encoder , introducing a forecasting-oriented inductive bias for reconstructing the forecast-start latent state:
Lag-invariant parameterization. We constrain to have the same parameterization for any positive . The parameter search space is fixed as a design choice and does not grow with the number of lagged values . This prevents the model search space from exploding and reduces model memory cost. Furthermore, it allows for a single to be learned from training samples with varying amounts of past data available.
Encoder Koopman update. The exact reconstructability map is recursively related to the latent dynamics: reconstructing from history can be viewed, informally, as reconstructing an earlier latent state and propagating it forward. Motivated by this structure, we impose a recurrent latent update inside the encoder. In particular, we define
for some linear matrix and MLPs and . This recurrence requires the encoder to learn not just a final estimate , but a trajectory of estimates that is updated with the same linear structure as the underlying Koopman system. In this context, is modeled as an additive input term alongside , helping to provide the information required to guide the trajectory of towards a final estimate .
Parameter sharing. In order to limit the parameterization of our model and align the dynamics inside the encoder with those used in the forecast horizon, we impose complete parameter sharing by setting and . This imposes a strong heuristic for the encoder to follow the dynamics of the Koopman model. However, the inclusion of the term allows for some differences, so that the known lagged values can influence the reconstruction of .
Model definition
Pre-processing: Patching. For long input histories or forecast horizons, we may optionally apply non-overlapping patching to the target and input sequences, reducing the effective sequence length while increasing the per-step target and input dimensions. The exact transformation is given in Appendix § 10. After patching, we reuse the notation and for the transformed target and input sequences.
Implementation of the Koopman operator. We implement the Koopman operator approximation as a matrix , with parameter sharing as imposed in § 5.2. For the input maps and , we approximate the terms
The MLPs have much more representational ability than a fixed matrix but are less general than , since the MLP output does not vary with . In time series forecasting tasks, the external input provided to the model may be noisy or uncertain. This choice provides a practical compromise. By alleviating restrictions on the input term, we can better match the complexity of real-world data. The resulting forecast rollout then becomes
Definition of the output map. Although the idealized formulation uses , we implement the output map as the nonlinear function . This added expressivity helps compensate for approximation error in the Koopman-inspired model.
Definition of Encoder . We encode the initial current lifted state from the lagged values of the past trajectory. Using the previously defined and , we define the encoder using a linear recurrent neural network with a hidden state , where
The equality only holds at time . We can write the closed-form equation for computing as repeated applications of the matrix on the encoded and lags:
Block structure. We impose a block structure on the entire forecasting model by decomposing the lifted state into non-interacting subspaces. Each SLiDE block is intended to capture different dynamics of the target system. We consider our full lifted state to be separable into sub-states where and . Each subspace is initialized by a separate encoder . We enforce a block-diagonal structure: , which allows to evolve independently through time. A separate output MLP is used to obtain , with the block forecasts summed to obtain the final output: .
Experimental results
In this section, we evaluate SLiDE along three axes: (1) Forecasting performance on real-world and synthetic benchmarks; (2) Generalization under shifted exogenous inputs, including out-of-range real-world samples and the Bouc–Wen transfer setting; and (3) Efficiency, assessing the tradeoff between predictive performance and computational cost.
Benchmarks. We evaluate SLiDE on real-world datasets with heterogeneous covariates, including future-known, past-only, and static variables. In SLiDE, future-known covariates are treated as exogenous inputs , past-only covariates are modeled jointly with the target history, and static covariates are embedded and concatenated repeatedly to the input signal .
The Electricity Price Forecasting (EPF) benchmark [23] consists of five datasets from different electricity markets and is a standard benchmark for forecasting with future-known covariates [26, 47, 33]. The Favorita sales dataset [6] targets large-scale retail demand forecasting with promotions and holidays known in advance. We additionally consider the synthetic Bouc–Wen hysteretic system [39, 31], a nonlinear dynamical model with exogenous forcing. We use it both as a controlled forecasting task and as a test of generalization under shifted input processes. In the Multisine setting, models are trained and evaluated on a random-phase multisine forcing trajectory. In the Transfer setting, models are trained on a sine-sweep forcing process and evaluated on a multisine forcing process at test time. Appendix F.1 provides additional dataset details.
Metrics. Performance is measured by Mean Absolute Error (MAE) and Mean Squared Error (MSE) for the EPF benchmark and the Bouc–Wen system. For the Favorita sales dataset, we report the Root Mean Squared Logarithmic Error (RMSLE). To assess statistical significance, we perform pairwise one-sided tests on forecast-error differences between models. We use the Diebold–Mariano test for all datasets except Favorita, for which we use a Wilcoxon test on per-series error differences. Appendix H provides additional details and bootstrapped confidence intervals. To compare computational cost, we report the mean inference time and the trainable parameter count for each model.
Baselines. We compare SLiDE against two baseline groups: competitive forecasting architectures that support exogenous information, and related Koopman- or system-identification-inspired models. The forecasting baselines are TSMixer [5], TiDE [7], TimeXer [47], CGNet [26], and DLinear [Zeng et al., 2023] as a simple linear baseline. We also include SKOLR [Zhang et al., 2025], a related Koopman-inspired model that cannot use future-known covariates to show the performance lift from auxiliary covariates. To position SLiDE relative to structured latent-dynamics approaches, we compare against Koopman-Subnet [16], CT-Subnet [2], and ManMKO [25], which are conceptually relevant Koopman-with-input or system-identification baselines, though not originally proposed for the exogenous forecasting setup studied here. Appendix F.2 provides additional context.
Training Methodology. To ensure a fair comparison, we select the hyperparameters for all baselines using the same random-search protocol with a fixed budget and patience. For each model, we select the hyperparameter configuration that achieves the lowest validation loss. Each model is then trained five times with different random seeds and the results are averaged. Additional details on the search spaces and training settings are provided in Appendix F.2.
Key results
Accuracy. SLiDE is a consistent top performer on the real-world datasets, ranking among the top two in eight out of eleven instances. On the synthetic Bouc-Wen benchmark, it achieves the strongest overall performance across forecasting architectures in the multisine task and the strongest performance overall in the transfer setting. While the related system identification and control baselines achieve top performance on the Bouc-Wen multisine task, they are not competitive with the forecasting architectures in general, achieving at best an average rank of 5.80. We report the benchmark results in Table 1. Overall, SLiDE significantly outperforms each baseline multiple times while being significantly outperformed at most twice (see Figure 3a).
| Model | NP MAE | NP MSE | PJM MAE | PJM MSE | EPEX BE MAE | EPEX BE MSE | EPEX FR MAE | EPEX FR MSE | EPEX DE MAE | EPEX DE MSE | Sales RMSLE | Multisine MAE | Multisine MSE | Transfer MAE | Transfer MSE | Avg. Rank |
| SLiDE | 0.210 | 0.167 | 0.157 | 0.064 | 0.231 | 0.367 | 0.169 | 0.329 | 0.265 | 0.182 | 0.419 | 0.085 | 0.012 | 0.296 | 0.139 | 1.87 |
| Forecasting Architectures: | ||||||||||||||||
| TimeXer | 0.220 | 0.186 | 0.154 | 0.060 | 0.230 | 0.367 | 0.169 | 0.347 | 0.278 | 0.213 | 0.461 | 0.160 | 0.040 | 0.419 | 0.273 | 3.27 |
| TSMixer | 0.219 | 0.184 | 0.158 | 0.063 | 0.235 | 0.335 | 0.189 | 0.331 | 0.283 | 0.218 | 0.422 | 0.092 | 0.013 | 0.541 | 0.480 | 3.27 |
| GCGNet | 0.220 | 0.177 | 0.157 | 0.065 | 0.252 | 0.367 | 0.189 | 0.320 | 0.285 | 0.206 | 0.482 | 0.220 | 0.086 | 0.448 | 0.322 | 3.87 |
| TiDE | 0.243 | 0.200 | 0.165 | 0.081 | 0.256 | 0.362 | 0.200 | 0.353 | 0.295 | 0.220 | 0.424 | 0.143 | 0.031 | 0.485 | 0.385 | 5.27 |
| DLinear | 0.249 | 0.211 | 0.166 | 0.074 | 0.258 | 0.371 | 0.198 | 0.363 | 0.307 | 0.248 | 0.483 | 0.793 | 0.966 | 1.354 | 2.919 | 7.93 |
| SKOLR | 0.264 | 0.237 | 0.185 | 0.097 | 0.256 | 0.405 | 0.201 | 0.372 | 0.410 | 0.432 | 0.478 | 0.754 | 0.862 | 0.782 | 0.929 | 9.00 |
| Related System Identification or Control Baselines: | ||||||||||||||||
| Koop.-Subnet | 0.251 | 0.214 | 0.181 | 0.089 | 0.250 | 0.360 | 0.196 | 0.345 | 0.312 | 0.257 | 0.438 | 0.064 | 0.007 | 0.721 | 0.815 | 5.80 |
| CT-Subnet | 0.237 | 0.185 | 0.175 | 0.082 | 0.260 | 0.391 | 0.208 | 0.375 | 0.318 | 0.247 | 0.428 | 0.070 | 0.010 | 0.767 | 0.885 | 6.67 |
| MamKO | 0.245 | 0.213 | 0.172 | 0.079 | 0.256 | 0.374 | 0.192 | 0.324 | 0.325 | 0.276 | 0.489 | 0.464 | 0.340 | 0.944 | 1.722 | 7.40 |
| Ablations: | ||||||||||||||||
| Base (SLiDE) | 0.210 | 0.167 | 0.157 | 0.064 | 0.231 | 0.367 | 0.169 | 0.329 | 0.265 | 0.182 | 0.419 | 0.085 | 0.012 | 0.296 | 0.139 | 1.87 |
| Nonlinearity | 0.214 | 0.170 | 0.158 | 0.067 | 0.236 | 0.371 | 0.169 | 0.329 | 0.269 | 0.186 | 0.428 | 0.035 | 0.002 | 0.741 | 0.877 | 2.73 |
| MLP encoder | 0.223 | 0.172 | 0.160 | 0.065 | 0.239 | 0.352 | 0.183 | 0.332 | 0.281 | 0.203 | 0.423 | 0.091 | 0.014 | 0.360 | 0.207 | 2.47 |
Table 1. Performance on real-world and synthetic benchmarks, including the main ablations. The reported metrics are averaged across five random seeds. We highlight the first, second and third results for each metric across baseline comparisons and the first across ablations. The rightmost column reports the average rank across metrics for the baselines and a hypothetical ranking for ablations. SLiDE achieves the best average rank overall, and the ablations show that replacing the structured encoder or the linear latent rollout degrades performance.
Figure 3. (a) Pairwise statistical test results across benchmark–metric combinations. Each cell reports how often the model on the row significantly outperforms the model on the column. (b) Mean inference time versus average performance rank; marker size is proportional to the number of trainable parameters. SLiDE achieves a notably higher ranking without compromising on computational cost.
Shifted Exogenous Inputs. SLiDE performs particularly well under shifts in the exogenous inputs. On the real-world side, we study out-of-range (OOR) exogenous inputs, defined as test samples for which at least one future exogenous value lies outside the range observed during training. We focus our analysis on EPF-DE as it contains the largest number of such samples among the EPF datasets. Figure 1b summarizes the aggregate results: on OOR EPF-DE samples, SLiDE reduces MSE by 20% relative to the strongest baseline. We observe a similar pattern on Favorita, where we observe a clear separation from the baselines on a small subset of OOR samples (see Appendix § 11). On the synthetic side, we use the Bouc-Wen transfer setting, where the test-time input process differs from training. In this setting, SLiDE reduces MAE by 30% relative to the next best model. These results support the view that SLiDE generalizes better under shifted exogenous inputs.
Efficiency. We compare mean inference time against average benchmark rank in Figure 3b. SLiDE has inference cost similar to TSMixer, a model designed for computational efficiency, while being considerably faster than TimeXer and GCGNet. Marker size reflects the number of trainable parameters. Thus, SLiDE’s superior performance does not come at a substantial computational cost.
Ablation studies
We perform targeted ablation experiments to assess the contribution of the main structural components of SLiDE. In particular, we study the role of the structured encoder and the linear latent rollout. For each ablation, we perform a random search over hyperparameters with fixed budget.
Nonlinear State Update. Our proposed architecture deliberately enforces a linear temporal evolution in latent space. To examine whether this provides a useful inductive bias, we perform an ablation that introduces a nonlinear transformation into the latent dynamics by replacing with a two-layer MLP with ReLU activation. We sweep over different hidden dimensions to vary model complexity.
MLP Encoder. We relax the constraints on the encoder by replacing it with a dense MLP while keeping the shared latent rollout unchanged. We preserve the multiple-block structure and tune the hidden dimension and number of hidden layers as hyperparameters.
Ablation results. Table 1 reports the performance of both ablations across all datasets. Replacing the structured encoder with a dense MLP generally degrades performance, indicating that the lag-invariant recurrent encoder is an important component of the model. The effect of introducing a nonlinearity into the latent rollout is more nuanced. On the real-world benchmarks, it changes performance only modestly on the full test sets, while on the synthetic Bouc-Wen tasks, it improves the in-range multisine setting but substantially deteriorates performance in the transfer setting, where the same underlying system is driven by an unseen forcing process at test time. This is consistent with the view that the linear latent rollout provides a stronger bias toward generalization under shifted exogenous inputs, whereas the nonlinear variant increases modeling flexibility but is more prone to fitting forcing-specific patterns.
This pattern is clearest on shifted-input subsets. As shown in Figure 1b and the appendix tables, both ablations degrade on out-of-range (OOR) real-world samples. On EPF-DE OOR samples, the MLP encoder drops more sharply, while the nonlinear-update ablation also underperforms the base model. Favorita OOR samples show SLiDE outperforming both ablations by 18% in RMSLE, while in-range performance is mostly unaffected. Together, these results indicate that both the structured encoder and shared linear latent rollout contribute to SLiDE’s stronger generalization when exogenous inputs move beyond the training regime.
We further examine the model design through additional input-map and encoder ablations in Appendix § 12.§ 1 and block-structure ablations in Appendix § 12.§ 2. These experiments show that the proposed design remains competitive with more flexible alternatives and characterize its sensitivity to the chosen number of blocks. Finally, Appendix § 12.§ 3 evaluates robustness to imperfect exogenous inputs, showing that SLiDE remains competitive under both missing and noisy future inputs.
Conclusion and Limitations
In this work, we introduced SLiDE, a structured architecture for exogenous multi-step forecasting inspired by Koopman-style latent linear modeling. SLiDE combines a structured lag-invariant recurrent encoder for reconstructing the forecast-start latent state with a shared linear latent rollout that propagates this state under additive exogenous forcing. Empirically, SLiDE achieves state-of-theart performance across real-world energy and retail benchmarks while remaining computationally efficient. Its advantage is particularly clear when future exogenous inputs shift beyond the training regime, where it outperforms the considered baselines on both real-world and synthetic tasks. Overall, our results suggest that carefully structured latent-state estimation together with a shared linear latent rollout is an effective design principle for forecasting with exogenous inputs.
Limitations. Our focus is on forecasting accuracy together with computational and memory efficiency. SLiDE inherits the strengths but also the modeling assumptions of Koopman-style latent representations. Its suitability may depend on how well a forecasting problem can be described by an approximately linear latent dynamics model. This could be more restrictive for systems with richer latent structure, for example, those not well captured by low-dimensional Koopman approximations or involving continuous spectra, which we do not study systematically here. As exogenous inputs directly influence the latent rollout, missing, noisy, or misaligned inputs affect forecast quality. Our experiments with missing or noisy inputs (see Appendix § 12.§ 3) suggest that SLiDE is relatively robust compared to the considered baselines. Moreover, we only evaluate a limited set of shifted-input scenarios, namely out-of-range covariates with a limited number of samples per dataset and a synthetic transfer setting. Extending the analysis to a wider range of covariate shifts and exploring more adaptive latent operators, for example, context-dependent variants as in Li et al. [ [25], are valuable directions for future work.
Acknowledgments and Disclosure of Funding
This research was partially funded by the Natural Sciences and Engineering Research Council of Canada (NSERC), [reference number 260250]. Cette recherche a été partiellement financée par le Conseil de recherches en sciences naturelles et en génie du Canada (CRSNG), [numéro de référence 260250]. Ce projet de recherche no 324302 est rendu possible grâce au financement du Fonds de recherche du Québec. The authors gratefully acknowledge funding from the Helmholtz Association under grant no. VH-NG-1727 and the Helmholtz Association’s Initiative and Networking Fund through Helmholtz AI and the HAICORE@KIT partition. The authors gratefully acknowledge the computing time provided on the high-performance computer HoreKa by the National High-Performance Computing Center at KIT (NHR@KIT). This center is jointly supported by the Federal Ministry of Research, Technology and Space and the Ministry of Science, Research and the Arts of Baden-Württemberg, as part of the National High-Performance Computing (NHR) joint funding program. HoreKa is partly funded by the German Research Foundation (DFG).
During the preparation of this work, the authors used AI-assisted tools for language editing and code development. After using these tools, the authors reviewed and edited the content as needed and take full responsibility for the content of the publication.
Derivation of the reconstructability map
In the following section, we provide a condensed derivation of the reconstructability map from Iacob et al. [2025] in the context of our method. We write and use for successive applications of . As in the main text, and (see the note on below).
Observability map. Consider a window of consecutive outputs , whose first sample is . Propagating through the inputs that follow gives
where, for , is empty and is the identity, so that . Stacking these outputs gives
Adapting Iacob et al. [2025] to our indexing, local observability from output samples requires
where are nonlinear constraints on the lifted state that ensure the linear dynamics are equivalent to the original nonlinear system. Inverting yields the observability map
with .
Reconstructability map. Since we prefer to determine the current state from past data, we propagate the reconstructed window-start state to the end of the window, which takes forward steps:
where is the reconstructability map. Reconstruction requires a sufficiently large window .
Full-history encoder. To reconstruct at present time from the full past trajectory , we take and :
This map does not depend on , the input aligned with the first observation. Our parameterized encoder nonetheless takes the full aligned sequence so that the same input–output structure is used at every time step:
where is an additional input. Computing analytically is infeasible because it requires inverting to obtain , so has learnable parameters .
Additional methodology details
Characterizing the departure from the exact Koopman form
The exact Koopman form has a state- and input-dependent input map
However, as detailed in Iacob et al. [2025], it may be desirable to trade accuracy for simplicity of the model, e.g. by choosing a suitable form of the input function in (8). In our case, we do not only choose the input map to be state-independent, but instead of explicitly parameterizing the matrix-valued map , our implementation directly parameterizes the resulting whole input forcing term as . The following characterizes what this input-decoupled model retains relative to the exact form.
The input-decoupled form is exact if there exists a finite-dimensional lifting for which the effect of the input on the lifted dynamics is independent of the lifted state
This structure is analogous to a Hammerstein model in the lifted coordinates, where a static nonlinear transformation of the input drives otherwise linear latent dynamics. If, instead, the exact lifted input forcing depends on both and , as permitted by the general Koopman form , the state-independent forcing constitutes an approximation.
When the input-decoupled form is not exact, we can characterize the error induced specifically by removing the latent-state dependence from the input forcing. Let denote the exact lifted forcing and let denote its state-independent approximation. We assume that their mismatch is uniformly bounded over the relevant domain of lifted states and inputs:
Furthermore, assume that the linear latent operator is Schur stable, i.e.,
For any satisfying , there then exists a constant such that
To isolate the error introduced by the state-independent forcing, consider the exact and input-decoupled lifted dynamics under the same input sequence:
with identical initial lifted states,
Define the trajectory discrepancy and the corresponding one-step forcing mismatch as
By assumption,
for all considered state-input pairs. Subtracting the two latent dynamics gives
Unrolling this recursion yields
Therefore,
Consequently,
Thus, under Schur-stable latent dynamics, a uniformly bounded error resulting from the state-independent approximation of the input forcing does not accumulate without bound with the forecast horizon.
This bound isolates the approximation introduced by replacing the exact forcing with while keeping the same latent operator . Therefore, it does not constitute a bound on the total error of the learned forecasting model. In our implementation, the latent operator is learned as and the forcing is directly parameterized as
The exact Koopman operator is unknown in our setting. However, our spectral analysis in Appendix E shows empirically that the learned is Schur stable across the considered tasks. Appendix D.1.1 further provides a specific ablation experiment, replacing SLiDE’s input map with a state-dependent alternative that stays closer to the structure proposed by the exact model form.
Patching
For time series with a long history and forecast horizon , we may optionally pre-process the target time series by patching together consecutive observations. We define a patch length to transform the target time series to have past values and future values. For and , we define:
Within each patch, the consecutive time steps and channels of are flattened into a space . This removes the sequential relationship of consecutive observations within the patch, treating it instead as simultaneous observations of a higher-dimensional variable. The range of defined time indices is reduced by a factor of . This same patching mechanism is then analogously applied for the input sequence .
We begin by reframing our target time series from to following the patching process described in (46). The transformed target variable is equivalent to some other target , with a different forecast horizon and dimension . Our model treats as the variable of interest for forecasting, and we can subsequently obtain by inverting the patching process.
Additional details on “OOR” results
For the real-world datasets, out-of-range exogenous inputs provide a concrete instance of shifted exogenous inputs. These are test samples whose future-known exogenous values fall outside the training input regime. This setting does not imply a general distribution shift, but isolates a practical form of extrapolation in the future input process.
EPF datasets. Table 2 reports the number of such OOR samples for each dataset in the EPF benchmark. The phenomenon is relatively rare in most markets, but occurs most frequently in EPF-DE, which contains 93 OOR test days, substantially more than the other EPF datasets. All EPF datasets contain 437 test days in total. We therefore focus our detailed analysis on EPF-DE, as it provides the clearest real-world setting for studying generalization beyond the training support of future-known covariates.
| Dataset | #OOR samples |
| NP | 18 |
| PJM | 0 |
| EPEX BE | 16 |
| EPEX FR | 16 |
| EPEX DE | 93 |
Table 2. Number of samples, here denoted as out-of-range (OOR) samples, for which an exogenous input value exceeds the training range per EPF dataset.
Table 3 compares model performance on the OOR subset, the complementary in-range subset, and the full EPF-DE test set. SLiDE performs best on the OOR subset, achieving the lowest MAE and MSE among all models. The margin over the strongest forecasting baselines is substantially larger on OOR samples than on the in-range subset, indicating that SLiDE’s advantage is concentrated in cases where future exogenous inputs exceed the range seen during training. The same trend is reflected in the ablations: both the nonlinear-update and MLP-encoder variants degrade on the OOR subset, with the MLP encoder showing the larger drop. This supports the view that both the structured encoder and the shared linear latent rollout contribute to the improved behavior under shifted input conditions.
| Model | OOR MAE | OOR MSE | In-Range MAE | In-Range MSE | overall MAE | overall MSE |
| SLiDE | 0.305 | 0.278 | 0.254 | 0.156 | 0.265 | 0.182 |
| TimeXer | 0.348 | 0.384 | 0.259 | 0.166 | 0.278 | 0.213 |
| GCGNet | 0.349 | 0.356 | 0.267 | 0.166 | 0.285 | 0.206 |
| TSMixer | 0.367 | 0.418 | 0.261 | 0.165 | 0.283 | 0.218 |
| TiDE | 0.379 | 0.400 | 0.272 | 0.172 | 0.295 | 0.220 |
| Koop.-Subnet | 0.392 | 0.444 | 0.291 | 0.206 | 0.312 | 0.257 |
| DLinear | 0.399 | 0.471 | 0.282 | 0.188 | 0.307 | 0.248 |
| CT-Subnet | 0.407 | 0.452 | 0.294 | 0.192 | 0.318 | 0.247 |
| MamKO | 0.415 | 0.495 | 0.301 | 0.217 | 0.325 | 0.276 |
| SKOLR | 0.502 | 0.698 | 0.385 | 0.360 | 0.410 | 0.432 |
| Base | 0.305 | 0.278 | 0.254 | 0.156 | 0.265 | 0.182 |
| Nonlinearity | 0.311 | 0.285 | 0.258 | 0.160 | 0.269 | 0.186 |
| MLP Encoder | 0.348 | 0.342 | 0.263 | 0.165 | 0.281 | 0.203 |
Table 3. Detailed EPF DE OOR Results
Favorita. We also perform an analogous analysis on the Favorita dataset. Here, we define a test sample as OOR if the number of promoted items for the corresponding product group, evaluated over the forecast horizon, exceeds the range observed during training for this particular group. Under this definition, 60 out of 1,579 test samples qualify as OOR. Although these samples make up only a small fraction of the test set, Table 4 shows that this is precisely the region in which SLiDE separates most clearly from the baselines: it achieves the best RMSLE on the OOR subset, while differences on the in-range subset are much smaller. The ablation results follow the same pattern, with both the MLP encoder and nonlinear latent update degrading performance on the OOR subset. Figure 4 displays an example forecast for a test sample with out-of-range promotion inputs, where SLiDE stays closer to the ground truth than either the MLP-encoder or nonlinear-rollout ablation.
| Model | OOR RMSLE | In-Range RMSLE | overall RMSLE |
| SLiDE | 0.670 | 0.406 | 0.419 |
| CT-Subnet | 0.752 | 0.410 | 0.428 |
| TiDE | 0.761 | 0.405 | 0.424 |
| TSMixer | 0.805 | 0.400 | 0.422 |
| Koop.-Subnet | 0.808 | 0.417 | 0.438 |
| TimeXer | 1.116 | 0.415 | 0.461 |
| MamKO | 1.179 | 0.440 | 0.489 |
| DLinear | 1.237 | 0.427 | 0.483 |
| GCGNet | 1.252 | 0.424 | 0.482 |
| SKOLR | 1.288 | 0.415 | 0.478 |
| Base | 0.670 | 0.406 | 0.419 |
| MLP Encoder | 0.819 | 0.401 | 0.424 |
| Nonlinearity | 0.877 | 0.400 | 0.428 |
Table 4. Detailed Favorita OOR Results
Figure 4. Favorita example with out-of-range promotion inputs. The top panel shows the future-known exogenous input, and the bottom panel the corresponding sales forecasts. Once the promotion signal exceeds the maximum training value, SLiDE stays closer to the ground truth than either the MLP-encoder or nonlinear-rollout ablation.
Although this analysis is based on a relatively small number of samples, it is consistent with the broader observation that SLiDE is particularly effective when future exogenous inputs move beyond the support observed during training.
Bouc-Wen Transfer. Figure 5 provides an illustrative Bouc-Wen transfer trajectory. In this example, SLiDE remains closer to the ground truth than strong forecasting baselines across much of the rollout, especially in intervals with out-of-range input values. Figure 6 shows an example trajectory comparing SLiDE to the main ablations. The nonlinear latent update produces substantially larger amplitude errors, while the MLP encoder also degrades performance relative to the base model.
Figure 5. Illustrative Bouc-Wen transfer trajectory for SLiDE and two baselines. The top panel shows the exogenous input process. The bottom panel compares the ground-truth target trajectory with forecasts from SLiDE, TimeXer and TSMixer. The shaded regions highlight intervals in which SLiDE tracks the ground-truth noticeably better than both of the baselines shown here.
Figure 6. Illustrative Bouc-Wen transfer trajectory for SLiDE and the two main ablations. The top panel shows the exogenous input process. The bottom panel compares the ground-truth target trajectory with forecasts from SLiDE, the MLP-encoder ablation, and the nonlinear-rollout ablation. While the MLP-encoder ablation remains relatively close to the base model, the nonlinear latent update produces substantially larger amplitude errors.
Additional ablations
Input-map and encoder ablations
State-dependent input map
To assess the effect of removing the latent-state dependence from the exogenous forcing, we implement a state-dependent input map following Koopman-Subnet. An MLP takes the current latent state and input as arguments and outputs a matrix , such that the additive forcing is given by .
The state-dependent map improves on the noiseless, fully deterministic Multisine task, as does the nonlinear rollout in § 6, but it is worse on the real-world benchmarks and degrades sharply on the Transfer task, where the exogenous input process shifts at test time. The additional state dependence is therefore helpful only in that clean deterministic setting. The input-only forcing performs better on the real-world tasks and under shifted forcing, and it uses fewer parameters: the state-dependent MLP must output an matrix rather than an -dimensional forcing vector.
Attention-based encoder
We implement an attention-based encoder while keeping the linear rollout fixed. Tokens are embedded using the same MLPs for and and summed, then processed by a standard Transformer with RoPE self-attention. The final hidden state is used as . Among the ablations in Table 5, this encoder is the most competitive with SLiDE. However, this architecture suffers from an increase in parameter count and computational cost, since self-attention replaces the linear recurrent encoder, and does not provide a clear performance uplift relative to SLiDE.
| Model | NP MAE | NP MSE | PJM MAE | PJM MSE | EPEX BE MAE | EPEX BE MSE | EPEX FR MAE | EPEX FR MSE | EPEX DE MAE | EPEX DE MSE | Sales RMSLE | Multisine MAE | Multisine MSE | Transfer MAE | Transfer MSE |
| SLiDE | 0.210 | 0.167 | 0.157 | 0.064 | 0.231 | 0.367 | 0.169 | 0.329 | 0.265 | 0.182 | 0.419 | 0.085 | 0.012 | 0.296 | 0.139 |
| Nonlinearity | 0.214 | 0.170 | 0.158 | 0.067 | 0.236 | 0.371 | 0.169 | 0.329 | 0.269 | 0.186 | 0.428 | 0.035 | 0.002 | 0.741 | 0.877 |
| State-dependent map | 0.218 | 0.174 | 0.160 | 0.068 | 0.234 | 0.360 | 0.174 | 0.328 | 0.277 | 0.207 | 0.427 | 0.064 | 0.007 | 0.370 | 0.312 |
| MLP encoder | 0.223 | 0.172 | 0.160 | 0.065 | 0.239 | 0.352 | 0.183 | 0.332 | 0.281 | 0.203 | 0.423 | 0.091 | 0.014 | 0.360 | 0.207 |
| Attention-based encoder | 0.214 | 0.173 | 0.159 | 0.069 | 0.229 | 0.354 | 0.167 | 0.318 | 0.267 | 0.184 | 0.426 | 0.075 | 0.010 | 0.297 | 0.140 |
Table 5. Ablation study of the state-dependent input map and the Transformer encoder, shown together with the nonlinear state-update and MLP-encoder ablations from § 6. We highlight the best result for each metric.
Block-structure ablations
Selection of and sensitivity to block count
Figure 7 illustrates a Favorita forecast in which the two block contributions exhibit different temporal patterns and combine to form the final prediction. To further investigate and inform the choice of the number of blocks , we ran a dedicated ablation with in two regimes: (i) fixed per-block dimension, where the total parameter count grows with , and (ii) fixed total latent dimension, where more blocks make sparser and reduce parameters.
Figure 7. Forecast sample of SLiDE on the Favorita benchmark for predicting product sales. Top: The exogenous inputs, indicating the presence of holidays and number of related products on promotion. Bottom: Sales target and SLiDE forecast broken down into individual block forecasts. We observe that the two blocks learn different temporal patterns, which are combined to form the final forecast.
Table 6 reports the results. On average, performance improves from one to two or four blocks, with only minor differences between and . Increasing the number of blocks to generally degrades performance, particularly in the fixed-total-dimension regime, where the average relative performance gap to the best-performing variant reaches 18.73%. We therefore selected as the default for its favorable performance–cost trade-off and excluded from HPO to reduce computational cost.
| Blocks | EPF Benchmark | Favorita | Bouc-Wen System | |||||||||||||
| NP | PJM | EPEX BE | EPEX FR | EPEX DE | Sales | Multisine | Transfer | |||||||||
| MAE | MSE | MAE | MSE | MAE | MSE | MAE | MSE | MAE | MSE | RMSLE | MAE | MSE | MAE | MSE | ||
| Fixed per-block dimension: | ||||||||||||||||
| 1 | 0.214 | 0.173 | 0.159 | 0.065 | 0.235 | 0.380 | 0.167 | 0.344 | 0.269 | 0.191 | 0.423 | 0.082 | 0.011 | 0.306 | 0.148 | |
| 2 | 0.210 | 0.167 | 0.157 | 0.064 | 0.231 | 0.367 | 0.169 | 0.329 | 0.265 | 0.182 | 0.419 | 0.085 | 0.012 | 0.296 | 0.139 | |
| 4 | 0.209 | 0.164 | 0.157 | 0.064 | 0.231 | 0.366 | 0.169 | 0.324 | 0.265 | 0.182 | 0.424 | 0.086 | 0.012 | 0.306 | 0.149 | |
| 8 | 0.211 | 0.169 | 0.155 | 0.063 | 0.229 | 0.357 | 0.172 | 0.320 | 0.264 | 0.184 | 0.428 | 0.091 | 0.014 | 0.327 | 0.169 | |
| Fixed total dimension: | ||||||||||||||||
| 1 | 0.208 | 0.165 | 0.159 | 0.066 | 0.232 | 0.361 | 0.167 | 0.337 | 0.267 | 0.189 | 0.421 | 0.084 | 0.012 | 0.307 | 0.150 | |
| 4 | 0.211 | 0.171 | 0.157 | 0.063 | 0.232 | 0.367 | 0.173 | 0.332 | 0.262 | 0.180 | 0.420 | 0.086 | 0.012 | 0.291 | 0.134 | |
| 8 | 0.212 | 0.173 | 0.158 | 0.063 | 0.232 | 0.363 | 0.176 | 0.336 | 0.265 | 0.183 | 0.424 | 0.089 | 0.013 | 0.447 | 0.367 |
Table 6. Block ablation results with fixed latent dimension (Fixed per-block dimension) and with latent dimension scaled inversely to the number of blocks (Fixed total dimension). We highlight the first, second and third results across both experiments for each metric.
Explicit block diversity
While Figure 7 suggests that different blocks learn distinct temporal patterns, Figure 9 shows that their eigenvalue spectra largely overlap. To investigate whether explicitly enforcing diversity improves performance, we added a diversity loss that penalizes pairwise squared cosine similarity between block operators under the Frobenius inner product, following the cosine-similarity diversity regularization of Wortsman et al. [2021]. We evaluated weights and across .
The effect on performance is negligible, with the mean relative performance change across dataset–metric pairs ranging from to across the tested configurations. Thus, explicitly encouraging block diversity does not yield systematic performance improvements in the considered experiments.
Robustness
Missing exogenous inputs
We evaluate robustness to missing exogenous inputs on EPF PJM and EPF DE, chosen to represent both a setting in which competing baselines are strong (PJM) and a setting in which SLIНе significantly outperforms (DE). For each time step, we independently drop all exogenous values with probability according to a Bernoulli distribution. Missing values are replaced with zeros after dataset-wide standardization, and an additional binary indicator channel is appended to mark whether the exogenous values at that time step are observed or missing. We reuse the hyperparameter configuration selected in the main experiments and report average metrics over five independent runs with different random seeds. Figure 8 shows that SLIНе outperforms TimeXer and TSMixer at 30% and 60% missing values on EPF PJM, despite being slightly behind at full availability. SLIНе’s performance degradation is comparable to the lighter TSMixer, while attention-based TimeXer degrades most sharply, demonstrating strong robustness relative to the most competitive baseline available.
Figure 8. Evaluation metrics (MAE left, MSE right) of SLiDE, TimeXer and TSMixer against percentage of missing exogenous values for the EPF PJM (top) and DE (bottom) datasets. SLiDE outperforms baselines on PJM with 30% and 60% of missing values, and is significantly more robust than TimeXer, the second-best ranking model, on EPF DE.
Noisy future exogenous inputs
We note that our real-world benchmarks already contain errors in future exogenous inputs by construction: the future-known covariates in all five EPF datasets are themselves day-ahead forecasts, not realized values. The EPF results therefore already evaluate the models using future exogenous variables that contain realistic forecast uncertainty.
To additionally characterize robustness in a controlled way, we ran an input corruption experiment. We perturb only the future exogenous inputs in the horizon with Gaussian noise (standard deviation scaled to 50% of each input’s standard deviation), keeping past values unperturbed. Each model is re-trained with its original hyperparameters on unperturbed past and noisy future inputs. We omit Favorita from this experiment since its future-known covariates (holidays, promotions, calendar features) are deterministically known in advance, so corrupting them would not correspond to a realistic uncertainty scenario.
SLiDE maintains its top average rank under this noisy regime. Notably, on Bouc–Wen Multisine, SLiDE now outperforms Koopman-Subnet and CT-Subnet, which outperform SLiDE on the task without noise addition but show particularly large relative degradation when the future forcing is corrupted. Results are reported in Table 7.
| Model | NP MAE | NP MSE | PJM MAE | PJM MSE | EPEX BE MAE | EPEX BE MSE | EPEX FR MAE | EPEX FR MSE | EPEX DE MAE | EPEX DE MSE | Multisine MAE | Multisine MSE | Transfer MAE | Transfer MSE |
| SLiDE | 0.219 | 0.181 | 0.163 | 0.069 | 0.236 | 0.369 | 0.176 | 0.339 | 0.278 | 0.203 | 0.243 | 0.096 | 0.336 | 0.178 |
| Forecasting Architectures: | ||||||||||||||
| TimeXer | 0.222 | 0.188 | 0.158 | 0.064 | 0.236 | 0.377 | 0.173 | 0.348 | 0.290 | 0.229 | 0.284 | 0.128 | 0.503 | 0.395 |
| GCGNet | 0.227 | 0.184 | 0.162 | 0.068 | 0.252 | 0.373 | 0.190 | 0.315 | 0.296 | 0.221 | 0.335 | 0.178 | 0.481 | 0.366 |
| TSMixer | 0.231 | 0.201 | 0.165 | 0.086 | 0.242 | 0.343 | 0.200 | 0.316 | 0.304 | 0.250 | 0.286 | 0.131 | 0.670 | 0.706 |
| TiDE | 0.247 | 0.206 | 0.164 | 0.075 | 0.255 | 0.357 | 0.201 | 0.350 | 0.309 | 0.247 | 0.281 | 0.126 | 0.494 | 0.383 |
| Related System Identification or Control Baselines: | ||||||||||||||
| Koop.-Subnet | 0.265 | 0.234 | 0.195 | 0.097 | 0.259 | 0.372 | 0.198 | 0.336 | 0.334 | 0.289 | 0.250 | 0.100 | 0.463 | 0.337 |
| CT-Subnet | 0.257 | 0.208 | 0.185 | 0.089 | 0.263 | 0.396 | 0.210 | 0.386 | 0.337 | 0.288 | 0.262 | 0.109 | 0.768 | 0.885 |
| MamKO | 0.265 | 0.242 | 0.182 | 0.085 | 0.269 | 0.395 | 0.206 | 0.334 | 0.375 | 0.355 | 0.508 | 0.399 | 0.744 | 0.968 |
Table 7. Performance under noisy future exogenous inputs on the EPF benchmark and Bouc-Wen tasks. We highlight the first, second, and third results for each metric.
Spectrum of the learned operator
We analyze the eigenvalue spectrum of the learned operator across blocks and datasets, as shown in Figure 9. Although no explicit spectral constraint is imposed during training, all learned eigenvalues remain inside the unit circle for the considered models. Hence, the learned operators are Schur stable, empirically satisfying the stability assumption used in our error bound in App. § 10.§ 1. Most eigenvalues lie well within the stability boundary, indicating predominantly fast-decaying latent modes. Note that was initialized using PyTorch’s default nn.Linear initialization, which, for sufficiently large square matrices, yields an approximately uniform eigenvalue distribution within a disk of radius .

Figure 9. Eigenvalue spectra of the learned operator across blocks and datasets. Each point denotes an eigenvalue of a block-specific operator and the dashed circle indicates the unit circle.
Across blocks, the eigenvalue distributions overlap substantially, with no clear partition into distinct frequency bands or decay timescales. The block structure therefore does not appear to induce a spectral decomposition of the dynamics. Instead, the results are consistent with the blocks providing a parameter-efficient collection of parallel latent dynamics, despite the corresponding block forecasts specializing to different temporal patterns (see Figure 7).
The Bouc–Wen benchmark provides an informative case study. Its linearized dynamics have a reported natural frequency of 35.59 Hz [31]. At a sampling rate of 750 Hz, this corresponds to discrete-time eigenvalue angles of approximately rad () for patch length and rad () for . The dominant learned conjugate pairs roughly agree with these positions. This correspondence suggests that captures meaningful oscillatory structure of the underlying system, while the remaining, generally faster-decaying modes provide additional flexibility for representing the nonlinear hysteretic dynamics.
Experimental details
Additional information on datasets
| Dataset | # Targets | # Series | Past | Future | Static | Context | Horizon | Loss | Metrics |
| EPF datasets | 1 | 1 | 0 | 2 | 0 | 168 | 24 | MAE | MAE, MSE |
| Favorita Sales | 1 | 1,579 | 1 | 6 | 6 | 56 | 28 | MSE (log) | RMSLE |
| Bouc-Wen tasks | 1 | 1 | 0 | 1 | 0 | 288 | 144 | MAE | MAE, MSE |
Table 8. Summary of the datasets and covariate types used in our experiments.
Electricity Price Forecasting (EPF) Benchmark. The EPF benchmark [23] consists of five datasets of different electricity markets. For each dataset, the task is forecasting the hourly day-ahead electricity price for the next 24 hours, given two forecasted covariates for the next day. The two forecasted covariates differ for each dataset. All datasets include six years of hourly data.
Nord Pool (NP): The NP dataset contains price data of the European power market of the Nordic countries. The two additional covariates are the day-ahead load forecast and the day-ahead wind generation forecast.
Pennsylvania–New Jersey-Maryland (PJM): This dataset includes prices from the Commonwealth Edison (COMED) zone from the PJM market in the United States as the target time series. The covariates are two day-ahead load forecast series, a system load forecast and a zonal load forecast for the COMED zone.
European Power Exchange - Belgium (EPEX-BE): The EPEX-BE dataset contains the day-ahead prices for the Belgian bidding zone on the market operated by EPEX SPOT. The two covariates in this dataset are the day-ahead load forecast and the day-ahead generation forecast in France.
European Power Exchange - France (EPEX-FR): The EPEX-FR dataset contains the day-ahead prices for the French bidding zone on the market operated by EPEX SPOT. The two covariates in this dataset are the day-ahead load forecast and the day-ahead generation forecast.
European Power Exchange - Germany (EPEX-DE): The EPEX-DE dataset includes the day-ahead prices for the German bidding zone on the market operated by EPEX SPOT. The two covariates in this dataset are the day-ahead load forecast for the control area operated by the transmission system operator Amprion and the aggregated day-ahead wind and solar generation forecast in the zones operated by the transmission system operators Amprion, TenneT and 50Hertz.
Following Li et al. [2026], we use a 70%/10%/20% train/validation/test split, a forecast horizon of 24 hours and a context length of one week (168 hours). In contrast to their evaluation setup, however, we extract inference samples with a stride of 24 hours rather than 1 hour in order to better reflect the application setting and realistic future-covariate availability. We train all models using a Mean Absolute Error (MAE) loss and evaluate performance with
MAE and Mean Squared Error (MSE) . All datasets are standardized using mean and standard deviation statistics computed from the respective training sets, and performance is reported in standardized units.
Favorita Sales Dataset. The Favorita Sales Dataset [6] is a large-scale retail forecasting dataset that contains daily sales from Corporación Favorita, a large grocery retailer located in Ecuador. The target time series are the total sales for a product family at a particular store on a given day. Future-known covariates are: (1) the total number of items in a product family that were being promoted at a store on a given day, and (2) whether the given day is a holiday. The number of promoted items is log-transformed, and the holiday indicator is binary encoded. In addition, we include day-of-week and day-of-month features as future-known covariates encoded with sine and cosine functions, yielding a total of six future-known covariates. As the Ecuadorian economy is highly dependent on oil, the daily oil price is included as a covariate for the past time steps. The oil price is standardized using mean and standard deviation statistics computed from the training set.
Additionally, the dataset includes the product family, store number, city, state and type as well as a cluster variable, which groups similar stores, as categorical static covariates for each time series.
We use the preprocessed dataset from Shchur et al. [2025] and also use the same horizon of 28 days. We hold out a single evaluation window consisting of the last 28 days of all series as the test set and the preceding 28 days as the validation set. We fix the context length to 56 days. We train all models to minimize an MSE loss in log-transformed space as the primary forecasting loss. As in the related Kaggle competition [6], we evaluate performance using the Root Mean Squared Logarithmic Error (RMSLE):
Bouc-Wen Hysteretic System. The Bouc-Wen benchmark [39, 31] provides two noiseless datasets, originally intended for system identification: (a) a random phase multisine input dataset containing a steady state period of 8192 timesteps and (b) a sine-sweep input dataset in which the sine input signal increases frequency in a frequency band from 20 to 50 Hz. This dataset contains about 153,000 timesteps.
We use this benchmark as a controlled test bed for forecasting with exogenous inputs and define the following two forecasting tasks:
Multisine: We employ a 70%/10%/20% split on dataset (a) and extract samples using a stride (step size) of 1.
Transfer: We train on the sinesweep dataset (b) of which we hold out the last 15% as a validation set and evaluate on the multisine dataset (a). Samples are extracted using a stride of 24. This setting is designed to test generalization under a shift in the exogenous forcing process.
For both tasks, we optimize the mean absolute error loss, use a context length of 288 steps, and a forecast horizon of 144 steps. Both datasets are standardized using mean and standard deviation statistics computed from the respective training sets, and performance is reported in standardized units.
Dataset availability. We do not redistribute or re-upload any of the datasets used in this work. The electricity price forecasting (EPF) datasets [23] are available from Zenodo4—the record lists the license as “Other (Open)”, with source-specific terms applying to the original electricity-market data. The Favorita store-sales data were accessed through the fev_datasets collection [41] on HuggingFace5, which identifies the original source as Kaggle’s Store Sales – Time Series Forecasting competition6 [6]; the Hugging Face record is licensed as “other” and points users to the original source terms, while Kaggle permits non-commercial use under the competition rules. The Bouc-Wen hysteresis benchmark data [39, 31] are available from 4TU.ResearchData7 under the Creative Commons Attribution-ShareAlike 4.0 International license (CC BY-SA 4.0).
Additional information on baselines and training methodology
We consider two groups of baselines: competitive forecasting architectures with exogenous-variable support, and related structured latent-dynamics baselines. For each baseline, we summarize the model class, the implementation used in our experiments, and any adaptations required to match our covariate setting.
TimeXer. The TimeXer model [47] is a Transformer-based architecture that is specifically designed for forecasting with exogenous variables. As the original implementation assumes that endogenous and exogenous sequences have the same length, it cannot directly accommodate future-known covariates beyond the historical context. We therefore use the implementation from Li et al. [ [26], which modifies the exogenous-input embedding to support future-known covariates in the forecasting setting studied here. However, this version is not able to utilize past-only covariates without further modifications, which only affects the oil price variable in the Favorita task.
TSMixer. The Time-Series Mixer (TSMixer) [5] is an MLP-based architecture built around mixing operations along the time and feature dimensions. We use the implementation from Neuralforecast [32] to run our experiments. TSMixer natively incorporates future-known, past-only and static covariates (in the TSMixerx variant).
GCGNet. The Graph-Consistent Generative Network (GCGNet) [26] is a recently proposed graph-based time series forecasting model that is specifically designed for forecasting tasks with exogenous variables. We use the original implementation to run baseline experiments. On the Favorita dataset, GCGNet exhibited unstable (internal) variance estimates; we therefore clamp these values to a bounded interval in order to stabilize training on this dataset.
TiDE. Time-series Dense Encoder (TiDE) [7] is an MLP-based encoder-decoder architecture. We use the implementation from Neuralforecast [32] to run our experiments. TiDE natively incorporates future-known, past-only and static covariates.
SKOLR. Structured Koopman Operator Linear Recurrent Neural Network (SKOLR) [Zhang et al., 2025] is a Koopman-based architecture that is structurally related to our approach. However, it is not able to incorporate future-known exogenous covariates. We use the original implementation and treat the past-only and the past portion of future-known covariates as additional channels of the input and run SKOLR in the non-channel-independent mode.
DLinear. DLinear [Zeng et al., 2023] is a simple linear architecture that includes a seasonal decomposition. We use the implementation from DARTS [13], which natively incorporates past-only, future-known and static covariates.
Koopman-Subnet. Koopman-Subnet [16] is a neural Koopman-with-input architecture originally developed for nonlinear system identification. It learns a lifted latent representation together with a generic MLP-based encoder and a state-dependent input map. We use the original implementation and adapt the inputs to our forecasting setting. Relative to SLiDE, Koopman-Subnet uses a more generic MLP encoder and a state-dependent input map,
CT-Subnet. CT-Subnet [2] is an architecture developed from a continuous-time system-identification perspective. We include it because it is structurally close to our setting in that it learns a latent state from observed history, but it differs from SLiDE in several key respects: it uses a generic MLP encoder, models nonlinear latent dynamics rather than a shared linear latent transport operator, and is motivated by continuous-time identification rather than discrete-time exogenous forecasting. We evaluate CT-Subnet using its original implementation.
MamKO. MamKO [25] is an adaptive Koopman-style architecture inspired by Mamba [10] and designed for modeling and control. Unlike SLiDE, which keeps the latent transition fixed and uses the full history to reconstruct a forecast-start latent state, MamKO uses historical context to generate operator-related components while obtaining the initial latent state from only the last target value through an MLP. We include MamKO as a conceptually relevant baseline because it represents an alternative design in which context modulates the latent operator itself rather than improving latent-state estimation at rollout start. We evaluate MamKO using its original implementation. In the original MamKO formulation, the input at time drives the state transition from to . We additionally evaluate the model with the complete exogenous input sequence shifted forward by one time step. This aligns the forecast covariates with the predicted timestamps and includes the final forecast covariate row in the rollout. Changes that noticeably exceed the reported standard deviation across seeds are improvements in EPEX BE MAE and MSE and EPEX FR MAE, and a further deterioration on the Bouc–Wen transfer task. The overall conclusions and discussions of MamKO remain qualitatively unchanged. We do not evaluate shifted Subnet variants as these architectures support direct feedthrough from to .
Baseline Implementations. GCGNet [26] and TimeXer [47] were implemented using the official GCGNet repository8, which is released under the MIT license. TiDE [7] and TSMixer [5] were run using NeuralForecast9 [32], which is released under the Apache License 2.0. DLinear [Zeng et al., 2023] was run using Darts10 [13], which is also released under the Apache License 2.0.
SKOLR [Zhang et al., 2025] was run from its public repository11, which is released under the MIT license. The CT-Subnet [2] and Koopman-Subnet [16] baselines were implemented using the deepSI toolbox12, which is released under the BSD 3-Clause license. MamKO [25] was implemented based on the CC BY 4.0-licensed OpenReview submission and its accompanying supplementary material13.
| Baseline | Past | Future | Static |
| TimeXer | ✗ | ✓ | (✓) |
| TSMixer | ✓ | ✓ | ✓ |
| GCGNet | ✗ | ✓ | (✓) |
| TiDE | ✓ | ✓ | ✓ |
| DLinear | ✓ | ✓ | ✓ |
| SKOLR | (✓) | ✗ | (✓) |
| Koopman-Subnet | (✓) | ✓ | (✓) |
| CT-Subnet | (✓) | ✓ | (✓) |
| MamKO | (✓) | ✓ | (✓) |
Table 9. Usage of past-only, future-known and static exogenous features in baselines. (✓) denotes models that do not natively incorporate static or past features. In this case, we provide an optional mechanism for static features that repeats the embedding and concatenates it to the inputs at each time step. For past features, we add their sequence as an additional channel to the target, while keeping a single output channel, if this is possible without major modifications.
Categorical static embedding. To allow the use of categorical static variables, we adopt the same learnable static embedding scheme for all baselines. For the baselines that do not natively incorporate static variables (TimeXer, GCGNet, SKOLR), we provide an optional mechanism that repeats the embedding and concatenates it to the inputs at each time step. We treat the inclusion of static information as a binary hyperparameter during tuning, allowing these models to leverage the static features if beneficial without forcing a non-native design choice.
Instance stationarization. Differences in instance stationarization can substantially influence forecasting accuracy [20]. To isolate the contribution of each method, we fix the instance stationarization protocol across all baselines for a given dataset, choosing the setting that performed best across baseline models. In particular, we apply instance stationarization to both endogenous and exogenous inputs for the EPF-BE and EPF-FR datasets, while applying it only to the endogenous input signal for the remaining EPF datasets and Favorita. We do not apply any instance stationarization to the Bouc–Wen tasks. An exception is Koopman-Subnet, which occasionally diverged at test time, without additional stationarization, in some settings. For this model, we also apply instance stationarization to exogenous inputs on EPF-DE, and to both endogenous and exogenous inputs on the Bouc–Wen transfer task.
Hyperparameter optimization. For all baseline models, we define the hyperparameter search spaces based on the ranges reported in the original papers and list them for the EPF datasets in Table 10. We use a random search with a fixed budget of 30 trials per model and dataset. Each configuration is evaluated on the validation set using early stopping with a patience of five epochs, and the configuration with the best validation performance is selected as the final model setting. The final baseline metrics are reported as averages over five independent runs with different random seeds. For the ablation experiments, we use a smaller random-search budget of 8 trials centered around the best configuration of the base model.
| Hyperparameter | EPF | Favorita | Bouc-Wen |
| SLiDE | |||
| batch size | |||
| learning rate | |||
| blocks | |||
| dynamic dims. | |||
| hidden layers | |||
| dropout | |||
| patch length | |||
| TimeXer | |||
| batch size | |||
| learning rate | |||
| feedforward dim. factor | |||
| model dim. | |||
| encoder layer | |||
| number of heads | |||
| patch length | |||
| TSMixer | |||
| batch size | |||
| learning rate | |||
| blocks | |||
| dropout | |||
| feedforward dim. | |||
| GCGNet | |||
| batch size | |||
| learning rate | |||
| feedforward dim. | |||
| model dim. | |||
| heads | |||
| TiDE | |||
| batch size | |||
| learning rate | |||
| hidden size | |||
| encoder layer | |||
| decoder layer | |||
| decoder output dim. | |||
| temporal decoder dim. | |||
| dropout | |||
| layerNorm | |||
| DLinear | |||
| batch size | |||
| learning rate | |||
| kernel size | |||
| constant initialization | |||
| SKOLR | |||
| batch size | |||
| learning rate | |||
| blocks | |||
| hidden layers | |||
| dynamic dim. | |||
| dropout | |||
| patch length | |||
| CT-Subnet | |||
| batch size | |||
| learning rate | |||
| latent dim. | |||
| feedthrough | |||
| Koop-Subnet | |||
| batch size | |||
| learning rate | |||
| latent dim. | |||
| feedthrough | |||
| u-dependent input map | |||
| MamKO | |||
| batch size | |||
| learning rate | |||
| kernel size | |||
| delta (factor of latent) | |||
| latent dim. | |||
| hidden dim. | |||
| learning rate scheduler |
Table 10. Hyperparameter optimization ranges for SLiDE and baselines on all datasets.
Computational resources
Experiments were conducted on multiple comparable compute systems. For concreteness, we report one representative configuration used for evaluation: a single node of a high-performance computing system with four NVIDIA A100 GPUs (40 GB), an Intel Xeon Platinum 8368 processor, and 512 GB RAM. Note that each individual training run used a single GPU. The remaining runs were performed on machines with comparable hardware configurations, which is not expected to materially affect
the reported results. The computational efficiency runs were all made on the same hardware for comparability. Overall, the experiments required approximately 1,000 GPU hours.
Performance of Koopman/system-identification baselines across benchmarks
We observe that Koopman-Subnet, CT-Subnet, and MamKO perform most favorably in settings that closely resemble classical system identification, with compact dynamics and directly observed forcing signals. This is visible in the Bouc–Wen experiments, where the methods perform strongly on Multisine, but degrade substantially under the distribution shift of the Transfer task and when future exogenous inputs are perturbed.
To test whether this trend extends beyond the original benchmarks, we additionally evaluate on the real-world UCI Bike Sharing dataset [8] and a synthetic Duffing oscillator driven by band-limited Gaussian forcing.
The additional results shown in Table 11 follow this pattern. On Bike Sharing, the system-identification methods show no systematic advantage. CT-Subnet remains competitive, while SLiDE performs best and Koopman-Subnet and MamKO trail the forecasting baselines. On Duffing, which more closely matches a controlled system-identification setting, CT-Subnet performs strongly. At the same time, the weaker Duffing results of Koopman-Subnet and MamKO show that this is not a uniform advantage of all system-identification or control methods.
| Model | Bike | Duffing | ||
| MAE | MSE | MAE | MSE | |
| SLiDE | 0.230 | 0.129 | 0.204 | 0.089 |
| TimeXer | 0.301 | 0.239 | 0.218 | 0.091 |
| GCGNet | 0.259 | 0.174 | 0.386 | 0.283 |
| CT-Subnet | 0.267 | 0.162 | 0.119 | 0.029 |
| Koop.-Subnet | 0.315 | 0.211 | 0.383 | 0.248 |
| MamKO | 0.327 | 0.262 | 0.641 | 0.665 |
Table 11. Results of Koopman/system-identification baselines on two additional dataset. Best results are highlighted in bold.
Statistical evaluation
Statistical Test Setup. We assess statistical significance using one-sided pairwise tests. For all datasets except Favorita, we apply the one-sided Diebold–Mariano (DM) test on the time series of error differences per sample averaged over seeds. We set the truncation of the variance estimate to the horizon divided by the step size between test samples. We implemented the DM test in Python following the implementation of the R forecast package [15]. As each Favorita test sample corresponds to a different product group predicted over the same time range, we instead use a one-sided Wilcoxon signed-rank test on per-product-group error differences, again averaged over seeds. We deem results significant at .
Bootstrap Confidence Intervals. In addition, we report 95% confidence intervals of the loss differential (again averaged over the five seeds) obtained via stationary bootstrap applying automatic block-length selection depending on autocorrelation in Table 12. The bootstrap confidence intervals show that SLiDE’s advantage is broad but not uniform, with the strongest and most statistically stable gains appearing on EPEX-DE and especially on the Bouc–Wen transfer task.
| Model | NP MAE | NP MSE | PJM MAE | PJM MSE | EPEX BE MAE | EPEX BE MSE | EPEX FR MAE | EPEX FR MSE | EPEX DE MAE | EPEX DE MSE | Sales MSLE | Multisine MAE | Multisine MSE | Transfer MAE | Transfer MSE |
| SLiDE | - | - | - | - | - | - | - | - | - | - | - | - | - | - | |
| TimeXer | 0.017 0.004 | 0.033 0.008 | 0.001 -0.007 | 0.001 -0.010 | 0.003 -0.006 | 0.007 -0.006 | 0.005 -0.007 | 0.053 -0.003 | 0.021 0.005 | 0.053 0.012 | 0.060 0.018 | 0.082 0.069 | 0.033 0.025 | 0.145 0.099 | 0.158 0.106 |
| TSMixer | 0.016 0.003 | 0.039 0.001 | 0.005 -0.003 | 0.002 -0.006 | 0.009 -0.001 | 0.006 -0.083 | 0.057 -0.001 | 0.028 -0.026 | 0.034 0.006 | 0.076 0.006 | 0.009 -0.003 | 0.012 0.002 | 0.003 0.000 | 0.265 0.224 | 0.368 0.312 |
| GCGNet | 0.015 0.005 | 0.024 -0.001 | 0.003 -0.003 | 0.004 -0.002 | 0.029 0.014 | 0.033 -0.048 | 0.049 0.003 | 0.019 -0.048 | 0.031 0.011 | 0.048 0.007 | 0.088 0.030 | 0.141 0.129 | 0.078 0.071 | 0.175 0.127 | 0.210 0.153 |
| TiDE | 0.042 0.026 | 0.046 0.021 | 0.017 0.002 | 0.048 0.000 | 0.034 0.016 | 0.030 -0.056 | 0.082 0.004 | 0.081 -0.025 | 0.046 0.017 | 0.071 0.015 | 0.009 0.000 | 0.066 0.050 | 0.022 0.016 | 0.212 0.164 | 0.275 0.214 |
| DLinear | 0.050 0.028 | 0.061 0.030 | 0.017 0.002 | 0.023 0.001 | 0.049 0.010 | 0.059 -0.071 | 0.076 0.003 | 0.094 -0.008 | 0.069 0.021 | 0.125 0.024 | 0.088 0.032 | 0.749 0.667 | 1.050 0.857 | 1.089 1.025 | 2.887 2.674 |
| SKOLR | 0.069 0.041 | 0.094 0.048 | 0.040 0.019 | 0.064 0.014 | 0.034 0.016 | 0.093 0.007 | 0.047 0.020 | 0.098 0.011 | 0.168 0.123 | 0.331 0.180 | 0.086 0.024 | 0.710 0.629 | 0.940 0.761 | 0.507 0.463 | 0.821 0.761 |
| Koop.-Subnet | 0.053 0.030 | 0.081 0.023 | 0.034 0.016 | 0.056 0.008 | 0.026 0.012 | 0.018 -0.039 | 0.066 0.005 | 0.051 -0.009 | 0.061 0.035 | 0.105 0.047 | 0.022 0.012 | -0.013 -0.028 | -0.003 -0.007 | 0.449 0.402 | 0.721 0.628 |
| CT-Subnet | 0.034 0.020 | 0.029 0.010 | 0.027 0.012 | 0.040 0.006 | 0.042 0.019 | 0.043 0.001 | 0.077 0.017 | 0.119 0.007 | 0.071 0.038 | 0.107 0.034 | 0.012 0.004 | -0.008 -0.021 | 0.000 -0.004 | 0.496 0.447 | 0.792 0.700 |
| MamKO | 0.045 0.027 | 0.064 0.032 | 0.021 0.010 | 0.031 0.004 | 0.031 0.019 | 0.023 -0.014 | 0.039 0.011 | 0.080 -0.121 | 0.083 0.043 | 0.152 0.052 | 0.089 0.041 | 0.402 0.356 | 0.360 0.296 | 0.689 0.607 | 1.787 1.391 |
Table 12. Bootstrap confidence intervals of the performance differences between SLiDE and baselines. The reported numbers represent the lower and upper bounds of the 95% confidence intervals.
Variability Across Random Seeds. To assess the stability of the evaluated methods, we report the standard deviation of performance across five random seeds for each baseline–dataset combination in Table 13.
| Model | NP MAE | NP MSE | PJM MAE | PJM MSE | EPEX BE MAE | EPEX BE MSE | EPEX FR MAE | EPEX FR MSE | EPEX DE MAE | EPEX DE MSE | Sales RMSLE | Multisine MAE | Multisine MSE | Transfer MAE | Transfer MSE |
| SLiDE | 0.210 ±0.002 | 0.167 ±0.003 | 0.157 ±0.003 | 0.064 ±0.004 | 0.231 ±0.001 | 0.367 ±0.003 | 0.169 ±0.003 | 0.329 ±0.003 | 0.265 ±0.002 | 0.182 ±0.003 | 0.419 ±0.002 | 0.085 ±0.001 | 0.012 ±0.000 | 0.296 ±0.010 | 0.139 ±0.010 |
| TimeXer | 0.220 ±0.002 | 0.186 ±0.005 | 0.154 ±0.001 | 0.060 ±0.001 | 0.230 ±0.001 | 0.367 ±0.003 | 0.169 ±0.003 | 0.347 ±0.006 | 0.265 ±0.002 | 0.213 ±0.003 | 0.005 ±0.002 | 0.001 ±0.001 | 0.004 ±0.004 | 0.273 ±0.004 | 0.004 ±0.004 |
| TSMixer | 0.219 ±0.004 | 0.184 ±0.004 | 0.158 ±0.001 | 0.063 ±0.001 | 0.235 ±0.004 | 0.335 ±0.007 | 0.001 ±0.005 | 0.331 ±0.006 | 0.283 ±0.002 | 0.218 ±0.003 | 0.422 ±0.005 | 0.001 ±0.004 | 0.001 ±0.001 | 0.541 ±0.004 | 0.480 ±0.169 |
| GCGNet | 0.220 ±0.006 | 0.177 ±0.011 | 0.157 ±0.003 | 0.065 ±0.003 | 0.252 ±0.014 | 0.367 ±0.017 | 0.189 ±0.005 | 0.320 ±0.017 | 0.285 ±0.005 | 0.206 ±0.007 | 0.482 ±0.002 | 0.220 ±0.004 | 0.086 ±0.092 | 0.448 ±0.040 | 0.322 ±0.040 |
| TiDE | 0.243 ±0.006 | 0.200 ±0.006 | 0.165 ±0.081 | 0.081 ±0.009 | 0.256 ±0.014 | 0.362 ±0.021 | 0.200 ±0.004 | 0.353 ±0.006 | 0.295 ±0.006 | 0.220 ±0.005 | 0.424 ±0.143 | 0.031 ±0.485 | 0.298 ±0.027 | 0.385 ±0.035 | |
| DLinear | 0.249 ±0.006 | 0.211 ±0.016 | 0.166 ±0.074 | 0.258 ±0.371 | 0.198 ±0.016 | 0.363 ±0.030 | 0.247 ±0.003 | 0.483 ±0.003 | 0.293 ±0.004 | 0.783 ±0.001 | 0.793 ±0.961 | 0.966 ±1.354 | 1.354 ±2.919 | 2.105 ±0.852 | |
| SKOLR | 0.264 ±0.001 | 0.237 ±0.001 | 0.185 ±0.003 | 0.097 ±0.002 | 0.256 ±0.002 | 0.405 ±0.002 | 0.201 ±0.003 | 0.372 ±0.003 | 0.410 ±0.006 | 0.432 ±0.006 | 0.478 ±0.007 | 0.754 ±0.008 | 0.862 ±0.004 | 0.782 ±0.005 | 0.929 ±0.013 |
| K.-Subnet | 0.251 ±0.007 | 0.214 ±0.010 | 0.181 ±0.003 | 0.089 ±0.002 | 0.250 ±0.003 | 0.360 ±0.003 | 0.196 ±0.004 | 0.345 ±0.011 | 0.312 ±0.004 | 0.257 ±0.008 | 0.438 ±0.007 | 0.064 ±0.005 | 0.007 ±0.001 | 0.721 ±0.040 | 0.815 ±0.088 |
| CT-Subnet | 0.237 ±0.002 | 0.185 ±0.007 | 0.175 ±0.002 | 0.082 ±0.004 | 0.260 ±0.008 | 0.391 ±0.008 | 0.208 ±0.017 | 0.375 ±0.004 | 0.318 ±0.004 | 0.247 ±0.004 | 0.428 ±0.003 | 0.070 ±0.007 | 0.010 ±0.002 | 0.767 ±0.002 | 0.885 ±0.005 |
| MamKO | 0.245 ±0.003 | 0.213 ±0.005 | 0.172 ±0.002 | 0.079 ±0.002 | 0.256 ±0.003 | 0.374 ±0.003 | 0.192 ±0.001 | 0.324 ±0.001 | 0.325 ±0.001 | 0.276 ±0.005 | 0.489 ±0.011 | 0.464 ±0.015 | 0.340 ±0.020 | 0.944 ±0.135 | 1.722 ±0.764 |
Table 13. Standard deviation of performance across five random seeds for each baseline and dataset. We report the population standard deviation, computed over the five runs. Lower values indicate greater stability across random seeds.
Extended related work
Deep Learning for forecasting with exogenous variables. Deep learning has become an important paradigm for time series forecasting, and explicitly incorporating exogenous variables to capture external drivers of temporal dynamics into neural forecasters remains an active research area. DeepAR represents an early recurrent approach that conditions probabilistic forecasts on past observations together with covariates [38]. Subsequent work has adopted transformer-based architectures for forecasting with exogenous information. The Temporal Fusion Transformer [27] introduced attention and gating mechanisms together with explicit handling of static and time-varying covariates. The TimeXer architecture [47] further explored transformer-based forecasting and includes covariates with a cross-attention mechanism. A parallel line of work explored simpler feedforward designs that remain competitive for forecasting with exogenous variables. The Time-series Dense Encoder (TiDE) [7] adopts a lightweight encoder–decoder formulation. TSMixer [5] is another all-MLP architecture that uses mixing operations across time and channels. N-BEATSx [33] extends the N-BEATS architecture [34] to forecasting with exogenous covariates. Recently, GCGNet [26] has been proposed as a generative, graph-based model that explicitly targets the future-known covariate setting. In contrast to attention-, graph-, and MLP-based approaches that primarily rely on flexible feature fusion, SLiDE imposes a constrained input-driven latent dynamics model, which we show improves accuracy and efficiency while promoting generalization under shifted input processes.
Koopman with inputs and controls. The Koopman operator is extensively used to describe dynamical systems. Some works within this community consider additional inputs, such as (Extended) Dynamic Mode Decomposition with control (DMDc/EDMDc) [36, 22] and Koopman-with-input formulations [37, 19]. These methods were developed primarily for system identification and control, where inputs are typically treated as observed, externally specified control or forcing signals and, in control applications, as directly manipulable. In contrast, forecasting applications involve exogenous variables that act as external drivers rather than controls and are often partially observed. Beyond classical approaches with hand-chosen lifting functions, a substantial body of work has studied learning Koopman observables directly from data using neural networks. Takeishi et al. [ [43] and Yeung et al. [2019] both learn nonlinear lifting functions and then fit linear dynamics in the lifted space. The first is more explicitly motivated by learning invariant subspaces for DMD and spectral analysis, while the second is framed as deep dictionary learning to avoid manually designing EDMD observables. Related deep operator learning approaches have also been proposed in molecular kinetics, including time-lagged autoencoders and VAMPnets [30, 48]. Lusch et al. [ [29] developed parsimonious, interpretable neural representations of Koopman eigenfunctions by embedding the dynamics on a low-dimensional manifold using an autoencoder architecture. A central difficulty is constructing or learning suitable lifted observables in the presence of inputs, particularly while preserving causal structure [40]. Recent neural system-identification approaches with inputs, such as Koopman-Subnet [16] and CT-Subnet [2], show that structured latent models can be effective for nonlinear dynamics. Adaptive Koopman-style architectures such as ManKО [25] use historical context to modulate latent operators, combining Koopman-inspired modeling with Mamba [10]. However, these methods are primarily motivated by system identification or control rather than multi-step forecasting with exogenous variables. Our work builds on Koopman-with-input formulations by shifting the emphasis from lifting construction to forecasting architecture. Treating the lift as a learnable component lets us focus on two key design questions for exogenous forecasting: how to reconstruct a forecast-start latent state from past context, and how to roll that state forward under future-known exogenous drivers. This yields a structured forecasting architecture that turns Koopman-inspired latent modeling into a practical multi-step prediction design.
Koopman-inspired forecasting and structured linear sequence models. Recent work has adapted the ideas from Koopman theory of learning a latent space in which nonlinear dynamics evolve approximately linearly for forecasting settings. Autoencoder architectures have been proposed to learn latent representations for Koopman-inspired sequential data forecasting [1]. Spectral approaches have likewise been explored for forecasting quasi-periodic dynamical systems [24]. The Koopman Neural Forecaster [46] is a Koopman-based architecture designed for time series that exhibit temporal distribution shifts. Koopa [28] addresses nonstationarity by decomposing time series into time-varying and time-invariant components. In parallel, renewed interest in linear recurrent dynamics provides a complementary perspective. Structured linear RNN models can match or exceed more complex recurrent baselines on long-context problems [35], while SKOLR [Zhang et al., 2025] provided an explicit connection between a linear recurrent architecture and Koopman theory. More broadly, state-space models such as S4 [11] and Mamba [10] show that structured latent linear dynamics can serve as highly effective sequence backbones. Hybrid approaches such as ManKО [25] further connect this state-space modeling perspective with Koopman-style latent operators. Unlike such general-purpose or control-oriented sequence models, SLiDE is designed specifically for exogenous multi-step forecasting. In particular, the Koopman forecasting and structured sequence models considered above do not jointly address the setting in which heterogeneous future-known exogenous covariates explicitly drive the latent dynamics throughout the forecast horizon.
References
- [1]Omri Azencot, N. Benjamin Erichson, Vanessa Lin, and Michael Mahoney. Forecasting Sequential Data Using Consistent Koopman Autoencoders. In Proceedings of the 37th International Conference on Machine Learning, volume 119, pages 475–485. PMLR, 2020.arxiv.org/abs/2003.02236
- [2]Gerben I. Beintema, Maarten Schoukens, and Roland Tóth. Continuous-time identification of dynamic state-space models by deep subspace encoding. In International Conference on Learning Representations, 2023.arxiv.org/abs/2204.09405
- [3]George E. P. Box, Gwilym M. Jenkins, Gregory C. Reinsel, and Greta M. Ljung. Time Series Analysis: Forecasting and Control. Wiley, 5th edition, 2015.
- [4]Steven L. Brunton, Marko Budišić, Eurika Kaiser, and J. Nathan Kutz. Modern Koopman Theory for Dynamical Systems. SIAM Review, 64(2):229–340, 2022. doi: 10.1137/21M1401234.arxiv.org/abs/2102.12086
- [5]Si-An Chen, Chun-Liang Li, Serkan Ö. Arık, Nathanael Christian Yoder, and Tomas Pfister. TSMixer: An All-MLP Architecture for Time Series Forecasting. Transactions on Machine Learning Research, 2023.arxiv.org/abs/2303.06053
- [6]Alexis Cook, DanB, inversion, and Ryan Holbrook. Store Sales - Time Series Forecasting. https://kaggle.com/competitions/store-sales-time-series-forecasting, 2021. Kaggle.
- [7]Abhimanyu Das, Weih ao Kong, Andrew Leach, Shaan K. Mathur, Rajat Sen, and Rose Yu. Long-term Forecasting with TiDE: Time-series Dense Encoder. Transactions on Machine Learning Research, 2023.arxiv.org/abs/2304.08424
- [8]Hadi Fanaee-T. Bike Sharing. UCI Machine Learning Repository (Dataset), 2013. doi: 10.24432/C5W894.
- [9]Robert Fildes, Shaohui Ma, and Stephan Kolassa. Retail forecasting: Research and practice. International Journal of Forecasting, 38(4):1283–1318, 2022. doi: 10.1016/j.ijforecast.2019.06.004.
- [10]Albert Gu and Tri Dao. Mamba: Linear-Time Sequence Modeling with Selective State Spaces. In First Conference on Language Modeling, 2024.arxiv.org/abs/2312.00752
- [11]Albert Gu, Karan Goel, and Christopher Ré. Efficiently Modeling Long Sequences with Structured State Spaces. In International Conference on Learning Representations, 2022.arxiv.org/abs/2111.00396
- [12]Hrayr Harutyunyan, Hrant Khachatrian, David C. Kale, Greg Ver Steeg, and Aram Galstyan. Multitask learning and benchmarking with clinical time series data. Scientific Data, 6(1):96, 2019. doi: 10.1038/s41597-019-0103-9.DOI
- [13]Julien Herzen, Francesco Lässig, Samuele Giuliano Piazzetta, Thomas Neuer, Léo Tafti, Guillaume Raille, Tomas Van Pottelbergh, Marek Pasieka, Andrzej Skrodzki, Nicolas Huguenin, Maxime Dumonal, Jan Kościsz, Dennis Bader, Frédéric Gusset, Mounir Benhedi, Camila Williamson, Michal Kosinski, Matej Petrik, and Gaël Grosch. Darts: User-Friendly Modern Machine Learning for Time Series. Journal of Machine Learning Research, 23(124):1–6, 2022.arxiv.org/abs/2110.03224
- [14]Tao Hong, Pierre Pinson, Yi Wang, Rafal Weron, Dazhi Yang, and Hamidreza Zareipour. Energy Forecasting: A Review and Outlook. IEEE Open Access Journal of Power and Energy, 7:376–388, 2020. doi: 10.1109/OAJPE.2020.3029979.DOI
- [15]Rob J. Hyndman and Yeasmin Khandakar. Automatic time series forecasting: the forecast package for R. Journal of Statistical Software, 27(3):1–22, 2008. doi: 10.18637/jss.v027.i03.DOI
- [16]Lucian Cristian Iacob, Gerben Izaak Beintema, Maarten Schoukens, and Roland Tóth. Deep Identification of Nonlinear Systems in Koopman Form. In 2021 60th IEEE Conference on Decision and Control (CDC), pages 2288–2293, 2021. doi: 10.1109/CDC45484.2021.9682946.DOI
- [17]Lucian Cristian Iacob, Roland Tóth, and Maarten Schoukens. Koopman form of nonlinear systems with inputs. Automatica, 162:111525, 2024. doi: 10.1016/j.automatica.2024.111525.DOI
- [19]Eurika Kaiser, J. Nathan Kutz, and Steven L. Brunton. Data-driven discovery of Koopman eigen-functions for control. Machine Learning: Science and Technology, 2(3):05023, 2021. doi: 10.1088/2632-2153/abf0f5.DOI
- [20]Taesung Kim, Jinhee Kim, Yunwon Tae, Cheonbok Park, Jang-Ho Choi, and Jaegul Choo. Reversible Instance Normalization for Accurate Time-Series Forecasting against Distribution Shift. In International Conference on Learning Representations, 2022.
- [21]B. O. Koopman. Hamiltonian Systems and Transformation in Hilbert Space. Proceedings of the National Academy of Sciences, 17(5):315–318, 1931. doi: 10.1073/pnas.17.5.315.DOI
- [22]Milan Korda and Igor Mezić. Linear predictors for nonlinear dynamical systems: Koopman operator meets model predictive control. Automatica, 93:149–160, 2018. doi: 10.1016/j.automatica.2018.03.046.DOI
- [23]Jesus Lago, Grzegorz Marcjasz, Bart De Schutter, and Rafal Weron. Forecasting day-ahead electricity prices: A review of state-of-the-art algorithms, best practices and an open-access benchmark. Applied Energy, 293:116983, 2021. doi: 10.1016/j.apenergy.2021.116983.DOI
- [24]Henning Lange, Steven L. Brunton, and J. Nathan Kutz. From Fourier to Koopman: Spectral Methods for Long-term Time Series Prediction. Journal of Machine Learning Research, 22(41):1–38, 2021.arxiv.org/abs/2004.00574
- [25]Zhaoyang Li, Minghao Han, and Xunyuan Yin. MamKO: Mamba-based Koopman operator for modeling and predictive control. In International Conference on Learning Representations, 2025.
- [26]Zhengyu Li, Xiangfei Qiu, Yuhan Zhu, Xingjian Wu, Jilin Hu, Chenjuan Guo, and Bin Yang. GCGNet: Graph-Consistent Generative Network for Time Series Forecasting with Exogenous Variables. In International Conference on Learning Representations, 2026.arxiv.org/abs/2603.08032
- [27]Bryan Lim, Sercan Ö. Arık, Nicolas Loeff, and Tomas Pfister. Temporal Fusion Transformers for interpretable multi-horizon time series forecasting. International Journal of Forecasting, 37(4):1748–1764, 2021. doi: 10.1016/j.ijforecast.2021.03.012.DOI
- [28]Yong Liu, Chenyu Li, Jianmin Wang, and Mingsheng Long. Koopa: Learning Non-stationary Time Series Dynamics with Koopman Predictors. Advances in Neural Information Processing Systems, 36:12271–12290, 2023. doi: 10.52202/075280-0538.DOI
- [29]Bethany Lusch, J. Nathan Kutz, and Steven L. Brunton. Deep learning for universal linear embeddings of nonlinear dynamics. Nature Communications, 9(1):4950, 2018. doi: 10.1038/s41467-018-07210-0.DOI
- [30]Andreas Mardt, Luca Pasquali, Hao Wu, and Frank Noé. VAMPnets for deep learning of molecular kinetics. Nature Communications, 9(1):5, 2018. doi: 10.1038/s41467-017-02388-1.DOI
- [31]Jean-Philippe Noël and Maarten Schoukens. Hysteretic Benchmark with a Dynamic Nonlinearity. 4TU.ResearchData, Version 1 (Dataset), 2020. doi: 10.4121/12967592.v1.DOI
- [32]Kin G. Olivares, Cristian Challú, Azul Garza, Max Mergenthaler Canseco, and Artur Dubrawski. NeuralForecast: User friendly state-of-the-art neural forecasting models. Pp: Salt Lake City, Utah, US 2022, 2022. URL https://github.com/Nixtla/neuralforecast.
- [33]Kin G. Olivares, Cristian Challu, Grzegorz Marcjasz, Rafal Weron, and Artur Dubrawski. Neural basis expansion analysis with exogenous variables: Forecasting electricity prices with NBEATSx. International Journal of Forecasting, 39(2):884–900, 2023. doi: 10.1016/j.ijforecast.2022.03.001.DOI
- [34]Boris N. Oreshkin, Dmitri Carpov, Nicolas Chapados, and Yoshua Bengio. N-BEATS: Neural basis expansion analysis for interpretable time series forecasting. In International Conference on Learning Representations, 2020.arxiv.org/abs/1905.10437
- [35]Antonio Orvieto, Samuel L. Smith, Albert Gu, Anushan Fernando, Caglar Gulcehre, Razvan Pascanu, and Soham De. Resurrecting Recurrent Neural Networks for Long Sequences. In Proceedings of the 40th International Conference on Machine Learning, volume 202, pages 26670–26698. PMLR, 2023.arxiv.org/abs/2303.06349
- [36]Joshua L. Proctor, Steven L. Brunton, and J. Nathan Kutz. Dynamic Mode Decomposition with Control. SIAM Journal on Applied Dynamical Systems, 15(1):142–161, 2016. doi: 10.1137/15M1013857.DOI
- [37]Joshua L. Proctor, Steven L. Brunton, and J. Nathan Kutz. Generalizing Koopman Theory to Allow for Inputs and Control. SIAM Journal on Applied Dynamical Systems, 17(1):909–930, 2018. doi: 10.1137/16M1062296.
- [38]David Salinas, Valentin Flunkert, Jan Gasthaus, and Tim Januschowski. DeepAR: Probabilistic forecasting with autoregressive recurrent networks. International Journal of Forecasting, 36(3):1181–1191, 2020. doi: 10.1016/j.ijforecast.2019.07.001.DOI
- [39]M. Schoukens and J. P. Noël. Three Benchmarks Addressing Open Challenges in Nonlinear System Identification. IFAC-PapersOnLine, 50(1):446–451, 2017. doi: 10.1016/j.ifacol.2017.08.071.
- [40]Nicholas S. Selby and H. Harry Asada. Learning of Causal Observable Functions for Koopman-DFL Lifting Linearization of Nonlinear Controlled Systems and Its Application to Excavation Automation. IEEE Robotics and Automation Letters, 6(4):6297–6304, 2021. doi: 10.1109/LRA.2021.3092256.
- [41]Oleksandr Schur, Abdul Fatir Ansari, Caner Turkmen, Lorenzo Stella, Nick Erickson, Pablo Guerron, Michael Bohlke-Schneider, and Yuyang Wang. Fev-bench: A Realistic Benchmark for Time Series Forecasting. arXiv preprint: arXiv:2509.26468, 2025.
- [42]James H. Stock and Mark W. Watson. Forecasting Output and Inflation: The Role of Asset Prices. Journal of Economic Literature, 41(3):788–829, 2003. doi: 10.1257/002205103322436197.DOI
- [43]Naoya Takeishi, Yoshinobu Kawahara, and Takehisa Yairi. Learning Koopman Invariant Subspaces for Dynamic Mode Decomposition. In Advances in Neural Information Processing Systems, volume 30, pages 1130–1140, 2017.
- [44]Julius Trebbien, Leonardo Rydin Görjão, Aaron Praktiknjo, Benjamin Schäfer, and Dirk Witthaut. Understanding electricity prices beyond the merit order principle using explainable AI. Energy and AI, 13:100250, 2023. doi: 10.1016/j.egyai.2023.100250.
- [45]Eleni I. Vlahogianni, Matthew G. Karlaftis, and John C. Golias. Short-term traffic forecasting: Where we are and where we’re going. Transportation Research Part C: Emerging Technologies, 43:3–19, 2014. doi: 10.1016/j.trc.2014.01.005.
- [46]Rui Wang, Yihe Dong, Sercan Ö. Arık, and Rose Yu. Koopman Neural Operator Forecaster for Time-series with Temporal Distributional Shifts. In International Conference on Learning Representations, 2023.
- [47]Yuxuan Wang, Haixu Wu, Jiaxiang Dong, Guo Qin, Haoran Zhang, Yong Liu, Yun-Zhong Qiu, Jianmin Wang, and Mingsheng Long. TimeXer: Empowering Transformers for Time Series Forecasting with Exogenous Variables. In Advances in Neural Information Processing Systems, volume 37, 2024. doi: 10.52202/079017-0015.
- [48]Christoph Wehmeyer and Frank Noé. Time-lagged autoencoders: Deep learning of slow collective variables for molecular kinetics. The Journal of Chemical Physics, 148(24):241703, 2018. doi: 10.1063/1.5011399.
- [49]Rafal Weron. Electricity price forecasting: A review of the state-of-the-art with a look into the future. International Journal of Forecasting, 30(4):1030–1081, 2014. doi: 10.1016/j.ijforecast.2014.08.008.







