WorksEngineering
Data-driven control of polynomial systems using implicit methods
Abstract
While conventional behavioral data-driven control represents linear time-invariant (LTI) systems directly from data, extending these data representations to nonlinear systems remains an open challenge. We address this gap for general polynomial systems, characterizing their finite-length trajectories as a real algebraic variety defined by implicit polynomial relations rather than explicit equations. First, we provide conditions on measured data under which these data can be used to represent the system. Building on this representation, we formulate data-driven simulation and predictive control problems that are equivalent to their model-based counterparts, and solve the resulting polynomial systems globally using homotopy continuation. Numerical case studies confirm the effectiveness of this approach by successfully simulating a stiff Van der Pol oscillator in situations where explicit models fail. Furthermore, these data-driven simulation and control methods are illustrated on a Duffing oscillator, demonstrating that our method outperforms Koopman-based approaches in predicting long trajectories.
Introduction
Data-driven predictive control based on behavioral systems theory has become popular for linear systems [10, 6, 13]. The behavioral approach describes a system by the set of its trajectories rather than by a particular representation through equations. For linear time-invariant (LTI) systems, the set of trajectories is a subspace, and this geometric viewpoint allows for a direct data representation of the behavior by the Fundamental Lemma [44, 28]. For nonlinear systems, the set of trajectories is not a linear subspace, and extending such direct data representations is an open problem, as also highlighted in the reviews by Markovsky and Dörfler [27]; Berberich and Allgöwer [5]. In this work, we focus on polynomial systems, for which this set is a real algebraic variety, and we show that it can be represented directly by data, enabling data-driven simulation and control.
Related work: in the data-driven control literature, nonlinear systems are often described by explicit models in discrete-time, such as nonlinear state-space or nonlinear ARX (NARX) equations [32, 12, 8]. While powerful, these explicit descriptions treat variables asymmetrically by isolating the future state or output, which often fails to capture the nonlinear geometry of the system. On the other hand, the behavioral approach preserves the geometric structure by treating all variables symmetrically, enabling implicit descriptions, see § 2.1 for an illustration. Data-driven methods inspired by the Fundamental Lemma have also been extended to nonlinear systems [5]. Many of these extensions are restricted to specific system classes, such as Volterra [38], Hammerstein and Wiener (Berberich and Allgöwer, 2020), or generalized bilinear systems [26], while others address general nonlinear systems through NARX models [34, 15], basis functions [24], kernel methods [20], or local linearization [7]. Most importantly, all these methods rely on explicit equations, which forgoes the main advantage of the geometric, representation-free viewpoint.
Koopman operator methods lift the state by a dictionary of observables and fit a linear model in the lifted space [45, 23, 33]. This general framework is suitable for describing implicit relations in the data. In practice, however, the lifted state is propagated by the linear model and mapped back to the state by a linear decoder [33], so nonlinear relations between the observables are typically lost along the prediction. Reprojection onto the set of lifted states restores this consistency [42, 33], but the predictions remain approximate unless the observables span a Koopman-invariant subspace, which can be infinite-dimensional even for polynomial dynamics.
Beyond data-driven control, relevant approaches also exist in the learning and system identification literature. For instance, the SINDy framework identifies nonlinear dynamics by regressing the time derivative of the state on a library of candidate functions with sparse coefficients [9]. While Mangan et al. [25]; Kaheman et al. [21] propose implicit variants of the SINDy algorithm, they aim at identifying continuous-time dynamics, and therefore require measuring or estimating time derivatives, which can be restrictive. This same limitation applies to Guo et al. [17]; Huang et al. [19] that design controllers for continuous-time polynomial systems via sum-of-squares programs. Finally, manifold learning methods also exploit that the data lie on a low-dimensional manifold, learned together with the dynamics on it [16] or via a diffusion model [22], but these approximations lack conditions on the data that guarantee an exact representation.
Contributions: our approach overcomes the limitations of the existing works by characterizing implicit relations between the variables. We represent these relations directly by data, and solve the resulting polynomial equations instead of relying on linear methods. Specifically, our contributions are as follows.
We motivate implicit data-driven methods through the example of simulating continuous-time systems from sampled data, and propose a pragmatic implicit behavioral description for polynomial systems, defined by the zero set of multiple, multivariate polynomials.
We provide conditions on the data (akin to the generalized persistency of excitation for LTI systems) enabling a direct data representation of polynomial behaviors with bounded degree. This presents a distinct challenge compared to the LTI case, as not only the defining equations but also their polynomial multiples vanish on the data, so the relevant object is a polynomial ideal rather than a subspace.
We propose computable data-driven simulation and predictive control methods based on the data representation, which are equivalent to their counterparts with known behavior under these conditions. These problems lead to polynomial systems of equations, which we solve globally with homotopy continuation (as in Rostalski et al. [37] for the model-based case).
We illustrate the data-driven simulation and control methods on a Duffing oscillator, showing superior prediction accuracy compared to Koopman based schemes. Further, we confirm the benefits of implicit descriptions over explicit models numerically on a Van der Pol oscillator.
Outline: Section 2 motivates implicit models and defines polynomial behaviors. Section 3 derives the direct data representation, which Section 4 uses for data-driven simulation and control. Section 5 contains the numerical case studies, and Section 6 concludes the paper.
Notation: let , , and denote the sets of real numbers, integers, and positive integers, respectively. For a matrix , we denote its rank, image and null space by , and , respectively. Let denote the polynomial ring in variables , and the polynomials of degree at most . An ideal is a set of polynomials that satisfies $0 \in I, , , and for all and all . For an ideal of , let .
Given polynomials , , we denote the ideal generated by them as
For any set in , denotes the vanishing ideal of consisting of all polynomials that vanish on , i.e., . Conversely, for any set of polynomials in , denotes the common zeros of , i.e., .
Polynomial behaviors
In this paper, we consider simulation and control of discrete-time nonlinear systems. To do this, we will first define the class of systems we consider in a precise manner. We approach this problem geometrically, which will allow us to capture important effects by encompassing implicit models, naturally generalize the linear case, and will enable a range of computationally feasible simulation and control methods.
On implicit models
Physical systems are typically described by continuous-time dynamics, for example
for autonomous systems, where is the state and is a nonlinear function. The function often takes a simple, e.g., polynomial or trigonometric form in practical applications.
Data-driven methods, on the other hand, work with discrete data sampled every seconds, i.e., . Data-driven simulation aims at identifying the discrete relations , where is the solution map of (1) over one sampling period. However, rarely has a closed form and is typically more complex than itself. Indeed, approximating is non-trivial even when is known, which is the subject of numerical integration. Data-driven simulation and numerical integration (with a fixed step size) thus address the same question in a data-based and a model-based setting, respectively, and we draw on the latter to guide the design of the former.
Numerical integration methods are typically categorized as explicit or implicit, taking the form
respectively. Although implicit methods are computationally more expensive per step because finding requires solving a nonlinear equation, their superior stability often permits much larger step sizes. This is crucial for stiff systems, where explicit methods require prohibitively small steps for stability, while implicit methods allow step sizes based purely on accuracy ([18]). The reason for this is that the implicit model class is strictly larger than the explicit (one can always pick ). For example, for polynomial , implicit integration schemes like the implicit Euler or trapezoidal rules induce the richer, algebraic explicit map required for stability, whereas explicit methods merely produce a polynomial map .
Motivated by these observations, instead of explicit methods based on, e.g., nonlinear ARX models, we adopt the behavioral point of view that treats all variables symmetrically and defines a system by implicit relations between these variables. The numerical case study in § 7.1 validates this choice, demonstrating that an implicit data-driven behavioral method successfully simulates a stiff system where an explicit model trained on the same data fails.
Generalizing linear systems
In contrast to starting from a nonlinear set of defining difference equations, the behavioral approach views systems as subsets of the space of all trajectories. More specifically, the vast majority of methods consider only linear systems, which correspond to subspaces, or equivalently, to the zero set of linear equations. From the perspective of real algebraic geometry, the natural generalization of this is to consider systems described by zero sets of higher-order equations: real algebraic varieties.
In mathematical terms, we consider signals , which are -variate signals collecting all variables of interest such as inputs, outputs, or states of the system. The behavioral setting imposes no a priori input/output partition and treats all variables symmetrically, which makes it well suited for the modeling of implicit relations in the data, see § 2.1. In the behavioral setting a discrete-time system is identified with a set of possible trajectories . In this paper, we consider complete systems with lag (cf. [43]), which are also time-invariant, that is, for any valid trajectory of , any time-shift of the trajectory is also in .
To enable data-based methods, we need to make further assumptions on the set of allowed systems, or model class. For this, we first define the restricted behavior as
For time-invariant systems, this is the set of all length- windows of trajectories . As our main goal is to propose computable data-driven simulation and control methods, we now define polynomial systems through their restricted behaviors (cf. [43 Proposition II.6]). Instead of assuming that the system is linear, i.e., that is a subspace, we will consider systems defined by the zero set of a set of polynomials, i.e., an algebraic variety, as formalized below.
Assumption 1 For any , there exists a number and a set of multivariate finite degree polynomials , such that is the zero set
We then call a polynomial behavior. Note that, while an arbitrary set of polynomials can define a behavior (see Appendix § 9), not every such set constitutes a valid restricted behavior as in Assumption 1. Characterizing whether a given set yields a well-posed system, such as having feasible initial conditions, unique solutions, causality, or even admitting real trajectories, is beyond the scope of the present paper.
The behavioral description (3) includes linear time-invariant systems, bilinear systems, as well as nonlinear input/output models with polynomial nonlinearities. Moreover, since may also contain the state of the system, any state-space system with polynomial dynamics and output equation falls into the class of systems defined in this way. In technical terms, the generating set (3) is a real algebraic variety. Next, we focus on deriving a direct data representation for from Assumption 1 and applying it to data-driven simulation and control. To keep the presentation self-contained, we introduce only the algebraic geometry concepts necessary for this task, referring the reader to Appendix § 10 for additional details.
Direct data representation
Inspired by behavioral systems theory for LTI systems, we now investigate how the restricted polynomial behavior in (3) can be represented directly by data. We choose a dictionary consisting of polynomials up to degree . Assume we measure data trajectories , (either windows of a single trajectory, or separate trajectories) and construct the lifted data matrix
For LTI systems, the dictionary contains only linear functions, so that is a trajectory (or Hankel) matrix. For sufficiently rich data, its image is the restricted LTI behavior, while a suitable basis of provides the coefficients of an ARX model (see Example 3). We now focus on the conditions guaranteeing that provides a direct data representation of the polynomial behavior .
Problem 1 Given data from defined as in Assumption 1, find conditions on the dictionary and the data such that any can be expressed in terms of .
The solution for this problem is well established for LTI behaviors (Willems et al. [44]). However, a new difficulty arises when polynomial behaviors are considered. Namely, in addition to the defining polynomials in (3), all polynomials in the form with vanish on the data , cf. Example 2 below. Therefore, we provide a direct data representation for through the vanishing ideal instead of the defining polynomials . In case the defining polynomials are given, the vanishing ideal can be expressed using the real radical, see Appendix § 10 for details.
Conditions on the dictionary
One could naively think that the dictionary degree has to be at least as large as the maximal degree of defining in (3). However, this is not necessary, as we illustrate on an example below. Instead, we define the minimal degree of a polynomial behavior as
In words, is the minimum degree, such that the polynomials with degree at most vanishing on generate all polynomials vanishing on . We illustrate the concept on an example.
Example 1. Consider the Duffing oscillator also used in Mezić et al. [33]; Rostalski et al. [37]
with state and input . The implicit trapezoidal rule with step yields the discrete-time dynamics defined by two polynomials and of degree 1 and 3 in the length-2 trajectory with . Thus, and is a representation of in (3). In this case, as the ideal is real radical (cf. Appendix § 10). As no polynomials of smaller degree can generate , we have that . In fact, for any , as each time shift can be described by and . Alternative representations of the same include or , which are of larger degrees, 4 and 6, respectively. The real zero set of these polynomials coincide with that of , but their degree is not minimal.
To formulate the condition on the dictionary, note that is a linear subspace of and the dimension is the number of monomials: . Further, any ideal and set are linear subspaces, as they are closed under addition and multiplication by constants.
Assumption 2. Suppose , , and let be a basis for .
Assumption 2 ensures that the considered dictionary is sufficiently rich to explain . Then, the lifted data matrix describes , i.e., the set of all polynomials in that vanish on the data, as formalized below.
Lemma 1. Let Assumptions 1 and 2 hold. Then, , and this subspace has dimension . Furthermore, .
Proof. Consider any . By definition, for any . Since is a basis for , can describe any polynomial in , and thus, the claim holds. Moreover, the set inclusion holds since implies for all .
Next, we investigate the condition on the data formulated in terms of subspace dimensions.
Conditions on the data
As we established, the nullspace of represents all polynomials in vanishing on the data, and (for noise-free data) these include any polynomial vanishing on . However, there might be more polynomials that vanish on the data than on when the data are not rich enough. Therefore, the condition on the data is that the set equals the set represented by . As the sets are linear subspaces of , this condition can be expressed by their dimensions.
Assumption 3 .
Assumption 3 can be written equivalently as , and implies that at least trajectories are required. The number in Assumption 3 grows with , so a richer dictionary requires more data. In case the generators in (3) are known, can be calculated by first computing the real radical of , e.g., with the algorithm of Becker and Neuhaus [3], and then a Gröbner basis of it, see Appendix § 10 and Cox et al. [11]. Under Assumptions 2 and 3, the behavior can be fully described by the lifted data matrix as formalized next.
Lemma 2 Let Assumptions 1, 2, and 3 hold, and consider the lifted data matrix . Then, a trajectory if and only if .
Proof. By Assumption 3, the inclusion in Lemma 1 is tight: . If , then for all by Lemma 1. Thus, , where the second equality holds as , and the set inclusion holds as . Conversely, if , then for all , which holds iff by Lemma 1.
Example 2
Example 2 Consider again the Duffing oscillator from Example 1 over a two-step horizon. For Assumption 2 to hold, we need . Let us pick the minimal degree . Then, the polynomials in the set are and for any (including the constant). As , we have that , and Assumption 3 requires to be of rank , which is the maximal rank can have. Importantly, the direct data representation of contains 29 polynomials, instead of and only.
Example 3
Example 3 (Linear and affine systems) The considered setting with recovers affine systems, whose restricted behavior is an affine subspace (Padoan et al. [35, 36]). LTI behaviors can be recovered by removing the constant term from the dictionary, i.e., . Then, becomes a trajectory or Hankel matrix. A linear form vanishes on if and only if , so the linear forms in form a subspace of dimension for , where is the number of inputs and is the order. For instance, can be chosen as the coefficients of an ARX model. Assumption 3 then reads , which is the generalized persistency of excitation condition (Markovsky and Dörfler [28]), and Lemma 2 states that if and only if , which is the Fundamental Lemma (Willems et al. [44]).
Remark 1 (Noisy data) If the data are noisy, typically has full rank, i.e., . We then estimate by computing the SVD of and keeping the singular vectors of the largest singular values. The orthogonal complement of this truncated space then gives polynomials that approximately vanish on the data. Since the true rank in Assumption 3 is unknown in practice, is a tuning criterion. parameter. The truncation is optimal if the noise is additive on with i.i.d. zero-mean Gaussian entries, as it yields the best rank- approximation of ([14]). However, noise on the trajectories enters through the monomials, making the noise on structured and not zero-mean. The SVD ignores this structure, which biases the estimate. The adjusted least squares method ([30, 41]) corrects this bias and yields a consistent estimate.
Data-driven simulation and control
Now we use the direct data representation of the restricted behavior in Lemma 2 to formulate the data-driven simulation and control problems without identifying a parametric model first.
Data-driven simulation
Simulation amounts to computing the response of a system to a given input and initial condition ([29]). To formalize this, we partition into inputs and outputs , and into an initial part of length specifying the initial condition, and a future part of length with inputs and outputs . With this partitioning, we structure the entire trajectory as , where a suitable row permutation is omitted. Note that may also be the state of the system, in which case a single sample suffices to specify the initial condition, i.e., .
Problem 2 (Simulation) Given , , and , find such that .
As is unknown, we apply Lemma 2 to express the condition by a system of polynomial equations through a basis of , leading to an equivalent data-driven simulation problem.
Theorem 3 (Data-driven simulation) Let Assumptions 1, 2, and 3 hold. Then, for any and , Problem 2 has the same solutions as the data-driven simulation problem
Proof if and only if , which is equivalent to by Lemma 2.
Since provides an implicit description of the dynamics, Problem 2, and hence (4), may have multiple solutions, similar to implicit numerical integrators in § 2.1. The appropriate solution then has to be selected, e.g., based on physical meaning or consistency with the past trajectory.
Remark 2 (Image formulation with regularization) Another common method to deal with noise in data-driven control is using the image of the lifted data matrix (i.e. writing for some in this setting) and adding regularization. With a 2-norm regularizer the problem is still polynomial but now both in and . Thus, the number of unknowns increases limiting practical applicability. However, since enters quadratically, it can be eliminated in closed form as in Sasfi et al. [39, 40], which leads to a formulation with a cost that is quadratic in . The problem can be solved through its KKT conditions, but these form a polynomial system of degree , which is more expensive to solve than the degree- kernel representation.
Data-driven predictive control
In predictive control, a finite-horizon optimal control problem is solved at every time step, and only the first optimal input is applied to the system. With the partitioning of § 6.1, contains the most recent measurements, and the future inputs and outputs are the decision variables. Following Rostalski et al. [37], we consider a polynomial cost and polynomial inequality constraints . A typical choice is the quadratic tracking cost with reference and weights , .
Problem 3 (Predictive control) Given and , solve
As in § 6.1, applying Lemma 2 to Problem 3 leads to an equivalent data-driven formulation.
Theorem 4 (Data-driven predictive control) Let Assumptions 1, 2, and 3 hold. Then, for any , , and , Problem 3 has the same solutions as the data-driven predictive control problem
Proof Similarly to Theorem 3, the statement is a direct consequence of Lemma 2.
Solving the simulation and control problems
The data-driven simulation problem (4) is a system of polynomial equations in , which can be solved approximately with Newton-type methods or, for smaller systems, to global optimality with homotopy continuation [2]. The data-driven control problem (5) is a non-convex polynomial optimization problem, which can be solved locally, e.g., by sequential quadratic programming. Instead, we reformulate (5) as a system of polynomial equations via its KKT conditions, as done by Rostalski et al. [37] in the model-based case. Under suitable constraint qualifications, every local minimizer satisfies
for some multipliers and , where and denote the gradient and the Jacobian with respect to . Among the real solutions of (6), the one with the lowest cost is the global minimizer. Since and enter (6) only as parameters, the system can be solved offline for generic parameter values, and only the paths starting at these solutions need to be tracked online [37]. Note, however, that the computational cost of homotopy continuation grows exponentially with the number of unknowns, making it intractable for large horizons. As a remedy, one can apply the data representation recursively, with the minimal , so that the computational cost grows linearly with the horizon.
Remark 3 (Homotopy continuation with redundant constraints) Homotopy continuation computes all isolated solutions of a square polynomial system, i.e., one with as many equations as unknowns [2]. Since the constraints are highly redundant, problem (4) is overdetermined, and the solutions of (6) are not isolated, as the multipliers are not unique. Homotopy continuation methods typically resolve this issue by replacing by , where is a randomly chosen matrix that makes the system square. Every solution of also solves , but one needs to check the feasibility of the computed solutions on the original constraint . Instead of a random matrix, it is often preferable to minimize rather than seeking an exact solution (see Remarks 1 and 2). A practical choice for is then the Jacobian , as for the minimizer. The Jacobian can be evaluated at a relevant reference point, such as the most recent measurement of or the control target.
Numerical case studies
We illustrate the proposed methods on two benchmark nonlinear systems below. All computations were carried out using Matlab, on a Lenovo ThinkPad X1 Carbon Gen 10 laptop with 12th Gen Intel i7-1260P 16 CPU running Ubuntu 22.04.1 LTS. The polynomial systems are solved with Bertini (Bates et al.). As outlined in Remark 3, we square the system using the Jacobian evaluated at the current state or the origin for control, and retain the solution with the smallest residual. The code reproducing the results is available at https://gitlab.ethz.ch/asasfi/polynomial_behaviors.
Van der Pol oscillator
We consider the Van der Pol oscillator
where increasing the parameter increases the stiffness of the system. We assume that the system is unknown and that its state is measured with sampling time . We use windows of length and monomials up to degree . The data are 6 noise-free trajectories of 1000 samples from initial states simulated with the stiff solver, ode15s, which is considered to be the true continuous-time trajectory.
Since the true trajectory does not satisfy polynomial relations up to degree 3 exactly, we compute from the truncated SVD of (Remark 1). The rank is selected manually as , since there is a visible drop in the singular values of at that value. The prediction is then computed recursively by solving (4) starting always from the last predicted state. As a benchmark, we identify an explicit model (cf. § 2.1), where minimizes the sum of over the state pairs used to build . The behavioral method takes about 20 ms per prediction step, whereas the explicit model takes less than 0.1 ms.
We test the methods on a simulation task for 300 steps starting from the initial condition . As shown in Figure 1, the behavioral method stays close to the true trajectory throughout the prediction for both and . In contrast, the explicit model only captures the qualitative shape of the limit cycle for with a significant offset, and does not produce a meaningful prediction for the stiffer system with . Note that the explicit Euler and Runge–Kutta 4 numerical integration methods on the same task become unstable for and , respectively.
Figure 1. Van der Pol oscillator trajectories for (left) and (right), showing predictions over 300 steps starting from the initial state (yellow square). The true trajectory is the black line, the behavioral method is in orange, and the explicit benchmark is in yellow.
Duffing oscillator
Next, we consider the forced Duffing oscillator from Mezić et al. [33]
with the parameters , and , see Figure 3 for the phase portrait. The input and the state are measured with sampling time , and we use zero-order hold between the samples for . We adopt the code accompanying Mezić et al. [33] and use the data from their example to construct . As for the Van der Pol oscillator, no polynomial relation holds exactly between the samples, and we compute from the truncated SVD of (Remark 1) in all experiments, also for noise-free data.
Figure 3. Duffing oscillator under the proposed controller starting from (yellow square). Unlike the free response (dotted), the closed-loop trajectory (orange) crosses the dashed separatrix from the basin of to stabilize at the saddle at . The background shows the unforced phase portrait and the basins of attraction for the stable equilibria (filled circles).
Simulation
We set with and degree (matching the polynomial lift of Mezić et al. [33]) giving . The singular values of decay without a visible gap, but the predictions are not sensitive to the choice of for a large interval in the noise-free case, and we pick from this interval. The 150 steps long test trajectory from Mezić et al. [33] is predicted by solving (4) recursively, starting from the last predicted state (75 solves). The predictions of various Koopman
models from Mezić et al. [33], trained on the same data, are shown in Figure 2 (left). Our prediction overlaps with the true trajectory, whereas the Koopman predictions drift away. This is likely because the Koopman models propagate the lifted state linearly, without enforcing that remains in the range of the lifting. In contrast, our method solves the identified implicit polynomial relations directly, at the price of increased computational load.
Figure 2. Predictions for the Duffing oscillator starting from initial state (yellow square). Black lines denote the true trajectory, while markers connected by dotted lines represent the behavioral method. Left: Exact data test case from Mezić et al. [33], comparing the behavioral method (orange) against different Koopman models with polynomial lift trained on the same data (linear – blue, bilinear – green, GeKo – red, and KCF – magenta). Right: Predictions under noise using the behavioral method with different truncations (orange circles), (yellow squares), and (blue diamonds).
Next, we add zero-mean Gaussian noise with standard deviation to the state data and to the initial state. We also use a more demanding test case, in which the input drives the state from the stable equilibrium to the other basin of attraction. Figure 2 (right) shows the predictions of our method for three different truncated ranks. The best truncation is at providing virtually zero error, whereas tracks the true trajectory with larger error. The trajectory produced by truncation at attains a very large error, although the shape resembles that of the true trajectory.
Control
We regulate the oscillator to the saddle at the origin with the data-driven predictive controller (5), using and . To keep the offline computation tractable, we reduce the degree to () and choose . The offline solve takes about 10 minutes, and the online computations about 0.07 s per time step. Figure 3 shows the closed loop from . Without control, the state converges to , but the controller steers the state across the separatrix to the other basin of attraction and then stabilizes at the origin.
Conclusion
We extended direct data representations from LTI to polynomial behaviors by describing their finite-length trajectories as a real algebraic variety. We provided conditions on the data so that the behavior has a direct data representation. This implicit description leads to data-driven simulation and control problems that can be solved globally with homotopy continuation. The proposed methods and their benefits over existing schemes were illustrated on benchmark nonlinear case studies. Future work includes provable robustness to noisy data and solution methods that scale to long horizons.
Appendix A
Here we detail the remark after Assumption 1, namely that an arbitrary set of polynomials defines a behavior, but need not describe its restricted behavior. Let and consider a generating set
where are multivariate finite degree polynomials. Any such set defines a behavior as
Most notably, the generating set is not unique, as different sets can give rise to the same system. By definition, the restricted behavior in (2) of this system satisfies for any generating set, but the inclusion can be strict, since may contain windows that do not extend to a trajectory of . If is itself the zero set of polynomials, as required by Assumption 1, then is the smallest generating set of and thus a canonical choice.
Appendix B
Let be an ideal of . The real radical of is defined as
and is called real radical if . Intuitively, collects every polynomial that is implied by the equations in on real points. For example, consider a system described by two polynomials and . The three ideals , , and are different, as , but , and , but . On the other hand, they all have the same real radical, i.e., . Thus, is a real radical ideal, but and are not.
The real Nullstellensatz (see, e.g., Marshall [31]) relates the real radical to the vanishing ideal.
Lemma 5 (Real Nullstellensatz) Let be an ideal of . Then, .
Applied to from (3), the lemma gives
This result allows us to obtain the vanishing ideal from any set of polynomials representing in (3) by computing the real radical.
References
- [2]Daniel J. Bates, Jonathan D. Hauenstein, Andrew J. Sommese, and Charles W. Wampler. Numerically Solving Polynomial Systems with Bertini, volume 25 of Software, Environments, and Tools. SIAM, 2013. doi: 10.1137/1.9781611972702.DOI
- [3]Eberhard Becker and Rolf Neuhaus. Computation of real radicals of polynomial ideals. In Frédéric Eyssette and André Galligo, editors, Computational Algebraic Geometry, Progress in Mathematics, pages 1–20. Birkhäuser, 1993.DOI
- [5]Julian Berberich and Frank Allgöwer. An overview of systems-theoretic guarantees in data-driven model predictive control. Annual Review of Control, Robotics, and Autonomous Systems, 8, 2025.DOI
- [6]Julian Berberich, Johannes Köhler, Matthias A. Müller, and Frank Allgöwer. Data-driven model predictive control with stability and robustness guarantees. IEEE Trans. Automatic Control, 66 (4):1702–1717, 2020.DOI
- [7]Julian Berberich, Johannes Köhler, Matthias A. Müller, and Frank Allgöwer. Linear tracking MPC for nonlinear systems—Part II: The data-driven case. IEEE Transactions on Automatic Control, 67(9):4406–4421, 2022.DOI
- [8]Fabio Bonassi, Jing Xie, Marcello Farina, and Riccardo Scattolini. An offset-free nonlinear MPC scheme for systems learned by neural NARX models. In Proc. 61st IEEE Conference on Decision and Control, pages 2123–2128, 2022. doi: 10.1109/CDC51059.2022.9992362.DOI
- [9]Steven L. Brunton, Joshua L. Proctor, and J. Nathan Kutz. Discovering governing equations from data by sparse identification of nonlinear dynamical systems. Proceedings of the National Academy of Sciences, 113(15):3932–3937, 2016. doi: 10.1073/pnas.1517384113.DOI
- [10]Jeremy Coulson, John Lygeros, and Florian Dörfler. Data-enabled predictive control: In the shallows of the DeePC. In Proc. 18th European Control Conference, pages 307–312. IEEE, 2019.arxiv.org/abs/1811.05890
- [11]David A. Cox, John Little, and Donal O’Shea. Ideals, Varieties, and Algorithms: An Introduction to Computational Algebraic Geometry and Commutative Algebra. Undergraduate Texts in Mathematics. Springer, 4th edition, 2015.
- [12]Claudio De Persis, Monica Rotulo, and Pietro Tesi. Learning controllers from data via approximate nonlinearity cancellation. IEEE Transactions on Automatic Control, 2023.
- [13]Florian Dörfler, Jeremy Coulson, and Ivan Markovsky. Bridging direct and indirect data-driven control formulations via regularizations and relaxations. IEEE Trans. Automatic Control, 68(2):883–897, 2022.
- [14]Carl Eckart and Gale Young. The approximation of one matrix by another of lower rank. Psychometrika, 1(3):211–218, 1936.DOI
- [15]Antonio Fazzi and Alessandro Chiuso. Simulation of nonlinear systems trajectories: Between models and behaviors. In 2024 10th International Conference on Control, Decision and Information Technologies (CoDIT), pages 2049–2054. IEEE, 2024.arxiv.org/abs/2304.02930
- [16]Daniel Floryan and Michael D. Graham. Data-driven discovery of intrinsic dynamics. Nature Machine Intelligence, 4(12):1113–1120, 2022. doi: 10.1038/s42256-022-00575-4.DOI
- [17]Meichen Guo, Claudio De Persis, and Pietro Tesi. Data-driven stabilization of nonlinear polynomial systems with noisy data. IEEE Transactions on Automatic Control, 67(8):4210–4217, 2022. doi: 10.1109/TAC.2021.3115436.DOI
- [18]Ernst Haier and Gerhard Wanner. Solving Ordinary Differential Equations II: Stiff and Differential-Algebraic Problems. Springer, 2 edition, 1996.
- [19]Huayuan Huang, M. Kanat Camilbel, Raffaella Carloni, and Henk J. van Waarde. Data-driven stabilization of polynomial systems using density functions. arXiv preprint arXiv:2503.07092, 2025.arxiv.org/abs/2503.07092
- [20]Linbin Huang, John Lygeros, and Florian Dörfler. Robust and kernelized data-enabled predictive control for nonlinear systems. IEEE Transactions on Control Systems Technology, 32(2):611–624, 2023.arxiv.org/abs/2206.01866
- [21]Kadierdan Kaheman, J. Nathan Kutz, and Steven L. Brunton. SINDy-PI: a robust algorithm for parallel implicit sparse identification of nonlinear dynamics. Proceedings of the Royal Society A, 476(2242):20200279, 2020. doi: 10.1098/rspa.2020.0279.DOI
- [22]Andrey Kharitenko, Zebang Shen, Riccardo De Santi, Niao He, and Florian Dörfler. Landing with the score: Riemannian optimization through denoising. In International Conference on Learning Representations (ICLR), 2026.arxiv.org/abs/2509.23357
- [23]Milan Korda and Igor Mezić. Linear predictors for nonlinear dynamical systems: Koopman operator meets model predictive control. Automatica, 93:149–160, 2018. doi: 10.1016/j.automatica.2018.03.046.DOI
- [24]Mircea Lazar. Basis-functions nonlinear data-enabled predictive control: Consistent and computationally efficient formulations. In Proc. European Control Conference, pages 888–893, 2024. doi: 10.23919/ECC64448.2024.10591192.DOI
- [25]Niall M. Mangan, Steven L. Brunton, Joshua L. Proctor, and J. Nathan Kutz. Inferring biological networks by sparse identification of nonlinear dynamics. IEEE Transactions on Molecular, Biological and Multi-Scale Communications, 2(1):52–63, 2016. doi: 10.1109/TMBMC.2016.2633265.DOI
- [26]Ivan Markovsky. Data-driven simulation of generalized bilinear systems via linear time-invariant embedding. IEEE Transactions on Automatic Control, 68(2):1101–1106, 2022.DOI
- [27]Ivan Markovsky and Florian Dörfler. Behavioral systems theory in data-driven analysis, signal processing, and control. Annual Reviews in Control, 52:42–64, 2021.DOI
- [28]Ivan Markovsky and Florian Dörfler. Identifiability in the behavioral setting. IEEE Transactions on Automatic Control, 68(3):1667–1677, 2023. doi: 10.1109/TAC.2022.3209954.DOI
- [29]Ivan Markovsky and Paolo Rapisarda. Data-driven simulation and control. International Journal of Control, 81:1946–1959, 2008.DOI
- [30]Ivan Markovsky, Alexander Kukush, and Sabine Van Huffel. Consistent least squares fitting of ellipsoids. Numerische Mathematik, 98(1):177–194, 2004.DOI
- [31]Murray Marshall. Positive polynomials and sums of squares. Number 146. American Mathematical Soc., 2008.
- [32]Tim Martin, Thomas B. Schön, and Frank Allgöwer. Guarantees for data-driven control of nonlinear systems using semidefinite programming: A survey. Annual Reviews in Control, 56:100911, 2023.arxiv.org/abs/2306.16042
- [33]Igor Mezić, Jorge Cortés, Karl Worthmann, Mircea Lazar, and Armin Lederer. Koopman operator theory: fundamentals, control, and applications. arXiv preprint arXiv:2607.01819, 2026. URL https://arxiv.org/abs/2607.01819.
- [34]Vikas K. Mishra, Ivan Markovsky, Antonio Fazzi, and Philippe Dreesen. Data-driven simulation for narx systems. In 2021 29th European Signal Processing Conference (EUSIPCO), pages 1055–1059, 2021. doi: 10.23919/EUSIPCO54536.2021.9616226.DOI
- [35]Alberto Padoan, Florian Dörfler, and John Lygeros. Data-driven representations of conical, convex, and affine behaviors. In Proc. 62nd Conference on Decision and Control, pages 596–601. IEEE, 2023.
- [36]Alberto Padoan, Jaap Eising, and Ivan Markovsky. From time series to affine systems. arXiv preprint arXiv:2510.22089, 2025.arxiv.org/abs/2510.22089
- [37]Philipp Rostalski, Ioannis A. Fotiou, Daniel J. Bates, A. Giovanni Beccuti, and Manfred Morari. Numerical algebraic geometry for optimal control applications. SIAM Journal on Optimization, 21(2):417–437, 2011.DOI
- [38]Juan G. Rueda-Escobedo and Johannes Schiffer. Data-driven internal model control of second-order discrete Volterra systems. In Proc. 59th IEEE Conference on Decision and Control, pages 4572–4579, 2020. doi: 10.1109/CDC42340.2020.9304122.
- [39]András Sasfi, Ivan Markovsky, Alberto Padoan, and Florian Dörfler. Gaussian behaviors: representations and data-driven control. In Proc. 64th Conference on Decision and Control, pages 1993–1998. IEEE, 2025.arxiv.org/abs/2504.15838
- [40]András Sasfi, Jaap Eising, and Florian Dörfler. Soft projections for robust data-driven control. arXiv preprint arXiv:2604.00900, 2026.arxiv.org/abs/2604.00900
- [41]Konstantin Usevich and Ivan Markovsky. Adjusted least squares fitting of algebraic hypersurfaces. Linear Algebra and its Applications, 502:243–274, 2016.DOI
- [42]Pieter van Goor, Robert Mahony, Manuel Schaller, and Karl Worthmann. Reprojection methods for Koopman-based modelling and prediction. In Proc. 62nd IEEE Conference on Decision and Control, pages 315–321, 2023. doi: 10.1109/CDC49753.2023.10383796.DOI
- [43]Jan C. Willems. Paradigms and puzzles in the theory of dynamical systems. IEEE Transactions on Automatic Control, 36(3):259–294, 1991. doi: 10.1109/9.73561.DOI
- [44]Jan C. Willems, Paolo Rapisarda, Ivan Markovsky, and Bart L. M. De Moor. A note on persistency of excitation. Systems & Control Letters, 54(4):325–329, 2005.
- [45]Matthew O. Williams, Ioannis G. Kevrekidis, and Clarence W. Rowley. A data-driven approximation of the Koopman operator: Extending dynamic mode decomposition. Journal of Nonlinear Science, 25(6):1307–1346, 2015. doi: 10.1007/s00332-015-9258-5.DOI


