WorksComputer Science
Instrumental Variables in Continuous-Time Stochastic Processes
Abstract
Causal questions often arise in systems that evolve in continuous time. While instrumental variable (IV) methods provide a principled approach to identify causal effects in static or discrete-time settings, even in the presence of unobserved confounding, they do not yet extend to continuous-time dynamics. In this work, we develop an IV framework for stationary continuous-time stochastic processes parameterized by stochastic differential equations (SDE), where the instrument itself takes the form of a stochastic process. We encode the structural sparsity and causal effects directly at the infinitesimal level of the drift, and contrast these assumptions with the IV assumptions on the discretized version of the same process. Based on these structural assumptions, we derive moment restrictions using path-valued instruments. We show how these restrictions simplify for Ornstein-Uhlenbeck processes and present an identification condition together with a corresponding consistent estimation method. Finally, we extend our estimation framework to nonlinear causal effects by expressing the path-based moment restrictions leveraging the signature kernel. Empirically, our method recovers causal effects in confounded continuous-time systems where maximum-likelihood-based estimation and discrete-time IV methods are systematically biased.
Introduction
Causal effect estimation under unobserved confounding is a central challenge in many scientific domains. In the presence of unobserved confounders, standard estimation techniques fail to distinguish between confounding and the true effect. This distinction is generally impossible from observational data without additional assumptions. The Instrumental Variable (IV) framework forms one of the most prominent settings in which principled strategies for cause-effect identification and estimation exist under certain assumptions. IVs are exogenous variables that affect the covariates, are independent of the hidden confounders, and only affect the outcome through the covariates. IV methods have been thoroughly studied and are an established workhorse in the toolbox of econometricians [39, 17, 43] and beyond. They also attracted renewed interest in the context of flexible machine learning techniques [6, 20, 2].
While a range of methods exists for the static IV setting, many real-world systems in which questions of causation arise are inherently dynamic, including applications in earth system sciences [36, 44], medical settings [21, 27] and macroeconomic analyses [14] (Sims 2002). As an example, consider the objective of identifying the glucose-insulin sensitivity of a type 2 diabetes patient, which describes the main mechanism impaired by the disease. Insulin and glucose concentration dynamics may be confounded by unobserved digestive processes, rendering standard effect estimation techniques biased. Using the IV structure of the problem, insulin sensitivity may still be identified using the external insulin administration process as an instrument. We will get back to this example in our empirical validation. Recent work on IV methods for parameter estimation of discrete-time processes Mogensen [31]; ); Thams et al. [46] is unsuitable for continuous-time systems. First, observational data is often available only on irregular sampling-intervals, which discrete-time methods fail to handle. Moreover, if the underlying real world system evolves in continuous-time, the structural IV sparsity needs to be modeled on an infinitesimal scale rather than over finite time intervals. That is, discrete-time models imply structural IV assumptions that do not preserve the actual local IV structure of a continuous-time process, resulting in severe model-misspecification.
Furthermore, our continuous-time formulation has strictly more “identification power” than in the static case. Concretely, in static IV settings identification is fundamentally limited by the variation and number of available instruments. For example, in the linear case, identification requires as many instruments as treatments. The relevant underspecified case, where only few instruments are available compared to treatments, has been acknowledged as an important setting [1], but received little attention. In contrast, in our new continuous-time setting, we show that the temporal structure of the process contains richer identifying information, allowing for identification of multi-dimensional causal effects from a single instrument process.
We summarize our contributions as follows:
We are first to formulate the IV setting in continuous-time stochastic processes parametrized by SDEs, where the IV structure is defined on the infinitesimal level of the process.
We derive the moment conditions implied by the IV structure in stationary SDE systems as orthogonality between forecasting errors and functionals of the instrumental process path.
We derive a controllability condition that identifies the target parameters in a confounded Ornstein–Uhlenbeck (OU) process, along with a consistent estimator.
We propose an extension for nonlinear objective functions via a kernel-based estimation scheme.
We demonstrate empirically that our method outperforms possible alternative approaches.
Static and Discrete-Time Instrumental Variables
Static IV. In the static setting, the standard IV setup aims to identify the effect of covariates on outcomes under confounding of an unobserved variable by making use of the instrument variable . In general, IV is defined by three assumptions on the underlying data-generating mechanism, relevance, exclusion and exogeneity [22, 35]. Relevance requires that is not independent of (), the exclusion restriction requires that only affects through () and exogeneity requires that is independent of (). The standard “IV graph” encoding these conditions is illustrated in Figure 4.

Figure 4. Standard instrumental-variable causal graph. The instrument affects the outcome only through the treatment , while the latent variable confounds the relationship between and . The causal effect of interest is the direct dependence of on highlighted in blue.
Instrumental variable methods and generalized-method-of-moments (GMM) frameworks use the exogeneity of instrument variables together with setting-specific assumptions to formulate effect-identifying moment conditions, and construct associated estimators [39, 17, 50]. Albeit the IV setting being restrictive as valid instruments are often hard to find, these methods continue to uncover relevant causal effects, such as the medical cost of air pollution, effects of medical aid programs, among other [11, 9, 3] (Duflo 2001). In recent years, deep learning methods have been applied to both IV- and GMM-setups [6, 37, 20] and in a different line of work, kernel-based methods are used to approximate causal effects [2, 7] (Zhang et al. 2023).
IV methods for discrete processes. Recent papers have described instrumental variable techniques in stationary multivariate vector autoregressive processes in discrete time [31, 46]. Mogensen [31] proposes using a time-integrated covariance matrix to discover normalized parameters, which can be given a causal interpretation. This also extends to linear Hawkes processes, which describe continuous-time event processes [31]. Thams et al. [46] investigate discrete-time instrumental processes by studying graphical properties of the time-unrolled causal graph of the process. They clarify that the previously described static IV conditions are not trivially fulfilled in such a graph, as past instruments violate exclusion by causally affecting both current instrument states and outcomes. They propose two approaches for estimating causal effects in this setting: conditional IV, which retrieves the standard IV setting by conditioning on subsets of the process history, and nuisance IV, which adds past outcomes to the covariates.
Causal interpretation of SDEs. A growing amount of papers seeks causal interpretations of SDEs, e.g., [19, 29, 28, 40], by defining interventions in SDE systems and performing causal discovery of the local independence graph in SDE systems. We extend this line of work by contributing IV-type estimation for continuous-time processes defined by SDEs.
Instrumental variables in system identification. Adjacent to our setting, IV methods can also be found in the systems engineering and control theory literature, mostly in the context of discrete-time stochastic processes, starting from early papers such as [24, 49]. This line of work often assumes an explicit control input which may serve as an instrumental process, alternatively lagged variables are used as instruments [15, 16]. The goal is most often the identification of a state-space model, instead of the identification of a set of causal parameters.
Preliminaries
Setup. We first introduce a general, continuous-time, stochastic data-generating mechanism in which we can encode the structural IV assumptions. Specifically, the data is generated by a stochastic process with states indexed by time and driven by a Wiener process with jointly independent components. Process acts as an instrument process, represents the evolving covariates, the outcome process, and the unobserved confounding process. All causal relationships between the variables are encoded in the structure of the drift, which allows for a direct interpretation of the causal effects, in contrast to diffusion coupling, and avoids additional identifiability challenges. Thus, we model the dynamics via the following system of SDEs
with , where is the unique invariant measure of the process. We assume drift and diffusion to be globally Lipschitz and satisfy linear growth conditions, ensuring existence and pathwise uniqueness of a strong solution to Eq. (1) [34], as well as finite first moments . The resulting joint process is assumed to be strongly stationary. We assume without loss of generality that the process is zero-mean. All components of aside from are observed. In Section A, we discuss the assumptions and alternative confounding types based on non-diagonal diffusion matrices, for which our proposed methods remain applicable.
The structural assumptions implied by Eq. (1) directly parallel the static IV assumptions and are illustrated in the sparsity graph of the process, shown in Figure 1. First, we assume relevance, meaning that the drift of process depends non-trivially on process . Second, the exclusion restriction requires that the instrument process only influences the outcome process through the covariate process , thus there is no direct effect of process on ( is not an argument of ). Third, exogeneity in continuous-time implies that the instrument process is independent of the Brownian motion

Figure 1. Observed trajectories of processes , confounded by the hidden process , together with the assumed sparse drift graph, are used to identify the objective function .
increments as well as of the confounding process . The latter is described by the following conditional moment restriction
where denotes the filtration of the instrument process up to time . Analogously to most static IV settings, we assume that enters the drift of the outcome process additively [22]. While restrictive, without additivity one typically needs similarly strong alternative assumptions to achieve identifiability [4, 23].
Data. We observe a finite trajectory of the marginal process and record tuples at observation times . The states are all measured simultaneously, however, the spacing between timepoints may be irregular. The confounding process is latent and never observed. In principle, a single long trajectory suffices for identification and estimation. For practical purposes, in our empirical evaluation we sample multiple shorter trajectories for efficiency.
Objective. The main objective of this paper is the identification of the drift component describing the causal effect of covariate process on outcome process and the self-dynamics of . Although the causal effect of process on process is the primary effect of interest, it is inherently entangled with the self-dynamics of and both are therefore jointly identified and estimated.
Bias in MLE. In the given setting, maximum likelihood estimation of is biased due to unobserved confounding. This becomes evident by analyzing the transition densities of the partially observed process. Naive Maximum-Likelihood Estimation (MLE) maximizes under some approximation of the transition density [34]. This transition density depends on the unobserved via . Since confounds both and , a likelihood model omitting generally attributes part of the confounding mechanism to the causal effect . This motivates the use of IV methods that exploit the structure to identify the drift function.
Relation to other IV settings. Unlike in the static case, the outcome depends on its own past and may interact cyclically with process leading to substantially different structure of the objective function . Compared to the discrete-time dynamic setting, the local independencies implied by the continuous-time setup in Eq. (1) differ fundamentally from structural assumptions in discrete-time processes described in Mogensen [31]; Thams et al. [46]. In continuous time, the structural sparsity exists only on the infinitesimal level and does not imply an identical sparsity pattern in finite-step transition maps of the corresponding discretely observed process [32]. For example, an equidistantly sampled OU process admits an equivalent representation as a VAR(1) process. However, when imposing an IV structure on the drift of the OU process, the exclusion restriction is generally not preserved in the corresponding VAR(1) transition matrix. The key is that sparsity in an infinitesimal generator matrix does not transfer to the exponential map for a finite interval (see Section B for detail), e.g., for :

Figure 5.
Hence, when causal mechanisms operate in continuous-time with IV sparsity imposed on the infinitesimal level, discrete-time IV models are misspecified by construction.
Continuous-Time IV Moment Conditions
We now derive the moment conditions implied by the IV structure using the independence between instrument and confounding processes described in Eq. (2).
Proposition 1 (Continuous-time IV Moment Restriction). Let be the joint Markov process satisfying Eq. (1), and assume that the IV exogeneity condition defined in Eq. (2) holds. Let describe the prediction residual at time
Then the following conditional moment restrictions hold
and, equivalently, for every and ,
Proof. We start by following Hansen & Scheinkman [18] and apply Itô’s formula to the test functions evaluated on the process state , yielding
Here, the resulting process is a continuous local martingale. We choose the linear test function such that becomes a true martingale under the finite first moment and linear growth assumptions. denotes the generator of the full process including the unobserved state, as defined in Pavliotis [34]. We take expectations conditioned on the filtration of the instrument process at time . As , the conditional expectation of any future martingale increment remains zero and thus
By expanding the generator for the linear test function as , Eq. (7) yields
The conditional expectation of the hidden confounder given vanishes for all by the exogeneity and the linearity of expectation. This directly results in Eq. (5), and under standard regularity conditions we can interchange the integral and expectation to obtain the differential form in Eq. (4), concluding the proof.
It follows that for all measurable random variables . This implies that we can use the filtration of to construct many valid instruments from a single continuous-time instrument process. Choosing for any functional of the instrument path up to time , we obtain the following continuum of moments
Importantly, the conditional expectation with respect to the filtration of the instrument path in Eq. (5) carries much more information than just the past state . Although the joint process described in Eq. (1) is Markov, this property does not carry over to the partially observed process. Consequently, the entire continuous instrument path up to time constitutes a valid instrument, giving rise to path-valued moment conditions.
These moment conditions rely on temporal information between observations. When those are not available, for example when only samples from the stationary distribution are accessible, we can still derive stationary moment conditions, which we describe in Section C.
The Linear Case: Ornstein-Uhlenbeck Processes
In this section we show that for an OU process the previously described moment equations can achieve point-identification of the targeted causal effect under mild conditions on the joint process. We instantiate the general setup described in Eq. (1) via an OU process with constant diffusion coefficients and a linear drift
where each drift coefficient is matrix-valued with dimensions for , and the diffusion coefficients are diagonal matrices for . We assume to be Hurwitz, so that the process is stable and stationary. Given the system described in Eq. (10), identification of the target function reduces to the identification of the parameters and .
Simplification of moment conditions under joint Gaussianity. For OU processes, Eq. (9) simplifies due to the joint Gaussianity of the process. As consists of a sum of Gaussian random variables and linear integrals over Gaussian processes, the distribution of is also jointly Gaussian. Thus, the conditional expectation is linear in the conditioning variables. This has two direct consequences: First, the unconditional formulation Eq. (9) can be restricted to linear functionals , as any nonlinear transformation in the moment conditions does not provide any additional identifying information. Second, joint conditioning on multiple past states of the instrument process does not provide additional information over conditioning on each lagged individually (Section D). Consequently, in the OU setting, Eq. (9) turns into a continuum of moments for all , . Due to stationarity and linearity of expectation, varying both and is redundant. So we can write equivalently
Identification. In an OU process, also enters the drift of additively, such that the confounder’s contribution to the cross-covariance dynamics between and vanishes by exogeneity as well. Thus, differentiating Eq. (11) with respect to together with the equivalent equation for the and cross-covariance yields a linear ODE in the covariance states , in which the confounding no longer appears explicitly. The resulting system contains an additional forcing term , which can be interpreted as a control input.
Consequently, in the case of a confounded OU process, the IV moment conditions therefore amount to matching the lagged covariances dynamics between instrument and outcome described by Eq. (12) to those estimated from data. With these prerequisites, we obtain the following identifiability statement.
Proposition 2 (Identification in the OU setting). Consider an OU as in Eq. (10) with Hurwitz drift matrix and non-degenerate instrument diffusion and let . Further, define the controllability matrix
*For timepoints drawn i.i.d. from an absolutely continuous distribution over , if , the linear system obtained by integrating the first row of Eq. (12)
almost surely has a unique solution, identifying the causal effect and the self-effect .
Proof sketch. The proof (presented in detail in Section E) relies on three steps. Given Eq. (14), the proposition can directly be viewed as a rank condition on a matrix of observed timepoints of the trajectory . In LTI systems, the controllability condition from Eq. (13) ensures that the trajectory can span the whole state-space [5]. However, for a fixed control input, there may still exist initial conditions for which some modes of the system remain unobserved. Using the stationary Lyapunov equation, the proof shows that such initial conditions do not occur under a non-degenerate instrument diffusion almost surely. Overall, the proposition thus states that given controllability, the causal parameters and are identified by fitting the covariance ODE in Eq. (12) at a finite number of lags .
Estimation. We estimate the drift coefficients through a two-stage procedure based on the integrated covariance identities in Eq. (14). For fixed lags sampled as in Theorem 2, define
The first stage estimates these moments from the observed trajectory. Specifically, we estimate by Nadaraya–Watson kernel regression [48] of the observed cross-products on their time lags , using a bandwidth that shrinks with sample size. Together with the empirical zero-lag covariance , this yields . We estimate directly by importance-weighted averages of lagged cross-products involving both and , correcting for the possibly nonuniform lag density induced by the known observation-gap distribution.
The second stage fits the empirical moment equations by least squares. Stacking and , the estimator admits the closed-form expression
where denotes the Moore–Penrose pseudoinverse, selecting the minimum-Frobenius-norm solution when the minimizer is nonunique. This combines nonparametric covariance estimation with a single linear least-squares solve for the causal drift coefficients. All details of the construction, a differential version of the estimator that performs similarly in experiments, and the proof of the following consistency statement are in Section F.
Theorem 3 (Consistent estimator in the OU setting). In the setting of Theorem 2, the estimator in Eq. (63) is consistent, i.e., and as .
In summary, we have established identifiability and developed a consistent estimator for the linear (OU) continuous-time IV setting. Before demonstrating the practical efficacy of our estimator empirically, we also develop a tractable estimation procedure for the generically unidentifiable and complex nonlinear case.
The Nonlinear Case
In the OU setting, identification is governed by a controllability condition, which can ultimately be tested for from observed data. In the nonlinear case, identification and practical estimation become much more challenging, as linear functionals do no longer exhaust the identifying information contained in the moment equation Eq. (4) and furthermore, the target parameters generally cannot be moved out of the expectation, as in Eq. (12).
Identification. It is known from the static case, that nonparametric instrumental variable estimation, which seeks to recover a nonlinear function from conditional moment conditions, is an ill-posed problem [7, 41, 47] (Zhang et al. 2023). In the nonlinear setting, the goal is to identify the parameters parameterizing the target drift function in the general SDE model described in Eq. (1). Generally, is unidentifiable for flexible function classes , i.e., the conditional moment restrictions in Eq. (5) are satisfied for multiple parameter settings. The standard remedy from the literature [7] is to regularize the problem to obtain one compatible candidate in the identified set, for instance, aiming at the least norm solution. We follow this approach in our continuous-time setting.
Estimation. We start from the unconditional form of the previously derived moment condition for all , where now depends on the drift function via Eq. (3). We evaluate the residual at a fixed time horizon , where is a hyperparameter. For a moderate choice of , the signal to noise ratio of the drift contribution increases. At the same time, the correlation to the past instrument path typically decreases as increases. When the sampling frequency is sufficiently high, the integral terms in can be approximated using standard quadrature schemes. Otherwise, simulation-based estimation methods are required.
We can then formulate the nonlinear estimation problem as a minimax problem of the risk associated with the moment conditions Eq. (5) [7, 2]. Concretely, we minimize the parameters of the target function with respect to the worst case functional , where we assume that lies in the reproducing kernel Hilbert space (RKHS) induced by some characteristic kernel . Together with the regularization term this gives the following dual optimization problem
Following Zhang et al. (2023), we assume that lies within a unit ball of its RKHS . This allows us to avoid a computationally expensive explicit dual optimization, as the inner supremum admits an analytical solution, so that we obtain the risk
Using the V-statistic to empirically estimate the risk, we finally get
where describes the kernel Gram matrix, the residual vector, and the number of sampled path sections.
Signature kernel. The risk assumes access to a characteristic kernel on path spaces to express the functionals of the instrument paths in the RKHS . We propose using the signature kernel (Manten et al. [29]; Salvi et al. [38]; Lee & Oberhauser [26]), which has gained increasing popularity in recent years for various types of sequential data. More details are found in Section H.
Experiments
OU setup and baselines. We evaluate our method on simulated OU process trajectories across different systems. For each system, we randomly sample drift and diffusion matrices with sparsity according to Eq. (10), and all nonzero parameters bounded away from zero. The observation timepoints are irregularly sampled with uniformly distributed observation intervals, detail are described in § 19.
We compare our method to parameter estimates obtained from naive Maximum Likelihood estimates (Pavliotis [34]) ignoring the unobserved state . Due to a lack of continuous-time IV baselines, we also compare to the VAR(1) estimator presented in Thams et al. [46] working with the same number of regularly sampled data from the same trajectory. Additionally, in § 19, we compare to the discrete-time estimator for the normalized parameters in Mogensen [31], where we construct the ratio estimates from both individually estimated variables and .
IVSDE identifies causal effects under confounding. Figure 2(left) shows the parameter estimation error over both and in a confounded OU process, with increasing confounding strength through parameters and . The MLE estimate of the parameters is clearly increasingly biased under growing confounding, reflecting that MLE cannot distinguish between the confounding effect
Figure 2. RMSE of and for a confounded OU process (one instrumental and one outcome process throughout, except in (b)). Left: Estimation error under varying confounding strength. Center: Recovery of multidimensional causal effects from a single instrument process. Right: Estimation error as a function of instrument–covariate coupling strength . Error bars indicate 95% confidence intervals, boxplots show medians and interquartile ranges. Each evaluation is based on 20 systems (left) and 10 systems (middle/right).
and the causal influence of process on . By contrast, the continuous-time IV estimate remains stable across confounding levels. Given the same number of samples on a regular grid, discrete IV methods for time series remain biased as they assume the IV sparsity in the finite-time transition maps instead of on the infinitesimal level, as explained in Section B.
The proposed method identifies multi-dimensional causal effects with a single instrument. Unlike static IV methods, which require at least as many instruments as causal effects for identification in the linear setting, a single instrumental process in continuous-time can identify multi-dimensional causal effects. Figure 2 (middle) shows the parameter estimation error depending on the dimensionality of the covariate process given a single instrument process. The total number of estimated parameters is always , accounting for both and . The results reveal that the proposed IV method may even be used to estimate four-dimensional causal effects using a single instrumental process and still obtains a lower average error than MLE. However, the variance of the IV estimator increases with growing dimensionality of the targeted causal effect.
Influence of instrument strength. The proposed IV method relies on the coupling between instrument and covariate process, which is also captured by the relevance assumption. Figure 2 (right) shows that the mean estimation error and variance decrease with stronger coupling parameter . This is consistent with the intuition that larger coupling parameters induce more exogenously generated variation in the covariate process, thus providing a stronger instrument.
Kernel-based estimation of confounded nonlinear effects. In the nonlinear setting, inspired by Saengkyongam et al. [37], we set up the drift as , where describes a randomly sampled parameter vector of radial-basis function weights and their centers. We parameterize the target function with a basis function expansion containing the same radial basis function centers and variances, as well as two linear terms for and . Figure 3 (left) clearly shows that the IV-based estimator outperforms the MLE estimation for larger confounding values, while the MLE performs better for small and no confounding. This behavior of these estimation methods can be explained by two observations. First, IV methods are inherently less efficient than MLE, since they only exploit the variation explained by the instrument instead of the full likelihood. Furthermore, the signature kernel-based optimization introduces a more complex optimization landscape, which might contribute to the lower performance in settings where MLE is only slightly biased. With higher confounding, however, this is outweighed by the bias of the MLE estimate.

Figure 3. Results for a nonlinear drift parametrization. (left) Relative drift RMSE over the distribution. (right) Ground truth sigmoidal drift and learned drift parameterized with an MLP.
Neural parametrization. We can also use a small MLP to parameterize the class of the target drift function . In this setting, we assume the target function drift function to be linear in and use a sigmoid function to describe the dependence on the covariates . Figure 3 (right) shows that we recover the qualitative shape of the target function.
Diabetes dataset. We setup a semi-synthetic experiment motivated by pharmacokinetic/pharmacodynamic models for type 2 diabetes ([45, 33]). We aim to identify the patient’s insulin sensitivity, which describes how their glucose level responds to insulin and is the main physiological factor impaired by the disease. Both glucose and insulin levels are confounded by unobserved gut glucose levels, and external insulin dosing schedule is used as an instrument. The resulting drift is modeled as . Table 1 shows that compared to an MLE-based parameter fit, our nonlinear estimator retrieves all function parameters with lower RMSE across five runs. More runs including parameter ablations are in § 19.
| Method | RMSE |
| IV-SDE | 0.0157 (0.0035) |
| MLE | 0.0998 (0.0003) |
Table 1. Parameter RMSE on the diabetes dataset.
Conclusion
We introduced a framework for instrumental variable estimation in continuous-time stochastic processes governed by SDEs by deriving path-based moment conditions resulting from the structural IV assumptions. For OU processes, we established a controllability-based identification condition together with a consistent estimator. For nonlinear effects, we proposed a minimax estimation scheme based on path-valued moment conditions. We have shown the empirical performance on synthetic data and proposed SDE simulators for diabetes from the literature. Our results also verify that a single instrument process indeed carries enough information to recover multi-dimensional effects.
We believe that with the currently growing interest in learning continuous-time dynamics [25, 28] the causal interpretation of these models is becoming increasingly relevant. Our results also highlight once more that the transition from discrete time to continuous time is often not trivial as local structure does often not transfer to finite-step transitions. Across our simulated systems, including the glucose–insulin example, respecting this structure improves estimation. Interesting direction for future work include a better understanding of identifiability in the nonlinear case and uncertainty quantification that remain reliable with weak instruments. Also, theoretical extensions beyond stationarity would be interesting, albeit stationarity does not appear to be mandatory for practical estimation.
AI Use Statement
In this work, we used generative AI tools to help generate synthetic data sets, support formulating mathematical claims, assist in the writing of proofs, propose and refine hypotheses, design or provide feedback on research methodology and experiments, support with the implementation of methods and support qualitative and thematic data analysis. We have not used generative AI tools to provide critical ingredients for proving mathematical claims, help develop conceptual frameworks, interpret results and assist with translation. Cleaning and reformatting datasets is not applicable to this work.
While we used AI in the research process, the final content of this paper was manually constructed, checked and verified with care. We have manually reviewed all LLM written code for functionality and correctness. We take responsibility for the final content of this work, including text, claims and artifacts produced with the aid of generative AI.
Reproducibility Statement
We prove all main mathematical statements in the appendix and the main paper itself and precisely refer to previous methods, when necessary. Further, we provide a thorough discussion of the method and its main assumptions in the appendix. We supply full descriptions of all synthetically generated datasets and used methods in the appendix. We provide the main methods in an anonymized form as source code at time of submission, the repository with full reproducible result plots will be available upon acceptance.
Extended Setup Discussion
Our setup relies on the standard instrumental variable assumptions, and it is worth discussing them in more detail and disentangling them from other assumption made throughout this paper.
Static IV assumptions
The instrumental variable setting itself is defined by the three conditions relevance, exclusion and exogeneity ([22, 35]). Relevance requires that is not independent of , the exclusion restriction requires that only affects through and exogeneity requires that is independent of . A simple structural causal model fulfilling these instrumental variable conditions is found in Figure 4. Relaxing any of these conditions is known to yield impossibility statements without strong replacements such as sign- or subset validity restrictions. For such very specific, IV-related settings, one can provably only obtain bounds or sensitivity regions and no point-identification ([30, 4]). While the literature contains ample discussion of the IV assumptions, they have not impaired the practical relevance and usage of IV estimation.
In addition to these three defining conditions, IV methods require a fourth assumption for identification [22], which usually takes the form of the additivity assumption. This assumption implies that the confounder only enters the outcome variable in an additive way. This assumption is substantive, but it is just as well standard and provably necessary: If this additive separability is not assumed the effect is unidentifiable unless other strong assumptions are introduced. Such alternatives include adding monotone control functions or shape restrictions ([23, 10]) or give up on identifiability and analyze partial identification.
Transfer to the SDE setting
We transfer the previously described defining assumptions of the IV setting together with the necessary additivity assumption to the continuous-time dynamic setting. We make the standard assumption of a diagonal diffusion matrix with coordinate-wise state-dependent entries. Consequently, we assume all causal effects between the variables to be encoded in the drift functions. We discuss a relaxation of this in a later section.
We encode the structural IV assumptions in the sparse interaction graph of the SDE. Thus, the relevance condition requires the drift of to depend on the instrument . Similarly, the exclusion restriction requires that does not enter the drift of outcome process and only influences through process . Exogeneity is best expressed through the path-filtration condition . The Additivity assumption can be directly transferred to the dynamic setting by requiring additivity of the unobserved state in the drift function of process .
Without the assumption of a diagonal, component-wise state-dependent diffusion, other definitions of the IV setup would also be possible in continuous-time, for which our proposed moment conditions would remain valid.
In its most general form, the moment condition presented in Theorem 1 can be written as
Hence, the moment restrictions remain valid as long as is a martingale and the exogeneity of the instrument holds. In case of an arbitrary non-diagonal and state-dependent diffusion matrix, remains a martingale. However, a non-diagonal diffusion matrix may break the validity of the moments through a violation of the exogeneity condition. This may occur in two ways:
First, exogeneity may be violated if and are directly mixed by sharing a mutual innovation, specifically . This introduces shared information between the history of and the history of , which through persistence in the latent process also allows for a prediction of future . Second, exogeneity may also not hold, if the diffusion coefficient of either process depends on the state of the other described by or .
We note that, as long as exogeneity is fulfilled, diffusion mixing as well as state dependent diffusions may introduce proper confounding bias in the naive MLE estimator even without drift confounding, while the moment conditions in Theorem 1 and thus the proposed estimation remain valid. Consequently, we may relax the assumption on a diagonal diffusion matrix by only requiring that exogenity holds, and could also define a more general continuous-time IV setting than described by the SDE system in (1).
We decide to present this paper with the more restrictive drift confounding as in (1), because we argue that proper causal confounding is intuitively conveyed via the drift instead of shared diffusion noise or state-dependent volatility. We discuss the influence of a non-diagonal diffusion matrix on our proposed methods in Section G.
Discussion of further assumptions.
Beyond the previously discussed conditions defining the IV setting, we make the following further assumptions on the process:
Zero-mean. We assume the joint process to have zero-mean. This holds without loss of generality, as the observed parts of the process can be centered with the observed mean. The moment conditions in both the linear and nonlinear setup retrieve the function up to translation, as we can only identify the sum of the intercept of and the unobserved . However, for prediction of process under intervention on process this translation cancels and the total outcome drift of process remains unchanged. Hence, we can assume without loss of generality. As presented, the current model setup requires . We interpret as the effective latent contribution instead of necessarily the full underlying state. Its dynamics may also depend on additional unobserved variables, the proposed moment conditions will remain valid as long as exogeneity is fulfilled.
Stationarity. We assume the joint process to be stationary, the non-stationary setting is only adjacent to our setup. We make use of stationarity for identification and estimation from a single curve. Together with the assumption of ergodicity, we can estimate the moments using time averages from a single trajectory. In the nonstationary setting, the moments would generally depend on the absolute observation time. Thus, they could not be pooled along single trajectories without introducing additional assumptions. Estimation would instead require e.g. multiple independent trajectories or assumptions on the local stationarity of the process. We leave this extension to future work.
Distinction from Discrete-Time Models
In the following section we demonstrate the difference between structural assumptions in discrete-time models and continuous-time models as also described in Mogensen et al. [32]. We specifically show that local IV structure on an infinitesimal level does not imply IV sparsity in finite interval transition maps in discrete-time models.
Consider as an example a general OU process with states with drift matrix and diagonal diffusion matrix . When all components of are observed on an equidistant grid with sampling interval , Bergstrom [8] showed that the discrete observations satisfy the VAR(1) process with transition matrix :
Here, the noise follows:
thus satisfying
and for all .
The discrete-time transition matrix , however, generally does not maintain the sparsity pattern of drift matrix . Therefore, the local independencies in are typically not visible in the discrete VAR(1) representation Mogensen et al. [32].
Specifically, for the OU process with IV structure described in Eq. (10) with states , the IV sparsity encoded in the drift (Eq. (10)) does not carry over to the transition matrix in the VAR(1) model of the process. While the block-diagonal structure of ensures that the exogeneity of the instrument and confounding process are preserved in the finite-time transition matrix, the exclusion restriction does not hold. Specifically, does not imply . For a concrete example, consider
but for
where despite .
Consequently, imposing a local IV structure in a continuous-time model implies a different assumption about the underlying mechanism than enforcing IV sparsity in discrete-time models.
Stationarity moment conditions
In the setting where only observations from the stationary distribution are accessible, we can still setup moment conditions: since (presented by [18]), we can directly make use of the stationary covariance between any function of the instrument state and the outcome . For this, we choose the test function as , where is a projection of the instrument state. Expanding the generator expression and using the exogeneity of the instrument, this yields
While this moment condition can be used for estimation and may even identify the target function by using different projections under a sufficiently rich instrument process, it also assumes knowledge of the instrument dynamics in the form of the instrument drift and diffusion. We therefore only focus on the previously introduced moment conditions in the presentation of this paper.
Simplification of Moment Conditions under Joint Gaussianity
The following section briefly shows that the moment restrictions conditioned on the full instrument path reduce to moment restrictions conditioned on the individual instrument states in an OU system.
Since the OU process is jointly Gaussian, the vector is jointly Gaussian with zero mean for any . The conditional expectation of a jointly Gaussian vector is linear in the conditioning variables, so:
where . Since for all , the path-valued moment conditions reduce to moment conditions based on all individual variables .
We further show that the continuum of moments over and may be reduced to the single-parameter family in Eq. (11). Starting from just the continuum over
we define and write, using linearity of expectation
Evaluating the first term to zero and using stationarity yields:
which is equivalent to the continuum of moments over both and .
Proof for Proposition 2
The proof for Theorem 2 consists of three steps.
Step 1: reduction to rank condition
Given is the ODE system with states and forcing term :
Furthermore, sampling random lags , integrating the first row of the covariance ODE, and stacking the equations results in the linear system described in Eq. (14)
where
and . The parameter matrix is uniquely determined iff .
Step 2: Trajectory spans
For the multi-input LTI system, we can determine the Kalman controllability of the pair via the rank condition of the controllability matrix , defined as:
This condition guarantees that every eigenmode of can be excited through some combination of input and delays. This equivalently means that the controllable subspace equals $\mathbb{R}^a When is fully controllable and the diffusion of is not degenerate, implying , the trajectory could still fail to span , only if the initial condition is “unluckily” aligned with the system dynamics and control input.
In standard control problems, the set of such initial conditions has measure zero when is randomly sampled, and thus usually this setting only obtains limited consideration. In our case however, is not chosen freely, but fixed by the full system dynamics via the stationary Lyapunov equation. Therefore, it remains to be shown that given the control input in form of the autocorrelation of process , the initial condition does not lie in such a subspace, in which the eigenmodes of are not fully visible in the trajectory. The following proof shows that given a non-degenerate instrument variation and controllability, the space covered by the is guaranteed to stretch .
Lyapunov condition. We first study the stationary covariance matrix , which satisfies the Lyapunov equation
where
and the block-diagonal diffusion matrix is given by
Evaluating sub-blocks of Eq. (35) for and results in:
and
Span analysis. Next, we assume the existence of a direction that defines a subspace not covered by the trajectory, such that
Now, we define . Since is real-analytic in , so is and the derivatives of exist everywhere on . Equation (40) implies that every derivative of is zero, as the direction is never observed along the entire trajectory.
We will show that this condition cannot be fulfilled under controllability by using the evaluations of and the stationary Lyapunov conditions derived earlier, Eq. (38) and Eq. (39).
We now investigate the trajectories of the covariances and the instrument’s lagged covariances jointly.
Starting with we obtain the condition . From the first derivative, we obtain:
For the second derivative, we obtain after inserting the first derivative:
Separately, we now multiply Eq. (39) with :
and now use Eq. (42) to obtain:
Subtracting this equation from Eq. (43):
Now we can insert Eq. (38):
Since we assume a non-degenerate diffusion for , we conclude: .
Higher-order derivatives. We can now similarly cascade through the expressions for the higher derivatives. The general form for a higher derivative is given by:
We now proceed by induction and assume as induction hypothesis that for all . For arbitrary , we obtain first observe
We now use the induction hypothesis to kill all terms of for , so that only the following remains:
As before, we separately multiply Eq. (39) by and :
To obtain the value for , we multiply the general derivative at and use the inductive hypothesis for all terms with :
Substituting this yields:
We now subtract Eq. (50) from Eq. (53) and obtain:
Again using Eq. (38):
which as before under a non-degenerate instrument diffusion implies and thus completes the induction.
By Cayley-Hamilton, we can express and higher order polynomials through the lower order polynomials, thus we do not obtain further conditions from higher derivatives and only need to consider all derivatives up to .
with .
If has full row rank, it has a trivial left nullspace, and no such direction exists.
Consequently, the full rank of guarantees that the trajectory of spans , and the degeneracy of a badly chosen initial condition cannot occur.
Step 3: Sampling points
If the trajectory of spans , the same is true for the integrated covariance curve, as any direction orthogonal to its integrals would also need to be orthogonal to the covariance curve itself. Hence, tuples of timepoints, where exist. Degenerate choices of sampling points can still occur. Intuitively, this happens, when the sampled times repeatedly hit an eigenfrequency of the system, such that the columns of are linearly dependent. However, such sampling points lie on a lower-dimensional subset of the sampling space. Thus, as the timepoints are drawn from a continuous distribution over positive sampling times, this set has Lebesgue measure zero.
Consequently randomly drawn lags almost surely give and identify .
Note: Sufficiency of less timepoints. Each instrument process contributes one moment condition at every sampled timepoint , giving a total of moment conditions for sampled timepoints. Compared to the parameters that are identified, this generally already puts the linear equation system Eq. (14) in the overidentified setting, if . The reason for this is that the correlation with different instrument processes might excite different and partially overlapping eigenmodes of matrix . Under the controllability criterion, each instrument excites at most eigenmodes, and all instruments jointly excite exact eigenmodes. Thus, given controllability, the number of timepoints required for the just identified setting lies between and . Sampling from all instrument processes at times thus gives a conservative identification strategy.
Estimator Consistency in the Linear Case
We present two estimators based on either the integral weak form formulation of the covariance ODE or the differential formulation. We show consistency for the integral form of the estimator.
Integral linear IV estimator. The fixed number of lags , with , is drawn from a continuous distribution on , as defined in Theorem 2. Further, denote
We define
and stack the blocks as and . Integrating the covariance ODE gives
We assume are observed at times , with positive, i.i.d. gaps having known density , which is bounded, positive on , continuous and independent of the process. We may then define -timestep gaps as and, considering the next samples, compute the expected number of successive samples at each time gap as . We choose , such that our sampling interval covers the maximum lag to be evaluated. Each integrated block is then estimated by
Following Walk [48], we define a kernel and bandwidth , with . The bandwidths are chosen as , with constants and . We use this kernel to define a Nadaraya-Watson estimator to nonparametrically regress the covariance function at the chosen lags . The covariance function at the lag does not admit an estimator in the form of a simple sample average, as we almost surely do not observe a sample at exactly , thus, we use this nonparametric first stage. The regression function takes the form of . Further, we define which selects the subsequent point indices, whose lag distributions are positive at the target lag . We then estimate the covariance function at lag zero and each sampled lag as follows:
Further, we denote
and . We fit the sample moments by least squares. The analytic minimizer of Eq. (59) can be obtained as
which gives the final parameter estimates for the integral linear estimator.
Theorem 3 (Consistent estimator in the OU setting). In the setting of Theorem 2, the estimator in Eq. (63) is consistent, i.e., and as .
Proof. We start by showing the consistency of the integrated blocks. Stationarity and ergodicity, together with finite second moments of the process imply that .
To show consistent estimation of , we first notice that and write
We then estimate the via the sample average as described in Eq. (60). Using the independence of the observation times from the process implies that the process is stationary and ergodic. Further, we can show integrability by using Cauchy Schwarz and stationarity
where the first inequality comes from using the triangle inequality over the sum up to timepoints. This thus allows to invoke Birkhoff’s ergodicity theorem [13] and yields .
Following Walk [48], we show the consistency of the kernel regression of with either a uniform or Gaussian kernel. First notice that the first equation in Eq. (61) can be written as a weighed sum of Nadaraya-Watson estimators for each .
with
For each the sequence of samples is geometrically mixing, as seen from the OU transition matrix, which takes the form of a matrix exponential. Geometric mixing is stronger than the polynomial mixing required by Walk [48]. Thus, we may choose with any and . Consequently, each of the estimators fulfills the conditions presented in Walk [48] and is consistent. As the weights are nonnegative and sum up to one, the average of these estimators and thus the final estimate for the endpoint covariance are consistent as well. This yields , as well as through the continuous mapping theorem, and for the stacked matrices and .
If the identification condition defined in Eq. (13) holds, matrix has full rank. Hence, is almost surely invertible. We use the least-squares solution for the final estimate of the parameter matrix. Following the continuous-mapping theorem, this function is continuous around an open set of the true matrix . Thus, given the consistent estimation of and , the estimate of is consistent.
On a simulation grid. The nonparametric first stage using the kernel-based estimation of can be replaced by a simple sample average in case of working on a simulation grid with random dropouts defined by a simulation interval and a uniformly random dropout percentage per point , as in such a setup each has a non-zero chance of being sampled. In this case, we can fix the kernel bandwidth to , which retrieves the standard sample average for the covariance estimation at the given lag . We note that this discrete version does not keep the previously presented consistency result due to numeric approximation errors.
Differential linear IV estimator. As a second estimator, we propose the differential estimator. We define the differential IV estimator by binning the covariances across lags to estimate the covariance curves on a fine grid in the first stage. In the second stage we then differentiate the curves at the lags , which are sampled as previously described, and then solve an equation system based on the differential form of the covariance ODE via least squares. The preceding consistency argument for the integral estimator does not extend directly to this differential form. Establishing consistency would require a separate analysis of the derivative estimator given the specific smoothing and sampling schemes.
Influence of a non-diagonal diffusion matrix.
In this section, we discuss the effects of a non-diagonal diffusion matrix for the linear case specifically. As mentioned in Section A, the moment conditions themselves remain valid assuming a non-diagonal diffusion matrix, as long as exogeneity of the instrument is fulfilled. Specifically, in case of an OU process this requires .
However, we note that the identification argument presented in Theorem 2 might not hold in case of diffusion mixing of and . In this case, even under the required controllability condition, the initial condition derived via the Lyapunov equation, as done in Section E, can be unluckily chosen such that the resulting covariance curves do not cover the required state space of . Consequently, in this case the moment equations do not necessarily identify the drift function anymore.
Nevertheless, we empirically investigated the effect of two special cases of non-diagonal diffusion matrices in OU-processes on our proposed estimation, as shown in Table 2.
| Configuration | IV-SDE MSE (total) |
| , | 0.0036 |
| , | 0.0068 |
| , | 0.0151 |
| , | 0.0162 |
| , | 0.0031 |
| , | 0.0009 |
| , | 0.0011 |
| Violation (dense, ) | 0.2306 |
Table 2. Total MSE of the IV-SDE estimator under different diffusion configurations and mixing strengths.
In the first case, we mix the diffusions between and with increasing strength up to the level of the diagonal entry, thus and . The results show that with increasing mixing strength the MSE of the estimation increases. Stronger mixing increases the variance of the outcome and thereby increases the variance of the moment conditions, resulting in lower estimation efficiency.
In a second experiment, we mix the diffusions between and . Interestingly, moderate mixing may decrease the MSE of the estimation. The increased coupling between process and increases the effective instrument strength and thus allows for a better effect estimation. Beyond a certain mixing level, however, the increase in the overall estimation variance dominates this gain in relevance, causing the estimation error to increase again. Further, the experiments confirm that a dense covariance matrix violates the assumptions, resulting in a higher estimation error.
The signature kernel
The signature kernel ([26, 29]) relies on the signature features of continuous bounded variation paths , where describes the tensor algebra over . These features can be understood as a sequence of n-fold iterated integrals of the path against itself, which together give a universal feature map of continuous paths. The signature kernel between paths , is the tensor-algebra inner product of their signatures, . The kernel can be efficiently evaluated without explicitly computing the signature features by using the kernel trick, which then requires solving an associated hyperbolic PDE ([38]).
Experimental Details
The linear experiments were performed on CPU. The nonlinear experiments were run on a single A100 GPU in under two hours for all evaluations.
Linear (OU) Experiments
The linear experiments were all simulated with the following SDE system:
where for . Unless stated otherwise, we use .
Parameter sampling. All non-zero drift coefficients are sampled uniformly from , ensuring existing edges of the sparse connectivity graph are bounded away from zero. Diffusion coefficients are sampled uniformly from . All sampled systems are filtered for stability (negative real parts of all eigenvalues of ) and controllability (full rank of the controllability matrix defined in Eq. (13)).
Simulation. For the left plot in Figure 2, trajectories are simulated by sampling from the analytic transition densities at irregularly sampled observation times. The irregular observation density is set to be uniform on an interval of . We evaluate each method on 8000 sample paths of length s, initialized from the analytically determined stationary distribution. For the plots in Figure 2 in the middle and right, we sampled the trajectories on a simulation grid of 0.01s, kept a random small subset of points and used the IV-estimator on a simulation grid, as described in Section F.
Experiment-specific settings. In the confounding strength experiment, we simultaneously vary and over the range , sampling 200 random systems across all confounding values.
For the covariate dimension experiment, we sample 30 systems in total. For the instrument strength experiment, we sample 80 systems in total, varying over [0.1, 0.8].
Baselines. We note that the only available baselines, besides the naive MLE estimator, for causal IV methods in time are presented in Mogensen [31] and Thams et al. [46], both of which are designed for discrete time methods. As both were not designed to handle irregularly spaced timepoints in continuous-time systems, we cannot directly compare them fairly on the same data. Thus, besides applying the VAR(1) estimator naively on irregular samples, we also sample the same number of regularly spaced timepoints from the simulated trajectories, and apply the discrete-time estimators on these.
To construct the MLE estimator, we assume the full system to be Markov with respect to just the observed states (, , ) and use the analytically available and exact Gaussian transition densities to estimate the drift parameters.
We applied the discrete VAR(1) estimator on regularly sampled timepoints with spacing of 0.2s and match the number of continuous-time timepoints. This yields an estimate for the discrete-time transition matrix. We estimate the continuous-time target parameters from the transition matrix by applying the matrix logarithm and dividing by the sampling interval. We also naively apply the discrete time estimator on the irregular timepoints.
We further compare to the discrete-time IV method presented Mogensen [31] which estimates the normalized parameters using integrated covariance matrices. Here, the normalized parameters correspond to the ratio . The method does not identify the target parameters themselves, thus we need to compare our results to their ratio estimate. We also apply this method on the regularly spaced timepoints.
Extended results discussion. Table 3 shows the mean coefficient error across all 200 simulated systems, with 20 sampled systems per confounding strength and irregular spacing. The results clearly demonstrate smaller estimation errors of the IVSDE estimators under stronger confounding. Both IV estimators, the differential IVSDE estimator (IVSDE-diff), which bins the data across 0.05s bins, and the continuous-time integral IVSDE estimator (IVSDE-int) presented in Section F perform similarly well on the data. In case of minimal or no confounding, the MLE yields slightly lower estimation errors, as it uses the full transition densities and is thus more efficient. The naively applied VAR(1) method fails on irregularly spaced data.
| Confounding strength | MLE full | VAR-1 | VAR-1 (reg.) | IVSDE-diff | IVSDE-int |
| 0.1 | 0.0069 | 0.6590 | 0.0516 | 0.0104 | 0.0123 |
| 0.2 | 0.0379 | 1.2766 | 0.0625 | 0.0148 | 0.0192 |
| 0.3 | 0.0691 | 1.5407 | 0.0576 | 0.0182 | 0.0202 |
| 0.4 | 0.1244 | 1.1334 | 0.0464 | 0.0244 | 0.0176 |
| 0.5 | 0.1146 | 0.8761 | 0.0431 | 0.0097 | 0.0137 |
| 0.6 | 0.1746 | 0.8853 | 0.0613 | 0.0214 | 0.0184 |
| 0.7 | 0.2065 | 0.9870 | 0.0456 | 0.0112 | 0.0136 |
| 0.8 | 0.2112 | 0.6470 | 0.0506 | 0.0225 | 0.0126 |
| 0.9 | 0.2397 | 1.0516 | 0.0675 | 0.0255 | 0.0185 |
| 1.0 | 0.2359 | 0.9859 | 0.0616 | 0.0309 | 0.0290 |
Table 3. Mean per-system parameter RMSE over 20 systems. (reg.) denotes that regularly sampled timepoints were used.
The results for the direct ratio estimation presented in Table 4 suffer from the same discrete sampling bias as the discrete VAR(1) method. As a consequence, using the proposed IVSDE method to first individually estimate the parameters and then construct ratio estimates still outperforms this direct ratio estimation, despite being a more complex two-step estimation.
| Confounding strength | MLE full | VAR-1 | VAR-1 (reg.) | IVSDE-diff | IVSDE-int | Direct ratio (reg.) |
| 0.1 | 0.0472 | 0.8777 | 0.3202 | 0.0166 | 0.0174 | 0.1005 |
| 0.2 | 0.1711 | 1.9936 | 0.1894 | 0.0504 | 0.0526 | 0.0613 |
| 0.3 | 1.2192 | 2.2831 | 0.1939 | 0.0772 | 0.0649 | 0.3011 |
| 0.4 | 0.3261 | 2.1911 | 0.2962 | 0.0218 | 0.0233 | 0.1542 |
| 0.5 | 0.5827 | 1.6280 | 0.2167 | 0.0338 | 0.0348 | 0.1127 |
| 0.6 | 1.1755 | 1.2828 | 0.2407 | 0.0344 | 0.0442 | 0.1520 |
| 0.7 | 2.6015 | 3.6445 | 0.2048 | 0.0305 | 0.0261 | 0.2258 |
| 0.8 | 15.2417 | 3.0491 | 0.5627 | 0.0615 | 0.0566 | 0.2535 |
| 0.9 | 84.2825 | 2.4190 | 0.3090 | 0.0916 | 0.0794 | 0.1910 |
| 1.0 | 1.7591 | 1.4126 | 0.2655 | 0.0462 | 0.0372 | 0.2251 |
Table 4. Ratio RMSE. Ratio RMSE across varying confounding strength. Each value represents the mean over 20 sampled systems.
Kernel-based estimation of a basis-function expansion
Simulation. We simulate paths from the following nonlinear SDE system, where all processes are one-dimensional except the instrument process , which is three-dimensional ():
where the confounding process follows a nonlinear mean-reverting dynamics, resulting in a non-Gaussian distribution of . The drift of is parameterized using two linear expressions in and , and pairs of radial basis functions symmetric about the origin, which preserves the zero mean of process . As described in the main text, we assume access to densely sampled observations and therefore use the time series directly on the simulation grid. In settings with coarser sampling, simulation-based estimation methods would be required to reliably approximate the integral terms in the residual .
Basis function parametrization. We parametrize the target drift using a basis function expansion consisting of radial basis functions (RBFs) with centers placed uniformly over , covering approximately 96% of the marginal distribution of under stationarity, together with two linear terms in and . The bandwidth of each RBF is set to the ground truth . The resulting parametrization is:
where are the parameters to be estimated.
Closed-form estimation. Given the parametrization , which is linear in parameters, where collects the basis function evaluations at time , the residual is linear in :
where is the time-integrated basis function vector over the horizon , approximated via numerical quadrature on the dense simulation grid, and describes the difference . As a result, the V-statistic risk in Eq. (19) reduces to a quadratic objective in , and the minimization problem admits the closed-form kernel ridge regression solution:
where stacks the integrated basis vectors across all sampled path sections, is the signature kernel Gram matrix evaluated on the instrument paths , collects the observed outcome increments , and is the regularization parameter. This allows the full estimation to be performed in a single linear solve, without iterative optimization.
Sampling scheme. We sample 5000 path segments, each consisting of the forward prediction horizon and the lookback time over , which is used as the instrument path. We use the following hyperparameters: prediction horizon s, stride between consecutive sections s, and lookback window for the instrument path s and .
Nonlinear drift function with a neural network
Furthermore, we show that the kernel-based estimation scheme also allows for a neural parameterization of the drift function. We keep the same setup for the instruments and covariates as described in the previous section. The drift of now depends on via a sigmoid nonlinearity , resulting in the following:
where we choose . We parameterize with a small MLP with two inputs , two hidden layers of dimension 16, and tanh activation functions.
We sample path segments and optimize the empirical risk in Eq. (19) with the following hyperparameters using the Adam optimizer: integration horizon s, lookback s, weight decay , learning rate , and gradient steps.
Diabetes dataset.
Setup. We setup a semi-synthetic experiment to demonstrate the applicability of our proposed method on problems of real-world complexity and relevance. We motivate our setting from pharmacokinetics / pharmacodynamics models of type 2 diabetes. These models describe the dynamics and interactions of insulin and glucose concentrations in the blood. In type 2 diabetes specifically, one specific mechanism of the disease is found in the insulin resistance build up by patients, as muscle and fat cells take up glucose less efficiently. Consequently, identifying the insulin sensitivity in such setting allows to judge a patient’s personal disease progression and guide future insulin dosing. Both insulin production as well as blood glucose concentration can be confounded by unobserved gut glucose. Here, the insulin production is stimulated by incretin hormones, such as GLP-1, which are secreted by enteroendocrine cells in the gut, while intestinal glucose absorption provides a direct additive contribution to the blood glucose concentration.
The setup thus fulfills the requirements of our setting, with scheduled external insulin dosages as instruments, the insulin concentration as the covariate process, glucose concentration as the outcome process, and the insulin sensitivity as the estimand. It illustrates our method in a system combining nonlinear interactions, feedback, and an unobserved common driver.
We follow the structural setup of the model presented in [33, 45], select the parameters for the simulation setting such that we obtain a stable SDE and set the instrument process to be a two-dimensional OU process, resulting in the following SDE system
| Parameter | Description | Value |
| Number of instruments | 2 | |
| Common instrument equilibrium mean | 0 | |
| Instrument mean-reversion rates | (0.4, 0.8) | |
| Instrument effects on | (0.35, 0.35) | |
| Instrument noise amplitudes | (0.5, 0.5) | |
| Effect of on | 0.60 | |
| Effect of on | 0.10 | |
| Decay rate of | 0.30 | |
| Noise amplitude of | 0.02 | |
| Effect of on | 2.10 | |
| Decay rate of | 0.10 | |
| Insulin sensitivity | 0.15 | |
| Noise amplitude of | 0.02 | |
| Constant inflow into | 0.05 | |
| Decay rate of | 0.05 | |
| Noise amplitude of | 0.005 | |
| Effect of on | 0.05 | |
| Decay rate of | 0.05 | |
| Noise amplitude of | 0.02 |
Table 5. Parameter values for the two-instrument diabetes dataset configuration.
We first center the SDE system, then apply our nonlinear estimator using a basis function expansion and the signature kernel to estimate the target parameters (Eq. (76)), and then transform the estimated parameters back to the original coordinate system.
We compute the final estimation error over the parameters after transforming back to the original coordinates.
Result and ablation. Furthermore, we run a small ablation over the parameters of the proposed nonlinear estimation method, specifically, the lookback, the residual integration horizon and the RBF bandwidth, as shown in Table 6. Overall, the results clearly show that the proposed IV-SDE method can estimate the causal effect with a lower error compared to the biased MLE estimate. Furthermore, the results remain stable across all settings, demonstrating the method’s robustness across reasonable parameter ranges.
| Study | Setting | Overall | ||
| Lookback | 0.2 | 0.0615 | 0.0126 | 0.0444 |
| 0.5 | 0.0113 | 0.0117 | 0.0115 | |
| 0.7 | 0.0371 | 0.0154 | 0.0284 | |
| 0.9 | 0.0477 | 0.0217 | 0.0370 | |
| Horizon | 0.1 | 0.0239 | 0.0094 | 0.0182 |
| 0.2 | 0.0398 | 0.0105 | 0.0291 | |
| 0.3 | 0.0236 | 0.0081 | 0.0177 | |
| RBF bandwidth | 0.3 | 0.0429 | 0.0271 | 0.0359 |
| 0.5 | 0.0398 | 0.0105 | 0.0291 | |
| 0.8 | 0.0211 | 0.0065 | 0.0157 | |
| MLE baseline | — | 0.1188 | 0.0763 | 0.0998 |
Table 6. Hyperparameter sensitivity in the diabetes model. in terms of RMSE. The standard setting across all runs is a Lookback of 0.7s, a horizon of 0.2 and a RBF bandwidth of 0.5.
Although this SDE system does not fulfill the linear growth assumptions of our theoretical setup defined in § 3, the simulated trajectories remain numerically stable under the chosen parameter settings, and our proposed estimator accurately retrieves the objective function. This shows that the estimator may also be applicable beyond the stated regularity conditions.
Alternative examples. We note that further examples for confounded dynamic settings fulfilling the main IV assumptions can be found e.g. a thermodynamic model of two bodies, where the thermal conductivity between them is the estimand, a known heat source drives one body, and the ambient temperature acts as a common confounder. Another motivating example concerns the interaction between two brain regions, where the stimulation of one region by an e.g. optogenic external impulse acts as the instrument process, while signal from a third region acts as a common confounder.
References
- [1]Elisabeth Ailer, Jason Hartford, and Niki Kilbertus. Sequential underspecified instrument selection for cause-effect estimation. In International Conference on Machine Learning, pp. 408–420. PMLR, 2023. URL https://arxiv.org/abs/2302.05684.
- [2]Elisabeth Ailer, Niclas Dern, Jason Hartford, and Niki Kilbertus. Targeted sequential indirect experiment design. In The Thirty-eighth Annual Conference on Neural Information Processing Systems, 2024. URL https://openreview.net/forum?id=U3Rgdb4l9.arxiv.org/abs/2405.19985
- [3]Katherine Baicker, Sarah L. Taubman, Heidi L. Allen, Mira Bernstein, Jonathan H. Gruber, Joseph P. Newhouse, Eric C. Schneider, Bill J. Wright, Alan M. Zaslavsky, and Amy N. Finkelstein. The oregon experiment-effects of medicaid on clinical outcomes. New England Journal of Medicine, 368(18):1713–1722, 2013.DOI
- [4]Alexander Balke and Judea Pearl. Bounds on treatment effects from studies with imperfect compliance. Journal of the American Statistical Association, 92(439):1171–1176, 1997. doi: 10.1080/01621459.1997.10474074.DOI
- [5]Richard Bellman and Karl Johan Åström. On structural identifiability. Mathematical Biosciences, 7 (3–4):329–339, 1970. doi: 10.1016/0025-5564(70)90132-X.DOI
- [6]Andrew Bennett, Nathan Kallus, and Tobias Schnabel. Deep generalized method of moments for instrumental variable analysis. Advances in neural information processing systems, 32, 2019. URL https://arxiv.org/abs/1905.12495.
- [7]Andrew Bennett, Nathan Kallus, Xiaojie Mao, Whitney Newey, Vasilis Syrgkanis, and Masatoshi Uehara. Minimax instrumental variable regression and l_2 convergence guarantees without identification or closedness. In The Thirty Sixth Annual Conference on Learning Theory, pp. 2291–2318. PMLR, 2023. URL https://arxiv.org/abs/2302.05404.
- [8]A.R. Bergstrom. Continuous time stochastic models and issues of aggregation over time, volume 2 of Handbook of Econometrics. Elsevier, 1 edition, None 1984. doi: None. URL https://ideas.repec.org/h/eee/ecochp/2-20.html.
- [9]Manudeep Bhuller, Gordon Dahl, Katrine Løken, and Magne Mogstad. Incarceration, recidivism, and employment. Journal of Political Economy, 2020.
- [10]Andrew Chesher. Identification in nonseparable models. Econometrica, 71(5):1405–1441, 2003. doi: https://doi.org/10.1111/1468-0262.00454. URL https://onlinelibrary.wiley.com/doi/abs/10.1111/1468-0262.00454.
- [11]Tatyana Deryugina, Garth Heutel, Nolan H. Miller, David Molitor, and Julian Reif. The mortality and medical costs of air pollution: Evidence from changes in wind direction. American Economic Review, 109(12):4178–4219, December 2019. doi: 10.1257/aer.20180279. URL https://www.aeaweb.org/articles?id=10.1257/aer.20180279.
- [13]Rick Durrett. Probability: Theory and Examples. Cambridge University Press, 5 edition, 2019. doi: 10.1017/9781108591034.DOI
- [14]Jesús Fernández-Villaverde and Juan F Rubio-Ramírez. Estimating macroeconomic models: A likelihood approach. The Review of Economic Studies, 74(4):1059–1087, 2007.
- [15]B Friedlander, P Stoica, and T Söderström. Instrumental variable methods for arma parameter estimation. IFAC Proceedings Volumes, 18(5):29–36, 1985.
- [16]Marion Gilson and Paul Van den Hof. Instrumental variable methods for closed-loop system identification. Automatica, 41(2):241–249, 2005.
- [17]Lars Peter Hansen. Large sample properties of generalized method of moments estimators. Econometrica, 50(4):1029–1054, 1982. ISSN 00129682, 14680262. URL http://www.jstor.org/stable/1912775.
- [18]Lars Peter Hansen and Jose Alexandre Scheinkman. Back to the future: Generating moment implications for continuous-time markov processes. Working Paper 141, National Bureau of Economic Research, September 1993. URL http://www.nber.org/papers/t0141.
- [19]Niels Hansen and Alexander Sokol. Causal interpretation of stochastic differential equations. Electronic Journal of Probability, 19(none), January 2014. ISSN 1083-6489. doi: 10.1214/ejp.v19-2891. URL http://dx.doi.org/10.1214/EJP.v19-2891.
- [20]Jason Hartford, Greg Lewis, Kevin Leyton-Brown, and Matt Taddy. Deep IV: A flexible approach for counterfactual prediction. In Doina Precup and Yee Whye Teh (eds.), Proceedings of the 34th International Conference on Machine Learning, volume 70 of Proceedings of Machine Learning Research, pp. 1414–1423. PMLR, 06–11 Aug 2017. URL https://proceedings.mlr.press/v70/hartford17a.html.
- [21]M. Hernan, B. Brumback, and JM. Robins. Marginal structural models to estimate the joint causal effect of nonrandomized treatments. Journal of the American Statistical Association, 96(None):440–448, June 2001. URL https://ideas.repec.org/a/bes/jnlasa/v96y2001mjunep440-448.html.DOI
- [22]Miguel A. Hernán and James M. Robins. Causal Inference: What If. Chapman & Hall/CRC, Boca Raton, 2020. Available online at https://www.hsph.harvard.edu/miguel-hernan/causal-inference-book/.
- [23]Guido W. Imbens and Whitney K. Newey. Identification and estimation of triangular simultaneous equations models without additivity. Econometrica, 77(5):1481–1512, 2009. doi: https://doi.org/10.3982/ECTA7108. URL https://onlinelibrary.wiley.com/doi/abs/10.3982/ECTA7108.
- [24]P Joseph, J Lewis, and J Tou. Plant identification in the presence of disturbances and application to digital adaptive systems. Transactions of the American Institute of Electrical Engineers, Part II: Applications and Industry, 80(1):18–24, 1961.DOI
- [25]Vladimir R Kostic, Hélène Halconruy, Timothée Devergne, Karim Lounici, and Massimiliano Pontil. Learning the infinitesimal generator of stochastic diffusion processes. In The Thirty-eighth Annual Conference on Neural Information Processing Systems, 2024. URL https://openreview.net/forum?id=H7SaaqfCUi.arxiv.org/abs/2405.12940
- [26]Darrick Lee and Harald Oberhauser. The signature kernel. In Signature Methods in Finance: An Introduction with Computational Applications, pp. 85–124. Springer, 2025.arxiv.org/abs/2305.04625
- [27]Judith J. Lok. Statistical modeling of causal effects in continuous time. The Annals of Statistics, 36 (3), 6 2008. ISSN 0090-5364. doi: 10.1214/009053607000000820. URL http://dx.doi.org/10.1214/009053607000000820.
- [28]Lars Lorch, Andreas Krause, and Bernhard Schölkopf. Causal modeling with stationary diffusions. In International Conference on Artificial Intelligence and Statistics, pp. 1927–1935. PMLR, 2024. URL https://arxiv.org/abs/2310.17405.
- [29]Georg Manten, Cecilia Casolo, Emilio Ferrucci, Søren Wengel Mogensen, Christopher Salvi, and Niki Kilbertus. Signature kernel conditional independence tests in causal discovery for stochastic processes. In The Thirteenth International Conference on Learning Representations, 2025. URL https://openreview.net/forum?id=Nx4PMtJ1ER.arxiv.org/abs/2402.18477
- [30]Matthew A. Masten and Alexandre Poirier. Salvaging falsified instrumental variable models. Econometrica, 89(3):1449–1469, 2021. doi: https://doi.org/10.3982/ECTA17969. URL https://onlinelibrary.wiley.com/doi/abs/10.3982/ECTA17969.
- [31]Søren Wengel Mogensen. Instrumental processes using integrated covariances. In Conference on Causal Learning and Reasoning, pp. 620–641. PMLR, 2023.arxiv.org/abs/2211.00740
- [32]Søren Wengel Mogensen, Daniel Malinsky, and Niels Richard Hansen. Causal learning for partially observed stochastic dynamical systems. In Conference on Uncertainty in Artificial Intelligence, 2018. URL https://api.semanticscholar.org/CorpusID:215768132.
- [33]Parvaiz Ahmad Naik, Bijal M. Yeolekar, Kolade M. Owolabi, and Mahesh Yeolekar. Modeling and analyzing glucose-insulin interactions during diabetes through fractional dynamics in presence of glucagon. Journal of Advanced Research, 2026. ISSN 2090-1232. doi: https://doi.org/10.1016/j.jare.2026.01.020. URL https://www.sciencedirect.com/science/article/pii/S2090123226000457.
- [34]Grigorios A. Pavliotis. Stochastic Processes and Applications: Diffusion Processes, the Fokker–Planck and Langevin Equations, volume 60 of Texts in Applied Mathematics. Springer, New York, NY, 2014. ISBN 978-1-4939-1322-0. doi: 10.1007/978-1-4939-1323-7.DOI
- [35]Judea Pearl. Causality: Models, Reasoning, and Inference. Cambridge University Press, 2000. ISBN 0-521-77362-8.DOI
- [36]Jakob Runge, Sebastian Bathiany, Erik Bollt, Gustau Camps-Valls, Dim Coumou, Ethan Deyle, Clark Glymour, Marlene Kretschmer, Miguel D. Mahecha, Jordi Muñoz-Marí, Egbert H. van Nes, Jonas Peters, Rick Quax, Markus Reichstein, Marten Scheffer, Bernhard Schölkopf, Peter Spirtes, George Sugihara, Jie Sun, Kun Zhang, and Jakob Zscheischler. Inferring causation from time series in earth system sciences. Nature Communications, 10(1):2553, Jun 2019. ISSN 2041-1723. doi: 10.1038/s41467-019-10105-3. URL https://doi.org/10.1038/s41467-019-10105-3.
- [37]Sorawit Saengkyongam, Leonard Henckel, Niklas Pfister, and Jonas Peters. Exploiting independent instruments: Identification and distribution generalization. In International Conference on Machine Learning, pp. 18935–18958. PMLR, 2022.arxiv.org/abs/2202.01864
- [38]Christopher Salvi, Thomas Cass, James Foster, Terry Lyons, and Weixin Yang. The signature kernel is the solution of a goursat pde. SIAM Journal on Mathematics of Data Science, 3(3):873–899, January 2021. ISSN 2577-0187. doi: 10.1137/20M1366794. URL http://dx.doi.org/10.1137/20M1366794.
- [39]J. D. Sargan. The estimation of economic relationships using instrumental variables. Econometrica, 26(3):393–415, 1958. ISSN 00129682, 14680262. URL http://www.jstor.org/stable/1907619.DOI
- [40]Nora Schneider, Georg Manten, and Niki Kilbertus. Conservative continuous-time treatment optimization. arXiv preprint arXiv:2603.16789, 2026.arxiv.org/abs/2603.16789
- [41]Zikai Shen, Dimitri Meunier, Houssam Zenati, Arthur Gretton, Nathan Kallus, and Aurélien Bibaut. Instrumental variable analysis without structural equations, 2026. URL https://arxiv.org/abs/2604.24660.
- [43]Douglas Staiger and James H. Stock. Instrumental variables regression with weak instruments. Econometrica, 65(3):557–586, 1997. ISSN 00129682, 14680262. URL http://www.jstor.org/stable/2171753.
- [44]Adolf Stips, Diego Macias, Clare Coughlan, Elisa Garcia-Gorriz, and X. San Liang. On the causal structure between co2 and global temperature. Scientific Reports, 6(1):21691, Feb 2016. ISSN 2045-2322. doi: 10.1038/srep21691. URL https://doi.org/10.1038/srep21691.
- [45]Vijaya Subramanian, Jonatan I. Bagger, Vinayak Harihar, Jens J. Holst, Filip K. Knop, and Tina Villsbøll. An extended minimal model of ogt: estimation of α- and β-cell dysfunction, insulin resistance, and the incretin effect. American Journal of Physiology-Endocrinology and Metabolism, 326(2):E182–E205, 2024. doi: 10.1152/ajpendo.00278.2023. URL https://doi.org/10.1152/ajpendo.00278.2023. PMID: 38088864.
- [46]Nikolaj Thams, Rikke Søndergaard, Sebastian Weichwald, and Jonas Peters. Identifying causal effects using instrumental time series: Nuisance iv and correcting for the past. Journal of Machine Learning Research, 25(302):1–51, 2024.
- [47]Lars van der Laan, Nathan Kallus, and Aurélien Bibaut. Nonparametric instrumental variable inference with many weak instruments, 2026. URL https://arxiv.org/abs/2505.07729.
- [48]Harro Walk. Strong laws of large numbers and nonparametric estimation. In Luc Devroye, Bülent Karasözen, Michael Kohler, and Ralf Korn (eds.), Recent Developments in Applied Probability and Statistics: Dedicated to the Memory of Jürgen Lehn, pp. 183–214. Physica-Verlag HD, Heidelberg, 2010. ISBN 978-3-7908-2598-5. doi: 10.1007/978-3-7908-2598-5_8. URL https://doi.org/10.1007/978-3-7908-2598-5_8.
- [49]Kwan Wong and Elijah Polak. Identification of linear discrete time systems using the instrumental variable method. IEEE Transactions on Automatic Control, 12(6):707–718, 1967.
- [50]P.G. Wright. The Tariff on Animal and Vegetable Oils. Investigations in international commercial policies. Macmillan, 1928. URL https://books.google.be/books?id=hig5AAAAMAAJ.
