WorksMathematics
Estimation and Inference for the Joint Autoregressive Quantile-Expected Shortfall Model
Abstract
Expected shortfall is defined as the truncated mean of a random variable that falls below a specified quantile level and is widely recognized as an important risk measure. Motivated by the empirical observation of clustering patterns in financial risks, we consider a joint autoregressive model for both conditional quantile and expected shortfall. Existing estimation methods for such models typically rely on minimizing a nonlinear and nonconvex joint loss function, which is challenging to solve. We introduce a two-step regression framework to estimate the model parameters with theoretical guarantees. We further develop a Portmanteau test for model diagnostics and prove its asymptotic validity for Type I error control. Our empirical results on stock market data indicate that the proposed models effectively capture the clustering patterns and leverage effects on the conditional expected shortfall.
Introduction
Financial risk management has been a prominent research area for decades. In recent years, the expected shortfall has gained considerable attention as a risk measure in finance [32]. Notably, the fundamental review of the trading book, an integral part of Basel III reforms, announced its adoption of the expected shortfall to replace the Value-at-Risk as the standard risk measure for regulatory supervision in the year 2016 [4]. Let be the return of a financial asset over some time horizon and let be an information set available by time . For a given quantile level , let be the -level conditional quantile of given the information set , which is also referred to as the Value-at-Risk. Then, the -level conditional expected shortfall (ES) of can be defined as
Equation (1) can be interpreted as the expected return of an asset, given that its return is less than or equal to the -level conditional quantile. Unlike the Value-at-Risk that focuses on a specific quantile level, the conditional expected shortfall aggregates the tail information of beyond the conditional quantile, providing a more comprehensive representation of the tail risk.
Although the importance of the conditional expected shortfall is well recognized in different fields such as finance [22], operations research [30], and insurance [9], its estimation and statistical inference remain challenging tasks. This is primarily due to the non-elicitability of the expected shortfall, that is, there does not exist a loss function for which the minimizer of the expected loss is the expected shortfall [20]. Although the expected shortfall is not elicitable by itself, it is jointly elicitable with the quantile from a class of strictly joint loss functions [17]. Motivated by the joint loss function in Fissler & Ziegel [17], Dimitriadis & Bayer [13] and Patton et al. [29] proposed joint semi-parametric regression frameworks to estimate the -level conditional quantile and expected shortfall simultaneously. On the other hand, Barendse [2] introduced a two-step estimation approach by first estimating the conditional quantile via quantile regression, and then estimating the expected shortfall using a least squares regression with a constructed pseudo-response based on the estimated quantile function obtained from the first step. Motivated by Barendse [2], He et al. (2023) proposed estimation and inference procedures for linear expected shortfall models under the heavy-tailed data and the growing dimension regime for the covariates. Furthermore, Barendse [1] and Zhang et al. [40] proposed an -penalized expected shortfall regression for the high-dimensional regime in which the dimension of the covariates can be larger than the number of samples. Li et al. (2026) proposed an expected shortfall regression approach based on the optimization perspective considered in Rockafellar et al. [30].
In this manuscript, we aim to address the following issues in the context of modeling conditional expected shortfall for financial time series: (i) develop a model that effectively captures the risk patterns of financial markets; (ii) provide an easy-to-implement estimation procedure with theoretical guarantees; and (iii) construct a statistical test to assess the quality of the resulting estimator. We start with modeling the conditional expected shortfall with autoregressive structures, i.e., the current expected shortfall can be expressed as a parametric function of the past expected shortfalls and a set of covariates. We are motivated by the observed clustering pattern of market risks, where a bad trading day can increase the risk level of future trading days, reflecting an important empirical property of the global financial market [8].
The existing literature on other risk measures such as standard deviation and Value-at-Risk with autoregressive structures is rich. The standard deviation models include the Generalized AutoRegressive Conditional Heteroskedasticity (GARCH) and its variants [7, 26]. The model proposed in Engle & Manganelli [16] assumed certain autoregressive structures on the conditional quantile, which has been extensively applied in financial risk management and prediction [12], and various extensions have been developed [36].
However, limited work has been done on estimating and conducting model diagnostics for conditional autoregressive expected shortfall in the presence of dependent data, despite its importance as a risk measure that aggregates tail risk. Most existing work does not model the autoregressive structures of the conditional expected shortfall directly. For instance, Taylor [33] proposed a joint estimation approach in which they modeled the conditional quantile via Engle & Manganelli [16], and then assumed certain parametric structures on the ratio (multiplicative models) or the difference (additive models) between the conditional quantile and the conditional expected shortfall. A sequence of works, including Gerlach & Wang [19], Wang et al. [34], and Patton et al. [29], extends Taylor [33] from the perspectives of Bayesian approaches and the generalized autoregressive score framework [11]. The aforementioned works have several limitations that hinder their practical applicability to financial institutions. First, the joint loss function applied is highly non-linear and non-convex, making the resulting optimization problem computationally challenging to solve in practice. Second, the estimators obtained from this joint loss function are generally not asymptotically efficient, which limits their statistical performance. Moreover, even when estimation is feasible, a reliable diagnostic framework is important to assess model adequacy to meet the regulatory requirements for financial institutions. However, research on model diagnostics for expected shortfall remains relatively unexplored, with existing approaches largely relying on the joint elicitability of quantile and expected shortfall, as in [28], Du & Escanciano (2017), and [3].
This manuscript contributes to the growing financial econometrics literature on the use of expected shortfall in risk management in three key aspects. First, we propose to model the autoregressive conditional expected shortfall directly. Compared with existing literature [33, 19], our modeling framework offers greater flexibilities in learning the tail risk dynamics. We develop a computationally efficient two-step procedure to estimate the parameters of the expected shortfall models with theoretical guarantees. At the first stage, we solve an autoregressive conditional quantile regression problem as described in [16]; and at the second stage, we solve a least squares autoregressive regression problem with a surrogate response variable that depends on the autoregressive conditional quantile function obtained from the first stage. We establish the asymptotic properties of the proposed estimators and show that, owing to the orthogonality structure of our framework (see § 3–§ 4 for details), the quantile estimation error from the first stage is first-order negligible. Second, we develop a novel Portmanteau test to assess the goodness-of-fit of the expected shortfall model, and we establish a theoretical guarantee for Type I error control. We further demonstrate empirically that the proposed test exhibits higher power than existing approaches in § 5. Lastly, in the data application presented in § 6, we uncover a leverage effect in the expected shortfall of the U.S. stock market, i.e., the expected shortfall is more sensitive to previous losses than previous gains. In addition, motivated by the optimal weighted least squares scheme considered in Barendse [2], we construct a weighted least squares estimator for the proposed autoregressive expected shortfall model and show that this weighted estimator is more efficient than estimators obtained by existing approaches [29, 13], i.e., our proposed estimator has a smaller asymptotic variance.
The manuscript is organized as follows. § 2 introduces the proposed joint autoregressive quantile-expected shortfall framework. § 3 details the estimation and inference methodology. § 4 presents the theoretical results for the expected shortfall estimator. § 5 reports the results of the numerical experiments. § 6 encompasses the empirical data analysis. We end with a discussion in § 7.
A Joint Autoregressive Quantile-ES Model
Consider a time series with as the response variable and as the covariate vector at time , respectively. We allow the covariate vector to be endogenous or exogenous. In the endogenous case, consists of lagged values of , i.e., . In the exogenous case, includes additional covariates in addition to the lagged values of . For a given quantile level , let and be the -level (conditional) quantile and the expected shortfall of , respectively. Moreover, let be the sigma-algebra generated by for any . Let and be two -measurable functions with true underlying parameters and . We model the conditional quantile and the ES defined in (1) as
To simplify the notation, we omit the dependence of and on in the rest of the paper. Our general model specification is motivated by empirical observations that risky days in the stock market tend to cluster together and financial risk changes smoothly over time [16]. Hence, it is natural to use certain autoregressive specifications to model such characteristics. To this end, we assume that both and have the following autoregressive structures:
where are user-specified autoregressive orders. For notational simplicity, let and . We have and . The functions and are pre-determined and used to model relationships between and and the covariates .
The selection of autoregressive orders and the functional forms of and in (3) depends on specific financial questions. In practice, it is crucial to select the appropriate model specifications for and . In § 3.2, we propose a joint quantile-expected shortfall backtesting procedure that allows us to perform statistical tests to assess model fit and determine the appropriate model specification. In the following, we outline three special cases of (3).
Example 1 (Symmetric Absolute Value Model). *For financial data with short-range dependencies, an autoregressive order of one is typically preferred. We set autoregressive orders to . When data exhibit symmetric sensitivities toward stock price impacts, both extremely high/low past returns have the same influence on the current risk level. To capture this pattern, we define the functions
and let
Example 2 (Asymmetric Slope Model). Numerous studies have shown that the current risk level exhibits different sensitivities to past losses compared to past gains. This phenomenon is referred to as the leverage effect [5, 10, 39]. To model such an effect, setting yields
where and correspond to and , respectively, and is the indicator function.
Example 3 (GARCH Model). Consider , where is a sequence of independent and identically distributed standard normal random variables and
This model has been widely employed to analyze the autoregressive structure in the conditional volatilities of . For , the conditional quantile and expected shortfall functions are
Remark 2.1. The expected shortfall, as defined in (1), is a statistic that integrates tail information beyond the given quantile level . The two separate model specifications in (3) reflect the fact that the conditional expected shortfall may exhibit different dynamic behavior from the conditional quantile function, due to the additional tail information not captured by the quantile. To illustrate, consider
Here, is a sequence of Uniform random variables independent of . The vector satisfies that given the history , is strictly increasing with respect to . For a fixed quantile level , we have
where and . Here, exhibits different dynamic behavior compared with due to the extra lag quantity .
Methodology
In this section, we propose a framework for estimating and performing statistical inference for the expected shortfall parameters in (3). We propose a two-step regression procedure for parameter estimation in Section 3.1. To perform model diagnostics, we construct a Portmanteau test to test whether the working conditional quantile and expected shortfall functions are correctly specified in Section 3.2.
Weighted Two-Step Autoregressive ES Regression
We propose to estimate the expected shortfall parameter using a two-step approach.
Let . This quantity can be interpreted as a score function for and under the joint quantile-expected shortfall framework in (2); see also He et al. (2023) and Barendse [2] for similar score functions for the linear quantile-expected shortfall model. In the following proposition, we establish an orthogonality property for the score function in the context of an autoregressive quantile-expected shortfall model with time series data.
Proposition 3.1. For any time , we have
Proposition 3.1 states that, given the history , is an identification function for and and is locally robust to small perturbations of around the true value . Motivated by the above observation, the estimator for can be obtained by first estimating through solving a nonlinear quantile regression problem, followed by estimating using the score function with a plug-in quantile estimator .
Assume that the conditional quantile and expected shortfall functions and have autoregressive structures as in (3). In the first step, we propose to solve the following non-linear quantile regression problem:
where is the check loss function and is the parameter space for . Given , we propose to estimate the expected shortfall parameters by minimizing the summation of the squared score function :
where is the parameter space for . The problem (5) can be seen as a non-linear least squares problem with constructed pseudo-response variables .
The estimator in (5) is generally not asymptotically efficient, i.e., it does not have the minimal asymptotic variance, due to the presence of conditional heteroskedasticity in the regression problem (5). In the existing literature, a weighted least squares estimator has been shown to be generally more efficient than the unweighted least squares estimator, provided that the weighting function in the regression problem is set to be the inverse of the conditional variance of the regression error terms (White [35]; Wooldridge [37]). Hence, to achieve a more efficient estimator than , the key lies in consistently estimating the conditional heteroskedasticity terms in the regression problem (5). It can be shown that
However, there is no explicit parametric form of the term under the general data generating process given in (2). Estimating the conditional variance can be challenging without further modeling assumptions.
To this end, we propose a working model for the weighting function under the location-scale family time series. Specifically, the time series can be written in the following form:
where and are 0 and , respectively. As shown in Proposition S5.1 of Section S5.1 in the online supplementary material, (7) is equivalent to a general class of location-scale time series models with independent and identically distributed () innovations, provided that is an sequence of appropriately scaled random variables and is independent of for any . Under the assumption on the innovation process, the conditional variance of the regression error terms in (5) can be expressed as
Hence, for . Motivated by the above derivation, we set the weighting function for the -th observation as with the corresponding true parameters .
Let and be estimators obtained from solving (4) and (5), respectively. We propose a weighted expected shortfall estimator that takes the following form:
For any and , the -level confidence interval for can then be constructed as
where and
and is the cumulative distribution function for a standard normal distribution.
Additionally, we also consider an alternative approach to construct confidence intervals based on random weighting bootstrap in § 5 for numerical stability. We defer the details of this construction to Section S2.2 of the online supplementary material.
Moreover, it should be noted that while our choice of the weighting function is motivated by the location-scale time series models with i.i.d. innovations, the validity of the proposed inference procedure does not rely on such specific data-generating assumptions, as illustrated by Theorems 4–5 of § 4. Under such an i.i.d. assumption, our weighted estimator attains asymptotic efficiency within the class of joint -estimators considered in Fissler & Ziegel [17], as demonstrated in Corollary 4.1 of § 4.
Finally, we provide a generic algorithm to solve (9). Our optimization steps include Broyden–Fletcher–Goldfarb–Shanno (BFGS) Fletcher & Reeves [18] and Nelder-Mead Nelder & Mead [27] algorithms. Our implementation is based on applying optim function in R. We note that (4) and (5) can be solved by slight modifications of Algorithm 1.
Remark 3.1. The optimal weighting function derived in this section relies on the assumption that the data are generated from a location-scale family time series model with i.i.d. innovations. The weighting function is no longer optimal when this assumption is violated. However, since the term remains an important component of (6), our weighting function can still be viewed as a working approximation to the optimal weights when (7) no longer holds. We conduct numerical experiments to quantify the efficiency loss of our weighted estimator (9) when the data-generating
process deviates from the location-scale family with i.i.d. innovations. Our results show that, even when the working weighting function is suboptimal in such settings, the efficiency loss is very small. See § 5, Model (5.2), and Section S9 of the online supplementary material for details.
Algorithm 1 A Framework for Solving (9)
Step 1: Randomly sample 10,000 initial parameter vectors from a uniform distribution.
Step 2: Among the 10,000 initial parameters, select 10 vectors that return the lowest empirical loss value in (9).
Step 3:
for do
Initialize: Set the starting value .
Refinement loop: Repeat the following procedure 5 times and output :
(i) BFGS update: Obtain by optimizing (9) using the BFGS algorithm initialized at .
(ii) Perturbation: Add a small Gaussian perturbation
(iii) Nelder–Mead update: Obtain by optimizing (9) with Nelder–Mead algorithm initialized at .
(iv) Perturbation: Repeat step (ii).
end for
Step 4: Compute the empirical loss in (9) for . Select the final estimator as the vector achieving the smallest empirical loss.
Model Diagnostics via a Portmanteau Test
Under the autoregressive quantile-ES framework in (3), it is important to accurately determine the appropriate autoregressive orders and functional forms of and . In this section, we assume that the data are generated by the location-scale family time series with i.i.d. innovations. Under this assumption, we develop a Portmanteau test for model diagnostics [23] (Li & Mak 1994).
Let . Under the assumption that is generated by the location-scale family time series with i.i.d. innovations, and that both quantile and expected shortfall functions are correctly specified with true parameters and known, it can be shown that is a sequence of i.i.d. random variables, see details in Proposition S5.1 in the online supplementary material. Therefore, the dependence structure of reflects whether and correctly specify the conditional quantile and expected shortfall of , respectively. Motivated by this observation, we propose the following model diagnostic procedure based on detecting serial dependence in .
For any positive integer , let . We develop a Portmanteau test to test the following hypothesis problem:
In practice, it is infeasible to examine all lag levels. To this end, we pick a positive integer and consider testing the hypothesis problem
where . The integer should be chosen such that and are approximately independent. Common choices of include . Our simulation results in § 5 show that the empirical performance of the Portmanteau test is robust to the choice of . In the real data applications in § 6, we set , which corresponds to the length of two trading weeks. We now outline the procedure for performing hypothesis testing on (12); detailed derivations of the proposed testing procedure are deferred to Section S2.3 of the online supplementary material. The test is based on the estimators and obtained by (4) and (5), respectively. We construct the estimated noise term as .
Let be the vector of the sample autocorrelation coefficients of up to the lag . The derivation steps given in the proof of Theorem 6 show that under , is asymptotically normally distributed with mean and variance . Furthermore, converges in distribution to a random variable.
The general procedure for testing (12) is summarized in Algorithm 2. The closed form expression of involves many intermediate quantities and is omitted from the main manuscript. We refer the reader to Section S2.3 in the online supplementary material for the details on the derivation and estimation of .
Algorithm 2 The Portmanteau Test for Testing (12).
Step1: Set a positive integer . Typical choices of include .
Step3: Compute and .
Step4: Estimate from data.
Step5: Let . Reject the null hypothesis in (12) if the test statistic for a given confidence level .
Theoretical Results
We study the theoretical properties of the proposed two-step expected shortfall regression estimators in Section 3. We first show that the unweighted expected shortfall estimator is weakly consistent, and provide the convergence rate and asymptotic normality of in Section 4.1. Parallel theoretical results for the weighted estimator are presented in Section 4.2. The theoretical guarantee of the proposed Portmanteau test is included in Section 4.3. We defer all assumptions required for the theoretical results to Section S3 of the online supplementary material.
We start with defining some notation. For a vector , let
for . For sequences and , we write if there exists a constant such that for all and if . We write if and if .
Let . For a function , let be the gradient of with respect to the parameter .
Unweighted Expected Shortfall Estimator
We derive the asymptotic properties of obtained by solving (5). The first step of our proposed approach involves solving an autoregressive quantile regression problem (4). Let
be an event characterizing the convergence rate of quantile estimator . The event has been shown to hold with high probability tending to 1 as increases (Xu & Härdle 2026), which implies that is weakly consistent with a mild rate. In the following, we will conduct our analysis, conditioned on the high-probability event .
We start by showing that obtained from (5) is weakly consistent. Our theoretical results require a series of regularity assumptions on the smoothness of quantile-expected shortfall functions, the existence of certain envelope functions, the stationarity and ergodicity conditions, and identifiability conditions. Specifically, our theoretical analysis requires the existence of sixth-moment bounds on and some corresponding envelope functions. This assumption allows the data to be heavy-tailed to a certain extent, but not without limitation. We refer readers to Assumption S1 of the online supplementary material for details.
Theorem 1. Under Assumption S1 and the event , the estimator is weakly consistent: .
Next, we characterize an upper bound for the estimation error of under the norm and establish its asymptotic distribution. For notational simplicity, let . We define the event as:
where . The event establishes the stochastic equicontinuity condition for the quantity . This property is a crucial condition to obtain the estimation error bound and the asymptotic normality of . This condition can be verified to hold under some sufficient conditions. In Section S4 of the online supplementary material, we provide a proof demonstrating that under certain moment bounds and convergence rate conditions.
The derivation of the asymptotic properties of relies on an upper bound for the conditional density of the quantile error and the existence of a positive definite covariance matrix. These requirements are summarized in Assumption S2.
Theorem 2. Under Assumptions S1–S2 and the event , we have (i) and (ii) .
The conclusion of Theorem 2 consists of two parts. The first part characterizes the convergence rate of . Our results demonstrate that the estimation error induced by is first-order negligible and does not affect the asymptotic distribution of . This finding aligns with the linear expected shortfall regression results in He et al. (2023).
The second part establishes the asymptotic normality of . The variance-covariance matrix exhibits a structure similar to that of the results in Patton et al. [29], although they are not asymptotically equivalent.
Weighted Expected Shortfall Estimator
In this section, we derive the asymptotic properties of the weighted estimator obtained by solving (9). We start by imposing two high-level events:
and the event is defined as
Here, we use to denote for notational simplicity. When the parameters for the weighting function can be consistently estimated, the event holds with high probability converging to one as increases, which is a common assumption required by weighted least squares in the existing literature ([35, 31]). For a given model specification (7), can be satisfied through and Theorem 1. The event extends by incorporating the weighting functions. A detailed discussion of the validity of is provided in Section S4 of the online supplementary material.
In the following, we derive a weak consistency result for the weighted least squares expected shortfall estimator . The regularity conditions are in Assumption S3, which generalizes Assumption S1 by incorporating the weighting functions.
Theorem 3. Under Assumptions – and the event , the estimator is weakly consistent: .
In § 3.1, we estimate using an unweighted least squares regression, where is replaced by in the score function . The orthogonality property for is established in Proposition 3.1. We extend this orthogonality condition for the weighted least squares regression problem (9), as formalized in Proposition S5.2 in Section S5.1 of the online supplementary material. Based on Proposition S5.2, we analyze the asymptotic behaviors of . The derivation follows closely from the proof of Theorem 2.
Theorem 4. Under Assumptions – and the event , we have (i) ; and (ii) .
Theorem 4 shows that the estimation errors of the components of the quantile and weighting function do not affect the asymptotic distribution of . The second part indicates that the variance-covariance matrix of differs from that of Theorem 2 due to the existence of the weighting functions. A properly constructed weighting function can improve the asymptotic efficiency of , leading to narrower confidence intervals for statistical inference in . This result is summarized in the following corollary.
Corollary 4.1. Suppose that and Theorem 4 hold. Then, the estimator is asymptotically efficient among the class of joint -estimators introduced in Fissler & Ziegel [17].
In the following theorem, we show that our proposed variance-covariance matrix estimator given in § 3.1 is consistent.
Theorem 5. Under Assumptions – and the event , the estimator of the variance-covariance matrix in Theorem 4 is weakly consistent:
The above theorem validates the inference procedure given in (10). Note that Theorem 5 also provides theoretical guarantees for the confidence intervals given in Theorem 2 by setting the weighting function equal to one for every , hence the variance-covariance matrix of will reduce to that of .
Validity of Portmanteau Test
In this section, we provide theoretical guarantees for the Portmanteau test proposed in § 3.2 for model diagnostics. Specifically, we characterize the asymptotic behavior of the test statistic introduced in Algorithm 2, under the null hypothesis in (12). The following two theorems establish the validity of the proposed Portmanteau test.
Theorem 6. Suppose is generated by the location-scale family model (7) and let where and are obtained by solving (4) and (5), respectively. For a fixed constant , let be the vector of sample autocorrelation coefficients of up to lag level . Then for the matrix defined in (S5.13) in the online supplementary material, under Assumptions –, and the event , we have
Theorem 7. Let be the estimator given in Algorithm S2 in the online supplementary material. Under Assumptions – and the event , we have
Numerical Studies
We conduct extensive numerical experiments to assess the finite-sample performance of our proposed expected shortfall estimator obtained from (9). We also compare to a class of estimators obtained from minimizing the different joint loss functions given in Patton et al. [29] and Dimitriadis et al. [14]. § 5.1 introduces the data generation processes. § 5.2 presents the results for the different estimators and illustrates the efficiency gain of the proposed weighted expected shortfall estimator relative to existing approaches. We conduct numerical studies to assess the performance of the proposed Portmanteau test for model diagnostics in § 5.3.
Data Generating Process and Methodology Comparison
We start with two data-generating processes for numerical studies: (i) an asymmetric slope model; and (ii) a non-location-scale family symmetric absolute value model. The above models correspond to scenarios in which the weighting function in (9) is optimal and suboptimal, respectively. The specifications of the two models are:
The first data generating process combines the quasi-score driven model in Blasques et al. [6] and the asymmetric slope model given in Engle & Manganelli [16]. Recall from § 2 that and . Let and
where and are standard normal. It can be shown that the conditional quantile and the expected shortfall functions of follow the asymmetric slope model given in Example 2. Especially, for the expected shortfall component, we have , where .
(ii) The second data generating process is based on the symmetric absolute value model in Example 1. However, generated by the following process does not belong to the location-scale family model introduced in (7). Let
where is a sequence of i.i.d. Uniform random variables. The vector satisfies that given the history , is strictly increasing with respect to . For a fixed quantile level , we have with .
In this section, we set the coefficient functions to , , and , where and denote the quantile functions of a Beta distribution and a Uniform distribution, respectively.
In § 5.2, we compare the finite-sample performance of our proposed two-step expected shortfall estimator (9) with two competing joint estimators introduced in Patton et al. [29] and Dimitriadis et al. [14], referred to as the “FZ0” and “Emp” estimators, respectively. Detailed descriptions and implementation procedures for these competing methods are provided in Section S2 of the online supplementary material.
Parameter Estimation and Inference
In this section, we evaluate the finite-sample performance of the estimators described in § 5.1. Specifically, for each estimator, we compute the element-wise bias and the length of its corresponding 95% confidence interval, based on Theorem 4 and the corresponding theoretical results in Patton et al. [29] and Dimitriadis et al. [14].
To improve the finite sample performance of our proposed two-step expected shortfall estimators, we consider using random weighting bootstrap to construct confidence intervals Zhu et al. [41]. We defer the implementation details of this bootstrap procedure to Section S2.2 of the online supplementary material. The average bias and confidence interval width, together with the corresponding standard error of the confidence interval width, summarized over 1000 replications, are reported in Table 1–Table 2 at the quantile level . Moreover, to mitigate the influence of outlier confidence interval lengths arising from numerical instabilities in the optimization routine, we compute the average confidence interval length after applying 95% winsorization.
| Avg Bias (WLS) | -0.01 | 0.01 | 0.01 | -0.02 | -0.02 | -0.01 | 0.01 | 0.01 | -0.01 | -0.01 |
| Avg Bias (FZ0) | -0.11 | -0.01 | -0.01 | -0.10 | -0.10 | -0.07 | -0.01 | -0.00 | -0.06 | -0.06 |
| Avg Bias (Emp) | -0.95 | 0.12 | 0.04 | -0.56 | -0.55 | -0.69 | 0.06 | 0.01 | -0.47 | -0.45 |
| CI Length (WLS) | 0.38 | 0.19 | 0.25 | 0.41 | 0.50 | 0.29 | 0.15 | 0.21 | 0.32 | 0.40 |
| CI Length (FZ0) | 0.39 | 0.22 | 0.31 | 0.44 | 0.55 | 0.31 | 0.18 | 0.25 | 0.35 | 0.44 |
| CI Length (Emp) | 0.55 | 0.25 | 0.37 | 0.54 | 0.63 | 0.43 | 0.17 | 0.25 | 0.41 | 0.48 |
| Std Err (WLS) | 0.55 | 0.08 | 0.12 | 0.46 | 0.52 | 0.37 | 0.03 | 0.06 | 0.32 | 0.36 |
| Std Err (FZ0) | 0.40 | 0.05 | 0.09 | 0.31 | 0.33 | 0.23 | 0.03 | 0.05 | 0.18 | 0.19 |
| Std Err (Emp) | 1.37 | 0.25 | 0.49 | 0.95 | 1.05 | 1.01 | 0.06 | 0.17 | 0.72 | 0.74 |
| Coverage (WLS) | 0.93 | 0.93 | 0.93 | 0.94 | 0.93 | 0.93 | 0.94 | 0.93 | 0.94 | 0.95 |
| Coverage (FZ0) | 0.84 | 0.92 | 0.92 | 0.85 | 0.86 | 0.87 | 0.93 | 0.93 | 0.88 | 0.89 |
| Coverage (Emp) | 0.26 | 0.61 | 0.67 | 0.40 | 0.42 | 0.45 | 0.73 | 0.73 | 0.50 | 0.50 |
Table 1. Simulation results for the asymmetric slope model (15) with are reported above. These include the average element-wise bias, the mean and empirical standard errors of the confidence interval lengths, and the coverage probabilities for expected shortfall regression estimators from three different methods: from (9) (WLS), the FZ0 minimization approach proposed in Patton et al. [29] (FZ0), the pseudo-efficient joint loss approach proposed in Dimitriadis et al. [14] with plug-in estimated nuisance components (Emp). The mean and standard errors of confidence interval lengths are computed after 95% winsorization.
| Avg Bias (WLS) | -0.00 | 0.00 | -0.00 | 0.00 | -0.00 | 0.00 |
| Avg Bias (FZ0) | 0.00 | -0.00 | -0.00 | -0.00 | 0.00 | -0.00 |
| Avg Bias (Emp) | 0.00 | -0.00 | -0.00 | -0.00 | 0.00 | -0.00 |
| Avg Bias (Optimal) | 0.00 | -0.00 | -0.00 | -0.00 | 0.00 | -0.00 |
| CI Length (WLS) | 0.12 | 0.12 | 0.09 | 0.09 | 0.07 | 0.07 |
| CI Length (FZ0) | 0.13 | 0.13 | 0.09 | 0.09 | 0.07 | 0.07 |
| CI Length (Emp) | 0.12 | 0.12 | 0.09 | 0.09 | 0.07 | 0.07 |
| CI Length (Optimal) | 0.13 | 0.13 | 0.09 | 0.09 | 0.07 | 0.07 |
| (100×) Std Err (WLS) | 0.05 | 0.03 | 0.02 | 0.01 | 0.02 | 0.01 |
| (100×) Std Err (FZ0) | 0.04 | 0.03 | 0.02 | 0.01 | 0.01 | 0.01 |
| (100×) Std Err (Emp) | 0.05 | 0.03 | 0.02 | 0.01 | 0.01 | 0.01 |
| (100×) Std Err (Optimal) | 0.05 | 0.03 | 0.02 | 0.01 | 0.01 | 0.01 |
| Coverage (WLS) | 0.93 | 0.93 | 0.94 | 0.95 | 0.95 | 0.95 |
| Coverage (FZ0) | 0.93 | 0.94 | 0.95 | 0.95 | 0.95 | 0.95 |
| Coverage (Emp) | 0.93 | 0.94 | 0.94 | 0.95 | 0.95 | 0.95 |
| Coverage (Optimal) | 0.93 | 0.94 | 0.96 | 0.97 | 0.94 | 0.95 |
Table 2. Simulation results for model (16). Other details are as in Table 1.
From Table 1, we find that under the data-generating process in (15), the average bias for our proposed estimators approaches zero as we increase the sample size. The empirical coverage probability for our proposed WLS estimator is close to the nominal 95% level as the sample size increases, supporting the validity of the asymptotic properties derived in Theorem 4. For the two joint estimators FZ0 and Emp proposed in Patton et al. [29] and Dimitriadis et al. [14], respectively, while they are asymptotically normal, in the complex model setting (15), the joint estimation approach requires solving a more challenging nonconvex optimization problem and estimating more nuisance quantities (see details in Section S2 of the online supplementary material), which introduce additional numerical instabilities. As a result, their finite-sample performance is worse than that of the two-step estimation approach. Finally, we observe from Table 1 that the proposed weighted two-step estimator has the highest efficiency among all estimators, as it has the smallest 95% confidence interval length. This is due to the use of the optimal weighting function in Corollary 4.1.
Under model (16), the weighting function is suboptimal due to the fact that model (16) does not belong to the location-scale family. However, motivated by the construction of the optimal weighting function proposed in Barendse [2], the conditional variance function of the regression problem (5) can be explicitly computed from the data generating process (16), such that
This quantity can be numerically approximated by solving the quantile regression problem (4) at multiple quantile levels. Consequently, we consider an alternative estimator for this model for comparison, obtained by solving the weighted least squares regression problem in (9) with the estimated optimal weighting function. We refer to this estimator as the “Optimal” estimator and defer the implementation steps to estimate the optimal weighting function to Section S8 of the online supplementary material. Our numerical results in Table 2 suggest that our proposed weighting function, although suboptimal in the general setting, can have competitive empirical performance relative to commonly used joint estimation approaches and the estimator obtained by optimal weights.
Model Misspecification Test
We now assess the empirical performance of the Portmanteau test proposed in § 3.2. To this end, we consider a generalized autoregressive conditional heteroskedasticity model motivated by Example 3 in § 2, which is also considered in Zhu et al. [41]. We start by introducing the true data generating process under the null hypothesis in (12). Recall from Example 3 that
where are i.i.d. standard normal and . Under (17), the true conditional quantile and expected shortfall functions are
where and . Here, we use (18) as our model under the null hypothesis in (12), which corresponds to the scenario in which the conditional quantile and expected shortfall functions are correctly specified. On the other hand, under the alternative hypothesis, we consider the true data generating process to be
We vary the scalar . When , model (19) reduces to (17), and the null model is correctly specified. For , however, (19) deviates from the null data generating process (17), leading to a misspecification of the null model (18).
We implement the Portmanteau test described in § 3.2 to evaluate whether the null model given in (17) is correctly specified, with in (12). We start by assuming that the null hypothesis is true and generate observations using (17). The empirical type I error rate is calculated as the rejection frequency across 1000 replications of the numerical studies. The results are summarized in Table 3. We observe that under the null hypothesis, the Portmanteau test controls the Type I error rate around the nominal level of 5% across different choices of .
| 0.056 | 0.041 | 0.043 | |
| 0.054 | 0.043 | 0.040 | |
| 0.051 | 0.048 | 0.051 |
Table 3. Empirical Type I error rates for different choices of and under (17).
Next, we evaluate the statistical power of the Portmanteau test. For comparison, we consider another model diagnostics approach proposed by Barendse et al. [3]. Here, we apply the matrix given in Barendse et al. [3] as the test matrix and follow their proposed approach to model testing. Under the alternative hypothesis, we set for our proposed Portmanteau test. For the method given in Barendse et al. [3], samples are used for in-sample estimation and samples are used for out-of-sample backtesting. The samples are generated using the alternative model (19), by varying the scalar . The empirical powers of the Portmanteau test and the test proposed in Barendse et al. [3] are calculated as the respective null hypothesis rejection frequencies in (12) and (4) in Barendse et al. [3], respectively. Our empirical power curves are shown in Figure 1. As increases, the data-generating process (19) increasingly diverges from the null model (17), causing the true and to deviate significantly from the null model (18). This growing distortion leads to higher rejection frequencies. Furthermore, we observe that the power curve for the Portmanteau test consistently dominates the approach in Barendse et al. [3], indicating that our proposed test is empirically more powerful. The overall patterns of the empirical power curves of the Portmanteau test are highly consistent with different choices of . Moreover, we include additional numerical experiments on a broader range of model-misspecification settings in Section S9 of the online supplementary material.
Figure 1. The empirical power curve for model misspecification tests with , and .
Financial Risk Inference and Prediction
We implement the proposed method to investigate the dynamic behavior of financial risk during periods of global financial crisis. To this end, we analyze stock index data, specifically the Hang Seng Index and the Dow Jones Industrial Average, from January 2, 2000, to December 31, 2020. Here, our response variable is the daily returns of stock indices, which is calculated as 100 times the log differences of daily closing prices in US dollars. The covariates are set to the lagged values of .
We consider two different scenarios: the global financial crisis triggered by the coronavirus pandemic in early 2020, and the real estate-driven financial crisis in 2008. For the first scenario, we use the data from January 2, 2000 to December 31, 2019 as the training set for the Hang Seng Index and the Dow Jones Industrial Average, respectively, to estimate the model parameters. We then treat the remaining observations from January 2, 2020, to June 30, 2020 as the test set for performing one-day-ahead predictions of the expected shortfall. For the second scenario, the model is trained using data from January 3, 2000, to May 30, 2008, and tested on data from June 2, 2008, to December 31, 2008. § 6.1 reports the results for in-sample parameter estimation based on the full in-sample dataset from January 2000 to December 2019. § 6.2 gives the out-of-sample forecasting results.
Parameter Estimation and Model Diagnostics
We begin by determining suitable functional forms for and in the model (7). We assume that and share the same functional form, and consider five candidate models to describe the joint autoregressive dynamics patterns of quantile and expected shortfall. The models are listed as follows:
(i) Lag One Symmetric Absolute Value (SAV1): .
(ii) Lag One Asymmetric Slope (AS1): .
(iii) GARCH: .
(iv) SAV2: .
(v) AS2: .
We perform the Portmanteau test proposed in § 3.2 for each of the five candidate models for model diagnostics. We set the lag level for the Portmanteau test, which corresponds to the time duration of two trading weeks. The test results indicate that the lag one and two symmetric absolute value models are suitable choices for the Hang Seng Index data, with -values 0.28 and 0.61, respectively. On the other hand, the lag two symmetric and asymmetric slope models serve as more appropriate models to fit Dow Jones Industrial Average data, with -values of 0.06 for both models. Based on the above results, we apply the weighted expected shortfall estimator proposed in (9) to estimate the parameter for the Hang Seng Index and Dow Jones Industrial Average data, respectively. The results for are summarized in Table 4.
| Hang Seng Index | Dow Jones Industrial Average | |||||||
| SAV1 | SAV2 | SAV2 | AS2 | |||||
| Est Value | Std Err | Est Value | Std Err | Est Value | Std Err | Est Value | Std Err | |
| -0.09 | 0.02 | -0.09 | 0.03 | -0.12 | 0.04 | -0.10 | 0.03 | |
| 0.90 | 0.02 | 0.90 | 0.02 | 0.83 | 0.04 | 0.87 | 0.04 | |
| -0.20 | 0.05 | -0.16 | 0.09 | -0.25 | 0.13 | -0.06 | 0.17 | |
| — | — | -0.04 | 0.09 | -0.10 | 0.14 | -0.44 | 0.19 | |
| — | — | — | — | — | — | -0.01 | 0.12 | |
| — | — | — | — | — | — | 0.01 | 0.18 |
Table 4. Estimated values and standard errors for in across different models and indices at . Bold entries indicate significance at the 5% confidence level.
From Table 4, we see that the estimated values for , the coefficient of the autoregressive term, are always significant across different models and stock indices. Our results align with similar conclusions in the context of autoregressive conditional quantile regression Engle & Manganelli [16], thus supporting the phenomenon of clustering patterns in conditional expected shortfall. Next, we find that the expected shortfall dynamic patterns are different between the Hang Seng Index and the Dow Jones Industrial Average. The symmetric absolute value models fit the Hang Seng Index data well, indicating that the previous positive return and negative return have similar influences on future risk. On the other hand, we find that the asymmetric slope model quantifies the differential impact of previous positive and negative returns for the Dow Jones Industrial Average, as , the coefficient for , is significantly different from , the coefficient of . This indicates a high sensitivity of the financial market to the negative return of the previous day. This asymmetric influence between previous positive and negative returns suggests strong evidence of the leverage effect, which stems from the empirical fact that losses have a greater influence on future risks than gains [10, 39].
In practice, when prior knowledge of the model structure is not available, we recommend that users apply the workflow described in this section for analyzing financial time series data. Specifically, we first implement the Portmanteau test on the time series data over a finite set of candidate joint quantile-expected shortfall models. We then select the models that pass the Portmanteau test as plausible working models and use them to fit the data.
Out-of-Sample Expected Shortfall Prediction
In this section, we evaluate the predictive performance of our proposed dynamic autoregressive expected shortfall model during periods of significant financial turbulence.
We focus on two distinct testing periods, as detailed in the beginning of § 6.
Following the training-testing split described in § 6 and the results given in § 6.1, we select the lag two symmetric absolute value model and lag two asymmetric slope model to make expected shortfall predictions for the Hang Seng index and Dow Jones Industrial Average data, respectively. In addition to these two models, we also consider a rolling window approach for predicting expected shortfall.
Specifically, for a given time point and a predetermined window size , the conditional -level expected shortfall of is estimated as the empirical marginal -level expected shortfall of the series . In this analysis, we set the window size to be 125 for simplicity.
The forecast results are presented in Figure 2–Figure 3. Our initial observation is that the rolling window-based approach provides only a rough prediction and cannot reveal the complex dynamic pattern of financial risk. Conversely, the predictions made by the lag two asymmetric slope and symmetric absolute value models can all reveal more complex dynamic patterns of the expected shortfall throughout the year than the rolling window approach. Both models exhibit very similar trends in predicting one-day-ahead conditional expected shortfall. The prediction results for 2008, as shown in Figure 2, indicate a significant decline in the expected shortfall estimates for both the Hang Seng Index and the Dow Jones Industrial Average following September 29, 2008. This date is particularly important for the Dow Jones Industrial Average, as it recorded the largest single-day point drop in its history. In 2020, the global stock market experienced three major events due to the pandemic: Black Monday I on March 9, Black Thursday on March 12, and Black Monday II on March 16. As illustrated in Figure 3, the expected shortfall predictions for both models and both stock indices show a similar downward trend during this period.
Figure 2. The 5% level expected shortfall forecasting results for different approaches: rolling window (orange curve), lag two symmetric absolute value and asymmetric slope models (blue curves). The upper panel includes the plots for the observed Hang Seng Index and Dow Jones Industrial Average return series in the year 2008. The lower panel plots the one-step expected shortfall predicted values for the aforementioned three models. The dashed vertical black line denotes the date of the largest single-day point drop in the history of the Dow Jones Industrial Average, which occurred on September 29, 2008.
Figure 3. The 5% level expected shortfall forecasting results for different approaches: rolling window (orange curve), lag two symmetric absolute value and asymmetric slope models (blue curves). The upper panel contains plots for the observed Hang Seng Index and Dow Jones Industrial Average return series in the year 2020. The lower panel plots the one-step expected shortfall predicted values for the aforementioned three models. The dashed vertical black lines denote the “Black Monday I”, “Black Thursday” and “Black Monday II” stock market crashes on March 9, 2020, March 12, 2020 and March 16, 2020.
In summary, both the lag two symmetric absolute value and the asymmetric slope models effectively predict the risk levels of various stock indices. Moreover, as discussed in § 6.1, the lag-two asymmetric slope model for Dow Jones data offers the advantage of distinguishing between the differential impacts of past gains and losses on stock returns. Due to its greater flexibility, we recommend adopting the lag-two asymmetric slope model as the preferred working model in this example.
Discussion
We consider a joint model for conditional quantiles and expected shortfall with autoregressive structures. Existing estimation approaches for such models typically involve minimizing a class of joint loss functions [17, 29]. Motivated by Barendse [2], we propose a weighted two-step estimation scheme to estimate the expected shortfall parameters. We start by using an unweighted least squares approach to estimate the expected shortfall parameters under the model (2). We apply weighted least squares regression to improve the asymptotic efficiency of our estimators. The choice of our weighting function is motivated by the location-scale family time series with innovations. Under such a model assumption, our proposed weighting functions are optimal and can achieve asymptotic efficiency among the class of joint estimators proposed in Dimitriadis et al. [14]. Moreover, we develop a Portmanteau test based on (7) with i.i.d. noise assumption, which exhibits great empirical efficiency. Both theoretical analysis and numerical simulations demonstrate that our proposed estimator is more efficient than those of Patton et al. [29].
Although the location-scale family time series models with i.i.d. innovations encompass a wide range of commonly used time series models, they remain a specific subclass of the more general model (2). In some scenarios, our proposed weighted estimator is suboptimal. A potential direction for future research is the development of nonparametric approaches to derive optimal weights without relying on the assumption in (7). Moreover, it is well known that the least squares step involved in the two-step approach is highly sensitive to heavy-tailed and highly skewed data, which are common in financial asset returns. Incorporating a robust loss function into the two-step approach may address this issue and yield a robust estimator (He et al. (2023)). We will leave the aforementioned discussion for future research.
References
- [1]Barendse, S. (2024), ‘Expected shortfall LASSO’, arXiv preprint arXiv:2307.01033.arxiv.org/abs/2307.01033
- [2]Barendse, S. (2026), ‘Efficiently weighted estimation of tail and interquantile expectations’, Journal of Financial Econometrics 24(2), nbag003.DOI
- [3]Barendse, S., Kole, E. & van Dijk, D. (2023), ‘Backtesting Value-at-Risk and expected shortfall in the presence of estimation error’, Journal of Financial Econometrics 21(2), 528–568.
- [4]Basel Committee (2016), ‘Minimum capital requirements for market risk’, Consultative Document.
- [5]Black, F. (1976), Studies of stock price volatility changes, in ‘Proceedings of the 1976 Meetings of the American Statistical Association’, pp. 171–181.
- [6]Blasques, F., Francq, C. & Laurent, S. (2023), ‘Quasi score-driven models’, Journal of Econometrics 234(1), 251–275.DOI
- [7]Bollerslev, T. (1986), ‘Generalized autoregressive conditional heteroskedasticity’, Journal of Econometrics 31(3), 307–327.
- [8]Bollerslev, T., Chou, R. Y. & Kroner, K. F. (1992), ‘ARCH modeling in finance: A review of the theory and empirical evidence’, Journal of Econometrics 52(1-2), 5–59.DOI
- [9]Boonen, T. J. (2017), ‘Solvency II solvency capital requirement for life insurance companies based on expected shortfall’, European Actuarial Journal 7(2), 405–434.
- [10]Christie, A. A. (1982), ‘The stochastic behavior of common stock variances: Value, leverage and interest rate effects’, Journal of Financial Economics 10(4), 407–432.
- [11]Creal, D., Koopman, S. J. & Lucas, A. (2013), ‘Generalized autoregressive score models with applications’, Journal of Applied Econometrics 28(5), 777–795.
- [12]De Gooijer, J. G. & Hyndman, R. J. (2006), ‘25 years of time series forecasting’, International Journal of Forecasting 22(3), 443–473.
- [13]Dimitriadis, T. & Bayer, S. (2019), ‘A joint quantile and expected shortfall regression framework’, Electronic Journal of Statistics 13(1), 1823–1871.
- [14]Dimitriadis, T., Fissler, T. & Ziegel, J. (2020), ‘The efficiency gap’, arXiv preprint arXiv:2010.144146.
- [16]Engle, R. F. & Manganelli, S. (2004), ‘CAViaR: Conditional autoregressive value at risk by regression quantiles’, Journal of Business & Economic Statistics 22(4), 367–381.
- [17]Fissler, T. & Ziegel, J. F. (2016), ‘Higher order elicitability and Osband’s principle’, The Annals of Statistics 44(4), 1680 – 1707.
- [18]Fletcher, R. & Reeves, C. M. (1964), ‘Function minimization by conjugate gradients’, The Computer Journal 7(2), 149–154.DOI
- [19]Gerlach, R. & Wang, C. (2020), ‘Semi-parametric dynamic asymmetric Laplace models for tail risk forecasting, incorporating realized measures’, International Journal of Forecasting 36(2), 489–506.arxiv.org/abs/1805.08653
- [20]Gneiting, T. (2011), ‘Making and evaluating point forecasts’, Journal of the American Statistical Association 106(494), 746–762.arxiv.org/abs/0912.0902
- [22]Lazar, E. & Zhang, N. (2019), ‘Model risk of expected shortfall’, Journal of Banking & Finance 105, 74–93.
- [23]Li, G. & Li, W. K. (2005), ‘Diagnostic checking for time series models with conditional heteroscedasticity estimated by the least absolute deviation approach’, Biometrika 92(3), 691–701.DOI
- [26]Lumsdaine, R. L. (1996), ‘Consistency and asymptotic normality of the quasi-maximum likelihood estimator in IGARCH(1,1) and covariance stationary GARCH(1,1) models’, Econometrica 64(3), 575–596.DOI
- [27]Nelder, J. A. & Mead, R. (1965), ‘A simplex method for function minimization’, The Computer Journal 7(4), 308–313.
- [28]Nolde, N. & Ziegel, J. F. (2017), ‘Elicitability and backtesting: Perspectives for banking regulation’, The Annals of Applied Statistics 11(4), 1833 – 1874.arxiv.org/abs/1608.05498
- [29]Patton, A. J., Ziegel, J. F. & Chen, R. (2019), ‘Dynamic semiparametric models for expected shortfall (and Value-at-Risk)’, Journal of Econometrics 211(2), 388–413.
- [30]Rockafellar, R. T., Royset, J. O. & Miranda, S. I. (2014), ‘Superquantile regression with applications to buffered reliability, uncertainty quantification, and conditional Value-at-Risk’, European Journal of Operational Research 234(1), 140–154.DOI
- [31]Romano, J. P. & Wolf, M. (2017), ‘Resurrecting weighted least squares’, Journal of Econometrics 197(1), 1–19.
- [32]Tasche, D. (2002), ‘Expected shortfall and beyond’, Journal of Banking & Finance 26(7), 1519–1533.
- [33]Taylor, J. W. (2019), ‘Forecasting Value at Risk and expected shortfall using a semiparametric approach based on the asymmetric Laplace distribution’, Journal of Business & Economic Statistics 37(1), 121–133.
- [34]Wang, C., Gerlach, R. & Chen, Q. (2023), ‘A semi-parametric conditional autoregressive joint Value-at-Risk and expected shortfall modeling framework incorporating realized measures’, Quantitative Finance 23(2), 309–334.DOI
- [35]White, H. (1980), ‘Nonlinear regression on cross-section data’, Econometrica 48(3), 721–746.
- [36]White, H., Kim, T.-H. & Manganelli, S. (2015), ‘VAR for VaR: Measuring tail dependence using multivariate regression quantiles’, Journal of Econometrics 187(1), 169–188.
- [37]Wooldridge, J. M. (2010), Econometric analysis of cross section and panel data, MIT Press.
- [39]Yu, J. (2005), ‘On leverage in a stochastic volatility model’, Journal of Econometrics 127(2), 165–178.
- [40]Zhang, S., He, X., Tan, K. M. & Zhou, W.-X. (2025), ‘High-dimensional expected shortfall regression’, Journal of the American Statistical Association 120(551), 1799–1810.
- [41]Zhu, Q., Zeng, R. & Li, G. (2020), ‘Bootstrap inference for GARCH models by the least absolute deviation estimation’, Journal of Time Series Analysis 41(1), 21–40.DOI


