Finite Sample Theory of QMLE in ARCH Models with Dynamics in the Mean Equation

Abstract. We provide simulation and theoretical results concerning the finite‐sample theory of quasi‐maximum‐likelihood estimators in autoregressive conditional heteroskedastic (ARCH) models when we include dynamics in the mean equation. In the setting of the AR(q)–ARCH(p), we find that in some cases bias correction is necessary even for sample sizes of 100, especially when the ARCH order increases. We warn about the existence of important biases and potentially low power of the t‐tests in these cases. We also propose ways to deal with them. We also find simulation evidence that when conditional heteroskedasticity increases, the mean‐squared error of the maximum‐likelihood estimator of the AR(1) parameter in the mean equation of an AR(1)‐ARCH(1) model is reduced. Finally, we generalize the Lumsdaine [J. Bus. Econ. Stat. 13 (1995) pp. 1–10] invariance properties for the biases in these situations.     

Estimation of Parameters in the NLAR(p) Model

Abstract. In this article, we study a new Laplace autoregressive model of order p– NLAR(p). Conditional least squares, weighted conditional least squares and maximum quasi‐likelihood are used to estimate the model parameters. Comparisons among these estimates of the NLAR(2) model are given via simulation studies.     

The Effect of the Estimation on Goodness‐of‐Fit Tests in Time Series Models

Abstract. We analyze, by simulation, the finite‐sample properties of goodness‐of‐fit tests based on residual autocorrelation coefficients (simple and partial) obtained using different estimators frequently used in the analysis of autoregressive moving‐average time‐series models. The estimators considered are unconditional least squares, maximum likelihood and conditional least squares. The results suggest that although the tests based on these estimators are asymptotically equivalent for particular models and parameter values, their sampling properties for samples of the size commonly found in economic applications can differ substantially, because of differences in both finite‐sample estimation efficiencies and residual regeneration methods.     

On Residual Variance Estimation in Autoregressive Models

In this paper we consider time series models belonging to the autoregressive (AR) family and deal with the estimation of the residual variance. This is important because estimates of the variance are involved in, for example, confidence sets for the parameters of the model, estimation of the spectrum, expressions for the estimated error of prediction and sample quantities used to make inferences about the order of the model. We consider the asymptotic biases for moment and least squares estimators of the residual variance, and compare them with known results when available and with those for maximum likelihood estimators under normality. Simulation results are presented for finite samples     

Empirical likelihood intervals for conditional Value‐at‐Risk in ARCH/GARCH models

Value‐at‐Risk (VaR) is a simple, but useful measure in risk management. When some volatility model is employed, conditional VaR is of importance. As autoregressive conditional heteroscedastic (ARCH) and generalized ARCH (GARCH) models are widely used in modelling volatilities, in this article, we propose empirical likelihood methods to obtain an interval estimation for the conditional VaR with the volatility model being an ARCH/GARCH model.     

Generalized least squares estimation for cointegration parameters under conditional heteroskedasticity

In the presence of generalized conditional heteroscedasticity (GARCH) in the residuals of a vector error correction model (VECM), maximum likelihood (ML) estimation of the cointegration parameters has been shown to be efficient. On the other hand, full ML estimation of VECMs with GARCH residuals is computationally difficult and may not be feasible for larger models. Moreover, ML estimation of VECMs with independently identically distributed residuals is known to have potentially poor small sample properties and this problem also persists when there are GARCH residuals. A further disadvantage of the ML estimator is its sensitivity to misspecification of the GARCH process. We propose a feasible generalized least squares estimator which addresses all these problems. It is easy to compute and has superior small sample properties in the presence of GARCH residuals.     

Inference for pth‐order random coefficient integer‐valued autoregressive processes

Abstract. A pth‐order random coefficient integer‐valued autoregressive [RCINAR(p)] model is proposed for count data. Stationarity and ergodicity properties are established. Maximum likelihood, conditional least squares, modified quasi‐likelihood and generalized method of moments are used to estimate the model parameters. Asymptotic properties of the estimators are derived. Simulation results on the comparison of the estimators are reported. The models are applied to two real data sets.     

Minimum α‐divergence estimation for arch models

Abstract. This paper considers a minimum α‐divergence estimation for a class of ARCH(p) models. For these models with unknown volatility parameters, the exact form of the innovation density is supposed to be unknown in detail but is thought to be close to members of some parametric family. To approximate such a density, we first construct an estimator for the unknown volatility parameters using the conditional least squares estimator given by Tjøstheim [Stochastic processes and their applications (1986) Vol. 21, pp. 251–273]. Then, a nonparametric kernel density estimator is constructed for the innovation density based on the estimated residuals. Using techniques of the minimum Hellinger distance estimation for stochastic models and residual empirical process from an ARCH(p) model given by Beran [Annals of Statistics (1977) Vol. 5, pp. 445–463] and Lee and Taniguchi [Statistica Sinica (2005) Vol. 15, pp. 215–234] respectively, it is shown that the proposed estimator is consistent and asymptotically normal. Moreover, a robustness measure for the score of the estimator is introduced. The asymptotic efficiency and robustness of the estimator are illustrated by simulations. The proposed estimator is also applied to daily stock returns of Dell Corporation.     

Local Likelihood for non‐parametric ARCH(1) models

Abstract. We propose a non‐parametric local likelihood estimator for the log‐transformed autoregressive conditional heteroscedastic (ARCH) (1) model. Our non‐parametric estimator is constructed within the likelihood framework for non‐Gaussian observations: it is different from standard kernel regression smoothing, where the innovations are assumed to be normally distributed. We derive consistency and asymptotic normality for our estimators and show, by a simulation experiment and some real‐data examples, that the local likelihood estimator has better predictive potential than classical local regression. A possible extension of the estimation procedure to more general multiplicative ARCH(p) models with p > 1 predictor variables is also described.     

SOME PROPERTIES OF THE MAXIMUM LIKELIHOOD ESTIMATOR IN THE SIMULTANEOUS SWITCHING AUTOREGRESSIVE MODEL

Abstract. The simultaneous switching autoregressive (SSAR) model proposed by Kunitomo and Sato (A non-linearity in economic time series and disequilibrium econometric models. In Theory and Application of Mathematical Statistics (ed. A. Takemura). Tokyo:University of Tokyo Press (in Japanese), 1994; Asymmetry in economic time series and simultaneous switching autoregressive model. Struct. Change Econ. Dyn. , forthcoming (1994).) is a Markovian non-linear time series model. We investigate the finite sample as well as the asymptotic properties of the least squares estimator and the maximum likelihood (ML) estimator. Due to a specific simultaneity involved in the SSAR model, the least squares estimator is badly biased. However, the ML estimator under the assumption of Gaussian disturbances gives reasonable estimates.     

Fixed Bandwidth Inference for Fractional Cointegration

In a fractional cointegration setting we derive the fixed bandwidth limiting theory of a class of estimators of the cointegrating parameter which are constructed as ratios of weighted periodogram averages. These estimators offer improved limiting properties over those of more standard approaches like ordinary least squares or narrow band least squares estimation. These advantages have been justified by means of traditional asymptotic theory and here we explore whether these improvements still hold when considering the alternative fixed bandwidth theory and, more importantly, whether this latter approach provides a more accurate approximation to the sampling distribution of the corresponding test statistics. This appears to be relevant, especially in view of the typical oversizing displayed by Wald statistics when confronted to the standard limiting theory. A Monte Carlo study of finite‐sample behaviour is included.     

Integer‐Valued GARCH Process

Abstract. An integer‐valued analogue of the classical generalized autoregressive conditional heteroskedastic (GARCH) (p,q) model with Poisson deviates is proposed and a condition for the existence of such a process is given. For the case p = 1, q = 1, it is explicitly shown that an integer‐valued GARCH process is a standard autoregressive moving average (1, 1) process. The problem of maximum likelihood estimation of parameters is treated. An application of the model to a real time series with a numerical example is given.     

On Asymptotic Theory for ARCH (∞) Models

Autoregressive conditional heteroskedasticity (ARCH)() models nest a wide range of ARCH and generalized ARCH models including models with long memory in volatility. Existing work assumes the existence of second moments. However, the fractionally integrated generalized ARCH model, one version of a long memory in volatility model, does not have finite second moments and rarely satisfies the moment conditions of the existing literature. This article weakens the moment assumptions of a general ARCH( ) class of models and develops the theory for consistency and asymptotic normality of the quasi‐maximum likelihood estimator.     

QMLE for Quadratic ARCH Model with Long Memory

We discuss parametric quasi‐maximum likelihood estimation for quadratic autoregressive conditional heteroskedasticity (ARCH) process with long memory introduced in Doukhan emphet al. (2016) and Grublyt? and ?karnulis (2016) with conditional variance involving the square of inhomogeneous linear combination of observable sequence with square summable weights. The aforementioned model extends the quadratic ARCH model of Sentana ( 1995 ) and the linear ARCH model of Robinson ( 1991 ) to the case of strictly positive conditional variance. We prove consistency and asymptotic normality of the corresponding quasi‐maximum likelihood estimates, including the estimate of long memory parameter 0 < d < 1/2. A simulation study of empirical mean‐squared error is included.     

Least squares estimation of ARCH models with missing observations

A least squares estimator for ARCH models in the presence of missing data is proposed. Strong consistency and asymptotic normality are derived. Monte Carlo simulation results are analysed and an application to real data of a Chilean stock index is reported.     

ESTIMATING THE ARCH PARAMETERS BY SOLVING LINEAR EQUATIONS

Abstract. This paper discusses the asymptotics of two-stage least squares estimator of the parameters of ARCH models. The estimator is easy to obtain since it involves solving two sets of linear equations. At the same time, the estimator has the same asymptotic efficiency as that of the widely used quasi-maximum likelihood estimator. Simulation results show that, even for small sample size, the performance of our estimator compared to the quasi-maximum likelihood estimator is better.     

Using least squares to generate forecasts in regressions with serial correlation

Abstract. The topic of serial correlation in regression models has attracted a great deal of research in the last 50 years. Most of these studies have assumed that the structure of the error covariance matrix Ω was known or could be consistently estimated from the data. In this article, we describe a new procedure for generating forecasts for regression models with serial correlation based on ordinary least squares and on an approximate representation of the form of the autocorrelation. We prove that the predictors from this specification are asymtotically efficient under some regularity conditions. In addition, we show that there is not much to be gained in trying to identify the correct form of the serial correlation since efficient forecasts can be generated using autoregressive approximations of the autocorrelation. A large simulation study is also used to compare the finite sample predictive efficiencies of this new estimator vis‐à‐vis estimators based on ordinary least squares and generalized least squares.     

Least tail‐trimmed squares for infinite variance autoregressions

We develop a robust least squares estimator for autoregressions with possibly heavy tailed errors. Robustness to heavy tails is ensured by negligibly trimming the squared error according to extreme values of the error and regressors. Tail‐trimming ensures asymptotic normality and super‐‐convergence with a rate comparable to the highest achieved amongst M‐estimators for stationary data. Moreover, tail‐trimming ensures robustness to heavy tails in both small and large samples. By comparison, existing robust estimators are not as robust in small samples, have a slower rate of convergence when the variance is infinite, or are not asymptotically normal. We present a consistent estimator of the covariance matrix and treat classic inference without knowledge of the rate of convergence. A simulation study demonstrates the sharpness and approximate normality of the estimator, and we apply the estimator to financial returns data. Finally, tail‐trimming can be easily extended beyond least squares estimation for a linear stationary AR model. We discuss extensions to quasi‐maximum likelihood for GARCH, weighted least squares for a possibly non‐stationary random coefficient autoregression, and empirical likelihood for robust confidence region estimation, in each case for models with possibly heavy tailed errors.     

Evaluating Specification Tests for Markov‐Switching Time‐Series Models

Abstract. We evaluate the performance of several specification tests for Markov regime‐switching time‐series models. We consider the Lagrange multiplier (LM) and dynamic specification tests of Hamilton (1996) and Ljung–Box tests based on both the generalized residual and a standard‐normal residual constructed using the Rosenblatt transformation. The size and power of the tests are studied using Monte Carlo experiments. We find that the LM tests have the best size and power properties. The Ljung–Box tests exhibit slight size distortions, though tests based on the Rosenblatt transformation perform better than the generalized residual‐based tests. The tests exhibit impressive power to detect both autocorrelation and autoregressive conditional heteroscedasticity (ARCH). The tests are illustrated with a Markov‐switching generalized ARCH (GARCH) model fitted to the US dollar–British pound exchange rate, with the finding that both autocorrelation and GARCH effects are needed to adequately fit the data.     

ON THE RELATIONSHIP BETWEEN GENERALIZED LEAST SQUARES AND GAUSSIAN ESTIMATION OF VECTOR ARMA MODELS

Abstract. This paper investigates theoretical aspects of the relationship between the generalized least squares and Gaussian estimation schemes for vector autoregressive moving-average models. The asymptotic convergence of the generalized least squares estimator to the Gaussian estimator is established and an alternative numerical method for implementing the generalized least squares scheme is proposed. Finally, some simulation results are presented to illustrate the theory.