Bartlett Correction of Empirical Likelihood for Non‐Gaussian Short‐Memory Time Series

Bartlett correction, which improves the coverage accuracies of confidence regions, is one of the desirable features of empirical likelihood. For empirical likelihood with dependent data, previous studies on the Bartlett correction are mainly concerned with Gaussian processes. By establishing the validity of Edgeworth expansion for the signed root empirical log‐likelihood ratio statistics, we show that the Bartlett correction is applicable to empirical likelihood for short‐memory time series with possibly non‐Gaussian innovations. The Bartlett correction is established under the assumptions that the variance of the innovation is known and the mean of the underlying process is zero for a single parameter model. In particular, the order of the coverage errors of Bartlett‐corrected confidence regions can be reduced from O(n^?1) to O(n^?2).     

Likelihood functions for state space models with diffuse initial conditions

State space models with non‐stationary processes and/or fixed regression effects require a state vector with diffuse initial conditions. Different likelihood functions can be adopted for the estimation of parameters in time‐series models with diffuse initial conditions. In this article, we consider profile, diffuse and marginal likelihood functions. The marginal likelihood function is defined as the likelihood function of a transformation of the data vector. The transformation is not unique. The diffuse likelihood is a marginal likelihood for a data transformation that may depend on parameters. Therefore, the diffuse likelihood cannot be used generally for parameter estimation. The marginal likelihood function is based on an orthonormal data transformation that does not depend on parameters. Here we develop a marginal likelihood function for state space models that can be evaluated by the Kalman filter. The so‐called diffuse Kalman filter is designed for computing the diffuse likelihood function. We show that a minor modification of the diffuse Kalman filter is needed for the evaluation of our marginal likelihood function. Diffuse and marginal likelihood functions have better small sample properties compared with the profile likelihood function for the estimation of parameters in linear time series models. The results in our article confirm the earlier findings and show that the diffuse likelihood function is not appropriate for a range of state space model specifications.     

Change‐Point Detection in Autoregressive Models with no Moment Assumptions

In this paper we consider the problem of detecting a change in the parameters of an autoregressive process where the moments of the innovation process do not necessarily exist. An empirical likelihood ratio test for the existence of a change point is proposed and its asymptotic properties are studied. In contrast to other works on change‐point tests using empirical likelihood, we do not assume knowledge of the location of the change point. In particular, we prove that the maximizer of the empirical likelihood is a consistent estimator for the parameters of the autoregressive model in the case of no change point and derive the limiting distribution of the corresponding test statistic under the null hypothesis. We also establish consistency of the new test. A nice feature of the method is the fact that the resulting test is asymptotically distribution‐free and does not require an estimate of the long‐run variance. The asymptotic properties of the test are investigated by means of a small simulation study, which demonstrates good finite‐sample properties of the proposed method.     

UNIFIED INTERVAL ESTIMATION FOR RANDOM COEFFICIENT AUTOREGRESSIVE MODELS

The consistency of the quasi‐maximum likelihood estimator for random coefficient autoregressive models requires that the coefficient be a non‐degenerate random variable. In this article, we propose empirical likelihood methods based on weighted‐score equations to construct a confidence interval for the coefficient. We do not need to distinguish whether the coefficient is random or deterministic and whether the process is stationary or non‐stationary, and we present two classes of equations depending on whether a constant trend is included in the model. A simulation study confirms the good finite‐sample behaviour of our resulting empirical likelihood‐based confidence intervals. We also apply our methods to study US macroeconomic data.     

Empirical likelihood inference for random coefficient INAR(p) process

In this article, we study the empirical likelihood (EL) method for the pth‐order random coefficient integer‐valued autoregressive process. In particular, the limiting distribution of the log EL ratio statistic is established and the confidence regions for the parameter of interest are derived. Also a simulation study is conducted for the evaluation of the developed approach.     

Testing for structural change of AR model to threshold AR model

The purpose of this article is to develop the likelihood ratio test for the structural change of an AR model to a threshold AR model. It is shown that the log‐likelihood ratio test converges to the maxima of a two‐parameter Gaussian process in distribution. This limiting distribution is novel and we tabulate the critical values. Some simulations are carried out to examine the finite‐sample performance of this test statistic. This article also includes a weak convergence of a two‐parameter marked empirical process, which is of independent interest.     

ON SELF‐NORMALIZATION FOR CENSORED DEPENDENT DATA

This article is concerned with confidence interval construction for functionals of the survival distribution for censored dependent data. We adopt the recently developed self‐normalization approach (Shao, 2010), which does not involve consistent estimation of the asymptotic variance, as implicitly used in the blockwise empirical likelihood approach of El Ghouch et al. (2011). We also provide a rigorous asymptotic theory to derive the limiting distribution of the self‐normalized quantity for a wide range of parameters. Additionally, finite‐sample properties of the self‐normalization‐based intervals are carefully examined, and a comparison with the empirical likelihood‐based counterparts is made.     

Frequency domain generalized empirical likelihood method

This paper is concerned with a version of empirical likelihood method for spectral restrictions, which handles stationary time series data via the frequency domain approach. The asymptotic properties of frequency domain generalized empirical likelihood are studied for either strictly stationary processes with vanishing cumulant spectral density function of order 4 or linear processes generated by iid innovations with possibly non‐zero fourth order cumulant. Several statistics for testing parametric restrictions, over‐identified spectral restrictions, and additional spectral restrictions are shown to have the limiting chi‐squared distributions. Some numerical results are presented to investigate the finite sample performance of the proposed procedures. Copyright © 2013 John Wiley & Sons, Ltd.     

Using the Penalized Likelihood Method for Model Selection with Nuisance Parameters Present only under the Alternative: An Application to Switching Regression Models

Abstract. We study the problem of model selection with nuisance parameters present only under the alternative. The common approach for testing in this case is to determine the true model through the use of some functionals over the nuisance parameters space. Since in such cases the distribution of these statistics is not known, critical values had to be approximated usually through computationally intensive simulations. Furthermore, the computed critical values are data and model dependent and hence cannot be tabulated. We address this problem by using the penalized likelihood method to choose the correct model. We start by viewing the likelihood ratio as a function of the unidentified parameters. By using the empirical process theory and the uniform law of the iterated logarithm (LIL) together with sufficient conditions on the penalty term, we derive the consistency properties of this method. Our approach generates a simple and consistent procedure for model selection. This methodology is presented in the context of switching regression models. We also provide some Monte Carlo simulations to analyze the finite sample performance of our procedure.     

NORMING RATES AND LIMIT THEORY FOR SOME TIME‐VARYING COEFFICIENT AUTOREGRESSIONS

A time‐varying autoregression is considered with a similarity‐based coefficient and possible drift. It is shown that the random‐walk model has a natural interpretation as the leading term in a small‐sigma expansion of a similarity model with an exponential similarity function as its AR coefficient. Consistency of the quasi‐maximum likelihood estimator of the parameters in this model is established, the behaviours of the score and Hessian functions are analysed and test statistics are suggested. A complete list is provided of the normalization rates required for the consistency proof and for the score and Hessian function standardization. A large family of unit root models with stationary and explosive alternatives is characterized within the similarity class through the asymptotic negligibility of a certain quadratic form that appears in the score function. A variant of the stochastic unit root model within the class is studied, and a large‐sample limit theory provided, which leads to a new nonlinear diffusion process limit showing the form of the drift and conditional volatility induced by sustained stochastic departures from unity. The findings provide a composite case for time‐varying coefficient dynamic modelling. Some simulations and a brief empirical application to data on international Exchange Traded Funds are included. Copyright © 2014 Wiley Publishing Ltd     

ASYMPTOTIC DISTRIBUTIONS OF LIKELIHOOD RATIOS FOR OVERPARAMETRIZED ARMA PROCESSES

Abstract. This paper is devoted to an extension of a classical problem of statistics to the asymptotic distribution of likelihood ratios. Two main types of likelihood ratios are considered for Gaussian ARMA processes. It is assumed in both cases that the asymptotic Fisher information matrix of estimation is singular in the higher order models. It is proved that the asymptotic distributions of the log likelihood ratios are invariant with respect to the parameters generating the process. A simulation shows that the sample distribution of the log likelihood ratio approaches the asymptotic one. Finally, the likelihood ratio test is proposed for model order reduction.     

Statistical Inference for Unified Garch–Itô Models with High‐Frequency Financial Data

The existing estimation methods for the model parameters of the unified GARCH–Itô model (Kim and Wang, 2014 ) require long period observations to obtain the consistency. However, in practice, it is hard to believe that the structure of a stock price is stable during such a long period. In this article, we introduce an estimation method for the model parameters based on the high‐frequency financial data with a finite observation period. In particular, we establish a quasi‐likelihood function for daily integrated volatilities, and realized volatility estimators are adopted to estimate the integrated volatilities. The model parameters are estimated by maximizing the quasi‐likelihood function. We establish asymptotic theories for the proposed estimator. A simulation study is conducted to check the finite sample performance of the proposed estimator. We apply the proposed estimation approach to the Bank of America stock price data.     

A FREQUENCY DOMAIN APPROACH FOR THE ESTIMATION OF PARAMETERS OF SPATIO‐TEMPORAL STATIONARY RANDOM PROCESSES

A frequency domain methodology is proposed for estimating parameters of covariance functions of stationary spatio‐temporal processes. Finite Fourier transforms of the processes are defined at each location. Based on the joint distribution of these complex valued random variables, an approximate likelihood function is constructed. The sampling properties of the estimators are investigated. It is observed that the expectation of these transforms can be considered to be a frequency domain analogue of the classical variogram. We call this measure frequency variogram. The method is applied to simulated data and also to Pacific wind speed data considered earlier by Cressie and Huang (1999). The proposed method does not depend on the distributional assumptions about the process.     

Empirical likelihood confidence intervals for the mean of a long‐range dependent process

Abstract. This paper considers blockwise empirical likelihood for real‐valued linear time processes which may exhibit either short‐ or long‐range dependence. Empirical likelihood approaches intended for weakly dependent time series can fail in the presence of strong dependence. However, a modified blockwise method is proposed for confidence interval estimation of the process mean, which is valid for various dependence structures including long‐range dependence. The finite‐sample performance of the method is evaluated through a simulation study and compared with other confidence interval procedures involving subsampling or normal approximations.     

Maximum likelihood estimation of higher‐order integer‐valued autoregressive processes

Abstract. In this article, we extend the earlier work of Freeland and McCabe [Journal of time Series Analysis (2004) Vol. 25, pp. 701–722] and develop a general framework for maximum likelihood (ML) analysis of higher‐order integer‐valued autoregressive processes. Our exposition includes the case where the innovation sequence has a Poisson distribution and the thinning is binomial. A recursive representation of the transition probability of the model is proposed. Based on this transition probability, we derive expressions for the score function and the Fisher information matrix, which form the basis for ML estimation and inference. Similar to the results in Freeland and McCabe (2004) , we show that the score function and the Fisher information matrix can be neatly represented as conditional expectations. Using the INAR(2) specification with binomial thinning and Poisson innovations, we examine both the asymptotic efficiency and finite sample properties of the ML estimator in relation to the widely used conditional least squares (CLS) and Yule–Walker (YW) estimators. We conclude that, if the Poisson assumption can be justified, there are substantial gains to be had from using ML especially when the thinning parameters are large.     

Robust empirical likelihood for time series

This article introduces a robust frequency domain empirical likelihood inference procedure for the parametric component in the spectral densities of stationary processes. We construct the empirical likelihood function by using a new spectral estimating function to achieve robustness against contamination in the spectral density. Simulation studies demonstrate the good performance of the proposed robust frequency domain empirical likelihood method, which produces more accurate confidence regions than the ordinary empirical likelihood counterpart.     

Testing for a Unit Root in Noncausal Autoregressive Models

This work develops maximum likelihood‐based unit root tests in the noncausal autoregressive (NCAR) model with a non‐Gaussian error term formulated by Lanne and Saikkonen (2011, Journal of Time Series Econometrics 3, Issue 3, Article 2). Finite‐sample properties of the tests are examined via Monte Carlo simulations. The results show that the size properties of the tests are satisfactory and that clear power gains against stationary NCAR alternatives can be achieved in comparison with available alternative tests. In an empirical application to a Finnish interest rate series, evidence in favour of an NCAR model with leptokurtic errors is found.     

Empirical Likelihood for a Long Range Dependent Process Subordinated to a Gaussian Process

This article develops empirical likelihood methodology for a class of long range dependent processes driven by a stationary Gaussian process. We consider population parameters that are defined by estimating equations in the time domain. It is shown that the standard block empirical likelihood (BEL) method, with a suitable scaling, has a non‐standard limit distribution based on a multiple Wiener–Itô integral. Unlike the short memory time series case, the scaling constant involves unknown population quantities that may be difficult to estimate. Alternative versions of the empirical likelihood method, involving the expansive BEL (EBEL) methods are considered. It is shown that the EBEL renditions do not require an explicit scaling and, therefore, remove this undesirable feature of the standard BEL. However, the limit law involves the long memory parameter, which may be estimated from the data. Results from a moderately large simulation study on finite sample properties of tests and confidence intervals based on different empirical likelihood methods are also reported.     

Empirical likelihood intervals for conditional Value‐at‐Risk in ARCH/GARCH models

Value‐at‐Risk (VaR) is a simple, but useful measure in risk management. When some volatility model is employed, conditional VaR is of importance. As autoregressive conditional heteroscedastic (ARCH) and generalized ARCH (GARCH) models are widely used in modelling volatilities, in this article, we propose empirical likelihood methods to obtain an interval estimation for the conditional VaR with the volatility model being an ARCH/GARCH model.