Negative Binomial Quasi‐Likelihood Inference for General Integer‐Valued Time Series Models

Two negative binomial quasi‐maximum likelihood estimates (NB‐QMLEs) for a general class of count time series models are proposed. The first one is the profile NB‐QMLE calculated while arbitrarily fixing the dispersion parameter of the negative binomial likelihood. The second one, termed two‐stage NB‐QMLE, consists of four stages estimating both conditional mean and dispersion parameters. It is shown that the two estimates are consistent and asymptotically Gaussian under mild conditions. Moreover, the two‐stage NB‐QMLE enjoys a certain asymptotic efficiency property provided that a negative binomial link function relating the conditional mean and conditional variance is specified. The proposed NB‐QMLEs are compared with the Poisson QMLE asymptotically and in finite samples for various well‐known particular classes of count time series models such as the Poisson and negative binomial integer‐valued GARCH model and the INAR(1) model. Application to a real dataset is given.     

Integer‐Valued GARCH Process

Abstract. An integer‐valued analogue of the classical generalized autoregressive conditional heteroskedastic (GARCH) (p,q) model with Poisson deviates is proposed and a condition for the existence of such a process is given. For the case p = 1, q = 1, it is explicitly shown that an integer‐valued GARCH process is a standard autoregressive moving average (1, 1) process. The problem of maximum likelihood estimation of parameters is treated. An application of the model to a real time series with a numerical example is given.     

MCMC for Integer‐Valued ARMA processes

Abstract. The classical statistical inference for integer‐valued time‐series has primarily been restricted to the integer‐valued autoregressive (INAR) process. Markov chain Monte Carlo (MCMC) methods have been shown to be a useful tool in many branches of statistics and is particularly well suited to integer‐valued time‐series where statistical inference is greatly assisted by data augmentation. Thus in this article, we outline an efficient MCMC algorithm for a wide class of integer‐valued autoregressive moving‐average (INARMA) processes. Furthermore, we consider noise corrupted integer‐valued processes and also models with change points. Finally, in order to assess the MCMC algorithms inferential and predictive capabilities we use a range of simulated and real data sets.     

Infinitely Divisible Distributions in Integer‐Valued Garch Models

We propose an integer‐valued stochastic process with conditional marginal distribution belonging to the class of infinitely divisible discrete probability laws. With this proposal, we introduce a wide class of models for count time series that includes the Poisson integer‐valued generalized autoregressive conditional heteroscedastic (INGARCH) model (Ferland et al., 2006) and the negative binomial and generalized Poisson INGARCH models (Zhu, 2011, 2012a). The main probabilistic analysis of this process is developed stating, in particular, first‐order and second‐order stationarity conditions. The existence of a strictly stationary and ergodic solution is established in a subclass including the Poisson and generalized Poisson INGARCH models.     

A Goodness‐of‐Fit Test for Integer‐Valued Autoregressive Processes

For autoregressive count data time series, a goodness‐of‐fit test based on the empirical joint probability generating function is considered. The underlying process is contained in a general class of Markovian models satisfying a drift condition. Asymptotic theory for the test statistic is provided, including a functional central limit theorem for the non‐parametric estimation of the stationary distribution and a parametric bootstrap method. Connections between the new approach and existing tests for count data time series based on moment estimators appear in limiting scenarios. Finally, the test is applied to a real data set.     

Integer‐Valued Autoregressive Models With Survival Probability Driven By A Stochastic Recurrence Equation

This paper proposes a new class of integer‐valued autoregressive models with a dynamic survival probability. The peculiarity of this class of models lies in the specification of the survival probability through a stochastic recurrence equation. The proposed models can effectively capture changing dependence over time and enhance both the in‐sample and out‐of‐sample performance of integer‐valued autoregressive models. This point is illustrated through an empirical application to a real‐time series of crime reports. Additionally, this paper discusses the reliability of likelihood‐based inference for the class of models. In particular, this study proves the consistency of the maximum likelihood estimator and a plug‐in estimator for the conditional probability mass function in a misspecified model setting.     

Testing Non‐Correlation and Non‐Causality between Multivariate ARMA Time Series

Abstract. Haugh [Journal of the American Statistical Association (1976) Vol. 71, pp. 378–85] developed an approach to the problem of testing non‐correlation (at all leads and lags) between two univariate time series. Haugh's tests however have low power against two series which are related over a long distributed lag when individual lag coefficients are relatively small. As a remedy, Koch and Yang [Journal of the American Statistical Association (1986) Vol. 8, pp. 533–44] proposed an alternative method that performs better than Haugh's under such dependencies. A multivariate extension of Haugh's procedure was proposed by El Himdi and Roy [The Canadian Journal of Statistics (1997) Vol. 25, pp. 233–56], but suffers the same weaknesses as the original univariate method. We develop here an asymptotic test generalizing Koch and Yang's method to the multivariate case. Our method includes El Himdi and Roy's as a special case. Based on the same idea, we also suggest a generalization of the El Himdi and Roy procedure for testing causality in the sense of Granger [Econometrica (1969) Vol. 37, pp. 424–38] between two multivariate series. A Monte Carlo study is conducted, which indicates that our approach performs better than El Himdi and Roy's for a wide range of models. Both procedures are applied to the problem of testing the absence of correlation between Canadian and US economic indicators, and to a brief study of causality between money and income in Canada.     

Poisson QMLE of Count Time Series Models

Regularity conditions are given for the consistency of the Poisson quasi‐maximum likelihood estimator of the conditional mean parameter of a count time series model. The asymptotic distribution of the estimator is studied when the parameter belongs to the interior of the parameter space and when it lies at the boundary. Tests for the significance of the parameters and for constant conditional mean are deduced. Applications to specific integer‐valued autoregressive (INAR) and integer‐valued generalized autoregressive conditional heteroscedasticity (INGARCH) models are considered. Numerical illustrations, Monte Carlo simulations and real data series are provided.     

Marginal Estimation of Parameter Driven Binomial Time Series Models

This article develops asymptotic theory for estimation of parameters in regression models for binomial response time series where serial dependence is present through a latent process. Use of generalized linear model estimating equations leads to asymptotically biased estimates of regression coefficients for binomial responses. An alternative is to use marginal likelihood, in which the variance of the latent process but not the serial dependence is accounted for. In practice, this is equivalent to using generalized linear mixed model estimation procedures treating the observations as independent with a random effect on the intercept term in the regression model. We prove that this method leads to consistent and asymptotically normal estimates even if there is an autocorrelated latent process. Simulations suggest that the use of marginal likelihood can lead to generalized linear model estimates result. This problem reduces rapidly with increasing number of binomial trials at each time point, but for binary data, the chance of it can remain over 45% even in very long time series. We provide a combination of theoretical and heuristic explanations for this phenomenon in terms of the properties of the regression component of the model, and these can be used to guide application of the method in practice.     

Oracle M‐Estimation for Time Series Models

We propose a thresholding M‐estimator for multivariate time series. Our proposed estimator has the oracle property that its large‐sample properties are the same as of the classical M‐estimator obtained under the a priori information that the zero parameters were known. We study the consistency of the standard block bootstrap, the centred block bootstrap and the empirical likelihood block bootstrap distributions of the proposed M‐estimator. We develop automatic selection procedures for the thresholding parameter and for the block length of the bootstrap methods. We present the results of a simulation study of the proposed methods for a sparse vector autoregressive VAR(2) time series model. The analysis of two real‐world data sets illustrate applications of the methods in practice.     

Broadband Semiparametric Estimation of the Memory Parameter of a Long-Memory Time Series Using Fractional Exponential Models

We consider a fractional exponential, or FEXP estimator of the memory parameter of a stationary Gaussian long-memory time series. The estimator is constructed by fitting a FEXP model of slowly increasing dimension to the log periodogram at all Fourier frequencies by ordinary least squares, and retaining the corresponding estimated memory parameter. We do not assume that the data were necessarily generated by a FEXP model, or by any other finite-parameter model. We do, however, impose a global differentiability assumption on the spectral density except at the origin. Because of this, and its use of all Fourier frequencies, we refer to the FEXP estimator as a broadband semiparametric estimator. We demonstrate the consistency of the FEXP estimator, and obtain expressions for its asymptotic bias and variance. If the true spectral density is sufficiently smooth, the FEXP estimator can strongly outperform existing semiparametric estimators, such as the Geweke–Porter-Hudak (GPH) and Gaussian semiparametric estimators (GSE), attaining an asymptotic mean squared error proportional to (log n )/ n , where n is the sample size. In a simulation study, we demonstrate the merits of using a finite-sample correction to the asymptotic variance, and we also explore the possibility of automatically selecting the dimension of the exponential model using Mallows' C_L criterion.     

A Self‐Normalized Semi‐Parametric Test to Detect Changes in the Long Memory Parameter

We consider the problem of testing for change points in the long memory parameter. The test relies on semi‐parametric estimation of the long memory parameter, which does not require the complete parametric specification of the whole spectrum. A self‐normalizer utilizing a sequence of recursive semi‐parametric estimators is used to make the asymptotic distribution of the test statistic free of the nuisance scale parameter. We study the asymptotic behavior of the proposed test for situations when there is at most one change point and also when there are an unknown number of change points. Monte Carlo simulations are carried out to examine the finite‐sample performance of the proposed test.     

Gaussian Maximum Likelihood Estimation For ARMA Models. I. Time Series

Abstract. We provide a direct proof for consistency and asymptotic normality of Gaussian maximum likelihood estimators for causal and invertible autoregressive moving‐average (ARMA) time series models, which were initially established by Hannan [Journal of Applied Probability (1973) vol. 10, pp. 130–145] via the asymptotic properties of a Whittle's estimator. This also paves the way to establish similar results for spatial processes presented in the follow‐up article by Yao and Brockwell [Bernoulli (2006) in press].     

Testing for Change in Long‐Memory Stochastic Volatility Time Series

In this article, change‐point problems for long‐memory stochastic volatility (LMSV) models are considered. A general testing problem which includes various alternative hypotheses is discussed. Under the hypothesis of stationarity the limiting behavior of CUSUM‐ and Wilcoxon‐type test statistics is derived. In this context, a limit theorem for the two‐parameter empirical process of LMSV time series is proved. In particular, it is shown that the asymptotic distribution of CUSUM test statistics may not be affected by long memory, unlike Wilcoxon test statistics which are typically influenced by long‐range dependence. To avoid the estimation of nuisance parameters in applications, the usage of self‐normalized test statistics is proposed. The theoretical results are accompanied by an analysis of Standard & Poor's 500 daily closing indices with respect to structural changes and by simulation studies which characterize the finite sample behavior of the considered testing procedures when testing for changes in mean and in variance.     

Zero‐Modified Geometric INAR(1) Process for Modelling Count Time Series with Deflation or Inflation of Zeros

In this article, we propose a first‐order integer‐valued autoregressive [INAR(1)] process for dealing with count time series with deflation or inflation of zeros. The proposed process has zero‐modified geometric marginals and contains the geometric INAR(1) process as a particular case. The proposed model is also capable of capturing underdispersion and overdispersion, which sometimes are caused by deflation or inflation of zeros. We explore several statistical and mathematical properties of the process, discuss point estimation of the parameters and find the asymptotic distribution of the proposed estimators. We also propose a test based on our model for checking if the count time series considered is deflated or inflated of zeros. Two empirical illustrations are presented in order to show the potential for practice of our zero‐modified geometric INAR(1) process. This article contains a Supporting Information.     

On the Optimal Segment Length for Parameter Estimates for Locally Stationary Time Series

We discuss the behaviour of parameter estimates when stationary time series models are fitted locally to non-stationary processes which have an evolutionary spectral representation. A particular example is the estimation for an autoregressive process with time-varying coefficients by local Yule–Walker estimates. The bias and the mean squared error for the parameter estimates are calculated and the optimal length of the data segment is determined.     

A Time‐Symmetric Self‐Normalization Approach for Inference of Time Series

Self‐normalization has been celebrated as an alternative approach for inference of time series because of its ability to avoid direct estimation of the nuisance asymptotic variance. However, when being applied to quantities other than the mean, the conventional self‐normalizer typically exhibits certain degrees of asymmetry, an undesirable feature especially for time‐reversible processes. This paper considers a new self‐normalizer for time series, which (i) provides a time‐symmetric generalization to the conventional self‐normalizer, (ii) is able to automatically reduce to the conventional self‐normalizer in the mean case where the latter is already time‐symmetric to yield a unified inference procedure, and (iii) possibly leads to narrower confidence intervals when compared with the conventional self‐normalizer. For the proposed time‐symmetric self‐normalizer, we establish the asymptotic theory for its induced inference procedure and examine its finite sample performance through numerical experiments.     

On the Evaluation of the Information Matrix for Multiplicative Seasonal Time‐Series Models

Abstract. This paper gives a procedure for evaluating the Fisher information matrix for a general multiplicative seasonal autoregressive moving average time‐series model. The method is based on the well‐known integral specification of Whittle [Ark. Mat. Fys. Astr. (1953) vol. 2. pp. 423–434] and leads to a system of linear equations, which is independent of the seasonal period and has a closed solution. It is shown to be much simpler, in general, than the method of Klein and Mélard [Journal of Time Series Analysis (1990) vol. 11, pp. 231–237], which depends on the seasonal period. It is also shown that the nonseasonal method of McLeod [Biometrika (1984) vol. 71, pp. 207–211] has the same basic features as that of Klein and Mélard. Explicit solutions are obtained for the simpler nonseasonal and seasonal models in common use, a feature which has not been attempted with the Klein–Mélard or the McLeod approaches. Several illustrations of these results are discussed in detail.     

Limiting distributions of unconditional maximum likelihood unit root test statistics in seasonal time–series models

Abstract.  The likelihood function of a seasonal model, Y _t  =  ρ Y _{t − d}  +  e _t as implemented in computer algorithms under the assumption of stationary initial conditions is a function of ρ which is zero at the point ρ  = 1. It is a smooth function for ρ in the above seasonal model with a well-defined maximum regardless of the data-generating mechanism. Gonzalez-Farias (PhD Thesis, North Carolina State University, 1992) proposed tests for unit roots based on maximizing the stationary likelihood function in nonseasonal time series. We extend it to seasonal time series. The limiting distribution of seasonal unit root test statistics based on the unconditional maximum likelihood estimators are shown. Models having a single mean, seasonal means, and a single-trend variable across the seasons are considered.     

A mixed portmanteau test for ARMA‐GARCH models by the quasi‐maximum exponential likelihood estimation approach

This paper investigates the joint limiting distribution of the residual autocorrelation functions and the absolute residual autocorrelation functions of ARMA‐GARCH models. This leads a mixed portmanteau test for diagnostic checking of the ARMA‐GARCH model fitted by using the quasi‐maximum exponential likelihood estimation approach in Zhu and Ling (2011) . Simulation studies are carried out to examine our asymptotic theory, and assess the performance of this mixed test and other two portmanteau tests in Li and Li (2008) . A real example is given.