Negative Binomial Quasi‐Likelihood Inference for General Integer‐Valued Time Series Models

Two negative binomial quasi‐maximum likelihood estimates (NB‐QMLEs) for a general class of count time series models are proposed. The first one is the profile NB‐QMLE calculated while arbitrarily fixing the dispersion parameter of the negative binomial likelihood. The second one, termed two‐stage NB‐QMLE, consists of four stages estimating both conditional mean and dispersion parameters. It is shown that the two estimates are consistent and asymptotically Gaussian under mild conditions. Moreover, the two‐stage NB‐QMLE enjoys a certain asymptotic efficiency property provided that a negative binomial link function relating the conditional mean and conditional variance is specified. The proposed NB‐QMLEs are compared with the Poisson QMLE asymptotically and in finite samples for various well‐known particular classes of count time series models such as the Poisson and negative binomial integer‐valued GARCH model and the INAR(1) model. Application to a real dataset is given.     

Integer‐Valued Autoregressive Models With Survival Probability Driven By A Stochastic Recurrence Equation

This paper proposes a new class of integer‐valued autoregressive models with a dynamic survival probability. The peculiarity of this class of models lies in the specification of the survival probability through a stochastic recurrence equation. The proposed models can effectively capture changing dependence over time and enhance both the in‐sample and out‐of‐sample performance of integer‐valued autoregressive models. This point is illustrated through an empirical application to a real‐time series of crime reports. Additionally, this paper discusses the reliability of likelihood‐based inference for the class of models. In particular, this study proves the consistency of the maximum likelihood estimator and a plug‐in estimator for the conditional probability mass function in a misspecified model setting.     

Infinitely Divisible Distributions in Integer‐Valued Garch Models

We propose an integer‐valued stochastic process with conditional marginal distribution belonging to the class of infinitely divisible discrete probability laws. With this proposal, we introduce a wide class of models for count time series that includes the Poisson integer‐valued generalized autoregressive conditional heteroscedastic (INGARCH) model (Ferland et al., 2006) and the negative binomial and generalized Poisson INGARCH models (Zhu, 2011, 2012a). The main probabilistic analysis of this process is developed stating, in particular, first‐order and second‐order stationarity conditions. The existence of a strictly stationary and ergodic solution is established in a subclass including the Poisson and generalized Poisson INGARCH models.     

Maximum likelihood estimation of higher‐order integer‐valued autoregressive processes

Abstract. In this article, we extend the earlier work of Freeland and McCabe [Journal of time Series Analysis (2004) Vol. 25, pp. 701–722] and develop a general framework for maximum likelihood (ML) analysis of higher‐order integer‐valued autoregressive processes. Our exposition includes the case where the innovation sequence has a Poisson distribution and the thinning is binomial. A recursive representation of the transition probability of the model is proposed. Based on this transition probability, we derive expressions for the score function and the Fisher information matrix, which form the basis for ML estimation and inference. Similar to the results in Freeland and McCabe (2004) , we show that the score function and the Fisher information matrix can be neatly represented as conditional expectations. Using the INAR(2) specification with binomial thinning and Poisson innovations, we examine both the asymptotic efficiency and finite sample properties of the ML estimator in relation to the widely used conditional least squares (CLS) and Yule–Walker (YW) estimators. We conclude that, if the Poisson assumption can be justified, there are substantial gains to be had from using ML especially when the thinning parameters are large.     

MCMC for Integer‐Valued ARMA processes

Abstract. The classical statistical inference for integer‐valued time‐series has primarily been restricted to the integer‐valued autoregressive (INAR) process. Markov chain Monte Carlo (MCMC) methods have been shown to be a useful tool in many branches of statistics and is particularly well suited to integer‐valued time‐series where statistical inference is greatly assisted by data augmentation. Thus in this article, we outline an efficient MCMC algorithm for a wide class of integer‐valued autoregressive moving‐average (INARMA) processes. Furthermore, we consider noise corrupted integer‐valued processes and also models with change points. Finally, in order to assess the MCMC algorithms inferential and predictive capabilities we use a range of simulated and real data sets.     

Testing Parameter Change in General Integer‐Valued Time Series

We consider the structural change in a class of discrete valued time series, which the conditional distribution belongs to the one‐parameter exponential family. We propose a change point test based on the maximum likelihood estimator of the model's parameter. Under the null hypothesis (of no change), the test statistic converges to a well‐known distribution, allowing the calculation of the critical value of the test. The test statistic diverges to infinity under the alternative, meaning that the test has asymptotic power one. Some simulation results and real data applications are reported to show the effectiveness of the proposed procedure.     

Asymptotics for the Conditional‐Sum‐of‐Squares Estimator in Multivariate Fractional Time‐Series Models

This article proves consistency and asymptotic normality for the conditional‐sum‐of‐squares estimator, which is equivalent to the conditional maximum likelihood estimator, in multivariate fractional time‐series models. The model is parametric and quite general and, in particular, encompasses the multivariate non‐cointegrated fractional autoregressive integrated moving average (ARIMA) model. The novelty of the consistency result, in particular, is that it applies to a multivariate model and to an arbitrarily large set of admissible parameter values, for which the objective function does not converge uniformly in probability, thus making the proof much more challenging than usual. The neighbourhood around the critical point where uniform convergence fails is handled using a truncation argument.     

Integer‐Valued GARCH Process

Abstract. An integer‐valued analogue of the classical generalized autoregressive conditional heteroskedastic (GARCH) (p,q) model with Poisson deviates is proposed and a condition for the existence of such a process is given. For the case p = 1, q = 1, it is explicitly shown that an integer‐valued GARCH process is a standard autoregressive moving average (1, 1) process. The problem of maximum likelihood estimation of parameters is treated. An application of the model to a real time series with a numerical example is given.     

Testing for parameter constancy in non‐Gaussian time series

This paper investigates testing for parameter constancy in models for non‐Gaussian time series. Models for discrete valued count time series are investigated as well as more general models with autoregressive conditional expectations. Both sup‐tests and CUSUM procedures are suggested depending on the complexity of the model being used. The asymptotic distribution of the CUSUM test is derived for a general class of conditional autoregressive models.     

Empirical likelihood inference for random coefficient INAR(p) process

In this article, we study the empirical likelihood (EL) method for the pth‐order random coefficient integer‐valued autoregressive process. In particular, the limiting distribution of the log EL ratio statistic is established and the confidence regions for the parameter of interest are derived. Also a simulation study is conducted for the evaluation of the developed approach.     

Finite Sample Theory of QMLE in ARCH Models with Dynamics in the Mean Equation

Abstract. We provide simulation and theoretical results concerning the finite‐sample theory of quasi‐maximum‐likelihood estimators in autoregressive conditional heteroskedastic (ARCH) models when we include dynamics in the mean equation. In the setting of the AR(q)–ARCH(p), we find that in some cases bias correction is necessary even for sample sizes of 100, especially when the ARCH order increases. We warn about the existence of important biases and potentially low power of the t‐tests in these cases. We also propose ways to deal with them. We also find simulation evidence that when conditional heteroskedasticity increases, the mean‐squared error of the maximum‐likelihood estimator of the AR(1) parameter in the mean equation of an AR(1)‐ARCH(1) model is reduced. Finally, we generalize the Lumsdaine [J. Bus. Econ. Stat. 13 (1995) pp. 1–10] invariance properties for the biases in these situations.     

Zero‐Modified Geometric INAR(1) Process for Modelling Count Time Series with Deflation or Inflation of Zeros

In this article, we propose a first‐order integer‐valued autoregressive [INAR(1)] process for dealing with count time series with deflation or inflation of zeros. The proposed process has zero‐modified geometric marginals and contains the geometric INAR(1) process as a particular case. The proposed model is also capable of capturing underdispersion and overdispersion, which sometimes are caused by deflation or inflation of zeros. We explore several statistical and mathematical properties of the process, discuss point estimation of the parameters and find the asymptotic distribution of the proposed estimators. We also propose a test based on our model for checking if the count time series considered is deflated or inflated of zeros. Two empirical illustrations are presented in order to show the potential for practice of our zero‐modified geometric INAR(1) process. This article contains a Supporting Information.     

Robust estimation for the covariance matrix of multi‐variate time series

In this article, we study the robust estimation for the covariance matrix of stationary multi‐variate time series. As a robust estimator, we propose to use a minimum density power divergence estimator (MDPDE) proposed by Basu et al. (1998) . Particularly, the MDPDE is designed to perform properly when the time series is Gaussian. As a special case, we consider the robust estimator for the autocovariance function of univariate stationary time series. It is shown that the MDPDE is strongly consistent and asymptotically normal under regularity conditions. Simulation results are provided for illustration.     

Inference for pth‐order random coefficient integer‐valued autoregressive processes

Abstract. A pth‐order random coefficient integer‐valued autoregressive [RCINAR(p)] model is proposed for count data. Stationarity and ergodicity properties are established. Maximum likelihood, conditional least squares, modified quasi‐likelihood and generalized method of moments are used to estimate the model parameters. Asymptotic properties of the estimators are derived. Simulation results on the comparison of the estimators are reported. The models are applied to two real data sets.     

Local asymptotic normality and efficient estimation for INAR(p) models

Abstract. Integer‐valued autoregressive (INAR) processes have been introduced to model non‐negative integer‐valued phenomena that evolve in time. The distribution of an INAR(p) process is determined by two parameters: a vector of survival probabilities and a probability distribution on the non‐negative integers, called an immigration distribution. This paper provides an efficient estimator of the parameters, and in particular, shows that the INAR(p) model has the Local Asymptotic Normality property.     

First‐order integer valued AR processes with zero inflated poisson innovations

The first‐order nonnegative integer valued autoregressive process has been applied to model the counts of events in consecutive points of time. It is known that, if the innovations are assumed to follow a Poisson distribution then the marginal model is also Poisson. This model may however not be suitable for overdispersed count data. One frequent manifestation of overdispersion is that the incidence of zero counts is greater than expected from a Poisson model. In this paper, we introduce a new stationary first‐order integer valued autoregressive process with zero inflated Poisson innovations. We derive some structural properties such as the mean, variance, marginal and joint distribution functions of the process. We consider estimation of the unknown parameters by conditional or approximate full maximum likelihood. We use simulation to study the limiting marginal distribution of the process and the performance of our fitting algorithms. Finally, we demonstrate the usefulness of the proposed model by analyzing some real time series on animal health laboratory submissions.     

Inference for the Fourth‐Order Innovation Cumulant in Linear Time Series

The rescaled fourth‐order cumulant of the unobserved innovations of linear time series is an important parameter in statistical inference. This article deals with the problem of estimating this parameter. An existing nonparametric estimator is first discussed, and its asymptotic properties are derived. It is shown how the autocorrelation structure of the underlying process affects the behaviour of the estimator. Based on our findings and on an important invariance property of the parameter of interest with respect to linear filtering, a pre‐whitening‐based nonparametric estimator of the same parameter is proposed. The estimator is obtained using the filtered time series only; that is, an inversion of the pre‐whitening procedure is not required. The asymptotic properties of the new estimator are investigated, and its superiority is established for large classes of stochastic processes. It is shown that for the particular estimation problem considered, pre‐whitening can reduce the variance and the bias of the estimator. The finite sample performance of both estimators is investigated by means of simulations. The new estimator allows for a simple modification of the multiplicative frequency domain bootstrap, which extends its considerable range of validity. Furthermore, the problem of testing hypotheses about the rescaled fourth‐order cumulant of the unobserved innovations is also considered. In this context, a simple test for Gaussianity is proposed. Some real‐life data applications are presented.     

Robustness of Zero Crossing Estimator

Zero crossing (ZC) statistic is the number of zero crossings observed in a time series. The expected value of the ZC specifies the first‐order autocorrelation of the processes. Hence, we can estimate the autocorrelation by using the ZC estimator. The asymptotic consistency and normality of the ZC estimator for scalar Gaussian processes are already discussed in 1980. In this article, first, we derive the joint asymptotic distribution of the ZC estimator for ellipsoidal processes. Next, we show the variance of the ZC estimator does not attain the Cramer–Rao lower bound (CRLB). However, it is shown that the ZC estimator has robustness when the process is contaminated by an outlier. In contrast with this, we observe that the quasi‐maximum likelihood estimator (QMLE) attains the CRLB. However, we can see that QMLE is sensitive for the outlier.     

A mixed INAR(p) model

A mixed integer‐valued autoregressive model of order p is proposed. The existence of this unique, stationary and ergodic process is proved and its autocorrelation structure and some conditional stochastic characteristics are derived. Model parameters are estimated via Yule‐Walker, conditional least squares and conditional maximum likelihood methods. Finally, possible application of the model to real data sets is considered.     

A PARAMETER‐DRIVEN LOGIT REGRESSION MODEL FOR BINARY TIME SERIES

We consider a parameter‐driven regression model for binary time series, where serial dependence is introduced by an autocorrelated latent process incorporated into the logit link function. Unlike in the case of parameter‐driven Poisson log‐linear or negative binomial logit regression model studied in the literature for time series of counts, generalized linear model (GLM) estimation of the regression coefficient vector, which suppresses the latent process and maximizes the corresponding pseudo‐likelihood, cannot produce a consistent estimator. As a remedial measure, in this article, we propose a modified GLM estimation procedure and show that the resulting estimator is consistent and asymptotically normal. Moreover, we develop two procedures for estimating the asymptotic covariance matrix of the estimator and establish their consistency property. Simulation studies are conducted to evaluate the finite‐sample performance of the proposed procedures. An empirical example is also presented.