Conway–Maxwell–Poisson Autoregressive Moving Average Model for Equidispersed,Underdispersed, and Overdispersed Count Data

In this work, we propose a dynamic regression model based on the ConwayŮMaxwell–Poisson (CMP) distribution with time-varying conditional mean depending on covariates and lagged observations. This new class of ConwayŮMaxwell–Poisson autoregressive moving average (CMP-ARMA) models is suitable for the analysis of time series of counts. The CMP distribution is a two-parameter generalization of the Poisson distribution that allows the modeling of underdispersed, equidispersed, and overdispersed data. Our main contribution is to combine this dispersion flexibility with the inclusion of lagged terms to model the conditional mean response, inducing an autocorrelation structure, usually relevant in time series. We present the conditional maximum likelihood estimation, hypothesis testing inference, diagnostic analysis, and forecasting along with their asymptotic properties. In particular, we provide closed-form expressions for the conditional score vector and conditional Fisher information matrix. We conduct a Monte Carlo experiment to evaluate the performance of the estimators in finite sample sizes. Finally, we illustrate the usefulness of the proposed model by exploring two empirical applications.     

The Effect of the Estimation on Goodness‐of‐Fit Tests in Time Series Models

Abstract. We analyze, by simulation, the finite‐sample properties of goodness‐of‐fit tests based on residual autocorrelation coefficients (simple and partial) obtained using different estimators frequently used in the analysis of autoregressive moving‐average time‐series models. The estimators considered are unconditional least squares, maximum likelihood and conditional least squares. The results suggest that although the tests based on these estimators are asymptotically equivalent for particular models and parameter values, their sampling properties for samples of the size commonly found in economic applications can differ substantially, because of differences in both finite‐sample estimation efficiencies and residual regeneration methods.     

Matched samples logistic regression in case-control studies with missing values: when to break the matches

Simulated data sets are used to evaluate conditional and unconditional maximum likelihood estimation in an individual case-control design with continuous covariates when there are different rates of excluded cases and different levels of other design parameters. The effectiveness of the estimation procedures is measured by method bias, variance of the estimators, root mean square error (RMSE) for logistic regression and the percentage of explained variation. Conditional estimation leads to higher RMSE than unconditional estimation in the presence of missing observations, especially for 1:1 matching. The RMSE is higher for the smaller stratum size, especially for the 1:1 matching. The percentage of explained variation appears to be insensitive to missing data, but is generally higher for the conditional estimation than for the unconditional estimation. It is particularly good for the 1:2 matching design. For minimizing RMSE, a high matching ratio is recommended; in this case, conditional and unconditional logistic regression models yield comparable levels of effectiveness. For maximizing the percentage of explained variation, the 1:2 matching design with the conditional logistic regression model is recommended.     

Maximum likelihood estimation of higher‐order integer‐valued autoregressive processes

Abstract. In this article, we extend the earlier work of Freeland and McCabe [Journal of time Series Analysis (2004) Vol. 25, pp. 701–722] and develop a general framework for maximum likelihood (ML) analysis of higher‐order integer‐valued autoregressive processes. Our exposition includes the case where the innovation sequence has a Poisson distribution and the thinning is binomial. A recursive representation of the transition probability of the model is proposed. Based on this transition probability, we derive expressions for the score function and the Fisher information matrix, which form the basis for ML estimation and inference. Similar to the results in Freeland and McCabe (2004) , we show that the score function and the Fisher information matrix can be neatly represented as conditional expectations. Using the INAR(2) specification with binomial thinning and Poisson innovations, we examine both the asymptotic efficiency and finite sample properties of the ML estimator in relation to the widely used conditional least squares (CLS) and Yule–Walker (YW) estimators. We conclude that, if the Poisson assumption can be justified, there are substantial gains to be had from using ML especially when the thinning parameters are large.     

Postmodel selection estimators of variance function for nonlinear autoregression

We consider a problem of estimating a conditional variance function of an autoregressive process. A finite collection of parametric models for conditional density is studied when both regression and variance are modelled by parametric functions. The proposed estimators are defined as the maximum likelihood estimators in the models chosen by penalized selection criteria. Consistency properties of the resulting estimator of the variance when the conditional density belongs to one of the parametric models are studied as well as its behaviour under mis‐specification. The autoregressive process does not need to be stationary but only existence of a stationary distribution and ergodicity is required. Analogous results for the pseudolikelihood method are also discussed. A simulation study shows promising behaviour of the proposed estimator in the case of heavy‐tailed errors in comparison with local linear smoothers.     

Inference on Multivariate Heteroscedastic Time Varying Random Coefficient Models

In this article, we introduce the general setting of a multivariate time series autoregressive model with stochastic time‐varying coefficients and time‐varying conditional variance of the error process. This allows modelling VAR dynamics for non‐stationary time series and estimation of time‐varying parameter processes by the well‐known rolling regression estimation techniques. We establish consistency, convergence rates, and asymptotic normality for kernel estimators of the paths of coefficient processes and provide pointwise valid standard errors. The method is applied to a popular seven‐variable dataset to analyse evidence of time variation in empirical objects of interest for the DSGE (dynamic stochastic general equilibrium) literature.     

HYPOTHESIS TESTING FOR ARCH MODELS: A MULTIPLE QUANTILE REGRESSIONS APPROACH

We propose a quantile regression‐based test to detect the presence of autoregressive conditional heteroscedasticity by combining distributional information across multiple quantiles. A chi‐square‐type test statistic based on the weighted average of distinct regression quantile estimators is formed. Unlike the widely used likelihood‐based tests, the proposed test does not make any distributional assumptions on the underlying errors. Monte Carlo simulation studies show that the proposed test outperforms the likelihood‐based tests in several aspects.     

ROBUST FITTING OF INARCH MODELS

We discuss robust M‐estimation of INARCH models for count time series. These models assume the observation at each point in time to follow a Poisson distribution conditionally on the past, with the conditional mean being a linear function of previous observations. This simple linear structure allows us to transfer M‐estimators for autoregressive models to this situation, with some simplifications being possible because the conditional variance given the past equals the conditional mean. We investigate the performance of the resulting generalized M‐estimators using simulations. The usefulness of the proposed methods is illustrated by real data examples.     

A Goodness‐of‐Fit Test for Integer‐Valued Autoregressive Processes

For autoregressive count data time series, a goodness‐of‐fit test based on the empirical joint probability generating function is considered. The underlying process is contained in a general class of Markovian models satisfying a drift condition. Asymptotic theory for the test statistic is provided, including a functional central limit theorem for the non‐parametric estimation of the stationary distribution and a parametric bootstrap method. Connections between the new approach and existing tests for count data time series based on moment estimators appear in limiting scenarios. Finally, the test is applied to a real data set.     

GQL Versus Conditional GQL Inferences for Non‐Stationary Time Series of Counts with Overdispersion

Abstract. This article proposes an autoregressive model for time series of counts with non‐stationary means, variances and covariances as functions of certain time‐dependant covariates. For the estimation of the regression, overdispersion and correlation index parameters, a conditional generalized quasilikelihood (CGQL) approach is developed under the assumption that the count responses marginally satisfy the first two moments of a negative binomial distribution. Thus this CGQL approach avoids the use of the likelihood or so‐called partial likelihood of the data which are known to be extremely complicated in the present non‐stationary time series set‐up. It is shown through an extensive simulation study that the proposed CGQL approach performs very well in estimating the parameters of the model. This is also shown that the CGQL approach performs better than an existing GQL approach, especially for the estimation of the overdispersion parameter of the model.     

ANALYSIS OF THE LIKELIHOOD FUNCTION FOR MARKOV‐SWITCHING VAR(CH) MODELS

In this work, we give simple matrix formulae for maximum likelihood estimates of parameters in a broad class of vector autoregressions subject to Markovian changes in regime. This allows us to determine explicitly the asymptotic variance–covariance matrix of the estimators, giving a concrete possibility for the use of the classical testing procedures. In the context of multivariate autoregressive conditional heteroskedastic models with changes in regime, we provide formulae for the analytic derivatives of the log likelihood. Then we prove the consistency of some maximum likelihood estimators and give some formulae for the asymptotic variance of the different estimators.     

Maximum likelihood estimation of pseudo-stoichiometry in macroscopic biological reaction schemes

Identification of pseudo-stoichiometric (or yield) coefficients is of primary importance for building a bioprocess model. In most of the applications, the estimation of these coefficients has to be performed without any knowledge of the kinetics and on the basis of a few experiments for which noisy discrete measurements of component concentrations are available. This paper proposes maximum likelihood estimators which are able to deal with measurement errors on all the signals, at each sampling time (including the initial one) and with intrinsic sign constraints on the parameters. This kind of realistic hypotheses exclude the use of the usual (weighted) least-squares estimators. The maximum likelihood estimators are proved to be unbiased (provided a first-order approximation) and their estimation error covariance matrix can be computed (at the same level of first-order approximation). The solutions are proposed in a very general framework, dealing with cell cultures (of bacteria, yeasts or animal cells) performed in stirred tank (continuous, semi-batch or batch) reactors, and without any a priori knowledge on the kinetics. The use of the estimators and their statistical properties are illustrated in a simulation case study (fed-batch bacterial cultures) and in a real case one (batch animal cell cultures).     

Multi‐variate stochastic volatility modelling using Wishart autoregressive processes

A new multi‐variate stochastic volatility estimation procedure for financial time series is proposed. A Wishart autoregressive process is considered for the volatility precision covariance matrix, for the estimation of which a two step procedure is adopted. The first step is the conditional inference on the autoregressive parameters and the second step is the unconditional inference, based on a Newton‐Raphson iterative algorithm. The proposed methodology, which is mostly Bayesian, is suitable for medium dimensional data and it bridges the gap between closed‐form estimation and simulation‐based estimation algorithms. An example, consisting of foreign exchange rates data, illustrates the proposed methodology.     

Least tail‐trimmed squares for infinite variance autoregressions

We develop a robust least squares estimator for autoregressions with possibly heavy tailed errors. Robustness to heavy tails is ensured by negligibly trimming the squared error according to extreme values of the error and regressors. Tail‐trimming ensures asymptotic normality and super‐‐convergence with a rate comparable to the highest achieved amongst M‐estimators for stationary data. Moreover, tail‐trimming ensures robustness to heavy tails in both small and large samples. By comparison, existing robust estimators are not as robust in small samples, have a slower rate of convergence when the variance is infinite, or are not asymptotically normal. We present a consistent estimator of the covariance matrix and treat classic inference without knowledge of the rate of convergence. A simulation study demonstrates the sharpness and approximate normality of the estimator, and we apply the estimator to financial returns data. Finally, tail‐trimming can be easily extended beyond least squares estimation for a linear stationary AR model. We discuss extensions to quasi‐maximum likelihood for GARCH, weighted least squares for a possibly non‐stationary random coefficient autoregression, and empirical likelihood for robust confidence region estimation, in each case for models with possibly heavy tailed errors.     

Spatio‐temporal models for big multinomial data using the conditional multivariate logit‐beta distribution

We introduce a Bayesian approach for analyzing high‐dimensional multinomial data that are referenced over space and time. In particular, the proportions associated with multinomial data are assumed to have a logit link to a latent spatio‐temporal mixed effects model. This strategy allows for covariances that are nonstationarity in both space and time, asymmetric, and parsimonious. We also introduce the use of the conditional multivariate logit‐beta distribution into the dependent multinomial data setting, which leads to conjugate full‐conditional distributions for use in a collapsed Gibbs sampler. We refer to this model as the multinomial spatio‐temporal mixed effects model (MN‐STM). Additionally, we provide methodological developments including: the derivation of the associated full‐conditional distributions, a relationship with a latent Gaussian process model, and the stability of the non‐stationary vector autoregressive model. We illustrate the MN‐STM through simulations and through a demonstration with public‐use quarterly workforce indicators data from the longitudinal employer household dynamics program of the US Census Bureau.     

ASYMPTOTIC DISTRIBUTIONS OF LIKELIHOOD RATIOS FOR OVERPARAMETRIZED ARMA PROCESSES

Abstract. This paper is devoted to an extension of a classical problem of statistics to the asymptotic distribution of likelihood ratios. Two main types of likelihood ratios are considered for Gaussian ARMA processes. It is assumed in both cases that the asymptotic Fisher information matrix of estimation is singular in the higher order models. It is proved that the asymptotic distributions of the log likelihood ratios are invariant with respect to the parameters generating the process. A simulation shows that the sample distribution of the log likelihood ratio approaches the asymptotic one. Finally, the likelihood ratio test is proposed for model order reduction.     

Local Likelihood for non‐parametric ARCH(1) models

Abstract. We propose a non‐parametric local likelihood estimator for the log‐transformed autoregressive conditional heteroscedastic (ARCH) (1) model. Our non‐parametric estimator is constructed within the likelihood framework for non‐Gaussian observations: it is different from standard kernel regression smoothing, where the innovations are assumed to be normally distributed. We derive consistency and asymptotic normality for our estimators and show, by a simulation experiment and some real‐data examples, that the local likelihood estimator has better predictive potential than classical local regression. A possible extension of the estimation procedure to more general multiplicative ARCH(p) models with p > 1 predictor variables is also described.     

Consistent Estimation of the Value at Risk When the Error Distribution of the Volatility Model is Misspecified

A two‐step approach for conditional value at risk estimation is considered. First, a generalized quasi‐maximum likelihood estimator is employed to estimate the volatility parameter, then the empirical quantile of the residuals serves to estimate the theoretical quantile of the innovations. When the instrumental density h of the generalized quasi‐maximum likelihood estimator is not the Gaussian density, both the estimations of the volatility and of the quantile are generally asymptotically biased. However, the two errors counterbalance and lead to a consistent estimator of the value at risk. We obtain the asymptotic behavior of this estimator and show how to choose optimally h.     

First‐order integer valued AR processes with zero inflated poisson innovations

The first‐order nonnegative integer valued autoregressive process has been applied to model the counts of events in consecutive points of time. It is known that, if the innovations are assumed to follow a Poisson distribution then the marginal model is also Poisson. This model may however not be suitable for overdispersed count data. One frequent manifestation of overdispersion is that the incidence of zero counts is greater than expected from a Poisson model. In this paper, we introduce a new stationary first‐order integer valued autoregressive process with zero inflated Poisson innovations. We derive some structural properties such as the mean, variance, marginal and joint distribution functions of the process. We consider estimation of the unknown parameters by conditional or approximate full maximum likelihood. We use simulation to study the limiting marginal distribution of the process and the performance of our fitting algorithms. Finally, we demonstrate the usefulness of the proposed model by analyzing some real time series on animal health laboratory submissions.     

Integer‐Valued GARCH Process

Abstract. An integer‐valued analogue of the classical generalized autoregressive conditional heteroskedastic (GARCH) (p,q) model with Poisson deviates is proposed and a condition for the existence of such a process is given. For the case p = 1, q = 1, it is explicitly shown that an integer‐valued GARCH process is a standard autoregressive moving average (1, 1) process. The problem of maximum likelihood estimation of parameters is treated. An application of the model to a real time series with a numerical example is given.