Maximum likelihood estimation for nearly non‐stationary stable autoregressive processes

The maximum likelihood estimate (MLE) of the autoregressive coefficient of a near‐unit root autoregressive process Y_t = ρ_nY_t?1 + ?_t with α‐stable noise {?_t} is studied in this paper. Herein ρ_n = 1 ? γ/n, γ ≥ 0 is a constant, Y₀ is a fixed random variable and ε_t is an α‐stable random variable with characteristic function φ(t,θ) for some parameter θ. It is shown that when 0 < α < 1 or α > 1 and E?₁ = 0, the limit distribution of the MLE of ρ_n and θ are mixtures of a stable process and Gaussian processes. On the other hand, when α > 1 and E?₁ ≠ 0, the limit distribution of the MLE of ρ_n and θ are normal. A Monte Carlo simulation reveals that the MLE performs better than the usual least squares procedures, particularly for the case when the tail index α is less than 1.     

Limit theory for a general class of GARCH models with just barely infinite variance

In this article, limit theory is established for a general class of generalized autoregressive conditional heteroskedasticity models given by ?_t = σ_tη_t and σ_t = f (σ_t?1, σ_t?2,…, σ_t?p, ?_t?1, ?_t?2,…, ?_t?q), when {?_t} is a process with just barely infinite variance, that is, {?_t} is a process with infinite variance but in the domain of normal attraction. In particular, we show that under some regular conditions, converges weakly to a Gaussian process. Applications of the asymptotic results to statistical inference, such as unit root test and sample autocorrelation, are also investigated. The obtained result fills in a gap between the classical infinite variance and finite variance in the literature. Further, when applying our limiting result to Dickey–Fuller (DF) test in a unit root model with integrated generalized autoregressive conditional heteroskedasticity (IGARCH) errors, it just confirms the simulation result of Kourogenis and Pittis (2008) that the DF statistics with IGARCH errors converges in law to the standard DF distribution.     

Estimation for non‐negative time series with heavy‐tail innovations

For moving average processes where the coefficients are non‐negative and the innovations are positive random variables with a regularly varying tail at infinity, we provide estimates for the coefficients based on the ratio of two sample values chosen with respect to an extreme value criteria. We then apply this result to obtain estimates for the parameters of non‐negative ARMA models. Weak convergence results for the joint distribution of our estimates are established and a simulation study is provided to examine the small sample size behaviour of these estimates.     

A p‐Order signed integer‐valued autoregressive (SINAR(p)) model

In this article, we propose an extension of integer‐valued autoregressive INAR models. Using a signed version of the thinning operator, we define a larger class of ‐valued processes, called SINAR, which can have positive as well as negative correlations. Using a Markov chain method, conditions for stationarity and the existence of moments are investigated. In particular, it is shown that the autocorrelation function of any real‐valued AR process can be recovered with a SINAR process, which improves INAR modeling.     

Akaike’s information criterion correction for the least‐squares autoregressive spectral estimator

In this article we propose a new correction for the penalty term of the Akaike’s information criterion (AIC), when it is used in the context of order selection for an autoregressive fit of the spectral density of a stationary time series. The classical AIC penalty term may be viewed as an approximation of an appropriate target quantity. Simulations show that the quality of this approximation strongly depends on the type of autoregressive estimator used, as well as on the discrepancy used. Therefore here we consider the least squares autoregressive estimator and the Whittle discrepancy only. In this context we propose a closed formula correction of the AIC penalty term. We also develop asymptotic theory which justifies this proposal: an asymptotically valid second‐order expansion of a stochastic approximation of the target quantity. This expansion assumes a non‐parametric framework: it does not assume gaussianity of the process and only requires its spectral density to be smooth enough. Simulations show that, as compared to previously introduced corrections, this new correction performs similarly to finite sample information criterion, while they both outperform AIC corrected and AIC.     

Change‐point detection in panel data

We consider N panels and each panel is based on T observations. We are interested to test if the means of the panels remain the same during the observation period against the alternative that the means change at an unknown time. We provide tests which are derived from a likelihood argument and they are based on the adaptation of the CUSUM method to panel data. Asymptotic distributions are derived under the no change null hypothesis and the consistency of the tests are proven under the alternative. The asymptotic results are shown to work in case of small and moderate sample sizes via Monte Carlo simulations.     

Asymptotic self‐similarity and wavelet estimation for long‐range dependent fractional autoregressive integrated moving average time series with stable innovations

Abstract. Methods for parameter estimation in the presence of long‐range dependence and heavy tails are scarce. Fractional autoregressive integrated moving average (FARIMA) time series for positive values of the fractional differencing exponent d can be used to model long‐range dependence in the case of heavy‐tailed distributions. In this paper, we focus on the estimation of the Hurst parameter H = d + 1/α for long‐range dependent FARIMA time series with symmetric α‐stable (1 < α < 2) innovations. We establish the consistency and the asymptotic normality of two types of wavelet estimators of the parameter H. We do so by exploiting the fact that the integrated series is asymptotically self‐similar with parameter H. When the parameter α is known, we also obtain consistent and asymptotically normal estimators for the fractional differencing exponent d = H ? 1/α. Our results hold for a larger class of causal linear processes with stable symmetric innovations. As the wavelet‐based estimation method used here is semi‐parametric, it allows for a more robust treatment of long‐range dependent data than parametric methods.     

Stationary bootstrapping for non‐parametric estimator of nonlinear autoregressive model

We consider stationary bootstrap approximation of the non‐parametric kernel estimator in a general kth‐order nonlinear autoregressive model under the conditions ensuring that the nonlinear autoregressive process is a geometrically Harris ergodic stationary Markov process. We show that the stationary bootstrap procedure properly estimates the distribution of the non‐parametric kernel estimator. A simulation study is provided to illustrate the theory and to construct confidence intervals, which compares the proposed method favorably with some other bootstrap methods.     

Parameter Estimation for Periodically Stationary Time Series

Abstract. The innovations algorithm can be used to obtain parameter estimates for periodically stationary time series models. In this paper, we compute the asymptotic distribution for these estimates in the case, where the innovations have a finite fourth moment. These asymptotic results are useful to determine which model parameters are significant. In the process, we also develop asymptotics for the Yule–Walker estimates.     

Wavelet‐Based Tests for Comparing Two Time Series with Unequal Lengths

Test procedures for assessing whether two stationary and independent time series with unequal lengths have the same spectral density (or same auto‐covariance function) are investigated. A new test statistic is proposed based on the wavelet transform. It relies on empirical wavelet coefficients of the logarithm of two spectral densities' ratio. Under the null hypothesis that two spectral densities are the same, the asymptotic normal distribution of the empirical wavelet coeffcients is derived. Furthermore, these empirical wavelet coefficients are asymptotically uncorrelated. A test statistic is proposed based on these results. The performance of the new test statistic is compared to several recent test statistics, with respect to their exact levels and powers. Simulation studies show that our proposed test is very comparable to the current test statistics in most cases. The main advantage of our proposed test statistic is that it is constructed very simply and is easy to implement.     

Random environment integer‐valued autoregressive process

An r states random environment integer‐valued autoregressive process of order 1, RrINAR(1), is introduced. Also, a random environment process is separately defined as a selection mechanism of differently parameterized geometric distributions, thus ensuring the non‐stationary nature of the RrNGINAR(1) model based on the negative binomial thinning. The distributional and correlation properties of this model are discussed, and the k‐step‐ahead conditional expectation and variance are derived. Yule–Walker estimators of model parameters are presented and their strong consistency is proved. The RrNGINAR(1) model motivation is justified on simulated samples and by its application to specific real‐life counting data.     

The Periodogram of fractional processes1

Abstract. We analyse asymptotic properties of the discrete Fourier transform and the periodogram of time series obtained through (truncated) linear filtering of stationary processes. The class of filters contains the fractional differencing operator and its coefficients decay at an algebraic rate, implying long‐range‐dependent properties for the filtered processes when the degree of integration α is positive. These include fractional time series which are nonstationary for any value of the memory parameter (α ≠ 0) and possibly nonstationary trending (α ≥ 0.5). We consider both fractional differencing or integration of weakly dependent and long‐memory stationary time series. The results obtained for the moments of the Fourier transform and the periodogram at Fourier frequencies in a degenerating band around the origin are weaker compared with the stationary nontruncated case for α > 0, but sufficient for the analysis of parametric and semiparametric memory estimates. They are applied to the study of the properties of the log‐periodogram regression estimate of the memory parameter α for Gaussian processes, for which asymptotic normality could not be showed using previous results. However, only consistency can be showed for the trending cases, 0.5 ≤ α < 1. Several detrending and initialization mechanisms are studied and only local conditions on spectral densities of stationary input series and transfer functions of filters are assumed.     

On the Spectral Density of the Wavelet Coefficients of Long‐Memory Time Series with Application to the Log‐Regression Estimation of the Memory Parameter

Abstract. In recent years, methods to estimate the memory parameter using wavelet analysis have gained popularity in many areas of science. Despite its widespread use, a rigorous semi‐parametric asymptotic theory, comparable with the one developed for Fourier methods, is still lacking. In this article, we adapt to the wavelet setting, the classical semi‐parametric framework introduced by Robinson and his co‐authors for estimating the memory parameter of a (possibly) non‐stationary process. Our results apply to a class of wavelets with bounded supports, which include but are not limited to Daubechies wavelets. We derive an explicit expression of the spectral density of the wavelet coefficients and show that it can be approximated, at large scales, by the spectral density of the continuous‐time wavelet coefficients of fractional Brownian motion. We derive an explicit bound for the difference between the spectral densities. As an application, we obtain minimax upper bounds for the log‐scale regression estimator of the memory parameter for a Gaussian process and we derive an explicit expression of its asymptotic variance.     

A Robbins–Monro Algorithm for Non‐Parametric Estimation of NAR Process with Markov Switching: Consistency

We approach the problem of non‐parametric estimation for autoregressive Markov switching processes. In this context, the Nadaraya–Watson‐type regression functions estimator is interpreted as a solution of a local weighted least‐square problem, which does not admit a closed‐form solution in the case of hidden Markov switching. We introduce a non‐parametric recursive algorithm to approximate the estimator. Our algorithm restores the missing data by means of a Monte Carlo step and estimates the regression function via a Robbins–Monro step. We prove that non‐parametric autoregressive models with Markov switching are identifiable when the hidden Markov process has a finite state space. Consistency of the estimator is proved using the strong α‐mixing property of the model. Finally, we present some simulations illustrating the performances of our non‐parametric estimation procedure.     

On the properties of the periodogram of a stationary long‐memory process over different epochs with applications

This article studies the asymptotic properties of the discrete Fourier transforms (DFT) and the periodogram of a stationary long‐memory time series over different epochs. The main theoretical result is a novel bound for the covariance of the DFT ordinates evaluated on two distinct epochs, which depends explicitly on the Fourier frequencies and the gap between the epochs. This result is then applied to obtain the limiting distribution of some nonlinear functions of the periodogram over different epochs, under the additional assumption of gaussianity. We then apply this result to construct an estimator of the memory parameter based on the regression in a neighbourhood of the zero‐frequency of the logarithm of the averaged periodogram, obtained by computing the empirical mean of the periodogram over adjacent epochs. It is shown that replacing the periodogram by its average has an effect similar to the frequency domain pooling to reduce the variance of the estimate. We also propose a simple procedure to test the stationarity of the memory coefficient. A limited Monte Carlo experiment is presented to support our findings.     

Central limit theorems for nonparametric estimators with real‐time random variables

In this article, asymptotic theories for nonparametric methods are studied when they are applied to real‐time data. In particular, we derive central limit theorems for nonparametric density and regression estimators. For this we formally introduce a sequence of real‐time random variables indexed by a parameter related to fine gridding of time domain (or fine discretization). Our results show that the impact of fine gridding is greater in the density estimation case in the sense that strong dependence due to fine gridding severely affects the major strength of nonparametric density estimator (or its data‐adaptive property). In addition, we discuss some issues about nonparametric regression model with fine gridding of time domain.     

Statistical tests for a single change in mean against long‐range dependence

Statistical tests are introduced for distinguishing between short‐range dependent time series with a single change in mean, and long‐range dependent time series, with the former making the null hypothesis. The tests are based on estimation of the self‐similarity parameter after removing the change in mean from the series. The focus is on the GPH (Geweke and Porter‐Hudak, 1983) and local Whittle estimation methods in the spectral domain. Theoretical properties of the resulting estimators are established when testing for a single change in mean, and small sample properties of the tests are examined in simulations. The introduced tests improve on the BHKS ( Berkes et al., 2006 ) test which is the only other available test for the considered problem. It is argued that the BHKS test has a low power against long‐range dependence alternatives and that this happens because the BHKS test statistic involves estimation of the long‐run variance. The BHKS test could be improved readily by considering its R/S‐like regression version which estimates the self‐similarity parameter and which does not involve the long‐run variance. Yet better alternatives are to use more powerful estimation methods (such as GPH or local Whittle) and lead to the tests introduced here.     

A test for second‐order stationarity of a time series based on the discrete Fourier transform

We consider a zero mean discrete time series, and define its discrete Fourier transform (DFT) at the canonical frequencies. It can be shown that the DFT is asymptotically uncorrelated at the canonical frequencies if and only if the time series is second‐order stationary. Exploiting this important property, we construct a Portmanteau type test statistic for testing stationarity of the time series. It is shown that under the null of stationarity, the test statistic has approximately a chi‐square distribution. To examine the power of the test statistic, the asymptotic distribution under the locally stationary alternative is established. It is shown to be a generalized non‐central chi‐square, where the non‐centrality parameter measures the deviation from stationarity. The test is illustrated with simulations, where is it shown to have good power.     

Semiparametric Estimation in Time‐Series Regression with Long‐Range Dependence

Abstract. We consider semiparametric estimation in time‐series regression in the presence of long‐range dependence in both the errors and the stochastic regressors. A central limit theorem is established for a class of semiparametric frequency domain‐weighted least squares estimates, which includes both narrow‐band ordinary least squares and narrow‐band generalized least squares as special cases. The estimates are semiparametric in the sense that focus is on the neighbourhood of the origin, and only periodogram ordinates in a degenerating band around the origin are used. This setting differs from earlier studies on time‐series regression with long‐range dependence, where a fully parametric approach has been employed. The generalized least squares estimate is infeasible when the degree of long‐range dependence is unknown and must be estimated in an initial step. In that case, we show that a feasible estimate which has the same asymptotic properties as the infeasible estimate, exists. By Monte Carlo simulation, we evaluate the finite‐sample performance of the generalized least squares estimate and the feasible estimate.