Estimation for non‐negative time series with heavy‐tail innovations

For moving average processes where the coefficients are non‐negative and the innovations are positive random variables with a regularly varying tail at infinity, we provide estimates for the coefficients based on the ratio of two sample values chosen with respect to an extreme value criteria. We then apply this result to obtain estimates for the parameters of non‐negative ARMA models. Weak convergence results for the joint distribution of our estimates are established and a simulation study is provided to examine the small sample size behaviour of these estimates.     

Analysis of accumulated rounding errors in autoregressive processes

In considering the rounding impact of an autoregressive (AR) process, there are two different models available to be considered. The first assumes that the dynamic system follows an underlying AR model and only the observations are rounded up to a certain precision. The second assumes that the updated observation is a rounded version of an autoregression on previous rounded observations. This article considers the second model and examines behaviour of rounding impacts to the statistical inferences. The conditional maximum‐likelihood estimates for the model are proposed and their asymptotic properties are established, including strong consistency and asymptotic normality. Furthermore, both the classical AR model and the ordinary rounded AR model are no longer reliable when dealing with accumulated rounding errors. The three models are also applied to fit the Ocean Wave data. It turns out that the estimates under distinct models are significantly different. Based on our findings, we strongly recommend that models for dealing with rounded data should be in accordance with the actions of rounding errors.     

Spectral Regression For Cointegrated Time Series With Long-Memory Innovations

Spectral regression is considered for cointegrated time series with long-memory innovations. The estimates we advocate are shown to be consistent when cointegrating relationships among stationary variables are investigated, while ordinary least squares are inconsistent due to correlation between the regressors and the cointegrating residuals; in the presence of unit roots, these estimates share the same asymptotic distribution as ordinary least squares. As a corollary of the main result, we provide a functional central limit theorem for quadratic forms in non-stationary fractionally integrated processes.     

Asymptotic self‐similarity and wavelet estimation for long‐range dependent fractional autoregressive integrated moving average time series with stable innovations

Abstract. Methods for parameter estimation in the presence of long‐range dependence and heavy tails are scarce. Fractional autoregressive integrated moving average (FARIMA) time series for positive values of the fractional differencing exponent d can be used to model long‐range dependence in the case of heavy‐tailed distributions. In this paper, we focus on the estimation of the Hurst parameter H = d + 1/α for long‐range dependent FARIMA time series with symmetric α‐stable (1 < α < 2) innovations. We establish the consistency and the asymptotic normality of two types of wavelet estimators of the parameter H. We do so by exploiting the fact that the integrated series is asymptotically self‐similar with parameter H. When the parameter α is known, we also obtain consistent and asymptotically normal estimators for the fractional differencing exponent d = H ? 1/α. Our results hold for a larger class of causal linear processes with stable symmetric innovations. As the wavelet‐based estimation method used here is semi‐parametric, it allows for a more robust treatment of long‐range dependent data than parametric methods.     

Semiparametric Estimation in Time‐Series Regression with Long‐Range Dependence

Abstract. We consider semiparametric estimation in time‐series regression in the presence of long‐range dependence in both the errors and the stochastic regressors. A central limit theorem is established for a class of semiparametric frequency domain‐weighted least squares estimates, which includes both narrow‐band ordinary least squares and narrow‐band generalized least squares as special cases. The estimates are semiparametric in the sense that focus is on the neighbourhood of the origin, and only periodogram ordinates in a degenerating band around the origin are used. This setting differs from earlier studies on time‐series regression with long‐range dependence, where a fully parametric approach has been employed. The generalized least squares estimate is infeasible when the degree of long‐range dependence is unknown and must be estimated in an initial step. In that case, we show that a feasible estimate which has the same asymptotic properties as the infeasible estimate, exists. By Monte Carlo simulation, we evaluate the finite‐sample performance of the generalized least squares estimate and the feasible estimate.     

On the Spectral Density of the Wavelet Coefficients of Long‐Memory Time Series with Application to the Log‐Regression Estimation of the Memory Parameter

Abstract. In recent years, methods to estimate the memory parameter using wavelet analysis have gained popularity in many areas of science. Despite its widespread use, a rigorous semi‐parametric asymptotic theory, comparable with the one developed for Fourier methods, is still lacking. In this article, we adapt to the wavelet setting, the classical semi‐parametric framework introduced by Robinson and his co‐authors for estimating the memory parameter of a (possibly) non‐stationary process. Our results apply to a class of wavelets with bounded supports, which include but are not limited to Daubechies wavelets. We derive an explicit expression of the spectral density of the wavelet coefficients and show that it can be approximated, at large scales, by the spectral density of the continuous‐time wavelet coefficients of fractional Brownian motion. We derive an explicit bound for the difference between the spectral densities. As an application, we obtain minimax upper bounds for the log‐scale regression estimator of the memory parameter for a Gaussian process and we derive an explicit expression of its asymptotic variance.     

Robust Estimation in Vector Autoregressive Moving-Average Models

Bustos and Yohai proposed a class of robust estimates for autoregressive moving-average (ARMA) models based on residual autocovariances (RA estimates). In this paper an affine equivariant generalization of the RA estimates for vector ARMA processes is given. These estimates are asymptotically normal and, when the innovations have an elliptical distribution, their asymptotic covariance matrix differs only by a scalar factor from the covariance matrix corresponding to the maximum likelihood estimate. A Monte Carlo study confirms that the RA estimates are efficient under normal errors and robust when the sample contains outliers. A robust multivariate goodness-of-fit test based on the RA estimates is also obtained.     

Uniform limit theorems for the integrated periodogram of weakly dependent time series and their applications to Whittle's estimate

Abstract. We prove uniform convergence results for the integrated periodogram of a weakly dependent time series, namely a strong law of large numbers and a central limit theorem. These results are applied to Whittle's parametric estimation. Under general weak‐dependence assumptions, the strong consistency and asymptotic normality of Whittle's estimate are established for a large class of models. For instance, the causal θ‐weak dependence property allows a new and unified proof of those results for autoregressive conditionally heteroscedastic (ARCH)(∞) and bilinear processes. Non‐causal η‐weak dependence yields the same limit theorems for two‐sided linear (with dependent inputs) or Volterra processes.     

Polynomial Cointegration Between Stationary Processes With Long Memory

Abstract. In this article we consider polynomial cointegrating relationships between stationary processes with long range dependence. We express the regression functions in terms of Hermite polynomials and consider a form of spectral regression around frequency zero. For these estimates, we establish consistency by means of a more general result on continuously averaged estimates of the spectral density matrix at frequency zero.     

Tests for the Equality of Two Processes' Spectral Densities with Unequal Lengths Using Wavelet Methods

Testing procedures for assessing whether two stationary and independent linear processes with unequal lengths have the same spectral densities or same auto‐covariance functions are investigated. New test statistics are proposed based on the difference of the two wavelet‐based estimates of the two spectral densities. The asymptotic normal distributions of the empirical wavelet coefficients are derived based on Bartlett type approximation of a quadratic form with dependent variables by the corresponding quadratic form with independent and identically distributed (i.i.d.) random variables. The limit distributions of the proposed test statistics are derived from those asymptotic results, and they asymptotically follow known chi‐square distributions. The advantage of those new procedures is that those test statistics are constructed very simply and can be used for two time series with arbitrary lengths. The performance of those new tests is compared with some recent test statistics, with respect to their exact levels and powers. Simulation studies show that our proposed tests are very comparable to the current tests.     

Periodic autoregressive conditional duration

We propose an autoregressive conditional duration (ACD) model with periodic time-varying parameters and multiplicative error form. We name this model periodic autoregressive conditional duration (PACD). First, we study the stability properties and the moment structures of it. Second, we estimate the model parameters, using (profile and two-stage) Gamma quasi-maximum likelihood estimates (QMLEs), the asymptotic properties of which are examined under general regularity conditions. Our estimation method encompasses the exponential QMLE, as a particular case. The proposed methodology is illustrated with simulated data and two empirical applications on forecasting Bitcoin trading volume and realized volatility. We found that the PACD produces better in-sample and out-of-sample forecasts than the standard ACD.     

Bootstrapping confidence intervals for the change‐point of time series

Abstract. We study an at‐most‐one‐change time‐series model with an abrupt change in the mean and dependent errors that fulfil certain mixing conditions. We obtain confidence intervals for the unknown change‐point via bootstrapping methods. Precisely, we use a block bootstrap of the estimated centred error sequence. Then, we reconstruct a sequence with a change in the mean using the same estimators as before. The difference between the change‐point estimator of the resampled sequence and the one of the original sequence can be used as an approximation of the difference between the real change‐point and its estimator. This enables us to construct confidence intervals using the empirical distribution of the resampled time series. A simulation study shows that the resampled confidence intervals are usually closer to their target levels and at the same time smaller than the asymptotic intervals.     

The Periodogram of fractional processes1

Abstract. We analyse asymptotic properties of the discrete Fourier transform and the periodogram of time series obtained through (truncated) linear filtering of stationary processes. The class of filters contains the fractional differencing operator and its coefficients decay at an algebraic rate, implying long‐range‐dependent properties for the filtered processes when the degree of integration α is positive. These include fractional time series which are nonstationary for any value of the memory parameter (α ≠ 0) and possibly nonstationary trending (α ≥ 0.5). We consider both fractional differencing or integration of weakly dependent and long‐memory stationary time series. The results obtained for the moments of the Fourier transform and the periodogram at Fourier frequencies in a degenerating band around the origin are weaker compared with the stationary nontruncated case for α > 0, but sufficient for the analysis of parametric and semiparametric memory estimates. They are applied to the study of the properties of the log‐periodogram regression estimate of the memory parameter α for Gaussian processes, for which asymptotic normality could not be showed using previous results. However, only consistency can be showed for the trending cases, 0.5 ≤ α < 1. Several detrending and initialization mechanisms are studied and only local conditions on spectral densities of stationary input series and transfer functions of filters are assumed.     

Testing for parameter stability in nonlinear autoregressive models

In this article we develop testing procedures for the detection of structural changes in nonlinear autoregressive processes. For the detection procedure, we model the regression function by a single layer feedforward neural network. We show that CUSUM‐type tests based on cumulative sums of estimated residuals, that have been intensively studied for linear regression, can be extended to this case. The limit distribution under the null hypothesis is obtained, which is needed to construct asymptotic tests. For a large class of alternatives, it is shown that the tests have asymptotic power one. In this case, we obtain a consistent change‐point estimator which is related to the test statistics. Power and size are further investigated in a small simulation study with a particular emphasis on situations where the model is misspecified, i.e. the data is not generated by a neural network but some other regression function. As illustration, an application on the Nile data set as well as S&P log‐returns is given.     

Assessing Time‐Reversibility Under Minimal Assumptions

Abstract. This article considers a simple procedure for assessing whether a weakly dependent univariate stochastic process is time‐reversible. Our approach is based on a simple index of the deviation from zero of the median of the one‐dimensional marginal law of differenced data. An attractive feature of the method is that it requires no moment assumptions. Instead of relying on Gaussian asymptotic approximations, we consider using subsampling and resampling methods to construct confidence intervals for the time‐reversibility parameter, and show that such inference procedures are asymptotically valid under a mild mixing condition. The small‐sample properties of the proposed procedures are examined by means of Monte Carlo experiments and an application to real‐world data is also presented.     

ON THE ASYMPTOTIC EFFICIENCY OF ESTIMATORS OF THE PARAMETERS OF AN ARMA PROCESS

Abstract. In this paper we derive a lower bound on the asymptotic covariance matrix of an estimator of the parameters of an autoregressive moving average (ARMA) process when the innovations are not necessarily Gaussian.     

Multivariate Portmanteau Test For Autoregressive Models with Uncorrelated but Nonindependent Errors

Abstract. We study the asymptotic behaviour of the least squares estimator, of the residual autocorrelations and of the Ljung–Box (or Box–Pierce) portmanteau test statistic for multiple autoregressive time series models with nonindependent innovations. Under mild assumptions, it is shown that the asymptotic distribution of the portmanteau tests is that of a weighted sum of independent chi‐squared random variables. When the innovations exhibit conditional heteroscedasticity or other forms of dependence, this asymptotic distribution can be quite different from that of models with independent and identically distributed innovations. Consequently, the usual chi‐squared distribution does not provide an adequate approximation to the distribution of the Box–Pierce goodness‐of‐fit portmanteau test in the presence of nonindependent innovations. Hence we propose a method to adjust the critical values of the portmanteau tests. Monte carlo experiments illustrate the finite sample performance of the modified portmanteau test.     

Central limit theorems for nonparametric estimators with real‐time random variables

In this article, asymptotic theories for nonparametric methods are studied when they are applied to real‐time data. In particular, we derive central limit theorems for nonparametric density and regression estimators. For this we formally introduce a sequence of real‐time random variables indexed by a parameter related to fine gridding of time domain (or fine discretization). Our results show that the impact of fine gridding is greater in the density estimation case in the sense that strong dependence due to fine gridding severely affects the major strength of nonparametric density estimator (or its data‐adaptive property). In addition, we discuss some issues about nonparametric regression model with fine gridding of time domain.     

On geometric ergodicity of CHARME models

In this article we consider a CHARME model, a class of generalized mixture of nonlinear nonparametric AR‐ARCH time series. To provide sets of conditions under which such processes are geometrically ergodic and, therefore, satisfy some mixing conditions, we apply the theory of Markov chains to derive asymptotic stability of this model. These results form the basis for deriving an asymptotic theory for nonparametric estimation. As an illustration, neural network sieve estimates for the autoregressive and volatility functions are considered, and consistency of the parameter estimates is obtained.     

ESTIMATION FOR NONNEGATIVE AUTOREGRESSIVE PROCESSES WITH AN UNKNOWN LOCATION PARAMETER

Abstract. Consider an AR(1) process given by X ^t=γ+ø X _t+ Z _t≥ 1. where 0 ≤γ, 0 ≤ø 1 are unknown parameters and the innovations Z _t, ≥ 1, are independently and identically distributed positive random variables. We propose estimates of (γø) which are obtained as the solution to a linear programming problem and establish their strong consistency. When the Z _ts have the exponential distribution. our estimate becomes the conditional maximum likelihood estimate given X ₀. Under the assumption of regular variation of the innovation distribution at its left and right endpoints (assumed to be 0 and ∝ respectively), we establish asymptotic limit laws for the estimates. Consistent estimators for a class of moving-average processes with heavy-tailed innovation distribution are also presented.