Robust Wilcoxon‐Type Estimation of Change‐Point Location Under Short‐Range Dependence

We introduce a robust estimator of the location parameter for the change‐point in the mean based on Wilcoxon statistic and establish its consistency for L₁ near‐epoch dependent processes. It is shown that the consistency rate depends on the magnitude of the change. A simulation study is performed to evaluate the finite sample properties of the Wilcoxon‐type estimator under Gaussianity as well as under heavy‐tailed distributions and disturbances by outliers, and to compare it with a CUSUM‐type estimator. It shows that the Wilcoxon‐type estimator is equivalent to the CUSUM‐type estimator under Gaussianity but outperforms it in the presence of heavy tails or outliers in the data.     

Postmodel selection estimators of variance function for nonlinear autoregression

We consider a problem of estimating a conditional variance function of an autoregressive process. A finite collection of parametric models for conditional density is studied when both regression and variance are modelled by parametric functions. The proposed estimators are defined as the maximum likelihood estimators in the models chosen by penalized selection criteria. Consistency properties of the resulting estimator of the variance when the conditional density belongs to one of the parametric models are studied as well as its behaviour under mis‐specification. The autoregressive process does not need to be stationary but only existence of a stationary distribution and ergodicity is required. Analogous results for the pseudolikelihood method are also discussed. A simulation study shows promising behaviour of the proposed estimator in the case of heavy‐tailed errors in comparison with local linear smoothers.     

A refined efficiency rate for ordinary least squares and generalized least squares estimators for a linear trend with autoregressive errors

When a straight line is fitted to time series data, generalized least squares (GLS) estimators of the trend slope and intercept are attractive as they are unbiased and of minimum variance. However, computing GLS estimators is laborious as their form depends on the autocovariances of the regression errors. On the other hand, ordinary least squares (OLS) estimators are easy to compute and do not involve the error autocovariance structure. It has been known for 50 years that OLS and GLS estimators have the same asymptotic variance when the errors are second‐order stationary. Hence, little precision is gained by using GLS estimators in stationary error settings. This article revisits this classical issue, deriving explicit expressions for the GLS estimators and their variances when the regression errors are drawn from an autoregressive process. These expressions are used to show that OLS methods are even more efficient than previously thought. Specifically, we show that the convergence rate of variance differences is one polynomial degree higher than that of least squares estimator variances. We also refine Grenander's (1954) variance ratio. An example is presented where our new rates cannot be improved upon. Simulations show that the results change little when the autoregressive parameters are estimated.     

Asymptotic self‐similarity and wavelet estimation for long‐range dependent fractional autoregressive integrated moving average time series with stable innovations

Abstract. Methods for parameter estimation in the presence of long‐range dependence and heavy tails are scarce. Fractional autoregressive integrated moving average (FARIMA) time series for positive values of the fractional differencing exponent d can be used to model long‐range dependence in the case of heavy‐tailed distributions. In this paper, we focus on the estimation of the Hurst parameter H = d + 1/α for long‐range dependent FARIMA time series with symmetric α‐stable (1 < α < 2) innovations. We establish the consistency and the asymptotic normality of two types of wavelet estimators of the parameter H. We do so by exploiting the fact that the integrated series is asymptotically self‐similar with parameter H. When the parameter α is known, we also obtain consistent and asymptotically normal estimators for the fractional differencing exponent d = H ? 1/α. Our results hold for a larger class of causal linear processes with stable symmetric innovations. As the wavelet‐based estimation method used here is semi‐parametric, it allows for a more robust treatment of long‐range dependent data than parametric methods.     

On a Mixture GARCH Time‐Series Model

Abstract. Recently, there has been a lot of interest in modelling real data with a heavy‐tailed distribution. A popular candidate is the so‐called generalized autoregressive conditional heteroscedastic (GARCH) model. Unfortunately, the tails of GARCH models are not thick enough in some applications. In this paper, we propose a mixture generalized autoregressive conditional heteroscedastic (MGARCH) model. The stationarity conditions and the tail behaviour of the MGARCH model are studied. It is shown that MGARCH models have tails thicker than those of the associated GARCH models. Therefore, the MGARCH models are more capable of capturing the heavy‐tailed features in real data. Some real examples illustrate the results.     

Linear Trend with Fractionally Integrated Errors

We consider the estimation of linear trend for a time series in the presence of additive long-memory noise with memory parameter d ∈[0, 1.5). Although no parametric model is assumed for the noise, our assumptions include as special cases the random walk with drift as well as linear trend with stationary invertible autoregressive moving-average errors. Moreover, our assumptions include a wide variety of trend-stationary and difference-stationary situations. We consider three different trend estimators: the ordinary least squares estimator based on the original series, the sample mean of the first differences and a class of weighted (tapered) means of the first differences. We present expressions for the asymptotic variances of these estimators in the form of one-dimensional integrals. We also establish the asymptotic normality of the tapered means for d ∈[0, 1.5) −{0.5} and of the ordinary least squares estimator for d ∈ (0.5, 1.5). We point out connections with existing theory and present applications of the methodology.     

Least squares estimation of ARCH models with missing observations

A least squares estimator for ARCH models in the presence of missing data is proposed. Strong consistency and asymptotic normality are derived. Monte Carlo simulation results are analysed and an application to real data of a Chilean stock index is reported.     

Estimation in Random Coefficient Autoregressive Models

Abstract. We propose the quasi‐maximum likelihood method to estimate the parameters of an RCA(1) process, i.e. a random coefficient autoregressive time series of order 1. The strong consistency and the asymptotic normality of the estimators are derived under optimal conditions.     

Robust estimators under semi‐parametric partly linear autoregression: Asymptotic behaviour and bandwidth selection

Abstract. In this article, under a semi‐parametric partly linear autoregression model, a family of robust estimators for the autoregression parameter and the autoregression function is studied. The proposed estimators are based on a three‐step procedure, in which robust regression estimators and robust smoothing techniques are combined. Asymptotic results on the autoregression estimators are derived. Besides combining robust procedures with M‐smoothers, predicted values for the series and detection residuals, which allow to detect anomalous data, are introduced. Robust cross‐validation methods to select the smoothing parameter are presented as an alternative to the classical ones, which are sensitive to outlying observations. A Monte Carlo study is conducted to compare the performance of the proposed criteria. Finally, the asymptotic distribution of the autoregression parameter estimator is stated uniformly over the smoothing parameter.     

APPROXIMATE DISTRIBUTION OF PARAMETER ESTIMATORS FOR FIRST-ORDER AUTOREGRESSIVE MODELS

Abstract. Formulae for the exact bias and mean square error for the least squares for forward-backward least squares estimators are obtained based on the explicit expressions for the moment-generating and characteristic functions of quadratic form in the first-order autoregressive process. Asymptotic expressions for their cumulants and the maximum likelihood estimator are given. Approximations of the distributions of the above estimators are proposed based on the Ornstein-Ulenbeck process. A simple computational procedure for the exact distribution is developed, and some numerical comparisons are given which support the overall good accuracy of the approximation and confirm that the maximum likelihood estimator performs better than the others.     

Local Likelihood for non‐parametric ARCH(1) models

Abstract. We propose a non‐parametric local likelihood estimator for the log‐transformed autoregressive conditional heteroscedastic (ARCH) (1) model. Our non‐parametric estimator is constructed within the likelihood framework for non‐Gaussian observations: it is different from standard kernel regression smoothing, where the innovations are assumed to be normally distributed. We derive consistency and asymptotic normality for our estimators and show, by a simulation experiment and some real‐data examples, that the local likelihood estimator has better predictive potential than classical local regression. A possible extension of the estimation procedure to more general multiplicative ARCH(p) models with p > 1 predictor variables is also described.     

Consistent estimation of the memory parameter for nonlinear time series

Abstract. For linear processes, semiparametric estimation of the memory parameter, based on the log‐periodogram and local Whittle estimators, has been exhaustively examined and their properties well established. However, except for some specific cases, little is known about the estimation of the memory parameter for nonlinear processes. The purpose of this paper is to provide the general conditions under which the local Whittle estimator of the memory parameter of a stationary process is consistent and to examine its rate of convergence. We show that these conditions are satisfied for linear processes and a wide class of nonlinear models, among others, signal plus noise processes, nonlinear transforms of a Gaussian process ξ_t and exponential generalized autoregressive, conditionally heteroscedastic (EGARCH) models. Special cases where the estimator satisfies the central limit theorem are discussed. The finite‐sample performance of the estimator is investigated in a small Monte Carlo study.     

Asymptotics for the Conditional‐Sum‐of‐Squares Estimator in Multivariate Fractional Time‐Series Models

This article proves consistency and asymptotic normality for the conditional‐sum‐of‐squares estimator, which is equivalent to the conditional maximum likelihood estimator, in multivariate fractional time‐series models. The model is parametric and quite general and, in particular, encompasses the multivariate non‐cointegrated fractional autoregressive integrated moving average (ARIMA) model. The novelty of the consistency result, in particular, is that it applies to a multivariate model and to an arbitrarily large set of admissible parameter values, for which the objective function does not converge uniformly in probability, thus making the proof much more challenging than usual. The neighbourhood around the critical point where uniform convergence fails is handled using a truncation argument.     

Polynomial Trend Regression With Long‐memory Errors

Abstract. For a time series generated by polynomial trend with stationary long‐memory errors, the ordinary least squares estimator (OLSE) of the trend coefficients is asymptotically normal, provided the error process is linear. The asymptotic distribution may no longer be normal, if the error is in the form of a long‐memory linear process passing through certain nonlinear transformations. However, one hardly has sufficient information about the transformation to determine which type of limiting distribution the OLSE converges to and to apply the correct distribution so as to construct valid confidence intervals for the coefficients based on the OLSE. The present paper proposes a modified least squares estimator to bypass this drawback. It is shown that the asymptotic normality can be assured for the modified estimator with mild trade‐off of efficiency even when the error is nonlinear and the original limit for the OLSE is non‐normal. The estimator performs fairly well when applied to various simulated series and two temperature data sets concerning global warming.     

ESTIMATION FOR REGRESSIVE AND AUTOREGRESSIVE MODELS WITH NON-NEGATIVE RESIDUAL ERRORS

Abstract. The parameter estimation problems for regressive and autoregressive models are investigated. A new procedure is proposed which differs from the least squares method. Theorems relating to the rate of almost sure convergence of the new estimators are formulated. Some simulation results are also shown. With these convergent rates and simulation results a clear comparison of the new estimator with the least squares estimator is obtained.     

Non‐stationary autoregressive processes with infinite variance

Consider an AR(p) process , where {?_t} is a sequence of i.i.d. random variables lying in the domain of attraction of a stable law with index 0<α<2. This time series {Y_t} is said to be a non‐stationary AR(p) process if at least one of its characteristic roots lies on the unit circle. The limit distribution of the least squares estimator (LSE) of for {Y_t} with infinite variance innovation {?_t} is established in this paper. In particular, by virtue of the result of Kurtz and Protter (1991) of stochastic integrals, it is shown that the limit distribution of the LSE is a functional of integrated stable process. Simulations for the estimator of β and its limit distribution are also given.     

Rank‐based estimation for autoregressive moving average time series models

Abstract. We establish asymptotic normality and consistency for rank‐based estimators of autoregressive‐moving average model parameters. The estimators are obtained by minimizing a rank‐based residual dispersion function similar to the one given by L.A. Jaeckel [Ann. Math. Stat. Vol. 43 (1972) 1449–1458]. These estimators can have the same asymptotic efficiency as maximum likelihood estimators and are robust. The quality of the asymptotic approximations for finite samples is studied via simulation.     

ON THE EFFICIENCY OF THE SAMPLE MEAN IN LONG-MEMORY NOISE

Abstract. When estimating the unknown mean of a stationary time series, the best linear unbiased estimator is often a significantly better estimator than the ordinary least squares estimates _n. The relative efficiency of these two estimators is investigated for time series whose spectrum behaves like a power at the origin (e.g., fractional Gaussian noise and fractional ARIMA).     

Subsampling inference for the mean of heavy‐tailed long‐memory time series

In this article, we revisit a time series model introduced by MCElroy and Politis (2007a) and generalize it in several ways to encompass a wider class of stationary, nonlinear, heavy‐tailed time series with long memory. The joint asymptotic distribution for the sample mean and sample variance under the extended model is derived; the associated convergence rates are found to depend crucially on the tail thickness and long memory parameter. A self‐normalized sample mean that concurrently captures the tail and memory behaviour, is defined. Its asymptotic distribution is approximated by subsampling without the knowledge of tail or/and memory parameters; a result of independent interest regarding subsampling consistency for certain long‐range dependent processes is provided. The subsampling‐based confidence intervals for the process mean are shown to have good empirical coverage rates in a simulation study. The influence of block size on the coverage and the performance of a data‐driven rule for block size selection are assessed. The methodology is further applied to the series of packet‐counts from ethernet traffic traces.     

Rate of convergence in the central limit theorem for parameter estimation in a causal,invertible ARMA(p,q) model

In this study we consider the estimators of the parameters of a stable ARMA(p, q) process. The autoregressive parameters are estimated by the instrumental variable technique while the moving average parameters are estimated using a derived autoregressive process. The estimators are shown to be asymptotically normal and their rate of convergence to normality is derived.