Parameter Estimation Under Failure-Censored Constant-Stress Life Testing Model: A Bayesian Approach

Abstract

This article compares likelihood and Bayesian estimations for partially accelerated constant-stress life test model under type II censoring assuming Pareto distribution of the second kind. Both maximum likelihood and Bayesian estimators of the model parameters are derived. The posterior means and posterior variances are obtained under the squared error loss function using Lindley's approximation procedure. The advantages of this proposed procedure are shown. Monte Carlo simulations are conducted under different samples sizes and different parameter values to assess and compare the proposed methods of estimation. A noninformative prior on the model parameters is used to make the comparison more meaningful. It has been observed that Lindley's method usually provides posterior variances and mean squared errors smaller than those of the maximum likelihood estimators. That is, Lindley's method produces improved estimates, which is an advantage of this method.     

Extracting Conditionally Heteroskedastic Components using Independent Component Analysis

In the independent component model, the multivariate data are assumed to be a mixture of mutually independent latent components. The independent component analysis (ICA) then aims at estimating these latent components. In this article, we study an ICA method which combines the use of linear and quadratic autocorrelations to enable efficient estimation of various kinds of stationary time series. Statistical properties of the estimator are studied by finding its limiting distribution under general conditions, and the asymptotic variances are derived in the case of ARMA-GARCH model. We use the asymptotic results and a finite sample simulation study to compare different choices of a weight coefficient. As it is often of interest to identify all those components which exhibit stochastic volatility features we suggest a test statistic for this problem. We also show that a slightly modified version of the principal volatility component analysis can be seen as an ICA method. Finally, we apply the estimators in analysing a data set which consists of time series of exchange rates of seven currencies to US dollar. Supporting information including proofs of the theorems is available online.     

Robust estimators under semi‐parametric partly linear autoregression: Asymptotic behaviour and bandwidth selection

Abstract. In this article, under a semi‐parametric partly linear autoregression model, a family of robust estimators for the autoregression parameter and the autoregression function is studied. The proposed estimators are based on a three‐step procedure, in which robust regression estimators and robust smoothing techniques are combined. Asymptotic results on the autoregression estimators are derived. Besides combining robust procedures with M‐smoothers, predicted values for the series and detection residuals, which allow to detect anomalous data, are introduced. Robust cross‐validation methods to select the smoothing parameter are presented as an alternative to the classical ones, which are sensitive to outlying observations. A Monte Carlo study is conducted to compare the performance of the proposed criteria. Finally, the asymptotic distribution of the autoregression parameter estimator is stated uniformly over the smoothing parameter.     

A refined efficiency rate for ordinary least squares and generalized least squares estimators for a linear trend with autoregressive errors

When a straight line is fitted to time series data, generalized least squares (GLS) estimators of the trend slope and intercept are attractive as they are unbiased and of minimum variance. However, computing GLS estimators is laborious as their form depends on the autocovariances of the regression errors. On the other hand, ordinary least squares (OLS) estimators are easy to compute and do not involve the error autocovariance structure. It has been known for 50 years that OLS and GLS estimators have the same asymptotic variance when the errors are second‐order stationary. Hence, little precision is gained by using GLS estimators in stationary error settings. This article revisits this classical issue, deriving explicit expressions for the GLS estimators and their variances when the regression errors are drawn from an autoregressive process. These expressions are used to show that OLS methods are even more efficient than previously thought. Specifically, we show that the convergence rate of variance differences is one polynomial degree higher than that of least squares estimator variances. We also refine Grenander's (1954) variance ratio. An example is presented where our new rates cannot be improved upon. Simulations show that the results change little when the autoregressive parameters are estimated.     

A Goodness‐of‐Fit Test for Integer‐Valued Autoregressive Processes

For autoregressive count data time series, a goodness‐of‐fit test based on the empirical joint probability generating function is considered. The underlying process is contained in a general class of Markovian models satisfying a drift condition. Asymptotic theory for the test statistic is provided, including a functional central limit theorem for the non‐parametric estimation of the stationary distribution and a parametric bootstrap method. Connections between the new approach and existing tests for count data time series based on moment estimators appear in limiting scenarios. Finally, the test is applied to a real data set.     

Recovery of reflectance spectra from CIE tristimulus values using a progressive database selection technique

A procedure for creating efficient reflectance spectra from CIE tristimulus colour values is described using a modified linear model. By fixing certain criteria based on colour difference values, the proposed technique preliminarily selects a series of suitable samples from a main data set containing the reflectance values of a large number of different coloured samples, based on the colour specifications of a given sample. In this way, a series of different databases containing the reflectance values of confirmed samples relating to the particular samples are formed. Then, a well-known principal components linear model is applied using three basis functions. This operation yields higher cumulative variances in comparison with the original database, having the same number of basis vectors. The performance of the proposed method is evaluated using a different collection of samples and the resulting spectra show considerable improvements in terms of root mean square error as well as colour difference values under different illuminants.     

Inference for the Lagged Cross‐Covariance Operator Between Functional Time Series

When considering two or more time series of functional data objects, for instance those derived from densely observed intraday stock price data of several companies, the empirical cross‐covariance operator is of fundamental importance due to its role in functional lagged regression and exploratory data analysis. Despite its relevance, statistical procedures for measuring the significance of such estimators are currently undeveloped. We present methodology based on a functional central limit theorem for conducting statistical inference for the cross‐covariance operator estimated between two stationary, weakly dependent, functional time series. Specifically, we consider testing the null hypothesis that the two series possess a specified cross‐covariance structure at a given lag. Since this test assumes that the series are jointly stationary, we also develop a change‐point detection procedure to validate this assumption of independent interest. The most imposing technical hurdle in implementing the proposed tests involves estimating the spectrum of a high dimensional spectral density operator at frequency zero. We propose a simple dimension reduction procedure based on functional principal component analysis to achieve this, which is shown to perform well in a simulation study. We illustrate the proposed methodology with an application to densely observed intraday price data of stocks listed on the New York stock exchange‐20.40     

A symptotic robustness of sequential confidence intervals and the connection with influence functions

The robustness of sequential confidence intervals is studied by considering contamination with probability ε of the basic underlying distribution in a so-called gross errors model. Asymptotic theory is considered when d → 0, where the prescribed length of the interval is 2d, and simultaneously ε ? ε(d) → 0. A general theorem, in a distribution free setting, is given which provides expressions for the asymptotic coverage probability and the asymptotic distribution of the stopping variable. The results depend on the rate of ε(d)/d as d → 0 and on the contaminating distribution. If the latter distribution is degenerate, it turns out that the influence functions of the above mentioned two estimators used in the construction of the procedure, appear in the expressions for the asymptotic coverage probability and the asymptotic distribution of the stopping variable respectively. This shows how the sequential procedure inherits the robustness properties of the estimators concerned and how this is quantified. The general theorem is specialized to two procedures for the estimation of the mean of a symmetric distribution. Results of Monte Carlo studies indicate agreement between the asymptotic theory and the actual behavior of the procedures.     

The Effect of the Estimation on Goodness‐of‐Fit Tests in Time Series Models

Abstract. We analyze, by simulation, the finite‐sample properties of goodness‐of‐fit tests based on residual autocorrelation coefficients (simple and partial) obtained using different estimators frequently used in the analysis of autoregressive moving‐average time‐series models. The estimators considered are unconditional least squares, maximum likelihood and conditional least squares. The results suggest that although the tests based on these estimators are asymptotically equivalent for particular models and parameter values, their sampling properties for samples of the size commonly found in economic applications can differ substantially, because of differences in both finite‐sample estimation efficiencies and residual regeneration methods.     

Measurements of particle-size distribution during suspension polymerization

The particle-size distribution is one of the main characteristics of polymers produced by suspension polymerization which determines the final properties of the product. Since the on-line measurement of particle-size distribution during the course of polymerization is not a straightforward task, a technique has been developed to accomplish such a measurement for a predefined polymerization process. In this paper the experimental procedure is described in detail and the experimental data are shown for the batch suspension polymerization of methyl methacrylate using benzoyl peroxide as initiator, water as suspending phase and agarose as suspending agent. The particle-size distributions have been measured both for a base case and also when varying some operating conditions including stirring speed, water-to-monomer weight ratio, and suspending agent concentration. Average values and variances of the surface distribution and of the volume distribution are also computed and shown for comparison. © 1999 Society of Chemical Industry     

An accelerated bias-corrected sequential estimation for the mean of NEF-PVF distributions

An accelerated sequential procedure for estimating the mean p in the class of the natural exponential family of distributions having power variance function (NEF-PVF), is proposed. The accelerated procedure is conducted under a combined loss of weighted squared estimation error and sarnpling cost. A class of bias-corrected estimators, which are natural for this suggested accelerated sampling scheme is proposed. The asymptotic properties of the suggested estimators are provided. In particular, one realizes the impact of acceleration on the regret and the tradeoff between bias reduction and regret reduction.     

Robust Estimation For Periodic Autoregressive Time Series

Abstract. A robust estimation procedure for periodic autoregressive (PAR) time series is introduced. The asymptotic properties and the asymptotic relative efficiency are discussed by the estimating equation approach. The performance of the robust estimators for PAR time‐series models with order one is illustrated by a simulation study. The technique is applied to a real data analysis.     

MULTIPLICATIVE EXPONENTIAL MODELS FOR STATIONARY TIME SERIES

Abstract. A class of models for one dimensional time series is presented. The spectrum of such a model is obtained by raising the spectrum of a known parameterized model to an exponent, allowed to attain arbitrary real values. For a moving average model this for example means that the roots of the moving average operator are allowed to have any real order. This method adds a further flexibility to the model which for example allows us to model long memory time series using only a few parameters. The exponent is parameterized in a special way to make the estimation of the parameter determining the exponent asymptotically independent of the estimation of the other model-parameters. The asymptotic distribution of the estimators is derived. The idea is also used for multiplicative models with an exponent for each seasonal factor. In this case the estimators are only approximately independent for a large season length. Finally an application of the model is given using the Beveridge wheat price index.     

Fixed‐b asymptotic approximation of the sampling behaviour of nonparametric spectral density estimators

Abstract. We propose a new asymptotic approximation for the sampling behaviour of nonparametric estimators of the spectral density of a covariance stationary time series. According to the standard approach, the truncation lag grows more slowly than the sample size. We derive first‐order limiting distributions under the alternative assumption that the truncation lag is a fixed proportion of the sample size. Our results extend the approach of Neave (1970) , who derived a formula for the asymptotic variance of spectral density estimators under the same truncation lag assumption. We show that the limiting distribution of zero‐frequency spectral density estimators depends on how the mean is estimated and removed. The implications of our zero‐frequency results are consistent with exact results for bias and variance computed by Ng and Perron (1996) . Finite sample simulations indicate that the new asymptotics provides a better approximation than the standard one.     

Exactly/Nearly Unbiased Estimation of Autocovariances of a Univariate Time Series With Unknown Mean

This article proposes an exactly/nearly unbiased estimator of the autocovariance function of a univariate time series with unknown mean. The estimator is a linear function of the usual sample autocovariances computed using the observed demeaned data. The idea is to stack the usual sample autocovariances into a vector and show that the expectation of this vector is a linear combination of population autocovariances. A matrix that we label, A , collects the weights in these linear combinations. When the population autocovariances of high lags are zero (small), exactly (nearly) unbiased estimators of the remaining autocovariances can be obtained using the inverse of upper blocks of the A matrix. The A ‐matrix estimators are shown to be asymptotically equivalent to the usual sample autocovariance estimators. The A ‐matrix estimators can be used to construct estimators of the autocorrelation function that have less bias than the usual estimators. Simulations show that the A ‐matrix estimators can substantially reduce bias while not necessarily increasing mean square error. More powerful tests for the null hypothesis of white noise are obtained using the A ‐matrix estimators.     

ROBUST FITTING OF INARCH MODELS

We discuss robust M‐estimation of INARCH models for count time series. These models assume the observation at each point in time to follow a Poisson distribution conditionally on the past, with the conditional mean being a linear function of previous observations. This simple linear structure allows us to transfer M‐estimators for autoregressive models to this situation, with some simplifications being possible because the conditional variance given the past equals the conditional mean. We investigate the performance of the resulting generalized M‐estimators using simulations. The usefulness of the proposed methods is illustrated by real data examples.     

M—estimators based repeated significance tests for one—way anova with adaptation to multiple comparisons

A repeated significance testing procedure for a multi—sample location problem based on a general class of M—estimators is considered. The asymptotic distribution theory of the allied test statistics is developed under the null hypothesis as well as under local alternatives. The theory is then adapted to provide a multiple comparison procedure which generalizes the classical Scheffé method to a pseudo—sequential setup. Allied asymptotic relative efficienty results are also considered.     

AN APPROACH TO TIME SERIES SMOOTHING AND FORECASTING USING THE EM ALGORITHM

Abstract. An approach to smoothing and forecasting for time series with missing observations is proposed. For an underlying state-space model, the EM algorithm is used in conjunction with the conventional Kalman smoothed estimators to derive a simple recursive procedure for estimating the parameters by maximum likelihood. An example is given which involves smoothing and forecasting an economic series using the maximum likelihood estimators for the parameters.     

YULE-WALKER ESTIMATES FOR CONTINUOUS-TIME AUTOREGRESSIVE MODELS

Abstract. I consider continuous-time autoregressive processes of order p and develop estimators of the model parameters based on Yule-Walker type equations. For continuously recorded data, it is shown that these estimators are least squares estimators and have the same asymptotic distribution as maximum likelihood estimators.
In practice, though, data can only be observed discretely. For discrete data, I consider approximations to the continuous-time estimators. It is shown that some of these discrete-time estimators are asymptotically biased. Alternative estimators based on the autocovariance function are suggested. These are asymptotically unbiased and are a fast alternative to the maximum likelihood estimators described by Jones. They may also be used as starting values for maximum likelihood estimation.     

MAXIMUM LIKELIHOOD ESTIMATION FOR AUTOREGRESSIVE PROCESSES DISTURBED BY A MOVING AVERAGE

Abstract. Maximum likelihood estimation for stationary autoregressive processes when the signal is subject to a moving-average sampling error is discussed. A modified maximum likelihood estimator is proposed. An algorithm for computing derivatives of the modified likelihood is suggested. Maximum likelihood estimators of the parameter vector are shown to be strongly consistent and to have a multivariate normal limiting distribution. A Monte Carlo simulation shows that the modified maximum likelihood estimator performs better than other available estimators. US current labour force data are analysed as an example.