Robust Regression using Probability Plots for Estimating the Weibull Shape Parameter

The Weibull shape parameter is important in reliability estimation as it characterizes the ageing property of the system. Hence, this parameter has to be estimated accurately. This paper presents a study of the efficiency of using robust regression methods over the ordinary least‐squares regression method based on a Weibull probability plot. The emphasis is on the estimation of the shape parameter of the two‐parameter Weibull distribution. Both the case of small data sets with outliers and the case of data sets with multiple‐censoring are considered. Maximum‐likelihood estimation is also compared with linear regression methods. Simulation results show that robust regression is an effective method in reducing bias and it performs well in most cases. Copyright © 2006 John Wiley & Sons, Ltd.     

A study of two estimation approaches for parameters of Weibull distribution based on WPP

Least-squares estimation (LSE) based on Weibull probability plot (WPP) is the most basic method for estimating the Weibull parameters. The common procedure of this method is using the least-squares regression of Y on X, i.e. minimizing the sum of squares of the vertical residuals, to fit a straight line to the data points on WPP and then calculate the LS estimators. This method is known to be biased. In the existing literature the least-squares regression of X on Y, i.e. minimizing the sum of squares of the horizontal residuals, has been used by the Weibull researchers. This motivated us to carry out this comparison between the estimators of the two LS regression methods using intensive Monte Carlo simulations. Both complete and censored data are examined. Surprisingly, the result shows that LS Y on X performs better for small, complete samples, while the LS X on Y performs better in other cases in view of bias of the estimators. The two methods are also compared in terms of other model statistics. In general, when the shape parameter is less than one, LS Y on X provides a better model; otherwise, LS X on Y tends to be better.     

Robust Estimation for Weibull Distribution in Partially Accelerated Life Tests with Early Failures

Maximum likelihood estimation (MLE) is a frequently used method for estimating distribution parameters in constant stress partially accelerated life tests (CS‐PALTs). However, using the MLE to estimate the parameters for a Weibull distribution may be problematic in CS‐PALTs. First, the equation for the shape parameter estimator derived from the log‐likelihood function is difficult to solve for the occurrence of nonlinear equations. Second, the sample size is typically not large in life tests. The MLE, a typical large‐sample inference method, may be unsuitable. Test items unsuitable for stress conditions may become early failures, which have extremely short lifetimes. The early failures may cause parameter estimate bias. For addressing early failures in the Weibull distribution in CS‐PALTs, we propose an M‐estimation method based on a Weibull Probability Plot (WPP) framework, which leads a closed‐form expression for the shape parameter estimator. We conducted a simulation study to compare the M‐estimation method with the MLE method. The results show that, with early‐failure samples, the M‐estimation method performs better than the MLE does. Copyright © 2015 John Wiley & Sons, Ltd.     

A comparison of three estimators of the Weibull parameters

Using mean square error as the criterion, we compare two least squares estimates of the Weibull parameters based on non‐parametric estimates of the unreliability with the maximum likelihood estimates (MLEs). The two non‐parametric estimators are that of Herd–Johnson and one recently proposed by Zimmer. Data was generated using computer simulation with three small sample sizes (5, 10 and 15) with three multiply‐censored patterns for each sample size. Our results indicate that the MLE is a better estimator of the Weibull characteristic value, θ, than the least squares estimators considered. No firm conclusions may be made regarding the best estimate of the Weibull shape parameter, although the use of maximum likelihood is not recommended for small sample sizes. Whenever least squares estimation of both Weibull parameters is appropriate, we recommend the use of the Zimmer estimator of reliability. Copyright © 2001 John Wiley & Sons, Ltd.     

More on the mis‐specification of the shape parameter with Weibull‐to‐exponential transformation

When lifetimes follow Weibull distribution with known shape parameter, a simple power transformation could be used to transform the data to the case of exponential distribution, which is much easier to analyze. Usually, the shape parameter cannot be known exactly and it is important to investigate the effect of mis‐specification of this parameter. In a recent article, it was suggested that the Weibull‐to‐exponential transformation approach should not be used as the confidence interval for the scale parameter has very poor statistical property. However, it would be of interest to study the use of Weibull‐to‐exponential transformation when the mean time to failure or reliability is to be estimated, which is a more common question. In this paper, the effect of mis‐specification of Weibull shape parameters on these quantities is investigated. For reliability‐related quantities such as mean time to failure, percentile lifetime and mission reliability, the Weibull‐to‐exponential transformation approach is generally acceptable. For the cases when the data are highly censored or when small tail probability is concerned, further studies are needed, but these are known to be difficult statistical problems for which there are no standard solutions. Copyright © 2000 John Wiley & Sons, Ltd.     

Some Percentile Estimators for Weibull Parameters

A percentile estimator for the shape parameter of the Weibull distribution, based on the 17th and 97th sample percentiles, is proposed which is asymptotically about 66% efficient when compared with the MLE (maximum likelihood estimator). A two-observation percentile estimator, based on the 40th and 82nd sample percentiles, for the scale parameter when the shape parameter is unknown is asymptotically about 82y0 efficient when compared with the MLE. The 24th and 93rd sample percentiles yield asymptotically about 41ye jointly efficient percentile estimators for both the scale and shape parameters in a class of two-observation percentile estimators when compared with their MLEs. Some other simple percentile estimators for these parameters are also briefly discussed. Finally, asymptotic properties of these estimators are investigated and their application in statistical inference problems is mentioned.     

A flexible Weibull extension

We propose a new two-parameter ageing distribution which is a generalization of the Weibull and study its properties. It has a simple failure rate (hazard rate) function. With appropriate choice of parameter values, it is able to model various ageing classes of life distributions including IFR, IFRA and modified bathtub (MBT). The ranges of the two parameters are clearly demarcated to separate these classes. It thus provides an alternative to many existing life distributions. Details of parameter estimation are provided through a Weibull-type probability plot and maximum likelihood. We also derive explicit formulas for the turning points of the failure rate function in terms of its parameters. This, combined with the parameter estimation procedures, will allow empirical estimation of the turning points for real data sets, which provides useful information for reliability policies.     

Bayesian Inference and Life Testing Plan for the Weibull Distribution in Presence of Progressive Censoring

This article deals with the Bayesian inference of unknown parameters of the progressively censored Weibull distribution. It is well known that for a Weibull distribution, while computing the Bayes estimates, the continuous conjugate joint prior distribution of the shape and scale parameters does not exist. In this article it is assumed that the shape parameter has a log-concave prior density function, and for the given shape parameter, the scale parameter has a conjugate prior distribution. As expected, when the shape parameter is unknown, the closed-form expressions of the Bayes estimators cannot be obtained. We use Lindley's approximation to compute the Bayes estimates and the Gibbs sampling procedure to calculate the credible intervals. For given priors, we also provide a methodology to compare two different censoring schemes and thus find the optimal Bayesian censoring scheme. Monte Carlo simulations are performed to observe the behavior of the proposed methods, and a data analysis is onducted for illustrative purposes.     

A new approach to MLE of Weibull distribution with interval data

We study the two-parameter maximum likelihood estimation (MLE) problem for the Weibull distribution with consideration of interval data. Without interval data, the problem can be solved easily by regular MLE methods because the restricted MLE of the scale parameter β for a given shape parameter α has an analytical form, thus α can be efficiently solved from its profile score function by traditional numerical methods. In the presence of interval data, however, the analytical form for the restricted MLE of β does not exist and directly applying regular MLE methods could be less efficient and effective. To improve efficiency and effectiveness in handling interval data in the MLE problem, a new approach is developed in this paper. The new approach combines the Weibull-to-exponential transformation technique and the equivalent failure and lifetime technique. The concept of equivalence is developed to estimate exponential failure rates from uncertain data including interval data. Since the definition of equivalent failures and lifetimes follows EM algorithms, convergence of failure rate estimation by applying equivalent failures and lifetimes is mathematically proved. The new approach is demonstrated and validated through two published examples, and its performance in different conditions is studied by Monte Carlo simulations. It indicates that the profile score function for α has only one maximum in most cases. Such good characteristic enables efficient search for the optimal value of α.     

Estimation of Weibull parameters with linear regression method

Abstract

Based on minimum mean square error, a modified probability estimator is proposed by a Monte Carlo simulation for estimating the Weibull parameters with the linear regression method. It is shown that compared with the commonly used estimators, the modified probability estimator gives a more accurate estimation of the Weibull modulus and the same estimation precision of the scale parameter. Furthermore, it is more conservative than the commonly used estimator recommended by previous authors and hence results in a higher safety in reliability predictions.     

Estimation of the Shape Parameter of the Weibull Distribution Using Linear Regression Methods: Non‐Censored Samples

The two‐parameter Weibull distribution is one of the most widely applied probability distributions, particularly in reliability and lifetime modelings. Correct estimation of the shape parameter of the Weibull distribution plays a central role in these areas of statistical analysis. Many different methods can be used to estimate this parameter, most of which utilize regression methods. In this paper, we presented various regression methods for estimating the Weibull shape parameter and an experimental study using classical regression methods to compare the results of the methods. A complete list of the parameter estimators considered in this study is as follows: ordinary least squares (OLS), weighted least squares (WLS, Bergman, F&T, Lu), non‐parametric robust Theil's (Theil) and weighted Theil's (WeTheil), robust Winsorized least squares (WinLS), and M‐estimators (Huber, Andrew, Tukey, Cauchy, Welsch, Hampel and Logistic). Estimator performances were compared based on bias and mean square error criteria using Monte‐Carlo simulations. The simulation results demonstrated that for small, complete, and non‐outlier data sets, the Bergman, F&T, and Lu estimators are more efficient than the others. When the data set contains one or two outliers in the X direction, Theil is the most efficient estimator. Copyright © 2012 John Wiley & Sons, Ltd.     

EM algorithm for estimating the Burr XII parameters with multiple censored data

The two‐parameter Burr XII distribution has been widely used in various practical applications such as business, chemical engineering, quality control, medical research and reliability engineering. In this paper, we present maximum likelihood estimation (MLE) via the expectation–maximization (EM) algorithm to estimate the Burr XII parameters with multiple censored data. We also provide a method that can be used to construct the confidence intervals of the parameters, a method that computes the asymptotic variance and the covariance of the MLE from the complete and missing information matrices. A simulation study is conducted to compare the performance of the MLE via the EM algorithm and the Netwon–Raphson (NR) algorithm. The simulation results show that the EM algorithm outperforms the NR algorithm in most cases in terms of bias and errors in the root mean square. A numerical example is also used to demonstrate the performance of the proposed method. Copyright © 2009 John Wiley & Sons, Ltd.     

Reliability analysis using an additive Weibull model with bathtub-shaped failure rate function

Lifetime distributions for many components usually have a bathtub-shaped failure rate in practice. However, there are very few practical models to model this type of failure rate function. In this paper we study a simple model based on adding two Weibull survival functions. Some simplifications of the model are also presented. The graphical estimation technique based on the conventional Weibull plot is demonstrated to be useful in this case.     

Reliability analysis of wind turbine subassemblies based on the 3-P Weibull model via an ergodic artificial bee colony algorithm

The Weibull distribution is the most widely used model for the reliability evaluation of wind turbine subassemblies. Considering the important role of the location parameter in the three-parameter (3-P) Weibull model and its rare application in wind turbines, this study conducted a reliability analysis of wind turbine subassemblies based on field data that obeyed the 3-P Weibull distribution model via maximum likelihood estimation (MLE). An improved ergodic artificial bee colony algorithm (ErgoABC) was proposed by introducing the chaos search theory, global best solution, and Lévy flights strategy into the classical artificial bee colony (ABC) algorithm to determine the maximum likelihood estimates of the Weibull distribution parameters. This was validated against simulation calculations and proved to be efficient for high-dimensional function optimization and parameter estimation of the 3-P Weibull distribution. Finally, reliability analyses of the wind turbine subassemblies based on different types of field failure data were conducted using ErgoABC. The results show that the 3-P Weibull model can reasonably evaluate the lifetime distribution of critical wind turbine subassemblies, such as generator slip rings and main shafts, on which the location parameter has a significant effect.     

Reliability analysis for q-Weibull distribution with multiply Type-I censored data

The widely used Weibull distribution could be generalized to be q-Weibull distribution. To fill out the gap in existing literature, the reliability is studied for q-Weibull distribution with multiply Type-I censored data, which is the general form of Type-I censored data. The point estimates and confidence intervals (CIs) for q-Weibull parameters and reliability parameters such as the reliability and remaining lifetime are all focused on. The maximum likelihood estimates (MLE) are obtained by maximizing the likelihood function and transforming it to an unconstrained optimization problem. The least-square estimates (LSEs) are proposed by minimizing the single-variable profile error function derived from reducing the previous multivariable error function. These improvements could make the computation of point estimates efficient. Concerning the CIs, the asymptotic normality of log-transformed MLE is used to guarantee they fall into the value ranges. Particularly, the closed form for the Fisher information matrix is derived using the missing information principal and is combined with the delta method to construct the CIs for reliability. Besides, the bias-corrected and accelerated (BCa) bootstrap method is also applied. Further, a Monte Carlo simulation study is conducted to compare different point estimates and CIs. Finally, an illustrative example is presented to show the application of the study in this paper.     

Evaluation of maximum likelihood procedures to estimate left censored observations

The optimal procedure for estimating chemical levels below the limit of detection (LOD) remains a topic of interest when working with ultratrace analysis of environmental or clinical specimens. Unique to this investigation, we evaluated the performance of three maximum likelihood estimation (MLE) procedures to estimate the population mean and standard deviation from chemical data with 10-40% observations below the LOD. Randomly drawn observations from the normal distributions with these parameter estimates were used to replace censored observations. Final estimates of the mean and standard deviation (SD) were obtained from these full samples and compared to actual population mean mu and SD sigma. The study demonstrated that the average percent relative bias for both the mean and SD increased as the sample size decreased and the percent observations below the LOD increased. The MLE procedure with multiple imputations almost always had acceptable coverage rates for both the mean and the SD. These findings support earlier observations, and they suggest that MLE with multiple imputations is the preferred method to estimate mean and SD when the frequency of left censored observations in the population is < or =40%.     

A two-parameter parsimonious bathtub model for the analysis of system failure times with illustrations to reliability data

In this study, a two-parameter, upper-bounded probability distribution called the tau distribution is introduced and its applications in reliability engineering are presented. Each of the parameters of the tau distribution has a clear semantic meaning. Namely, one of them determines the upper bound of the distribution, while the value of the other parameter influences the shape of the cumulative distribution function. A remarkable property of this new probability distribution is that its probability density function, survival function, hazard rate function (HRF), and quantile function can all be expressed in terms of its cumulative distribution function. The HRF of the proposed probability distribution can exhibit an increasing trend and various bathtub shapes with or without a low and long-flat phase (useful time phase), which makes this new distribution suitable for modeling a wide range of real-world problems. The constraint maximum likelihood estimation, percentile estimation, approximate Bayesian computation, and approximate quantile estimation computation are proposed to calculate the unknown parameters of the model. The suitability of the estimation methods is verified with the aid of simulation and real-world data results. The modeling capability of the tau distribution was compared with that of some well-known two- and three-parameter probability distributions using two data sets known from the literature of reliability engineering: time between failures data of a machining center, and time to failure of data acquisition system cards. Based on empirical results, the new distribution may be viewed as a viable competitor to the Weibull, Gamma, Chen, and modified Weibull distributions.     

Maximum-Likelihood Estimation of the Parameters of Gamma and Weibull Populations from Complete and from Censored Samples

Iterative procedures are given for joint maximum-likelihood estimation, from complete and censored samples, of the three parameters of Gamma and of Weibull populations. For each of these populations, the likelihood function is written down, and the three maximum-likelihood equations are obtained. In each case, simultaneous solution of these three equations would yield joint maximum-likelihood estimators for the three parameters. The iterative procedures proposed to solve the equations are applicable to the most general case, in which all three parameters are unknown, and also to special cases in which any one or any two of the parameters are known. Numerical examples are worked out in which the parameters are estimated from the first m failure times in simulated life tests of n items (m ≤ n), using data drawn from Gamma and Weibull populations, each with two different values of the shape parameter.     

Topographic analysis and Weibull regression for prediction of strain localisation in an automotive aluminium alloy

Abstract

We fit a two-parameter Weibull regression model by maximum likelihood estimation (MLE) to filtered surface roughness data. These data were acquired with scanning confocal laser microscopy performed on aluminium alloy AA 5754-O surfaces that were subjected to a range of plastic strain intensities in three different in-plane strain modes. Noting that one of the two Weibull regression parameters is, to a good approximation, invariant with strain intensity for a given strain mode, the authors find that the variation of the second parameter with strain intensity conforms to a simple quadratic function. These functions may then be used to generate accurate, statistically significant, single parameter predictors of both strain intensity and strain mode up to and including the onset of critical strain localisation and/or failure.     

基于GM-噪声SVR方法的矿山设备可靠性参数估计

为了有效估计小子样条件下矿山设备的三参数威布尔分布可靠性模型参数,提出基于GM-噪声SVR的参数估计方法。该方法以灰色估计法(GM)为基础估计模型的位置参数,采用基于训练样本数量和噪声参数寻优的ε - 带支持向量回归机(ε-SVR)估计尺度参数和形状参数,并通过拟合的三参数威布尔分布函数分析预测和解决设备的可靠性问题。算例结果表明,GM-噪声SVR方法可以很好地用于矿山设备可靠性模型参数估计,估计某带式输送机三参数威布尔分布可靠性模型的位置参数、尺度参数和形状参数依次为3.1525、188.3763、1.0476,平均无故障时间为188 h,标准均方根误差NRMSE为0.0519。这表明该方法的可行性和有效性。