Sharpening Wald-type inference in robust regression for small samples

The datasets used in statistical analyses are often small in the sense that the number of observations n is less than 5 times the number of parameters p to be estimated. In contrast, methods of robust regression are usually optimized in terms of asymptotics with an emphasis on efficiency and maximal bias of estimated coefficients. Inference, i.e., determination of confidence and prediction intervals, is proposed as complementary criteria. An analysis of MM-estimators leads to the development of a new scale estimate, the Design Adaptive Scale Estimate, and to an extension of the MM-estimate, the SMDM-estimate, as well as a suitable ψ-function. A simulation study shows and a real data example illustrates that the SMDM-estimate has better performance for small n/p and that the use the new scale estimate and of a slowly redescending ψ-function is crucial for adequate inference.