Preconditioned Conjugate Gradient Method and Generalized Successive Overrelaxation Method for the Least Squares Problems

In a recent paper 4], Li et al . gave a generalized successive overrelaxation (GSOR) method for the least squares problems. In this paper, the connection between the GSOR method and the preconditioned conjugate gradient (PCG) method for the normal equations is investigated. It is shown that the PCG method is at least as fast as the GSOR method. Numerical examples demonstrates that the PCG method is much faster than the GSOR method.