On the worst-case divergence of the least-squares algorithm

In this paper, we provide a _∞-norm lower bound on the worst-case identification error of least-squares estimation when using FIR model structures. This bound increases as a logarithmic function of model complexity and is valid for a wide class of inputs characterized as being quasi-stationary with covariance function falling off sufficiently quickly.