We discuss the behaviour of parameter estimates when stationary time series models are fitted locally to non-stationary processes which have an evolutionary spectral representation. A particular example is the estimation for an autoregressive process with time-varying coefficients by local Yule–Walker estimates. The bias and the mean squared error for the parameter estimates are calculated and the optimal length of the data segment is determined.