Abstract: | The question of the existence of steady state solutions to the closed loop system equations for stochastic systems, and in particular ARMAX systems under non-linear feedback control, is addressed. Using the ergodic theory of time-invariant Markov processes, it is shown that corresponding to a large class of control laws there exist shift-invariant probabilities for the joint disturbance input-output processes. This permits an asymptotic analysis of (i) averages of functions of the state process, (ii) the probability distributions governing the state process and (iii) loss functions on the system in the steady state. |