Performance analysis of stochastic gradient algorithms under weak conditions |
| |
Authors: | Feng Ding HuiZhong Yang and Fei Liu |
| |
Affiliation: | (1) Control Science and Engineering Research Center, Jiangnan University, Wuxi, 214122, China |
| |
Abstract: | By using the stochastic martingale theory,convergence properties of stochastic gra-dient(SG) identification algorithms are studied under weak conditions. The analysis indicates that the parameter estimates by the SG algorithms consistently converge to the true parameters,as long as the information vector is persistently exciting(i.e.,the data product moment matrix has a bounded condition number) and that the process noises are zero mean and uncorrelated. These results remove the strict assumptions,made in existing references,that the noise variances and high-order moments exist,and the processes are stationary and ergodic and the strong persistent excitation condition holds. This contribution greatly relaxes the convergence conditions of stochastic gradient algorithms. The simulation results with bounded and unbounded noise variances confirm the convergence conclusions proposed. |
| |
Keywords: | recursive identification parameter estimation least squares stochastic gradient multivariable systems convergence properties martingale convergence theorem |
本文献已被 维普 SpringerLink 等数据库收录! |
|