首页 | 本学科首页   官方微博 | 高级检索  
     


Risk-sensitive probability for Markov chains
Authors:Vahid Reza Ramezani  Steven I. Marcus  
Affiliation:Department of Electrical and Computer Engineering and Institute for System Research, University of Maryland, 2415 A.V. Williams Building, College Park, MD 20742, USA
Abstract:The probability distribution of a Markov chain is viewed as the information state of an additive optimization problem. This optimization problem is then generalized to a product form whose information state gives rise to a generalized notion of probability distribution for Markov chains. The evolution and the asymptotic behavior of this generalized or “risk-sensitive” probability distribution is studied in this paper and a conjecture is proposed regarding the asymptotic periodicity of risk-sensitive probability and proved in the two-dimensional case. The relation between a set of simultaneous non-linear and the set of periodic attractors is analyzed.
Keywords:Markov chains   Risk-sensitive estimation   Asymptotic periodicity
本文献已被 ScienceDirect 等数据库收录!
设为首页 | 免责声明 | 关于勤云 | 加入收藏

Copyright©北京勤云科技发展有限公司  京ICP备09084417号