Ergodicity conditions for nonlinear discrete time stochastic dynamical systems with Markovian noise

DOI10.1080/07362999308809331zbMath0790.60061OpenAlexW2112163543MaRDI QIDQ4284122

Patrick Homble

Publication date: 20 June 1994

Published in: Stochastic Analysis and Applications (Search for Journal in Brave)

Full work available at URL: https://doi.org/10.1080/07362999308809331

zbMATH Keywords

dynamical systemsgeometric control theoryMarkovian noise processunique maximal invariant control setweak stochastic controllability

Mathematics Subject Classification ID

Optimal stochastic control (93E20) Applications of Markov chains and discrete-time Markov processes on general state spaces (social mobility, learning theory, industrial processes, etc.) (60J20)

Cites Work

• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Recurrence and invariant measures for degenerate diffusions
• Recurrent Markov chains
• Sufficient conditions for ergodicity and recurrence of Markov chains on a general state space
• A uniform theory for sums of Markov chain transition probabilities
• Infinite time optimal control and periodicity
• Controllability of Nonlinear Discrete-Time Systems: A Lie-Algebraic Approach
• Lyapunov numbers of markov solutions of linear stochastic systems
• On degenerate elliptic-parabolic operators of second order and their associated diffusions
• Criteria for classifying general Markov chains
• Markov Chains with Continuous Components
• On unique ergodicity for degenerate diffusions
• Asymptotic Behavior of Stochastic Systems Possessing Markovian Realizations
• Contributions to Doeblin's theory of Markov processes
• The general theory of Markov processes according to Doeblin

This page was built for publication: Ergodicity conditions for nonlinear discrete time stochastic dynamical systems with Markovian noise