On Markov chains generated by Markovian controlled Markov systems. I: Ergodic properties

DOI10.1016/0025-5564(76)90056-0zbMath0371.62120OpenAlexW2038071061MaRDI QIDQ1243563

Masayuki Kimura, Kokichi Futatsugi, Yasuo Komota

Publication date: 1976

Published in: Mathematical Biosciences (Search for Journal in Brave)

Full work available at URL: https://doi.org/10.1016/0025-5564(76)90056-0

Mathematics Subject Classification ID

Markov processes: estimation; hidden Markov models (62M05) Markov chains (discrete-time Markov processes on discrete state spaces) (60J10) Optimal stochastic control (93E20) General biology and biomathematics (92B05)

Related Items

A characterization of the class of structurally stable probabilistic automata II. Continuous-time case, Long-run growth rates of discrete multiplicative processes in Markovian environments, On Markov chains generated by markovian controlled Markov systems: Structural stability

Cites Work

• Some limit theorems for a class of network problems as related to finite Markov chains
• Definite and Quasidefinite Sets of Stochastic Matrices
• Equivalences between probabilistic and deterministic sequential machines
• Probabilistic automata
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item