Potentials for denumerable Markov chains
From MaRDI portal
Publication:5896038
DOI10.1016/0022-247X(61)90054-3zbMath0105.33103WikidataQ110853102 ScholiaQ110853102MaRDI QIDQ5896038
J. Laurie Snell, John G. Kemeny
Publication date: 1961
Published in: Journal of Mathematical Analysis and Applications (Search for Journal in Brave)
Related Items (25)
Variational characterizations in Markov decision processes ⋮ Continuous time markov decision processes with interventions ⋮ Limit theorems involing capacities for recurrent Markov chains ⋮ Leveraging environmental correlations: the thermodynamics of requisite variety ⋮ On the Green functions of 1-dimensional diffusion processes ⋮ On homogeneous and oscillating random walks on the integers ⋮ Reward algorithms for semi-Markov processes ⋮ Representation Theory for Denumerable Markov Chains ⋮ Emptiness Under Isolation and the Value Problem for Hierarchical Probabilistic Automata ⋮ Extinction times and size of the surviving species in a two-species competition process ⋮ Foolproof convergence in multichain policy iteration ⋮ Laplace and bi-Laplace equations for directed networks and Markov chains ⋮ Probabilistic Büchi Automata with Non-extremal Acceptance Thresholds ⋮ Potential kernels for recurrent Markov chains ⋮ Boundary Theory for Recurrent Markov Chains ⋮ La théorie du potentiel et les processus recurrents ⋮ Potentials associated with recurrent Markov renewal processes ⋮ Über die diskrete Potentialtheorie ⋮ Power of Randomization in Automata on Infinite Strings ⋮ Recurrence relations for generalized hitting times for semi-Markov processes ⋮ Slowly spreading chains of the first kind ⋮ A global Riesz decomposition theorem on trees without positive potentials ⋮ A further note on discrete potential theory ⋮ Kac's moment formula and the Feynman-Kac formula for additive functionals of a Markov process ⋮ Potential theory and non-Markovian chains
Cites Work
This page was built for publication: Potentials for denumerable Markov chains
