Markov chains. Models, algorithms and applications

DOI10.1007/978-1-4614-6312-2zbMath1270.60001OpenAlexW4236609033MaRDI QIDQ358995

Ximin Huang, Wai-Ki Ching, Tak Kuen Siu, Michael Kwok-Po Ng

Publication date: 9 August 2013

Published in: International Series in Operations Research \& Management Science (Search for Journal in Brave)

Full work available at URL: https://doi.org/10.1007/978-1-4614-6312-2

Mathematics Subject Classification ID

Introductory exposition (textbooks, tutorial papers, etc.) pertaining to probability theory (60-01) Queueing theory (aspects of probability theory) (60K25) Markov chains (discrete-time Markov processes on discrete state spaces) (60J10) Applications of Markov chains and discrete-time Markov processes on general state spaces (social mobility, learning theory, industrial processes, etc.) (60J20) Markov and semi-Markov decision processes (90C40) Continuous-time Markov processes on discrete state spaces (60J27) Applications of queueing theory (congestion, allocation, storage, traffic, etc.) (60K30)

Related Items (10)

Implementation of Markovian queueing network model with multiple closed chains ⋮ Fast computation of stationary joint probability distribution of sparse Markov chains ⋮ A novel high-order multivariate Markov model for spatiotemporal analysis with application to COVID-19 outbreak ⋮ Noda iteration for computing generalized tensor eigenpairs ⋮ Discrete time homogeneous Markov processes for the study of the basic risk processes ⋮ Integration by parts and martingale representation for a Markov chain ⋮ A gradual facilitate high-order multivariate Markov chains model with application to the changes of exchange rates in Egypt: new approach ⋮ The study of basic risk processes by discrete-time non-homogeneous Markov processes ⋮ On a Markov chain approximation method for option pricing with regime switching ⋮ Generalized Tensor Eigenvalue Problems

This page was built for publication: Markov chains. Models, algorithms and applications