Singularly Perturbed Discrete-Time Markov Chains

DOI10.1137/S0036139999354297zbMath0972.60068OpenAlexW2050206842MaRDI QIDQ4507316

G. George Yin, Qing Zhang

Publication date: 18 October 2000

Published in: SIAM Journal on Applied Mathematics (Search for Journal in Brave)

Full work available at URL: https://doi.org/10.1137/s0036139999354297

zbMATH Keywords

asymptotic expansionquasi-stationary distributiondiscrete-time Markov chain

Mathematics Subject Classification ID

Markov chains (discrete-time Markov processes on discrete state spaces) (60J10) Perturbations, asymptotics of solutions to ordinary differential equations (34E10)

Related Items (13)

A unified perturbation analysis framework for countable Markov chains ⋮ Stability of Markov modulated discrete-time dynamic systems. ⋮ Discrete-time Markov chains with two-time scales and a countable state space: limit results and queueing applications ⋮ Near-optimal controls of discrete-time dynamic systems driven by singularly-perturbed Markov chains ⋮ On finite capacity queues with time dependent arrival rates ⋮ A note on two-person zero-sum communicating stochastic games ⋮ Discrete-time approximation of Wonham filters ⋮ Asymptotic properties of consensus-type algorithms for networked systems with regime-switching topologies ⋮ Asymptotically optimal controls of hybrid linear quadratic regulators in discrete time. ⋮ Stability of Discrete-Time Regime-Switching Dynamic Systems with Delays ⋮ Discrete-time singularly perturbed Markov chains: aggregation, occupation measures, and switching diffusion limit ⋮ Control of singularly perturbed Markov chains: A numerical study ⋮ Exponential bounds for discrete-time singularly perturbed Markov chains

This page was built for publication: Singularly Perturbed Discrete-Time Markov Chains