Equivalence of Lyapunov stability criteria in a class of Markov decision processes

DOI10.1007/BF01189027zbMath0766.90082OpenAlexW2028955531MaRDI QIDQ1194209

Rolando Cavazos-Cadena, Onésimo Hernández-Lerma

Publication date: 27 September 1992

Published in: Applied Mathematics and Optimization (Search for Journal in Brave)

Full work available at URL: https://doi.org/10.1007/bf01189027

zbMATH Keywords

countable state spacediscrete time average reward Markov decision processesLyapunov stability criteria

Mathematics Subject Classification ID

Lyapunov and other classical stabilities (Lagrange, Poisson, (L^p, l^p), etc.) in control theory (93D05) Markov and semi-Markov decision processes (90C40)

Related Items

Approximation of average cost optimal policies for general Markov decision processes with unbounded costs ⋮ Controlled Markov processes on the infinite planning horizon: Weighted and overtaking cost criteria ⋮ A pause control approach to the value iteration scheme in average Markov decision processes ⋮ Sample-Path Optimal Stationary Policies in Stable Markov Decision Chains with the Average Reward Criterion ⋮ Discrete-time zero-sum games for Markov chains with risk-sensitive average cost criterion ⋮ Antisideslip and antirollover safety speed controller design for vehicle on curved road ⋮ A note on the vanishing interest rate approach in average Markov decision chains with continuous and bounded costs ⋮ Solutions of the average cost optimality equation for Markov decision processes with weakly continuous kernel: the fixed-point approach revisited ⋮ Denumerable controlled Markov chains with average reward criterion: Sample path optimality ⋮ Continuity of the optimal average cost in Markov decision chains with small risk-sensitivity

Cites Work

• Existence of optimal stationary policies in average reward Markov decision processes with a recurrent state
• Adaptive Markov control processes
• The average-optimal adaptive control of a Markov renewal model in presence of an unknown parameter
• On the Stochastic Matrices Associated with Certain Queuing Processes
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item