Time and Ratio Expected Average Cost Optimality for Semi-Markov Control Processes on Borel Spaces

DOI10.1081/STA-120028693zbMath1114.90476MaRDI QIDQ3155288

Óscar Vega-Amaya, Fernando Luque-Vásquez

Publication date: 14 January 2005

Published in: Communications in Statistics - Theory and Methods (Search for Journal in Brave)

Mathematics Subject Classification ID

Markov renewal processes, semi-Markov processes (60K15) Markov and semi-Markov decision processes (90C40)

Related Items (3)

Optimality in Feller semi-Markov control processes ⋮ Continuous-Time Markov Decision Processes with Unbounded Transition and Discounted-Reward Rates ⋮ Constrained semi-Markov decision processes with ratio and time expected average criteria in Polish spaces

Cites Work

• Unnamed Item
• Unnamed Item
• Unnamed Item
• Markov chains and stochastic stability
• An approximation approach to ergodic semi-Markov control processes
• On the optimality equation for zero-sum ergodic stochastic games
• Markov chains and invariant probabilities
• Monotonic allocation schemes in clan games
• Controlled semi-Markov models under long-run average rewards
• Poisson equation, moment inequalities and quick convergence for Markov random walks.
• Zero-Sum Stochastic Games in Borel Spaces: Average Payoff Criteria
• Average Cost Semi-Markov Decision Processes and the Control of Queueing Systems
• Denumerable Undiscounted Semi-Markov Decision Processes with Unbounded Rewards
• On the Second Optimality Equation for Semi-Markov Decision Models
• On Dynamic Programming with Unbounded Rewards
• Constrained Semi-Markov decision processes with average rewards
• Minimax Control of Discrete-Time Stochastic Systems
• Zero-Sum Semi-Markov Games
• A Convex Analytic Framework for Ergodic Control of Semi-Markov Processes
• Sample-Path Optimality and Variance-Minimization of Average Cost Markov Control Processes

This page was built for publication: Time and Ratio Expected Average Cost Optimality for Semi-Markov Control Processes on Borel Spaces