On the Second Optimality Equation for Semi-Markov Decision Models

DOI10.1287/moor.17.2.470zbMath0773.90091OpenAlexW2112804068MaRDI QIDQ4016704

Manfred Schäl

Publication date: 16 January 1993

Published in: Mathematics of Operations Research (Search for Journal in Brave)

Full work available at URL: https://doi.org/10.1287/moor.17.2.470

zbMATH Keywords

countable state spaceaverage expected rewardsemi-Markov decision models

Mathematics Subject Classification ID

Markov and semi-Markov decision processes (90C40)

Related Items (12)

Time and Ratio Expected Average Cost Optimality for Semi-Markov Control Processes on Borel Spaces ⋮ On undiscounted semi-Markov decision processes with absorbing states ⋮ Optimality in Feller semi-Markov control processes ⋮ Constrained Semi-Markov decision processes with average rewards ⋮ Computing semi-stationary optimal policies for multichain semi-Markov decision processes ⋮ Performance analysis for controlled semi-Markov systems with application to maintenance ⋮ Semi-Markov decision processes with limiting ratio average rewards ⋮ A survey of recent results on continuous-time Markov decision processes (with comments and rejoinder) ⋮ Constrained semi-Markov decision processes with ratio and time expected average criteria in Polish spaces ⋮ Condition-based maintenance policies under imperfect maintenance at scheduled and unscheduled opportunities ⋮ On zero-sum two-person undiscounted semi-Markov games with a multichain structure ⋮ The value iteration method for countable state Markov decision processes

This page was built for publication: On the Second Optimality Equation for Semi-Markov Decision Models