Denumerable Undiscounted Semi-Markov Decision Processes with Unbounded Rewards

DOI10.1287/moor.8.2.298zbMath0513.90085OpenAlexW2107037985MaRDI QIDQ3659555

Awi Federgruen, Paul J. Schweitzer, Henk C. Tijms

Publication date: 1983

Published in: Mathematics of Operations Research (Search for Journal in Brave)

Full work available at URL: https://semanticscholar.org/paper/020c3d56efa52984f29da56397cc92dbc883bea4

zbMATH Keywords

inventory modelcountable state spaceoptimality equationsrecurrence conditionunbounded rewardsreplacement modelapplication of a fixed point theoremaverage return per unit timesolution existence proofundiscounted semi-Markov decision models

Mathematics Subject Classification ID

Applications of mathematical programming (90C90) Reliability, availability, maintenance, inspection in operations research (90B25) Inventory, storage, reservoirs (90B05) Dynamic programming (90C39) Fixed-point and coincidence theorems (topological aspects) (54H25) Markov and semi-Markov decision processes (90C40)

Related Items

Time and Ratio Expected Average Cost Optimality for Semi-Markov Control Processes on Borel Spaces ⋮ Policy iteration type algorithms for recurrent state Markov decision processes ⋮ Optimality equations and sensitive optimality in bounded Markov decision processes¹ ⋮ A forecast horizon and a stopping rule for general Markov decision processes ⋮ Optimal control of Markov processes with age-dependent transition rates ⋮ Conditions for existence of average and Blackwell optimal stationary policies in denumerable Markov decision processes ⋮ An expected average reward criterion ⋮ New average optimality conditions for semi-Markov decision processes in Borel spaces ⋮ Semi-Markov control processes with unknown holding times distribution under an average cost criterion ⋮ Recent results on conditions for the existence of average optimal stationary policies ⋮ Denumerable semi-Markov decision chains with small interest rates ⋮ On strong average optimality of Markov decision processes with unbounded costs ⋮ Non-Stationary Semi-Markov Decision Processes on a Finite Horizon ⋮ Semi-Markov control models with partially known holding times distribution: discounted and average criteria ⋮ A Fixed Point Approach to Undiscounted Markov Renewal Programs ⋮ Optimal threshold probability and expectation in semi-Markov decision processes ⋮ Recent developments in single product, discrete-time, capacitated production-inventory systems. ⋮ Constrained semi-Markov decision processes with ratio and time expected average criteria in Polish spaces ⋮ Controlled semi-Markov models under long-run average rewards ⋮ Average Cost Semi-Markov Decision Processes and the Control of Queueing Systems ⋮ The value iteration method for countable state Markov decision processes

This page was built for publication: Denumerable Undiscounted Semi-Markov Decision Processes with Unbounded Rewards