Controlled semi-Markov models under long-run average rewards

DOI10.1016/0378-3758(89)90113-4zbMath0683.49003OpenAlexW1985315411MaRDI QIDQ1824853

Rabi N. Bhattacharya, Mukul K. Majumdar

Publication date: 1989

Published in: Journal of Statistical Planning and Inference (Search for Journal in Brave)

Full work available at URL: https://doi.org/10.1016/0378-3758(89)90113-4

zbMATH Keywords

dynamic programming equationstationary optimal policiesgeneral semi- markov models

Mathematics Subject Classification ID

Optimal stochastic control (93E20) Applications of Markov renewal processes (reliability, queueing networks, etc.) (60K20) Existence of optimal solutions to problems involving randomness (49J55)

Related Items

On the optimality equation for average cost Markov control processes with Feller transition probabilities, Duality between discounted and undiscounted models of optimal growth for a class of utility functions, Time and Ratio Expected Average Cost Optimality for Semi-Markov Control Processes on Borel Spaces, Recurrence conditions for Markov decision processes with Borel state space: A survey, Controlled semi-Markov models - the discounted case, Performance analysis for controlled semi-Markov systems with application to maintenance, Semi-Markov control processes with unknown holding times distribution under an average cost criterion, What do discounted optima converge to!: A theory of discount rate asymptotics in economic models, Average cost optimal policies for Markov control processes with Borel state space and unbounded costs, Condition-based maintenance policies under imperfect maintenance at scheduled and unscheduled opportunities, Recursive utility and the Ramsey problem, Optimality of Quasi-Open-Loop Policies for Discounted Semi-Markov Decision Processes, A note on the economic management of inventory or resource under stochastic prices, Decentralized evolutionary mechanisms for intertemporal economies: A possibility result

Cites Work

• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Dynamic programming and stochastic control
• Controlled semi-Markov models - the discounted case
• Denumerable state semi-Markov decision processes with unbounded costs, average cost criterion
• Invariant problems in dynamic programming - average reward criterion
• A stochastic model for the economic management of a renewable animal resource
• Averaging vs. discounting in dynamic programming: a counterexample
• Denumerable Undiscounted Semi-Markov Decision Processes with Unbounded Rewards
• On Dynamic Programming with Unbounded Rewards
• Discrete Dynamic Programming
• Average cost semi-markov decision processes
• A Useful Convergence Theorem for Probability Distributions