Average optimal policies in Markov decision drift processes with applications to a queueing and a replacement model

DOI10.2307/1426437zbMath0517.90091OpenAlexW2331742422MaRDI QIDQ3666622

Arie Hordijk, Frank A. Van der Duyn Schouten

Publication date: 1983

Published in: Advances in Applied Probability (Search for Journal in Brave)

Full work available at URL: https://doi.org/10.2307/1426437

zbMATH Keywords

average cost criterionregenerative stochastic processcontinuous time parameterM/M/1 queueing modelcomputation of optimal control parametersexistence of stationary average optimal policieslimit point of discounted optimal policiesmaintenance replacementMarkov decision drift processes

Mathematics Subject Classification ID

Queueing theory (aspects of probability theory) (60K25) Queues and service in operations research (90B22) Reliability, availability, maintenance, inspection in operations research (90B25) Markov and semi-Markov decision processes (90C40)

Related Items

Integro-differential equations associated with optimal stopping time of a piecewise-deterministic process, Impulsive control for continuous-time Markov decision processes: a linear programming approach, Optimal control of Markov processes with age-dependent transition rates, Impulse control of piecewise-deterministic processes, Continuous time shock markov decision processes with discounted criterion, Explicit solution of the average-cost optimality equation for a pest-control problem, An Overview for Markov Decision Processes in Queues and Networks, Optimal control problem regularization for the Markov process with finite number of states and constraints, Discrete type shock semi-markov decision processes with borel state space, Convex stochastic fluid programs with average cost., Unnamed Item, Impulsive Control for Continuous-Time Markov Decision Processes, Infinite horizon optimal impulsive control with applications to Internet congestion control, Optimal control of stochastic hybrid system with jumps: a numerical approximation, A condition based maintenance model for a two-unit series system