Optimal adaptive control of priority assignment in queueing systems

DOI10.1016/S0167-6911(84)80053-5zbMath0529.90045OpenAlexW2010073541MaRDI QIDQ787850

Steven I. Marcus, Onésimo Hernández-Lerma

Publication date: 1984

Published in: Systems \& Control Letters (Search for Journal in Brave)

Full work available at URL: https://doi.org/10.1016/s0167-6911(84)80053-5

zbMATH Keywords

parameter estimationadaptive controlqueueing systemsemi-Markov decision processespriority assignmentaverage cost criteriondynamic scheduling problemnaive feedback controlleroptimal adaptive policyunknown arrivalunknown service rateswork-conserving policies

Mathematics Subject Classification ID

Queueing theory (aspects of probability theory) (60K25) Queues and service in operations research (90B22) Markov and semi-Markov decision processes (90C40)

Related Items (7)

Finite-state approximations for denumerable multidimensional state discounted Markov decision processes ⋮ Adaptive policies for discrete-time stochastic control systems with unknown disturbance distribution ⋮ Ergodic and adaptive control of nearest-neighbor motions ⋮ Analysis of an identification algorithm arising in the adaptive estimation of Markov chains ⋮ Unnamed Item ⋮ Adaptive control of service in queueing systems ⋮ Adaptive control of discounted Markov decision chains

Cites Work

• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Adaptive control of service in queueing systems
• Dynamic programming and stochastic control
• Denumerable state semi-Markov decision processes with unbounded costs, average cost criterion
• Adaptive queueing systems controlled by linear-strategy automata
• The average-optimal adaptive control of a Markov renewal model in presence of an unknown parameter
• Priority assignment using dynamic programming for a class of queueing systems
• Stochastic control of two partially observed competing queues
• On Dynamic Programming with Unbounded Rewards
• Time-Sharing Service Systems. I
• Estimation and control in Markov chains
• Average cost semi-markov decision processes
• Work-conserving priorities
• Embedded renewal processes in the GI/G/s queue
• Regenerative processes in the theory of queues, with applications to the alternating-priority queue

This page was built for publication: Optimal adaptive control of priority assignment in queueing systems