Optimality of monotonic policies for two-action Markovian decision processes, with applications to control of queues with delayed information

DOI10.1007/BF01149165zbMath0859.90118MaRDI QIDQ1923636

Shaler jun. Stidham, Eitan Altman

Publication date: 25 November 1996

Published in: Queueing Systems (Search for Journal in Brave)

zbMATH Keywords

submodularityhigh-speed communication networksdelayed informationmonotone policiesdiscrete-time Markov decision processpartially ordered state spacesingle queueing facility

Mathematics Subject Classification ID

Markov and semi-Markov decision processes (90C40)

Related Items (11)

Discrete time queues with delayed information ⋮ A Verification Theorem for Threshold-Indexability of Real-State Discounted Restless Bandits ⋮ Dynamic priority allocation via restless bandit marginal productivity indices ⋮ An Overview for Markov Decision Processes in Queues and Networks ⋮ Admission and routing control with partial information and limited buffers ⋮ INDEXABILITY OF BANDIT PROBLEMS WITH RESPONSE DELAYS ⋮ ROUTING OF AIRPLANES TO TWO RUNWAYS: MONOTONICITY OF OPTIMAL CONTROLS ⋮ Cross docking for libraries with a depot ⋮ Unnamed Item ⋮ Delayed information and action in on-line algorithms ⋮ Near optimal admission control for multiserver loss queues in series

Cites Work

• Monotone control laws for noisy, countable-state Markov chains
• Monotone control of queueing networks
• A survey of Markov decision models for control of networks of queues
• Optimal control of admission to a quenching system
• Control of arrivals to a stochastic input–output system
• Optimal control of random walks, birth and death processes, and queues
• Conditions for optimality in dynamic programming and for the limit of n-stage optimal policies to be optimal
• A Classified Bibliography of Research on Optimal Design and Control of Queues
• Minimizing a Submodular Function on a Lattice
• Monotone Optimal Control of Permutable GSMPs
• Optimal control of service rates in networks of queues
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item

This page was built for publication: Optimality of monotonic policies for two-action Markovian decision processes, with applications to control of queues with delayed information