Survey of linear programming for standard and nonstandard Markovian control problems. Part II: Applications

DOI10.1007/BF01432805zbMath0826.90121OpenAlexW2030238818MaRDI QIDQ4698111

Lodewijk C. M. Kallenberg

Publication date: 23 November 1995

Published in: [https://portal.mardi4nfdi.de/entity/Q4289815 ZOR Zeitschrift f�r Operations Research Mathematical Methods of Operations Research] (Search for Journal in Brave)

Full work available at URL: https://doi.org/10.1007/bf01432805

zbMATH Keywords

optimal stoppingmulti-armed banditMarkov decision modelsreplacement models

Mathematics Subject Classification ID

Linear programming (90C05) Markov and semi-Markov decision processes (90C40) Research exposition (monographs, survey articles) pertaining to operations research and mathematical programming (90-02)

Related Items (1)

Derman's book as inspiration: some results on LP for MDPs

Cites Work

• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Separable Markovian decision problems. The linear programming method in the multichain case
• On the Gittins index for multiarmed bandits
• Extensions of the multiarmed bandit problem: The discounted case
• Linear Programming for Finite State Multi-Armed Bandit Problems
• A Note on M. N. Katehakis' and Y.-R. Chen's Computation of the Gittins Index
• The Multi-Armed Bandit Problem: Decomposition and Computation
• Myopic Solutions of Markov Decision Processes and Stochastic Games
• Survey of linear programming for standard and nonstandard Markovian control problems. Part I: Theory
• Linear Programming Solutions for Separable Markovian Decision Problems
• Separable Markovian Decision Problems

This page was built for publication: Survey of linear programming for standard and nonstandard Markovian control problems. Part II: Applications