Survey of linear programming for standard and nonstandard Markovian control problems. Part I: Theory
From MaRDI portal
Publication:4304579
DOI10.1007/BF01414028zbMath0810.90133OpenAlexW1995985801MaRDI QIDQ4304579
Publication date: 13 October 1994
Published in: ZOR - Methods and Models of Operations Research (Search for Journal in Brave)
Full work available at URL: https://doi.org/10.1007/bf01414028
Linear programming (90C05) Stochastic games, stochastic differential games (91A15) Markov and semi-Markov decision processes (90C40)
Related Items (10)
Selecting malaria interventions: a top-down approach ⋮ Algebraic optimization of sequential decision problems ⋮ Geometry and convergence of natural policy gradient methods ⋮ Finding the \(K\) best policies in a finite-horizon Markov decision process ⋮ The LP approach in average reward MDPs with multiple cost constraints: The countable state case ⋮ Constrained cost-coupled stochastic games with independent state processes ⋮ Multiobjective Stopping Problem for Discrete-Time Markov Processes: Convex Analytic Approach ⋮ Survey of linear programming for standard and nonstandard Markovian control problems. Part II: Applications ⋮ Optimal M-Switch Surveillance Policies for Liver Cancer in a Hepatitis C–Infected Population ⋮ Zero-sum constrained stochastic games with independent state processes
Cites Work
- Unnamed Item
- Unnamed Item
- Unnamed Item
- Unnamed Item
- Unnamed Item
- Unnamed Item
- Unnamed Item
- Unnamed Item
- Unnamed Item
- Unnamed Item
- Unnamed Item
- Unnamed Item
- Unnamed Item
- Sensitivity analysis in discounted Markovian decision problems
- Maximal mean/standard deviation ratio in an undiscounted MDP
- Optimal policies for controlled Markov chains with a constraint
- Linear programming formulations of Markov decision processes
- A variance minimization problem for a Markov decision process
- On efficiency of linear programming applied to discounted Markovian decision problems
- Communicating MDPs: Equivalence and LP properties
- An orderfield property for stochastic games when one player controls transition probabilities
- Linear programming and undiscounted stochastic games in which one player controls transitions
- Mean, variance and probabilistic criteria in finite Markov decision processes: A review
- Linear programming considerations on Markovian decision processes with no discounting
- Finite state Markovian decision processes
- Linear Programming and Sequential Decisions
- Transient policies in discrete dynamic programming: Linear programming including suboptimality tests and additional constraints
- Constrained Undiscounted Stochastic Dynamic Programming
- Time-average optimal constrained semi-Markov decision processes
- Variance-Penalized Markov Decision Processes
- Linear Programming and Markov Decision Chains
- Optimality in transient markov chains and linear programming
- Algorithms for stochastic games ? A survey
- Discounted semi-Markov decision processes: linear programming and policy iteration
- Solving stochastic dynamic programming problems by linear programming — An annotated bibliography
- On Stochastic Games with Stationary Optimal Strategies
- On the Convergence of Policy Iteration in Stationary Dynamic Programming
- On Finding Optimal Policies for Markov Decision Chains: A Unifying Framework for Mean-Variance-Tradeoffs
- Discrete Dynamic Programming
- Some Remarks on Finite Horizon Markovian Decision Models
- A Note on Memoryless Rules for Controlling Sequential Control Processes
- On Finding Optimal Policies in Discrete Dynamic Programming with No Discounting
- Contraction Mappings in the Theory Underlying Dynamic Programming
- An Optimality Condition for Discrete Dynamic Programming with no Discounting
- Discrete Dynamic Programming with a Small Interest Rate
- Discrete Dynamic Programming with Sensitive Discount Optimality Criteria
- On Linear Programming in a Markov Decision Problem
- Computing a Bias-Optimal Policy in a Discrete-Time Markov Decision Problem
- Multichain Markov Renewal Programs
- Linear Programming Solutions for Separable Markovian Decision Problems
- Constrained Markov Decision Chains
- Stochastic Games
- Stochastic games
This page was built for publication: Survey of linear programming for standard and nonstandard Markovian control problems. Part I: Theory
