Markov control processes with pathwise constraints
From MaRDI portal
Publication:992046
DOI10.1007/s00186-010-0311-8zbMath1196.93101OpenAlexW2158187943MaRDI QIDQ992046
Onésimo Hernández-Lerma, Armando Felipe Mendoza-Pérez
Publication date: 8 September 2010
Published in: Mathematical Methods of Operations Research (Search for Journal in Brave)
Full work available at URL: https://doi.org/10.1007/s00186-010-0311-8
constrained control problems(discrete-time) Markov control processesaverage reward criteriapathwise average reward
Optimal stochastic control (93E20) Markov and semi-Markov decision processes (90C40) Optimality conditions for problems involving randomness (49K45)
Related Items (9)
Policy iteration algorithms for zero-sum stochastic differential games with long-run average payoff criteria ⋮ Constrained Markov decision processes in Borel spaces: from discounted to average optimality ⋮ Asymptotic Normality of Discrete-Time Markov Control Processes ⋮ Constrained stochastic games with the average payoff criteria ⋮ Markov control processes with pathwise constraints ⋮ The Lagrange and the vanishing discount techniques to controlled diffusions with cost constraints ⋮ Constrained semi-Markov decision processes with ratio and time expected average criteria in Polish spaces ⋮ The Lagrange approach to ergodic control of diffusions with cost constraints ⋮ Variance-minimization of Markov control processes with pathwise constraints
Cites Work
- Unnamed Item
- Unnamed Item
- Unnamed Item
- Unnamed Item
- Markov chains and stochastic stability
- Markov control processes with pathwise constraints
- Application of average dynamic programming to inventory systems
- Dynamic principal agent model based on CMDP
- The average cost optimality equation: a fixed point approach
- Markov chains and invariant probabilities
- On constrained Markov decision processes
- Multichain Markov Decision Processes with a Sample Path Constraint: A Decomposition Approach
- Inequalities in Theorems of Ergodicity and Stability for Markov Chains with Common Phase Space. II
- Ergodic Control of Markov Chains with Constraints—the General Case
- Constrained Discounted Dynamic Programming
- Infinite-horizon Markov control processes with undiscounted cost criteria: from average to overtaking optimality
- Constrained Average Cost Markov Control Processes in Borel Spaces
- Sample path average optimality of Markov control processes with strictly unbounded cost
- MIMO Transmission Control in Fading Channels—A Constrained Markov Decision Process Formulation With Monotone Randomized Policies
- Markov Decision Processes with Sample Path Constraints: The Communicating Case
- Average cost Markov control processes with weighted norms: existence of canonical policies
- Sample-Path Optimality and Variance-Minimization of Average Cost Markov Control Processes
- Ergodic Control of Continuous-Time Markov Chains with Pathwise Constraints
- Stochastic finance. An introduction in discrete time
This page was built for publication: Markov control processes with pathwise constraints
