Note on discounted continuous-time Markov decision processes with a lower bounding function

DOI10.1017/jpr.2017.53zbMath1405.90136arXiv1612.00744OpenAlexW2962888089MaRDI QIDQ4684909

Xin Guo, Yi Zhang, Aleksey B. Piunovskiy

Publication date: 26 September 2018

Published in: Journal of Applied Probability (Search for Journal in Brave)

Full work available at URL: https://arxiv.org/abs/1612.00744

zbMATH Keywords

continuous-time Markov decision processdiscounted criterion

Mathematics Subject Classification ID

Continuous-time Markov processes on general state spaces (60J25) Markov and semi-Markov decision processes (90C40)

Cites Work

• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Conditions for the solvability of the linear programming formulation for constrained discounted Markov decision processes
• Kolmogorov forward equation and explosiveness in countable state Markov processes
• A linear programming formulation for constrained discounted continuous control for piecewise deterministic Markov processes
• Constrained total undiscounted continuous-time Markov decision processes
• Markov decision processes with applications to finance.
• Discounted dynamic programming with unbounded returns: application to economic models
• Stochastic games with unbounded payoffs: applications to robust control in economics
• Optimal growth models with bounded or unbounded returns: A unifying approach
• Nonhomogeneous Markov processes
• Continuous-time Markov decision processes. Theory and applications
• Continuous-time Markov chains. An applications-oriented approach
• On solutions of Kolmogorov's equations for nonhomogeneous jump Markov processes
• Finite state continuous time Markov decision processes with an infinite planning horizon
• Countable state Markov decision processes with unbounded jump rates and discounted cost: optimality equation and approximations
• The Expected Total Cost Criterion for Markov Decision Processes under Constraints
• Splitting Randomized Stationary Policies in Total-Reward Markov Decision Processes
• Selected Topics on Continuous-Time Controlled Markov Chains and Markov Games
• Discounted Continuous-Time Markov Decision Processes with Unbounded Rates: The Convex Analytic Approach
• The Expected Total Cost Criterion for Markov Decision Processes under Constraints: A Convex Analytic Approach
• Randomized and Relaxed Strategies in Continuous-Time Markov Decision Processes
• Practical Criterion for Uniqueness of $Q$-processes
• Multivariate point processes: predictable projection, Radon-Nikodym derivatives, representation of martingales
• Reduction of Discounted Continuous-Time MDPs with Unbounded Jump and Reward Rates to Discrete-Time Total-Reward MDPs
• Error bounds for rolling horizon policies in discrete-time Markov control processes
• COUNTABLE STATE MARKOV PROCESSES: NON-EXPLOSIVENESS AND MOMENT FUNCTION
• Continuous-Time Markov Decision Processes with Discounted Rewards: The Case of Polish Spaces
• Uniqueness criteria for continuous-time Markov chains with general transition structures
• Discrete Dynamic Programming with Sensitive Discount Optimality Criteria
• Markov Decision Processes with Finite State and Decision Spaces
• Continuous Time Discounted Jump Markov Decision Processes: A Discrete-Event Approach

This page was built for publication: Note on discounted continuous-time Markov decision processes with a lower bounding function