Continuous-time Markov decision processes with state-dependent discount factors
From MaRDI portal
Publication:693162
DOI10.1007/s10440-012-9669-3zbMath1281.90082OpenAlexW2023432628MaRDI QIDQ693162
Publication date: 7 December 2012
Published in: Acta Applicandae Mathematicae (Search for Journal in Brave)
Full work available at URL: https://doi.org/10.1007/s10440-012-9669-3
dynamic programmingexplicit expressioncontinuous-time Markov decision processesexplicit and exact solutionstate-dependent discount factor
Markov and semi-Markov decision processes (90C40) Continuous-time Markov processes on discrete state spaces (60J27)
Related Items (5)
Asymptotic optimality and rates of convergence of quantized stationary policies in continuous-time Markov decision processes ⋮ Finite-horizon optimality for continuous-time Markov decision processes with unbounded transition rates ⋮ Unnamed Item ⋮ On the First Passage $g$-Mean-Variance Optimality for Discounted Continuous-Time Markov Decision Processes ⋮ Zero-sum semi-Markov games with state-action-dependent discount factors
Cites Work
- Unnamed Item
- Unnamed Item
- Unnamed Item
- Unnamed Item
- Discounted continuous-time constrained Markov decision processes in Polish spaces
- Existence and regularity of a nonhomogeneous transition matrix under measurability conditions
- Markov decision processes with exponentially representable discounting
- Continuous-time Markov decision processes. Theory and applications
- Continuous time control of Markov processes on an arbitrary state space: Discounted rewards
- Continuous-time controlled Markov chains.
- Construction and regularity of transition functions on Polish spaces under measurability conditions
- Markov control processes with randomized discounted cost
- New discount and average optimality conditions for continuous-time Markov decision processes
- Conditions for optimality in dynamic programming and for the limit of n-stage optimal policies to be optimal
- Markov Decision Models with Weighted Discounted Criteria
- Constrained dynamic programming with two discount factors: applications and an algorithm
- Average Optimality in Markov Control Processes via Discounted-Cost Problems and Linear Programming
- Constrained Optimization for Average Cost Continuous-Time Markov Decision Processes
- Continuous-Time Markov Decision Processes with Discounted Rewards: The Case of Polish Spaces
- Continuously Discounted Markov Decision Model with Countable State and Action Space
- Continuous Time Discounted Jump Markov Decision Processes: A Discrete-Event Approach
This page was built for publication: Continuous-time Markov decision processes with state-dependent discount factors