Linear Programming and Constrained Average Optimality for General Continuous-Time Markov Decision Processes in History-Dependent Policies
From MaRDI portal
Publication:2884585
DOI10.1137/100805169zbMath1250.90108OpenAlexW1989510286MaRDI QIDQ2884585
Xianping Guo, Xin-Yuan Song, Yong-hui Huang
Publication date: 30 May 2012
Published in: SIAM Journal on Control and Optimization (Search for Journal in Brave)
Full work available at URL: https://doi.org/10.1137/100805169
linear programunbounded transition ratecontinuous-time Markov processconstrained optimal policydual programaverage criterion
Markov and semi-Markov decision processes (90C40) Continuous-time Markov processes on discrete state spaces (60J27)
Related Items (20)
Continuous-time zero-sum games for markov decision processes with discounted risk-sensitive cost criterion on a general state space ⋮ Finite horizon continuous-time Markov decision processes with mean and variance criteria ⋮ Risk-sensitive discounted cost criterion for continuous-time Markov decision processes on a general state space ⋮ Constrained continuous-time Markov decision processes on the finite horizon ⋮ Finite-horizon piecewise deterministic Markov decision processes with unbounded transition rates ⋮ Risk-sensitive continuous-time Markov decision processes with unbounded rates and Borel spaces ⋮ Average cost criterion induced by the regular utility function for continuous-time Markov decision processes ⋮ The risk probability criterion for discounted continuous-time Markov decision processes ⋮ Continuous-time Markov decision processes under the risk-sensitive first passage discounted cost criterion ⋮ Discounted continuous-time Markov decision processes with unbounded rates and randomized history-dependent policies: the dynamic programming approach ⋮ Risk-sensitive average continuous-time Markov decision processes with unbounded rates ⋮ Stochastic games for continuous-time jump processes under finite-horizon payoff criterion ⋮ Nonzero-sum games for continuous-time jump processes under the expected average payoff criterion ⋮ Finite-horizon optimality for continuous-time Markov decision processes with unbounded transition rates ⋮ Constrained expected average stochastic games for continuous-time jump processes ⋮ Constrained semi-Markov decision processes with ratio and time expected average criteria in Polish spaces ⋮ Risk-Sensitive Discounted Continuous-Time Markov Decision Processes with Unbounded Rates ⋮ Optimality of Mixed Policies for Average Continuous-Time Markov Decision Processes with Constraints ⋮ Absorbing Continuous-Time Markov Decision Processes with Total Cost Criteria ⋮ Average optimality for continuous-time Markov decision processes under weak continuity conditions
This page was built for publication: Linear Programming and Constrained Average Optimality for General Continuous-Time Markov Decision Processes in History-Dependent Policies