Continuous Time Discounted Jump Markov Decision Processes: A Discrete-Event Approach

DOI10.1287/moor.1040.0089zbMath1082.90126OpenAlexW2162378322MaRDI QIDQ5704186

Eugene A. Feinberg

Publication date: 11 November 2005

Published in: Mathematics of Operations Research (Search for Journal in Brave)

Full work available at URL: https://semanticscholar.org/paper/1271bf731a035254776ac688e9cc2f51f6151196

zbMATH Keywords

semi-Markov decision processcontinuous time jump Markov decision process

Mathematics Subject Classification ID

Multi-objective and goal programming (90C29) Discrete event control/observation systems (93C65) Markov and semi-Markov decision processes (90C40)

Related Items (40)

Continuous-time controlled Markov chains. ⋮ Kolmogorov's Equations for Jump Markov Processes and Their Applications to Control Problems ⋮ OPTIMALITY OF RANDOMIZED TRUNK RESERVATION FOR A PROBLEM WITH MULTIPLE CONSTRAINTS ⋮ Convergence of controlled models and finite-state approximation for discounted continuous-time Markov decision processes with constraints ⋮ Randomized and Relaxed Strategies in Continuous-Time Markov Decision Processes ⋮ Zero-sum continuous-time Markov games with unbounded transition and discounted payoff rates ⋮ Constrained continuous-time Markov decision processes on the finite horizon ⋮ Constrained optimality for finite horizon semi-Markov decision processes in Polish spaces ⋮ Sufficiency of Markov Policies for Continuous-Time Jump Markov Decision Processes ⋮ A useful technique for piecewise deterministic Markov decision processes ⋮ Gradual-Impulsive Control for Continuous-Time Markov Decision Processes with Total Undiscounted Costs and Constraints: Linear Programming Approach via a Reduction Method ⋮ Variance minimization for constrained discounted continuous-time MDPs with exponentially distributed stopping times ⋮ Scheduling Markovian PERT networks to maximize the net present value: new results ⋮ Asymptotic optimality and rates of convergence of quantized stationary policies in continuous-time Markov decision processes ⋮ The transformation method for continuous-time Markov decision processes ⋮ Continuous-Time Markov Decision Processes with Exponential Utility ⋮ Finite horizon semi-Markov decision processes with application to maintenance systems ⋮ Realizable Strategies in Continuous-Time Markov Decision Processes ⋮ Discounted continuous-time Markov decision processes with unbounded rates and randomized history-dependent policies: the dynamic programming approach ⋮ A linear programming formulation for constrained discounted continuous control for piecewise deterministic Markov processes ⋮ Customizing exponential semi-Markov decision processes under the discounted cost criterion ⋮ Continuous-time Markov decision processes with state-dependent discount factors ⋮ Towards the optimal control of Markov chains with constraints ⋮ On solutions of Kolmogorov's equations for nonhomogeneous jump Markov processes ⋮ Optimal risk probability for first passage models in semi-Markov decision processes ⋮ Variance minimization for continuous-time Markov decision processes: two approaches ⋮ Finite-horizon optimality for continuous-time Markov decision processes with unbounded transition rates ⋮ Note on discounted continuous-time Markov decision processes with a lower bounding function ⋮ Unnamed Item ⋮ New discount and average optimality conditions for continuous-time Markov decision processes ⋮ Continuous-Time Markov Decision Processes with Unbounded Transition and Discounted-Reward Rates ⋮ On Reducing a Constrained Gradual-Impulsive Control Problem for a Jump Markov Model to a Model with Gradual Control Only ⋮ Risk-Sensitive Discounted Continuous-Time Markov Decision Processes with Unbounded Rates ⋮ Optimality of randomized trunk reservation for a problem with a single constraint ⋮ First passage risk probability optimality for continuous time Markov decision processes ⋮ An Inequality for Variances of the Discounted Rewards ⋮ Optimality of Mixed Policies for Average Continuous-Time Markov Decision Processes with Constraints ⋮ Finite optimal control for time-bounded reachability in CTMDPs and continuous-time Markov games ⋮ On the First Passage $g$-Mean-Variance Optimality for Discounted Continuous-Time Markov Decision Processes ⋮ On essential information in sequential decision processes

This page was built for publication: Continuous Time Discounted Jump Markov Decision Processes: A Discrete-Event Approach