A survey of recent results on continuous-time Markov decision processes (with comments and rejoinder)
type: Item
instance of: scholarly article
title: A survey of recent results on continuous-time Markov decision processes (with comments and rejoinder)
zbMATH Open document ID: 1278.90427
DOI: 10.1007/BF02837562
author: Xianping Guo
author: Onésimo Hernández-Lerma
author: Tomás Prieto-Rumeau
published in: Top
publication date: 2007-08-08T00:00:00Z
Mathematics Subject Classification ID: 90C40
Mathematics Subject Classification ID: 93E20
Mathematics Subject Classification ID: 60J27
zbMATH DE Number: 5178054
zbMATH Keywords: continuous-time Markov decision processes
zbMATH Keywords: controlled Markov chains
zbMATH Keywords: unbounded reward
zbMATH Keywords: transition rates
zbMATH Keywords: discounted reward
zbMATH Keywords: average reward
zbMATH Keywords: bias optimality
zbMATH Keywords: sensitive discount criteria
MaRDI profile type: Publication
cites work: A birth–death model of advertising and pricing
cites work: Q3068202
cites work: Continuous-time Markov chains. An applications-oriented approach
cites work: Q4101645
cites work: Q4404220
cites work: Q3241581
cites work: Q5722776
cites work: Q3376697
cites work: Discrete Dynamic Programming
cites work: Basic ideas for event-based optimization of Markov systems
cites work: Average, Sensitive and Blackwell Optimal Policies in Denumerable Markov Decision Chains with Unbounded Rewards
cites work: Recurrence Conditions for Average and Blackwell Optimality in Denumerable State Markov Decision Chains
cites work: Continuous time control of Markov processes on an arbitrary state space: Discounted rewards
cites work: Q3237805
cites work: Handbook of Markov decision processes. Methods and applications
cites work: On the Integro-Differential Equations of Purely Discontinuous Markoff Processes
cites work: On Recurrent Denumerable Decision Processes
cites work: Optimal Control of Ergodic Continuous-Time Markov Chains with Average Sample-Path Rewards
cites work: Continuous-time controlled Markov chains.
cites work: Continuous-time controlled Markov chains with discounted rewards
cites work: Drift and monotonicity conditions for continuous-time controlled markov chains with an average criterion
cites work: Zero-sum games for continuous-time Markov chains with unbounded transition and average payoff rates
cites work: Nonzero-sum games for continuous-time Markov chains with unbounded discounted payoffs
cites work: Zero-sum continuous-time Markov games with unbounded transition and discounted payoff rates
cites work: A note on optimality conditions for continuous-time Markov decision processes with average cost criterion
cites work: Average optimality for continuous-time Markov decision processes in Polish spaces
cites work: Denumerable-state continuous-time Markov decision processes with unbounded transition and reward rates under the discounted criterion
cites work: Q4534402
cites work: Bias Optimality in Controlled Queueing Systems
cites work: Q4891056
cites work: Nonstationary continuous-time Markov control processes with discounted costs on infinite horizon
cites work: Q4863593
cites work: Q4255598
cites work: The scalarization approach to multiobjective Markov control problems: \textit{Why} does it work?
cites work: Bias optimality versus strong 0-discount optimality in Markov control processes with unbounded costs
cites work: Blackwell optimality in the class of stationary policies in Markov decision chains with a Borel state space and unbounded rewards
cites work: Blackwell optimality in the class of all policies in Markov decision chains with a Borel state space and unbounded rewards
cites work: Q4547440
cites work: Q3266141
cites work: Discounted and average Markov decision processes with unbounded rewards: New conditions
cites work: Continuous time Markov decision processes with discounted moment criterion
cites work: Q5678706
cites work: On the Equivalence of Two Expected Average Cost Criteria for Semi-Markov Control Processes
cites work: Continuously Discounted Markov Decision Model with Countable State and Action Space
cites work: Nondiscounted Continuous Time Markovian Decision Process with Countable State Space
cites work: Continuous time Markovian decision processes average return criterion
cites work: Relation between continuous and discrete time markovian decision problems
cites work: Q5526485
cites work: Semi-Markov and Jump Markov Controlled Models: Average Cost Criterion
cites work: Conditions for existence of average and Blackwell optimal stationary policies in denumerable Markov decision processes
cites work: Optimal control of the simple stochastic epidemic with variable recovery rates
cites work: Optimal Control of a Birth and Death Epidemic Process
cites work: Overtaking and Almost-Sure Optimality for Infinite Horizon Markov Decision Processes
cites work: On maximal rewards and \(\varepsilon\)-optimal policies in continuous time Markov decision chains
cites work: BIAS OPTIMALITY IN A QUEUE WITH ADMISSION CONTROL
cites work: Bias optimal admission control policies for a multiclass nonstationary queueing system
cites work: A note on bias optimality in controlled queueing systems

A survey of recent results on continuous-time Markov decision processes (with comments and rejoinder) (cites work)
cites work: A probabilistic analysis of bias optimality in unichain Markov decision processes

A survey of recent results on continuous-time Markov decision processes (with comments and rejoinder) (cites work)
cites work: Applying a New Device in the Optimization of Exponential Queuing Systems

A survey of recent results on continuous-time Markov decision processes (with comments and rejoinder) (cites work)
cites work: Computable exponential convergence rates for stochastically ordered Markov processes

A survey of recent results on continuous-time Markov decision processes (with comments and rejoinder) (cites work)
cites work: Decision and control in uncertain resource systems

A survey of recent results on continuous-time Markov decision processes (with comments and rejoinder) (cites work)
cites work: Stability of Markovian processes III: Foster–Lyapunov criteria for continuous-time processes

A survey of recent results on continuous-time Markov decision processes (with comments and rejoinder) (cites work)
cites work: Finite state continuous time Markov decision processes with an infinite planning horizon

A survey of recent results on continuous-time Markov decision processes (with comments and rejoinder) (cites work)
cites work: Discrete Dynamic Programming with a Small Interest Rate

A survey of recent results on continuous-time Markov decision processes (with comments and rejoinder) (cites work)
cites work: Multicriteria impulsive control of jump Markov processes

A survey of recent results on continuous-time Markov decision processes (with comments and rejoinder) (cites work)
cites work: Blackwell optimality in the class of Markov policies for continuous-time controlled Markov chains

A survey of recent results on continuous-time Markov decision processes (with comments and rejoinder) (cites work)
cites work: The Laurent series, sensitive discount and Blackwell optimality for continuous-time controlled Markov chains

A survey of recent results on continuous-time Markov decision processes (with comments and rejoinder) (cites work)
cites work: Bias and overtaking equilibria for zero-sum continuous-time Markov games

A survey of recent results on continuous-time Markov decision processes (with comments and rejoinder) (cites work)
cites work: Bias Optimality for Continuous-Time Controlled Markov Chains

A survey of recent results on continuous-time Markov decision processes (with comments and rejoinder) (cites work)
cites work: Ergodic Control of Continuous-Time Markov Chains with Pathwise Constraints

A survey of recent results on continuous-time Markov decision processes (with comments and rejoinder) (cites work)
cites work: Variance minimization and the overtaking optimality approach to continuous-time controlled Markov chains

A survey of recent results on continuous-time Markov decision processes (with comments and rejoinder) (cites work)
cites work: Sensitive discount optimality in controlled one-dimensional diffusions

A survey of recent results on continuous-time Markov decision processes (with comments and rejoinder) (cites work)
cites work: Q5615108

A survey of recent results on continuous-time Markov decision processes (with comments and rejoinder) (cites work)
cites work: Markov Decision Processes with Finite State and Decision Spaces

A survey of recent results on continuous-time Markov decision processes (with comments and rejoinder) (cites work)
cites work: On the Second Optimality Equation for Semi-Markov Decision Models

A survey of recent results on continuous-time Markov decision processes (with comments and rejoinder) (cites work)
cites work: Q4223191

A survey of recent results on continuous-time Markov decision processes (with comments and rejoinder) (cites work)
cites work: Technical Note—An Equivalence Between Continuous and Discrete Time Markov Decision Processes

A survey of recent results on continuous-time Markov decision processes (with comments and rejoinder) (cites work)
cites work: Optimal design and control of queues

A survey of recent results on continuous-time Markov decision processes (with comments and rejoinder) (cites work)
cites work: Q4143989

A survey of recent results on continuous-time Markov decision processes (with comments and rejoinder) (cites work)
cites work: On Finding Optimal Policies in Discrete Dynamic Programming with No Discounting

A survey of recent results on continuous-time Markov decision processes (with comments and rejoinder) (cites work)
cites work: Discrete Dynamic Programming with Sensitive Discount Optimality Criteria

A survey of recent results on continuous-time Markov decision processes (with comments and rejoinder) (cites work)
cites work: Mathematical models for the control of pests and infectious diseases: A survey

A survey of recent results on continuous-time Markov decision processes (with comments and rejoinder) (cites work)
cites work: Q4391895

A survey of recent results on continuous-time Markov decision processes (with comments and rejoinder) (cites work)
cites work: Q3874718

A survey of recent results on continuous-time Markov decision processes (with comments and rejoinder) (cites work)
cites work: On a Class of Strategies in General Markov Decision Models

A survey of recent results on continuous-time Markov decision processes (with comments and rejoinder) (cites work)
cites work: Controlled Markov Models with Countable State Space and Continuous Time

A survey of recent results on continuous-time Markov decision processes (with comments and rejoinder) (cites work)
cites work: Blackwell optimal policies in a Markov decision process with a Borel state space

A survey of recent results on continuous-time Markov decision processes (with comments and rejoinder) (cites work)
cites work: Blackwell Optimality in Borelian Continuous-in-Action Markov Decision Processes

A survey of recent results on continuous-time Markov decision processes (with comments and rejoinder) (cites work)
cites work: On Homogeneous Markov Models with Continuous Time and Finite or Countable State Space

A survey of recent results on continuous-time Markov decision processes (with comments and rejoinder) (Recommended article)
Recommended article: Continuous-time Markov decision processes. Theory and applications
Similarity Score: 0.9300134
Recommender Run: Recommender Run 2

A survey of recent results on continuous-time Markov decision processes (with comments and rejoinder) (Recommended article)
Recommended article: Continuous-time markov decision processes with nonzero terminal reward
Similarity Score: 0.8988917
Recommender Run: Recommender Run 2

A survey of recent results on continuous-time Markov decision processes (with comments and rejoinder) (Recommended article)
Recommended article: A Survey of Applications of Markov Decision Processes
Similarity Score: 0.89814925
Recommender Run: Recommender Run 2

A survey of recent results on continuous-time Markov decision processes (with comments and rejoinder) (Recommended article)
Recommended article: A survey on semi-Markov decision processes
Similarity Score: 0.8926476
Recommender Run: Recommender Run 2

A survey of recent results on continuous-time Markov decision processes (with comments and rejoinder) (Recommended article)
Recommended article: Continuous-Time Markov Decision Processes with Unbounded Transition and Discounted-Reward Rates
Similarity Score: 0.8922606
Recommender Run: Recommender Run 2

A survey of recent results on continuous-time Markov decision processes (with comments and rejoinder) (Recommended article)
Recommended article: Continuous-time Markov decision processes with \(n\)th-bias optimality criteria
Similarity Score: 0.8877279
Recommender Run: Recommender Run 2

A survey of recent results on continuous-time Markov decision processes (with comments and rejoinder) (Recommended article)
Recommended article: Q3812066
Similarity Score: 0.88718784
Recommender Run: Recommender Run 2

A survey of recent results on continuous-time Markov decision processes (with comments and rejoinder) (Recommended article)
Recommended article: Continuous time markov decision processes with nonuniformly bounded transition rate: expected total rewards
Similarity Score: 0.8866972
Recommender Run: Recommender Run 2