The transformation method for continuous-time Markov decision processes
type: Item
instance of: scholarly article
title: The transformation method for continuous-time Markov decision processes
zbMATH Open document ID: 1256.90048
author: Yi Zhang
author: A. B. Piunovskiy
published in: Journal of Optimization Theory and Applications
publication date: 2013-02-11T00:00:00Z
Mathematics Subject Classification ID: 90C40
zbMATH DE Number: 6135552
zbMATH Keywords: discrete-time Markov decision process
zbMATH Keywords: continuous-time Markov decision process
zbMATH Keywords: unbounded transition rates
zbMATH Keywords: transformation method
zbMATH Keywords: history-dependent policies
MaRDI profile type: Publication
full work available at URL: s10957-012-0015-8
OpenAlex ID: W1984329922
cites work: A survey of recent results on continuous-time Markov decision processes (with comments and rejoinder)
cites work: Discounted Continuous-Time Markov Decision Processes with Constraints: Unbounded Transition and Loss Rates
cites work: Discounted Continuous-Time Markov Decision Processes with Unbounded Rates: The Convex Analytic Approach
cites work: Continuous Time Discounted Jump Markov Decision Processes: A Discrete-Event Approach
cites work: Q4315289
cites work: Technical Note—An Equivalence Between Continuous and Discrete Time Markov Decision Processes
cites work: CTMDP and its relationship with DTMDP
cites work: Continuous-time Markov decision processes. Theory and applications
cites work: Denumerable-state continuous-time Markov decision processes with unbounded transition and reward rates under the discounted criterion
cites work: Continuous-Time Markov Decision Processes with Discounted Rewards: The Case of Polish Spaces
cites work: Semi-Markov and Jump Markov Controlled Models: Average Cost Criterion
cites work: Multivariate point processes: predictable projection, Radon-Nikodym derivatives, representation of martingales
cites work: Q4331806
cites work: Stochastic optimal control. The discrete time case
cites work: Average Optimality in Markov Control Processes via Discounted-Cost Problems and Linear Programming
cites work: The optimal reward operator in dynamic programming
cites work: Q4377607
cites work: Q4547438
cites work: Stationary policies and Markov policies in Borel dynamic programming
cites work: Q4255598
cites work: Q3912356
cites work: Continuous-time Markov chains. An applications-oriented approach
cites work: Continuous-Time Markov Decision Processes with Unbounded Transition and Discounted-Reward Rates
cites work: Asymptotic Fluid Optimality and Efficiency of the Tracking Policy for Bandwidth-Sharing Networks
cites work: Accuracy of fluid approximations to controlled birth-and-death processes: absorbing case
cites work: Death and discounting
cites work: Q5599448
DOI: 10.1007/S10957-012-0015-8
description: scientific article; zbMATH DE number 6135552