Coupling based estimation approaches for the average reward performance potential in Markov chains
type: Item
instance of: scholarly article
title: Coupling based estimation approaches for the average reward performance potential in Markov chains
zbMATH Open document ID: 1414.60061
author: Yunjiang Lou
author: Haoyao Chen
author: Jiangang Li
author: Yanjie Li
author: Xinyu Wu
published in: Automatica
publication date: 2018-10-17T00:00:00Z
Mathematics Subject Classification ID: 60J20
Mathematics Subject Classification ID: 93E10
zbMATH DE Number: 6957765
zbMATH Keywords: value function
zbMATH Keywords: performance potential
zbMATH Keywords: perturbation realization factor
zbMATH Keywords: estimation with geometric variance reduction
zbMATH Keywords: coupling techniques
MaRDI profile type: Publication
full work available at URL: j.automatica.2018.03.011
OpenAlex ID: W2794916412
cites work: Q5708419
cites work: Q4326384
cites work: Q4368722
cites work: Q5425954
cites work: Perturbation realization, potentials, and sensitivity analysis of Markov processes
cites work: Simulation-based algorithms for Markov decision processes.
cites work: CONVERGENCE OF SIMULATION-BASED POLICY ITERATION
cites work: Perturbation analysis via coupling
cites work: Regenerative structure of Markov chains simulated via common random numbers
cites work: Sequential Control Variates for Functionals of Markov Processes
cites work: A maximal coupling for Markov chains
cites work: Continuous-time Markov decision processes. Theory and applications
cites work: Sequential Monto Carlo techniques for the solution of linear systems
cites work: Q5732992
cites work: Performance analysis for controlled semi-Markov systems with application to maintenance
cites work: On Solving Event-Based Optimization With Average Reward Over Infinite Stages
cites work: Stability Analysis of A Class of Hybrid Stochastic Retarded Systems Under Asynchronous Switching
cites work: Adapative importance sampling on discrete Markov chains
cites work: A unified approach to time-aggregated Markov decision processes
cites work: A simple coupling of renewal processes
cites work: Simulation-based optimization of Markov reward processes
cites work: Q3093352
cites work: Q4335417
cites work: Q4315289
cites work: Error bounds of optimization algorithms for semi-Markov decision processes
cites work: Bivariate distributions with given marginals
cites work: Performance optimization of queueing systems with perturbation realization
cites work: Parameterized Markov decision process and its application to service rate control
Wikidata QID: Q130046852
DOI: 10.1016/J.AUTOMATICA.2018.03.011
description: scientific article; zbMATH DE number 6957765