Optimal and suboptimal stationary controls for Markov chains

DOI10.1109/TAC.1978.1101742zbMath0382.93073MaRDI QIDQ4160811

Pravin P. Varaiya

Publication date: 1978

Published in: IEEE Transactions on Automatic Control (Search for Journal in Brave)

Mathematics Subject Classification ID

Stochastic systems and control (93E99) Markov chains (discrete-time Markov processes on discrete state spaces) (60J10)

Related Items (7)

New exactly solvable examples for controlled discrete-time Markov chains ⋮ Error bounds for stochastic shortest path problems ⋮ The average cost of Markov chains subject to total variation distance uncertainty ⋮ Criteria for selecting the relaxation factor of the value iteration algorithm for undiscounted Markov and semi-Markov decision processes ⋮ Optimal control of discrete time population processes ⋮ Optimal and near-optimal incentive strategies in the hierarchical control of Markov chains ⋮ Guaranteed approximation of Markov chains with applications to multiplexer engineering in ATM networks

This page was built for publication: Optimal and suboptimal stationary controls for Markov chains