Structural Results for Partially Observable Markov Decision Processes

DOI10.1287/opre.27.5.1041zbMath0433.90083OpenAlexW2032509103MaRDI QIDQ3872232

S. Christian Albright

Publication date: 1979

Published in: Operations Research (Search for Journal in Brave)

Full work available at URL: https://doi.org/10.1287/opre.27.5.1041

zbMATH Keywords

applicationssupermodularitymaintenanceBayes theoremadvertisingpartially observable Markov decision processesstructural resultsisotone differencespartially ordered action spacetwo-state problems

Mathematics Subject Classification ID

Minimax problems in mathematical programming (90C47) Reliability, availability, maintenance, inspection in operations research (90B25) Markov and semi-Markov decision processes (90C40) Operations research and management science (90B99)

Related Items (14)

A model of project evaluation with limited attention ⋮ Structural results for partially observed control models ⋮ A two-state partially observable Markov decision process with three actions ⋮ On the average cost optimality equation and the structure of optimal policies for partially observable Markov decision processes ⋮ On the computation of the optimal cost function for discrete time Markov models with partial observations ⋮ Control limits for two-state partially observable Markov decision processes ⋮ Computation of approximate optimal policies in a partially observed inventory model with rain checks ⋮ On two-state quality control under Markovian deterioration ⋮ A Multi-Stage Two-Machines Replacement Strategy Using Mixture Models, Bayesian Inference, and Stochastic Dynamic Programming ⋮ Monotonicity properties for two-action partially observable Markov decision processes on partially ordered spaces ⋮ A simple suboptimal algorithm for system maintance under partial observability ⋮ A transformation method for stochastic control problems with partial observations ⋮ Optimizing active surveillance for prostate cancer using partially observable Markov decision processes ⋮ Optimal cost and policy for a Markovian replacement problem

This page was built for publication: Structural Results for Partially Observable Markov Decision Processes