Optimal control-limit strategies for a partially observed replacement problem†

DOI10.1080/00207727908941584zbMath0399.93048OpenAlexW2069065005MaRDI QIDQ4184723

Chelsea C. III White

Publication date: 1979

Published in: International Journal of Systems Science (Search for Journal in Brave)

Full work available at URL: https://doi.org/10.1080/00207727908941584

Mathematics Subject Classification ID

Estimation and detection in stochastic control theory (93E10) Optimal stochastic control (93E20)

Related Items

Policy structure for discrete time Markov chain disorder problems ⋮ Structural results for partially observed control models ⋮ A survey of algorithmic methods for partially observed Markov decision processes ⋮ On the average cost optimality equation and the structure of optimal policies for partially observable Markov decision processes ⋮ On-line parameter estimation for a failure-prone system subject to condition monitoring ⋮ An efficient heuristic for a partially observable Markov decision process of machine replacement ⋮ Control limits for two-state partially observable Markov decision processes ⋮ Monotone control laws for noisy, countable-state Markov chains ⋮ A Multi-Stage Two-Machines Replacement Strategy Using Mixture Models, Bayesian Inference, and Stochastic Dynamic Programming ⋮ Filters and parameter estimation for a partially observable system subject to random failure with continuous-range observations ⋮ Optimal condition based maintenance with imperfect information and the proportional hazards model ⋮ Optimally maintaining a multi-state system with limited imperfect preventive repairs ⋮ Monotonicity properties for two-action partially observable Markov decision processes on partially ordered spaces ⋮ A simple suboptimal algorithm for system maintance under partial observability ⋮ Optimizing active surveillance for prostate cancer using partially observable Markov decision processes

Cites Work

• Optimal maintenance and replacement via a semi-Markov decision model
• On the Optimality of Structured Policies in Countable Stage Decision Processes
• The Optimal Control of Partially Observable Markov Processes over a Finite Horizon
• Optimal Replacement Rules when Changes of State are Semi-Markovian