Technical Note—Identifying Forecast Horizons in Nonhomogeneous Markov Decision Processes

DOI10.1287/opre.37.2.339zbMath0679.90092OpenAlexW2073103075MaRDI QIDQ4729637

Wallace J. Hopp

Publication date: 1989

Published in: Operations Research (Search for Journal in Brave)

Full work available at URL: https://doi.org/10.1287/opre.37.2.339

zbMATH Keywords

nonhomogeneous Markov decision processesforecast horizonsepsilon optimalityKarkov finite staterelative value functions

Mathematics Subject Classification ID

Dynamic programming (90C39) Markov and semi-Markov decision processes (90C40)

Related Items

Conditions for the discovery of solution horizons ⋮ Sensitivity analysis in discrete dynamic programming ⋮ A forecast horizon and a stopping rule for general Markov decision processes ⋮ Dual Ascent and Primal-Dual Algorithms for Infinite-Horizon Nonstationary Markov Decision Processes ⋮ A model for equipment replacement due to technological obsolescence ⋮ Resource-constrained management of heterogeneous assets with stochastic deterioration ⋮ Denumerable state nonhomogeneous Markov decision processes ⋮ The infinite horizon non-stationary stochastic inventory problem: Near myopic policies and weak ergodicity