Average Optimality in Dynamic Programming with General State Space
From MaRDI portal
Publication:4697089
DOI10.1287/moor.18.1.163zbMath0777.90079OpenAlexW2030544250MaRDI QIDQ4697089
Publication date: 29 June 1993
Published in: Mathematics of Operations Research (Search for Journal in Brave)
Full work available at URL: https://doi.org/10.1287/moor.18.1.163
Related Items
Portfolio management under drawdown constraint in discrete-time financial markets ⋮ On the optimality equation for average cost Markov control processes with Feller transition probabilities ⋮ Optimal Control of Piecewise Deterministic Markov Processes ⋮ Approximate dynamic programming for stochastic linear control problems on compact state spaces ⋮ A note on risk-sensitive control of invariant models ⋮ STOCHASTIC SETUP-COST INVENTORY MODEL WITH BACKORDERS AND QUASICONVEX COST FUNCTIONS ⋮ Value iteration in average cost Markov control processes on Borel spaces ⋮ Average Cost Markov Decision Processes with Weakly Continuous Transition Probabilities ⋮ Controlled Markov processes on the infinite planning horizon: Weighted and overtaking cost criteria ⋮ Optimizing DoS attack energy with imperfect acknowledgments and energy harvesting constraints in cyber-physical systems ⋮ Hamilton-Jacobi-Bellman inequality for the average control of piecewise deterministic Markov processes ⋮ Markov Decision Processes with Incomplete Information and Semiuniform Feller Transition Probabilities ⋮ Robust Markov control processes ⋮ Examples concerning Abel and Cesàro limits ⋮ Continuity of discounted values and the structure of optimal policies for <scp>periodic‐review</scp> inventory systems with setup costs ⋮ Optimal transmission strategy for multiple Markovian fading channels: existence, structure, and approximation ⋮ Dual sourcing models with stock-out dependent substitution ⋮ A survey of average cost problems in deterministic discrete-time control systems ⋮ Short Communication: Existence of Markov Equilibrium Control in Discrete Time ⋮ Optimal sensor scheduling for remote state estimation with limited bandwidth: a deep reinforcement learning approach ⋮ Synthesis and Generalization of Structural Results in Inventory Management: A Generalized Convexity Property ⋮ Fatou's Lemma in Its Classical Form and Lebesgue's Convergence Theorems for Varying Measures with Applications to Markov Decision Processes ⋮ Mean field Markov decision processes ⋮ Average control of Markov decision processes with Feller transition probabilities and general action spaces ⋮ Average Cost Optimality Inequality for Markov Decision Processes with Borel Spaces and Universally Measurable Policies ⋮ Average optimality for risk-sensitive control with general state space ⋮ A note on the vanishing interest rate approach in average Markov decision chains with continuous and bounded costs ⋮ Another set of conditions for average optimality in Markov control processes ⋮ Average Cost Markov Decision Processes with Semi-Uniform Feller Transition Probabilities ⋮ Average optimality in dynamic programming on Borel spaces -- unbounded costs and controls ⋮ Optimal energy allocation for linear control with packet loss under energy harvesting constraints ⋮ Solutions of the average cost optimality equation for Markov decision processes with weakly continuous kernel: the fixed-point approach revisited ⋮ Ergodicity of filtering process by vanishing discount approach ⋮ Uniform Fatou's lemma ⋮ On the vanishing discount factor approach for Markov decision processes with weakly continuous transition probabilities ⋮ Convex stochastic fluid programs with average cost. ⋮ A Fixed Point Approach to Solve the Average Cost Optimality Equation for Semi-Markov Decision Processes with Feller Transition Probabilities ⋮ Stackelberg equilibrium in a dynamic stimulation model with complete information ⋮ Partially Observable Total-Cost Markov Decision Processes with Weakly Continuous Transition Probabilities ⋮ Entropic repulsion of Gaussian free field on high-dimensional Sierpinski carpet graphs ⋮ On the Minimum Pair Approach for Average Cost Markov Decision Processes with Countable Discrete Action Spaces and Strictly Unbounded Costs ⋮ MDPs with setwise continuous transition probabilities ⋮ Optimal battery purchasing and charging strategy at electric vehicle battery swap stations ⋮ On structural properties of optimal average cost functions in Markov decision processes with Borel spaces and universally measurable policies ⋮ Optimal strategies for an inventory system with cost functions of general form ⋮ Optimal Control of Brownian Inventory Models with Convex Holding Cost: Average Cost Case ⋮ On the reduction of total‐cost and average‐cost MDPs to discounted MDPs ⋮ Application of average dynamic programming to inventory systems ⋮ On the optimality equation for average cost Markov decision processes and its validity for inventory control
