scientific article; zbMATH DE number 1233798
From MaRDI portal
Publication:4223191
zbMath0997.93503MaRDI QIDQ4223191
Publication date: 18 December 1998
Title: zbMATH Open Web Interface contents unavailable due to conflicting licenses.
Stochastic programming (90C15) Dynamic programming (90C39) Research exposition (monographs, survey articles) pertaining to systems and control theory (93-02) Optimal stochastic control (93E20) Research exposition (monographs, survey articles) pertaining to operations research and mathematical programming (90-02)
Related Items
Two‐class constrained optimization with applications to queueing control ⋮ Average criteria in denumerable semi-Markov decision chains under risk-aversion ⋮ Unnamed Item ⋮ A note on the existence of optimal stationary policies for average Markov decision processes with countable states ⋮ Average cost minimization in a multi-server retrial queueing system with a controllable reserve group of servers ⋮ Another Set of Conditions for Strongn(n = −1, 0) Discount Optimality in Markov Decision Processes ⋮ New sufficient conditions for average optimality in continuous-time Markov decision processes ⋮ Continuous-time controlled Markov chains. ⋮ Constrained average stochastic games with continuous-time independent state processes ⋮ Analysis and optimization of a controlled model for a closed queueing network ⋮ Optimal control of a multiclass queueing system when customers can change types ⋮ Nonzero-sum constrained discrete-time Markov games: the case of unbounded costs ⋮ Markov Decision Processes with Variance Minimization: A New Condition and Approach ⋮ Convergence of controlled models and finite-state approximation for discounted continuous-time Markov decision processes with constraints ⋮ Bias optimality and strong \(n\) \((n= -1,0)\) discount optimality for Markov decision processes ⋮ Attention allocation for decision making queues ⋮ Constrained Continuous-Time Markov Control Processes with Discounted Criteria ⋮ Zero-sum stochastic games with average payoffs: new optimality conditions ⋮ OPTIMAL CONTROL POLICIES FOR AN M/M/1 QUEUE WITH A REMOVABLE SERVER AND DYNAMIC SERVICE RATES ⋮ Controlled semi-Markov chains with risk-sensitive average cost criterion ⋮ Zero-sum continuous-time Markov games with unbounded transition and discounted payoff rates ⋮ Sustainable social choice under risk ⋮ Decentralized stochastic control ⋮ Multi-Actor Markov Decision Processes ⋮ Approximate linear programming for networks: average cost bounds ⋮ Dynamic pricing and replenishment: Optimality, bounds, and asymptotics ⋮ Optimal threshold control of a retrial queueing system with finite buffer ⋮ Heuristic Solution for the Optimal Thresholds in a Controllable Multi-server Heterogeneous Queueing System Without Preemption ⋮ A semimartingale characterization of average optimal stationary policies for Markov decision processes ⋮ Dynamic admission and service rate control of a queue ⋮ A mean-variance optimization problem for discounted Markov decision processes ⋮ Bias optimality of admission control in a non-stationary repairable queue ⋮ Another set of verifiable conditions for average Markov decision processes with Borel spaces ⋮ Sample-Path Optimal Stationary Policies in Stable Markov Decision Chains with the Average Reward Criterion ⋮ Strong \(n\)-discount and finite-horizon optimality for continuous-time Markov decision processes ⋮ Robust Markov control processes ⋮ Examples concerning Abel and Cesàro limits ⋮ Periodic capacity management under a lead-time performance constraint ⋮ Optimality of the fastest available server policy ⋮ Uniform Turnpike Theorems for Finite Markov Decision Processes ⋮ Finite horizon semi-Markov decision processes with application to maintenance systems ⋮ Joint management of capacity and inventory in make-to-stock production systems with multi-class demand ⋮ Randomization and simplification in dynamic decision-making. ⋮ Joint routing and scheduling control in a two-class network with a flexible server ⋮ Queueing model of a hybrid channel with faster link subject to partial and complete failures ⋮ Dynamic scheduling of a single-server two-class queue with constant retrial policy ⋮ First passage models for denumerable semi-Markov decision processes with nonnegative discounted costs ⋮ Book Review: Optimal stochastic control, stochastic target problems, and backward SDE ⋮ Explicit solution of the average-cost optimality equation for a pest-control problem ⋮ New average optimality conditions for semi-Markov decision processes in Borel spaces ⋮ Performance optimization of queueing systems with perturbation realization ⋮ Control of a production-inventory system with returns under imperfect advance return information ⋮ Verifiable conditions for average optimality of continuous-time Markov decision processes ⋮ Average control of Markov decision processes with Feller transition probabilities and general action spaces ⋮ Control and observation for dynamical queueing networks. I ⋮ Reinforcement learning for long-run average cost. ⋮ Discounted continuous-time constrained Markov decision processes in Polish spaces ⋮ On structural properties of the value function for an unbounded jump Markov process with an application to a processor sharing retrial queue ⋮ Nonzero-sum games for continuous-time Markov chains with unbounded discounted payoffs ⋮ Average optimality for risk-sensitive control with general state space ⋮ Approximation of Markov decision processes with general state space ⋮ Sample-path optimality and variance-maximization for Markov decision processes ⋮ Existence and regularity of a nonhomogeneous transition matrix under measurability conditions ⋮ An Overview for Markov Decision Processes in Queues and Networks ⋮ Integrating inventory control and capacity management at a maintenance service provider ⋮ Average optimality for continuous-time Markov decision processes with a policy iteration approach ⋮ Optimal production and rationing decisions in supply chains with information sharing ⋮ On Finite Approximations to Markov Decision Processes with Recursive and Nonlinear Discounting ⋮ Robust bounds and optimization at the large deviations scale for queueing models via Rényi divergence ⋮ Attack allocation on remote state estimation in multi-systems: structural results and asymptotic solution ⋮ THE N-NETWORK MODEL WITH UPGRADES ⋮ A Poisson equation for the risk-sensitive average cost in semi-Markov chains ⋮ Average optimality inequality for continuous-time Markov decision processes in Polish spaces ⋮ Analysis of the optimal resource allocation for a tandem queueing system ⋮ Continuous-time Markov decision processes with \(n\)th-bias optimality criteria ⋮ Hysteretic Capacity Switching for M/G/1 Queues ⋮ Computation of the optimal policy for the control of a compound immigration process through total catastrophes ⋮ A simple heuristic for load balancing in parallel processing networks with highly variable service time distributions ⋮ On the introduction of an agile, temporary workforce into a tandem queueing system ⋮ Variance minimization for continuous-time Markov decision processes: two approaches ⋮ A two-demand-class inventory system with lost-sales and backorders ⋮ Another set of conditions for Markov decision processes with average sample-path costs ⋮ Threshold policies for controlled retrial queues with heterogeneous servers ⋮ Optimal Control of a Two-Server Heterogeneous Queueing System with Breakdowns and Constant Retrials ⋮ Optimal pricing for tandem queues with finite buffers ⋮ A survey of recent results on continuous-time Markov decision processes (with comments and rejoinder) ⋮ Average optimality for continuous-time Markov decision processes in Polish spaces ⋮ New discount and average optimality conditions for continuous-time Markov decision processes ⋮ Continuous-Time Markov Decision Processes with Unbounded Transition and Discounted-Reward Rates ⋮ Optimal server assignment in a two-stage tandem queueing system ⋮ Convergence of Markov decision processes with constraints and state-action dependent discount factors ⋮ Optimal control and performance analysis of anMX/M/1queue with batches of negative customers ⋮ Bias optimality for multichain continuous-time Markov decision processes ⋮ Average optimality for Markov decision processes in borel spaces: a new condition and approach ⋮ Optimality of admission control in an M∕M∕1∕N queue with varying services ⋮ On the reduction of total‐cost and average‐cost MDPs to discounted MDPs ⋮ Optimal dynamic assignment of a flexible worker on an open production line with specialists ⋮ The Expected Total Cost Criterion for Markov Decision Processes under Constraints ⋮ Optimal and near-optimal inventory control policies for a make-to-order inventory-production system ⋮ On a Slow Server Problem ⋮ Blackwell optimality in Markov decision processes with partial observation. ⋮ Stochastic approximations of constrained discounted Markov decision processes ⋮ Efficient computation of time-bounded reachability probabilities in uniform continuous-time Markov decision processes ⋮ On the First Passage $g$-Mean-Variance Optimality for Discounted Continuous-Time Markov Decision Processes ⋮ Markovian controllable queueing systems with hysteretic policies: Busy period and waiting time analysis ⋮ On essential information in sequential decision processes ⋮ First passage Markov decision processes with constraints and varying discount factors
