On monotone optimal decision rules and the stay-on-a-winner rule for the two-armed bandit
type: Item
instance of: scholarly article
title: On monotone optimal decision rules and the stay-on-a-winner rule for the two-armed bandit
zbMATH Open document ID: 0616.90093
DOI: 10.1007/BF01897828
author: H. Benzing
author: Michael Kolonko
published in: Metrika
publication date: 1985-01-01T00:00:00Z
full work available at URL: https://eudml.org/doc/176018
review text: Consider the following optimization problem: Find a decision rule \(\delta\) such that \(w(x,\delta (x))=\max_{a}w(x,a)\) for all x under the constraint \(\delta\) (x)\(\in D(x)\). We give conditions for the existence of monotone optimal decision rules \(\delta\). The term 'monotone' is used in a general sense. The well-known stay-on-a-winner rules for the two- armed bandit can be characterized as monotone decision rules by including the stage number into x and using a special ordering on x. This enables us to give simple conditions for the existence of optimal rules that are stay-on-a-winner rules. We extend results of \textit{D. A. Berry} [Ann. Math. Stat. 43, 871-897 (1972; Zbl 0258.62013)] and \textit{D. Kalin} and \textit{R. Theodorescu} [Math. Operations-Forsch. Stat., Ser. Optimization 13, 469-472 (1982; Zbl 0505.90080)] to the case of dependent arms.
Mathematics Subject Classification ID: 90C40
zbMATH DE Number: 3999703
zbMATH Keywords: existence of monotone optimal decision rules
zbMATH Keywords: stay-on-a-winner rules
zbMATH Keywords: two-armed bandit
MaRDI profile type: Publication
cites work: On the k-armed Bernoulli bandit: monotonicity of the total reward under an arbitrary prior distribution
cites work: A Bernoulli Two-armed Bandit
cites work: On Sequential Designs for Maximizing the Sum of $n$ Observations
cites work: On the Bernoulli two-armed bandit problem
cites work: Q3725880
cites work: A note on ‘monotone optimal policies for markov decision processes’
cites work: Q4198358
cites work: A note on structural properties of the Bernoulli two-armed bandit problem
cites work: Some Concepts of Dependence
cites work: Minimizing a Submodular Function on a Lattice
Recommended article: Q3330997
Recommended article: Stay-with-a-winner rule for dependent Bernoulli bandits
Recommended article: On the k-armed Bernoulli bandit: monotonicity of the total reward under an arbitrary prior distribution
Recommended article: Q3330996
Recommended article: On the problem of the two-armed bandit with impulse controls and discounting
Recommended article: Some monotonicity properties of parametric and nonparametric Bayesian bandits
Recommended article: On the Optimal Reward Function of the Continuous Time Multiarmed Bandit Problem
Recommended article: Q3798561
Recommended article: On the two-armed bandit problem with continuous time parameter and discounted rewards
description: scientific article; zbMATH DE number 3999703