Multi-armed bandits in discrete and continuous time
This paper analyzes Gittin's Markovian model in discrete and continuous time. Using multi-parameter processes and excursion theory, the authors show that index-priority strategies are optimal and express the optimal value in terms of indices.
scientific article; zbMATH DE number 1319912
scientific article