Multiple stopping time POMDPs: structural results \& application in interactive advertising on social media

DOI10.1016/j.automatica.2018.06.013zbMath1406.90045arXiv1712.00524OpenAlexW2964339410MaRDI QIDQ1626919

Anup Aprem, Vikram Krishnamurthy, Sujay Bhatt

Publication date: 21 November 2018

Published in: Automatica (Search for Journal in Brave)

Full work available at URL: https://arxiv.org/abs/1712.00524

zbMATH Keywords

schedulingstochastic approximationsubmodularitymonotone policiespartially observed Markov decision processinteractive advertisementlive social mediamonotone likelihood ratio dominancemultiple stopping time problemstructural result

Mathematics Subject Classification ID

Social networks; opinion dynamics (91D30) Deterministic scheduling theory in operations research (90B35) Deterministic network models in operations research (90B10) Markov and semi-Markov decision processes (90C40) Marketing, advertising (90B60)

Related Items (1)

Multi-goal motion planning using traveling salesman problem in belief space

Cites Work

• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• The problem of optimal stopping in a partially observable Markov chain
• Classes of orderings of measures and related correlation inequalities. I. Multivariate totally positive distributions
• An optimal multiple stopping approach to infrastructure investment decisions
• Partially Observed Markov Decision Processes
• Multiple-stopping problems with random horizon
• Bayesian Quickest Change-Point Detection With Sampling Right Constraints
• Quickest Detection POMDPs With Social Learning: Interaction of Local and Global Decision Makers
• Technical Note—Stochastic Sequential Decision-Making with a Random Number of Jobs
• Myopic Bounds for Optimal Policy of POMDPs: An Extension of Lovejoy’s Structural Results
• On the Best 2-CUSUM Stopping Rule for Quickest Detection of Two-Sided Alternatives in a Brownian Motion Model
• Introduction to Stochastic Search and Optimization
• Reduced Complexity HMM Filtering With Stochastic Dominance Bounds: A Convex Optimization Approach
• On Optimal Multiple Stopping of Markov Sequences
• Quickest Detection with Discretely Controlled Observations
• Bayesian Sequential Detection With Phase-Distributed Change Time and Nonlinear Penalty—A POMDP Lattice Programming Approach
• How to Schedule Measurements of a Noisy Markov Chain in Decision Making?
• OPTIMAL MULTIPLE STOPPING AND VALUATION OF SWING OPTIONS

This page was built for publication: Multiple stopping time POMDPs: structural results \& application in interactive advertising on social media