Policy mirror descent inherently explores action space
type: Item
instance of: scholarly article
title: Policy mirror descent inherently explores action space
author: Yan Li
author: Guanghui Lan
published in: SIAM Journal on Optimization
publication date: 2025-01-14T00:00:00Z
Mathematics Subject Classification ID: 90C40
Mathematics Subject Classification ID: 90C15
Mathematics Subject Classification ID: 90C26
Mathematics Subject Classification ID: 68Q25
zbMATH DE Number: 7966996
zbMATH Keywords: Markov decision process
zbMATH Keywords: stochastic policy gradient
zbMATH Keywords: exploration
zbMATH Keywords: mirror descent
zbMATH Keywords: sample complexity
MaRDI profile type: Publication
cites work: The Nonstochastic Multiarmed Bandit Problem
cites work: Fast Global Convergence of Natural Policy Gradient Methods with Entropy Regularization
cites work: Finite-Sample Analysis of Two-Time-Scale Natural Actor–Critic Algorithm
cites work: Simple and Optimal Methods for Stochastic Variational Inequalities, II: Markovian Noise and Policy Evaluation in Reinforcement Learning
cites work: Asymptotically efficient adaptive allocation rules
cites work: Policy mirror descent for reinforcement learning: linear convergence, new sampling complexity, and generalized problem classes
cites work: Block Policy Mirror Descent
cites work: Q4595047
cites work: Homotopic policy mirror descent: policy convergence, algorithmic regularization, and improved sample complexity
cites work: Robust Stochastic Approximation Approach to Stochastic Programming
cites work: Q3967358
cites work: Q5305630
cites work: Reinforcement learning with replacing eligibility traces
cites work: On average versus discounted reward temporal-difference learning
cites work: Policy Mirror Descent for Regularized Reinforcement Learning: A Generalized Framework with Linear Convergence
DOI: 10.1137/23M1560215
description: scientific article; zbMATH DE number 7966996