Concentration bounds for temporal difference learning with linear function approximation: the case of batch data and uniform sampling
type: Item
instance of: scholarly article
title: Concentration bounds for temporal difference learning with linear function approximation: the case of batch data and uniform sampling
author: L. A. Prashanth
author: Nathaniel Korda
author: Rémi Munos
published in: Machine Learning
publication date: 2021-11-24T00:00:00Z
full work available at URL: https://arxiv.org/abs/1306.2557
Mathematics Subject Classification ID: 68T05
zbMATH DE Number: 7432813
MaRDI profile type: Publication
OpenAlex ID: W3118861484
cites work: Learning near-optimal policies with Bellman-residual minimization based fitted policy iteration and a single sample path
cites work: Dynamic programming and optimal control. Vol. 2
cites work: Q4257216
cites work: Stochastic approximation. A dynamical systems viewpoint.
cites work: The O.D.E. Method for Convergence of Stochastic Approximation and Reinforcement Learning
cites work: Q5477859
cites work: Harder, Better, Faster, Stronger Convergence Rates for Least-Squares Regression
cites work: Transport-entropy inequalities and deviation estimates for stochastic approximation schemes
cites work: Concentration bounds for stochastic approximations
cites work: OnActor-Critic Algorithms
cites work: Stochastic approximation methods for constrained and unconstrained systems
cites work: Q4421713
cites work: 10.1162/1532443041827907
cites work: Q5405216
cites work: Q3967358
cites work: Acceleration of Stochastic Approximation by Averaging
cites work: A Stochastic Approximation Method
cites work: Q4626283
cites work: Online Learning as Stochastic Approximation of Regularization Paths: Optimality and Almost-Sure Convergence
cites work: An analysis of temporal-difference learning with function approximation
cites work: High-Dimensional Statistics
cites work: Convergence Results for Some Temporal Difference Methods Based on Least Squares
DOI: 10.1007/S10994-020-05912-5
description: scientific article; zbMATH DE number 7432813