Model-free mean-field reinforcement learning: mean-field MDP and mean-field Q-learning

DOI10.1214/23-aap1949arXiv1910.12802MaRDI QIDQ6139682

Mathieu Laurière, René A. Carmona, Zongjun Tan

Publication date: 19 January 2024

Published in: The Annals of Applied Probability (Search for Journal in Brave)

Full work available at URL: https://arxiv.org/abs/1910.12802

zbMATH Keywords

McKean-Vlasov controlmean field Markov decision processesmean field reinforcement learning

Mathematics Subject Classification ID

Cites Work

• Mean field type control with congestion. II: An augmented Lagrangian method
• Mean-field-game model for botnet defense in cyber-security
• A mean field approach for optimization in discrete time
• Mean field games
• Two numerical approaches to stationary mean-field games
• \({\mathcal Q}\)-learning
• Convergence analysis of machine learning algorithms for the numerical solution of mean field control and games. II: The finite horizon case
• Mean-field Markov decision processes with common noise and open-loop controls
• Convergence of some mean field games systems to aggregation and flocking models
• Bertrand and Cournot mean field games
• Large population stochastic dynamic games: closed-loop McKean-Vlasov systems and the Nash certainty equivalence principle
• Numerical resolution of McKean-Vlasov FBSDEs using neural networks
• Mean Field Games: Numerical Methods for the Planning Problem
• Random Measures, Theory and Applications
• Mean Field Games and Applications
• The Master Equation and the Convergence Problem in Mean Field Games
• Convergence Analysis of Machine Learning Algorithms for the Numerical Solution of Mean Field Control and Games I: The Ergodic Case
• Mean-Field Controls with Q-Learning for Cooperative MARL: Convergence and Complexity Analysis
• A Probabilistic Approach to Classical Solutions of the Master Equation for Large Population Equilibria
• Mean Field Games for Modeling Crowd Motion
• Mean Field Games and Mean Field Type Control Theory
• Probabilistic Theory of Mean Field Games with Applications II
• Mean Field for Markov Decision Processes: From Discrete to Continuous Optimization
• Mean Field Games: Numerical Methods
• Deep Blue
• Q-learning in regularized mean-field games

This page was built for publication: Model-free mean-field reinforcement learning: mean-field MDP and mean-field Q-learning