A Machine Learning Framework for Solving High-Dimensional Mean Field Game and Mean Field Control Problems

02/15/2020
by   Lars Ruthotto, et al.
0

Mean field games (MFG) and mean field control (MFC) are critical classes of multi-agent models for efficient analysis of massive populations of interacting agents. Their areas of application span topics in economics, finance, game theory, industrial engineering, crowd motion, and more. In this paper, we provide a flexible machine learning framework for the numerical solution of potential MFG and MFC models. State-of-the-art numerical methods for solving such problems utilize spatial discretization that leads to a curse-of-dimensionality. We approximately solve high-dimensional problems by combining Lagrangian and Eulerian viewpoints and leveraging recent advances from machine learning. More precisely, we work with a Lagrangian formulation of the problem and enforce the underlying Hamilton-Jacobi-Bellman (HJB) equation that is derived from the Eulerian formulation. Finally, a tailored neural network parameterization of the MFG/MFC solution helps us avoid any spatial discretization. Our numerical results include the approximate solution of 100-dimensional instances of optimal transport and crowd motion problems on a standard work station and a validation using an Eulerian solver in two dimensions. These results open the door to much-anticipated applications of MFG and MFC models that were beyond reach with existing numerical methods.

READ FULL TEXT

page 8

page 9

page 13

page 15

page 16

page 17

page 18

page 19

research
02/25/2022

Random Features for High-Dimensional Nonlocal Mean-Field Games

We propose an efficient solution approach for high-dimensional nonlocal ...
research
06/30/2022

Bridging Mean-Field Games and Normalizing Flows with Trajectory Regularization

Mean-field games (MFGs) are a modeling framework for systems with a larg...
research
02/28/2023

Deep Learning for Mean Field Optimal Transport

Mean field control (MFC) problems have been introduced to study social o...
research
09/20/2022

Deep Generalized Schrödinger Bridge

Mean-Field Game (MFG) serves as a crucial mathematical framework in mode...
research
04/25/2022

Learning High-Dimensional McKean-Vlasov Forward-Backward Stochastic Differential Equations with General Distribution Dependence

One of the core problems in mean-field control and mean-field games is t...
research
09/08/2022

Learning Sparse Graphon Mean Field Games

Although the field of multi-agent reinforcement learning (MARL) has made...
research
06/29/2015

Machine learning for many-body physics: efficient solution of dynamical mean-field theory

Machine learning methods for solving the equations of dynamical mean-fie...

Please sign up or login with your details

Forgot password? Click here to reset