DeepHAM: A Global Solution Method for Heterogeneous Agent Models with Aggregate Shocks

12/29/2021
by   Jiequn Han, et al.
8

We propose an efficient, reliable, and interpretable global solution method, Deep learning-based algorithm for Heterogeneous Agent Models, DeepHAM, for solving high dimensional heterogeneous agent models with aggregate shocks. The state distribution is approximately represented by a set of optimal generalized moments. Deep neural networks are used to approximate the value and policy functions, and the objective is optimized over directly simulated paths. Besides being an accurate global solver, this method has three additional features. First, it is computationally efficient for solving complex heterogeneous agent models, and it does not suffer from the curse of dimensionality. Second, it provides a general and interpretable representation of the distribution over individual states; and this is important for addressing the classical question of whether and how heterogeneity matters in macroeconomics. Third, it solves the constrained efficiency problem as easily as the competitive equilibrium, and this opens up new possibilities for studying optimal monetary and fiscal policies in heterogeneous agent models with aggregate shocks.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/31/2021

Solving Heterogeneous General Equilibrium Economic Models with Deep Reinforcement Learning

General equilibrium macroeconomic models are a core tool used by policym...
research
08/13/2023

Heterogeneous Multi-Agent Reinforcement Learning via Mirror Descent Policy Optimization

This paper presents an extension of the Mirror Descent method to overcom...
research
06/06/2018

Randomized Value Functions via Multiplicative Normalizing Flows

Randomized value functions offer a promising approach towards the challe...
research
07/21/2017

Mastering Heterogeneous Behavioural Models

Heterogeneity is one important feature of complex systems, leading to th...
research
08/25/2023

Pretty darn good control: when are approximate solutions better than approximate models

Existing methods for optimal control struggle to deal with the complexit...
research
04/26/2023

NA^2Q: Neural Attention Additive Model for Interpretable Multi-Agent Q-Learning

Value decomposition is widely used in cooperative multi-agent reinforcem...
research
09/07/2019

Mature GAIL: Imitation Learning for Low-level and High-dimensional Input using Global Encoder and Cost Transformation

Recently, GAIL framework and various variants have shown remarkable poss...

Please sign up or login with your details

Forgot password? Click here to reset