Limiting free energy of multi-layer generalized linear models

08/28/2021

∙

by   Hong-Bin Chen, et al.

∙

0

∙

share

We compute the high-dimensional limit of the free energy associated with a multi-layer generalized linear model. Under certain technical assumptions, we identify the limit in terms of a variational formula. The approach is to first show that the limit is a solution to a Hamilton-Jacobi equation whose initial condition is related to the limiting free energy of a model with one fewer layer. Then, we conclude by an iteration.