NINNs: Nudging Induced Neural Networks

03/15/2022
by   Harbir Antil, et al.
0

New algorithms called nudging induced neural networks (NINNs), to control and improve the accuracy of deep neural networks (DNNs), are introduced. The NINNs framework can be applied to almost all pre-existing DNNs, with forward propagation, with costs comparable to existing DNNs. NINNs work by adding a feedback control term to the forward propagation of the network. The feedback term nudges the neural network towards a desired quantity of interest. NINNs offer multiple advantages, for instance, they lead to higher accuracy when compared with existing data assimilation algorithms such as nudging. Rigorous convergence analysis is established for NINNs. The algorithmic and theoretical findings are illustrated on examples from data assimilation and chemically reacting flows.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/10/2018

Hierarchical Block Sparse Neural Networks

Sparse deep neural networks(DNNs) are efficient in both memory and compu...
research
04/01/2021

Novel DNNs for Stiff ODEs with Applications to Chemically Reacting Flows

Chemically reacting flows are common in engineering, such as hypersonic ...
research
05/29/2018

Review of Applications of Generalized Regression Neural Networks in Identification and Control of Dynamic Systems

This paper depicts a brief revision of Generalized Regression Neural Net...
research
12/10/2019

Robust Training and Initialization of Deep Neural Networks: An Adaptive Basis Viewpoint

Motivated by the gap between theoretical optimal approximation rates of ...
research
05/27/2023

On Neural Networks as Infinite Tree-Structured Probabilistic Graphical Models

Deep neural networks (DNNs) lack the precise semantics and definitive pr...
research
08/23/2023

Adversarial Training Using Feedback Loops

Deep neural networks (DNN) have found wide applicability in numerous fie...
research
12/06/2021

AdaSTE: An Adaptive Straight-Through Estimator to Train Binary Neural Networks

We propose a new algorithm for training deep neural networks (DNNs) with...

Please sign up or login with your details

Forgot password? Click here to reset