On the effectiveness of neural priors in modeling dynamical systems

03/10/2023
by   Sameera Ramasinghe, et al.
0

Modelling dynamical systems is an integral component for understanding the natural world. To this end, neural networks are becoming an increasingly popular candidate owing to their ability to learn complex functions from large amounts of data. Despite this recent progress, there has not been an adequate discussion on the architectural regularization that neural networks offer when learning such systems, hindering their efficient usage. In this paper, we initiate a discussion in this direction using coordinate networks as a test bed. We interpret dynamical systems and coordinate networks from a signal processing lens, and show that simple coordinate networks with few layers can be used to solve multiple problems in modelling dynamical systems, without any explicit regularizers.

READ FULL TEXT
research
06/22/2021

Learning Dynamical Systems from Noisy Sensor Measurements using Multiple Shooting

Modeling dynamical systems plays a crucial role in capturing and underst...
research
10/28/2021

Roto-translated Local Coordinate Frames For Interacting Dynamical Systems

Modelling interactions is critical in learning complex dynamical systems...
research
09/06/2020

Spatio-Temporal Activation Function To Map Complex Dynamical Systems

Most of the real world is governed by complex and chaotic dynamical syst...
research
12/16/2015

Symphony from Synapses: Neocortex as a Universal Dynamical Systems Modeller using Hierarchical Temporal Memory

Reverse engineering the brain is proving difficult, perhaps impossible. ...
research
06/19/2011

Prediction and Modularity in Dynamical Systems

Identifying and understanding modular organizations is centrally importa...
research
09/21/2020

A mathematical approach to resilience

In this paper, we evolve from sparsity, a key concept in robust statisti...
research
06/06/2023

Learning Dynamical Systems from Noisy Data with Inverse-Explicit Integrators

We introduce the mean inverse integrator (MII), a novel approach to incr...

Please sign up or login with your details

Forgot password? Click here to reset