Neural ODEs with Irregular and Noisy Data

by   Pawan Goyal, et al.

Measurement noise is an integral part while collecting data of a physical process. Thus, noise removal is necessary to draw conclusions from these data, and it often becomes essential to construct dynamical models using these data. We discuss a methodology to learn differential equation(s) using noisy and irregular sampled measurements. In our methodology, the main innovation can be seen in the integration of deep neural networks with the neural ordinary differential equations (ODEs) approach. Precisely, we aim at learning a neural network that provides (approximately) an implicit representation of the data and an additional neural network that models the vector fields of the dependent variables. We combine these two networks by constraining using neural ODEs. The proposed framework to learn a model describing the vector field is highly effective under noisy measurements. The approach can handle scenarios where dependent variables are not available at the same temporal grid. Moreover, a particular structure, e.g., second-order with respect to time, can easily be incorporated. We demonstrate the effectiveness of the proposed method for learning models using data obtained from various differential equations and present a comparison with the neural ODE method that does not make any special treatment to noise.


page 6

page 9

page 10


Learning Dynamics from Noisy Measurements using Deep Learning with a Runge-Kutta Constraint

Measurement noise is an integral part while collecting data of a physica...

A Robust SINDy Approach by Combining Neural Networks and an Integral Form

The discovery of governing equations from data has been an active field ...

Discovery of Nonlinear Dynamical Systems using a Runge-Kutta Inspired Dictionary-based Sparse Regression Approach

Discovering dynamical models to describe underlying dynamical behavior i...

Individualized Dosing Dynamics via Neural Eigen Decomposition

Dosing models often use differential equations to model biological dynam...

Embedding stochastic differential equations into neural networks via dual processes

We propose a new approach to constructing a neural network for predictin...

Discovery of the Hidden State in Ionic Models Using a Domain-Specific Recurrent Neural Network

Ionic models, the set of ordinary differential equations (ODEs) describi...

Calibrating multi-dimensional complex ODE from noisy data via deep neural networks

Ordinary differential equations (ODEs) are widely used to model complex ...

Please sign up or login with your details

Forgot password? Click here to reset