Deep-OSG: A deep learning approach for approximating a family of operators in semigroup to model unknown autonomous systems

02/07/2023
by   Junfeng Chen, et al.
0

This paper proposes a novel deep learning approach for approximating evolution operators and modeling unknown autonomous dynamical systems using time series data collected at varied time lags. It is a sequel to the previous works [T. Qin, K. Wu, and D. Xiu, J. Comput. Phys., 395:620–635, 2019], [K. Wu and D. Xiu, J. Comput. Phys., 408:109307, 2020], and [Z. Chen, V. Churchill, K. Wu, and D. Xiu, J. Comput. Phys., 449:110782, 2022], which focused on learning single evolution operator with a fixed time step. This paper aims to learn a family of evolution operators with variable time steps, which constitute a semigroup for an autonomous system. The semigroup property is very crucial and links the system's evolutionary behaviors across varying time scales, but it was not considered in the previous works. We propose for the first time a framework of embedding the semigroup property into the data-driven learning process, through a novel neural network architecture and new loss functions. The framework is very feasible, can be combined with any suitable neural networks, and is applicable to learning general autonomous ODEs and PDEs. We present the rigorous error estimates and variance analysis to understand the prediction accuracy and robustness of our approach, showing the remarkable advantages of semigroup awareness in our model. Moreover, our approach allows one to arbitrarily choose the time steps for prediction and ensures that the predicted results are well self-matched and consistent. Extensive numerical experiments demonstrate that embedding the semigroup property notably reduces the data dependency of deep learning models and greatly improves the accuracy, robustness, and stability for long-time prediction.

READ FULL TEXT

page 17

page 31

page 33

page 34

research
06/19/2018

HybridNet: Integrating Model-based and Data-driven Learning to Predict Evolution of Dynamical Systems

The robotic systems continuously interact with complex dynamical systems...
research
10/07/2021

A Meta-learning Approach to Reservoir Computing: Time Series Prediction with Limited Data

Recent research has established the effectiveness of machine learning fo...
research
03/11/2022

Parameter Inference of Time Series by Delay Embeddings and Learning Differentiable Operators

A common issue in dealing with real-world dynamical systems is identifyi...
research
06/13/2021

Markov Neural Operators for Learning Chaotic Systems

Chaotic systems are notoriously challenging to predict because of their ...
research
03/07/2022

Robust Modeling of Unknown Dynamical Systems via Ensemble Averaged Learning

Recent work has focused on data-driven learning of the evolution of unkn...
research
10/24/2022

Designing Universal Causal Deep Learning Models: The Case of Infinite-Dimensional Dynamical Systems from Stochastic Analysis

Deep learning (DL) is becoming indispensable to contemporary stochastic ...
research
03/09/2021

Data-driven Prediction of General Hamiltonian Dynamics via Learning Exactly-Symplectic Maps

We consider the learning and prediction of nonlinear time series generat...

Please sign up or login with your details

Forgot password? Click here to reset