Randomized Signature Layers for Signal Extraction in Time Series Data

by   Enea Monzio Compagnoni, et al.

Time series analysis is a widespread task in Natural Sciences, Social Sciences, and Engineering. A fundamental problem is finding an expressive yet efficient-to-compute representation of the input time series to use as a starting point to perform arbitrary downstream tasks. In this paper, we build upon recent works that use the Signature of a path as a feature map and investigate a computationally efficient technique to approximate these features based on linear random projections. We present several theoretical results to justify our approach and empirically validate that our random projections can effectively retrieve the underlying Signature of a path. We show the surprising performance of the proposed random features on several tasks, including (1) mapping the controls of stochastic differential equations to the corresponding solutions and (2) using the Randomized Signatures as time series representation for classification tasks. When compared to corresponding truncated Signature approaches, our Randomizes Signatures are more computationally efficient in high dimensions and often lead to better accuracy and faster training. Besides providing a new tool to extract Signatures and further validating the high level of expressiveness of such features, we believe our results provide interesting conceptual links between several existing research areas, suggesting new intriguing directions for future investigations.


page 1

page 2

page 3

page 4


Tropical time series, iterated-sums signatures and quasisymmetric functions

Driven by the need for principled extraction of features from time serie...

On Consistency of Signatures Using Lasso

Signature transforms are iterated path integrals of continuous and discr...

The insertion method to invert the signature of a path

The signature is a representation of a path as an infinite sequence of i...

Path Signatures for Seizure Forecasting

Forecasting the state of a system from an observed time series is the su...

A Generalised Signature Method for Time Series

The `signature method' refers to a collection of feature extraction tech...

Neural SDEs for Conditional Time Series Generation and the Signature-Wasserstein-1 metric

(Conditional) Generative Adversarial Networks (GANs) have found great su...

Neural CDEs for Long Time Series via the Log-ODE Method

Neural Controlled Differential Equations (Neural CDEs) are the continuou...

Please sign up or login with your details

Forgot password? Click here to reset