Estimating Conditional Transfer Entropy in Time Series using Mutual Information and Non-linear Prediction

We propose a new estimator to measure directed dependencies in time series. The dimensionality of data is first reduced using a new non-uniform embedding technique, where the variables are ranked according to a weighted sum of the amount of new information and improvement of the prediction accuracy provided by the variables. Then, using a greedy approach, the most informative subsets are selected in an iterative way. The algorithm terminates, when the highest ranked variable is not able to significantly improve the accuracy of the prediction as compared to that obtained using the existing selected subsets. In a simulation study, we compare our estimator to existing state-of-the-art methods at different data lengths and directed dependencies strengths. It is demonstrated that the proposed estimator has a significantly higher accuracy than that of existing methods, especially for the difficult case, where the data is highly correlated and coupled. Moreover, we show its false detection of directed dependencies due to instantaneous couplings effect is lower than that of existing measures. We also show applicability of the proposed estimator on real intracranial electroencephalography data.


page 1

page 2

page 3

page 4


Detecting causality in multivariate time series via non-uniform embedding

Causal analysis based on non-uniform embedding schemes is an important w...

Estimating the Mutual Information between two Discrete, Asymmetric Variables with Limited Samples

Determining the strength of non-linear statistical dependencies between ...

Structure Learning from Time Series with False Discovery Control

We consider the Granger causal structure learning problem from time seri...

Neural Fields for Interactive Visualization of Statistical Dependencies in 3D Simulation Ensembles

We present the first neural network that has learned to compactly repres...

Cluster based inference for extremes of time series

We introduce a new type of estimator for the spectral tail process of a ...

Shortcomings of transfer entropy and partial transfer entropy: Extending them to escape the curse of dimensionality

Transfer entropy (TE) captures the directed relationships between two va...

Please sign up or login with your details

Forgot password? Click here to reset