Anomaly Detection in Paleoclimate Records using Permutation Entropy

11/03/2018
by   Joshua Garland, et al.
0

Permutation entropy techniques can be useful in identifying anomalies in paleoclimate data records, including noise, outliers, and post-processing issues. We demonstrate this using weighted and unweighted permutation entropy of water-isotope records in a deep polar ice core. In one region of these isotope records, our previous calculations revealed an abrupt change in the complexity of the traces: specifically, in the amount of new information that appeared at every time step. We conjectured that this effect was due to noise introduced by an older laboratory instrument. In this paper, we validate that conjecture by re-analyzing a section of the ice core using a more-advanced version of the laboratory instrument. The anomalous noise levels are absent from the permutation entropy traces of the new data. In other sections of the core, we show that permutation entropy techniques can be used to identify anomalies in the raw data that are not associated with climatic or glaciological processes, but rather effects occurring during field work, laboratory analysis, or data post-processing. These examples make it clear that permutation entropy is a useful forensic tool for identifying sections of data that require targeted re-analysis---and can even be useful in guiding that analysis.

READ FULL TEXT
research
11/03/2018

Anomaly Detection in Paleoclimate Records using Information Theory

The Shannon entropy rate can be useful in identifying anomalies in high-...
research
01/15/2023

Efficient anomaly detection method for rooftop PV systems using big data and permutation entropy

The number of rooftop photovoltaic (PV) systems has significantly increa...
research
10/23/2020

Detection of Local Mixing in Time-Series Data Using Permutation Entropy

While it is tempting in experimental practice to seek as high a data rat...
research
03/05/2021

Complexity-based permutation entropies: from deterministic time series to white noise

This is a paper in the intersection of time series analysis and complexi...
research
08/05/2023

Anomaly Detection in Global Financial Markets with Graph Neural Networks and Nonextensive Entropy

Anomaly detection is a challenging task, particularly in systems with ma...
research
04/11/2023

Optimizing Linear Correctors: A Tight Output Min-Entropy Bound and Selection Technique

Post-processing of the raw bits produced by a true random number generat...
research
05/15/2019

On the Automatic Parameter Selection for Permutation Entropy

Permutation Entropy (PE) has been shown to be a useful tool for time ser...

Please sign up or login with your details

Forgot password? Click here to reset