Fast and Multi-aspect Mining of Complex Time-stamped Event Streams

by   Kota Nakamura, et al.

Given a huge, online stream of time-evolving events with multiple attributes, such as online shopping logs: (item, price, brand, time), and local mobility activities: (pick-up and drop-off locations, time), how can we summarize large, dynamic high-order tensor streams? How can we see any hidden patterns, rules, and anomalies? Our answer is to focus on two types of patterns, i.e., ”regimes” and ”components”, for which we present CubeScope, an efficient and effective method over high-order tensor streams. Specifically, it identifies any sudden discontinuity and recognizes distinct dynamical patterns, ”regimes” (e.g., weekday/weekend/holiday patterns). In each regime, it also performs multi-way summarization for all attributes (e.g., item, price, brand, and time) and discovers hidden ”components” representing latent groups (e.g., item/brand groups) and their relationship. Thanks to its concise but effective summarization, CubeScope can also detect the sudden appearance of anomalies and identify the types of anomalies that occur in practice. Our proposed method has the following properties: (a) Effective: it captures dynamical multi-aspect patterns, i.e., regimes and components, and statistically summarizes all the events; (b) General: it is practical for successful application to data compression, pattern discovery, and anomaly detection on various types of tensor streams; (c) Scalable: our algorithm does not depend on the length of the data stream and its dimensionality. Extensive experiments on real datasets demonstrate that CubeScope finds meaningful patterns and anomalies correctly, and consistently outperforms the state-of-the-art methods as regards accuracy and execution speed.


MStream: Fast Streaming Multi-Aspect Group Anomaly Detection

Given a stream of entries in a multi-aspect data setting i.e., entries h...

SSMF: Shifting Seasonal Matrix Factorization

Given taxi-ride counts information between departure and destination loc...

Online anomaly detection using statistical leverage for streaming business process events

While several techniques for detecting trace-level anomalies in event lo...

Explaining Anomalies in Groups with Characterizing Subspace Rules

Anomaly detection has numerous applications and has been studied vastly....

Context Recovery and Knowledge Retrieval: A Novel Two-Stream Framework for Video Anomaly Detection

Video anomaly detection aims to find the events in a video that do not c...

Utilizing Dynamic Properties of Sharing Bits and Registers to Estimate User Cardinalities over Time

Online monitoring user cardinalities (or degrees) in graph streams is fu...

Fast and Accurate Graph Stream Summarization

A graph stream is a continuous sequence of data items, in which each ite...

Please sign up or login with your details

Forgot password? Click here to reset