Deep Learning Algorithms for Rotating Machinery Intelligent Diagnosis: An Open Source Benchmark Study

by   Zhibin Zhao, et al.

With the development of artificial intelligence and deep learning (DL) techniques, rotating machinery intelligent diagnosis has gone through tremendous progress with verified success and the classification accuracies of many DL-based intelligent diagnosis algorithms are tending to 100%. However, different datasets, configurations, and hyper-parameters are often recommended to be used in performance verification for different types of models, and few open source codes are made public for evaluation and comparisons. Therefore, unfair comparisons and ineffective improvement may exist in rotating machinery intelligent diagnosis, which limits the advancement of this field. To address these issues, we perform an extensive evaluation of four kinds of models with various datasets to provide a benchmark study within the same framework. In this paper, we first gather most of the publicly available datasets and give the complete benchmark study of DL-based intelligent algorithms under two data split strategies, five input formats, three normalization methods, and four augmentation methods. Second, we integrate the whole evaluation codes into a code library and release this code library to the public for better development of this field. Third, we use the specific-designed cases to point out the existing issues, including class imbalance, generalization ability, interpretability, few-shot learning, and model selection. By these works, we release a unified code framework for comparing and testing models fairly and quickly, emphasize the importance of open source codes, provide the baseline accuracy (a lower bound) to avoid useless improvement, and discuss potential future directions in this field. The code library is available at <>.


page 9

page 10

page 11

page 12

page 22

page 27

page 28

page 39


Unsupervised Deep Transfer Learning for Intelligent Fault Diagnosis: An Open Source and Comparative Study

Recent progress on intelligent fault diagnosis has greatly depended on t...

A Machine Learning Benchmark for Facies Classification

The recent interest in using deep learning for seismic interpretation ta...

Open-TransMind: A New Baseline and Benchmark for 1st Foundation Model Challenge of Intelligent Transportation

With the continuous improvement of computing power and deep learning alg...

Towards Efficient and Comprehensive Urban Spatial-Temporal Prediction: A Unified Library and Performance Benchmark

As deep learning technology advances and more urban spatial-temporal dat...

Deep Learning and Its Applications to WiFi Human Sensing: A Benchmark and A Tutorial

WiFi sensing has been evolving rapidly in recent years. Empowered by pro...

S2AND: A Benchmark and Evaluation System for Author Name Disambiguation

Author Name Disambiguation (AND) is the task of resolving which author m...

Audit to Forget: A Unified Method to Revoke Patients' Private Data in Intelligent Healthcare

Revoking personal private data is one of the basic human rights, which h...

Please sign up or login with your details

Forgot password? Click here to reset