Advanced Bearing-Fault Diagnosis and Classification Using Mel-Scalograms and FOX-Optimized ANN
Abstract
:1. Introduction
- (1)
- A new type of Mel-transformed scalogram derived from vibration signals. This process involves windowing the signals and applying a Mel filter bank, transforming them into Mel-spectra that highlight essential fault-related features, often missed by traditional signal-processing methods.
- (2)
- The generated Mel scalograms are then input into an autoencoder’s convolutional and pooling layers, enabling efficient extraction of meaningful features specific to fault detection directly from the Mel spectrum.
- (3)
- For classification, an ANN is employed, utilizing the FOX optimizer in place of traditional backpropagation. This approach improves accuracy, reduces loss, enhances generalization, and offers better interpretability, addressing limitations present in previous optimization methods.
- (4)
- The model’s effectiveness is rigorously validated on a bearing-testbed dataset featuring diverse fault conditions, demonstrating its robustness and generalizability across multiple fault types, highlighting the model’s potential for real-world fault diagnosis applications.
- (5)
- Experimental results showcase the proposed model’s robustness and generalizability, making it a promising solution for complex fault detection tasks in bearing systems.
2. Proposed Method for Fault Diagnosis in Bearings
- (1)
- Data Acquisition and Signal Preprocessing: VSs from a bearing testbed are collected and preprocessed by windowing the signals and applying a wavelet transform. These windowed signals are then passed through a Mel filter bank to generate Mel-transformed scalograms, representing the time–frequency characteristics of the signals.
- (2)
- Feature Extraction using Autoencoder: The generated Mel scalograms are fed into an autoencoder with two convolutional and two pooling layers for feature extraction. The autoencoder effectively captures significant high-level features from the scalograms while reducing dimensionality, ensuring that essential fault-relevant patterns are retained.
- (3)
- Classification with FOX Optimizer and ANN: The extracted features are passed to an ANN, where the classification is optimized using the FOX optimizer. This optimizer replaces traditional backpropagation, improving accuracy, minimizing loss, and enhancing generalization. The model categorizes faults into four classes: Inner Race Fault (IRF), Outer Race Fault (ORF), Roller Fault (RF), and Normal Condition (NC).
- (4)
- Model Evaluation and Validation: The proposed model is validated using experimental data from the bearing testbed. The results demonstrate the robustness and generalization ability of the model, achieving accurate fault detection across various fault conditions. Visualizations, including confusion matrices and accuracy curves, showcase the model’s effectiveness in fault classification.
2.1. Mel Transformation
- (1)
- Vibration data are loaded from the dataset and extract relevant parameters, such as the signal data (s) and sampling frequency fs.
- (2)
- The p-spectrum function computes the time–frequency representation (spectrogram) of the signal (s). This can be represented mathematically as follows:
- S (t, f) is the spectrogram, representing energy distribution over time t and frequency f, and s(t) is the time-domain signal to be transformed.
- Frequency limits in p-spectrum define the range [0, fs/2], limiting the analysis to frequencies within the Nyquist limit.
- (3)
- The Mel transformation is implied in the choice of plotting the frequency spectrum with emphasis on lower-frequency bands, even though the exact formula is not directly used in your code. The formula for mapping frequency to the Mel scale is as follows:
- (4)
- While the Mel filter bank is not directly implemented, p-spectrum helps achieve a similar effect by emphasizing certain frequency ranges. The frequency resolution parameter essentially dictates the resolution of the time–frequency representation, allowing the low-frequency bands (where bearing fault characteristics are more likely to be found) to be more pronounced.
- (5)
- A visual representation of the Mel-transformed scalogram for each class is generated with all labels as attached in Figure 2.
2.2. Convolutional Autoencoders (CAEs)
2.3. ANN
2.4. FOX Optimizer
2.5. FOX–ANN
3. Results and Performance Evaluation
3.1. Experimental Setup and Data Acquisition
3.2. Performance Metrics for Comparisons
3.3. Comparative Analysis of Fault Diagnosis Methods
4. Conclusions
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Conflicts of Interest
Nomenclature
STFT | Short-Time Fourier Transform |
CWT | Continuous Wavelet Transform |
IRF | Inner Race Fault |
ORF | Outer Race Fault |
RF | Roller Fault |
NC | Normal Condition |
CNN | Convolutional Neural network |
Bi-LSTM | Bidirectional Long Short Time Memory |
ReLU | Rectified Linear Unit |
TPR | True Positive Rate |
ANN | Artificial Neural Network |
References
- Sun, Y.; Wang, J.; Wang, X. Fault diagnosis of mechanical equipment in high energy consumption industries in China: A review. Mech. Syst. Signal Process. 2023, 186, 109833. [Google Scholar] [CrossRef]
- Sahu, A.R.; Palei, S.K.; Mishra, A. Data-driven fault diagnosis approaches for industrial equipment: A review. Expert. Syst. 2024, 41, e13360. [Google Scholar] [CrossRef]
- Bi, S.; Wang, C.; Wu, B.; Hu, S.; Huang, W.; Ni, W.; Gong, Y.; Wang, X. A comprehensive survey on applications of AI technologies to failure analysis of industrial systems. Eng. Fail. Anal. 2023, 148, 107172. [Google Scholar] [CrossRef]
- Kibrete, F.; Woldemichael, D.E. Applications of Artificial Intelligence for Fault Diagnosis of Rotating Machines: A Review. In International Conference on Advances of Science and Technology; Springer: Cham, Switzerland, 2023; pp. 41–62. [Google Scholar] [CrossRef]
- Lei, Y.; Lin, J.; Zuo, M.J.; He, Z. Condition monitoring and fault diagnosis of planetary gearboxes: A review. Measurement 2014, 48, 292–305. [Google Scholar] [CrossRef]
- Wang, H.; Li, S.; Song, L.; Cui, L.; Wang, P. An Enhanced Intelligent Diagnosis Method Based on Multi-Sensor Image Fusion via Improved Deep Learning Network. IEEE Trans. Instrum. Meas. 2020, 69, 2648–2657. [Google Scholar] [CrossRef]
- Xu, X.; Cao, D.; Zhou, Y.; Gao, J. Application of neural network algorithm in fault diagnosis of mechanical intelligence. Mech. Syst. Signal Process. 2020, 141, 106625. [Google Scholar] [CrossRef]
- Lei, Y.; Yang, B.; Jiang, X.; Jia, F.; Li, N.; Nandi, A.K. Applications of machine learning to machine fault diagnosis: A review and roadmap. Mech. Syst. Signal Process. 2020, 138, 106587. [Google Scholar] [CrossRef]
- Wang, J.; Liang, Y.; Zheng, Y.; Gao, R.X.; Zhang, F. An integrated fault diagnosis and prognosis approach for predictive maintenance of wind turbine bearing with limited samples. Renew. Energy 2020, 145, 642–650. [Google Scholar] [CrossRef]
- Nguyen, C.D.; Ahmad, Z.; Kim, J.-M. Gearbox fault identification framework based on novel localized adaptive denoising technique, wavelet-based vibration imaging, and deep convolutional neural network. Appl. Sci. 2021, 11, 7575. [Google Scholar] [CrossRef]
- Ahmad, S.; Ahmad, Z.; Kim, J.-M. A Centrifugal Pump Fault Diagnosis Framework Based on Supervised Contrastive Learning. Sensors 2022, 22, 6448. [Google Scholar] [CrossRef]
- Samanta, B.; Al-Balushi, K.R. Artificial neural network based fault diagnostics of rolling element bearings using time-domain features. Mech. Syst. Signal Process. 2003, 17, 317–328. [Google Scholar] [CrossRef]
- Kang, M.; Kim, J.; Wills, L.M.; Kim, J.-M. Time-varying and multiresolution envelope analysis and discriminative feature analysis for bearing fault diagnosis. IEEE Trans. Ind. Electron. 2015, 62, 7749–7761. [Google Scholar] [CrossRef]
- Liu, R.; Yang, B.; Zhang, X.; Wang, S.; Chen, X. Time-frequency atoms-driven support vector machine method for bearings incipient fault diagnosis. Mech. Syst. Signal Process. 2016, 75, 345–370. [Google Scholar] [CrossRef]
- Yao, P.; Wang, J.; Zhang, F.; Li, W.; Lv, S.; Jiang, M.; Jia, L. Intelligent rolling bearing imbalanced fault diagnosis based on Mel-Frequency Cepstrum Coefficient and Convolutional Neural Networks. Measurement 2022, 205, 112143. [Google Scholar] [CrossRef]
- Zhao, M.; Tang, B.; Tan, Q. Bearing remaining useful life estimation based on time–frequency representation and supervised dimensionality reduction. Measurement 2016, 86, 41–55. [Google Scholar] [CrossRef]
- Widodo, A.; Yang, B.-S. Support vector machine in machine condition monitoring and fault diagnosis. Mech. Syst. Signal Processing 2007, 21, 2560–2574. [Google Scholar] [CrossRef]
- Peng, Z.; Chu, F.; He, Y. Vibration signal analysis and feature extraction based on reassigned wavelet scalogram. J. Sound Vib. 2002, 253, 1087–1100. [Google Scholar] [CrossRef]
- Han, T.; Li, Y.-F.; Qian, M. A Hybrid Generalization Network for Intelligent Fault Diagnosis of Rotating Machinery Under Unseen Working Conditions. IEEE Trans. Instrum. Meas. 2021, 70, 3520011. [Google Scholar] [CrossRef]
- Zaman, W.; Ahmad, Z.; Siddique, M.F.; Ullah, N.; Kim, J.-M. Centrifugal Pump Fault Diagnosis Based on a Novel SobelEdge Scalogram and CNN. Sensors 2023, 23, 5255. [Google Scholar] [CrossRef]
- Zhang, S.; Zhang, S.; Wang, B.; Habetler, T.G. Deep Learning Algorithms for Bearing Fault Diagnostics—A Comprehensive Review. IEEE Access 2020, 8, 29857–29881. [Google Scholar] [CrossRef]
- Cao, S.; Hu, Z.; Luo, X.; Wang, H. Research on fault diagnosis technology of centrifugal pump blade crack based on PCA and GMM. Measurement 2021, 173, 108558. [Google Scholar] [CrossRef]
- Zhou, T.; Han, T.; Droguett, E.L. Towards trustworthy machine fault diagnosis: A probabilistic Bayesian deep learning framework. Reliab. Eng. Syst. Saf. 2022, 224, 108525. [Google Scholar] [CrossRef]
- Zhiyi, H.; Haidong, S.; Xiang, Z.; Yu, Y.; Junsheng, C. An intelligent fault diagnosis method for rotor-bearing system using small labeled infrared thermal images and enhanced CNN transferred from CAE. Adv. Eng. Informatics 2020, 46, 101150. [Google Scholar] [CrossRef]
- Janssens, O.; Slavkovikj, V.; Vervisch, B.; Stockman, K.; Loccufier, M.; Verstockt, S.; Van de Walle, R.; Van Hoecke, S. Convolutional Neural Network Based Fault Detection for Rotating Machinery. J. Sound Vib. 2016, 377, 331–345. [Google Scholar] [CrossRef]
- Zhang, W.; Zhang, T.; Cui, G.; Pan, Y. Intelligent Machine Fault Diagnosis Using Convolutional Neural Networks and Transfer Learning. IEEE Access 2022, 10, 50959–50973. [Google Scholar] [CrossRef]
- Ding, X.; He, Q. Energy-Fluctuated Multiscale Feature Learning with Deep ConvNet for Intelligent Spindle Bearing Fault Diagnosis. IEEE Trans. Instrum. Meas. 2017, 66, 1926–1935. [Google Scholar] [CrossRef]
- Wen, L.; Li, X.; Gao, L.; Zhang, Y. A New Convolutional Neural Network-Based Data-Driven Fault Diagnosis Method. IEEE Trans. Ind. Electron. 2018, 65, 5990–5998. [Google Scholar] [CrossRef]
- Ezzat, D.; Hassanien, A.E.; Darwish, A.; Yahia, M.; Ahmed, A.; Abdelghafar, S. Multi-Objective Hybrid Artificial Intelligence Approach for Fault Diagnosis of Aerospace Systems. IEEE Access 2021, 9, 41717–41730. [Google Scholar] [CrossRef]
- Wu, Y.-C.; Feng, J.-W. Development and Application of Artificial Neural Network. Wirel. Pers. Commun. 2018, 102, 1645–1656. [Google Scholar] [CrossRef]
- Toma, R.N.; Prosvirin, A.E.; Kim, J.-M. Bearing Fault Diagnosis of Induction Motors Using a Genetic Algorithm and Machine Learning Classifiers. Sensors 2020, 20, 1884. [Google Scholar] [CrossRef]
- Zhang, Y.; Zhou, T.; Huang, X.; Cao, L.; Zhou, Q. Fault diagnosis of rotating machinery based on recurrent neural networks. Measurement 2020, 171, 108774. [Google Scholar] [CrossRef]
- Ullah, N.; Siddique, M.F.; Ullah, S.; Ahmad, Z.; Kim, J.-M. Pipeline Leak Detection System for a Smart City: Leveraging Acoustic Emission Sensing and Sequential Deep Learning. Smart Cities 2024, 7, 2318–2338. [Google Scholar] [CrossRef]
- Zhao, Z.-Q. A novel modular neural network for imbalanced classification problems. Pattern Recognit. Lett. 2009, 30, 783–788. [Google Scholar] [CrossRef]
- Siddique, M.F.; Ahmad, Z.; Kim, J.-M. Pipeline leak diagnosis based on leak-augmented scalograms and deep learning. Eng. Appl. Comput. Fluid Mech. 2023, 17, 2225577. [Google Scholar] [CrossRef]
- He, M.; He, D. Deep Learning Based Approach for Bearing Fault Diagnosis. IEEE Trans. Ind. Appl. 2017, 53, 3057–3065. [Google Scholar] [CrossRef]
- Wong, A.; Wang, X.Y. A Bayesian Residual Transform for Signal Processing. IEEE Access 2015, 3, 709–717. [Google Scholar] [CrossRef]
- Ullah, S.; Ahmad, Z.; Kim, J.-M. Fault Diagnosis of a Multistage Centrifugal Pump Using Explanatory Ratio Linear Discriminant Analysis. Sensors 2024, 24, 1830. [Google Scholar] [CrossRef]
- Theis, L.; Shi, W.; Cunningham, A.; Huszár, F. Lossy Image Compression with Compressive Autoencoders. arXiv 2017, arXiv:1703.00395. [Google Scholar]
- Ballé, J.; Laparra, V.; Simoncelli, E.P. End-to-end Optimized Image Compression. arXiv 2016, arXiv:1611.01704. [Google Scholar]
- Abiodun, O.I.; Jantan, A.; Omolara, A.E.; Dada, K.V.; Mohamed, N.A.; Arshad, H. State-of-the-art in artificial neural network applications: A survey. Heliyon 2018, 4, e00938. [Google Scholar] [CrossRef]
- Rasamoelina, A.D.; Adjailia, F.; Sincak, P. A Review of Activation Function for Artificial Neural Network. In Proceedings of the 2020 IEEE 18th World Symposium on Applied Machine Intelligence and Informatics (SAMI), Herlany, Slovakia, 23–25 January 2020; pp. 281–286. [Google Scholar]
- Carré, A.; Klausner, G.; Edjlali, M.; Lerousseau, M.; Briend-Diop, J.; Sun, R.; Ammari, S.; Reuzé, S.; Andres, E.A.; Estienne, T.; et al. Standardization of brain MR images across machines and protocols: Bridging the gap for MRI-based radiomics. Sci. Rep. 2020, 10, 12340. [Google Scholar] [CrossRef]
- Hodson, T.O. Root-mean-square error (RMSE) or mean absolute error (MAE): When to use them or not. Geosci. Model Dev. 2022, 15, 5481–5487. [Google Scholar] [CrossRef]
- Jumaah, M.A.; Shihab, A.I.; Farhan, A.A. Epileptic Seizures Detection Using DCT-II and KNN Classifier in Long-Term EEG Signals. Iraqi J. Sci. 2020, 61, 2687–2694. [Google Scholar] [CrossRef]
- Mohammed, N.A.; Al-Bazi, A. An adaptive backpropagation algorithm for long-term electricity load forecasting. Neural Comput. Appl. 2022, 34, 477–491. [Google Scholar] [CrossRef] [PubMed]
- Połap, D.; Woźniak, M. Red fox optimization algorithm. Expert Syst. Appl. 2021, 166, 114107. [Google Scholar] [CrossRef]
- Jumaah, M.A.; Ali, Y.H.; Rashid, T.A.; Vimal, S. FOXANN: A Method for Boosting Neural Network Performance. J. Soft Comput. Comput. Appl. 2024, 1, 2. [Google Scholar] [CrossRef]
- Zhang, Q.; Deng, L. An Intelligent Fault Diagnosis Method of Rolling Bearings Based on Short-Time Fourier Transform and Convolutional Neural Network. J. Fail. Anal. Prev. 2023, 23, 795–811. [Google Scholar] [CrossRef]
- Fu, G.; Wei, Q.; Yang, Y.; Li, C. Bearing fault diagnosis based on CNN-BiLSTM and residual module. Meas. Sci. Technol. 2023, 34, 125050. [Google Scholar] [CrossRef]
Type of Layer | No. of Filters/Neurons | Kernel Size | Output Shape | Activation Function | |
---|---|---|---|---|---|
0 | Input Layer | - | - | (None, 256, 256, 3) | - |
1 | Conv2D | 32 | (3, 3) | (None, 256, 256, 32) | ReLU |
2 | MaxPooling2D | - | - | (None, 128, 128, 32) | - |
3 | Conv2D | 64 | (3, 3) | (None, 128, 128, 64) | ReLU |
4 | MaxPooling2D | - | - | (None, 64, 64, 64) | - |
5 | Conv2D | 128 | (3, 3) | (None, 64, 64, 128) | ReLU |
6 | MaxPooling2D | - | - | (None, 32, 32, 128) | - |
7 | InputLayer | - | - | (None, 32, 32, 128) | - |
8 | Conv2D | 128 | (3, 3) | (None, 32, 32, 128) | ReLU |
9 | UpSampling2D | - | - | (None, 64, 64, 128) | - |
10 | Conv2D | 64 | (3, 3) | (None, 64, 64, 64) | ReLU |
11 | UpSampling2D | - | - | (None, 128, 128, 64) | - |
12 | Conv2D | 32 | (3, 3) | (None, 128, 128, 32) | ReLU |
13 | UpSampling2D | - | - | (None, 256, 256, 32) | - |
14 | Conv2D | 3 | (3, 3) | (None, 256, 256, 3) | softmax |
15 | Flatten | - | - | (None, 131072) | - |
16 | Dense | 512 | - | (None, 512) | ReLU |
17 | Dense | 256 | - | (None, 256) | ReLU |
18 | Dense | 128 | - | (None, 128) | ReLU |
19 | Dense | 4 | - | (None, 4) | softmax |
Device | Specification | Value |
---|---|---|
Vibration sensor (PCB-622B01) | Measurement range | ±490 m/s2 |
Frequency | 0.2–15,000 Hz | |
Sensitivity | 100 mV/g | |
AE sensor (R151-AST) | Operating range | 50–400 kHz |
Resonant frequency | 150 kHz | |
Peak sensitivity | −22 dB | |
DAQ (NI 9234) | Dynamic range | 102 dB |
Resolution | 24-bit | |
Operating temperature | −40 °C–70 °C |
Testing Condition | Samples Count | Sampling Rate (KHz) | Time (min) |
---|---|---|---|
IRF | 370 | 25 | 5 |
NC | 390 | 25 | 5 |
ORF | 347 | 25 | 5 |
RF | 309 | 25 | 5 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2024 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Siddique, M.F.; Zaman, W.; Ullah, S.; Umar, M.; Saleem, F.; Shon, D.; Yoon, T.H.; Yoo, D.-S.; Kim, J.-M. Advanced Bearing-Fault Diagnosis and Classification Using Mel-Scalograms and FOX-Optimized ANN. Sensors 2024, 24, 7303. https://doi.org/10.3390/s24227303
Siddique MF, Zaman W, Ullah S, Umar M, Saleem F, Shon D, Yoon TH, Yoo D-S, Kim J-M. Advanced Bearing-Fault Diagnosis and Classification Using Mel-Scalograms and FOX-Optimized ANN. Sensors. 2024; 24(22):7303. https://doi.org/10.3390/s24227303
Chicago/Turabian StyleSiddique, Muhammad Farooq, Wasim Zaman, Saif Ullah, Muhammad Umar, Faisal Saleem, Dongkoo Shon, Tae Hyun Yoon, Dae-Seung Yoo, and Jong-Myon Kim. 2024. "Advanced Bearing-Fault Diagnosis and Classification Using Mel-Scalograms and FOX-Optimized ANN" Sensors 24, no. 22: 7303. https://doi.org/10.3390/s24227303