Various intelligent methods for condition monitoring and fault diagnosis of mechanical equipment have been developed over the past few years. However, most of the existing deep learning (DL)-based fault diagnosis models perform well only when applied to deal with limited types of general failures, and these models fail to accurately distinguish fine-grained faults under multiple working conditions. To address these challenges, we propose a novel multiscale hybrid model (MSHM), which takes the raw vibration signal as input and progressively learns representative features containing both spatial and temporal information to effectively classify fine-grained faults in an end-to-end way. To simulate fine-grained failure scenarios in practice, more than 100 classes of faults under different working conditions are constructed based on two benchmark datasets, and the experimental results demonstrate that our proposed MSHM has advantages over state-of-the-art methods in terms of accuracy in identifying fine-grained faults, generality in handling fault classes of different granularity, and learning ability with limited data.
Citation: Chuanjiang Li, Shaobo Li, Lei Yang, Hongjing Wei, Ansi Zhang, Yizong Zhang. A novel multiscale hybrid neural network for intelligent fine-grained fault diagnosis[J]. Networks and Heterogeneous Media, 2023, 18(1): 444-462. doi: 10.3934/nhm.2023018
Various intelligent methods for condition monitoring and fault diagnosis of mechanical equipment have been developed over the past few years. However, most of the existing deep learning (DL)-based fault diagnosis models perform well only when applied to deal with limited types of general failures, and these models fail to accurately distinguish fine-grained faults under multiple working conditions. To address these challenges, we propose a novel multiscale hybrid model (MSHM), which takes the raw vibration signal as input and progressively learns representative features containing both spatial and temporal information to effectively classify fine-grained faults in an end-to-end way. To simulate fine-grained failure scenarios in practice, more than 100 classes of faults under different working conditions are constructed based on two benchmark datasets, and the experimental results demonstrate that our proposed MSHM has advantages over state-of-the-art methods in terms of accuracy in identifying fine-grained faults, generality in handling fault classes of different granularity, and learning ability with limited data.
[1] | C. J. Li, S. B. Li, A. S. Zhang, L. Yang, E. Zio, M. Pecht, et al., A Siamese hybrid neural network framework for few-shot fault diagnosis of fixed-wing unmanned aerial vehicles, J Comput Des Eng, 9 (2022), 1511–1524. https://doi.org/10.1093/jcde/qwac070 doi: 10.1093/jcde/qwac070 |
[2] | J. L. Chen, J. Pan, Z. P. Li, Y. Y. Zi, X. F. Chen, Generator bearing fault diagnosis for wind turbine via empirical wavelet transform using measured vibration signals, Renewable Energy, 89 (2016), 80–92. https://doi.org/10.1016/j.renene.2015.12.010 doi: 10.1016/j.renene.2015.12.010 |
[3] | D. D. Peng, Z. L. Liu, H. Wang, Y. Qin, L. M. Jia, A novel deeper one-dimensional CNN with residual learning for fault diagnosis of wheelset bearings in high-speed trains, IEEE Access, 7 (2018), 10278–10293. https://doi.org/10.1109/ACCESS.2018.2888842 doi: 10.1109/ACCESS.2018.2888842 |
[4] | R. X. Chen, L. L. Tang, X. L. Hu, H. N. Wu, Fault diagnosis method of low-speed rolling bearing based on acoustic emission signal and subspace embedded feature distribution alignment, IEEE Trans Ind Inf, 17 (2020), 5402–5410. https://doi.org/10.1109/TⅡ.2020.3028103 doi: 10.1109/TⅡ.2020.3028103 |
[5] | A. Rai, S. H. Upadhyay, A review on signal processing techniques utilized in the fault diagnosis of rolling element bearings, Tribol Int, 96 (2016), 289–306. https://doi.org/10.1016/j.triboint.2015.12.037 doi: 10.1016/j.triboint.2015.12.037 |
[6] | Z. J. Wang, W. H. Du, J. Y. Wang, J. Zhou, X. F. Han, Z. Y. Zhang, et al., Research and application of improved adaptive MOMEDA fault diagnosis method, Measurement, 140 (2019), 63–75. https://doi.org/10.1016/j.measurement.2019.03.033 doi: 10.1016/j.measurement.2019.03.033 |
[7] | A. B. Nassif, I. Shahin, I. Attili, M. Azzeh, K. Shaalan, Speech recognition using deep neural networks: A systematic review, IEEE Access, 7 (2019), 19143–19165. https://doi.org/10.1109/ACCESS.2019.2896880 doi: 10.1109/ACCESS.2019.2896880 |
[8] | Y. Li, H. K. Zhang, X. Z. Xue, Y. N. Jiang, Q. Shen, Deep learning for remote sensing image classification: A survey, WIREs Data Min Knowl Discovery, 8 (2018), e1264. https://doi.org/10.1002/widm.1264 doi: 10.1002/widm.1264 |
[9] | PM. Lavanya, E. Sasikala, Deep learning techniques on text classification using Natural language processing (NLP) in social healthcare network: A comprehensive survey, 2021 3rd International Conference on Signal Processing and Communication (ICPSC) (IEEE), (2021), 603–609. https://doi.org/10.1109/ICSPC51351.2021.9451752 doi: 10.1109/ICSPC51351.2021.9451752 |
[10] | C. Zhong, J. S. Wang, W. Z. Sun, Fault diagnosis method of rotating bearing based on improved ensemble empirical mode decomposition and deep belief network, Meas Sci Technol, 33 (2022), 085109. https://doi.org/10.1088/1361-6501/ac6cc9 doi: 10.1088/1361-6501/ac6cc9 |
[11] | C. J. Li, S. B. Li, A. S. Zhang, Q. He, Z. Liao, J. J. Hu, Meta-learning for few-shot bearing fault diagnosis under complex working conditions, Neurocomputing, 439 (2021), 197–211. https://doi.org/10.1016/j.neucom.2021.01.099 doi: 10.1016/j.neucom.2021.01.099 |
[12] | J. L. Li, R. X. Chen, X. Z. Huang, A sequence-to-sequence remaining useful life prediction method combining unsupervised LSTM encoding-decoding and temporal convolutional network, Meas Sci Technol, 33 (2022), 085013. https://doi.org/10.1088/1361-6501/ac632d doi: 10.1088/1361-6501/ac632d |
[13] | H. D. Shao, H. K. Jiang, X. Q. Li, S. P. Wu, Intelligent fault diagnosis of rolling bearing using deep wavelet auto-encoder with extreme learning machine, Knowledge-Based Systems, 140 (2018), 1–14. https://doi.org/10.1016/j.knosys.2017.10.024 doi: 10.1016/j.knosys.2017.10.024 |
[14] | W. Zhang, G. L. Peng, C. H. Li, Y. H. Chen, Z. J. Zhang, A new deep learning model for fault diagnosis with good anti-noise and domain adaptation ability on raw vibration signals, Sensors, 17 (2017), 425. https://doi.org/10.3390/s17020425 doi: 10.3390/s17020425 |
[15] | D. T. Hoang, H. J. Kang, Rolling element bearing fault diagnosis using convolutional neural network and vibration image, Cognit Syst Res, 53 (2019), 42–50. https://doi.org/10.1016/j.cogsys.2018.03.002 doi: 10.1016/j.cogsys.2018.03.002 |
[16] | Z. Y. Chen, W. H. Li, Multisensor feature fusion for bearing fault diagnosis using sparse autoencoder and deep belief network, IEEE Trans Instrum Meas, 66 (2017), 1693–1702. https://doi.org/10.1109/TIM.2017.2669947 doi: 10.1109/TIM.2017.2669947 |
[17] | H. K. Jiang, X. Li, H. D. Shao, K. Zhao, Intelligent fault diagnosis of rolling bearings using an improved deep recurrent neural network, Meas Sci Technol, 29 (2018), 065107. https://doi.org/10.1088/1361-6501/aab945 doi: 10.1088/1361-6501/aab945 |
[18] | H. R. Fang, J. Deng, B. Zhao, Y. Shi, J. Y. Zhou, S. Y Shao, LEFE-Net: A lightweight efficient feature extraction network with strong robustness for bearing fault diagnosis, IEEE Trans Instrum Meas, 70 (2021), 1–11. https://doi.org/10.1109/TIM.2021.3067187 doi: 10.1109/TIM.2021.3067187 |
[19] | Z. L. Liu, H. Wang, J. J. Liu, Y. Qin, D. D. Peng, Multitask learning based on lightweight 1DCNN for fault diagnosis of wheelset bearings, IEEE Trans Instrum Meas, 70 (2020), 1–11. https://doi.org/10.1109/TIM.2020.3017900 doi: 10.1109/TIM.2020.3017900 |
[20] | X. Chu, Y. Lin, Y. S. Wang, X. T. Wang, H. L. Yu, X. Gao, et al., Distance metric learning with joint representation diversification, International Conference on Machine Learning (PMLR), (2020), 1962–1973. |
[21] | C. P. Pang, Management optimization of equipment maintenance and spare parts for automobile intelligent manufacturing enterprises, Int J Front Eng Technol, (2022), 4. https://dx.doi.org/10.25236/IJFET.2022.040507 |
[22] | G. D. Sun, Y. Gao, K. Lin, Y. Hu, Fine-grained fault diagnosis method of rolling bearing combining multisynchrosqueezing transform and sparse feature coding based on dictionary learning, Shock Vib, 2019 (2019), 1–13. https://doi.org/10.1155/2019/1531079 doi: 10.1155/2019/1531079 |
[23] | Y. Wang, R. N. Liu, D. Lin, D. Y. Chen, P Li, Q. H. Hu, et al., Coarse-to-Fine: progressive knowledge transfer-based multitask convolutional neural network for intelligent large-scale fault diagnosis, IEEE Trans Neural Networks Learn Syst, (2021), 1–14. https://doi.org/10.1109/TNNLS.2021.3100928 doi: 10.1109/TNNLS.2021.3100928 |
[24] | K. M. He, X. Y. Zhang, S. Q. Ren, J. Sun, Deep residual learning for image recognition, Comput Vision Pattern Recognit, (2021), 770–781. https://doi.org/10.48550/arXiv.1512.03385 doi: 10.48550/arXiv.1512.03385 |
[25] | X. H. Chen, B. K. Zhang, D. Gao, Bearing fault diagnosis base on multi-scale CNN and LSTM model, J Intell Manuf, 32 (2021), 971–987. https://doi.org/10.1007/s10845-020-01600-2 doi: 10.1007/s10845-020-01600-2 |
[26] | Z. B. Zhao, T. F. Li, J. Y. Wu, C. Sun, S. B. Wang, R. Q. Yan, et al., Deep learning algorithms for rotating machinery intelligent diagnosis: An open source benchmark study, ISA Trans, 107 (2020), 224–255. https://doi.org/10.1016/j.isatra.2020.08.010 doi: 10.1016/j.isatra.2020.08.010 |
[27] | R. N. Liu, F. Wang, B. Y. Yang, S. J Qin, Multiscale kernel based residual convolutional neural network for motor fault diagnosis under nonstationary conditions, IEEE Trans Ind Inf, 16 (2019), 3797–3806. https://doi.org/10.1109/TⅡ.2019.2941868 doi: 10.1109/TⅡ.2019.2941868 |