Abstract
Bearings are an important component in rotating machinery and their failure can lead to serious injuries and economic losses, therefore the diagnosis of bearing faults and the guarantee of their smooth operation are essential steps in maintaining the safe and stable operation of modern machinery and equipment. Traditional bearing fault diagnosis methods focus on manually designing complex noise reduction, filtering, and feature extraction processes, however, these processes are too cumbersome and lack intelligence, making it increasingly difficult to rely on manual diagnosis with large amounts of data. With the development of information technology, convolutional neural networks have been proposed for bearing fault detection and identification. However, these convolutional models have the disadvantage of having difficulty handling fault-time information, leading to a lack of classification accuracy. So this paper proposes a transformer-based fault diagnosis method, using the short-time Fourier transform to convert the one-dimensional fault signal into a two-dimensional image, and then input the two-dimensional image into the transformer model for classification. Experimental results show that the fault classification can reach an accuracy of 98.45%.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Rai, A., Upadhyay, S.H.: A review on signal processing techniques utilized in the fault diagnosis of rolling element bearings. Tribol. Int. 96, 289–306 (2016)
Cerrada, M., et al.: A review on data-driven fault severity assessment in rolling bearings. Mech. Syst. Signal Process. 99, 169–196 (2018)
Chen, K., Huang, C., He, J.: Fault detection, classification and location for transmission lines and distribution systems: a review on the methods. High Voltage 1(1), 25–33 (2016)
Khan, F.N., et al.: Modulation format identification in coherent receivers using deep machine learning. IEEE Photon. Technol. Lett. 28(17), 1886–1889 (2016)
Zhang, H., et al.: Object-level video advertising: an optimization framework. IEEE Trans. Ind. Inform. 13(2), 520–531 (2016)
Zhang, H., et al.: Understanding subtitles by character-level sequence-to-sequence learning. IEEE Trans. Ind. Inform. 13(2), 616–624 (2016)
Ali, H., et al.: Speaker recognition with hybrid features from a deep belief network. Neural Comput. Appl. 29(6), 13–19 (2018)
Muhammad, U.R., et al.: Goal-driven sequential data abstraction. In: Proceedings of the IEEE/CVF International Conference on Computer Vision, pp. 71–80 (2019)
Liu, F.Y., Wang, S.H., Zhang, Y.D.: Survey on deep belief network model and its applications. Comput. Eng. Appl. 54(1), 11–18 (2018)
Khan, A., et al.: A survey of the recent architectures of deep convolutional neural networks. Artif. Intell. Rev. 53(8), 5455–5516 (2020)
Karpathy, A.: The unreasonable effectiveness of recurrent neural networks. Andrej Karpathy Blog 21, 23 (2015)
Ma, L., et al.: Bearing fault diagnosis based on convolutional neural network learning of time-domain vibration signal imaging. In: 2019 Chinese Control and Decision Conference (CCDC). IEEE, pp. 659–664 (2019)
Liu, Y., et al.: Hierarchical independence thresholding for learning Bayesian network classifiers. Knowl.-Based Syst. 212, 106627 (2021)
Sun, W., Paiva, A.R.C., Xu, P., Sundaram, A., Braatz, R.D.: Fault detection and identification using Bayesian recurrent neural networks. Comput. Chem. Eng. 141 (2020)
Chen, X., et al.: Rolling bearings fault diagnosis based on tree heuristic feature selection and the dependent feature vector combined with rough sets. Appl. Sci. 9(6), 1161 (2019)
Tong, T., Xu, X.: Improvement of power system fault diagnosis algorithm based on Petri Net. Int. Core J. Eng. 6(9), 319–334 (2020)
Long, J., Shelhamer, E., Darrell, T.: Fully convolutional networks for semantic segmentation. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 3431–3440 (2015)
Sun, W., et al.: A sparse auto-encoder-based deep neural network approach for induction motor faults classification. Measurement 89, 171–178 (2016)
Li, C., et al.: Multimodal deep support vector classification with homologous features and its application to gearbox fault diagnosis. Neurocomputing 168, 119–127 (2015)
Kiranyaz, S., et al.: Real-time fault detection and identification for MMC using 1-D convolutional neural networks. IEEE Trans. Industr. Electron. 66(11), 8760–8771 (2018)
Eren, L., Ince, T., Kiranyaz, S.: A generic intelligent bearing fault diagnosis system using compact adaptive 1D CNN classifier. J. Signal Process. Syst. 91(2), 179–189 (2019)
Abdeljaber, O., et al.: 1-D CNNs for structural damage detection: verification on a structural health monitoring benchmark data. Neurocomputing 275, 1308–1317 (2018)
Eren, L.: Bearing fault detection by one-dimensional convolutional neural networks. Math. Probl. Eng., 34–37 (2017)
Vaswani, A., et al.: Attention is all you need. In: Proceedings of the 31st International Conference on Neural Information Processing Systems, pp. 6000–6010 (2017)
Zheng, S., et al.: Rethinking semantic segmentation from a sequence-to-sequence perspective with transformers. arXiv Preprint, arXiv:2012-15840 (2020)
Zhao, R., et al.: Machine health monitoring using local feature-based gated recurrent unit networks. IEEE Trans. Ind. Electron. 65(2), 1539–1548 (2017)
Gabor, D.: Theory of communication. Part 1: The analysis of information. J. Instit. Electr. Eng. Pt. III Radio Commun. Eng. 93(26), 429–441 (1946)
Lou, X., Loparo, K.A.: Bearing fault diagnosis based on wavelet transform and fuzzy inference. Mech. Syst. Signal Process. 18(5), 1077–1095 (2004)
Smith, W.A., Randall, R.B.: Rolling element bearing diagnostics using the Case Western Reserve University data: A benchmark study. Mech. Syst. Signal Process. 64, 100–131 (2015)
Kingma, D.P., Ba, J.: Adam: a method for stochastic optimization. arXiv Preprint, arXiv:1412.6980 (2014)
Keskar, N.S., et al.: On large-batch training for deep learning: generalization gap and sharp minima. In: 5th International Conference on Learning Representations, ICLR 2017 (2019)
Hinchi, A.Z., Tkiouat, M.: Rolling element bearing remaining useful life estimation based on a convolutional long-short-term memory network. Procedia Comput. Sci. 127, 123–132 (2018)
Fan, Y., et al.: Study on a small sample rolling bearing fault diagnosis method based on BI-LSTM. Noise Vib. Control 40(4), 103–108 (2020)
Lu, C., Wang, Z., Zhou, B.: Intelligent fault diagnosis of rolling bearing using hierarchical convolutional network based health state classification. Adv. Eng. Inform. 32, 139–151 (2017)
Liang, T., et al.: Bearing fault diagnosis based on improved ensemble learning and deep belief network. In: Journal of Physics: Conference Series, vol. 1074, no. 1, p. 012154. IOP Publishing (2018)
Jia, F., et al.: Deep neural networks: a promising tool for fault characteristic mining and intelligent diagnosis of rotating machinery with massive data. Mech. Syst. Signal Process. 72, 303–315 (2016)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Bao, Z., Du, J., Zhang, W., Wang, J., Qiu, T., Cao, Y. (2021). A Transformer Model-Based Approach to Bearing Fault Diagnosis. In: Zeng, J., Qin, P., Jing, W., Song, X., Lu, Z. (eds) Data Science. ICPCSEE 2021. Communications in Computer and Information Science, vol 1451. Springer, Singapore. https://doi.org/10.1007/978-981-16-5940-9_5
Download citation
DOI: https://doi.org/10.1007/978-981-16-5940-9_5
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-16-5939-3
Online ISBN: 978-981-16-5940-9
eBook Packages: Computer ScienceComputer Science (R0)