Abstract
Fault patterns are often unavailable for machine fault diagnosis without prior knowledge. This makes it challenging to diagnose the existence of machine faults and their types. To address this issue, a novel scheme of deep soft assignments fusion network (DSAFN) is proposed for the self-supervised multi-view diagnosis of machine faults. To enhance the robustness of the model and prevent overfitting, random noise is added to the collected signals. In each view, vibration features are extracted by a denoising autoencoder. Using the extracted deep features, a soft assignment fusion strategy is proposed to fully utilize both the public and complementary information of multiple views. Critical diagnosis missions, including novel fault detection and fault clustering, are accomplished through binary clustering and multi-class clustering of DSAFN, respectively. Two diagnostic experiments are conducted to validate the proposed method. The results indicate that the proposed method performs better than state-of-the-art peer methods in terms of diagnostic accuracy and noise robustness.
Similar content being viewed by others
Data availability
The data that support the findings of this study are available from the corresponding author, upon reasonable request. The python codes are available at https://github.com/ManjunXiong/DSAFN.
References
Cen, J., Yang, Z., Liu, X., Xiong, J., & Chen, H. (2022). A review of data-driven machinery fault diagnosis using machine learning algorithms. Journal of Vibration Engineering & Technologies, 10(7), 2481–2507. https://doi.org/10.1007/s42417-022-00498-9
Diez-Olivan, A., Del Ser, J., Galar, D., & Sierra, B. (2019). Data fusion and machine learning for industrial prognosis: Trends and perspectives towards Industry 4.0. Information Fusion, 50, 92–111. https://doi.org/10.1016/j.inffus.2018.10.005
Gu, J., Jiao, L., Yang, S., & Liu, F. (2017). Fuzzy double c-means clustering based on sparse self-representation. IEEE Transactions on Fuzzy Systems, 26(2), 612–626. https://doi.org/10.1109/TFUZZ.2017.2686804
Hu, Q., Si, X., Qin, A., Lv, Y., & Liu, M. (2022). Balanced adaptation regularization based transfer learning for unsupervised cross-domain fault diagnosis. IEEE Sensors Journal, 22(12), 12139–12151. https://doi.org/10.1109/JSEN.2022.3174396
Jiang, Q., Chang, F., & Sheng, B. (2019). Bearing fault classification based on convolutional neural network in noise environment. IEEE Access, 7, 69795–69807. https://doi.org/10.1109/ACCESS.2019.2919126
Jiang, G., Jia, C., Nie, S., Wu, X., He, Q., & Xie, P. (2022). Multiview enhanced fault diagnosis for wind turbine gearbox bearings with fusion of vibration and current signals. Measurement, 196, 111159. https://doi.org/10.1016/j.measurement.2022.111159
Jieyang, P., Kimmig, A., Dongkun, W., Niu, Z., Zhi, F., Jiahai, W., Liu, X., & Ovtcharova, J. (2023). A systematic review of data-driven approaches to fault diagnosis and early warning. Journal of Intelligent Manufacturing, 34, 3277–3304. https://doi.org/10.1007/s10845-022-02020-0
Li, H., Huang, J., Gao, M., Yang, L., & Bao, Y. (2022). Multi-view information fusion fault diagnosis method based on attention mechanism and convolutional neural network. Applied Sciences, 12(22), 11410. https://doi.org/10.3390/app122211410
Li, J., Li, X., He, D., & Qu, Y. (2020). Unsupervised rotating machinery fault diagnosis method based on integrated SAE–DBN and a binary processor. Journal of Intelligent Manufacturing, 31, 1899–1916. https://doi.org/10.1007/s10845-020-01543-8
Liu, X., Wang, J., Meng, S., Qiu, X., & Zhao, G. (2023). Multi-view rotating machinery fault diagnosis with adaptive co-attention fusion network. Engineering Applications of Artificial Intelligence, 122, 106138. https://doi.org/10.1016/j.engappai.2023.106138
Li, Y., Yang, Y., Li, G., Xu, M., & Huang, W. (2017). A fault diagnosis scheme for planetary gearboxes using modified multi-scale symbolic dynamic entropy and mRMR feature selection. Mechanical Systems and Signal Processing, 91, 295–312. https://doi.org/10.1016/j.ymssp.2016.12.040
Li, Y., Yang, M., & Zhang, Z. (2018). A survey of multi-view representation learning. IEEE Transactions on Knowledge and Data Engineering, 31(10), 1863–1883. https://doi.org/10.1109/TKDE.2018.2872063
Lu, N., Cui, Z., Hu, H., & Yin, T. (2023). Multi-view and multi-level network for fault diagnosis accommodating feature transferability. Expert Systems with Applications, 213, 119057. https://doi.org/10.1016/j.eswa.2022.119057
Mrabah, N., Khan, N. M., Ksantini, R., & Lachiri, Z. (2020). Deep clustering with a dynamic autoencoder: From reconstruction towards centroids construction. Neural Networks, 130, 206–228. https://doi.org/10.1016/j.neunet.2020.07.005
Peng, B., Bi, Y., Xue, B., Zhang, M., & Wan, S. (2021). Multi-view feature construction using genetic programming for rolling bearing fault diagnosis. IEEE Computational Intelligence Magazine, 16(3), 79–94. https://doi.org/10.1109/MCI.2021.3084495
Pu, Z., Cabrera, D., Bai, Y., & Li, C. (2021). A one-class generative adversarial detection framework for multifunctional fault diagnoses. IEEE Transactions on Industrial Electronics, 69(8), 8411–8419. https://doi.org/10.1109/TIE.2021.3108719
Rodríguez Ramos, A., Bernal de Lázaro, J. M., Prieto-Moreno, A., da Silva Neto, A. J., & Llanes-Santiago, O. (2019). An approach to robust fault diagnosis in mechanical systems using computational intelligence. Journal of Intelligent Manufacturing, 30(4), 1601–1615. https://doi.org/10.1007/s10845-017-1343-1
Ruff, L., Vandermeulen, R. A., Görnitz, N., Binder, A., Müller, E., Müller, K. R., & Kloft, M. (2020). Deep semi-supervised anomaly detection. In Proceedings of 2020 international conference on learning representations. ICLR. https://doi.org/10.48550/arXiv.1906.02694
Smith, W. A., & Randall, R. B. (2015). Rolling element bearing diagnostics using the Case Western Reserve University data: A benchmark study. Mechanical Systems and Signal Processing, 64, 100–131. https://doi.org/10.1016/j.ymssp.2015.04.021
Sun, Z., & Sun, H. (2019). Stacked denoising autoencoder with density-grid based clustering method for detecting outlier of wind turbine components. IEEE Access, 7, 13078–13091. https://doi.org/10.1109/ACCESS.2019.2893206
Tang, Z., Bo, L., Liu, X., & Wei, D. (2022). A semi-supervised transferable LSTM with feature evaluation for fault diagnosis of rotating machinery. Applied Intelligence, 52(2), 1703–1717. https://doi.org/10.1007/s10489-021-02504-1
Tang, G., Huang, Y., & Wang, Y. (2021). Fractional frequency band entropy for bearing fault diagnosis under varying speed conditions. Measurement, 171, 108777. https://doi.org/10.1016/j.measurement.2020.108777
Vincent, P., Larochelle, H., Bengio, Y., & Manzagol, P. A. (2008). Extracting and composing robust features with denoising autoencoders. In Proceedings of the 25th international conference on machine Learning (pp. 1096–1103). https://dl.acm.org/doi/abs/10.1145/1390156.1390294.
Wan, W., Chen, J., Zhou, Z., & Shi, Z. (2022). Self-supervised simple Siamese framework for fault diagnosis of rotating machinery with unlabeled samples. IEEE Transactions on Neural Networks and Learning Systems. https://doi.org/10.1109/TNNLS.2022.3209332
Wang, T., Qiao, M., Zhang, M., Yang, Y., & Snoussi, H. (2020). Data-driven prognostic method based on self-supervised learning approaches for fault detection. Journal of Intelligent Manufacturing, 31, 1611–1619. https://doi.org/10.1007/s10845-018-1431-x
Wen, L., Gao, L., & Li, X. (2017). A new deep transfer learning based on sparse autoencoder for fault diagnosis. IEEE Transactions on Systems, Man, and Cybernetics: Systems, 49(1), 136–144. https://doi.org/10.1016/j.measurement.2020.108777
Xie, J., Girshick, R., & Farhadi, A. (2016). Unsupervised deep embedding for clustering analysis. In International conference on machine learning (pp. 478–487). PMLR.
Xu, J., Ren, Y., Li, G., Pan, L., Zhu, C., & Xu, Z. (2021). Deep embedded multi-view clustering with collaborative training. Information Sciences, 573, 279–290. https://doi.org/10.1016/j.ins.2020.12.073
Xu, J., Ren, Y., Tang, H., Yang, Z., Pan, L., Yang, Y., Pu, X., Yu, P., & He, L. (2022). Self-supervised discriminative feature learning for deep multi-view clustering. IEEE Transactions on Knowledge and Data Engineering, 35(7), 7470–7482. https://doi.org/10.1109/TKDE.2022.3193569
Yan, Y., Hao, H., Xu, B., Zhao, J., & Shen, F. (2020). Image clustering via deep embedded dimensionality reduction and probabilitybased triplet loss. IEEE Transactions on Image Processing, 29, 5652–5661. https://doi.org/10.1109/TIP.2020.2984360
Zhang, T., Chen, J., He, S., & Zhou, Z. (2022). Prior knowledge-augmented self-supervised feature learning for few-shot intelligent fault diagnosis of machines. IEEE Transactions on Industrial Electronics, 69(10), 10573–10584. https://doi.org/10.1109/TIE.2022.3140403
Zhu, Y., Peng, T., Su, S., Li, C., & Lu, S. (2021). Discriminant sensitive harmonic correlation fault diagnosis for rolling bearing. In 2021 IEEE international conference on data science and computer application (ICDSCA) (pp. 52–55). IEEE. https://doi.org/10.1109/ICDSCA53499.2021.9650301.
Acknowledgements
This work is supported in part by the National Key Research and Development Program of China (2023YFB3406104), and the National Natural Science Foundation of China (52175080, 72271036). The valuable comments and suggestions from the editor and the three anonymous reviewers are very much appreciated.
Author information
Authors and Affiliations
Corresponding authors
Ethics declarations
Conflict of interest
We declare that we do not have any commercial or associative interest that represents a Conflict of interest in connection with the work submitted.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Li, C., Wu, Y., Xiong, M. et al. Self-supervised fusion of deep soft assignments for multi-view diagnosis of machine faults. J Intell Manuf (2024). https://doi.org/10.1007/s10845-024-02360-z
Received:
Accepted:
Published:
DOI: https://doi.org/10.1007/s10845-024-02360-z