Abstract
In recent years, data-driven machine learning models have achieved good results in fault diagnosis of rotating machinery under different working conditions. However, in practical applications, the lack of fault samples under various working conditions makes the training of models difficult. In this paper, a multi scale meta-learning network (MS-MLN) that can be applied to few-shot cross-domain diagnosis of rotating machinery is proposed to address this issue. MS-MLN consists of a multi scale feature encoder, a metric embedding process and a classifier. The model is trained by an episodic metric meta-learning strategy under few-shot and domain shift scenarios. Extensive experiments are carried out to verify the effectiveness of MS-MLN, results show that MS-MLN outperforms most benchmark models in bearing and wind turbine gearbox fault diagnosis. Visualization is applied to the model to study its effectiveness. Ablation study is also conducted to discuss the impact of different parts of the model’s feature encoder on its performance in detail.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
Data availability
The data are available from the corresponding author on reasonable request.
References
Chang, Y., Chen, J., Qu, C., & Pan, T. (2020). Intelligent fault diagnosis of wind turbines via a deep learning network using parallel convolution layers with multi-scale Kernels. Renewable Energy, 153, 205–213. https://doi.org/10.1016/j.renene.2020.02.004
Changting, W., & Gao, R. X. (2000). 1–4 May 2000). Sensor placement strategy for in-situ bearing defect detection. Paper presented at the Proceedings of the 17th IEEE Instrumentation and Measurement Technology Conference [Cat. No. 00CH37066].
Chauhan, V. K., Dahiya, K., & Sharma, A. (2018). Problem formulations and solvers in linear SVM: A review. Artificial Intelligence Review, 52(2), 803–855. https://doi.org/10.1007/s10462-018-9614-6.
Chen, X., Zhang, B., & Gao, D. (2020). Bearing fault diagnosis base on multi-scale CNN and LSTM model. Journal of Intelligent Manufacturing, 32(4), 971–987. https://doi.org/10.1007/s10845-020-01600-2.
Cheng, C., Zhou, B., Ma, G., Wu, D., & Yuan, Y. (2020). Wasserstein distance based deep adversarial transfer learning for intelligent fault diagnosis with unlabeled or insufficient labeled data. Neurocomputing, 409, 35–45. https://doi.org/10.1016/j.neucom.2020.05.040.
Deng, Y., Huang, D., Du, S., Li, G., Zhao, C., & Lv, J. (2021). A double-layer attention based adversarial network for partial transfer learning in machinery fault diagnosis. Computers in Industry. https://doi.org/10.1016/j.compind.2021.103399
Ding, Y., Jia, M., Miao, Q., & Cao, Y. (2022). A novel time–frequency transformer based on self–attention mechanism and its application in fault diagnosis of rolling bearings. Mechanical Systems and Signal Processing. https://doi.org/10.1016/j.ymssp.2021.108616
Dixit, S., Verma, N., & Ghosh, A. (2021). Intelligent fault diagnosis of rotary machines: Conditional auxiliary classifier GAN coupled with meta learning using limited data. IEEE Transactions on Instrumentation and Measurement. https://doi.org/10.1109/TIM.2021.3082264
Feng, Y., Chen, J., Yang, Z., Song, X., Chang, Y., He, S., & Zhou, Z. (2021). Similarity-based meta-learning network with adversarial domain adaptation for cross-domain fault identification. Knowledge-Based Systems. https://doi.org/10.1016/j.knosys.2021.106829
Feng, Y., Chen, J., Zhang, T., He, S., Xu, E., & Zhou, Z. (2022a). Semi-supervised meta-learning networks with squeeze-and-excitation attention for few-shot fault diagnosis. Isa Transactions, 120, 383–401. https://doi.org/10.1016/j.isatra.2021.03.013.
Feng, Y., Chen, J., Xie, J., Zhang, T., Lv, H., & Pan, T. (2022b). Meta-learning as a promising approach for few-shot cross-domain fault diagnosis: Algorithms, applications, and prospects. Knowledge-Based Systems. https://doi.org/10.1016/j.knosys.2021.107646
Finn, C., Abbeel, P., & Levine, S. (2017). Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks. Paper presented at the International Conference on Machine Learning, Sydney
Gao, R. X., Yan, R., Sheng, S., & Zhang, L. (2006). Sensor Placement and Signal Processing for Bearing Condition Monitoring. In L. Wang & R. X. Gao (Eds.), Condition Monitoring and Control for Intelligent Manufacturing (pp. 167–191). Springer.
Gao, S., He, J., Pan, H., & Gong, T. (2022). A multi-scale and lightweight bearing fault diagnosis model with small samples. Symmetry. https://doi.org/10.3390/sym14050909
García-Laencina, P. J., Sancho-Gómez, J. L., Figueiras-Vidal, A. R., & Verleysen, M. (2009). K nearest neighbours with mutual information for simultaneous classification and missing data imputation. Neurocomputing, 72(7–9), 1483–1493. https://doi.org/10.1016/j.neucom.2008.11.026.
Han, T., Liu, C., Wu, R., & Jiang, D. (2021). Deep transfer learning with limited data for machinery fault diagnosis. Applied Soft Computing. https://doi.org/10.1016/j.asoc.2021.107150
He, Z., Shao, H., Wang, P., Lin, J., Cheng, J., & Yang, Y. (2020). Deep transfer multi-wavelet auto-encoder for intelligent fault diagnosis of gearbox with few target training samples. Knowledge-Based Systems. https://doi.org/10.1016/j.knosys.2019.105313
Hoang, D. T., & Kang, H. J. (2019). A survey on deep learning based bearing fault diagnosis. Neurocomputing, 335, 327–335. https://doi.org/10.1016/j.neucom.2018.06.078
Hospedales, T., Antoniou, A., Micaelli, P., & Storkey, A. (2020). Meta-learning in neural networks: A survey. arXiv preprint arXiv:2004.05439.
Huang, W., Cheng, J., Yang, Y., & Guo, G. (2019). An improved deep convolutional neural network with multi-scale information for bearing fault diagnosis. Neurocomputing, 359, 77–92. https://doi.org/10.1016/j.neucom.2019.05.052.
Jiang, C., Chen, H., Xu, Q., & Wang, X. (2022). Few-shot fault diagnosis of rotating machinery with two-branch prototypical networks. Journal of Intelligent Manufacturing. https://doi.org/10.1007/s10845-021-01904-x.
KITTLER, J. (1978). A method for determining k-nearest neighbours. Kybernetes, 7, 313–315.
Koch, G., Zemel, R., & Salakhutdinov, R. (2015). Siamese neural networks for one-shot image recognition. Paper presented at the ICML deep learning workshop.
KQ, C., ZL, Z., XM, D., CX, M., & HA, W. (2021). Deep learning for multi-scale object detection: A survey. Journal of Software, 32, 7. https://doi.org/10.13328/j.cnki.jos.006166.
Lei, Y., Yang, B., Jiang, X., Jia, F., Li, N., & Nandi, A. K. (2020). Applications of machine learning to machine fault diagnosis: A review and roadmap. Mechanical Systems and Signal Processing. https://doi.org/10.1016/j.ymssp.2019.106587
Li, X., Zhang, W., & Ding, Q. (2019). Cross-domain fault diagnosis of rolling element bearings using deep generative neural networks. IEEE Transactions on Industrial Electronics, 66(7), 5525–5534. https://doi.org/10.1109/tie.2018.2868023
Meng, Y., Xuan, J., Xu, L., & Liu, J. (2022). Dynamic reweighted domain adaption for cross-domain bearing fault diagnosis. Machines. https://doi.org/10.3390/machines10040245
Mishra, M., & Srivastava, M. (2014). A View of Artificial Neural Network. Paper presented at the IEEE International Conference on Advances in Engineering & Technology Research (ICAETR – 2014), Unnao
Pan, S. J., & Yang, Q. (2010). A survey on transfer learning. IEEE Transactions on Knowledge and Data Engineering, 22(10), 1345–1359.
Qinghua Zhang, & Benveniste, A. (1992). Wavelet Networks. IEEE Transactions on Neural Networks, 3, 889–898.
Sheng, S. (2012). Wind turbine gearbox vibration condition monitoring benchmarking datasets. NREL National Wind Technology Center, Boulder, CO, Report No. NREL/TP-5000-54530.
Shao, S., McAleer, S., Yan, R., & Baldi, P. (2019). Highly accurate machine fault diagnosis using deep transfer learning. IEEE Transactions on Industrial Informatics, 15(4), 2446–2455. https://doi.org/10.1109/tii.2018.2864759
Sheng, S., Zhang, L., & Gao, R. X. (2006). A systematic sensor-placement strategy for enhanced defect detection in rolling bearings. IEEE Sensors Journal, 6(5), 1346–1354. https://doi.org/10.1109/jsen.2006.881421
Smith, W. A., & Randall, R. B. (2015). Rolling element bearing diagnostics using the Case Western Reserve University data: A benchmark study. Mechanical Systems and Signal Processing, 64–65, 100–131. https://doi.org/10.1016/j.ymssp.2015.04.021.
Snell, J., Swersky, K., & R, Z. (2017). Prototypical networks for few-shot learning. Advances in Neural Information Processing Systems, 30.
Su, H., Xiang, L., Hu, A., Xu, Y., & Yang, X. (2022). A novel method based on meta-learning for bearing fault diagnosis with small sample learning under different working conditions. Mechanical Systems and Signal Processing. https://doi.org/10.1016/j.ymssp.2021.108765
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., & Rabinovich, A. (2015). Going Deeper with Convolutions. Paper presented at the Proceedings of the IEEE conference on computer vision and pattern recognition.
Tang, S., Yuan, S., & Zhu, Y. (2020). Convolutional neural network in intelligent fault diagnosis toward rotatory machinery. Ieee Access : Practical Innovations, Open Solutions, 8, 86510–86519. https://doi.org/10.1109/access.2020.2992692
Vinyals, O., Blundell, C., Lillicrap, T., Kavukcuoglu, K., & Wierstra, D. (2016). Matching networks for one shot learning. Advances in Neural Information Processing Systems, 29.
Wang, S., Wang, D., Kong, D., Wang, J., Li, W., & Zhou, S. (2020). Few-shot rolling bearing fault diagnosis with metric-based meta learning. Sensors (Basel). https://doi.org/10.3390/s20226437
Wang, D., Zhang, M., Xu, Y., Lu, W., Yang, J., & Zhang, T. (2021a). Metric-based meta-learning model for few-shot fault diagnosis under multiple limited data conditions. Mechanical Systems and Signal Processing. https://doi.org/10.1016/j.ymssp.2020.107510
Wang, Y., Chen, L., Liu, Y., & Gao, L. (2021b). Wavelet-prototypical network based on fusion of time and frequency domain for fault diagnosis. Sensors (Basel). https://doi.org/10.3390/s21041483
Wen, L., Gao, L., & Li, X. (2019). A new deep transfer learning based on sparse auto-encoder for Fault diagnosis. IEEE Transactions on Systems Man and Cybernetics: Systems, 49(1), 136–144. https://doi.org/10.1109/tsmc.2017.2754287.
Wu, J., Zhao, Z., Sun, C., Yan, R., & Chen, X. (2020). Few-shot transfer learning for intelligent fault diagnosis of machine. Measurement. https://doi.org/10.1016/j.measurement.2020.108202
Yang, B., Lei, Y., Jia, F., & Xing, S. (2019). An intelligent fault diagnosis approach based on transfer learning from laboratory bearings to locomotive bearings. Mechanical Systems and Signal Processing, 122, 692–706. https://doi.org/10.1016/j.ymssp.2018.12.051.
Yu, C., Ning, Y., Qin, Y., Su, W., & Zhao, X. (2020). Multi-label fault diagnosis of rolling bearing based on meta-learning. Neural Computing and Applications, 33(10), 5393–5407. https://doi.org/10.1007/s00521-020-05345-0.
Yuan, H., Wu, N., Chen, X., & Wang, Y. (2021). Fault diagnosis of rolling bearing based on shift invariant sparse feature and optimized support vector machine. Machines. https://doi.org/10.3390/machines9050098
Zhang, R., Tao, H., Wu, L., & Guan, Y. (2017a). Transfer learning with neural networks for bearing fault diagnosis in changing working conditions. Ieee Access : Practical Innovations, Open Solutions, 5, 14347–14357. https://doi.org/10.1109/access.2017.2720965
Zhang, W., Peng, G., Li, C., Chen, Y., & Zhang, Z. (2017b). A new deep learning model for fault diagnosis with good anti-noise and domain adaptation ability on raw vibration signals. Sensors (Basel). https://doi.org/10.3390/s17020425
Zhu, J., Chen, N., & Shen, C. (2020). A new deep transfer learning method for bearing fault diagnosis under different working conditions. IEEE Sensors Journal, 20(15), 8394–8402. https://doi.org/10.1109/jsen.2019.2936932
Funding
The work is supported by the National Natural Science Foundation of China (No. 51975100), the Fundamental Research Funds for the Central Universities (No. DUT21GF210) and the National key research and development plan sub-project “Gear transmission system health status monitoring system development and platform verification (2019YFB2004604).
Author information
Authors and Affiliations
Contributions
Yu Wang ‘s contributions encompass the construction of models, experiment design and execution, data processing and paper writing. Liu Shujie initiated and guided the research direction, spanning topic selection and overarching research management, while securing the necessary financial support to support the research.
Corresponding author
Ethics declarations
Competing interest
The authors declare that they have no financial interests or personal relationships that could have appeared to influence the work reported in this paper.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Wang, Y., Liu, S. A multi scale meta-learning network for cross domain fault diagnosis with limited samples. J Intell Manuf (2024). https://doi.org/10.1007/s10845-024-02365-8
Received:
Accepted:
Published:
DOI: https://doi.org/10.1007/s10845-024-02365-8