Abstract
Traditional tool condition monitoring methods developed in an ideal environment are not universal in multiple working conditions considering different signal sources and recognition methods. This paper presents a novel tool condition monitoring approach that packages deep learning networks for accurate condition recognition with a cocktail solver library. First, the multisource signals from the machining process are collected and sequenced as the input of the cocktail solver library. The machining signals are transformed into a series of two-dimensional images by a continuous wavelet transform. In addition, ten pretrained networks with transfer learning are rapidly transferred with a finetuning operation, which contributes to a set of monitor networks. Three major processes are integrated by the cocktail solver library, which is the choosing dataset process for multi-signals, the training option process for network training parameters, and the network package process for the basic monitoring model. A Bayesian optimization method is employed to handle a tradeoff for these three processes to improve the prediction accuracy and reduce the recognition time. In the testing experiment, the milling datasets are used to train the model, and the results show that the accuracy of the model proposed in this paper can exceed 90%. The proposed method was also compared with other traditional methods to verify its effectiveness.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Agogino, A., & Goebel, K. (2007). Milling data set. BEST Lab, UC Berkeley. NASA Prognostics Data Repository, NASA Ames Research Center, Moffett Field, CA. Retrieved from http://ti.arc.nasa.gov/project/prognostic-data-repository
Ardakani, A. A., Kanafi, A. R., Acharya, U. R., Khadem, N., & Mohammadi, A. (2020). Application of deep learning technique to manage COVID-19 in routine clinical practice using CT images: Results of 10 convolutional neural networks. Computers in Biology and Medicine, 121, 103795. https://doi.org/10.1016/j.compbiomed.2020.103795
Aslan, A. (2020). Optimization and analysis of process parameters for flank wear, cutting forces and vibration in turning of AISI 5140: A comprehensive study. Measurement, 163, 107959. https://doi.org/10.1016/j.measurement.2020.107959
Bhat, N. N., Dutta, S., Vashisth, T., Pal, S., Pal, S. K., & Sen, R. (2016). Tool condition monitoring by SVM classification of machined surface images in turning. The International Journal of Advanced Manufacturing Technology, 83(9–12), 1487–1502. https://doi.org/10.1007/s00170-015-7441-3
Cabezas, M., Kentsch, S., Tomhave, L., Gross, J., Caceres, M. L. L., & Diez, Y. (2020). Detection of invasive species in wetlands: Practical DL with heavily imbalanced data. Remote Sensing., 12, 3431. https://doi.org/10.3390/rs12203431
Cao, P., Zhang, S., & Tang, J. (2018). Preprocessing-free gear fault diagnosis using small datasets with deep convolutional neural network-based transfer learning. IEEE Access, 6, 26241–26253. https://doi.org/10.1109/ACCESS.2018.2837621
Cao, X., Chen, B., Yao, B., & He, W. (2019). Combining translation-invariant wavelet frames and convolutional neural network for intelligent tool wear state identification. Computers in Industry, 106, 71–84. https://doi.org/10.1016/j.compind.2018.12.018
Cheng, C., Zhou, B., Ma, G., Wu, D., & Yuan, Y. (2020). Wasserstein distance based deep adversarial transfer learning for intelligent fault diagnosis with unlabeled or insufficient labeled data. Neurocomputing, 409, 35–45. https://doi.org/10.1016/j.neucom.2020.05.040
Dara, S., & Tumma, P. (2018). Feature extraction by using deep learning: A survey. 2018 Second International Conference on Electronics, Communication and Aerospace Technology (ICECA), 1795–1801. https://doi.org/10.1109/ICECA.2018.8474912
Ferrag, M. A., Shu, L., Friha, O., & Yang, X. (2021). Cyber security intrusion detection for agriculture 4.0: Machine learning-based solutions, datasets, and future directions. IEEE/CAA Journal of Automatica Sinica, 9(3), 407–436. https://doi.org/10.1109/JAS.2021.1004344
Hera, A., & Hou, Z. (2004). Application of wavelet approach for ASCE structural health monitoring benchmark studies. Journal of Engineering Mechanics, 130(1), 96–104. https://doi.org/10.1061/(ASCE)0733-9399(2004)130:1(96)
International Organization for Standardization. (1989). Tool life testing in milling—part 2: End milling ISO-8688-2. https://www.iso.org/standard/16092.html
Iwendi, C., Mohan, S., Khan, S., Ibeke, E., Ahmadian, A., & Ciano, T. (2022). Covid-19 fake news sentiment analysis. Computers and Electrical Engineering, 101, 107967. https://doi.org/10.1016/j.compeleceng.2022.107967
Lee, W. J., Wu, H., Huang, A., & Sutherland, J. W. (2020). Learning via acceleration spectrograms of a DC motor system with application to condition monitoring. The International Journal of Advanced Manufacturing Technology, 106(3–4), 803–816. https://doi.org/10.1007/s00170-019-04563-8
Li, Y., Mou, W., Li, J., Liu, C., & Gao, J. (2021). An automatic and accurate method for tool wear inspection using grayscale image probability algorithm based on Bayesian inference. Robotics and Computer-Integrated Manufacturing, 68, 102079. https://doi.org/10.1016/j.rcim.2020.102079
Li, X., Liu, X., Yue, C., Liang, S. Y., & Wang, L. (2022). Systematic review on tool breakage monitoring techniques in machining operations. International Journal of Machine Tools & Manufacture, 176, 103882. https://doi.org/10.1016/j.ijmachtools.2022.103882
Liao, Y., Ragai, I., Huang, Z., & Kerner, S. (2021). Manufacturing process monitoring using time-frequency representation and transfer learning of deep neural networks. Journal of Manufacturing Processes, 68, 231–248. https://doi.org/10.1016/j.jmapro.2021.05.046
Marei, M., Zaatari, S. E., & Li, W. (2021). Transfer learning enabled convolutional neural networks for estimating health state of cutting tools. Robotics and Computer-Integrated Manufacturing, 71, 102145. https://doi.org/10.1016/j.rcim.2021.102145
Miao, R., Gao, Y., Ge, L., Jiang, Z., & Zhang, J. (2019). Online defect recognition of narrow overlap weld based on two-stage recognition model combining continuous wavelet transform and convolutional neural network. Computers in Industry, 112, 103115. https://doi.org/10.1016/j.compind.2019.07.005
Mohanraj, T., Shankar, S., Rajasekar, R., Sakthivel, N. R., & Pramanik, A. (2020). Tool condition monitoring techniques in milling process—A review. Journal of Materials Research and Technology, 9(1), 1032–1042. https://doi.org/10.1016/j.jmrt.2019.10.031
Mostaghimi, H., Park, C. I., Kang, G., Park, S. S., & Lee, D. Y. (2021). Reconstruction of cutting forces through fusion of accelerometer and spindle current signals. Journal of Manufacturing Processes, 68, 990–1003. https://doi.org/10.1016/j.jmapro.2021.06.007
Nirwan, N. W., & Ramani, H. B. (2022). Condition monitoring and fault detection in roller bearing used in rolling mill by acoustic emission and vibration analysis. Materials Today: Proceedings, 51, 344–354. https://doi.org/10.1016/j.matpr.2021.05.447
Opitz, J., & Burst, S. (2019). Macro F1 and Macro F1. https://doi.org/10.48550/arXiv.1911.03347
Pardalos, P. M., Zhigljavsky, A., & Žilinskas, J. (2016). Advances in stochastic and deterministic global optimization. Springer International Publishing.
Pimenov, D. Y., Bustillo, A., Wojciechowski, S., Sharma, V. S., Gupta, M. K., & Kuntoğlu, M. (2022). Artificial intelligence systems for tool condition monitoring in machining: Analysis and critical review. Journal of Intelligent Manufacturing. https://doi.org/10.1007/s10845-022-01923-2
Sarıkaya, M., Gupta, M. K., Tomaz, I., Pimenov, D. Y., Kuntoğlu, M., Khanna, N., et al. (2021). A state-of-the-art review on tool wear and surface integrity characteristics in machining of superalloys. CIRP Journal of Manufacturing Science and Technology, 35, 624–658. https://doi.org/10.1016/j.cirpj.2021.08.005
Shahriari, B., Swersky, K., Wang, Z., Adams, R. P., & de Freitas, N. (2016). Taking the human out of the loop: a review of bayesian optimization. Proceedings of the IEEE, 104(1), 148–175. https://doi.org/10.1109/JPROC.2015.2494218
Sun, H., Zhang, J., Mo, R., & Zhang, X. (2020). In-process tool condition forecasting based on a deep learning method. Robotics and Computer-Integrated Manufacturing, 64, 101924. https://doi.org/10.1016/j.rcim.2019.101924
Traini, E., Bruno, G., & Lombardi, F. (2021). Tool condition monitoring framework for predictive maintenance: A case study on milling process. International Journal of Production Research, 59(23), 7179–7193. https://doi.org/10.1080/00207543.2020.1836419
Wu, J., Xu, X., Liu, C., Deng, C., & Shao, X. (2021). Lamb wave-based damage detection of composite structures using deep convolutional neural network and continuous wavelet transform. Composite Structures, 276, 114590. https://doi.org/10.1016/j.compstruct.2021.114590
Xu, D., Liao, Z., Axinte, D., & Hardy, M. (2020). A novel method to continuously map the surface integrity and cutting mechanism transition in various cutting conditions. International Journal of Machine Tools and Manufacture, 151, 103529. https://doi.org/10.1016/j.ijmachtools.2020.103529
Xu, L., Huang, C., Li, C., Wang, J., Liu, H., & Wang, X. (2021). Estimation of tool wear and optimization of cutting parameters based on novel ANFIS-PSO method toward intelligent machining. Journal of Intelligent Manufacturing, 32(1), 77–90. https://doi.org/10.1007/s10845-020-01559-0
Zhou, C., Guo, K., & Sun, J. (2021). An integrated wireless vibration sensing tool holder for milling tool condition monitoring with singularity analysis. Measurement, 174, 109038. https://doi.org/10.1016/j.measurement.2021.109038
Zhu, J., Chen, N., & Shen, C. (2020). A new deep transfer learning method for bearing fault diagnosis under different working conditions. IEEE Sensors Journal, 20(15), 8394–8402. https://doi.org/10.1109/JSEN.2019.2936932
Funding
This work is partially supported by the National Key Laboratory of Science and Technology on Helicopter Transmission (Grant No. HTL-A-21G09).
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Li, Y., Zhao, Z., Fu, Y. et al. A novel approach for tool condition monitoring based on transfer learning of deep neural networks using time–frequency images. J Intell Manuf 35, 1159–1171 (2024). https://doi.org/10.1007/s10845-023-02099-z
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10845-023-02099-z