Abstract
Wear particles produced by machines in the process of wear carry valuable information including wear mechanism and wear severity. Wear particle classification based on wear particle images provides predictive analysis for wear condition of machines. A novel wear particle recognition network based on feature fusion, FFWR-Net, is proposed in this research paper for wear particle images classification. In FFWR-Net, traditional feature extraction method by image processing technique (i.e. manually feature extracting) and deep learning convolutional neural network method (i.e. automatically feature extracting) is paralleled to extract the features of wear particle image. Then the features obtained by two different methods are fused together for building a wear particle classifier. In order to verify the effectiveness of the proposed classifier, it is compared with the previous convolutional neural network models on the same wear particle dataset. The comparison results show the accuracy and effectiveness of the proposed FFWR-Net classifier is better than the previous models.
Similar content being viewed by others
References
M. Kumar, P. S. Mukherjee and N. M. Misra, Advancement and current status of wear debris analysis for machine condition monitoring: a review, Industrial Lubrication and Tribology, 65(1) (2013) 3–11.
W. Cao et al., Prediction of wear trend of engines via on-line wear debris monitoring, Tribology International, 120(1) (2018) 510–519.
S. Wang et al., Three-dimensional reconstruction of wear particle surface based on photometric stereo, Measurement, 133(10) (2019) 350–360.
L. Zheng, H. Huan, Y. Zeng, S. Song, S. Cheng and C. Zhang, A study on the failure mechanism and wear loss of impregnated diamond bits during machining process of armor ceramics, Journal of Mechanical Science and Technology, 32(1) (2018) 261–268.
G. P. Stachowiak, G. W. Stachowiak and P. Podsiadlo, Automated classification of wear particles based on their surface texture and shape features, Tribology International, 41(1) (2008) 34–43.
W. Yuan et al., Shape classification of wear particles by image boundary analysis using machine learning algorithms, Mechanical Systems & Signal Processing, 72–73(10) (2016) 346–358.
N. K. Myshkin et al., The use of color in wear debris analysis, Wear, 250(2) (2001) 1218–1226.
S. Asgari, A. Mehrnia and M. Moussavi, Automatic detection of atrial fibrillation using stationary wavelet transform and support vector machine, Computers in Biology and Medicine, 60(3) (2015) 132–142.
Y. Peng et al., A hybrid search-tree discriminant technique for multivariate wear debris classification, Wear, 392–393(9) (2017) 152–158.
J. Wang and X. Wang, A wear particle identification method by combining principal component analysis and grey relational analysis, Wear, 304(1–2) (2013) 96–102.
B. Xu et al., Wear particle classification using genetic programming evolved features, Lubrication Science, 30(5) (2018) 229–246.
A. Krizhevsky, I. Sutskever and G. E. Hinton, ImageNet classification with deep convolutional neural networks, Communications of the ACM, 60(6) (2017) 84–90.
K. Simonyan and A. Zisserman, Very deep convolutional networks for large-scale image recognition, Computer Science (2014) arXiv preprint arXiv:1409.1556.
C. Szegedy et al., Going deeper with convolutions, The IEEE Conference on Computer Vision and Pattern Recognition (2015) 1–9.
K. He, X. Zhang, S. Ren and J. Sun, Deep residual learning for image recognition, The IEEE Conference on Computer Vision and Pattern Recognition (2016) 770–778.
X. Zhang et al., ShuffleNet: An extremely efficient convolutional neural network for mobile devices, The IEEE Conference on Computer Vision and Pattern Recognition (2018) 6848–6856.
S. Wang et al., Integrated model of BP neural network and CNN algorithm for automatic wear debris classification, Wear, 426–427(12) (2019) 1761–1770.
P. Peng and J. Wang, Wear particle classification considering particle overlapping, Wear, 422–423(1) (2019) 119–127.
P. Peng and J. Wang, FECNN: A promising model for wear particle recognition, Wear, 432–433 (2019) 202968.
Y. Peng et al., A hybrid convolutional neural network for intelligent wear particle classification, Tribology International, 138(5) (2019) 166–173.
Y. Peng et al., WP-DRnet: A novel wear particle detection and recognition network for automatic ferrograph image analysis, Tribology International, 151 (2020) 106379.
J. Wang et al., Direct detection of wear conditions by classification of ferrograph images, Journal of the Brazilian Society of Mechanical Sciences and Engineering, 42(4–5) (2020) 857–862.
J. Long, E. Shelhamer and T. Darrell, Fully convolutional networks for semantic segmentation, IEEE Transactions on Pattern Analysis and Machine Intelligence, 39(6) (2017) 640–651.
T. Y. Lin et al., Feature pyramid networks for object detection, The IEEE Conference on Computer Vision and Pattern Recognition (2017) 936–944.
S. Zhang et al., Single-shot refinement neural network for object detection, The IEEE Conference on Computer Vision and Pattern Recognition (2018) 4203–4212.
J. Yuan et al., Gated CNN: Integrating multi-scale feature layers for object detection, Pattern Recognition, 105 (2020) 10731.
P. Haffner et al., Gradient-based learning applied to document recognition, Proceedings of the IEEE, 86(11) (1998) 2278–2324.
S. Ioffe and C. Szegedy, Batch normalization: accelerating deep network training by reducing internal covariate shift (2015) arXiv preprint arXiv:1502.03167.
M. Lin et al., Network In Network (2013) arXiv preprint arXiv:1312.4400.
D. P. Kingma and J. Ba, Adam: A method for stochastic optimization (2014) arXiv preprint arXiv:1412.6980.
Acknowledgments
This paper is sponsored by the National Study Abroad Fund of China and supported by The National Key Research and Development Program of China (2017YFB1002304) and Fundamental Research Funds for the Central Universities (FRF-GF-20-16B).
Author information
Authors and Affiliations
Corresponding authors
Additional information
Recommended by Editor Hyung Wook Park
Suli Fan is a master candidate from the School of Computer and Communication Engineering, University of Science and Technology Beijing, PR China. Her current research interests include deep learning, computer vision and object detection.
Taohong Zhang received the Ph.D. degree from the Institute of Mechanics, Chinese Academy of Sciences, China, in 2005. Her current position is an Associate Professor at School of Computer and Communication Engineering, University of Science and Technology Beijing, China. Her research areas cover polymer degradation simulation, computer image processing, and object detection.
Xuxu Guo is a master candidate from the School of Computer and Communication Engineering, University of Science and Technology Beijing, PR China. His current research interests include deep learning, computer vision and object detection.
Aziguli Wulamu is Deputy Director of Beijing Key Laboratory of Knowledge Engineering in materials field of University of Science and Technology Beijing. Her research interests are knowledge engineering, knowledge mapping, deep learning and artificial intelligence. It has undertaken more than 30 national 863 projects, National Science and technology support, national key R&D programs and provincial and ministerial level projects in Beijing, and published more than 40 academic papers.
Rights and permissions
About this article
Cite this article
Fan, S., Zhang, T., Guo, X. et al. FFWR-Net: A feature fusion wear particle recognition network for wear particle classification. J Mech Sci Technol 35, 1699–1710 (2021). https://doi.org/10.1007/s12206-021-0333-6
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12206-021-0333-6