Skip to main content
SpringerLink
Log in

A Harmony Search-Based Wrapper-Filter Feature Selection Approach for Microstructural Image Classification

  • Technical Article
  • Published:
Integrating Materials and Manufacturing Innovation Aims and scope Submit manuscript

Abstract

Besides chemical composition, microstructure plays a key role to control the properties of engineering materials. A strong correlation exists between microstructure and many mechanical and physical properties of a metal. It has the utmost importance to understand the microstructure and distinguish the microstructure accurately for the appropriate selection of engineering materials in product fabrication. Computer vision and machine learning play a major role to extract the feature and predict the most probable class of a 7-class microstructural image with a high degree of accuracy. Features contain information about the image, and the classification function is defined in terms of features. Feature selection plays an important role in the classification problem to improve the classification accuracy and also to reduce the computational time by eliminating redundant or non-influential features. The current research aims at classifying microstructure image datasets by an improved wrapper-filter based feature selection method using texture-based feature descriptor. Before applying the feature selection method, a feature descriptor, called rotational local tetra pattern (RLTrP), is applied to extract the features from the input images. Then, an ensemble of three filter methods is developed by considering the union of the top-n features selected by Chi-square, Fisher score, and Gini impurity-based filter methods. The objective of this ensemble is to combine all possible important features selected by three filter methods which will be used to create an initial population of the wrapper-based meta-heuristic feature selection algorithm called, harmony search (HS). The novelty of this HS method lies in the objective function, which is defined as a function of Pearson correlation coefficient and mutual information to calculate the fitness value. The proposed method not only optimizes features with reduced dimension but also improves the performance of classification accuracy of the 7-class microstructural images. Moreover, the proposed HS model has also been compared with some standard optimization algorithms like whale optimization algorithm, particle swarm optimization, and Grey wolf optimization on the present dataset, and in every case, the HS method ensures better agreement between feature selection and classification accuracy than the other methods.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12

Similar content being viewed by others

References

  1. Clemens H, Mayer S, Scheu C (2017) Microstructure and properties of engineering materials. In: Neutrons and synchrotron radiation in engineering materials science: from fundamentals to applications, 2nd edn. https://doi.org/10.1002/9783527684489.ch1

  2. Gourgues-Lorenzon AF (2009) Application of electron backscatter diffraction to the study of phase transformations: present and possible future. J Microscopy 233(3):460–473. https://doi.org/10.1111/j.1365-2818.2009.03130.x

    Article  CAS  Google Scholar 

  3. Britz D, Webel J, Schneider A, Mücklich F (2017) Identifying and quantifying microstructures in low-alloyed steels: a correlative approach. Metallurgia Italiana 3:5–10

    Google Scholar 

  4. Carvalho ED, Antônio Filho OC, Silva RR, Araújo FH, Diniz JO, Silva AC, Paiva AC, Gattass M (2020) Breast cancer diagnosis from histopathological images using textural features and CBIR. Artif Intell Med 105:101845. https://doi.org/10.1016/j.artmed.2020.101845

    Article  Google Scholar 

  5. Zhao W, Li S, Li A, Zhang B, Li Y (2019) Hyperspectral images classification with convolutional neural network and textural feature using limited training samples. Remote Sens Lett 10(5):449–458. https://doi.org/10.1080/2150704X.2019.1569274

    Article  Google Scholar 

  6. Mather P, Tso B (2016) Classification methods for remotely sensed data. CRC Press, Boca Raton

    Book  Google Scholar 

  7. Weszka JS, Dyer CR, Rosenfeld A (1976) A comparative study of texture measures for terrain classification. IEEE Trans Syst Man Cybernetics 4:269–285. https://doi.org/10.1109/TSMC.1976.5408777

    Article  Google Scholar 

  8. Guan D, Xiang D, Tang X, Wang L, Kuang G (2019) Covariance of textural features: a new feature descriptor for SAR image classification. IEEE J Selected Topics Appl Earth Observations Remote Sens 12(10):3932–3942. https://doi.org/10.1109/JSTARS.2019.2944943

    Article  Google Scholar 

  9. Gajalakshmi K, Palanivel S, Nalini NJ, Saravanan S (2018) Automatic classification of cast iron grades using support vector machine. Optik 157:724–732. https://doi.org/10.1016/j.ijleo.2017.11.183

    Article  CAS  Google Scholar 

  10. Webel J, Gola J, Britz D, Mücklich F (2018) A new analysis approach based on Haralick texture features for the characterization of microstructure on the example of low-alloy steels. Mater Charact 144:584–596. https://doi.org/10.1016/j.matchar.2018.08.009

    Article  CAS  Google Scholar 

  11. Kitahara AR, Holm EA (2018) Microstructure cluster analysis with transfer learning and unsupervised learning. Integr Mater Manuf Innov 7(3):148–156. https://doi.org/10.1007/s40192-018-0116-9

    Article  Google Scholar 

  12. Gola J, Britz D, Staudt T, Winter M, Schneider AS, Ludovici M, Mücklich F (2018) Advanced microstructure classification by data mining methods. Comput Mater Sci 148:324–335. https://doi.org/10.1016/j.commatsci.2018.03.004

    Article  CAS  Google Scholar 

  13. Xue B, Zhang M, Browne WN, Yao X (2015) A survey on evolutionary computation approaches to feature selection. IEEE Trans Evolutionary Comput 20(4):606–626. https://doi.org/10.1109/TEVC.2015.2504420

    Article  Google Scholar 

  14. Mitra P, Murthy CA, Pal SK (2002) Unsupervised feature selection using feature similarity. IEEE Trans Pattern Anal Mach Intell 24(3):301–312. https://doi.org/10.1109/34.990133

    Article  Google Scholar 

  15. Kashef S, Nezamabadi-pour H (2015) An advanced ACO algorithm for feature subset selection. Neurocomputing 147:271–279. https://doi.org/10.1016/j.neucom.2014.06.067

    Article  Google Scholar 

  16. Duval B, Hao JK, Hernandez Hernandez JC (2009) A memetic algorithm for gene selection and molecular classification of cancer. In: Proceedings of the 11th annual conference on genetic and evolutionary computation, pp. 201–208. https://doi.org/10.1145/1569901.1569930

  17. DeCost BL, Holm EA (2015) A computer vision approach for automated analysis and classification of microstructural image data. Comput Mater Sci 110:126–133. https://doi.org/10.1016/j.commatsci.2015.08.011

    Article  Google Scholar 

  18. Chowdhury A, Kautz E, Yener B, Lewis D (2016) Image driven machine learning methods for microstructure recognition. Comput Mater Sci 123:176–187. https://doi.org/10.1016/j.commatsci.2016.05.034

    Article  Google Scholar 

  19. Gola J, Webel J, Britz D, Guitar A, Staudt T, Winter M, Mücklich F (2019) Objective microstructure classification by support vector machine (SVM) using a combination of morphological parameters and textural features for low carbon steels. Comput Mater Sci 160:186–196. https://doi.org/10.1016/j.commatsci.2019.01.006

    Article  CAS  Google Scholar 

  20. Diao R, Shen Q (2012) Feature selection with harmony search. IEEE Trans Syst Man Cybernetics Part B (Cybernetics) 42(6):1509–1523. https://doi.org/10.1109/TSMCB.2012.2193613

    Article  Google Scholar 

  21. Das S, Singh PK, Bhowmik S, Sarkar R, Nasipuri M (2017) A harmony search based wrapper feature selection method for Holistic Bangla word recognition. arXiv preprint arXiv:1707.08398. https://doi.org/10.1016/j.procs.2016.06.087

  22. Gholami J, Pourpanah F, Wang X (2020) Feature selection based on improved binary global harmony search for data classification. Appl Soft Comput. https://doi.org/10.1016/j.asoc.2020.106402

    Article  Google Scholar 

  23. Zainuddin Z, Lai KH, Ong P (2016) An enhanced harmony search based algorithm for feature selection: applications in epileptic seizure detection and prediction. Comput Electr Eng 53:143–162. https://doi.org/10.1016/j.compeleceng.2016.02.009

    Article  Google Scholar 

  24. Moayedikia A, Ong KL, Boo YL, Yeoh WG, Jensen R (2017) Feature selection for high dimensional imbalanced class data using harmony search. Eng Appl Artif Intelligence 57(2017):38–49. https://doi.org/10.1016/j.engappai.2016.10.008

    Article  Google Scholar 

  25. Nekkaa M, Boughaci D (2016) Hybrid harmony search combined with stochastic local search for feature selection. Neural Process Lett 44(1):199–220

    Article  Google Scholar 

  26. Dash R (2018) An adaptive harmony search approach for gene selection and classification of high dimensional medical data. J King Saud Univ Comput Inf Sci. https://doi.org/10.1016/j.jksuci.2018.02.013

    Article  Google Scholar 

  27. Ramos CC, Souza AN, Chiachia G, Falcão AX, Papa JP (2011) A novel algorithm for feature selection using harmony search and its application for non-technical losses detection. Comput Electr Eng 37(6):886–894. https://doi.org/10.1016/j.compeleceng.2011.09.013

    Article  Google Scholar 

  28. Huang Yin-Fu, Lin Sheng-Min, Huan-Yu Wu, Li Yu-Siou (2014) Music genre classification based on local feature selection using a self-adaptive harmony search algorithm. Data Knowl Eng 92:60–76. https://doi.org/10.1016/j.datak.2014.07.005

    Article  Google Scholar 

  29. Tao Y, Wang K, Yang J, An N, Li L (2015) Harmony search for feature selection in speech emotion recognition. In: 2015 International conference on affective computing and intelligent interaction (ACII), pp. 362–367. IEEE, 2015. https://doi.org/10.1109/ACII.2015.7344596

  30. Saha S, Ghosh M, Ghosh S, Sen S, Singh PK, Geem ZW, Sarkar R (2020) Feature selection for facial emotion recognition using cosine similarity-based harmony search algorithm. Appl Sci 10(8):2816. https://doi.org/10.3390/app10082816

    Article  CAS  Google Scholar 

  31. Haralick RM, Shanmugam K, Dinstein IH (1973) Textural features for image classification. IEEE Trans Syst Man Cybern 6:610–621. https://doi.org/10.1109/TSMC.1973.4309314

    Article  Google Scholar 

  32. Lowe DG (2004) Distinctive image features from scale-invariant keypoints. Int J Comput Vision 60(2):91–110

    Article  Google Scholar 

  33. Rublee E, Rabaud V, Konolige K, Bradski G (2011) ORB: an efficient alternative to SIFT or SURF. In: 2011 International conference on computer vision, pp. 2564–2571. IEEE, 2011. https://doi.org/10.1109/ICCV.2011.6126544

  34. Rosin PL (1999) Measuring corner properties. Comput Vis Image Underst 73(2):291–307. https://doi.org/10.1006/cviu.1998.0719

    Article  Google Scholar 

  35. Ojala T, Pietikainen M, Maenpaa T (2002) Multiresolution gray-scale and rotation invariant texture classification with local binary patterns. IEEE Trans Pattern Anal Mach Intell 7:971–987. https://doi.org/10.1109/TPAMI.2002.1017623

    Article  Google Scholar 

  36. Murala S, Maheshwari RP, Balasubramanian R (2012) Local tetra patterns: a new feature descriptor for content-based image retrieval. IEEE Trans Image Process 21(5):2874–2886. https://doi.org/10.1109/TIP.2012.2188809

    Article  Google Scholar 

  37. Tan X, Triggs B (2010) Enhanced local texture feature sets for face recognition under difficult lighting conditions. IEEE Trans Image Process 19(6):1635–1650. https://doi.org/10.1109/tip.2010.2042645

    Article  Google Scholar 

  38. Zhang B et al (2009) Local derivative pattern versus local binary pattern: face recognition with high-order local pattern descriptor. IEEE Trans Image Process 19(2):533–544. https://doi.org/10.1109/tip.2009.2035882

    Article  Google Scholar 

  39. Jin X, Xu A, Bie R, Guo P (2006) Machine learning techniques and Chi square feature selection for cancer classification using SAGE gene expression profiles. In: International workshop on data mining for biomedical applications, pp. 106–115. Springer, Berlin, Heidelberg

  40. Gu Q, Li Z, Han J (2012) Generalized fisher score for feature selection. arXiv preprint arXiv:1202.3725

  41. Shang W, Huang H, Zhu H, Lin Y, Youli Q, Wang Z (2007) A novel feature selection algorithm for text categorization. Expert Syst Appl 33(1):1–5. https://doi.org/10.1016/j.eswa.2006.04.001

    Article  Google Scholar 

  42. Geem ZW, Kim JH, Loganathan GV (2001) A new heuristic optimization algorithm: harmony search. Simulation 76(2):60–68. https://doi.org/10.1177/003754970107600201

    Article  Google Scholar 

  43. Khalid H. Sheikh (2019) Local tetra pattern. https://github.com/khalid0007/Local-Tetra-Pattern

  44. Sheikh KH (2019) Harmony Search. https://github.com/khalid0007/Metaheuristic-Algorithms/tree/master/HS

  45. Barber ZH, Leake JA, Clyne TW (2007) The DoITPoMS project—a web-based initiative for teaching and learning materials science. J Mater Educ 29(1/2):7

    Google Scholar 

  46. Mirjalili S, Lewis A (2016) The whale optimization algorithm. Adv Eng Softw 95:51–67. https://doi.org/10.1016/j.advengsoft.2016.01.008

    Article  Google Scholar 

  47. Kennedy J, Eberhart R (1995) Particle swarm optimization. In: Proceedings of ICNN’95 - international conference on neural networks. pp 1942–1948 vol 4 https://doi.org/10.1109/icnn.1995.488968

  48. Mirjalili S, Mirjalili S, Lewis A (2014) Grey wolf optimizer. Adv Eng Softw 69:46–61. https://doi.org/10.1016/j.advengsoft.2013.12.007

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Computer Science and Engineering, Government College of Engineering & Textile Technology Berhampore, Berhampore, 742101, India

    Shib Sankar Sarkar & Arpan Mahanty

  2. Department of Mechanical Engineering, Government College of Engineering & Textile Technology Berhampore, Berhampore, 742101, India

    Aniruddha Ghosh

  3. Department of Computer Science and Engineering, University of Kalyani, Kalyani, 741235, India

    Kalyani Mali

  4. Department of Computer Science and Engineering, Jadavpur University, Kolkata, 700032, India

    Khalid Hassan Sheikh & Ram Sarkar

Authors
  1. Shib Sankar Sarkar
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Khalid Hassan Sheikh
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Arpan Mahanty
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Kalyani Mali
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Aniruddha Ghosh
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Ram Sarkar
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Shib Sankar Sarkar.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Sarkar, S.S., Sheikh, K.H., Mahanty, A. et al. A Harmony Search-Based Wrapper-Filter Feature Selection Approach for Microstructural Image Classification. Integr Mater Manuf Innov 10, 1–19 (2021). https://doi.org/10.1007/s40192-020-00197-x

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s40192-020-00197-x

Keywords

Search

Navigation