Shape recognition through multi-level fusion of features and classifiers

  • Xinming Wang
  • Weili DingEmail author
  • Han Liu
  • Xiangsheng Huang
Original Paper


Shape recognition is a fundamental problem and a special type of image classification, where each shape is considered as a class. Current approaches to shape recognition mainly focus on designing low-level shape descriptors, and classify them using some machine learning approaches. To achieve effective learning of shape features, it is essential to ensure that a comprehensive set of high quality features can be extracted from the original shape data. Thus, we have been motivated to develop methods of fusion of features and classifiers for advancing the classification performance. In this paper, we propose a multi-level framework for fusion of features and classifiers in the setting of granular computing. The proposed framework involves creation of diversity among classifiers, through adopting feature selection and fusion to create diverse feature sets and to train diverse classifiers using different learning algorithms. The experimental results show that the proposed multi-level framework can effectively create diversity among classifiers leading to considerable advances in the classification performance.


Machine learning Ensemble learning Image classification Shape recognition Feature extraction Granular computing 



This work was supported by the National Key R&D Program of China (no. 2018YFB1308302), the National Natural Science Foundation of China (61573356) and the Natural Science Foundation of Hebei Province (no. F2016203211).


  1. Aha DW, Kibler D, Albert MK (1991) Instance-based learning algorithms. Mach Learn 6(1):37–66Google Scholar
  2. Arjun P, Mirnalinee TT (2018) An efficient image retrieval system based on multi-scale shape features. J Circuits Syst Comput 27(11):1850174Google Scholar
  3. Bai X, Liu W, Tu Z (2009) Integrating contour and skeleton for shape classification. In: 2009 IEEE 12th international conference on computer vision workshops, ICCV workshops, pp 360–367Google Scholar
  4. Belongie S, Malik J, Puzicha J (2002) Shape matching and object recognition using shape contexts. IEEE Trans Pattern Anal Mach Intell 24(4):509–522Google Scholar
  5. Bermejo P, Gámez J, Puerta J (2014) Speeding up incremental wrapper feature subset selection with naive bayes classifier. Knowl Based Syst 55:140–147Google Scholar
  6. Berthold MR (2003) Mixed fuzzy rule formation. Int J Approx Reason 32(2):67–84zbMATHGoogle Scholar
  7. Berthold MR, Diamond J (1998) Constructive training of probabilistic neural networks. Neurocomputing 19(1):167–183Google Scholar
  8. Bolón-Canedo V, Alonso-Betanzos A (2018) Ensembles for feature selection: a review and future trends. Inf Fusion 52:1–12Google Scholar
  9. Chatterjee K, Kar S (2017) Unified granular-number-based AHP-VIKOR multi-criteria decision framework. Granul. Comput 2(3):199–221Google Scholar
  10. Chen SM, Chang YC (2011) Weighted fuzzy rule interpolation based on ga-based weight-learning techniques. IEEE Trans Fuzzy Syst 19(4):729–744MathSciNetGoogle Scholar
  11. Chen SJ, Chen SM (2001) A new method to measure the similarity between fuzzy numbers. In: IEEE international conference on fuzzy systems. Melbourne, Australia, pp 1123–1126Google Scholar
  12. Chen SM, Chen CD (2011) Handling forecasting problems based on high-order fuzzy logical relationships. Expert Syst Appl 38(4):3857–3864Google Scholar
  13. Chen SM, Tanuwijaya K (2011) Fuzzy forecasting based on high-order fuzzy logical relationships and automatic clustering techniques. Expert Syst Appl 38(12):15425–15437Google Scholar
  14. Chen SM, Wang NY, Pan JS (2009) Forecasting enrollments using automatic clustering techniques and fuzzy logical relationships. Expert Syst Appl 36(8):11,070–11,076Google Scholar
  15. Chen SM, Munif A, Chen GS, Liu HC, Kuo BC (2012) Fuzzy risk analysis based on ranking generalized fuzzy numbers with different left heights and right heights. Expert Syst Appl 39(7):6320–6334Google Scholar
  16. Chen SM, Chang YC, Pan JS (2013) Fuzzy rules interpolation for sparse fuzzy rule-based systems based on interval type-2 gaussian fuzzy sets and genetic algorithms. IEEE Trans Fuzzy Syst 21(3):412–425Google Scholar
  17. Cutler A, Cutler DR, Stevens JR (2012) Random forests. Springer, Boston, pp 157–175Google Scholar
  18. Dash M, Liu H (1997) Feature selection for classification. Intell Data Anal 1(3):131–156Google Scholar
  19. Ding W, Gao X, Su Y, Li X (2015) A movement smoothness measuring algorithm based on curvature estimation. Chin High Technol Lett 25(8):835–842Google Scholar
  20. Ding M, Antani S, Jaeger S, Xue Z, Candemir S, Kohli M, Thoma G (2017) Local-global classifier fusion for screening chest radiographs. In: SPIE medical imagingGoogle Scholar
  21. Ding W, Wang X, Liu H, Hu B (2018) An empirical study of shape recognition in ensemble learning context. In: 2018 International conference on wavelet analysis and pattern recognition (ICWAPR). Chengdu, China, pp 256–261Google Scholar
  22. Friedman J (2000) Greedy function approximation: a gradient boosting machine. Ann Stat 29:1189–1232MathSciNetzbMATHGoogle Scholar
  23. Giangreco Maidana A, Legal-Ayala H, Schaerer C, Villamayor-Venialbo W (2018) Contour-point signature shape descriptor for point correspondence. Int J Image Graph 18(1850):007MathSciNetGoogle Scholar
  24. Guan H, Antani SK, Long LR, Thoma GR (2010) Comparative study of shape retrieval using feature fusion approaches. In: Proceedings of the IEEE symposium on computer-based medical systems, pp 226–231Google Scholar
  25. Hu MK (1962) Visual pattern recognition by moment invariants. IRE Trans Inf Theory 8(2):179–187zbMATHGoogle Scholar
  26. Jović A, Brkić K, Bogunović N (2015) A review of feature selection methods with applications. In: 2015 38th International convention on information and communication technology, electronics and microelectronics (MIPRO), Opatija, Croatia, pp 1200–1205Google Scholar
  27. Kuncheva L (2002) A theoretical study on six classifier fusion strategies. IEEE Trans Pattern Anal Mach Intell 24:281–286Google Scholar
  28. Kurnianggoro L, Wahyono Jo KH (2018) A survey of 2D shape representation: methods, evaluations, and future research directions. Neurocomputing 300:1–16Google Scholar
  29. Lee LW, Chen SM (2008) Fuzzy multiple attributes group decision-making based on the extension of topsis method and interval type-2 fuzzy sets. In: Proceedings of the 2008 international conference on machine learning and cybernetics, Kunming, China, vol 6, pp 3260–3265Google Scholar
  30. Lin G, Zhu H, Kang X, Fan C, Zhang E (2013) Multi-feature structure fusion of contours for unsupervised shape classification. Pattern Recognit Lett 34(11):1286–1290Google Scholar
  31. Lin C, Pun CM, Vong CM, Adjeroh D (2015) Efficient shape classification using region descriptors. Multimedia Tools Appl 76:83–102Google Scholar
  32. Liu H, Cocea M (2017a) Fuzzy information granulation towards interpretable sentiment analysis. Granul Comput 2(4):289–302Google Scholar
  33. Liu H, Cocea M (2017b) Granular computing based approach for classification towards reduction of bias in ensemble learning. Granul Comput 2(3):131–139Google Scholar
  34. Liu H, Cocea M (2018) Granular computing based machine learning: a big data processing approach. Springer, BerlinGoogle Scholar
  35. Liu P, You X (2017) Probabilistic linguistic todim approach for multiple attribute decision-making. Granul Comput 2(4):332–342MathSciNetGoogle Scholar
  36. Liu H, Cocea M, Ding W (2018) Multi-task learning for intelligent data processing in granular computing context. Granul Comput 3(3):257–273Google Scholar
  37. Lu G, Sajjanhar A (1999) Region-based shape representation and similarity measure suitable for content-based image retrieval. Multimedia Syst 7(2):165–174Google Scholar
  38. Maloň S, Freeman H (2009) On the encoding of arbitrary geometric configurations. IRE Trans EC Electron Comput 10(2):260–268MathSciNetGoogle Scholar
  39. Mohandes M, Deriche M, Aliyu SO (2018) Classifiers combination techniques: a comprehensive review. IEEE Access 6:19626–19639Google Scholar
  40. Mokhtarian F, Bober M (2003) Robust image corner detection through curvature scale space. Springer, DordrechtzbMATHGoogle Scholar
  41. Nakai G, Nakashima T, Ishibuchi H (2003) A fuzzy ensemble learning method for pattern classification. J Jpn Soc Fuzzy Theory Intell Inform 15(6):671–681Google Scholar
  42. Pedrycz W (2011) Information granules and their use in schemes of knowledge management. Sci Iran 18(3):602–610Google Scholar
  43. Pedrycz W, Chen SM (2011) Granular computing and intelligent systems: design with information granules of higher order and higher type. Springer, HeidelbergGoogle Scholar
  44. Pedrycz W, Chen SM (2015a) Granular computing and decision-making: interactive and iterative approaches. Springer, HeidelbergGoogle Scholar
  45. Pedrycz W, Chen SM (2015b) Information granularity, big data, and computational intelligence. Springer, HeidelbergGoogle Scholar
  46. Platt J (1999) Fast training of support vector machines using sequential minimal optimization. In: Schölkopf B, Burges CJC, Smola AJ (eds) Advances in kernel methods: support vector learning. MIT Press, Cambridge, MA, pp 185–208Google Scholar
  47. Priyanka S, Sudhakar M (2018) Tetrakis square tiling-based triangulated feature descriptor aiding shape retrieval. Digit Signal Process 79:125–135MathSciNetGoogle Scholar
  48. Quinlan R (1993) C4.5: programs for machine learning, vol 1. Morgan Kaufmann Publishers Inc., San Francisco, CA, USAGoogle Scholar
  49. Reed Teague M (1980) Image-analysis via the general-theory of moments. J Opt Soc Am (1917–1983) 69:1468Google Scholar
  50. Sekita I, Kurita T, Otsu N (1992) Complex autoregressive model for shape recognition. IEEE Trans Pattern Anal Mach Intell 14(4):489–496Google Scholar
  51. Shen W, Jiang Y, Gao W, Zeng D, Wang X (2016) Shape recognition by bag of skeleton-associated contour parts. Pattern Recognit Lett 83:321–329Google Scholar
  52. Sun KB, Super BJ (2005) Classification of contour shapes using class segment sets. In: 2005 IEEE computer society conference on computer vision and pattern recognition (CVPR’05), vol 2, pp 727–733Google Scholar
  53. Sun QS, Zeng SG, Liu Y, Heng PA, Xia DS (2005) A new method of feature fusion and its application in image recognition. Pattern Recognit 38(12):2437–2448Google Scholar
  54. Thakoor N, Gao J, Jung S (2007) Hidden markov model-based weighted likelihood discriminant for 2-D shape classification. IEEE Trans Image Process 16(11):2707–2719MathSciNetGoogle Scholar
  55. Wang HY, Chen SM (2008) Evaluating students’ answerscripts using fuzzy numbers associated with degrees of confidence. IEEE Trans Fuzzy Syst 16(2):403–415Google Scholar
  56. Wang X, Feng B, Bai X, Liu W, Latecki LJ (2014) Bag of contour fragments for robust shape classification. Pattern Recognit 47(6):2116–2125Google Scholar
  57. Wang A, An N, Chen G, Li L, Alterovitz G (2015) Accelerating wrapper-based feature selection with k-nearest-neighbor. Knowl Based Syst 83:81–91Google Scholar
  58. Wan L, Hong Y, Huang Z, Peng X, Li R (2018) A hybrid ensemble learning method for tourist route recommendations based on geo-tagged social networks. Int J Geograph Inf Sci 32:1–22Google Scholar
  59. Xu Z, Wang H (2016) Managing multi-granularity linguistic information in qualitative group decision making: an overview. Granul Comput 1(1):21–35Google Scholar
  60. Yang J, yu Yang J, Zhang D, feng Lu J (2003) Feature fusion: parallel strategy vs. serial strategy. Pattern Recognit 36(6):1369–1381zbMATHGoogle Scholar
  61. Yao J (2005a) Information granulation and granular relationships. IEEE international conference on granular computing, Beijing, China, pp 326–329Google Scholar
  62. Yao Y (2005b) Perspectives of granular computing. In: Proceedings of 2005 IEEE international conference on granular computing, Beijing, China, pp 85–90Google Scholar
  63. Yerima S, Sezer S (2018) DroidFusion: a novel multilevel classifier fusion approach for android malware detection. IEEE Trans Cybern 99:1–14Google Scholar
  64. Zadeh L (1965) Fuzzy sets. Inf Control 8(3):338–353zbMATHGoogle Scholar
  65. Zhang D, Lu G (2004) Review of shape representation and description techniques. Pattern Recognit 37(1):1–19Google Scholar
  66. Zulueta-Veliz Y, García-Cabrera L (2018) A choquet integral-based approach to multiattribute decision-making with correlated periods. Granul Comput 3(3):245–256Google Scholar

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  1. 1.Department of Automation, Institute of Electrical EngineeringYanshan UniversityHaigang DistrictChina
  2. 2.School of Computer Science and InformaticsCardiff UniversityCardiffUK
  3. 3.Institute of AutomationChinese Academy of SciencesBeijingChina

Personalised recommendations