Skip to main content

Advertisement

Log in

An advance ensemble classification for object recognition

  • Original Article
  • Published:
Neural Computing and Applications Aims and scope Submit manuscript

Abstract

The quest to improve performance accuracy and prediction speed in machine learning algorithms cannot be overemphasized, as the need for machines to outperform humans continue to grow. Accordingly, several studies have proposed methods to improve prediction performance and speed particularly for spatio-temporal analysis. This study proposes a novel classifier that leverages ensemble techniques to improve prediction performance and speed. The proposed classifier, Ada-AdaSVM uses an AdaBoost feature selection algorithm to select small features of input datasets for a joint support vector machine (SVM)–AdaBoost classifier. The proposition is evaluated against a selection of existing classifiers (SVM, AdaSVM and AdaBoost) using the Jaffe, Yale, Taiwanese facial expression database (TFEID) and CK + 48 datasets with Haar features as the preferred method for feature extraction. The findings indicated that Ada-AdaSVM outperforms SVM, AdaSVM and AdaBoost classifiers in terms of speed and accuracy.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18
Fig. 19
Fig. 20
Fig. 21
Fig. 22
Fig. 23
Fig. 24

Similar content being viewed by others

References

  1. Mahadik K, Wu Q, Li S, Sabne A (2020) Fast distributed bandits for online recommendation systems. In: Proceedings of the 34th ACM international conference on supercomputing, pp 1–13

  2. Chawla NV, Lazarevic A, Hall LO, Bowyer KW (2003) SMOTEBoost: improving prediction of the minority class in boosting. In: Lavrač N, Gamberger D, Todorovski L, Blockeel H (eds) Lecture Notes in Computer Science, vol 2838, pp 107–119. Springer Verlag, Berlin Heidelberg

  3. Huang Z, Yang C, Chen X, Huang K, Xie Y (2019) Adaptive over-sampling method for classification with application to imbalanced datasets in aluminum electrolysis. In: Neural computing and applications, pp 1–17

  4. Twala B, Cartwright M, Shepperd M (2006) Ensemble of missing data techniques to improve software prediction accuracy. In: Proceedings—international conference on software engineering, May 2014, pp 909–912. https://doi.org/https://doi.org/10.1145/1134285.1134449

  5. Kim D (2005) Improving prediction performance of neural networks in pattern classification. Int J Comput Math 82(4):391–399. https://doi.org/10.1080/0020716042000301806

    Article  MathSciNet  MATH  Google Scholar 

  6. Wei S, Zuo D, Song J (2012) Improving prediction accuracy of river discharge time series using a wavelet-NAR artificial neural network. J Hydroinform 14(4):974–991. https://doi.org/10.2166/hydro.2012.143

    Article  Google Scholar 

  7. Błaszczyński J, Stefanowski J (2015) Neighbourhood sampling in bagging for imbalanced data. Neurocomputing 150(PB):529–542. https://doi.org/10.1016/j.neucom.2014.07.064

    Article  Google Scholar 

  8. Kuncheva LI, Skurichina M, Duin RPW (2002) An experimental study on diversity for bagging and boosting with linear classifiers. Inf Fusion 3(4):245–258. https://doi.org/10.1016/S1566-2535(02)00093-3

    Article  Google Scholar 

  9. Owusu E, Zhan Y, Mao QR (2014) A neural-AdaBoost based facial expression recognition system. Expert Syst Appl 41(7):3383–3390. https://doi.org/10.1016/j.eswa.2013.11.041

    Article  Google Scholar 

  10. Deng L (2014) A tutorial survey of architectures, algorithms, and applications for deep learning. APSIPA Trans Signal Inf Process 3(2):1–29. https://doi.org/10.1017/ATSIP.2013.99

    Article  Google Scholar 

  11. Auria L, Moro RA (2008) Support vector machines (SVM) as a technique for solvency analysis (No. 811), Berlin

  12. Tu JV (1996) Advantages and disadvantages of using artificial neural networks versus logistic regression for predicting medical outcomes. J Clin Epidemiol 49(11):1225–1231. https://doi.org/10.1016/S0895-4356(96)00002-9

    Article  Google Scholar 

  13. Guo Y, Liu Y, Oerlemans A, Lao S, Wu S, Lew MS (2016) Deep learning for visual understanding: a review. Neurocomputing. https://doi.org/10.1016/j.neucom.2015.09.116

    Article  Google Scholar 

  14. Mayr A, Binder H, Gefeller O, Schmid M (2014) The evolution of boosting algorithms: from machine learning to statistical modelling. Methods Inf Med 53(6):419–427. https://doi.org/10.3414/ME13-01-0122

    Article  Google Scholar 

  15. Schapire RE (2013) Explaining adaboost. Empirical Inference: Festschrift in Honor of Vladimir N Vapnik. https://doi.org/10.1007/978-3-642-41136-6_5

    Article  MATH  Google Scholar 

  16. Wang Y, Ai H, Wu B, Huang C (2004) Real time facial expression recognition with adaboost. Proc Int Conf Pattern Recognit 3:926–929. https://doi.org/10.1109/ICPR.2004.1334680

    Article  Google Scholar 

  17. Narsky I, Porter FC (2013) Reducing multiclass to binary. Stat Anal Tech Part Phys 1:371–379. https://doi.org/10.1002/9783527677320.ch16

    Article  Google Scholar 

  18. Friedman J, Hastie T, Tibshirani R (2000) Additive logistic regression: a statistical view of boosting (with discussion and a rejoinder by the authors). Ann Stat 28(2):337–407. https://doi.org/10.1214/aos/1016218223

    Article  MATH  Google Scholar 

  19. Lin C-J, Hsu C-W (2002) A comparison of methods for multi-class support vector machine. IEEE Trans Neural Netw 13(2):415–425

    Article  Google Scholar 

  20. Senior A (1998) A hidden Markov model fingerprint classifier. In: Signals, system and computers, pp 306–310

  21. Amami R, Ben Ayed D, Ellouze N (2013) The challenges of SVM optimization using Adaboost on a phoneme recognition problem. In: 4th IEEE international conference on cognitive infocommunications, CogInfoCom 2013—proceedings, pp 463–468. https://doi.org/https://doi.org/10.1109/CogInfoCom.2013.6719292

  22. Li X, Wang L, Sung E (2008) AdaBoost with SVM-based component classifiers. Eng Appl Artif Intell 21(5):785–795. https://doi.org/10.1016/j.engappai.2007.07.001

    Article  Google Scholar 

  23. Satiyan M, Nagarajan R (2010) Recognition of facial expression using Haar-like feature extraction method. In: 2010 international conference on intelligent and advanced systems, ICIAS 2010, pp 1–4. https://doi.org/https://doi.org/10.1109/ICIAS.2010.5716228

  24. Owusu E, Zhan YZ, Mao QR (2014) An SVM-AdaBoost-based face detection system. J Exp Theor Artif Intell 26(4):477–491. https://doi.org/10.1080/0952813X.2014.886300

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Isaac Wiafe.

Ethics declarations

Conflict of interest

Conflict of interest and authorship confirmation form please check the following as appropriate: all authors have participated in (a) conception and design, or analysis and interpretation of the data; (b) drafting the article or revising it critically for important intellectual content; and (c) approval of the final version. This manuscript has not been submitted to, nor is under review at, another journal or other publishing venue. The authors have no affiliation with any organization with a direct or indirect financial interest in the subject matter discussed in the manuscript.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Owusu, E., Wiafe, I. An advance ensemble classification for object recognition. Neural Comput & Applic 33, 11661–11672 (2021). https://doi.org/10.1007/s00521-021-05881-3

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00521-021-05881-3

Keywords

Navigation