Abstract
The quest to improve performance accuracy and prediction speed in machine learning algorithms cannot be overemphasized, as the need for machines to outperform humans continue to grow. Accordingly, several studies have proposed methods to improve prediction performance and speed particularly for spatio-temporal analysis. This study proposes a novel classifier that leverages ensemble techniques to improve prediction performance and speed. The proposed classifier, Ada-AdaSVM uses an AdaBoost feature selection algorithm to select small features of input datasets for a joint support vector machine (SVM)–AdaBoost classifier. The proposition is evaluated against a selection of existing classifiers (SVM, AdaSVM and AdaBoost) using the Jaffe, Yale, Taiwanese facial expression database (TFEID) and CK + 48 datasets with Haar features as the preferred method for feature extraction. The findings indicated that Ada-AdaSVM outperforms SVM, AdaSVM and AdaBoost classifiers in terms of speed and accuracy.
Similar content being viewed by others
References
Mahadik K, Wu Q, Li S, Sabne A (2020) Fast distributed bandits for online recommendation systems. In: Proceedings of the 34th ACM international conference on supercomputing, pp 1–13
Chawla NV, Lazarevic A, Hall LO, Bowyer KW (2003) SMOTEBoost: improving prediction of the minority class in boosting. In: Lavrač N, Gamberger D, Todorovski L, Blockeel H (eds) Lecture Notes in Computer Science, vol 2838, pp 107–119. Springer Verlag, Berlin Heidelberg
Huang Z, Yang C, Chen X, Huang K, Xie Y (2019) Adaptive over-sampling method for classification with application to imbalanced datasets in aluminum electrolysis. In: Neural computing and applications, pp 1–17
Twala B, Cartwright M, Shepperd M (2006) Ensemble of missing data techniques to improve software prediction accuracy. In: Proceedings—international conference on software engineering, May 2014, pp 909–912. https://doi.org/https://doi.org/10.1145/1134285.1134449
Kim D (2005) Improving prediction performance of neural networks in pattern classification. Int J Comput Math 82(4):391–399. https://doi.org/10.1080/0020716042000301806
Wei S, Zuo D, Song J (2012) Improving prediction accuracy of river discharge time series using a wavelet-NAR artificial neural network. J Hydroinform 14(4):974–991. https://doi.org/10.2166/hydro.2012.143
Błaszczyński J, Stefanowski J (2015) Neighbourhood sampling in bagging for imbalanced data. Neurocomputing 150(PB):529–542. https://doi.org/10.1016/j.neucom.2014.07.064
Kuncheva LI, Skurichina M, Duin RPW (2002) An experimental study on diversity for bagging and boosting with linear classifiers. Inf Fusion 3(4):245–258. https://doi.org/10.1016/S1566-2535(02)00093-3
Owusu E, Zhan Y, Mao QR (2014) A neural-AdaBoost based facial expression recognition system. Expert Syst Appl 41(7):3383–3390. https://doi.org/10.1016/j.eswa.2013.11.041
Deng L (2014) A tutorial survey of architectures, algorithms, and applications for deep learning. APSIPA Trans Signal Inf Process 3(2):1–29. https://doi.org/10.1017/ATSIP.2013.99
Auria L, Moro RA (2008) Support vector machines (SVM) as a technique for solvency analysis (No. 811), Berlin
Tu JV (1996) Advantages and disadvantages of using artificial neural networks versus logistic regression for predicting medical outcomes. J Clin Epidemiol 49(11):1225–1231. https://doi.org/10.1016/S0895-4356(96)00002-9
Guo Y, Liu Y, Oerlemans A, Lao S, Wu S, Lew MS (2016) Deep learning for visual understanding: a review. Neurocomputing. https://doi.org/10.1016/j.neucom.2015.09.116
Mayr A, Binder H, Gefeller O, Schmid M (2014) The evolution of boosting algorithms: from machine learning to statistical modelling. Methods Inf Med 53(6):419–427. https://doi.org/10.3414/ME13-01-0122
Schapire RE (2013) Explaining adaboost. Empirical Inference: Festschrift in Honor of Vladimir N Vapnik. https://doi.org/10.1007/978-3-642-41136-6_5
Wang Y, Ai H, Wu B, Huang C (2004) Real time facial expression recognition with adaboost. Proc Int Conf Pattern Recognit 3:926–929. https://doi.org/10.1109/ICPR.2004.1334680
Narsky I, Porter FC (2013) Reducing multiclass to binary. Stat Anal Tech Part Phys 1:371–379. https://doi.org/10.1002/9783527677320.ch16
Friedman J, Hastie T, Tibshirani R (2000) Additive logistic regression: a statistical view of boosting (with discussion and a rejoinder by the authors). Ann Stat 28(2):337–407. https://doi.org/10.1214/aos/1016218223
Lin C-J, Hsu C-W (2002) A comparison of methods for multi-class support vector machine. IEEE Trans Neural Netw 13(2):415–425
Senior A (1998) A hidden Markov model fingerprint classifier. In: Signals, system and computers, pp 306–310
Amami R, Ben Ayed D, Ellouze N (2013) The challenges of SVM optimization using Adaboost on a phoneme recognition problem. In: 4th IEEE international conference on cognitive infocommunications, CogInfoCom 2013—proceedings, pp 463–468. https://doi.org/https://doi.org/10.1109/CogInfoCom.2013.6719292
Li X, Wang L, Sung E (2008) AdaBoost with SVM-based component classifiers. Eng Appl Artif Intell 21(5):785–795. https://doi.org/10.1016/j.engappai.2007.07.001
Satiyan M, Nagarajan R (2010) Recognition of facial expression using Haar-like feature extraction method. In: 2010 international conference on intelligent and advanced systems, ICIAS 2010, pp 1–4. https://doi.org/https://doi.org/10.1109/ICIAS.2010.5716228
Owusu E, Zhan YZ, Mao QR (2014) An SVM-AdaBoost-based face detection system. J Exp Theor Artif Intell 26(4):477–491. https://doi.org/10.1080/0952813X.2014.886300
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
Conflict of interest and authorship confirmation form please check the following as appropriate: all authors have participated in (a) conception and design, or analysis and interpretation of the data; (b) drafting the article or revising it critically for important intellectual content; and (c) approval of the final version. This manuscript has not been submitted to, nor is under review at, another journal or other publishing venue. The authors have no affiliation with any organization with a direct or indirect financial interest in the subject matter discussed in the manuscript.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Owusu, E., Wiafe, I. An advance ensemble classification for object recognition. Neural Comput & Applic 33, 11661–11672 (2021). https://doi.org/10.1007/s00521-021-05881-3
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00521-021-05881-3