Abstract
In this chapter, the algorithm summary of the main procedure of the deep rule-based (DRB) classifier described in Chap. 9 is provided. Numerical examples based on popular benchmark image sets including, handwritten digits recognition, remote sensing scene classification, face recognition and object recognition, etc., are presented for evaluating the performance of the DRB algorithm on image classification, and the state-of-the-art approaches are used for comparison. Numerical experiments show that DRB classifier is able to perform highly accurate classification in various image classification problems, and also demonstrate the advantages of its prototype-based nature and transparency over the existing approaches. The pseudo-code of the main procedure of the DRB classifier and the MATLAB implementations can be found in appendices B.5 and C.5, respectively.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
X. Gu, P.P. Angelov, J.C. Principe, A method for autonomous data partitioning. Inf. Sci. (Ny) 460–461, 65–82 (2018)
Y. LeCun, L. Bottou, Y. Bengio, P. Haffner, Gradient-based learning applied to document recognition. Proc. IEEE 86(11), 2278–2323 (1998)
F.S. Samaria, A.C. Harter, Parameterisation of a stochastic model for human face identification, in IEEE Workshop on Applications of Computer Vision (1994) pp. 138–142
http://www.cl.cam.ac.uk/research/dtg/attarchive/facedatabase.html
J. Gan, Q. Li, Z. Zhang, J. Wang, Two-level feature representation for aerial scene classification. IEEE Geosci. Remote Sens. Lett. 13(11), 1626–1630 (2016)
Y. Yang, S. Newsam, Bag-of-visual-words and spatial extensions for land-use classification, in International Conference on Advances in Geographic Information Systems (2010) pp. 270–279
L. Fei-Fei, R. Fergus, P. Perona, One-shot learning of object categories. IEEE Trans. Pattern Anal. Mach. Intell. 28(4), 594–611 (2006)
S. Gao, L. Duan, I.W. Tsang, DEFEATnet—A deep conventional image representation for image classification. IEEE Trans. Circuits Syst. Video Technol. 26(3), 494–505 (2016)
T. Larrain, J.S.J. Bernhard, D. Mery, K.W. Bowyer, Face recognition using sparse fingerprint classification algorithm. IEEE Trans. Inf. Forensics Secur. 12(7), 1646–1657 (2017)
P. Angelov, X. Gu, A cascade of deep learning fuzzy rule-based image classifier and SVM, in International Conference on Systems, Man and Cybernetics (2017) pp. 1–8
A. Oliva, A. Torralba, Modeling the shape of the scene: A holistic representation of the spatial envelope. Int. J. Comput. Vis. 42(3), 145–175 (2001)
N. Dalal, B. Triggs, Histograms of oriented gradients for human detection, in IEEE Computer Society Conference on Computer Vision and Pattern Recognition (2005) pp. 886–893
M. Ranzato, F.J. Huang, Y.L. Boureau, Y. LeCun, Unsupervised learning of invariant feature hierarchies with applications to object recognition, in Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (2007) pp. 1–8
K. Jarrett, K. Kavukcuoglu, M. Ranzato, Y. LeCun, What is the best multi-stage architecture for object recognition? in IEEE International Conference on Computer Vision (2009) pp. 2146–2153
D.C. Cireşan, U. Meier, L.M. Gambardella, J. Schmidhuber, Convolutional neural network committees for handwritten character classification. Int. Conf. Doc. Analysis Recogn. 10, 1135–1139 (2011)
D. Ciresan, U. Meier, J. Schmidhuber, Multi-column deep neural networks for image classification, in Conference on Computer Vision and Pattern Recognition (2012) pp. 3642–3649
P.P. Angelov, X. Gu, MICE: Multi-layer multi-model images classifier ensemble, in IEEE International Conference on Cybernetics (2017) pp. 436–443
J. Wang, C. Lu, M. Wang, P. Li, S. Yan, X. Hu, Robust face recognition via adaptive sparse representation. IEEE Trans. Cybern. 44(12), 2368–2378 (2014)
X. Shi, Y. Yang, Z. Guo, Z. Lai, Face recognition by sparse discriminant analysis via joint L2,1-norm minimization. Pattern Recogn. 47(7), 2447–2453 (2014)
P.P. Angelov, X. Gu, Deep rule-based classifier with human-level performance and characteristics. Inf. Sci. (Ny) 463–464, 196–213 (2018)
K. Simonyan, A. Zisserman, Very deep convolutional networks for large-scale image recognition, in International Conference on Learning Representations (2015) pp. 1–14
T. Joachims, Text categorization with support vector machines: learning with many relevant features, in European Conference on Machine Learning (1998) pp. 137–142
A.M. Cheriyadat, Unsupervised feature learning for aerial scene classification. IEEE Trans. Geosci. Remote Sens. 52(1), 439–451 (2014)
S. Lazebnik, C. Schmid, J. Ponce, Beyond bags of features : spatial pyramid matching for recognizing natural scene categories, in IEEE Computer Society Conference on Computer Vision and Pattern Recognition (2006) pp. 2169–2178
Y. Yang, S. Newsam, Spatial pyramid co-occurrence for image classification, in Proceedings of the IEEE International Conference on Computer Vision (2011) pp. 1465–1472
J. Fan, T. Chen, S. Lu, Unsupervised feature learning for land-use scene recognition. IEEE Trans. Geosci. Remote Sens. 55(4), 2250–2261 (2017)
L. Zhang, L. Zhang, V. Kumar, Deep learning for remote sensing data. IEEE Geosci. Remote Sens. Mag. 4(2), 22–40 (2016)
X. Gu, P.P. Angelov, C. Zhang, P.M. Atkinson, A massively parallel deep rule-based ensemble classifier for remote sensing scenes. IEEE Geosci. Remote Sens. Lett. 15(3), 345–349 (2018)
H. Lee, R. Grosse, R. Ranganath, A.Y. Ng, Convolutional deep belief networks for scalable unsupervised learning of hierarchical representations, in Annual International Conference on Machine Learning (2009) pp. 1–8
K. Kavukcuoglu, P. Sermanet, Y.-L. Boureau, K. Gregor, M. Mathieu, Y. LeCun, Learning convolutional feature hierarchies for visual recognition, in Advances in Neural Information Processing Systems (2010) pp. 1090–1098
M. Zeiler, D. Krishnan, G. Taylor, R. Fergus, Deconvolutional networks, in IEEE Conference on Computer Vision and Pattern Recognition (2010) pp. 2528–2535
J. Yang, K. Yu, Y. Gong, T. Huang, Linear spatial pyramid matching using sparse coding for image classification, in IEEE Conference on Computer Vision and Pattern Recognition (2009) pp. 1794–1801
J. Wang, J. Yang, K. Yu, F. Lv, T. Huang, Y. Gong, Locality-constrained linear coding for image classification, in IEEE Conference on Computer Vision and Pattern Recognition (2010) pp. 3360–3367
W. Luo, J. Li, J. Yang, W. Xu, J. Zhang, Convolutional sparse autoencoders for image classification. IEEE Trans. Neural Networks Learn. Syst. 29(7), 1–6 (2017)
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this chapter
Cite this chapter
Angelov, P.P., Gu, X. (2019). Applications of Deep Rule-Based Classifiers. In: Empirical Approach to Machine Learning. Studies in Computational Intelligence, vol 800. Springer, Cham. https://doi.org/10.1007/978-3-030-02384-3_13
Download citation
DOI: https://doi.org/10.1007/978-3-030-02384-3_13
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-02383-6
Online ISBN: 978-3-030-02384-3
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)