Abstract
With the rapid development of Internet-of-Things (IoT) technologies and edge computing, identifying efficient solutions for data mining tasks such as classification is becoming crucial. Binary Decision Trees (DT) are one of the most used classifiers, due to their ability to handle a large amount of data with a high accuracy. More important, inference of DTs is well suited to be accelerated through custom hardware designs that allow enabling parallel and power-efficient computations with respect to the software-based counterpart. This is very important especially in the context of edge computing, where the computation is performed locally to the data acquisition with a reduced hardware-power budget. This paper describes a novel approach to design low-power and high-speed FPGA-based hardware accelerators of DTs. It is based on the idea of a novel hardware processing element, the so-called Super PE, that can be configured to execute in parallel the operation of three nodes belonging to two consecutive levels of the tree: a parent and its two children nodes. When implemented on the FPGA platform hosted on the Xilinx Zynq XC7Z020-1CLG400C heterogeneous System on Chip (SoC), the new design has shown a dynamic power reduction of up to 41%, in comparison with previously published designs based on the conventional PE. Moreover, compared to a pure software-based DT implementation, the proposed hardware accelerator, integrated into a complete embedded system, has shown an execution speed-up of about 21\(\times \).
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Wu, X., Zhu, X., Wu, G.-Q., Ding, W.: Data mining with big data. IEEE Trans. Knowl. Data Eng. 26(11), 97–107 (2014)
Rofouei, M., Pedram, M., Fraternali, F., Ashari, Z.E., Ghasemzadeh, H.: Resource-efficient computing in wearable systems. In: 2019 IEEE International Conference on Smart Computing (SMARTCOMP), Washington D.C. (US), pp. 150–155 (2019)
Sun, F., Zang, W., Gravina, R., Fortino, G., Li, Y.: Gait-based identification for elderly users in wearable healthcare systems. Inf. Fusion 53, 134–144 (2020)
Shi, W., Cao, J., Zhang, Q., Li, Y., Xu, L.: Edge computing: vision and challenges. IEEE Internet Things J. 3(5), 637–646 (2016)
Baraka, A., Shaban, H., Abou El-Nasr, M., Attallah, O.: Wearable accelerometer and sEMG-based upper limb BSN for tele-rehabilitation. Appl. Sci. 9(14), 1–22 (2019)
Balkhi, P., Moallem, M.: A multipurpose wearable sensor-based system for weight training. Automation 3(1), 132–152 (2022)
Raj, S., Ray, K.C., Shankar, O.: Cardiac arrhythmia beat classification using DOST and PSO tuned SVM. Comput. Methods Programs Biomed. 136, 163–177 (2016)
Ferreira, P.J.S., Cardoso, J.M.P., Mendes-Moreira, J.: kNN prototyping schemes for embedded human activity recognition with online learning. Computers 9(4), 1–20 (2020)
Liu, X., Zhiqiang, W.: Distributed computing system based on microprocessor cluster for wearable devices. In: 2017 International Conference on Computer Network, Electronic and Automation (ICCNEA), Xi’an, China, pp. 66–71 (2017)
Buschjäger, S., Morik, K.: Decision tree and random forest implementations for fast filtering of sensor data. IEEE Trans. Circuits Syst. I Regul. Pap. 65(1), 209–222 (2018)
Saqib, F., Dutta, A., Plusquellic, J., Ortiz, P., Pattichis, M.S.: Pipelined decision tree classification accelerator implementation in FPGA (DT-CAIF). IEEE Trans. Comput. 64(1), 280–285 (2015)
Van Essen, B., Macaraeg, C., Gokhale, M., Prenger, R.: Accelerating a random forest classifier: Multi-core, GP-GPU, or FPGA? In: The IEEE 20th International Symposium on Field-Programmable Custom Computing Machines, pp. 232–239 (2012)
Narayanan, R., Honbo, D., Memik, G., Choudhary, A., Zambreno, J.: An FPGA implementation of decision tree classification. In: 2007 Design, Automation & Test in Europe Conference & Exhibition, pp. 1–6 (2007)
Owaida, M., Alonso, G., Fogliarini, L., Hock-Koon, A., Melet, P.-E.: Lowering the latency of data processing pipelines through FPGA based hardware acceleration. Proc. VLDB Endow. 13(1), 71–85 (2019)
Kyrkou, C., Bouganis, C.-S., Theocharides, T., Polycarpou, M.M.: Embedded hardware-efficient real-time classification with cascade support vector machines. IEEE Trans. Neural Netw. Learn. Syst. 27(1), 99–112 (2016)
Fernandez, D., Gonzalez, C., Mozos, D., Lopez, S.: FPGA implementation of the principal component analysis algorithm for dimensionality reduction of hyperspectral images. J. Real-Time Image Proc. 16(5), 1395–1406 (2019)
Liu, L., Khalid, M.A.S.: Acceleration of k-nearest neighbor algorithm on FPGA using Intel SDK for OpenCL. In: IEEE 61st International Midwest Symposium on Circuits and Systems (MWSCAS), Windsor, ON, Canada, pp. 1070–1073 (2018)
Li, Z.-H., Jin, J.-F., Zhou, X.-G., Feng, Z.-H.: K-nearest neighbor algorithm implementation on FPGA using high level synthesis. In: IEEE International Conference on Solid-State and Integrated Circuit Technology (ICSICT), Hangzhou, China, pp. 1–4 (2016)
Pu, Y., Peng, J., Huang, L., Chen, J.: An efficient KNN algorithm implemented on FPGA based heterogeneous computing system using OpenCL. In: IEEE 23rd Annual International Symposium on Field-Programmable Custom Computing Machines, Vancouver, BC, Canada, pp. 167–170 (2015)
Zhang, S., Li, X., Zong, M., Zhu, X., Wang, R.: Efficient kNN classification with different numbers of nearest neighbors. IEEE Trans. Neural Netw. Learn. Syst. 49(5), 1774–1785 (2018)
Ramkumar, B., Kittur, H.M.: Low-power and area-efficient carry select adder. IEEE Trans. Very Large Scale Integr. (VLSI) Syst. 20(2), 371–375 (2012)
Dua, D., Graff, C.: UCI Machine Learning Repository. https://archive.ics.uci.edu/ml. Accessed Mar 2022
D’Angelo, G., Rampone, S., Palmieri, F.: Developing a trust model for pervasive computing based on Apriori association rules learning and Bayesian classification. Soft. Comput. 21, 6297–6315 (2017)
D’Angelo, G., Rampone, S., Palmieri, F.: An artificial intelligence-based trust model for pervasive computing. In: International Conference on P2P, Parallel, Grid, Cloud and Internet Computing (3PGCIC), Krakow, Poland, pp. 701–706 (2015)
Palechor, F.M., de la Hoz Manotas, A.: Dataset for estimation of obesity levels based on eating habits and physical condition in individuals from Colombia, Peru and Mexico. Data Brief 25, 1–5 (2019)
AMD Xilinx, AXI Reference Guide, UG1037 15 July 2017. https://docs.xilinx.com/v/u/en-US/ug1037-vivado-axi-reference-guide. Accessed 15 Apr 2022
Acknowledgement
This work was supported in part by PON Ricerca & Innovazione - MUR (grant 062\(\_\)R24\(\_\)INNOVAZIONE), Ministero dell’Università e della Ricerca, Italian Government.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Huzyuk, R., Spagnolo, F., Frustaci, F. (2022). Designing Low-Power and High-Speed FPGA-Based Binary Decision Tree Hardware Accelerators. In: Mahmud, M., Ieracitano, C., Kaiser, M.S., Mammone, N., Morabito, F.C. (eds) Applied Intelligence and Informatics. AII 2022. Communications in Computer and Information Science, vol 1724. Springer, Cham. https://doi.org/10.1007/978-3-031-24801-6_5
Download citation
DOI: https://doi.org/10.1007/978-3-031-24801-6_5
Publisher Name: Springer, Cham
Online ISBN: 978-3-031-24801-6
eBook Packages: Computer ScienceComputer Science (R0)