Skip to main content

Designing Low-Power and High-Speed FPGA-Based Binary Decision Tree Hardware Accelerators

  • Conference paper
Applied Intelligence and Informatics (AII 2022)

Abstract

With the rapid development of Internet-of-Things (IoT) technologies and edge computing, identifying efficient solutions for data mining tasks such as classification is becoming crucial. Binary Decision Trees (DT) are one of the most used classifiers, due to their ability to handle a large amount of data with a high accuracy. More important, inference of DTs is well suited to be accelerated through custom hardware designs that allow enabling parallel and power-efficient computations with respect to the software-based counterpart. This is very important especially in the context of edge computing, where the computation is performed locally to the data acquisition with a reduced hardware-power budget. This paper describes a novel approach to design low-power and high-speed FPGA-based hardware accelerators of DTs. It is based on the idea of a novel hardware processing element, the so-called Super PE, that can be configured to execute in parallel the operation of three nodes belonging to two consecutive levels of the tree: a parent and its two children nodes. When implemented on the FPGA platform hosted on the Xilinx Zynq XC7Z020-1CLG400C heterogeneous System on Chip (SoC), the new design has shown a dynamic power reduction of up to 41%, in comparison with previously published designs based on the conventional PE. Moreover, compared to a pure software-based DT implementation, the proposed hardware accelerator, integrated into a complete embedded system, has shown an execution speed-up of about 21\(\times \).

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Wu, X., Zhu, X., Wu, G.-Q., Ding, W.: Data mining with big data. IEEE Trans. Knowl. Data Eng. 26(11), 97–107 (2014)

    Google Scholar 

  2. Rofouei, M., Pedram, M., Fraternali, F., Ashari, Z.E., Ghasemzadeh, H.: Resource-efficient computing in wearable systems. In: 2019 IEEE International Conference on Smart Computing (SMARTCOMP), Washington D.C. (US), pp. 150–155 (2019)

    Google Scholar 

  3. Sun, F., Zang, W., Gravina, R., Fortino, G., Li, Y.: Gait-based identification for elderly users in wearable healthcare systems. Inf. Fusion 53, 134–144 (2020)

    Article  Google Scholar 

  4. Shi, W., Cao, J., Zhang, Q., Li, Y., Xu, L.: Edge computing: vision and challenges. IEEE Internet Things J. 3(5), 637–646 (2016)

    Article  Google Scholar 

  5. Baraka, A., Shaban, H., Abou El-Nasr, M., Attallah, O.: Wearable accelerometer and sEMG-based upper limb BSN for tele-rehabilitation. Appl. Sci. 9(14), 1–22 (2019)

    Article  Google Scholar 

  6. Balkhi, P., Moallem, M.: A multipurpose wearable sensor-based system for weight training. Automation 3(1), 132–152 (2022)

    Article  Google Scholar 

  7. Raj, S., Ray, K.C., Shankar, O.: Cardiac arrhythmia beat classification using DOST and PSO tuned SVM. Comput. Methods Programs Biomed. 136, 163–177 (2016)

    Article  Google Scholar 

  8. Ferreira, P.J.S., Cardoso, J.M.P., Mendes-Moreira, J.: kNN prototyping schemes for embedded human activity recognition with online learning. Computers 9(4), 1–20 (2020)

    Article  Google Scholar 

  9. Liu, X., Zhiqiang, W.: Distributed computing system based on microprocessor cluster for wearable devices. In: 2017 International Conference on Computer Network, Electronic and Automation (ICCNEA), Xi’an, China, pp. 66–71 (2017)

    Google Scholar 

  10. Buschjäger, S., Morik, K.: Decision tree and random forest implementations for fast filtering of sensor data. IEEE Trans. Circuits Syst. I Regul. Pap. 65(1), 209–222 (2018)

    Article  Google Scholar 

  11. Saqib, F., Dutta, A., Plusquellic, J., Ortiz, P., Pattichis, M.S.: Pipelined decision tree classification accelerator implementation in FPGA (DT-CAIF). IEEE Trans. Comput. 64(1), 280–285 (2015)

    Article  MathSciNet  MATH  Google Scholar 

  12. Van Essen, B., Macaraeg, C., Gokhale, M., Prenger, R.: Accelerating a random forest classifier: Multi-core, GP-GPU, or FPGA? In: The IEEE 20th International Symposium on Field-Programmable Custom Computing Machines, pp. 232–239 (2012)

    Google Scholar 

  13. Narayanan, R., Honbo, D., Memik, G., Choudhary, A., Zambreno, J.: An FPGA implementation of decision tree classification. In: 2007 Design, Automation & Test in Europe Conference & Exhibition, pp. 1–6 (2007)

    Google Scholar 

  14. Owaida, M., Alonso, G., Fogliarini, L., Hock-Koon, A., Melet, P.-E.: Lowering the latency of data processing pipelines through FPGA based hardware acceleration. Proc. VLDB Endow. 13(1), 71–85 (2019)

    Article  Google Scholar 

  15. Kyrkou, C., Bouganis, C.-S., Theocharides, T., Polycarpou, M.M.: Embedded hardware-efficient real-time classification with cascade support vector machines. IEEE Trans. Neural Netw. Learn. Syst. 27(1), 99–112 (2016)

    Article  MathSciNet  Google Scholar 

  16. Fernandez, D., Gonzalez, C., Mozos, D., Lopez, S.: FPGA implementation of the principal component analysis algorithm for dimensionality reduction of hyperspectral images. J. Real-Time Image Proc. 16(5), 1395–1406 (2019)

    Article  Google Scholar 

  17. Liu, L., Khalid, M.A.S.: Acceleration of k-nearest neighbor algorithm on FPGA using Intel SDK for OpenCL. In: IEEE 61st International Midwest Symposium on Circuits and Systems (MWSCAS), Windsor, ON, Canada, pp. 1070–1073 (2018)

    Google Scholar 

  18. Li, Z.-H., Jin, J.-F., Zhou, X.-G., Feng, Z.-H.: K-nearest neighbor algorithm implementation on FPGA using high level synthesis. In: IEEE International Conference on Solid-State and Integrated Circuit Technology (ICSICT), Hangzhou, China, pp. 1–4 (2016)

    Google Scholar 

  19. Pu, Y., Peng, J., Huang, L., Chen, J.: An efficient KNN algorithm implemented on FPGA based heterogeneous computing system using OpenCL. In: IEEE 23rd Annual International Symposium on Field-Programmable Custom Computing Machines, Vancouver, BC, Canada, pp. 167–170 (2015)

    Google Scholar 

  20. Zhang, S., Li, X., Zong, M., Zhu, X., Wang, R.: Efficient kNN classification with different numbers of nearest neighbors. IEEE Trans. Neural Netw. Learn. Syst. 49(5), 1774–1785 (2018)

    Article  MathSciNet  Google Scholar 

  21. Ramkumar, B., Kittur, H.M.: Low-power and area-efficient carry select adder. IEEE Trans. Very Large Scale Integr. (VLSI) Syst. 20(2), 371–375 (2012)

    Article  Google Scholar 

  22. Dua, D., Graff, C.: UCI Machine Learning Repository. https://archive.ics.uci.edu/ml. Accessed Mar 2022

  23. D’Angelo, G., Rampone, S., Palmieri, F.: Developing a trust model for pervasive computing based on Apriori association rules learning and Bayesian classification. Soft. Comput. 21, 6297–6315 (2017)

    Article  Google Scholar 

  24. D’Angelo, G., Rampone, S., Palmieri, F.: An artificial intelligence-based trust model for pervasive computing. In: International Conference on P2P, Parallel, Grid, Cloud and Internet Computing (3PGCIC), Krakow, Poland, pp. 701–706 (2015)

    Google Scholar 

  25. Palechor, F.M., de la Hoz Manotas, A.: Dataset for estimation of obesity levels based on eating habits and physical condition in individuals from Colombia, Peru and Mexico. Data Brief 25, 1–5 (2019)

    Article  Google Scholar 

  26. AMD Xilinx, AXI Reference Guide, UG1037 15 July 2017. https://docs.xilinx.com/v/u/en-US/ug1037-vivado-axi-reference-guide. Accessed 15 Apr 2022

Download references

Acknowledgement

This work was supported in part by PON Ricerca & Innovazione - MUR (grant 062\(\_\)R24\(\_\)INNOVAZIONE), Ministero dell’Università e della Ricerca, Italian Government.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Fabio Frustaci .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Cite this paper

Huzyuk, R., Spagnolo, F., Frustaci, F. (2022). Designing Low-Power and High-Speed FPGA-Based Binary Decision Tree Hardware Accelerators. In: Mahmud, M., Ieracitano, C., Kaiser, M.S., Mammone, N., Morabito, F.C. (eds) Applied Intelligence and Informatics. AII 2022. Communications in Computer and Information Science, vol 1724. Springer, Cham. https://doi.org/10.1007/978-3-031-24801-6_5

Download citation

Publish with us

Policies and ethics