Skip to main content
SpringerLink
Log in

A Survey of AI Accelerators for Edge Environment

  • Conference paper
  • First Online:
Trends and Innovations in Information Systems and Technologies (WorldCIST 2020)

Part of the book series: Advances in Intelligent Systems and Computing ((AISC,volume 1160))

Included in the following conference series:

Abstract

The execution of AI models, especially deep learning models, involves large quantity of processor operations and high memory transfer, which is critical to edge environment. To response to this, a number of specific hardware, a.k.a. edge AI accelerators, have been developed to accelerate the AI model execution in edge. Nevertheless, with no dominant design in the domain, existing AI accelerators hold different physical types, hardware features and software capabilities, and users without prior knowledge can barely choose the proper accelerator corresponding to their computation requirements. This paper aims at providing a systematic survey of AI accelerators for edge environment: firstly we briefly introduce the AI computation requirements and AI accelerator history; we then present a list of criteria covering both hardware and software aspects; following the criteria, we survey the emerging and representative AI accelerator products. At last, we summary the current trends and shed light on future directions for AI accelerator design.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. LeCun, Y., Bengio, Y., Hinton, G.: Deep learning. Nature 521, 436–444 (2015). https://doi.org/10.1038/nature14539

    Article  Google Scholar 

  2. An, J., Li, W., Gall, F.L., Kovac, E., Kim, J., Taleb, T., Song, J.: EiF: toward an elastic IoT fog framework for AI services. IEEE Commun. Mag. 57, 28–33 (2019). https://doi.org/10.1109/MCOM.2019.1800215

    Article  Google Scholar 

  3. Sze, V., Chen, Y.-H., Yang, T.-J., Emer, J.S.: Efficient processing of deep neural networks: a tutorial and survey. Proc. IEEE 105, 2295–2329 (2017). https://doi.org/10.1109/JPROC.2017.2761740

    Article  Google Scholar 

  4. Williams, S., Waterman, A., Patterson, D.: Roofline: an insightful visual performance model for multicore architectures. Commun. ACM 52, 65–76 (2009). https://doi.org/10.1145/1498765.1498785

    Article  Google Scholar 

  5. Saiyeda, A., Mir, M.A.: Cloud computing for deep learning analytics: a survey of current trends and challenges. Int. J. Adv. Res. Comput. Sci. 8 (2017). https://doi.org/10.26483/ijarcs.v8i2.2931

  6. Intel® MovidiusTM MyriadTM X VPU | Machine Vision Technology | Movidius. https://www.movidius.com/myriadx. Accessed 15 Nov 2019

  7. Jetson Nano Developer Kit. https://developer.nvidia.com/embedded/jetson-nano-developer-kit. Accessed 15 Nov 2019

  8. Dev Board | Coral. https://coral.withgoogle.com/products/dev-board/. Accessed 15 Nov 2019

  9. Lecun, Y., Bottou, L., Bengio, Y., Haffner, P.: Gradient-based learning applied to document recognition. Proc. IEEE 86, 2278–2324 (1998). https://doi.org/10.1109/5.726791

    Article  Google Scholar 

  10. Li, Z., Wang, Y., Zhi, T., Chen, T.: A survey of neural network accelerators. Front. Comput. Sci. 11, 746–761 (2017). https://doi.org/10.1007/s11704-016-6159-1

    Article  Google Scholar 

  11. Blaiech, A.G., Ben Khalifa, K., Valderrama, C., Fernandes, M.A.C., Bedoui, M.H.: A survey and taxonomy of FPGA-based deep learning accelerators. J. Syst. Archit. 98, 331–345 (2019). https://doi.org/10.1016/j.sysarc.2019.01.007

  12. Wang, E., Davis, J.J., Zhao, R., Ng, H.-C., Niu, X., Luk, W., Cheung, P.Y.K., Constantinides, G.A.: Deep neural network approximation for custom hardware: where we’ve been, where we’re going. ACM Comput. Surv. 52, 40:1–40:39 (2019). https://doi.org/10.1145/3309551

  13. USB Accelerator. https://coral.withgoogle.com/products/accelerator/. Accessed 15 Nov 2019

  14. Key Information about the Huawei Kirin 970 | HiSilicon. http://www.hisilicon.com/en/Media-Center/News/Key-Information-About-the-Huawei-Kirin970. Accessed 15 Nov 2019

  15. Snapdragon 855+ Mobile Platform | Qualcomm. https://www.qualcomm.com/products/snapdragon-855-plus-mobile-platform. Accessed 15 Nov 2019

  16. Arora, N.D., Rios, E., Huang, C.-L.: Modeling the polysilicon depletion effect and its impact on submicrometer CMOS circuit performance. IEEE Trans. Electron Devices 42, 935–943 (1995). https://doi.org/10.1109/16.381991

    Article  Google Scholar 

  17. Supported Framework Layers - OpenVINO Toolkit. https://docs.openvinotoolkit.org/latest/_docs_MO_DG_prepare_model_Supported_Frameworks_Layers.html. Accessed 15 Nov 2019

  18. HUAWEI HiAI Engine Introduction. https://developer.huawei.com/consumer/en/doc/2020315. Accessed 15 Nov 2019

  19. Snapdragon Neural Processing Engine SDK: Main Page. https://developer.qualcomm.com/docs/snpe/index.html. Accessed 15 Nov 2019

  20. MediaTek: MediaTek Helio P 90. https://www.mediatek.com/products/smartphones/mediatek-helio-p90. Accessed 15 Nov 2019

  21. TensorRT Developer Guide. http://docs.nvidia.com/deeplearning/sdk/tensorrt-developer-guide/index.html. Accessed 15 Nov 2019

  22. Rockchip RK3399Pro. http://www.rock-chips.com/a/en/products/RK33_Series/2018/0130/874.html. Accessed 15 Nov 2019

  23. TB-96AI - Products - Toybrick EN. http://t.rock-chips.com/en/portal.php?mod=view&aid=24. Accessed 15 Nov 2019

  24. TensorFlow models on the Edge TPU. https://coral.withgoogle.com/docs/edgetpu/models-intro. Accessed 15 Nov 2019

  25. BeagleBoard.org – AI. https://beagleboard.org/ai. Accessed 15 Nov 2019

  26. Texas Instruments Deep Learning (TIDL) Overview. https://training.ti.com/texas-instruments-deep-learning-tidl-overview. Accessed 15 Nov 2019

  27. New Premium Mobile Processor and 5G Modem Unveiled at Samsung Tech Day. https://news.samsung.com/global/new-premium-mobile-processor-and-5g-modem-unveiled-at-samsung-tech-day. Accessed 15 Nov 2019

  28. Davies, M., Srinivasa, N., et al.: Loihi: a neuromorphic manycore processor with on-chip learning. IEEE Micro. 38, 82–99 (2018). https://doi.org/10.1109/MM.2018.112130359

  29. Cheng, H.-P., Wen, W., Wu, C., Li, S., Li, H.H., Chen, Y.: Understanding the design of IBM neurosynaptic system and its tradeoffs: a user perspective. In: Design, Automation Test in Europe Conference Exhibition (DATE), pp. 139–144 (2017). https://doi.org/10.23919/DATE.2017.7926972

  30. Panda, P.R., Panda, P.R., Dutt, N.D., Nicolau, A.: On-chip vs. off-chip memory: the data partitioning problem in embedded processor-based systems. ACM Trans. Des. Autom. Electron. Syst. 5, 682–704 (2000). https://doi.org/10.1145/348019.348570

  31. Chen, W.-H., Li, K.-X., et al.: A 65 nm 1 Mb nonvolatile computing-in-memory ReRAM macro with sub-16 ns multiply-and-accumulate for binary DNN AI edge processors. In: 2018 IEEE International Solid - State Circuits Conference - (ISSCC), pp. 494–496 (2018). https://doi.org/10.1109/ISSCC.2018.8310400

  32. Konečný, J., McMahan, H.B., Yu, F.X., Richtarik, P., Suresh, A.T., Bacon, D.: Federated learning: strategies for improving communication efficiency. In: NIPS Workshop on Private Multi-Party Machine Learning (2016)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Orange Labs, 35510, Cesson-Sévigné, France

    Wenbin Li & Matthieu Liewig

Authors
  1. Wenbin Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Matthieu Liewig
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Wenbin Li .

Editor information

Editors and Affiliations

  1. Departamento de Engenharia Informática, Universidade de Coimbra, Coimbra, Portugal

    Álvaro Rocha

  2. College of Engineering, The Ohio State University, Columbus, OH, USA

    Hojjat Adeli

  3. FEUP, Universidade do Porto, Porto, Portugal

    Luís Paulo Reis

  4. DIMES, Università della Calabria, Arcavacata di Rende, Italy

    Sandra Costanzo

  5. Faculty of Electrical Engineering, University of Montenegro, Podgorica, Montenegro

    Irena Orovic

  6. Universidade Portucalense, Porto, Portugal

    Fernando Moreira

Rights and permissions

Reprints and permissions

Copyright information

© 2020 The Editor(s) (if applicable) and The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Li, W., Liewig, M. (2020). A Survey of AI Accelerators for Edge Environment. In: Rocha, Á., Adeli, H., Reis, L., Costanzo, S., Orovic, I., Moreira, F. (eds) Trends and Innovations in Information Systems and Technologies. WorldCIST 2020. Advances in Intelligent Systems and Computing, vol 1160. Springer, Cham. https://doi.org/10.1007/978-3-030-45691-7_4

Download citation

Publish with us

Policies and ethics

Search

Navigation