Skip to main content
SpringerLink
Log in

Evaluating the Performance of a Multimodal Speaker Tracking System at the Edge-to-Cloud Continuum

  • Chapter
  • First Online:
Device-Edge-Cloud Continuum

Part of the book series: Internet of Things ((ITTCC))

  • 120 Accesses

Abstract

The edge-to-cloud compute continuum has become increasingly popular in recent years for effectively collecting and analyzing data generated by Internet of Things (IoT) devices at the network edge, ensuring low latency, high scalability, and privacy preservation. This continuum of computing resources, features, and services, which spans from the edge to the cloud, can be effectively leveraged in various application domains like smart cities, industrial IoT, and smart healthcare. However, many unexplored scenarios still exist where this technology can be successfully applied. This chapter investigates how the compute continuum can support speaker tracking in smart spaces, such as smart homes, offices, and public venues, especially focusing on multimodal systems that leverage both audio and visual data. The effectiveness of the edge-to-cloud continuum in supporting such systems was assessed through a simulation-based experimental evaluation performed with the iFogSim toolkit. Our findings reveal that edge-cloud integration improves application performance in terms of network usage and latency, compared to a centralized solution that solely relies on cloud computing.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Hardcover Book
USD 169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. M.S. Alam, S.J. Jabin, A. Alam, M.I. Hossain, Comparative analysis of cloud and Fog environment based on network usage and cost of execution using iFogSim, in 2021 International Conference on Decision Aid Sciences and Application (DASA) (IEEE, Piscataway, 2021), pp. 132–137

    Google Scholar 

  2. L. Belcastro, R. Cantini, F. Marozzo, A. Orsino, D. Talia, P. Trunfio, Programming big data analysis: principles and solutions. J. Big Data 9(4), 1–50 (2022)

    Google Scholar 

  3. L. Belcastro, F. Marozzo, A. Orsino, D. Talia, P. Trunfio, Edge-cloud continuum solutions for urban mobility prediction and planning. IEEE Access 11, 38864–38874 (2023)

    Article  Google Scholar 

  4. G. D’Angelo, S. Ferretti, V. Ghini, Simulation of the internet of things, in 2016 International Conference on High Performance Computing & Simulation (HPCS) (IEEE, Piscataway, 2016), pp. 1–8

    Google Scholar 

  5. H. Gupta, A. Vahid Dastjerdi, S.K. Ghosh, R. Buyya, iFogSim: a toolkit for modeling and simulation of resource management techniques in the internet of things, edge and fog computing environments. Softw. Pract. Exp. 47(9), 1275–1296 (2017)

    Article  Google Scholar 

  6. N. Hassan, S. Gillani, E. Ahmed, I. Yaqoob, M. Imran, The role of edge computing in internet of things. IEEE Commun. Mag. 56(11), 110–115 (2018)

    Article  Google Scholar 

  7. G. Kecskemeti, G. Casale, D.N. Jha, J. Lyon, R. Ranjan, Modelling and simulation challenges in internet of things. IEEE Cloud Comput. 4(1), 62–69 (2017)

    Article  Google Scholar 

  8. V. Kılıç, M. Barnard, W. Wang, A. Hilton, J. Kittler, Mean-shift and sparse sampling-based SMC-PHD filtering for audio informed visual speaker tracking. IEEE Trans. Multimedia 18(12), 2417–2431 (2016)

    Article  Google Scholar 

  9. L.E. Lima, B.Y.L. Kimura, V. Rosset, Experimental environments for the internet of things: a review. IEEE Sens. J. 19(9), 3203–3211 (2019)

    Article  Google Scholar 

  10. H. Liu, Y. Li, B. Yang, 3d audio-visual speaker tracking with a two-layer particle filter, in 2019 IEEE International Conference on Image Processing (ICIP) (IEEE, Piscataway, 2019), pp. 1955–1959

    Google Scholar 

  11. H. Liu, Y. Sun, Y. Li, B. Yang, 3d audio-visual speaker tracking with a novel particle filter, in 2020 25th International Conference on Pattern Recognition (IEEE, Piscataway, 2021), pp. 7343–7348

    Google Scholar 

  12. S. Maheshwari, D. Raychaudhuri, I. Seskar, F. Bronzino, Scalability and performance evaluation of edge cloud systems for latency constrained applications, in 2018 IEEE/ACM Symposium on Edge Computing (SEC) (IEEE, Piscataway, 2018), pp. 286–299

    Google Scholar 

  13. R. Mahmud, S. Pallewatta, M. Goudarzi, R. Buyya, iFogSim2: an extended iFogSim simulator for mobility, clustering, and microservice management in edge and fog computing environments. J. Syst. Softw. 190, 111351 (2022)

    Article  Google Scholar 

  14. F. Marozzo, A. Orsino, D. Talia, P. Trunfio, Edge computing solutions for distributed machine learning, in 2022 IEEE International Conference on Dependable, Autonomic and Secure Computing, International Conference on Pervasive Intelligence and Computing, International Conference on Cloud and Big Data Computing, International Conference on Cyber Science and Technology Congress (2022), pp. 1–8

    Google Scholar 

  15. X. Qian, A. Brutti, M. Omologo, A. Cavallaro, 3d audio-visual speaker tracking with an adaptive particle filter, in 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) (IEEE, Piscataway, 2017), pp. 2896–2900

    Google Scholar 

  16. F.H. Rahman, T.W. Au, S. Shah Newaz, W.S. Haji Suhaili, A performance study of high-end fog and fog cluster in iFogSim, in Computational Intelligence in Information Systems: Proceedings of the Computational Intelligence in Information Systems Conference (CIIS 2018), vol. 3 (Springer, Berlin, 2019), pp. 87–96

    Google Scholar 

  17. D.M.A.d. Silva, G. Asaamoning, H. Orrillo, R.C. Sofia, P.M. Mendes, An analysis of fog computing data placement algorithms, in Proceedings of the 16th EAI International Conference on Mobile and Ubiquitous Systems: Computing, Networking and Services (2019), pp. 527–534

    Google Scholar 

  18. M. Sinqadu, Z.S. Shibeshi, Performance evaluation of a traffic surveillance application using iFogSim, in International Conference on Wireless Intelligent and Distributed Environment for Communication (Springer, Berlin, 2020), pp. 51–64

    Google Scholar 

  19. C. Sonmez, A. Ozgovde, C. Ersoy, EdgeCloudSim: an environment for performance evaluation of edge computing systems. Trans. Emerg. Telecommun. Technol. 29(11), e3493 (2018)

    Google Scholar 

  20. X. Zeng, S.K. Garg, P. Strazdins, P.P. Jayaraman, D. Georgakopoulos, R. Ranjan, IOTSim: a simulator for analysing IoT applications. J. Syst. Archit. 72, 93–107 (2017)

    Article  Google Scholar 

Download references

Acknowledgements

This work has been supported by the “RESTART - PNRR MUR - M4C2 – I 1.3” project - CUP C37G22000480001.

Author information

Authors and Affiliations

  1. Department of Informatics, Modeling, Electronics and Systems (DIMES), University of Calabria, Arcavacata, Italy

    Alessio Orsino, Riccardo Cantini & Fabrizio Marozzo

Authors
  1. Alessio Orsino
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Riccardo Cantini
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Fabrizio Marozzo
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Alessio Orsino .

Editor information

Editors and Affiliations

  1. DIMES, Università della Calabria, Rende, Cosenza, Italy

    Claudio Savaglio

  2. DIMES, Universita della Calabria, Rende, Cosenza, Italy

    Giancarlo Fortino

  3. New Jersey Institute of Technology, Newark, NJ, USA

    MengChu Zhou

  4. Hosei University, Tokyo, Japan

    Jianhua Ma

Rights and permissions

Reprints and permissions

Copyright information

© 2024 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Orsino, A., Cantini, R., Marozzo, F. (2024). Evaluating the Performance of a Multimodal Speaker Tracking System at the Edge-to-Cloud Continuum. In: Savaglio, C., Fortino, G., Zhou, M., Ma, J. (eds) Device-Edge-Cloud Continuum. Internet of Things. Springer, Cham. https://doi.org/10.1007/978-3-031-42194-5_9

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-42194-5_9

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-42193-8

  • Online ISBN: 978-3-031-42194-5

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics

Search

Navigation