Augmented Reality in IoT

  • Gary WhiteEmail author
  • Christian Cabrera
  • Andrei Palade
  • Siobhán Clarke
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11434)


IoT is a combination of physical objects with virtual representations and services. Augmented reality provides an ideal interface to IoT applications by superimposing virtual information about smart objects and services on a user’s view of the real world. This allows a user to interact with the physical object as well as receiving additional context-aware information about the object e.g., size, speed and temperature, as well as information about nearby objects. However, users do not have to directly interact with the physical objects or sensors as augmented reality can be an effective method of providing additional information about IoT services in the environment, such as the QoS attributes of a service or the ratings that other users have provided during previous invocations. In this paper, we describe the use of augmented reality in IoT to provide contextual information to service users and providers and give a demonstration of an augmented reality application that we have developed and three projections of how users may interact with future context-aware applications. We also discuss some of the current research challenges and the future work that needs to be carried out to address these challenges.



This work was funded by Science Foundation Ireland (SFI) under grant 13/IA/1885.


  1. 1.
    Bauer, H., Patel, M., Veira, J.: The Internet of Things: Sizing Up the Opportunity. McKinsey, New York (2014)Google Scholar
  2. 2.
    Lee, I., Lee, K.: The Internet of Things (IoT): applications, investments, and challenges for enterprises. Bus. Horiz. 58(4), 431–440 (2015)CrossRefGoogle Scholar
  3. 3.
    Al-Fuqaha, A., Guizani, M., Mohammadi, M., Aledhari, M., Ayyash, M.: Internet of Things: a survey on enabling technologies, protocols, and applications. IEEE Comm. Surv. Tutor. 17(4), 2347–2376 (2015)CrossRefGoogle Scholar
  4. 4.
    Ploennigs, J., Ba, A., Barry, M.: Materializing the promises of cognitive IoT: how cognitive buildings are shaping the way. IEEE Internet Things J. 5(4), 2367–2374 (2018)CrossRefGoogle Scholar
  5. 5.
    Abate, A.F., Narducci, F., Ricciardi, S.: Mixed reality environment for mission critical systems servicing and repair. In: Shumaker, R. (ed.) VAMR 2013. LNCS, vol. 8022, pp. 201–210. Springer, Heidelberg (2013). Scholar
  6. 6.
    White, G., Nallur, V., Clarke, S.: Quality of service approaches in IoT: a systematic mapping. J. Syst. Softw. 132, 186–203 (2017). Scholar
  7. 7.
    White, G., Palade, A., Clarke, S.: Forecasting QoS attributes using LSTM networks. In: International Joint Conference on Neural Networks (IJCNN) (2018)Google Scholar
  8. 8.
  9. 9.
  10. 10.
    García-Macías, J.A., Alvarez-Lozano, J., Estrada-Martinez, P., Avilés-López, E.: Browsing the Internet of Things with sentient visors. Computer 5, 46–52 (2011)CrossRefGoogle Scholar
  11. 11.
    Jo, D., Kim, G.J.: ARIoT: scalable augmented reality framework for interacting with Internet of Things appliances everywhere. IEEE Trans. Consum. Electron. 62(3), 334–340 (2016)CrossRefGoogle Scholar
  12. 12.
    Kasahara, S., Heun, V., Lee, A.S., Ishii, H.: Second surface: multi-user spatial collaboration system based on augmented reality. In: SIGGRAPHAsia 2012 Emerging Technologies, p. 20. ACM (2012)Google Scholar
  13. 13.
    White, G., Clarke, S.: Smart cities with deep edges. In: ECML International Workshop on Urban Reasoning (2018)Google Scholar
  14. 14.
    Redmon, J., Divvala, S.K., Girshick, R.B., Farhadi, A.: You only look once: unified, real-time object detection (2015).
  15. 15.
    Braubach, L., Murillo, J.M., Kaviani, N., Lama, M., Burgueño, L., Moha, N., Oriol, M. (eds.): ICSOC 2017. LNCS, vol. 10797. Springer, Cham (2018). Scholar
  16. 16.
    White, G., Palade, A., Cabrera, C., Clarke, S.: IoTPredict: collaborative QoS prediction in IoT. In: IEEE International Conference on Pervasive Computing and Communications (PerCom) (PerCom 2018), Greece, March 2018Google Scholar
  17. 17.
    Henderson, S., Feiner, S.: Exploring the benefits of augmented reality documentation for maintenance and repair. IEEE Trans. Visual Comput. Graphics 17(10), 1355–1368 (2011)CrossRefGoogle Scholar

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  • Gary White
    • 1
    Email author
  • Christian Cabrera
    • 1
  • Andrei Palade
    • 1
  • Siobhán Clarke
    • 1
  1. 1.School of Computer Science and StatisticsTrinity College DublinDublinIreland

Personalised recommendations