Skip to main content

Adaptation of a Gaze-Aware Security Surveillance Support Tool for Augmented Reality

  • Conference paper
  • First Online:
Human Interaction, Emerging Technologies and Future Systems V (IHIET 2021)


Operators monitoring closed-circuit television systems face many error-prone situations given the cognitive challenges they experience. The Scantracker is a prototype tool developed to support surveillance, relying on live oculometric data to trigger notifications that mitigate camera negligence, attention tunneling and vigilance decrement. To be robust and flexible, this tool must however collect valid gaze measures at a sufficient sampling rate and allow the display of surveillance-supportive visual notifications. This paper documents the integration of the Scantracker with the Microsoft HoloLens 2 augmented reality (AR) system embarked with eye tracking and reports a validity study performed in a high-fidelity surveillance simulation. The AR solution led to superior gaze validity than previous mobile or fixed oculometer integration. Implications of the solution integration are discussed and compared with the other implementations.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
USD 99.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 129.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions


  1. Wang, X.: Intelligent multi-camera video surveillance: a review. Pattern Recogn. Lett. 34, 3–19 (2013).

    Article  Google Scholar 

  2. Hodgetts, H.M., Vachon, F., Chamberland, C., Tremblay, S.: See no evil: cognitive challenges of security surveillance and monitoring. J. Appl. Res. Mem. Cogn. 6, 230–243 (2017).

    Article  Google Scholar 

  3. Tremblay, S., Lafond, D., Chamberland, C., Hodgetts, H.M., Vachon, F.: Gaze-aware cognitive assistant for multiscreen surveillance. In: Karwowski, W., Ahram, T. (eds.) IHSI 2018. AISC, vol. 722, pp. 230–236. Springer, Cham (2018).

    Chapter  Google Scholar 

  4. Marois, A., Lafond, D., Williot, A., Vachon, F., Tremblay, S.: Real-time gaze-aware cognitive support system for security surveillance. Hum. Fac. Erg. Soc. P. 64, 1145–1149 (2020).

  5. Marois, A., Lafond, D., Vachon, F., Harvey, E.R., Martin, B., Tremblay, S.: Mobile real-time eye-tracking for gaze-aware security surveillance support systems. In: Ahram, T., Karwowski, W., Vergnano, A., Leali, F., Taiar, R. (eds.) IHSI 2020. AISC, vol. 1131, pp. 201–207. Springer, Cham (2020).

    Chapter  Google Scholar 

  6. Carmigniani J., Furht B.: Augmented reality: an overview. In: Furht, B. (ed.) Handbook of Augmented Reality. Springer, New York (2011).

  7. Mascareñas, D., et al.: Augmented reality for enabling smart nuclear infrastructure. Front. Built Environ. 5, 82 (2019).

    Article  Google Scholar 

  8. Amaguaña, F., Collaguazo, B., Tituaña, J., Aguilar, W.G.: Simulation system based on augmented reality for optimization of training tactics on military operations. In: De Paolis, L.T., Bourdot, P. (eds.) AVR 2018. LNCS, vol. 10850, pp. 394–403. Springer, Cham (2018).

    Chapter  Google Scholar 

  9. González Izard, S., Juanes Méndez, J.A., Ruisoto Palomera, P., García-Peñalvo, F.J.: Applications of virtual and augmented reality in biomedical imaging. J. Med. Syst. 43(4), 1–5 (2019).

    Article  Google Scholar 

  10. Marois, A., Salvan, L., Lafond, D., Williot, A., Lemaire, N., Tremblay, S.: Improving usability of a gaze-based surveillance support tool through user-centered design. In: Ahram, T.Z., Falcão, C.S. (eds.) AHFE 2021. LNNS, vol. 275, pp. 732–740. Springer, Cham (2021).

    Chapter  Google Scholar 

  11. Funke, G., Greenlee, E., Carter, M., Dukes, A., Brown, R., Menke, L.: Which eye tracker is right for your research? Performance evaluation of several cost variant eye trackers. Hum. Fac. Erg. Soc. P. 60, 1240–1244 (2016).

  12. Macinnes, J.J., Iqbal, S., Pearson, J., Johnson, E.N.: Wearable eye-tracking for research: automated dynamic gaze mapping and accuracy/precision comparisons across devices, 28 June 2018

    Google Scholar 

  13. Vachon, F., Vallières, B.R., Suss, J., Thériault, J.-D., Tremblay, S.: The CSSS microworld: a gateway to understanding and improving CCTV security surveillance. Hum. Fac. Erg. Soc. P. 60, 265–269 (2016).

  14. Anderson, R., Nyström, M., Holmqvist, K.: Sampling frequency and eye-tracking measures: how speed affects durations, latencies, and more. J. Eye. Mov. Res. 3, 1–12 (2010).

    Google Scholar 

Download references


This project was supported by a grant from the Innovation for Defence Excellence and Security (IDEaS) program and by Mitacs Canada. We are grateful to all the participants involved in the workshops and data collection. Thanks are due to François Vachon, Vincent Poiré, Laura Salvan, Noémie Lemaire, to the Thales development team and to the research assistants from Université Laval.

Author information

Authors and Affiliations


Corresponding author

Correspondence to Alexandre Marois .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Marois, A. et al. (2022). Adaptation of a Gaze-Aware Security Surveillance Support Tool for Augmented Reality. In: Ahram, T., Taiar, R. (eds) Human Interaction, Emerging Technologies and Future Systems V. IHIET 2021. Lecture Notes in Networks and Systems, vol 319. Springer, Cham.

Download citation

  • DOI:

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-85539-0

  • Online ISBN: 978-3-030-85540-6

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics