Skip to main content
SpringerLink
Log in

Effects of coordinate system and position of AR notification while walking

  • Original Article
  • Published:
Virtual Reality Aims and scope Submit manuscript

Abstract

Augmented reality (AR) head-mounted displays (HMDs) allow users to easily receive notifications while participating other tasks by projecting information directly in their field of view. Although HMDs offer such benefits in displaying notifications, there is insufficient research on the effective placement of AR notifications when the user is walking. For this, we conducted two studies based on different types of AR information to identify how the users perceive and understand the AR notifications according to placement while walking. We compared two different coordinate systems (display-fixed and body-fixed) and three different positions (top, right, and bottom) for icon-type and text-type notifications. The results indicated that using a display-fixed coordinate system for icon-type notifications yields significantly higher noticeability and comprehension. In contrast, using a body-fixed coordinate system for text-type notifications significantly improved comprehension and walking performance. Regarding the position of notifications, the bottom position resulted in a significantly higher noticeability and comprehension for both icon- and text-type notifications compared with the top. Based on these results, we draw some recommendations for the future design of notifications in AR HMDs.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11

Similar content being viewed by others

Data availability

Data will be made available upon request.

Notes

  1. https://www.microsoft.com/en-us/hololens.

  2. https://www.magicleap.com/en-us.

  3. https://www.google.com/glass/start/.

  4. https://moverio.epson.com/.

References

  • Ali H, Li H (2016) Designing a smart watch interface for a notification and communication system for nursing homes. In: International conference on human aspects of IT for the aged population. Springer, pp 401–411, https://doi.org/10.1007/978-3-319-39943-0_39

  • Barnard L, Yi JS, Jacko JA, Sears A (2005) An empirical comparison of use-in-motion evaluation scenarios for mobile computing devices. Int J Hum Comput Stud 62(4):487–520. https://doi.org/10.1016/j.ijhcs.2004.12.002

    Article  Google Scholar 

  • Billinghurst M, Bowskill J, Dyer N, Morphett J (1998a) An evaluation of wearable information spaces. In: Proceedings. IEEE 1998 virtual reality annual international symposium (Cat. No. 98CB36180), IEEE, pp 20–27, https://doi.org/10.1109/VRAIS.1998.658418

  • Billinghurst M, Bowskill J, Jessop M, Morphett J (1998b) A wearable spatial conferencing space. In: Digest of papers. Second international symposium on wearable computers (Cat. No. 98EX215), IEEE, pp 76–83, https://doi.org/10.1109/10.1109/ISWC.1998.729532

  • Bimber O, Raskar R (2005) Spatial augmented reality: merging real and virtual worlds. https://doi.org/10.1201/b10624

  • Borg O, Casanova R, Bootsma RJ (2015) Reading from a head-fixed display during walking: adverse effects of gaze stabilization mechanisms. PLoS ONE 10(6):e0129902. https://doi.org/10.1371/journal.pone.0129902

    Article  Google Scholar 

  • Chaturvedi I, Bijarbooneh FH, Braud T, Hui P (2019) Peripheral vision: a new killer app for smart glasses. In: Proceedings of the 24th international conference on intelligent user interfaces, pp 625–636, https://doi.org/10.1145/3301275.3302263

  • Chua SH, Perrault ST, Matthies DJ, Zhao S (2016) Positioning glass: Investigating display positions of monocular optical see-through head-mounted display. In: Proceedings of the fourth international symposium on Chinese CHI, pp 1–6, https://doi.org/10.1145/2948708.2948713

  • Debernardis S, Fiorentino M, Gattullo M, Monno G, Uva AE (2013) Text readability in head-worn displays: color and style optimization in video versus optical see-through devices. IEEE Trans Visual Comput Graphics 20(1):125–139. https://doi.org/10.1109/TVCG.2013.86

    Article  Google Scholar 

  • Ens B, Hincapié-Ramos JD, Irani P (2014) Ethereal planes: a design framework for 2d information space in 3d mixed reality environments. In: Proceedings of the 2nd ACM symposium on spatial user interaction, pp 2–12, https://doi.org/10.1145/2659766.2659769

  • Feiner S, MacIntyre B, Haupt M, Solomon E (1993) Windows on the world: 2d windows for 3d augmented reality. In: Proceedings of the 6th annual ACM symposium on User interface software and technology, pp 145–155, https://doi.org/10.1145/168642.168657

  • Fukushima S, Hamada T, Hautasaari A (2020) Comparing world and screen coordinate systems in optical see-through head-mounted displays for text readability while walking. In: 2020 IEEE international symposium on mixed and augmented reality (ISMAR), IEEE, pp 649–658, https://doi.org/10.1109/ISMAR50242.2020.00093

  • Gabbard JL, Mehra DG, Swan JE (2018) Effects of ar display context switching and focal distance switching on human performance. IEEE Trans Visual Comput Graphics 25(6):2228–2241. https://doi.org/10.1109/TVCG.2018.2832633

    Article  Google Scholar 

  • Genç Ç, Soomro S, Duyan Y, Ölçer S, Balcı F, Ürey H, Özcan O (2016) Head mounted projection display & visual attention: Visual attentional processing of head referenced static and dynamic displays while in motion and standing. In: Proceedings of the 2016 CHI conference on human factors in computing systems, pp 1538–1547, https://doi.org/10.1145/2858036.2858449

  • Ghosh S, Winston L, Panchal N, Kimura-Thollander P, Hotnog J, Cheong D, Reyes G, Abowd GD (2018) Notifivr: exploring interruptions and notifications in virtual reality. IEEE Trans Visual Comput Graphics 24(4):1447–1456. https://doi.org/10.1109/TVCG.2018.2793698

    Article  Google Scholar 

  • Gutwin C, Cockburn A, Coveney A (2017) Peripheral popout: The influence of visual angle and stimulus intensity on popout effects. In: Proceedings of the 2017 CHI conference on human factors in computing systems. pp 208–219, https://doi.org/10.1145/3025453.3025984

  • Harding TH, Rash CE, Lang GT (2010) Perceptual and cognitive effects on the use of helmet-mounted displays due to external operational factors. In: Head-and helmet-mounted displays XV: design and applications, International Society for Optics and Photonics, vol 7688, p 76880C, https://doi.org/10.1117/12.848931

  • Hart SG (2006) Nasa-task load index (nasa-tlx); 20 years later. In: Proceedings of the human factors and ergonomics society annual meeting, Sage publications Sage CA: Los Angeles, CA 50:904–908. https://doi.org/10.1177/154193120605000909

  • Imamov S, Monzel D, Lages WS (2020) Where to display? how interface position affects comfort and task switching time on glanceable interfaces. In: 2020 IEEE conference on virtual reality and 3D user interfaces (VR), IEEE, pp 851–858, https://doi.org/10.1109/VR46266.2020.00110

  • Iqbal ST, Bailey BP (2010) Oasis: a framework for linking notification delivery to the perceptual structure of goal-directed tasks. ACM Trans Comput Hum Interact 17(4):1–28. https://doi.org/10.1145/1879831.1879833

    Article  Google Scholar 

  • Ishiguro Y, Rekimoto J (2011) Peripheral vision annotation: noninterference information presentation method for mobile augmented reality. In: Proceedings of the 2nd augmented human international conference, pp 1–5, https://doi.org/10.1145/1959826.1959834

  • Jaschinski W, Heuer H, Kylian H (1999) A procedure to determine the individually comfortable position of visual displays relative to the eyes. Ergonomics 42(4):535–549. https://doi.org/10.1080/001401399185450

    Article  Google Scholar 

  • Klose EM, Mack NA, Hegenberg J, Schmidt L (2019) Text presentation for augmented reality applications in dual-task situations. In: 2019 IEEE conference on virtual reality and 3D user interfaces (VR), IEEE, pp 636–644, https://doi.org/10.1109/VR.2019.8797992

  • Komatsubara A (2008) Human error. Maruzen 2:3

    Google Scholar 

  • Kruijff E, Swan JE, Feiner S (2010) Perceptual issues in augmented reality revisited. In: 2010 IEEE international symposium on mixed and augmented reality, IEEE, pp 3–12, https://doi.org/10.1109/ISMAR.2010.5643530

  • Kruijff E, Orlosky J, Kishishita N, Trepkowski C, Kiyokawa K (2018) The influence of label design on search performance and noticeability in wide field of view augmented reality displays. IEEE Trans Visual Comput Graphics 25(9):2821–2837. https://doi.org/10.1109/TVCG.2018.2854737

    Article  Google Scholar 

  • Kushlev K, Proulx J, Dunn EW (2016) “silence your phones” smartphone notifications increase inattention and hyperactivity symptoms. In: Proceedings of the 2016 CHI conference on human factors in computing systems, pp 1011–1020, https://doi.org/10.1145/2858036.2858359

  • Lages W, Bowman D (2019) Adjustable adaptation for spatial augmented reality workspaces. In: Symposium on spatial user interaction, pp 1–2, https://doi.org/10.1145/3357251.3358755

  • Lee H, Bang S, Woo W (2020) Effects of background complexity and viewing distance on an ar visual search task. In: 2020 IEEE International symposium on mixed and augmented reality adjunct (ISMAR-Adjunct), IEEE, pp 189–194, https://doi.org/10.1109/ISMAR-Adjunct51615.2020.00057

  • Lindlbauer D, Feit AM, Hilliges O (2019) Context-aware online adaptation of mixed reality interfaces. In: Proceedings of the 32nd annual ACM symposium on user interface software and technology, pp 147–160, https://doi.org/10.1145/3332165.3347945

  • Lucero A, Vetek A (2014) Notifeye: using interactive glasses to deal with notifications while walking in public. In: Proceedings of the 11th conference on advances in computer entertainment technology, pp 1–10, https://doi.org/10.1145/2663806.2663824

  • MagicLeap (2020) Head-locked content - unity. https://developer.magicleap.com/en-us/learn/guides/head-locked-content-tutorial-unity, Accessed on 16, April, 2020

  • Mairena A, Gutwin C, Cockburn A (2019) Peripheral notifications in large displays: effects of feature combination and task interference. In: Proceedings of the 2019 CHI conference on human factors in computing systems, pp 1–12, https://doi.org/10.1145/3290605.3300870

  • Matsuura Y, Terada T, Aoki T, Sonoda S, Isoyama N, Tsukamoto M (2019) Readability and legibility of fonts considering shakiness of head mounted displays. In: Proceedings of the 23rd international symposium on wearable computers, pp 150–159, https://doi.org/10.1145/3341163.3347748

  • McCrickard DS, Chewar CM, Somervell JP, Ndiwalana A (2003) A model for notification systems evaluation-assessing user goals for multitasking activity. ACM Trans Comput Hum Interact 10(4):312–338. https://doi.org/10.1145/966930.966933

    Article  Google Scholar 

  • McCrickard DS, Czerwinski M, Bartram L (2003) Introduction: design and evaluation of notification user interfaces. Int J Hum Comput Stud 58(5):509–514. https://doi.org/10.1016/S1071-5819(03)00025-9

    Article  Google Scholar 

  • Mehrotra A, Pejovic V, Vermeulen J, Hendley R, Musolesi M (2016) My phone and me: understanding people’s receptivity to mobile notifications. In: Proceedings of the 2016 CHI conference on human factors in computing systems, pp 1021–1032, https://doi.org/10.1145/2858036.2858566

  • Mv M, Av B, Krueger H, Miège C (1994) Direction of gaze and comfort: discovering the relation for the ergonomic optimization of visual tasks. Ophthalmic Physiol Opt 14(4):393–399. https://doi.org/10.1016/0275-5408(94)90166-X

    Article  Google Scholar 

  • Microsoft (2019a) Coordinate systems: mixed reality. https://docs.microsoft.com/en-us/windows/mixed-reality/design/coordinate-systems, Accessed 24, Feb, 2019

  • Microsoft (2019b) Typography - mixed reality. https://docs.microsoft.com/en-us/windows/mixed-reality/design/typography, Accessed 03, Jun, 2019

  • Microsoft (2020) Comfort - mixed reality. https://docs.microsoft.com/en-us/windows/mixed-reality/design/comfort, Accessed 25, Jun, 2020

  • Mustonen T, Berg M, Kaistinen J, Kawai T, Häkkinen J (2013) Visual task performance using a monocular see-through head-mounted display (hmd) while walking. J Exp Psychol Appl 19(4):333. https://doi.org/10.1037/a0034635

    Article  Google Scholar 

  • Öberg T, Karsznia A, Öberg K (1993) Basic gait parameters: reference data for normal subjects, 10–79 years of age. J Rehabil Res Dev 30:210

    Google Scholar 

  • Panero J, Zelnik M (1979) Human dimension & interior space: a source book of design reference standards. Watson-Guptill, New York

    Google Scholar 

  • Patterson R, Winterbottom MD, Pierce BJ (2006) Perceptual issues in the use of head-mounted visual displays. Hum Factors 48(3):555–573. https://doi.org/10.1518/001872006778606877

    Article  Google Scholar 

  • Pielot M, Church K, De Oliveira R (2014) An in-situ study of mobile phone notifications. In: Proceedings of the 16th international conference on human-computer interaction with mobile devices & services, pp 233–242, https://doi.org/10.1145/2628363.2628364

  • Pielot M, Vradi A, Park S (2018) Dismissed! a detailed exploration of how mobile phone users handle push notifications. In: Proceedings of the 20th international conference on human-computer interaction with mobile devices and services, pp 1–11, https://doi.org/10.1145/3229434.3229445

  • Ren D, Goldschwendt T, Chang Y, Höllerer T (2016) Evaluating wide-field-of-view augmented reality with mixed reality simulation. In: 2016 IEEE virtual reality (VR), IEEE, pp 93–102, https://doi.org/10.1109/VR.2016.7504692

  • Rzayev R, Woźniak PW, Dingler T, Henze N (2018) Reading on smart glasses: the effect of text position, presentation type and walking. In: Proceedings of the 2018 CHI conference on human factors in computing systems, pp 1–9, https://doi.org/10.1145/3173574.3173619

  • Rzayev R, Mayer S, Krauter C, Henze N (2019) Notification in vr: The effect of notification placement, task and environment. In: Proceedings of the annual symposium on computer-human interaction in play, pp 199–211, https://doi.org/10.1145/3311350.3347190

  • Rzayev R, Korbely S, Maul M, Schark A, Schwind V, Henze N (2020) Effects of position and alignment of notifications on ar glasses during social interaction. In: Proceedings of the 11th Nordic conference on human-computer interaction: shaping experiences, Shaping Society, pp 1–11, https://doi.org/10.1145/3419249.3420095

  • Rzayev R, Ugnivenko P, Graf S, Schwind V, Henze N (2021) Reading in vr: The effect of text presentation type and location. In: Proceedings of the 2021 CHI conference on human factors in computing systems, pp 1–10, https://doi.org/10.1145/3411764.3445606

  • Schildbach B, Rukzio E (2010) Investigating selection and reading performance on a mobile phone while walking. In: Proceedings of the 12th international conference on Human computer interaction with mobile devices and services, pp 93–102, https://doi.org/10.1145/1851600.1851619

  • Tanaka K, Kishino Y, Miyamae M, Terada T, Nishio S (2008) An information layout method for an optical see-through head mounted display focusing on the viewability. In: 2008 7th IEEE/ACM international symposium on mixed and augmented reality, IEEE, pp 139–142, https://doi.org/10.1109/ISMAR.2008.4637340

  • Uchimura M, Kitazawa S (2013) Cancelling prism adaptation by a shift of background: a novel utility of allocentric coordinates for extracting motor errors. J Neurosci 33(17):7595–7602. https://doi.org/10.1523/JNEUROSCI.5702-12.2013

    Article  Google Scholar 

  • Uchimura M, Nakano T, Morito Y, Ando H, Kitazawa S (2015) Automatic representation of a visual stimulus relative to a background in the right precuneus. Eur J Neurosci 42(1):1651–1659. https://doi.org/10.1111/ejn.12935

    Article  Google Scholar 

  • Vadas K, Lyons KM, Ashbrook D, Yi JS, Starner T, Jacko JA (2006) Reading on the go: An evaluation of three mobile display technologies. Tech. rep., Georgia Institute of Technology, https://hdl.handle.net/1853/13112

  • Weber D, Mayer S, Voit A, Ventura Fierro R, Henze N (2016) Design guidelines for notifications on smart tvs. In: Proceedings of the ACM international conference on interactive experiences for TV and online video, pp 13–24, https://doi.org/10.1145/2932206.2932212

  • Wobbrock JO, Findlater L, Gergle D, Higgins JJ (2011) The aligned rank transform for nonparametric factorial analyses using only anova procedures. In: Proceedings of the SIGCHI conference on human factors in computing systems, pp 143–146, https://doi.org/10.1145/1978942.1978963

  • Xiao R, Benko H (2016) Augmenting the field-of-view of head-mounted displays with sparse peripheral displays. In: Proceedings of the 2016 CHI conference on human factors in computing systems, pp 1221–1232, https://doi.org/10.1145/2858036.2858212

  • Zenner A, Speicher M, Klingner S, Degraen D, Daiber F, Krüger A (2018) Immersive notification framework: adaptive & plausible notifications in virtual reality. In: Extended abstracts of the 2018 chi conference on human factors in computing systems, pp 1–6, https://doi.org/10.1145/3170427.3188505

  • Zhao X, Go K, Kashiwagi K, Toyoura M, Mao X, Fujishiro I (2019) Computational alleviation of homonymous visual field defect with ost-hmd: The effect of size and position of overlaid overview window. In: 2019 International conference on cyberworlds (CW), IEEE, pp 175–182, https://doi.org/10.1109/CW.2019.00036

Download references

Funding

This work was supported by Institute of Information & communications Technology Planning & Evaluation (IITP) grant funded by the Korea government (MSIT) (No. 2019-0-01270, WISE AR UI/UX Platform Development for Smartglasses).

Author information

Authors and Affiliations

  1. KAIST UVR Lab, #2325, N5, 291, Daehak-ro, Yuseong-gu, Daejeon, Republic of Korea

    Hyunjin Lee, Sunyoung Bang & Woontack Woo

  2. KAIST KI-ITC Augmented Reality Research Center, #303, E4, 291, Daehak-ro, Yuseong-gu, Daejeon, Republic of Korea

    Woontack Woo

Authors
  1. Hyunjin Lee
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Sunyoung Bang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Woontack Woo
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Woontack Woo.

Ethics declarations

Ethics approval

This study and all procedures were approved by the Korea Advanced Institute of Science and Technology (KAIST) Institutional Review Board (KH2021-046).

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Lee, H., Bang, S. & Woo, W. Effects of coordinate system and position of AR notification while walking. Virtual Reality 27, 829–848 (2023). https://doi.org/10.1007/s10055-022-00693-9

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10055-022-00693-9

Keywords

Search

Navigation