Skip to main content
SpringerLink
Log in

Rapid Mixed Reality Prototyping for Novel Interaction Devices: Evaluating a Transparent Handheld Display

  • Conference paper
  • First Online:
Extended Reality (XR Salento 2023)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 14218))

Included in the following conference series:

  • 521 Accesses

Abstract

This paper proposes and evaluates a rapid mixed reality prototyping process for novel interaction devices. The process consists of five steps: ideation & visualization, CAD modeling, physical construction, MR augmentation, and comparative evaluation. It is exemplarily tested by developing a physical prototype of a transparent handheld display device and evaluating it against an opaque version (\(N=16\)). Results show that rapid MR prototyping can detect certain UX differences without the need to actually realize the final device. The transparent version had significantly higher hedonic quality. However, no obvious advantage of transparency could be identified regarding task completion. It turned out that the tablet-based AR solution had limited ability to mediate the technological concept and led to ergonomic problems in the experimental setup. However, the proposed process is flexible enough to allow the use of high-quality MR augmentation solutions such as immersive head-mounted display AR, which could overcome the identified limitations.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 69.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 89.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    https://www.nintendo.com/store/hardware/joy-con-and-controllers/.

  2. 2.

    https://www.thingiverse.com/thing:2347696.

  3. 3.

    https://www.ultimaker-3.de/.

  4. 4.

    Samsung Galaxy Tab S7, 12.4in display (2,560\(\,\times \,\)600px), 8 MP camera, Android 11.

  5. 5.

    https://unity.com/    https://unity.com/unity/features/arfoundation.

References

  1. Barbieri, L., Angilica, A., Bruno, F., Muzzupappa, M.: An interactive tool for the participatory design of product interface. In: Proceedings of the ASME 2012 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference, vol. 2, pp. 1437–1447. ASME, Chicago, Illinois, USA (Aug 2012). https://doi.org/10.1115/DETC2012-71097

  2. Barbieri, L., Angilica, A., Bruno, F., Muzzupappa, M.: Mixed prototyping with configurable physical archetype for usability evaluation of product interfaces. Comput. Ind. 64, 310–323 (2013). https://doi.org/10.1016/j.compind.2012.11.010

    Article  Google Scholar 

  3. Billinghurst, M., Kato, H., Poupyrev, I.: Tangible augmented reality. In: ACM SIGGRAPH ASIA 2008 Courses on - SIGGRAPH Asia 2008, pp. 1–10. ACM Press, Singapore (2008). https://doi.org/10.1145/1508044.1508051

  4. Bjoerkli, L.E.: A Review of Virtual Prototyping Approaches for User Testing of Design Solutions, p. 14 (2015)

    Google Scholar 

  5. Bordegoni, M., Polistina, S., Carulli, M.: Mixed reality prototyping for handheld products testing. In: Proceedings of IDMME - Virtual Concept 2010, Bordeaux, France, p. 6 (2010)

    Google Scholar 

  6. Bruno, F., Cosco, F., Angilica, A., Muzzupappa, M.: Mixed prototyping for products usability evaluation. In: 30th Computers and Information in Engineering Conference, Parts A and B, vol. 3, pp. 1381–1390. ASMEDC, Montreal, Quebec, Canada (Jan 2010). https://doi.org/10.1115/DETC2010-28841

  7. Camburn, B., et al.: Design prototyping methods: State of the art in strategies, techniques, and guidelines. Design Sci. 3, e13 (2017). https://doi.org/10.1017/dsj.2017.10

    Article  Google Scholar 

  8. Catecati, T., et al.: Mixed prototyping in the evaluation of human-product interaction: issues and solutions. In: Proceedings of the 3rd International Conferenc on Integration of Design, Engineering & Management for Innovation, Porto, Portugal, pp. 269–276 (Oct 2013)

    Google Scholar 

  9. Choi, Y.M.: Utilizing end user input in early product development. Procedia Manuf. 3, 2244–2250 (2015). https://doi.org/10.1016/j.promfg.2015.07.368

    Article  Google Scholar 

  10. Choi, Y.M.: Applying tangible augmented reality for product usability assessment. J. Usability Stud. 14(4), 14 (2019)

    Google Scholar 

  11. El-Abed, M., Charrier, C., Rosenberger, C.: Evaluation of biometric systems. In: Yang, J. (ed.) New Trends and Developments in Biometrics. InTech (Nov 2012). https://doi.org/10.5772/52084

  12. Faust, F.G., et al.: Mixed prototypes for the evaluation of usability and user experience: simulating an interactive electronic device. Virtual Reality 23(2), 197–211 (2019). https://doi.org/10.1007/s10055-018-0356-1

    Article  Google Scholar 

  13. Franke, T., Attig, C., Wessel, D.: a personal resource for technology interaction: development and validation of the affinity for technology Interaction (ATI) scale. Int. J. Hum.-Comput. Interact. 35(6), 456–467 (2019). https://doi.org/10.1080/10447318.2018.1456150

    Article  Google Scholar 

  14. Hassenzahl, M., Burmester, M., Koller, F.: AttrakDiff: Ein Fragebogen zur Messung wahrgenommener hedonischer und pragmatischer Qualität. In: Szwillus, G., Ziegler, J. (eds.) Mensch & Computer 2003, vol. 57, pp. 187–196. Vieweg+Teubner Verlag, Wiesbaden (2003). https://doi.org/10.1007/978-3-322-80058-9_19

  15. Hedili, M.K., Freeman, M.O., Urey, H.: Transmission characteristics of a bidirectional transparent screen based on reflective microlenses. Opt. Express 21(21), 24636–24646 (2013). https://doi.org/10.1364/OE.21.024636

    Article  Google Scholar 

  16. Hignett, S., McAtamney, L.: Rapid entire body assessment (REBA). Appl. Ergon. 31(2), 201–205 (2000). https://doi.org/10.1016/S0003-6870(99)00039-3

    Article  Google Scholar 

  17. Jain, K., Choi, Y.M.: Authoring interactions for tangible augmented reality. In: Stephanidis, C., Antona, M. (eds.) HCII 2020. CCIS, vol. 1225, pp. 43–50. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-50729-9_6

    Chapter  Google Scholar 

  18. Kanai, S., Verlinden, J.: Advanced prototyping for human-centered design for information appliances. Int. J. Inter. Design Manuf. (IJIDeM) 3(3), 131–134 (2009)

    Article  Google Scholar 

  19. Kato, H., Billinghurst, M., Poupyrev, I., Imamoto, K., Tachibana, K.: Virtual object manipulation on a table-top AR environment. In: Proceedings IEEE and ACM International Symposium on Augmented Reality (ISAR 2000), pp. 111–119. IEEE, Munich, Germany (2000). https://doi.org/10.1109/ISAR.2000.880934

  20. Kent, L., Snider, C., Gopsill, J., Hicks, B.: Mixed reality in design prototyping: a systematic review. Des. Stud. 77, 101046 (2021). https://doi.org/10.1016/j.destud.2021.101046

    Article  Google Scholar 

  21. Lamel, L., Bennacef, S., Gauvain, J.L., Dartigues, H., Temem, J.N.: User evaluation of the MASK kiosk. Speech Commun. 38(1), 131–139 (2002)

    Article  Google Scholar 

  22. Lee, J.Y., Rhee, G.W., Park, H.: Ar/rp-based tangible interactions for collaborative design evaluation of digital products. Int. J. Adv. Manuf. Technol. 45(7), 649–665 (2009)

    Article  Google Scholar 

  23. Lee, W., Park, J.: Augmented foam: a tangible augmented reality for product design. In: Fourth IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR 2005), pp. 106–109. IEEE, Vienna, Austria (2005). https://doi.org/10.1109/ISMAR.2005.16

  24. Mäkelä, K., Belt, S., Greenblatt, D., Häkkilä, J.: Mobile interaction with visual and RFID tags: a field study on user perceptions. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 991–994. ACM, San Jose California USA (Apr 2007). https://doi.org/10.1145/1240624.1240774

  25. Milgram, P., Takemura, H., Utsumi, A., Kishino, F.: Augmented reality: a class of displays on the reality-virtuality continuum. In: Das, H. (ed.) Proceedings, Telemanipulator and Telepresence Technologies, vol. 2351, pp. 282–292. SPIE, Boston, MA (Dec 1995). https://doi.org/10.1117/12.197321

  26. Moon, B.S.: A study on the evaluation of ux elements for users’ selective attention to the transparent public display. Arch. Design Res. 27(2), 183–197 (2014). https://doi.org/10.15187/adr.2014.05.110.2.183

  27. Morozova, A., Rheinstädter, V., Wallach, D.: MixedUX: a mixed prototyping framework for usability testing in augmented reality. In: Companion Publication of the 2019 on Designing Interactive Systems Conference 2019 Companion, DIS 2019 Companion, pp. 41–44. Association for Computing Machinery, New York (Jun 2019). https://doi.org/10.1145/3301019.3325146

  28. Nakamura, T., et al.: 360-degree transparent holographic screen display. In: ACM SIGGRAPH 2019 Emerging Technologies, SIGGRAPH 2019, pp. 1–2. Association for Computing Machinery, New York (Jul 2019). https://doi.org/10.1145/3305367.3327974

  29. Nam, T.J.: Sketch-based rapid prototyping platform for hardware-software integrated interactive products. In: CHI 2005 Extended Abstracts on Human Factors in Computing Systems, CHI EA 2005, pp. 1689–1692. Association for Computing Machinery, New York (Apr 2005). https://doi.org/10.1145/1056808.1056998

  30. Park, H., Moon, H.C.: Design evaluation of information appliances using augmented reality-based tangible interaction. Comput. Ind. 64(7), 854–868 (2013). https://doi.org/10.1016/j.compind.2013.05.006

    Article  Google Scholar 

  31. Park, H., Moon, H.C., Lee, J.Y.: Tangible augmented prototyping of digital handheld products. Comput. Ind. 60(2), 114–125 (2009). https://doi.org/10.1016/j.compind.2008.09.001

    Article  Google Scholar 

  32. Park, H., Park, S.J., Jung, H.K.: Note on tangible interaction using paper models for AR-based design evaluation. J. Adv. Mech. Design Syst. Manuf. 7(5), 827–835 (2013). https://doi.org/10.1299/jamdsm.7.827

    Article  Google Scholar 

  33. Repo, P., Kerttula, M., Salmela, M., Huomo, H.: Virtual product design case study: the Nokia RFID tag reader. IEEE Pervasive Comput. 4(4), 95–99 (2005). https://doi.org/10.1109/MPRV.2005.92

    Article  Google Scholar 

  34. Verlinden, J., de Smit, A., Peeters, A.W.J., van Gelderen, M.H.: Development of a flexible augmented prototyping system. WSCG 11(1), 8 (2003)

    Google Scholar 

  35. Verlinden, J., Horváth, I.: Analyzing opportunities for using interactive augmented prototyping in design practice. Artif. Intell. Eng. Des. Anal. Manuf. 23(3), 289–303 (2009). https://doi.org/10.1017/S0890060409000250

    Article  Google Scholar 

  36. Wang, G.G.: Definition and review of virtual prototyping. J. Comput. Inf. Sci. Eng. 2(3), 232–236 (2002). https://doi.org/10.1115/1.1526508

    Article  Google Scholar 

  37. Zhang, X., Choi, Y.M.: Applying tangible augmented reality in usability evaluation. In: Shumaker, R., Lackey, S. (eds.) VAMR 2015. LNCS, vol. 9179, pp. 88–94. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-21067-4_11

    Chapter  Google Scholar 

Download references

Acknowledgements

Our thanks to Malte Husung for his part in design and implementation, and to Rafael Wortmann and Pascal Stagge for 3D modelling/printing.

Author information

Authors and Affiliations

  1. University of Lübeck, Lübeck, Germany

    Markus Dresel, Bastian Schmeier, Nele Balke, Bjoern Emkes, Wan Abdul Aliim Wanali & Nicole Jochems

Authors
  1. Markus Dresel
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Bastian Schmeier
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Nele Balke
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Bjoern Emkes
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Wan Abdul Aliim Wanali
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Nicole Jochems
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Markus Dresel .

Editor information

Editors and Affiliations

  1. University of Salento, Lecce, Italy

    Lucio Tommaso De Paolis

  2. University of Naples Federico II, Naples, Italy

    Pasquale Arpaia

  3. CNR-STIIMA, Lecco, Italy

    Marco Sacco

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Dresel, M., Schmeier, B., Balke, N., Emkes, B., Wanali, W.A.A., Jochems, N. (2023). Rapid Mixed Reality Prototyping for Novel Interaction Devices: Evaluating a Transparent Handheld Display. In: De Paolis, L.T., Arpaia, P., Sacco, M. (eds) Extended Reality. XR Salento 2023. Lecture Notes in Computer Science, vol 14218. Springer, Cham. https://doi.org/10.1007/978-3-031-43401-3_30

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-43401-3_30

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-43400-6

  • Online ISBN: 978-3-031-43401-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation