Skip to main content
SpringerLink
Log in

Satisfied or not: user experience of mobile augmented reality in using natural language processing techniques on review comments

  • Original Article
  • Published:
Virtual Reality Aims and scope Submit manuscript

Abstract

With the rapid developments and improvements in mobile technologies, mobile devices have become one of the primary interfaces of augmented reality technologies. In this study, we explore how user groups (satisfied vs. dissatisfied users) and domains (game vs. non-game domain) affect user experience, including perceived usefulness, usability, and affection using two-factor theory and analysis of review comments. We employ two linguistic approaches for processing the content of the comments. The results of a series of analyses of variance indicate that both user groups and domains significantly affect user-perceived usability and affection, while there is no effect of user groups on the perceived usefulness of mobile applications. Based on the findings of the study, notable implications and a few limitations are presented.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

Similar content being viewed by others

Notes

  1. https://play.google.com/store/search?q=ar&c=apps&hl=en.

  2. https://www.merriam-webster.com/.

References

  • Aggelidis VP, Chatzoglou PD (2012) Hospital information systems: measuring end user computing satisfaction (EUCs). J Biomed Inform 45(3):566–579

    Article  Google Scholar 

  • Alizadehsalehi S, Hadavi A, Huang JC (2020) From BIM to extended reality in AEC industry. Autom Constr 116:103254

    Article  Google Scholar 

  • Azuma RT (1997) A survey of augmented reality. Presence Teleoperators Virtual Environ 6(4):355–385

    Article  Google Scholar 

  • Bailey JE, Pearson SW (1983) Development of a tool for measuring and analyzing computer user satisfaction. Manag Sci 29(5):530–545

    Article  Google Scholar 

  • Bevan N (2009) Extending quality in use to provide a framework for usability measurement. In: International conference on human centered design. Springer, Berlin, pp 13–22

  • Chen Y, Wang Q, Chen H, Song X, Tang H, Tian M (2019) An overview of augmented reality technology. J Phys Conf Ser 1237(2):022082

    Article  Google Scholar 

  • Davis FD (1989) Perceived usefulness, perceived ease of use, and user acceptance of information technology. MIS Q 13(3):319–340

    Article  Google Scholar 

  • Demirbilek O, Sener B (2003) Product design, semantics and emotional response. Ergonomics 46(13–14):1346–1360

    Article  Google Scholar 

  • Deng L, Liu Y (2018) Deep learning in natural language processing. Springer, Berlin

    Book  Google Scholar 

  • Dey A, Billinghurst M, Lindeman RW, Swan J (2018) A systematic review of 10 years of augmented reality usability studies: 2005 to 2014. Front Robot AI 5(37):1–28

    Google Scholar 

  • Dirin A, Laine T (2018) User experience in mobile augmented reality: emotions, challenges, opportunities and best practices. Computers 7(2):33–45

    Article  Google Scholar 

  • Doll WJ, Torkzadeh G (1988) The measurement of end-user computing satisfaction. MIS Q 12(2):259–274

    Article  Google Scholar 

  • Fang X, Zhan J (2015) Sentiment analysis using product review data. J Big Data 2(5):1–14

    Google Scholar 

  • Farshid M, Paschen J, Eriksson T, Kietzmann J (2018) Go boldly! Explore augmented reality (AR), virtual reality (VR), and mixed reality (MR) for business. Bus Horiz 61(5):657–663

    Article  Google Scholar 

  • Genc-Nayebi N, Abran A (2017) A systematic literature review: opinion mining studies from mobile app store user reviews. J Syst Softw 125:207–219

    Article  Google Scholar 

  • Goebert C, Greenhalgh GP (2020) A new reality: fan perceptions of augmented reality readiness in sport marketing. Comput Hum Behav 106:106231

    Article  Google Scholar 

  • Guzman E, Maalej W (2014) How do users like this feature? A fine grained sentiment analysis of app reviews. In: 2014 IEEE 22nd international requirements engineering conference (RE). IEEE, Karlskrona, pp 153–162

  • Hedegaard S, Simonsen JG (2013) Extracting usability and user experience information from online user reviews. In: Proceedings of the SIGCHI conference on human factors in computing systems. ACM, New York, pp 2089–2098

  • Herzberg F, Mausner B, Snyderman BB (1959) The motivation to work. Wiley, New York

    Google Scholar 

  • Herzberg F et al (1968) One more time: how do you motivate employees. Harv Bus Rev 46:53–62

    Google Scholar 

  • Hsu SHY, Tsou HT, Chen JS (2021) “Yes, we do. Why not use augmented reality?” Customer responses to experiential presentations of AR-based applications. J Retail Consum Serv 62:102649

    Article  Google Scholar 

  • Huang TL, Liao S (2015) A model of acceptance of augmented-reality interactive technology: the moderating role of cognitive innovativeness. Electron Commer Res 15(2):269–295

    Article  Google Scholar 

  • Islam AN (2014) Sources of satisfaction and dissatisfaction with a learning management system in post-adoption stage: a critical incident technique approach. Comput Hum Behav 30:249–261

    Article  Google Scholar 

  • Jang Y, Park E (2019) An adoption model for virtual reality games: the roles of presence and enjoyment. Telematics Inform 42:101239

    Article  Google Scholar 

  • Jung T, tom Dieck MC (2018) Augmented reality and virtual reality: empowering human, place and business. Springer, Cham

    Book  Google Scholar 

  • Jung T, Chung N, Leue MC (2015) The determinants of recommendations to use augmented reality technologies: the case of a Korean theme park. Tour Manag 49:75–86

    Article  Google Scholar 

  • Kanakaraj M, Guddeti RMR (2015) Nlp based sentiment analysis on twitter data using ensemble classifiers. In: 2015 3rd International Conference on Signal Processing, Communication and Networking (ICSCN). IEEE, Chennai, pp 1–5

  • Kano N (1984) Attractive quality and must-be quality. Hinshitsu (Quality, The Journal of Japanese Society for Quality Control) 14:39–48

    Google Scholar 

  • Karimi HA (2004) Telegeoinformatics: location-based computing and services. CRC Press, Boca Raton

    Book  Google Scholar 

  • Kim J (2005) Human computer interaction introduction. Ahn Graphics, Seoul

    Google Scholar 

  • Ko SM, Chang WS, Ji YG (2013) Usability principles for augmented reality applications in a smartphone environment. Int J Hum Comput Interact 29(8):501–515

    Article  Google Scholar 

  • Kosmadoudi Z, Lim T, Ritchie J, Louchart S, Liu Y, Sung R (2013) Engineering design using game-enhanced cad: the potential to augment the user experience with game elements. Comput Aided Des 45(3):777–795

    Article  Google Scholar 

  • Lee S, Shin B, Lee HG (2009) Understanding post-adoption usage of mobile data services: the role of supplier-side variables. J Assoc Inf Syst 10(12):860–888

    Google Scholar 

  • Liu CZ, Au YA, Choi HS (2014) Effects of freemium strategy in the mobile app market: an empirical study of google play. J Manag Inf Syst 31(3):326–354

    Article  Google Scholar 

  • Llewellyn C, Grover C, Oberlander J (2014) Summarizing newspaper comments. In: Eighth international AAAI conference on weblogs and social media. Association for the Advancement of Artificial Intelligence, Palo Alto, pp 599–602

  • López-Faican L, Jaen J (2020) Emofindar: evaluation of a mobile multiplayer augmented reality game for primary school children. Comput Educ 149:103814

    Article  Google Scholar 

  • Muylle S, Moenaert R, Despontin M (2004) The conceptualization and empirical validation of web site user satisfaction. Inf Manag 41(5):543–560

    Article  Google Scholar 

  • Olsson T, Lagerstam E, Kärkkäinen T, Väänänen-Vainio-Mattila K (2013) Expected user experience of mobile augmented reality services: a user study in the context of shopping centres. Pers Ubiquit Comput 17(2):287–304

    Article  Google Scholar 

  • Park SC, Ryoo SY (2013) An empirical investigation of end-users’ switching toward cloud computing: a two factor theory perspective. Comput Hum Behav 29(1):160–170

    Article  Google Scholar 

  • Phan MH, Keebler JR, Chaparro BS (2016) The development and validation of the game user experience satisfaction scale (guess). Hum Factors 58(8):1217–1247

    Article  Google Scholar 

  • Qin H, Peak DA, Prybutok V (2021) A virtual market in your pocket: how does mobile augmented reality (MAR) influence consumer decision making? J Retail Consum Serv 58:102337

    Article  Google Scholar 

  • Ramos J et al (2003) Using TF-IDF to determine word relevance in document queries. In: Proceedings of the first instructional conference on machine learning, Piscataway, NJ, vol 242, pp 133–142

  • Ruiz-Ariza A, Casuso RA, Suarez-Manzano S, Martínez-López EJ (2018) Effect of augmented reality game pokémon go on cognitive performance and emotional intelligence in adolescent young. Comput Educ 116:49–63

    Article  Google Scholar 

  • Salton G, Buckley C (1988) Term-weighting approaches in automatic text retrieval. Inf Process Manag 24(5):513–523

    Article  Google Scholar 

  • Scavarelli A, Arya A, Teather RJ (2020) Virtual reality and augmented reality in social learning spaces: a literature review. Virtual Reality 25:257–277

    Article  Google Scholar 

  • Scholtz J, Consolvo S (2004) Toward a framework for evaluating ubiquitous computing applications. IEEE Pervasive Comput 3(2):82–88

    Article  Google Scholar 

  • Schrepp M, Hinderks A, Thomaschewski J (2014) Applying the user experience questionnaire (UEQ) in different evaluation scenarios. In: International conference of design, user experience, and usability. Springer, Cham, pp 383–392

  • Serino M, Cordrey K, McLaughlin L, Milanaik RL (2016) Pokémon go and augmented virtual reality games: a cautionary commentary for parents and pediatricians. Curr Opin Pediatr 28(5):673–677

    Article  Google Scholar 

  • Sherry JL, Lucas K, Greenberg BS, Lachlan K (2006) Video game uses and gratifications as predictors of use and game preference. Playing Video Games Motives Responses Conseq 24(1):213–224

    Google Scholar 

  • Takacs G, Chandrasekhar V, Gelfand N, Xiong Y, Chen WC, Bismpigiannis T, Grzeszczuk R, Pulli K, Girod B (2008) Outdoors augmented reality on mobile phone using loxel-based visual feature organization. In: Proceedings of the 1st ACM international conference on Multimedia information retrieval. ACM, New York, pp 427–434

  • Takatalo J, Häkkinen J, Kaistinen J, Nyman G (2010) Presence, involvement, and flow in digital games. Evaluating user experience in games. Springer, Cham, pp 23–46

    Chapter  Google Scholar 

  • Wagner D, Reitmayr G, Mulloni A, Drummond T, Schmalstieg D (2009) Real-time detection and tracking for augmented reality on mobile phones. IEEE Trans Visual Comput Graph 16(3):355–368

    Article  Google Scholar 

  • Weichbroth P, Baj-Rogowska A (2019) Do online reviews reveal mobile application usability and user experience? The case of whatsapp. In: 2019 Federated Conference on Computer Science and Information Systems (FedCSIS). IEEE, New York, pp 747–754

  • Winn BM (2009) The design, play, and experience framework. Handbook of research on effective electronic gaming in education. IGI Global, New York, pp 1010–1024

    Chapter  Google Scholar 

  • Wixom BH, Todd PA (2005) A theoretical integration of user satisfaction and technology acceptance. Inf Syst Res 16(1):85–102

    Article  Google Scholar 

  • Wu LL, Chuang YL, Chen PY (2008) Motivation for using search engines: a two-factor model. J Am Soc Inf Sci Technol 59(11):1829–1840

    Article  Google Scholar 

Download references

Acknowledgements

This research was supported by National Research Foundation (NRF) of Korea Grant funded by the Korean Government (MSIT) (No. 2021R1A4A3022102), and by Korea Agency for Infrastructure Technology Advancement (No. 21ATOG-C161932-01).

Author information

Authors and Affiliations

  1. Department of Interaction Science, Sungkyunkwan University, Seoul, 03063, Korea

    Yeonju Jang & Eunil Park

Authors
  1. Yeonju Jang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Eunil Park
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Eunil Park.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Jang, Y., Park, E. Satisfied or not: user experience of mobile augmented reality in using natural language processing techniques on review comments. Virtual Reality 26, 839–848 (2022). https://doi.org/10.1007/s10055-021-00599-y

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10055-021-00599-y

Keywords

Search

Navigation