Skip to main content

What Makes a Good UX Questionnaire? User-Centered Scorecard Development

  • Conference paper
  • First Online:
Advances in Affective and Pleasurable Design

Part of the book series: Advances in Intelligent Systems and Computing ((AISC,volume 483))

  • 1631 Accesses

Abstract

Numerous standardized questionnaires like the System Usability Scale and Net Promoter Score have been developed to provide reliable and valid measurement of subjective satisfaction. Few studies, however, examine the perceived usability and preferences of questionnaires by the raters or end users themselves. In this study, 20 participants evaluated different types of questionnaires as well as ranked and discussed their subjective preferences for them. We found that 65 % of participants chose the questionnaire with enhanced design features (e.g., color-coded ratings, user experience examples, and specific/global comments) as well as measurement of user experience beyond usability as the most preferred questionnaire, while 80 % of participants chose the questionnaire that measured user experience with semantic-differential rating scales as the least preferred. Based on participant feedback, we provide several questionnaire design recommendations.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
EUR 32.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Brooke, J.: SUS: a “quick and dirty” usability scale. Usabiltiy Eval. Ind. 189–194 (1996)

    Google Scholar 

  2. Reichheld, F.F.: The one number you need to grow. Harvard Bus. Rev. 81, 46–54 (2003)

    Google Scholar 

  3. Lund, A.: Measuring usability with the USE questionnaire. Usability Interface 8(2), 3–6 (2001)

    MathSciNet  Google Scholar 

  4. Lewis, J., Sauro, J.: The factor structure of the system usability scale. In: Human Centered Design, HCII 2009, pp. 94–103. Springer, Berlin (2009)

    Google Scholar 

  5. Tullis, T.S., Stetson, J.N.: A comparison of questionnaires for assessing website usability. In: Usability Professional Association Conference, pp. 1–12 (2004)

    Google Scholar 

  6. Sauro, J.: SUPR-Q: a comprehensive measure of the quality of the website user experience. J. Usability Stud. 68–86 (2015)

    Google Scholar 

  7. Chin, J.P., Diehl, V.A., Norman, K.L.: Development of an instrument measuring user satisfaction of the human-computer interface. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 213–218 (1988)

    Google Scholar 

  8. Bangor, A., Kortum, P.T., Miller, J.T.: An empirical evaluation of the system usability scale. Int. J. Hum. Comput. Interact. 6, 574–594 (2008)

    Article  Google Scholar 

  9. Abby Covert.: Does it have legs? Information architecture heuristics for interaction designers. Retrieved 15 June 2015 from http://www.slideshare.net/AbbyCovert/information-architecture-heuristics (2011)

  10. Nielsen, J., Molich, R.: Heuristic evaluation of user interfaces. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 249–256 (1990)

    Google Scholar 

  11. Morville, P.: User experience honeycomb. Retrieved 22 June 2015 from http://semanticstudios.com/user_experience_design (2004)

  12. Resmini, A., Rosati, L.: Pervasive Information Architecture: Designing Cross-Channel User Experiences. Elsevier Inc., Burlington (2011)

    Google Scholar 

  13. Finstad, K.: The system usability scale and non-native English speakers. J. Usability Stud. 185–188 (2006)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Seunghyun “Tina” Lee .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer International Publishing Switzerland

About this paper

Cite this paper

“Tina” Lee, S., Ivory, M. (2017). What Makes a Good UX Questionnaire? User-Centered Scorecard Development. In: Chung, W., Shin, C. (eds) Advances in Affective and Pleasurable Design . Advances in Intelligent Systems and Computing, vol 483. Springer, Cham. https://doi.org/10.1007/978-3-319-41661-8_28

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-41661-8_28

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-41660-1

  • Online ISBN: 978-3-319-41661-8

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics