Usability Engineering in the Wild: How Do Practitioners Integrate Usability Engineering in Software Development?

  • Nis Bornoe
  • Jan Stage
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8742)


It has been argued that too much research on usability engineering is incoherent with the processes, and settings being the realities for practitioners. In this paper we want to extend the existing knowledge about usability engineering in the wild. Through 12 semi-structured interviews we wanted to get an understanding of how usability is perceived, and practiced in reality. We found that our participants primarily focus on upfront work to support the design, and implementation process. They implement usability engineering through informal evaluations, and by following a set of local de facto standards. We want to extend the existing body of knowledge about usability engineering in practice, to support the development of methods aimed at practitioners.


Usability usability engineering user experience (UX) software development agile development usability practitioners 


  1. 1.
    Bak, J.O., Nguyen, K., Risgaard, P., Stage, J.: Obstacles to usability evaluation in practice: a survey of software development organizations. In: Proceedings of the 5th Nordic Conference on Human-computer Interaction: Building Bridges, pp. 23–32. ACM, New York (2008)Google Scholar
  2. 2.
    Bargas-Avila, J.A., Hornbæk, K.: Old wine in new bottles or novel challenges: a critical analysis of empirical studies of user experience. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 2689–2698. ACM, New York (2011)Google Scholar
  3. 3.
    Bødker, S., Sundblad, Y.: Usability and interaction design – new challenges for the Scandinavian tradition. Behav. Inf. Technol. 27(4), 293–300 (2008)CrossRefGoogle Scholar
  4. 4.
    Bruun, A., Jensen, J.J., Skov, M.B., Stage, J.: Active Collaborative Learning: Supporting Software Developers in Creating Redesign Proposals. In: Sauer, S., et al. (eds.) HCSE 2014. LNCS, vol. 8742, pp. 1–18. Springer, Heidelberg (2014)Google Scholar
  5. 5.
    Budwig, M., Jeong, S., Kelkar, K.: When user experience met agile: a case study. In: CHI 2009 Extended Abstracts on Human Factors in Computing Systems, pp. 3075–3084. ACM, New York (2009)Google Scholar
  6. 6.
    Bygstad, B., Ghinea, G., Brevik, E.: Software development methods and usability: Perspectives from a survey in the software industry in Norway. Interact. with Comput. 20(3), 375–385 (2008)CrossRefGoogle Scholar
  7. 7.
    Cajander, Å., Larusdottir, M., Gulliksen, J.: Existing but Not Explicit - The User Perspective in Scrum Projects in Practice. In: Kotzé, P., Marsden, G., Lindgaard, G., Wesson, J., Winckler, M. (eds.) INTERACT 2013, Part III. LNCS, vol. 8119, pp. 762–779. Springer, Heidelberg (2013)CrossRefGoogle Scholar
  8. 8.
    Chilana, P.K., Wobbrock, J.O., Ko, A.J.: Understanding Usability Practices in Complex Domains. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 2337–2346. ACM, New York (2010)Google Scholar
  9. 9.
    Følstad, A., Law, E., Hornbæk, K.: Analysis in practical usability evaluation: a survey study. In: Proceedings of the 2012 ACM Annual Conference on Human Factors in Computing Systems, pp. 2127–2136. ACM, New York (2012)CrossRefGoogle Scholar
  10. 10.
    Furniss, D., Blandford, A., Curzon, P.: Usability Work in Professional Website Design: Insights from Practitioners’ Perspectives. In: Law, E.-C., Hvannberg, E., Cockton, G. (eds.) Maturing Usability SE- 7, pp. 144–167. Springer London (2008)Google Scholar
  11. 11.
    Gulliksen, J., Boivie, I., Göransson, B.: Usability professionals—current practices and future development. Interact. with Comput. 18(4), 568–600 (2006)CrossRefGoogle Scholar
  12. 12.
    Hornbæk, K.: Dogmas in the assessment of usability evaluation methods. Behav. Inf. Technol. 29(1), 97–111 (2010)CrossRefGoogle Scholar
  13. 13.
    Jia, Y., Larusdottir, M., Cajander, Å.: The Usage of Usability Techniques in Scrum Projects. In: Winckler, M., Forbrig, P., Bernhaupt, R. (eds.) HCSE 2012. LNCS, vol. 7623, pp. 331–341. Springer, Heidelberg (2012)CrossRefGoogle Scholar
  14. 14.
    Jokela, T., Koivumaa, J., Pirkola, J., Salminen, P., Kantola, N.: Methods for Quantitative Usability Requirements: A Case Study on the Development of the User Interface of a Mobile Phone. Pers. Ubiquitous Comput. 10(6), 345–355 (2006)CrossRefGoogle Scholar
  15. 15.
    Juristo, N., Moreno, A.M., Sanchez-Segura, M.-I.: Analysing the impact of usability on software design. J. Syst. Softw. 80(9), 1506–1516 (2007)CrossRefGoogle Scholar
  16. 16.
    Kuusinen, K., Mikkonen, T., Pakarinen, S.: Agile user experience development in a large software organization: Good expertise but limited impact. In: Winckler, M., Forbrig, P., Bernhaupt, R. (eds.) HCSE 2012. LNCS, vol. 7623, pp. 94–111. Springer, Heidelberg (2012)CrossRefGoogle Scholar
  17. 17.
    Lárusdóttir, M., Cajander, Å., Gulliksen, J.: Informal feedback rather than performance measurements – user-centred evaluation in Scrum projects. Behav. Inf. Technol. (2013)Google Scholar
  18. 18.
    Lee, J.C., Scott McCrickard, D.: Towards Extreme(ly) Usable Software: Exploring Tensions Between Usability and Agile Software Development. In: Agile Conference (AGILE) 2007, pp. 59–71 (2007)Google Scholar
  19. 19.
    Lizano, F., Sandoval, M.M., Bruun, A., Stage, J.: Is Usability Evaluation Important: The Perspective of Novice Software Developers. In: The 27th International BCS Human Computer Interaction Conference (HCI 2013) (2013)Google Scholar
  20. 20.
    Molich, R.: The Quest for Quality: Usability Testing Assessment. In: Proceedings of the 11th Danish Human-Computer Interaction Research Symposium, pp. 56–59 (2011)Google Scholar
  21. 21.
    Monahan, K., Lahteenmaki, M., McDonald, S., Cockton, G.: An Investigation into the Use of Field Methods in the Design and Evaluation of Interactive Systems. In: Proceedings of the 22Nd British HCI Group Annual Conference on People and Computers: Culture, Creativity, Interaction, vol. 1, pp. 99–108. British Computer Society, Swinton (2008)Google Scholar
  22. 22.
    Nielsen, J.: Usability engineering. Morgan Kaufmann (1993)Google Scholar
  23. 23.
    Nielsen, L., Madsen, S.: The Usability Expert’s Fear of Agility: An Empirical Study of Global Trends and Emerging Practices. In: Proceedings of the 7th Nordic Conference on Human-Computer Interaction: Making Sense Through Design, pp. 261–264. ACM, New York (2012)Google Scholar
  24. 24.
    Nørgaard, M., Hornbæk, K.: What do usability evaluators do in practice?: an explorative study of think-aloud testing. In: Proceedings of the 6th Conference on Designing Interactive Systems, pp. 209–218. ACM, New York (2006)CrossRefGoogle Scholar
  25. 25.
    Seffah, A., Metzker, E.: The obstacles and myths of usability and software engineering. Commun. ACM 47(12), 71–76 (2004)CrossRefGoogle Scholar
  26. 26.
    Da Silva, T., Martin, A., Maurer, F., Silveira, M.: User-Centered Design and Agile Methods: A Systematic Review. In: Agile Conference (AGILE), pp. 77–86 (2011)Google Scholar
  27. 27.
    Sy, D.: Adapting usability investigations for agile user-centered design. J. usability Stud. 2(3), 112–132 (2007)MathSciNetGoogle Scholar
  28. 28.
    Venturi, G., Troost, J., Jokela, T.: People, Organizations, and Processes: An Inquiry into the Adoption of User-Centered Design in Industry. Int. J. Hum. Comput. Interact. 21(2), 219–238 (2006)CrossRefGoogle Scholar
  29. 29.
    Wixon, D.: Evaluating Usability Methods: Why the Current Literature Fails the Practitioner. Interactions 10(4), 28–34 (2003)CrossRefGoogle Scholar

Copyright information

© IFIP International Federation for Information Processing 2014

Authors and Affiliations

  • Nis Bornoe
    • 1
  • Jan Stage
    • 1
  1. 1.Aalborg UniversityAalborgDenmark

Personalised recommendations