User Evaluation Support Through Development Environment for Agile Software Teams

  • Shah Rukh Humayoun
  • Yael Dubinsky
  • Tiziana Catarci
Conference paper
Part of the Lecture Notes in Information Systems and Organisation book series (LNISO, volume 7)


User evaluation is generally performed early in the development process to reveal usability problems, design flaws, and errors and correct them before deploying. Due to the short iterations of agile development, implementing user evaluation as part of the development process is a challenge that is often neglected. In a previous work, we proposed an approach that would enable the integration of user evaluation throughout the development process, by managing and automating user evaluation activities from with the integrated development environment (IDE). In this work, we focus on a case study in which small-sized agile software teams, made up of students in an annual software engineering project course, applied our integrated user evaluation approach for developing their software projects. The feedbacks from these agile teams show the intuitiveness and effectiveness of our integration approach.


User evaluation Automated evaluation Integrated development environment (IDE) Software development Agile development 


  1. 1.
    Abrahamsson, P., Salo, O., Ronkainen, J., Warsta, J.: Agile software development methods—review and analysis. Technical Report 478, VTT Publications (2002)Google Scholar
  2. 2.
    Agile-Alliance.: Manifesto for agile software development. Technical re-port. (2001)
  3. 3.
    Anderson, J., Fleek, F., Garrity, K., Drake, F.: Integrating usability techniques into software development. IEEE Softw. 18(1), 46–53 (2001)Google Scholar
  4. 4.
    Carmel, E., Espinosa, J.A., Dubinsky, Y.: “Follow the sun” workflow in global software development. J. Manag. Inf. Syst. 27(1), 17–38 (2010)CrossRefGoogle Scholar
  5. 5.
    Chamberlain, S., Sharp, H., Maiden, N.A.M.: Towards a framework for integrating agile development and user-centred design. In: Abrahamsson, P., Marchesi, M., Succi, G. (eds.) XP 2006. LNCS, vol. 4044, pp. 143–153. Springer, Heidelberg (2006)Google Scholar
  6. 6.
    Constantine, L.L., Lockwood, L.A.D.: Usage-centered software engineering: an agile approach to integrating users, user interfaces, and usability into software engineering practice. In: ICSE ’03, IEEE Computer Society, Washington, DC, USA, pp. 746–747 (2003)Google Scholar
  7. 7.
    Dix, A., Finlay, J.E., Abowd, G.D., Beale, R.: Human-Computer Interaction, 3rd edn. Prentice-Hall Inc, Upper Saddle River (2003)Google Scholar
  8. 8.
    Dubinsky, Y., Hazzan, O.: The construction process of a framework for teaching software development methods. Comput. Sci. Educ. 15(4), 275–296 (2005)CrossRefGoogle Scholar
  9. 9.
    Dubinsky, Y., Catarci, T., Humayoun, S.R., Kimani, S.: Integrating user evaluation into software development environments. In: 2nd DELOS Conference on Digital Libraries, Pisa, Italy (December 5–7, 2007)Google Scholar
  10. 10.
    Dubinsky, Y., Humayoun, S.R., Catarci, T.: Eclipse plug-into manage user centered design. In: Workshop on the Interplay between Usability Evaluation and Software Development (I-USED), Pisa, Italy (2008)Google Scholar
  11. 11.
    Göransson, B., Gulliksen, J., Boivie, I.: The usability design process—integrating user- centered systems design in the software development process. Softw. Process Improv. Pract. 8, 111–131 (2003)CrossRefGoogle Scholar
  12. 12.
    Gulliksen, J., Goransson, B., Boivie, I., Blomkvist, S., Persson, J., Cajander, A.: Key principles for user-centered systems design. Behav. Inf. Technol. 22(6), 397–409 (2003)CrossRefGoogle Scholar
  13. 13.
    Hazzan, O., Dubinsky, Y.: Agile software engineering. In: Undergraduate Topics in Computer Science Series. Springer, London (2008)Google Scholar
  14. 14.
    Humayoun, S.R., Dubinsky, Y., Catarci, T.: UEMan: a tool to manage user evaluation in development environments. In: ICSE, pp. 551–554. IEEE press, Vancouver (2009)Google Scholar
  15. 15.
    Humayoun, S.R., Dubinsky, Y., Catarci, T.: A three-fold integration framework to incorporate user-centered design into agile software development. In: Kurosu, M. (ed.) HCD’11, pp. 55–64. Springer, Berlin (2011)Google Scholar
  16. 16.
    Humayoun, S.R.: Incorporating usability evaluation in software development environments. Künstliche Intelligenz 26(2), 197–200 (2012)CrossRefGoogle Scholar
  17. 17.
    Ivory, M.Y., Hearst, M.A.: The state of the art in automating usability evaluation of user interfaces. ACM Comput. Surv. 33, 470–516 (2001)CrossRefGoogle Scholar
  18. 18.
    Kiczales, G., Mezini, M.: Aspect-oriented programming and modular reasoning. In: ICSE ‘05. ACM, New York, NY, USA, pp. 49–58 (2005)Google Scholar
  19. 19.
    Landauer, T.K.: The Trouble with Computers: Usefulness, Usability, and Productivity. The MIT Press, Cambridge (1996)Google Scholar
  20. 20.
    Lohmann, S., Rashid, A.: Fostering remote user participation and integration of user feedback into software development. In: I-USED (2008)Google Scholar
  21. 21.
    Patton, J.: Hitting the target: adding interaction design to agile software development. In: OOPSLA 2002. ACM, New York (2002)Google Scholar
  22. 22.
    Rogers, Y., Sharp, H., Preece, J.: Interaction Design—Beyond Human-Computer Interaction, 3rd edn. Wiley, Chichester (2012)Google Scholar
  23. 23.
    Sy, D.: Adapting usability investigations for agile user-centered design. J. Usability Stud. 2(3), 112–130 (2000)Google Scholar
  24. 24.
    Talby, D., Hazzan, O., Dubinsky, Y., Keren, A.: Agile software testing in a large-scale project. IEEE Softw. (Special Issue on Software Testing) 23(4), 30–37 (2006)Google Scholar

Copyright information

© Springer International Publishing Switzerland 2014

Authors and Affiliations

  • Shah Rukh Humayoun
    • 1
  • Yael Dubinsky
    • 2
  • Tiziana Catarci
    • 3
  1. 1.Computer Graphics and HCI GroupUniversity of KaiserslauternKaiserslauternGermany
  2. 2.IBM Research—HaifaHaifaIsrael
  3. 3.Dipartimento di Ingegneria Informatica, Automatica e Gestionale “A. Rubert”SAPIENZA Università di RomaRomeItaly

Personalised recommendations