Modelling Users Feedback in Crowd-Based Requirements Engineering: An Empirical Study

  • Nada Sherief
  • Walid Abdelmoez
  • Keith Phalp
  • Raian AliEmail author
Conference paper
Part of the Lecture Notes in Business Information Processing book series (LNBIP, volume 235)


Most enterprises operate within a complex and ever-changing context. To ensure that requirements keep pace with changing context, users’ feedback is advocated to ensure that the requirements knowledge is refreshed and reflects the degree to which the system meets its design objectives. The traditional approach to users’ feedback, which is based on data mining and text analysis, is often limited, partly due to the ad-hoc nature of users’ feedback and, also, the methods used to acquire it. To maximize the expressiveness of users’ feedback and still be able to efficiently analyse it, we propose that feedback acquisition should be designed with that goal in mind. This paper contributes to that aim by presenting an empirical study that investigates users’ perspectives on feedback constituents and how they could be structured. This will provide a baseline for modelling and customizing feedback for enterprise systems in order to maintain and evolve their requirements.


Users’ feedback Feedback analysis User involvement Crowd-Based requirements engineering Enterprise requirements evaluation 



The research is supported by a European FP7 Marie Curie CIG grant (the SOCIAD project) and Bournemouth University through the Graduate School PGR Development fund.


  1. 1.
    Jarke, M., Loucopoulos, P., Lyytinen, K., Mylopoulos, J., Robinson, W.: The brave new world of design requirements. Information Systems 36(7), 992–1008 (2011)CrossRefGoogle Scholar
  2. 2.
    Cleland-Huang, J., Jarke, M., Liu, L., Lyytinen, K.: Requirements management–novel perspectives and challenges. In: Dagstuhl Reports 2, vol. 10, pp. 117–152 (2013)Google Scholar
  3. 3.
    Hosseini, M., Phalp, K., Taylor, J., Ali, R.: Towards crowdsourcing for requirements engineering. In: REFSQ 2014, Germany (2014)Google Scholar
  4. 4.
    Snijders, R., Dalpiaz, F., Hosseini, M., Shahri, A., Ali, R.: Crowd-centric requirements engineering. In: UCC 2014, pp. 614–615. IEEE, London (2014)Google Scholar
  5. 5.
    Ali, R., Solis, C., Omoronyia, I., Salehie, M., and Nuseibeh, B.: Social adaptation: when software gives users a voice. In: ENASE 2012, Poland (2012)Google Scholar
  6. 6.
    Ali, R., Solis, C., Salehie, M., Omoronyia, I., Nuseibeh, B., Maalej, W.: Social sensing: when users become monitors. In: ESEC/FSE 2011, Hungary, pp. 476–479 (2001)Google Scholar
  7. 7.
    Sherief, N., Jiang, N., Hosseini, M., Phalp, K., Ali, R.: Crowdsourcing software evaluation. In: EASE 2014, pp. 19. ACM, London (2014)Google Scholar
  8. 8.
    Almaliki, M., Ncube, C., Ali, R.: The design of adaptive acquisition of users feedback: An empirical study. In: RCIS 2014. IEEE, Morocco (2014)Google Scholar
  9. 9.
    Almaliki, M., Ncube, C. Ali, R.: Adaptive software-based Feedback acquisition: a persona-based design. In: RCIS 2015. IEEE, Greece (2015)Google Scholar
  10. 10.
    Kontio, J., Lehtola, L., Bragge, J.: Using the focus group method in software engineering: obtaining practitioner and user experiences. In: ISESE 2004. IEEE, USA (2004)Google Scholar
  11. 11.
    Braun, V., Clarke, V.: Using thematic analysis in psychology. Qual. Res. Psychol. 3(2), 77–101 (2006)CrossRefGoogle Scholar
  12. 12.
    Crawford, H.K., Leybourne, M.L., Arnott, A.: How we ensured rigor from a multi-site, multi-discipline, multi-researcher study. In: Forum Qualitative Sozialforschung/Forum: Qualitative Social Research, vol. 1, no. 1 (2000)Google Scholar
  13. 13.
    Krogstie, J., Lyytinen, K., Opdahl, A.L., Pernici, B., Siau, K., Smolander, K.: Research areas and challenges for mobile information systems. Int. J. Mobile Commun. 2(3), 220–234 (2004)CrossRefGoogle Scholar
  14. 14.
    Vredenburg, K., Mao, J.Y., Smith, P.W., Carey, T.: A survey of user-centered design practice. In: CHI 2002, pp. 471–478. ACM, Minneapolis, Minnesota, USA (2002)Google Scholar
  15. 15.
    Law, E.L.C., Van Schaik, P.: Modelling user experience - an agenda for research and practice. Interact. Comput. 22(5), 313–322 (2010)CrossRefGoogle Scholar
  16. 16.
    Dybå, T., Dingsøyr, T.: Empirical studies of agile software development: a systematic review. Inf. Softw. Technol. 50(9–10), 833–859 (2008)CrossRefGoogle Scholar
  17. 17.
    Adikari, S., McDonald, C.: User and usability modeling for HCI/HMI: a research design. In: ICIA 2006, pp. 151–154. IEEE (2006)Google Scholar
  18. 18.
    Doll, W.J., Torkzadeh, G.: The measurement of end-user computing satisfaction. MIS Q. 12, 259–274 (1988)CrossRefGoogle Scholar
  19. 19.
    Yeoh, W., Koronios, A.: Critical success factors for business intelligence systems. J. Comput. Inf. Syst. 50(3), 23–32 (2010)Google Scholar
  20. 20.
    Pourshahid, A., Amyot, D., Peyton, L., Ghanavati, S., Chen, P., Weiss, M., Forster, A.J.: Business process management with the user requirements notation. Electron. Commer. Res. 9(4), 269–316 (2009)CrossRefGoogle Scholar
  21. 21.
    Svee, E.-O., Giannoulis, C., Zdravkovic, J.: Modeling business strategy: a consumer value perspective. In: Johannesson, P., Krogstie, J., Opdahl, A.L. (eds.) PoEM 2011. LNBIP, vol. 92, pp. 67–81. Springer, Heidelberg (2011)CrossRefGoogle Scholar
  22. 22.
    Galvis Carreño, L.V., Winbladh, K.: Analysis of user comments: an approach for software requirements evolution. In: ICSE 2013, pp. 582–591. IEEE Press, CA, USA (2013)Google Scholar
  23. 23.
    Schneider, K.: Focusing spontaneous feedback to support system evolution. In: RE 2011. IEEE, Italy (2011)Google Scholar
  24. 24.
    Seyff, N., Graf, F., Maiden, N.: Using mobile RE tools to give end-users their own voice. In: RE 2010, pp. 37–46. IEEE Computer Society, Sydney, Australia (2010)Google Scholar
  25. 25.
    Yu, E.S.: Social modeling and i*. In: Borgida, A.T., Chaudhri, V.K., Giorgini, P., Yu, E.S. (eds.) Conceptual Modeling: Foundations and Applications. LNCS, vol. 5600, pp. 99–121. Springer, Heidelberg (2009)CrossRefGoogle Scholar
  26. 26.
    Kang, K.C., Kim, S., Lee, J., Kim, K., Shin, E., Huh, M.: FORM: a feature-; oriented reuse method with domain-; specific reference architectures. Ann. Softw. Eng. 5(1), 143–168 (1998)CrossRefGoogle Scholar
  27. 27.
    OMG, B.P.M.N., Version 1.0. OMG Final Adopted Specification, Object Management Group (2006)Google Scholar

Copyright information

© IFIP International Federation for Information Processing 2015

Authors and Affiliations

  • Nada Sherief
    • 1
  • Walid Abdelmoez
    • 2
  • Keith Phalp
    • 1
  • Raian Ali
    • 1
    Email author
  1. 1.Faculty of Science and TechnologyBournemouth UniversityPooleUK
  2. 2.The Arab Academy for Science, Technology and Maritime TransportAlexandriaEgypt

Personalised recommendations