Gamification pp 123-135 | Cite as

Engaging the Crowd of Stakeholders in Requirements Engineering via Gamification

  • Fabiano DalpiazEmail author
  • Remco Snijders
  • Sjaak Brinkkemper
  • Mahmood Hosseini
  • Alimohammad Shahri
  • Raian Ali
Part of the Progress in IS book series (PROIS)


Requirements engineering (RE) is a discipline that focuses on obtaining a specification for a system that fulfils the expectations of the stakeholders. Unfortunately, the current state of the practice reveals that only a few stakeholders are involved—mostly key clients and lead designers—while active stakeholders are not highly engaged. This lowers the chances of obtaining a system that fully fulfils the stakeholders’ wishes. Gamification is an opportunity to increase the engagement of stakeholders in RE by establishing feedback loops that reward the useful participants, i.e., those who provide valuable contributions (requirements) for the system being designed. The related trend of crowdsourcing can be employed to maximise the number of participating stakeholders, by making RE a participatory activity where current and prospective users, developers, clients and analysts are involved. This chapter introduces the Crowd-Centric Requirements Engineering (CCRE) method that guides software producing organisations (SPOs) by involving a crowd of engaged stakeholders in RE. CCRE uses the REfine tool, a gamified platform for eliciting and refining requirements. In addition to presenting the method and its application in a case study, we define research challenges for the field.


Requirement Engineering User Involvement Requirement Engineer Requirement Elicitation Design Science Research 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.



This research was partially supported by a European FP7 Marie Curie grant (the SOCIAD Project).


  1. Adepetu, A., Ahmed, K. A., Al Abd, Y., Al Zaabi, A., & Svetinovic, D. (2012). CrowdREquire: A requirements engineering crowdsourcing platform. In Proceedings of the AAAI Spring Symposium: Wisdom of the Crowd. Google Scholar
  2. Berander, P., & Andrews, A. (2005). Requirements prioritization. In Engineering and managing software requirements (pp. 69–94). Springer.Google Scholar
  3. Brinkkemper, S. (1996). Method engineering: Engineering of information systems development methods and tools. Information and Software Technology, 38(4), 275–280.CrossRefGoogle Scholar
  4. Costa, P. T., & MacCrae, R. R. (1992). Revised NEO personality inventory (NEO PI-R) and NEO five-factor inventory (NEO FFI): Professional manual. Psychological Assessment Resources.Google Scholar
  5. Damodaran, L. (1996). User involvement in the systems design process-a practical guide for users. Behaviour & Information Technology, 15(6), 363–377.CrossRefGoogle Scholar
  6. Dave, K., Lawrence, S., & Pennock, D. M. (2003). Mining the peanut gallery: Opinion extraction and semantic classification of product reviews. In Proceedings of the 12th international conference on World Wide Web (pp. 519–528). ACM.Google Scholar
  7. Deterding, S., Dixon, D., Khaled, R., & Nacke, L. (2011). From game design elements to gamefulness: defining gamification. In Proceedings of the 15th international academic MindTrek conference: Envisioning future media environments (pp. 9–15). ACM.Google Scholar
  8. Eickhoff, C., Harris, C. G., de Vries, A. P., & Srinivasan, P. (2012). Quality through flow and immersion: gamifying crowdsourced relevance assessments. In Proceedings of the 35th international ACM SIGIR conference on Research and development in information retrieval (pp. 871–880). ACM.Google Scholar
  9. El Emam, K., Quintin, S., & Madhavji, N. H. (1996). User participation in the requirements engineering process: An empirical study. Requirements Engineering, 1(1), 4–26.CrossRefGoogle Scholar
  10. Fernandes, J., Duarte, D., Ribeiro, C., Farinha, C., Pereira, J. M., & da Silva, M. M. (2012). iThink: A game-based approach towards improving collaboration and participation in requirement elicitation. Procedia Computer Science, 15, 66–77.CrossRefGoogle Scholar
  11. Gartner. (2011). Gartner says by 2015, more than 50 percent of organizations that manage innovation processes will gamify those processes. Last accessed February 19, 2016.
  12. Hamari, J., & Koivisto, J. (2013). Social motivations to use gamification: An empirical study of gamifying exercise. In Proceedings of the European Conference on Information Systems.Google Scholar
  13. Hamari, J., Koivisto, J., & Sarsa, H. (2014). Does gamification work?–A literature review of empirical studies on gamification. In Proceedings of the 47th Hawaii International Conference on System Sciences (HICSS) (pp. 3025–3034). IEEE.Google Scholar
  14. Hosseini, M., Shahri, A., Phalp, K., Taylor, J., Ali, R., & Dalpiaz, F. (2015). Configuring crowdsourcing for requirements elicitation. In Proceedings of the IEEE 9th International Conference on Research Challenges in Information Science (RCIS) (pp. 133–138). IEEE.Google Scholar
  15. Howe, J. (2006). Crowdsourcing: A definition (Online). Last accessed February 19, 2016.
  16. Kabbedijk, J., Brinkkemper, S., Jansen, S., & Van der Veldt, B. (2009). Customer involvement in requirements management: lessons from mass market software development. In Proceedings of the 17th IEEE International Requirements Engineering Conference (pp. 281–286). IEEE.Google Scholar
  17. Kujala, S. (2003). User involvement: A review of the benefits and challenges. Behaviour & information technology, 22(1), 1–16.CrossRefGoogle Scholar
  18. Kujala, S., Kauppinen, M., Lehtola, L., & Kojo, T. (2005). The role of user involvement in requirements quality and project success. In Proceedings of the 13th IEEE International Requirements Engineering Conference (pp. 75–84). IEEE.Google Scholar
  19. Lim, S. L., Damian, D., & Finkelstein, A. (2011). StakeSource2.0: Using social networks of stakeholders to identify and prioritise requirements. In Proceedings of the 33rd International Conference on Software Engineering (pp. 1022–1024). ACM.Google Scholar
  20. Lim, S. L., & Finkelstein, A. (2012). Stakerare: Using social networks and collaborative filtering for large-scale requirements elicitation. IEEE Transactions on Software Engineering, 38(3), 707–735.CrossRefGoogle Scholar
  21. Lucassen, G., Dalpiaz, F., Van Der Werf, J. M., & Brinkkemper, S. (2015a). Bridging the twin peaks: the case of the software industry. In Proceedings of the Fifth International Workshop on Twin Peaks of Requirements and Architecture (pp. 24–28). IEEE.Google Scholar
  22. Lucassen, G., Dalpiaz, F., van der Werf, J. M. E., & Brinkkemper, S. (2015b). Forging high-quality user stories: Towards a discipline for agile requirements. In Proceedings of the 23rd IEEE International Requirements Engineering Conference (pp. 126–135). IEEE.Google Scholar
  23. Nicholson, S. (2012). A user-centered theoretical framework for meaningful gamification. In Proceedings of Games+Learning+Society 8.0.Google Scholar
  24. Pang, B., & Lee, L. (2008). Opinion mining and sentiment analysis. Foundations and Trends in Information Retrieval, 2(1–2), 1–135.CrossRefGoogle Scholar
  25. Peffers, K., Tuunanen, T., Rothenberger, M. A., & Chatterjee, S. (2007). A design science research methodology for information systems research. Journal of Management Information Systems, 24(3), 45–77.CrossRefGoogle Scholar
  26. Shahri, A., Hosseini, M., Phalp, K., Taylor, J., & Ali, R. (2014). Towards a code of ethics for gamification at enterprise. In Proceedings of the IFIP WG 8.1 Working Conference on the Practice of Enterprise Modeling (pp. 235–245). Springer.Google Scholar
  27. Snijders, R., Dalpiaz, F., Brinkkemper, S., Hosseini, M., Ali, R., & O ̈zum, A. (2015). REfine: A gamified platform for participatory requirements engineering. In Proceedings of the 1st IEEE International Workshop on Crowd-Based Requirements Engineering (pp. 1–6). IEEE.Google Scholar
  28. Snijders, R., Dalpiaz, F., Hosseini, M., Shahri, A., & Ali, R. (2014). Crowd-centric requirements engineering. In Proceedings of the Second Workshop on Crowdsourcing and Gamification in the Cloud (CGCloud) (pp. 614–615). IEEE.Google Scholar
  29. The Standish Group. (2009). CHAOS summary 2009: The 10 laws of CHAOS. Technical report.Google Scholar
  30. Wiegers, K. (1999). First things first: Prioritizing requirements. Software Development, 7(9), 48–53.Google Scholar
  31. Zand, D. E., & Sorensen, R. E. (1975). Theory of change and the effective use of management science. Administrative Science Quarterly, 532–545.Google Scholar

Copyright information

© Springer International Publishing Switzerland 2017

Authors and Affiliations

  • Fabiano Dalpiaz
    • 1
    Email author
  • Remco Snijders
    • 1
  • Sjaak Brinkkemper
    • 1
  • Mahmood Hosseini
    • 2
  • Alimohammad Shahri
    • 2
  • Raian Ali
    • 2
  1. 1.Department of Information and Computing SciencesUtrecht UniversityUtrechtThe Netherlands
  2. 2.Faculty of Science and TechnologyBournemouth UniversityPooleUK

Personalised recommendations