Engaging the Crowd of Stakeholders in Requirements Engineering via Gamification
Requirements engineering (RE) is a discipline that focuses on obtaining a specification for a system that fulfils the expectations of the stakeholders. Unfortunately, the current state of the practice reveals that only a few stakeholders are involved—mostly key clients and lead designers—while active stakeholders are not highly engaged. This lowers the chances of obtaining a system that fully fulfils the stakeholders’ wishes. Gamification is an opportunity to increase the engagement of stakeholders in RE by establishing feedback loops that reward the useful participants, i.e., those who provide valuable contributions (requirements) for the system being designed. The related trend of crowdsourcing can be employed to maximise the number of participating stakeholders, by making RE a participatory activity where current and prospective users, developers, clients and analysts are involved. This chapter introduces the Crowd-Centric Requirements Engineering (CCRE) method that guides software producing organisations (SPOs) by involving a crowd of engaged stakeholders in RE. CCRE uses the REfine tool, a gamified platform for eliciting and refining requirements. In addition to presenting the method and its application in a case study, we define research challenges for the field.
KeywordsRequirement Engineering User Involvement Requirement Engineer Requirement Elicitation Design Science Research
This research was partially supported by a European FP7 Marie Curie grant (the SOCIAD Project).
- Adepetu, A., Ahmed, K. A., Al Abd, Y., Al Zaabi, A., & Svetinovic, D. (2012). CrowdREquire: A requirements engineering crowdsourcing platform. In Proceedings of the AAAI Spring Symposium: Wisdom of the Crowd. Google Scholar
- Berander, P., & Andrews, A. (2005). Requirements prioritization. In Engineering and managing software requirements (pp. 69–94). Springer.Google Scholar
- Costa, P. T., & MacCrae, R. R. (1992). Revised NEO personality inventory (NEO PI-R) and NEO five-factor inventory (NEO FFI): Professional manual. Psychological Assessment Resources.Google Scholar
- Dave, K., Lawrence, S., & Pennock, D. M. (2003). Mining the peanut gallery: Opinion extraction and semantic classification of product reviews. In Proceedings of the 12th international conference on World Wide Web (pp. 519–528). ACM.Google Scholar
- Deterding, S., Dixon, D., Khaled, R., & Nacke, L. (2011). From game design elements to gamefulness: defining gamification. In Proceedings of the 15th international academic MindTrek conference: Envisioning future media environments (pp. 9–15). ACM.Google Scholar
- Eickhoff, C., Harris, C. G., de Vries, A. P., & Srinivasan, P. (2012). Quality through flow and immersion: gamifying crowdsourced relevance assessments. In Proceedings of the 35th international ACM SIGIR conference on Research and development in information retrieval (pp. 871–880). ACM.Google Scholar
- Gartner. (2011). Gartner says by 2015, more than 50 percent of organizations that manage innovation processes will gamify those processes. http://www.gartner.com/newsroom/id/1629214. Last accessed February 19, 2016.
- Hamari, J., & Koivisto, J. (2013). Social motivations to use gamification: An empirical study of gamifying exercise. In Proceedings of the European Conference on Information Systems.Google Scholar
- Hamari, J., Koivisto, J., & Sarsa, H. (2014). Does gamification work?–A literature review of empirical studies on gamification. In Proceedings of the 47th Hawaii International Conference on System Sciences (HICSS) (pp. 3025–3034). IEEE.Google Scholar
- Hosseini, M., Shahri, A., Phalp, K., Taylor, J., Ali, R., & Dalpiaz, F. (2015). Configuring crowdsourcing for requirements elicitation. In Proceedings of the IEEE 9th International Conference on Research Challenges in Information Science (RCIS) (pp. 133–138). IEEE.Google Scholar
- Howe, J. (2006). Crowdsourcing: A definition (Online). http://www.crowdsourcing.com/cs/2006/06/crowdsourcinga.html. Last accessed February 19, 2016.
- Kabbedijk, J., Brinkkemper, S., Jansen, S., & Van der Veldt, B. (2009). Customer involvement in requirements management: lessons from mass market software development. In Proceedings of the 17th IEEE International Requirements Engineering Conference (pp. 281–286). IEEE.Google Scholar
- Kujala, S., Kauppinen, M., Lehtola, L., & Kojo, T. (2005). The role of user involvement in requirements quality and project success. In Proceedings of the 13th IEEE International Requirements Engineering Conference (pp. 75–84). IEEE.Google Scholar
- Lim, S. L., Damian, D., & Finkelstein, A. (2011). StakeSource2.0: Using social networks of stakeholders to identify and prioritise requirements. In Proceedings of the 33rd International Conference on Software Engineering (pp. 1022–1024). ACM.Google Scholar
- Lucassen, G., Dalpiaz, F., Van Der Werf, J. M., & Brinkkemper, S. (2015a). Bridging the twin peaks: the case of the software industry. In Proceedings of the Fifth International Workshop on Twin Peaks of Requirements and Architecture (pp. 24–28). IEEE.Google Scholar
- Lucassen, G., Dalpiaz, F., van der Werf, J. M. E., & Brinkkemper, S. (2015b). Forging high-quality user stories: Towards a discipline for agile requirements. In Proceedings of the 23rd IEEE International Requirements Engineering Conference (pp. 126–135). IEEE.Google Scholar
- Nicholson, S. (2012). A user-centered theoretical framework for meaningful gamification. In Proceedings of Games+Learning+Society 8.0.Google Scholar
- Shahri, A., Hosseini, M., Phalp, K., Taylor, J., & Ali, R. (2014). Towards a code of ethics for gamification at enterprise. In Proceedings of the IFIP WG 8.1 Working Conference on the Practice of Enterprise Modeling (pp. 235–245). Springer.Google Scholar
- Snijders, R., Dalpiaz, F., Brinkkemper, S., Hosseini, M., Ali, R., & O ̈zum, A. (2015). REfine: A gamified platform for participatory requirements engineering. In Proceedings of the 1st IEEE International Workshop on Crowd-Based Requirements Engineering (pp. 1–6). IEEE.Google Scholar
- Snijders, R., Dalpiaz, F., Hosseini, M., Shahri, A., & Ali, R. (2014). Crowd-centric requirements engineering. In Proceedings of the Second Workshop on Crowdsourcing and Gamification in the Cloud (CGCloud) (pp. 614–615). IEEE.Google Scholar
- The Standish Group. (2009). CHAOS summary 2009: The 10 laws of CHAOS. Technical report.Google Scholar
- Wiegers, K. (1999). First things first: Prioritizing requirements. Software Development, 7(9), 48–53.Google Scholar
- Zand, D. E., & Sorensen, R. E. (1975). Theory of change and the effective use of management science. Administrative Science Quarterly, 532–545.Google Scholar