Abstract
Creativity is often needed in requirements elicitation, i.e., generating ideas for requirements, and therefore, techniques to enhance creativity are believed to be useful. How does the size of a group using the Power-Only EPMcreate (POEPMcreate) creativity enhancement technique affect the group’s and each member of the group’s effectiveness in generating requirement ideas? This paper describes an experiment in which individuals and two-person and four-person groups used POEPMcreate to generate ideas for requirements for enhancing a high school’s public Web site. The data of this experiment combined with the data of two previous experiments involving two-person and four-person groups using POEPMcreate show that, similar to what has been observed for brainstorming, the size of a group using POEPMcreate does affect the number of raw and new requirement ideas generated by the group and by the average member of the group. The data allow concluding that a two-person group using POEPMcreate generates more raw and new requirement ideas, both per group and per group member or individual, than does a four-person group and than does an individual. This conclusion is partially corroborated by qualitative data gathered from a survey of professional business or requirements analysts about group sizes and creativity enhancement techniques.
Similar content being viewed by others
Notes
The general form of a subhypothesis is:
“The number of members of an elicitation group using \(\left \{ \begin {array}{l} E :~\text {EPMcreate} \\ P :~\text { POEPMcreate} \end {array} \right \}\) has no effect on the \(\left \{ \begin {array}{l} T :~\text {total number of requirement ideas per group} \\ A :~\text {average number of requirement ideas per group member} \end {array} \right \}\) of \(\left \{ \begin {array}{l} R :~\text {raw} \\ N :~\text {new} \end {array} \right \}\) requirement ideas generated.” The name of any subhypothesis is “H” followed by concatenation of the labels designating the choices made to construct the subhypothesis. Each label is the first letter of the phrase that it labels.
The phrase “individual creativity” is a technical term from the creativity assessment field that means natural, unassisted, original creativity of the individual and not just individual as opposed to group creativity (Kaufman and Sternberg 2006).
In cooperative education at the University of Waterloo, each student works for pay, over his or her four years, one term per year, in an off-campus job, generally in his or her area of study. A CS or SE student typically works in a computing-related job, often in software development. In some cases, the student ends up getting a permanent job at one of his or her co-op employers.
4 We had to wait at least a year and then until the Fall term between rounds to get a large enough crop of new potential subjects, a.k.a. new students, who had never participated in any of our experiments.
The number of asterisks indicates the order of magnitude of the deciding P-value, i.e., the number of 0s after the decimal point before the first non-0 digit. Also, a single asterisk is shown only if the P-value is less than 0.05.
Thus, there is an interaction between the independent variables experiment number and group size in their effects on the dependent variables PTR, PTN, PAR, and PAN. Section 8.3 deals with this interaction.
This “less than or equal to” should be taken with the same grain of salt as is the test of whether p<α. If the number N is only a small percentage more than exactly equal to \(\frac {M}{\alpha }\), the researcher is still on shaky grounds claiming support for the hypotheses.
The second and third conjuncts in this definition of the multiple comparisons problem came from private communication with William Berry, one of the authors of (Berry and Sanders 2000).
Even though the original work was done in 1935, the work was not published formally until 1953.
Beyond mentioning the overwhelming data showing that individuals are more effective than face-to-face groups at generating ideas with brainstorming, and that one negative social influence is the power of a majority in a group to inhibit a minority in the group, Ocker makes no mention of the effect of group sizes.
References
Administrator: Sir John A MacDonald High School Web Site (Viewed 16–20 November 2009 and 7–12 March 2010), http://sja.ednet.ns.ca/index.html
Al-Ani B, Lowe D, Leany J (1998) Incomplete requirements: when requirements go missing. In: Proceedings of the 3rd Australian conference on requirements engineering. Deakin University, Australia
Amabile TM (1988) A model of creativity and innovation in organizations. Res Organ Behav 10:123–167
Ang D, Lim LH, Chan HC (1998) Collaborative requirements engineering: an overview and a proposed integrated model. In: Proceedings of the Thirty-First Hawaii international conference on system sciences, vol 5, pp 355–364
Aurum A, Martin E (1998) Requirements elicitation using solo brainstorming. In: Proceedings of the 3rd Australian conference on requirements engineering. Deakin University, Australia, pp 29–37
Aurum A, Handzic M, Cross J, Toorn CV (2001) Software support for creative problem solving. In: IEEE International conference on advanced learning technologies (ICALT’01), pp 160–162. Madison
Berander P (2004) Using students as subjects in requirements prioritization. In: Proceedings of the international symposium on empirical software engineering (ISESE’04), pp 167–176. IEEE Computer Society
Berntsson Svensson R, Taghavianfar M (2015) Selecting creativity techniques for creative requirements: an evaluation of four techniques using creativity workshops. In: Proceedings of the 23rd IEEE international requirements engineering conference (RE), pp 66–75
Berntsson Svensson R, Taghavianfar M, Gren L (2015) Creativity techniques for more creative requirements: theory vs. practice. In: Proceedings of the forty-first euromicro conference on software engineering and advanced applications (SEAA), pp 104–111
Berry W, Sanders M (2000) Understanding multivariate research: a primer for beginning social scientists. Westview Press, New York
Binnig G (1989) Aus dem Nichts. Über die Kreativität von Natur und Mensch. Piper, München. in German
Briggs RO, Reinig BA, Shepherd MM, Yen J, Nunameker JF Jr (1997) Quality as a function of quantity in electronic brainstorming. In: Hawaii International conference on system sciences, pp 94–103
Boehm B, Grünbacher P, Briggs R O (2001) Developing groupware for requirements negotiation: lessons learned. IEEE Softw 18:46–55
Browne GJ, Rogich MB (2001) An empirical investigation of user requirements elicitation: comparing the effectiveness of prompting techniques. J Manag Inf Sys 17:223–249
Brooks FP (1995) The mythical man-month: essays on software engineering, 2nd edn. Addison-Wesley, Reading
Conboy K, Wang X, Fitzgerald B (2009) Creativity in agile systems development: a literature review. In: Information systems — creativity and innovation in small and medium-sized enterprises, proceedings of the IFIP WG8.2 international conference, CreativeSME 2009. Volume IFIP AICT 301, pp 122–134
Couger JD (1995) Creative problem solving and opportunity finding. Boyd & Fraser, San Francisco
Couger JD (1996) Creativity and innovation in information systems organizations. Boyd & Fraser, San Francisco
Couger JD, Higgens LF, McIntyre SC (1993) (Un)structured creativity in information systems organizations. MIS Q 17:375–398
Cybulski JL, Nguyen L, Thanasankit T, Lichtenstein S (2003) Understanding problem solving. In: Proceedings of the 7th Pacific Asia conference on information systems, pp 465–482. Adelaide
de Bono E (1985) Six thinking hats. Viking, UK
de Bono E (1993) Serious creativity: using the power of lateral thinking to create new ideas. Harper Collins, UK
de Bono E, Heller R (2010) Can creative management techniques help you survive the recession (Viewed 10 August 2010) http://www.thinkingmanagers.com/management/creative-management-techniques
Damian D, Marczak S, Kwan I (2007) Collaboration patterns and the impact of distance on awareness in requirements-centred social networks. In: Proceedings of the 15th IEEE international requirements engineering conference (RE), pp 59–68
Daun M, Salmon A, Bandyszak T, Weyer T (2016) Common threats and mitigation strategies in requirements engineering experiments with student participants. In: Proceedings of the 21st international working conference on requirements engineering: foundation for software quality (REFSQ’2016), pp 269–295
Dean DL, Hender JM, Rodgers TL, Santanen EL (2006) Identifying quality, novel, and creative ideas: constructs and scales for idea evaluation. J Assoc Inf Syst 7
Dennis AR, Valacich JS (1993) Computer brainstorms: more heads are better than one. J Appl Psychol 78:531–537
Dornburg CC, Stevens SM, Hendrickson SML, Davidson GS (2008) LDRD final report for improving human effectiveness for extreme-scale problem solving: assessing the effectiveness of electronic brainstorming in an industrial setting. Technical Report SAND2008-5971, Sandia National Laboratories. http://prod.sandia.gov/techlib/access-control.cgi/2008/085971.pdf
Dow G (2016) Creativity test: creativity assessment packet (Williams, 1980), R546 instructional strategies for thinking, collaboration, and motivation, AKA: Best of Bonk on the Web (BOBWEB). Technical report, Indiana University (Viewed 11 April 2016) http://www.indiana.edu/bobweb/Handout/d16.cap.html
etourism Website (2011) Online bibliographies, click on (1) creativity, (2) business creativity, (3) creativity techniques or (4) brainstorming as a technique for software requirements elicitation (viewed April 2011) http://etourism.economia.unitn.it/bibliographies/?locale=en
Evans JR (1991) Creative thinking in the decision and management sciences. South Western, Cincinnati
Feist GJ (1993) A structural model of scientific eminence. Psychol Sci 4:366–371
Ficalora JP, Cohen L (eds) (2010) Quality function deployment and six sigma, 2nd edn: a QFD handbook. Pearson Education, Boston
Fricker S (2010) Requirements value chains: Stakeholder management and requirements engineering in software ecosystems. In: Proceedings of the working conference on requirements engineering: foundation for software quality (REFSQ), pp 60–66
Fromm E (1959) The creative attitude. In: Anderson H (ed) Creativity and its cultivation. Harper & Row, New York, pp 44–54
Furnham A, Yazdanpanahi T (1958) Personality differences and group versus individual brainstorming. Person Individ Diff 19:73–80
Gallagher K, Mason RM, Vandenbosch B (2004) Managing the tension in IS projects: balancing alignment, engagement, perspective and imagination. In: Proceedings of the 37th Hawaii international conference on system sciences. Honolulu
Gallupe RB, Cooper WH (1993) Brainstorming electronically. Sloan Manag Rev 35:27–36
Gause DC (2000) User DRIVEN design—the luxury that has become a necessity, a works hop in full life-cycle requirements management. ICRE 2000 Tutorial T7, Schaumberg
Gelman A, Hill J, Yajima M (2012) Why we (usually) don’t have to worry about multiple comparisons. J Res Educ Effect 5:189–211
Geschka H (1983) Creativity techniques in product planning and development: a view from West Germany. R&D Manag 13:169–183
Givant S, Halmos P (2009) Introduction to Boolean algebras. Springer Science+Business Media, New York
Glass R (1995) Software creativity. Prentice Hall, Englewood Cliffs
Glass RL, DeMarco T (2006) Software Creativity 2.0. developer.* Books, Atlanta
Gause D, Weinberg G (1989) Exploring requirements: quality before design. Dorset House, New York
Gause D, Weinberg G (1990) Are your lights on? How to figure out what the problem REALLY is. Dorset House, New York
Goguen JA (1993) Requirements engineering as the reconciliation of technical and social issues. Technical report, Centre for Requirements and Foundations, Programming Research Group, Oxford University Computing Lab. Modified version later published as (Goguen 1994)
Goguen JA (1994) Requirements engineering as the reconciliation of technical and social issues. In: Requirements engineering, social and technical issues, pp 165–199. Academic Press
Gundy ABV (1984) Managing group creativity. American Management Association, New York
Hoffmann O, Cropley D, Cropley A, Nguyen L, Swatman P (2005) Creativity, requirements and perspectives. Aust J Inf Syst 13:159–174
Isaksen SG, Gaulin JP (2005) A reexamination of brainstorming research: implications for research and practice. Gifted Child Q 40(Fall):315–329
Jaoui H (1991) La Créativité Mode d’Emploi. E.S.F. Editeur – Entreprise Moderne d’Edition – Librairies Techniques. Paris, in French
Jeff, Berg, Mike (2016) 882: Significant (Viewed 11 August 2016) https://www.explainxkcd.com/wiki/index.php/882:_Significant
Jones S, Lynch P, Maiden N, Lindstaedt S (2008) Use and influence of creative ideas and requirements for a work-integrated learning system. In: Proceedings of the 16th IEEE international requirements engineering conference (RE), pp 289–294
Kano N, Seraku N, Takahashi F, Tsuji S (1984) Attractive quality and must-be quality (in japanese). J Japan Soc Qual Control 14:39–48
Kauppinen M, Savolainen J, Männisto T (2007) Requirements engineering as a driver for innovations. In: Proceedings of the 15th IEEE international requirements engineering conference (RE), pp 15– 20
Kaufman JC, Sternberg RJ (eds) (2006) The international handbook of creativity. Cambridge University Press, Cambridge
Kohn NW, Smith SM (2011) Collaborative fixation: effects of others’ ideas on brainstorming. Appl Cogn Psychol 25:359–371
LeadershipReview (2016) Using creativity to help your business stand out from the crowd (Viewed 11 April 2016) http://www.leadershipreview.net/using-creativity-help-your-business-stand-out-crowd
Leigh A (1983) Decisions, decisions!: a practical management guide to problem solving and decision making. Gower Aldershot, Hampshire
Lemos J, Alves C, Duboc L, Rodrigues GN (2012) A systematic mapping study on creativity in requirements engineering. In: Proceedings of the 27th Annual ACM symposium on applied computing (SAC), pp 1083–1088
Maiden N, Gizikis A (2001) Where do requirements come from? IEEE Softw 18:10–12
Maiden N, Robertson S, Gizikis A (2004) Provoking creativity: imagine what your requirements could be like. IEEE Softw 21:68–75
Maiden N, Manning S, Robertson S, Greenwood J (2004) Integrating creativity workshops into structured requirements processes. In: Proceedings of the conference on designing interactive systems (DIS’2004), pp 113–122. Cambridge
Maiden N, Robertson S, Robertson J (2006) Creative requirements: Invention and its role in requirements engineering. In: Proceedings of the 28th international conference on software engineering (ICSE), pp 1073–1074
Maiden N, Ncube C, Robertson S (2007) Can requirements be creative? experiences with an enhanced air space management system. In: Proceedings of the 29th international conference on software engineering, pp 632–641
Mahaux M, Nguyen L, Gotel O, Mich L, Mavin A, Schmid K (2013) Collaborative creativity in requirements engineering: Analysis and practical advice. In: Proceedings of the 7th IEEE international conference on research challenges in information science (RCIS), pp 1–10
Mavin A, Maiden N (2003) Determining socio-technical systems requirements: experiences with generating and walking through scenarios. In: Proceedings of the 11th IEEE International requirements engineering conference, pp 213–222. Monterey Bay
McBreen P (2001) Tutorial 38: creativity in software development. In: OOPSLA 2001. Tampa Bay
Mich L, Anesi C, Berry DM (2005) Applying a pragmatics-based creativity-fostering technique to requirements elicitation. Require Eng J 10:262–274
Mich L, Berry DM, Franch M (2006) Classifying web-application requirement ideas generated using creativity fostering techniques according to a quality model for web applications. In: Proceedings of the 12th international workshop requirements engineering: foundation for software quality, REFSQ’ 06
Mich L, Berry DM, Alzetta A (2010) Individual and end-user application of the EPMcreate creativity enhancement technique to website requirements elicitation. In: Proceedings of the workshop on creativity in requirements engineering (CreaRE) at REFSQ’2010
Mich L, Sakhnini V, Berry DM (2012) Requirements elicitation (ReqElic) in my company. Technical report, University of Trento (Deployed 31 August 2012) https://docs.google.com/spreadsheet/viewform?formkey=dFI2UWx0MWJuRUdvQ1JNZnh1NFN0SGc6MQ
Mullery G (1996) The perfect requirements myth. Requir Eng J 1:132–134. also at http://link.springer.com/content/pdf/10.1007
Nagasundaram M, Bostrom RP (1995) Structuring creativity with GSS: an experiment. In: Proceedings of the Americas conference on information systems. Paper 145, http://aisel.aisnet.org/amcis1995/145/
Niknafs A, Berry DM (2016) The impact of domain knowledge on the effectiveness of requirements engineering activities. Empirical Software Engineering Online First. http://link.springer.com/article/10.1007/s10664-015-9416-2
Nguyen L, Shanks G (2009) A framework for understanding creativity in requirements engineering. J Inf Softw Technol 51:655–662
Nguyen L, Carroll J, Swatman PA (2000) Supporting and monitoring the creativity of IS personnel during the requirements engineering process. In: Proceedings of the 33rd Hawaii international conference on system sciences. HICSS-33, Maui, http://csdl2.computer.org/comp/proceedings/hicss/2000/0493/07/04937008.pdf
Ocker RJ (2010) Promoting group creativity in upstream requirements engineering. Human Technol Interdiscip J Humans ICT Environ 6:55–70
Osborn A (1953) Applied imagination. Charles Scribner’s, New York
Parnes S (1992) Source book for creative problem solving. Creative Foundation, USA
Poincaré H (2001) Science and method. Key Texts, South Bend. Originally published in 1914
Preparata FP, Yeh RTY (1973) Introduction to discrete structures for computer science and engineering. Addison-Wesley Longman, Boston
Price J, Cybulski JL (2004) Influence of stakeholder communication on consensus making in requirements negotiation. In: Proceedings of the 11th Austrlian workshop on requirements engineering (AWRE)
Price J, Cybulski JL (2006) The importance of IS stakeholder perspectives and perceptions to requirements negotiation. In: Proceedings of the 11th Austrlian workshop on requirements engineering (AWRE)
Rickards T (1974) Problem solving through creative analysis. Gower, New York
Rickards T (1999) Creativity and the management of change. Blackwell, Oxford
Rittel H, Webber M (1973) Dilemmas in a general theory of planning. Polic Sci 4:155–169
Robertson S (2001) Requirements trawling: techniques for discovering requirements. Int J Human-Comput Stud 55:405–421
Robertson J (2002) Eureka! Why analysts should invent requirements. IEEE Softw 19:20–22
Robertson S, Maiden N (2002) Tutorial notes T08: creativity, the path to innovative requirements. In: IEEE Joint international requirements engineering conference. Essen
Runco MA (2007) Creativity: theories and themes: research, development, and practice. Elsevier Academic Press, Burlington
Saha SK, Selvi M, Büyükcan G, Mohymen M (2012) A systematic review on creativity techniques for requirements engineering. In: Proceedings of the international conference on informatics, electronics vision (ICIEV), pp 34–39
Sakhnini V, Mich L, Berry DM (2012) The effectiveness of an optimized EPMcreate as a creativity enhancement technique for Website requirements elicitation. Require Eng J 17:171–186
Sakhnini V, Mich L, Berry DM (2013) On the sizes of groups using the full and optimized EPMcreate creativity enhancement technique for Web site requirements elicitation. In: Proceedings of the workshop on creativity in requirements engineering (CreaRE) at REFSQ’2013, pp 23–38. http://www.icb.uni-due.de/fileadmin/ICB/research/research_reports/ICB-Report-No56.pdf
Sakhnini V, Mich L, Berry DM (2016) Group versus individual use of an optimized and the full EPMcreate as creativity enhancement techniques for web site requirements elicitation. Technical report, School of Computer Science, University of Waterloo (Viewed 11 April 2016) http://se.uwaterloo.ca/dberry/FTP_SITE/tech.reports/SakhniniMichBerryTR.pdf
Sakhnini V, Berry DM, Mich L (2016) Materials for comparing POEPMcreate, EPMcreate, and brainstorming. Technical report, School of Computer Science, University of Waterloo (Viewed 11 April 2016). http://se.uwaterloo.ca/dberry/FTP_SITE/software.distribution/EPMcreateExperimentMaterials/
Salzer H, Levin I (2004) Atomic requirements in teaching logic control implementation. Int J Eng Educ 20:46–51
Schenk KD, Vitalari NP, Davis KS (1998) Differences between novice and expert systems analysts: what do we know and what do we do? J Manag Inf Syst 15:9–50
Schlosser C, Jones S, Maiden N (2008) Using a creativity workshop to generate requirements for an event database application. In: Proceedings of the international workshop requirements engineering: foundation for software quality REFSQ’08. LNCS, vol 5025. Springer, Berlin, pp 109–122
Simon H, Newell A (1972) Human problem solving. Prentice Hall, Englewood Cliffs
Simonton DK (1988) Scientific genius: a psychology of science. Cambridge University Press, Cambridge
Sweeney RB (2003) Creativity in the information technology curriculum proposal. In: Proceedings of the 4th conference on information technology curriculum, CITC4’03, pp 139–141. Lafayette
Taylor DW, Berry PC, Block CH (1958) Does group participation when using brainstorming facilitate or inhibit creative thinking? Admin Sci Q 3:23–47
The Standish Group (1994) The CHAOS report. Technical report, The Standish Group
Vieira ER, Alves C, Duboc L (2012) Creativity patterns guide: Support for the application of creativity techniques in requirements engineering. In: Proceedings of the 4th international conference on human-centered software engineering (HCSE), pp 283–290. Springer-Verlag
von Bertalanaffy L (1976) General systems theory: foundations, development, applications. revised edn. George Braziller, New York
West Side School District (2016) Gifted and talented program. Technical report, West Side Public Schools, Higden, AR, U.S.A. (Viewed 11 April 2016) http://wseagles.k12.ar.us/GT.pdf
Wiegers K E (2001) Inspecting requirements. Technical report, StickyMinds.com Original Column. http://www.stickyminds.com/se/S2697.asp
Williams F, Taylor CW (1966) Instructional media and creativity. In: Proceedings of the 6th Utah creativity research conference. New York, Wiley
Wohlin C, Runeson P, Höst M, Ohlsson M C, Regnell B, Wesslén A (2000) Experimentation in software engineering: an introduction. Kluwer Academic Publishers, Norwell
Wohlin C, Runeson P, Höst M, Ohlsson M C, Regnell B, Wesslén A (2012) Experimentation in software engineering. Springer, Heidelberg
Wood J, Silver D (1999) Joint application development. Wiley, New York
Zachos K, Maiden N (2008) Inventing requirements from software: An empirical investigation with web services. In: Proceedings of the 16th IEEE international requirements engineering conference (RE), pp 145–154
Zhou J (ed) (2016) The Oxford handbook of creativity, innovation, and entrepreneurship. Oxford Library of Psychology Series. Oxford University Press, Oxford
Acknowledgments
Each of Victoria Sakhnini’s and Luisa Mich’s work was supported in part by a Cheriton School of Computer Science addendum to the same Canadian NSERC–Scotia Bank Industrial Research Chair that was supporting Daniel Berry. Daniel Berry’s work was supported in parts by a Canadian NSERC grant NSERC-RGPIN227055-00 and by a Canadian NSERC–Scotia Bank Industrial Research Chair NSERC-IRCPJ365473-05. The authors thank William Berry for his graciously offered and personal advice on multivariate regressions. All blame for any misapplication of this advice falls on the authors.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
This paper is an enhancement of a similarly titled, shorter paper (Sakhnini et al. 2013), by the same authors, published in the Proceedings of the Workshop on Creativity in Requirements Engineering (CreaRE) at the 18th Working Conference on Requirements Engineering: Foundation for Software Quality (REFSQ’2013). The workshop paper has been extended by a more detailed description of the techniques, reporting of more data gathered since submitting the workshop paper, a more detailed statistical analysis, and a strengthening of the conclusions.
This paper uses in Sections 1, 2.1 through 2.3, 9, and 12 material copied verbatim from the authors’ and others’ previous papers (Mich et al. 2005; Sakhnini et al. 2012), describing EPMcreate, POEPMcreate, the conduct of the experiment, threats, and related work.
The research conducted with human subjects described in this paper was approved in advance by the University of Waterloo’s Office of Research Ethics. Each subject was given, during his or her Step 1, the approved description of the project and was asked to sign an informed-consent form. The only subjects actually used were those that signed this form.
Conflict of interests
There is no known potential or actual conflict of interest.
Additional information
Communicated by: Tony Gorschek
See the section titled “Compliance with Ethical Standards”, just before the references, for a statement about previous publication of parts of this paper’s contents.
Rights and permissions
About this article
Cite this article
Sakhnini, V., Mich, L. & Berry, D.M. Group versus individual use of power-only EPMcreate as a creativity enhancement technique for requirements elicitation. Empir Software Eng 22, 2001–2049 (2017). https://doi.org/10.1007/s10664-016-9475-z
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10664-016-9475-z