Skip to main content

A Systematic Review of Protocol Studies on Conceptual Design Cognition

  • Conference paper
  • First Online:

Abstract

This paper reports the first systematic review and synthesis of protocol studies on conceptual design cognition. 47 studies from the domains of architectural design, engineering design, and product design engineering were reviewed towards answering the following question: What is our current understanding of the cognitive processes involved in conceptual design tasks carried out by individual designers? Studies were found to reflect three viewpoints on the cognitive nature of designing: design as search; design as exploration; and design activities. Synthesising the findings of individual studies revealed ten categories of executive and non-executive function studied across the viewpoints: visual perception; mental imagery; semantic association; long term memory; working memory; selective attention; creative thinking; evaluation and decision making; externalisation; and reasoning and problem solving. The review highlights several avenues for future research, centering on the need for general formalisms, more objective methods to supplement protocol analysis, and a shared ontology of cognitive processes.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   259.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   329.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD   329.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

References marked with * are included in the systematic review sample.

  • *Akin Ö (1984) An exploration of the design process. In: Cross N (ed) Developments in design methodology. Wiley, Chichester, pp 189–207

    Google Scholar 

  • Akin Ö (1986) Psychology of architectural design. Pion, London

    Google Scholar 

  • *Akin O, Akin C (1996) Frames of reference in architectural design: analysing the hyperacclamation (a-h-a-!). Des Stud 17(4):341–361

    Article  Google Scholar 

  • *Athavankar UA (1997) Mental imagery as a design tool. Cybern Syst 28(1):25–42

    Article  Google Scholar 

  • *Athavankar U, Bokil P, Guruprasad K (2008) Reaching out in the mind’s space. Design computing and cognition 08. Springer, Dordrecht, pp 321–340

    Book  Google Scholar 

  • Baddeley A (1983) Working memory. Philos Trans R Soc Lond B Biol Sci 302(1110):311–324

    Article  Google Scholar 

  • Baddeley A (2003) Working memory: looking back and looking forward. Nat Rev Neurosci 4:829–839

    Article  Google Scholar 

  • *Ball LJ, Ormerod TC, Morley NJ (2004) Spontaneous analogising in engineering design: a comparative analysis of experts and novices. Des Stud 25(5):495–508

    Article  Google Scholar 

  • *Bilda Z, Gero JS (2007) The impact of working memory limitations on the design process during conceptualization. Des Stud 28(4):343–367

    Article  Google Scholar 

  • *Bilda Z, Gero JS, Purcell T (2006) To sketch or not to sketch? That is the question. Des Stud 27(5):587–613

    Article  Google Scholar 

  • Bruce V, Green PR, Georgeson MA (2003) Visual perception: physiology, psychology and ecology. Psychology Press, New York

    Google Scholar 

  • *Chan C-S (1990) Cognitive processes in architectural problem solving. Des Stud 11(2):60–80

    Article  Google Scholar 

  • Chan RCK, Shum D, Toulopoulou T, Chen EYH (2008) Assessment of executive functions: review of instruments and identification of critical issues. Arch Clin Neuropsychol 23(2):201–216

    Article  Google Scholar 

  • *Chandrasekera T, Vo N, D’Souza N (2013) The effect of subliminal suggestions on Sudden Moments of Inspiration (SMI) in the design process. Des Stud 34(2):193–215

    Article  Google Scholar 

  • *Chiu ML (2003) Design moves in situated design with case-based reasoning. Des Stud 24(1):1–25

    Article  Google Scholar 

  • Cross N (2001) Design cognition: results from protocol and other empirical studies of design activity. In: Eastman CM, McCracken WM, Newstetter WC (eds) Design knowing and learning: cognition in design education. Elsevier Science Ltd, Oxford

    Google Scholar 

  • *Daly SR, Yilmaz S, Christian JL, Seifert CM, Gonzalez R (2012) Design heuristics in engineering. J Eng Educ 101(4):601–629

    Article  Google Scholar 

  • Dinar M, Shah JJ, Cagan J, Leifer L, Linsey J, Smith SM et al (2015) Empirical studies of designer thinking: past, present, and future. J Mech Des 137(2):1–13

    Article  Google Scholar 

  • Dorst K, Dijkhuis J (1995) Comparing paradigms for describing design activity. Des Stud 16(2):261–274

    Article  Google Scholar 

  • *Dorst K, Cross N (2001) Creativity in the design process: co-evolution of problem–solution. Des Stud 22(5):425–437

    Article  Google Scholar 

  • *Eckersley M (1998) The form of design processes: a protocol analysis study. Des Stud 9(2):86–94

    Article  Google Scholar 

  • Eysenck MW, Keane MT (2005) Cognitive psychology: a student’s handbook, 5th edn. Pyschology Press Ltd., Hove

    Google Scholar 

  • Federmeier KD, McLennan DB, Ochoa E, Kutas M (2002) The impact of semantic memory organization and sentence context information on spoken language processing by younger and older adults: an ERP study. Psychophysiology 39(2):133–146

    Article  Google Scholar 

  • Finke RA (1996) Imagery, creativity, and emergent structure. Conscious Cogn 5(3):381–393

    Article  Google Scholar 

  • Fish J, Scrivener S (1990) Amplifying the mind’s eye: sketching and visual cognition. Leonardo 23(1):117–126

    Article  Google Scholar 

  • Gawronski B, Bodenhausen G (2006) Associative and propositional processes in evaluation: an integrative review of implicit and explicit attitude change. Psychol Bull 132(5):692–731

    Article  Google Scholar 

  • Gero JS (1990) Design prototypes: a knowledge representation schema for design. AI Mag 11(4):26–36

    Google Scholar 

  • Gero JS, Kannengiesser U (2004) A function–behavior–structure ontology of processes. AI EDAM 21(04):379–391

    Google Scholar 

  • Gobet F, Chassy P, Bilalic M (2011) Foundations of cognitive psychology. McGraw-Hill Education, Maidenhead

    Google Scholar 

  • *Goel V (1995) Sketches of thought. MIT Press, Cambridge

    Google Scholar 

  • *Goldschmidt G (1991) The dialectics of sketching. Creat Res J 4(2):123–143

    Article  Google Scholar 

  • Hubka V (1982) Principles of engineering design. Butterworth & Co Ltd, London

    Google Scholar 

  • Hubka V, Eder WE (1996) Design science: introduction to needs, scope and organization of engineering design knowledge. Springer, Berlin

    Book  Google Scholar 

  • Jiang H, Yen C-C (2009) Protocol analysis in design research: a review. Rigor and relevance in design: IASDR 2009, Seoul, Korea, 18–22 October, pp 147–156

    Google Scholar 

  • *Jin Y, Benami O (2010) Creative patterns and stimulation in conceptual design. Artif Intell Eng Des Anal Manuf 24(02):191–209

    Article  Google Scholar 

  • *Jin Y, Chusilp P (2006) Study of mental iteration in different design situations. Des Stud 27(1):25–55

    Article  Google Scholar 

  • *Kavakli M, Gero JS (2002) The structure of concurrent cognitive actions: a case study on novice and expert designers. Des Stud 23(1):25–40

    Article  Google Scholar 

  • Kim KM, Lee KP (2010) Two types of design approaches regarding industrial design and engineering design in product design. In: DESIGN 2010—11th international design conference, pp 1795–1806

    Google Scholar 

  • *Kim J, Ryu H (2014) A design thinking rationality framework: framing and solving design problems in early concept generation. Hum Comput Interact 29(5–6):516–553

    Google Scholar 

  • *Kim Y, Jin S, Lee H (2005) Dual protocol analysis based on design information and design process: a case study. Studying designers ’05, Aix-en-Provence, France. Key Centre of Design Computing and Cognition, pp 71–85

    Google Scholar 

  • *Kim YS, Jin ST, Lee SW (2006) Design activities and personal creativity characteristics: a case study of dual protocol analysis using design information and process. In: ASME 2006 international design engineering technical conferences and computers and information in engineering conference, Philadelphia

    Google Scholar 

  • *Kim JE, Bouchard C, Omhover JF, Aoussat A (2010) Towards a model of how designers mentally categorise design information. CIRP J Manuf Sci Technol 3(3):218–226

    Article  Google Scholar 

  • Kosslyn SM (1995) Mental imagery. In: Kosslyn SM, Osherson DN (eds) Visual cognition: an invitation to cognitive science, vol 2, pp 267–296

    Google Scholar 

  • *Kruger C, Cross N (2006) Solution driven versus problem driven design: strategies and outcomes. Des Stud 27(5):527–548

    Article  Google Scholar 

  • *Lane D, Seery N (2011) Examining the development of sketch thinking and behaviour. Annual conference for the American Society of Engineering Education, Vancouver, Canada

    Google Scholar 

  • *Leblebici-Basar D, Altarriba J (2013) The role of imagery and emotion in the translation of concepts into product form. Des J 16(3):295–314

    Google Scholar 

  • *Lee J, Gu N, Williams A (2014) Parametric design strategies for the generation of creative designs. Int J Archit Comput 12(3):263–282

    Article  Google Scholar 

  • *Liikkanen LA, Perttula M (2009) Exploring problem decomposition in conceptual design among novice designers. Des Stud 30(1):38–59

    Article  Google Scholar 

  • *Lloyd P, Scott P (1994) Discovering the design problem. Des Stud 15(2):125–140

    Article  Google Scholar 

  • Lloyd P, Lawson B, Scott P (1995) Can concurrent verbalization reveal design cognition? Des Stud 16(2):237–259

    Article  Google Scholar 

  • *Maher M, Tang H-H (2003) Co-evolution as a computational and cognitive model of design. Res Eng Des 14(1):47–64

    Article  Google Scholar 

  • Martin A, Chao LL (2001) Semantic memory and the brain: structure and processes. Curr Opin Neurobiol 11(2):194–201

    Article  Google Scholar 

  • *McNeill T, Gero JS, Warren J (1998) Understanding conceptual electronic design using protocol analysis. Res Eng Des 10(3):129–140

    Article  Google Scholar 

  • Milner AD, Goodale MA (2008) Two visual systems re-viewed. Neuropsychologia 46(3):774–785

    Article  Google Scholar 

  • Moher D, Liberati A, Tetzlaff J, Altman DG (2009) Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. PLoS Med 6(7):1–6

    Article  Google Scholar 

  • Newell A, Simon HA (1972) Human problem solving. Prentice-Hall, Englewood Cliffs

    Google Scholar 

  • *Park J, Kim Y (2007) Visual reasoning and design processes. In: International conference on engineering design, ICED’07, pp 1–12

    Google Scholar 

  • Poldrack RA, Kittur A, Kalar D, Miller E, Seppa C, Gil Y et al (2011) The cognitive atlas: toward a knowledge foundation for cognitive neuroscience. Front Neuroinform 5:1–11

    Article  Google Scholar 

  • Rabbitt P (2004) Methodology of frontal and executive function. Psychology Press Ltd: online

    Google Scholar 

  • Roozenburg NFM, Eekels J (1994) Product design: fundamentals and methods. Wiley, Chichester, New York

    Google Scholar 

  • Schön DA (1983) The reflective practitioner: how professionals think in action. Basic Books, Pennsylvania

    Google Scholar 

  • Sim SK, Duffy AHB (2003) Towards an ontology of generic engineering design activities. Res Eng Des 14(4):200–223

    Article  Google Scholar 

  • Squire LR, Zola SM (1998) Episodic memory, semantic memory, and amnesia. Hippocampus 8:205–211

    Article  Google Scholar 

  • *Stauffer LA, Ullman DG (1991) Fundamental processes of mechanical designers based on empirical data. J Eng Des 2(2):113–125

    Article  Google Scholar 

  • Suwa M, Tversky B (1996) What architects see in their sketches: implications for design tools. In: Conference companion on human factors in computing systems: common ground, pp 191–192

    Google Scholar 

  • *Suwa M, Tversky B (1997) What do architects and students perceive in their design sketches? A protocol analysis. Des Stud 18(4):385–403

    Article  Google Scholar 

  • Suwa M, Tversky B, Gero J, Purcell T (1994) Seeing into sketches: regrouping parts encourages new interpretations. Vis Spat Reason Des II:207–219

    Google Scholar 

  • Suwa M, Gero JS, Purcell T (1998) Analysis of cognitive processes of a designer as the foundation for support tools. Artif Intell Des 98:229–248

    Google Scholar 

  • *Suwa M, Purcell T, Gero J (1998) Macroscopic analysis of design processes based on a scheme for coding designers’ cognitive actions. Des Stud 19(4):455–483

    Article  Google Scholar 

  • *Suwa M, Gero J, Purcell T (2000) Unexpected discoveries and S-invention of design requirements: important vehicles for a design process. Des Stud 21(2000):539–567

    Google Scholar 

  • Tulving E (1983) Elements of episodic memory. Clarendon Press, Oxford

    Google Scholar 

  • *Yu R, Gero JS (2015) An empirical foundation for design patterns in parametric design. In: Ikeda Y, Herr CM, Holzer D, Kaijima S, Kim MJ, Schnabel A (eds) Proceedings of the 20th international conference of the association for computer-aided architectural design research in Asia CAADRIA, pp 1–9

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Laura Hay .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer International Publishing Switzerland

About this paper

Cite this paper

Hay, L., McTeague, C., Duffy, A.H.B., Pidgeon, L.M., Vuletic, T., Grealy, M. (2017). A Systematic Review of Protocol Studies on Conceptual Design Cognition. In: Gero, J. (eds) Design Computing and Cognition '16. Springer, Cham. https://doi.org/10.1007/978-3-319-44989-0_8

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-44989-0_8

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-44988-3

  • Online ISBN: 978-3-319-44989-0

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics