Cognition, Technology & Work

, Volume 10, Issue 2, pp 119–128 | Cite as

Validating the Fun Toolkit: an instrument for measuring children’s opinions of technology

  • Janet C. ReadEmail author
Original Article


The paper presents the Fun Toolkit (v3), a survey instrument that has been devised to assist researchers and developers to gather opinions about technology from children. In presenting the toolkit, the paper provides a reflective look at several studies where the toolkit has been validated and considers how the Fun Toolkit should be used as well as discussing how, and in what way, the instruments contained within it should be employed. This consideration of use is one of the novel contributions of the paper. The second major contribution is the discussion based around software appeal; in which the fit between the Fun Toolkit and usability and engagement is explored. The paper concludes that the Fun Toolkit is useful, that it can be used with some confidence to gather opinions from children and that it has the potential for use for other user experiences.


Survey methods Questionnaires Fun Toolkit Children Evaluation 



Hundreds of children have freely shared their opinions and views, they are acknowledged here for their willingness to provide windows into their worlds, for moments of amusement, and for the many special insights they have provided. Also, thanks to Dr Stuart MacFarlane who provided some assistance with the statistics in this paper.


  1. Airey S, Plowman L, Connolly D, Luckin R (2002) Rating children’s enjoyment of toys, games and media. In: 3rd world congress of international toy research on toys, Games and Media, LondonGoogle Scholar
  2. Barendregt W, Bekker MM, Bouwhuis DG, Baauw E (2006) Identifying usability and fun problems in a computer game during first use and after some practice. Int J Human Comput Stud 64:830–846CrossRefGoogle Scholar
  3. Bark I, Folstad A, Gulliksen J (2005) Use and usefulness of HCI methods: results from an exploratory study among nordic HCI practitioners, HCI 2005. Springer, EdinburghGoogle Scholar
  4. Bogdan RC, Biklen SK (1998) Qualitative research for education: an introduction to theory and methods. Allyn and Bacon, BostonGoogle Scholar
  5. Borgers N, Hox J (2001) Item non response in questionnaire research with children. J Official Stat 17(2):321–335Google Scholar
  6. Borgers N, Hox J, Sikkel D (2002) Response quality in research with children and adolescents: the effect of labelled response opinions and vague quantifiers. Int J Public Opin Res 15(1):83–94CrossRefGoogle Scholar
  7. Borgers N, Hox J, Sikkel D (2004) Response effects in surveys on children and adolescents: the effect of number of response options, negative wording, and neutral mid-point. Qual Quant 38(1):17–33CrossRefGoogle Scholar
  8. Bosenberg A, Thomas J, Lopez T, Kokinsky E, Larsson IE (2003) Validation of a six-graded faces scale for evaluation of postoperative pain in children. Paediatr Anaesth 13:708–713CrossRefGoogle Scholar
  9. Breakwell G (1995) Research methods in psychology. SAGE Publications, LondonGoogle Scholar
  10. Bruck M, Ceci SJ, Melnyk L (1997) External and internal sources of variation in the creation of false reports in children. Learn Individ Differ 9(4):269–316CrossRefGoogle Scholar
  11. Carroll JM (2004) Beyond fun. Interactions 2:38–40CrossRefGoogle Scholar
  12. Carroll JM, Thomas JC (1988) Fun. SIGCHI Bull 19(3):21–24CrossRefGoogle Scholar
  13. Cohen L, Manion L (1994) Research methods in education. Routledge, LondonGoogle Scholar
  14. Coolican H (2004) Research methods and statistics in psychology. Hodder and Stoughton, AbingdonGoogle Scholar
  15. Denham SA, Auerbach S (1995) ‘Mother–child dialogue about emotions and pre-schoolers’ emotional competence. Genet Soc Gen Psychol Monogr 12(3):311–327Google Scholar
  16. Fransella F, Bannister D (1977) A manual for repertory grid technique. Academic, LondonGoogle Scholar
  17. Greig A, Taylor A (1999) Doing research with children. Sage, LondonGoogle Scholar
  18. Hanna E, Risden K, Czerwinski M, Alexander KJ (1999) The role of usability research in designing children’s computer products. Druin A (ed) The design of children’s technology. Morgan Kaufmann, San Francisco, pp 4–26Google Scholar
  19. Hanna L, Neapolitan D, Risden K (2004) Evaluating computer game concepts with children. IDC2004, ACM Press, MarylandGoogle Scholar
  20. Hassenzahl M, Platz A, Burmester M, Lehner K (2000) Hedonic and ergonomic quality aspects determine a software’s appeal. CHI2000, ACM Press The Hague, AmsterdamGoogle Scholar
  21. Holoday B, Turner-Henson A (1989) Response effects in surveys with school-age children. Nurs Res (methodological corner) 38:248–250Google Scholar
  22. ISO/IEC (1998) 9241—14 Ergonomic requirements for office work with visual display terminals (VDT)sGoogle Scholar
  23. van Kesteren I, Bekker MM, Vermeeren APOS, Lloyd P (2003) Assessing usability evaluation methods on their effectiveness to elicit verbal information from children subjects. IDC2003, ACM Press, PrestonGoogle Scholar
  24. Krosnick JA (1991) Response strategies for coping with the cognitive demands of attitude measures in surveys. Appl Cogn Psychol 5:213–236CrossRefGoogle Scholar
  25. Lenhart A, Madden M, Hitlin P (2005) Teens and technology: youth are leading the transition to a fully wired and mobile nation. PEW Internet and American Life, Washington DC, p 57Google Scholar
  26. Likert R (1932) A technique for the measurement of attitudes. Archives of Psychology 140Google Scholar
  27. MacFarlane SJ, Sim G, Horton M (2005) Assessing usability and fun in educational software. IDC2005, Co, ACM Press, BoulderGoogle Scholar
  28. Markopoulos P, Bekker M (2002) Usability testing with children subjects: comparing usability testing methods. Interaction design and children, EindhovenGoogle Scholar
  29. Metaxas G, Metin B, Schneider J, Shapiro G, Zhou W, Markopoulos P (2005) SCORPIODROME: an exploration in mixed reality social gaming for children. ACE 2005, ACM Press, ValenciaGoogle Scholar
  30. Osgood CE, Suci GJ, Tannenbaum PH (1957) The measurement of meaning. University of Illinois Press, UrbanaGoogle Scholar
  31. Read JC, MacFarlane SJ (2000) Measuring fun—usability testing for children. Computers and Fun 3, BCS HCI Group, York, England Google Scholar
  32. Read JC, MacFarlane SJ (2006) Using the Fun Toolkit and other survey methods to gather opinions in child computer interaction. Interaction Design and Children, IDC2006, ACM Press, TampereGoogle Scholar
  33. Read JC, MacFarlane SJ, Casey C (2001a) Expectations and endurability—measuring fun. Computers and fun 4, York, EnglandGoogle Scholar
  34. Read JC, MacFarlane SJ, Casey C (2001b) Measuring the usability of text input methods for children, HCI2001. Springer, LilleGoogle Scholar
  35. Read JC, Gregory P, MacFarlane SJ, McManus B, Gray P, Patel R (2002a) An investigation of participatory design with children—informant, balanced and facilitated design. Interaction Design and Children, Shaker Publishing, Eindhoven Google Scholar
  36. Read JC, MacFarlane SJ, Casey C (2002b) Endurability, engagement and expectations: measuring children’s fun. Interaction Design and Children, Shaker Publishing, EindhovenGoogle Scholar
  37. Read JC, MacFarlane SJ, Horton M (2004) The usability of handwriting recognition for writing in the primary classroom, HCI 2004. Springer, LeedsGoogle Scholar
  38. Scullin MH, Ceci SJ (2001) A suggestibility scale for children. Person Individ Differ 30:843–856CrossRefGoogle Scholar
  39. Shields BJ, Palermo TM, Powers JD, Grewe SD, Smith GA (2003) Predictors of a child’s ability to use a visual analogue scale. Child Care Health Dev 29(4):281–290Google Scholar
  40. Sim G, MacFarlane SJ, Read JC (2006) All work and no play: measuring fun, usability, and learning in software for children. Comput Edu 46(3):235–248CrossRefGoogle Scholar
  41. Subrahmanyam K, Greenfield P, Kraut R, Gross E (2001) The impact of computer use on children’s and adolescents’ development. Appl Dev Psychol 22:7–30CrossRefGoogle Scholar
  42. Tobey A, Goodman G (1992) Children’s eyewitness memory: effects of participation and forensic context. Child Abuse Neglect 16:807–821CrossRefGoogle Scholar
  43. Wilson N, McLean S (1994) Questionnaire design: a practical introduction. Co Antrim, University of Ulster Press, Newton Abbey, pp 94–120Google Scholar
  44. Wong DL, Baker CM (1988) Pain in children: comparison of assessment scales. Pediatr Nurse 14:9–17Google Scholar
  45. Youngman MB (1984) Designing questionnaires. In: Bell J, Bush T, Fox A, Goodey J, Goulding S (eds) Conducting small scale investigations in education management. Harper and Row, London, pp 156–176Google Scholar

Copyright information

© Springer-Verlag London Limited 2007

Authors and Affiliations

  1. 1.University of Central LancashirePrestonUK

Personalised recommendations