CyberPLAYce, A Cyber-Physical-Spatial Storytelling Tool: Results from an Empirical Study with 8-10-Year-Old Storytellers
- 3k Downloads
The product of a multidisciplinary and iterative process, CyberPLAYce is an interactive, portable learning tool for children enhancing personal and computational expression, and particularly, playful storytelling. CyberPLAYce finds inspiration in the concept of embodied child-computer interaction, where meaning is constructed through spatially reconfiguring the physical environment. This paper briefly outlines the motivations for CyberPLAYce, and focuses on an iterative design, mixed-methodology and usability studies involving 8-10-year-old storytellers. The kinds of digital-physical-spatial activity afforded by CyberPLAYce promise to scaffold thinking, imagining, creating, and sharing in children. Lessons learned from this research-through-design case will aid members of the HCI International community as they design and test tools for our youngest learners.
KeywordsComputer support tools Play Childhood education Storytelling Interactive environments Architecture Usability evaluation User-Centered design Tangible computing Prototyping
We describe the design and evaluation of CyberPLAYce, (Fig. 1), a novel, interactive, computational learning tool for children and their teachers. CyberPLAYce aims to bridge physical and digital worlds, allowing children to make storytelling tangible through the spatial manipulation of cyber-physical elements.
1.1 Play and Storytelling
Research shows that well-developed play has positive impacts on the development of children . The concept of play has extensively been considered and cultivated within the HCI community [6, 7, 8, 9]. CyberPLAYce is particularly targeted at developing children’s personal and computational expression. CyberPLAYce promotes children’s active involvement and imagination in creating their own play activity which is in alignment with Caillois’s paidia play [6, 7], where play is open and affords uncontrollable imagination while giving life to fantasy worlds using physical-digital elements (see, e.g., [10, 11]). CyberPLAYce takes inspiration from research on storytelling in the field of HCI [12, 13] that specifically highlights storytelling as a creative activity: in PETS , child-assembled, augmented toys support emotional expression as children create and tell stories; in StoryMat , children move around a blanket while they make stories with tangible objects; and in StoryRoom  and POGO  children play with tangibles offering visual and sound effects that guide the storytelling activity. Collectively, this prior research suggests the promise of tangibles as tools for children to creatively express themselves, to construct meaning, to learn new knowledge, and to communicate during storytelling activities. Our tangible learning tool, CyberPLAYce, novel for expanding tangibles into the dimension of space, aims to merge play and learning in the physical world while transitioning children from consumers of virtual and digital-centric technologies into technological innovators and cyber-playful storytellers.
2 Design Process
One day, in a classroom of 8 year olds, Mr. Smith asks the students to think of the routine tasks the students perform each morning at home. Then he tells his story of “Jane”: The sun rises just before Jane’s alarm goes off. When Jane hears the sound of the alarm, she pushes a button to turn it off. She turns on her bedroom light and her room becomes yellow. Jane walks to the bathroom to take a shower, but first she tests the water to make sure it isn’t too hot….
The break-down of Jane’s story into segments, as a vehicle to thinking algorithmically and computationally
In a ten week period, the first-functioning CyberPLAYce prototype was designed and built by our design-research team employing the open – source Arduino  platform, and containing magnetic panels and modules of electronic components, such as push buttons, LEDs, temperature sensors, light sensors and LCDs (Fig. 4). Etched into the electronic modules were the images of the icon cards, providing real-time feedback when children plug the modules into the panels, and assemble the magnetic panels into spatial constructions.
As an early test of CyberPLAYce’s capacity, the segments from the CyberPLAYce scenario were matched to various input-output activities (Table 1) – a linkage of cards, modules and ideas that suggests how CyberPLAYce might provide children the means to think, understand, learn and share through a multi-modal, interactive and tangible experience. The different physical, digital and spatial dimensions of the CyberPLAYce tool offer children a variety of story-making elements to choose from which and create their own story of interest.
3 Empirical Study
The empirical study was conducted over three days. Each day, one pair of children, ages 8–10, participated in a 2.5-h evaluative session. Relative to the research questions posed, the sessions were designed to elicit data on the system’s usability (Questions 1 and 2), and efficacy (Question 3). The empirical study reported here follows from the recorded observations and feedback received from children and the research team in the evaluation of our full-functioning CyberPLAYce, carried out with 8 and 10 year old children, and mostly focuses on the usability studies (Questions 1 and 2).
3.1 Research Activity
To collect data on whether children could comfortably use CyberPLAYce during interactive storytelling, the research team was guided by established protocols for evaluating interactive technology for children . Children completed two main tasks, Tasks 1 and 2, during each session. In Task-1, children listened to a given story (Jane’s story), and then were asked to retell the story through the icon and action cards (Fig. 3). Children began by: 1. matching the story segments to the action cards, and 2. using the icon cards, finding different input-outputs that define each action. Subsequently, the participating children were asked to retell the story by plugging-in the associated CyberPLAYce modules into the panels according to the order of the icon cards that they had previously organized. In Task-2, the children were asked to choose at least six action cards out of ten provided them, and to match these action cards with the relevant icon cards. The action cards provided the children pictured different phenomena (e.g., a jungle, a GPS device, a car, a lion, and a thunderstorm). Children then wrote on paper their own stories following from the prompts pictured on their selected action cards. Lastly, each group presented their composed story through a creative combination of the CyberPLAYce cards and modules. Children completed Tasks 1 and 2 collaboratively while sharing ideas and communicating through the tangible tool. During each session, the research team observed the storytelling activity, and made notes on how participants engaged with the cards, module and panel interfaces, and reacted to the tool overall. Immediately after the storytelling and story creation activities, the research team asked the children for feedback about their experience of telling stories through CyberPLAYce. The sessions were videotaped (see http://youtu.be/uZpGh-_KXQY) and the discourse transcribed.
Furthermore, at the end of the session, each child completed a facilitated questionnaire (employing Smileyometer  on a 5-point Likert scale) that evaluated CyberPLAYce on measures of usability, aesthetic design and storytelling engagement.
Figure 5 illustrates samples of questions included in the questionnaire. To offset any potential limitations of the “Smileyometer” instrument, such as inclusion of leading or confusing questions, the results of the questionnaire were confirmed against documented observations of usability errors exhibited by the children.
Questionnaire results of the empirical study
4 Four Things Learned
Most children found the plug-and-play activity frustrating when they were plugging electronic modules into the large panels. Friction must be reduced.
Some children had difficulty matching the icon cards to the associated modules; they suggested we color-code and name the cards and modules appropriately.
Most children wanted more electronic modules, including ones with a sound recorder, a camera, and a large LCD screen to show pictures and hand drawings of visual representations of their stories.
All participants preferred to see more color in everything.
5 Future Work
Our next experiment will focus on advancing the spatial dimension of CyberPLAYce and answering the third CyberPLAYce research question: How does CyberPLAYce support children’s storytelling experience and enhance their personal and computational expression? A new CyberPLAYce prototype was designed and built following the feedback received from the children, educators and our research team participated in the empirical study reported here.
6 Import for HCI International Community
For the larger HCI International community, CyberPLAYce is a case of research through design focused on cyber-physical learning tools, and tangibles extending into the spatial dimension. As computing becomes ever-more ubiquitous in our everyday lives, it will inevitably occupy the physical spaces we live in, and increasingly converges with it to construct a tangible environment – a next frontier for HCII.
- 1.Dourish, P.: Where the Action is: The Foundations of Embodied Interaction. MIT Press, Cambridge (2001)Google Scholar
- 3.Papert, S.: Mindstorms Children, Computers, and Powerful Ideas, p. 23. Basic Books, New York (1993)Google Scholar
- 4.Soleimani, A., Green, K. E., Herro, D., Walker, I., Garder-McCune, C.: Design Team: Learning with CyberPLAYce. In: Proceedings of the CHI 2014, p. 165. ACM (2014)Google Scholar
- 5.Leong, D.J., Bordrova, E.: Assessing and scaffolding: make-believe play. Natl. Assoc. Educ. Young Child. 67(1), 28–34 (2012)Google Scholar
- 6.Gaver, B.: Designing for homo ludens, still. In: Binder, T., et al. (eds.) (Re)searching the Digital Bauhaus, pp. 163–178. Springer, London (2009)Google Scholar
- 7.Lindley, E. S., Harper, R., Sellen, A.: Designing a technological playground: a field study of the emergence of play in household messaging. In: Proceedings of the CHI 2010, pp. 2351–2360. ACM (2010)Google Scholar
- 8.Monk, A., Hassenzahl, M., Blythe, M., Reed, D.: Funology: designing enjoyment. Interactions 2002, 11 (2002)Google Scholar
- 9.National Literacy Trust: Literacy Guide for Secondary Schools. National Literary Trust, London (2012)Google Scholar
- 10.Åkerman, P., Puikkonen, A.: Prochinima: using pico projector to tell situated stories. In: Proceedings of the Mobile HCI 2011, pp. 337–346. ACM (2011)Google Scholar
- 11.Garzotto, F., Forfori, M.: Hyperstories and social interaction in 2D and 3D edutainment spaces for children. In: Proceedings of the HYPERTEXT 2006, pp. 57–68. ACM (2006)Google Scholar
- 13.Hourcade, J., et al.: KidPad: collaborative storytelling for children. In: Proceedings of the CHI EA 2002, p. 500. ACM (2002)Google Scholar
- 14.Druin, A., Hendler, J.: Robtos for Kids: Exploring New Technologies for Learning, pp. 75–84. Academic Press, San Diego (2000)Google Scholar
- 18.Read, J., Markopoulos, P.: C15: evaluating children’s interactive technology. In: Course Notes SIGCHI Conference on Human Factors in Computing Systems, Vancouver, 7–12 May 2011Google Scholar