Interest Arousal by Haptic Feedback During a Storytelling for Kindergarten Children

Vygotsky and Bandura [5] stated that the physicality of words and gestures should also be considered as types of tools for interaction for children. They believed communicating with other people was one method to help a child develop. A picture book is one example of a tool that helps children to gain verbal ability through communication with adults. It has been confirmed that children are able to learn languages from adults through picture books [1, 2]. Moreover, according to Bruner [6], the phenomenon of joint attention is how children display empathy for others. Bruner’s infant study suggested that from an early age, children actively use their bodies to engage with others. Thus, collaborative interaction plays an essential role in the child’s development for the child to understand themselves and others. Therefore, storytelling events at libraries and kids’ spaces are beneficial to a child’s development as they encourage collaborative interaction. However, the primary way that children explore the world using their bodies is through touch. As a result, educators, such as Frobel [3] and Montessori [4], attempted to demonstrate how interacting with “things” was essential for child development. Frobel [3], for example, founded a kindergarten that used the “Gifts,” or educational play materials, to encourage children to learn while playing freely with objects. Montessori [4], similarly, developed teaching tools that trained a child’s senses. Reggio Emilia [7] took this notion further by introducing the importance of creativity and developed a preschool education method that stressed physical learning through art expression. Iverson et al. [9, 10] and Antle et al. [11] also showed that exploratory activity that allowed a child to use their body influenced the depth of their understanding. By utilizing human physicality, especially one’s tactile sense, the brain is more actively stimulated, which can help comprehension. Therefore, many museums have incorporated hands-on [8] activities to encourage a deep understanding of exhibits, particularly exhibitions related to cultural properties. Already there are many studies in which tactile technology has been adapted to children’s education. Several of which focus on storytelling and reading. Yannier [12] et al. and Zhao et al. [13] verified that children reading with a vibrotactile tablet could achieve a deeper understanding of the content they were reading. However, a limitation to these studies was that they focused on individual or one-on-one readers. Through this research, we hope to explore how to focus children’s interest in picture books in a group reading setting. During storytelling time, at public spaces like the library or kid space, children of various backgrounds listen to a story together. However, there are usually differences in age, the ability of understanding, and the interest level of the children. Also, there is a field problem that it was difficult to grab children’s attention all of them because children’s attention was different when long storytelling. As a result, selecting a picture-book that is suitable for everyone is a difficult task. In this study, we aimed to design experience to grab children’s attention to picture books when multiple children listen to storytelling together. In the next chapter, we did fieldwork to explore the issue of a typical kindergarten setting and to find what interaction needed to make the system. Based on this result we developed a cushion that multiple children can feel picture book world through their body by haptic feedback same time. And then we conducted experiment to verification the effective of this system, and we analyzed children behavior to use behavior psychology method. Finally, we discussed what value the embodied experience of picture book could provide to children.

We conducted experiment to verification the effective of this system. Drew et al. [17] reported haptic feedback can draw children’s attention and conversation about the sensation explain in picture book between parents and children. Therefore, we thought if children get information through the sensation, children’s behavior like attention to the picture book and sitting on the cushion will change. For our study, we compared storytelling using our “BURU BURU” cushion and normal storytelling. And we analyzed children behavior to use behavior psychology method. The test was performed in four groups over two days (am/pm), and we analyzed what changes occurred in the children’s behavior.

3.1 Experimental Method

Participants

Participants were recruited using flyers in a kid space operated by Froebel-Kan Co., Ltd. For the first test, we recruited a total of 10 children and their parents, 6 children in the morning (3 boys and 3 girls, aged 3 years) and 4 children in the afternoon (2 boys and 2 girls, aged 3 years) on July 23th 2019. In the second test, we recruited a total of 21 children and their parents, 10 pairs of children and parents in the morning (4 boys and 6 girls, aged 3–4 years) and 11 pairs of children and parents in the afternoon (6 boys and 5 girls, aged 3–4 years) on October 19th 2019. Participants were paid 3,000 JPY per hour for their participation. The total 31 children (average aged: 43.4 months) were used for the analysis, excluding those who were absence or attendees who joined in midway. Additionally, parents were asked to complete a questionnaire: “How many picture books do you read a week?” to help us gauge the participating children’s existing level of familiarity with picture books. The majority, 21 people, answered that they read picture books every day. On the other hand, two participants stated that they rarely read picture books. The remaining eight people said they read picture books a few days a week. Overall, many of the children who participated were familiar with picture books.

Procedure

Testing was performed in a kid’s space operated by Froebel-Kan Co., Ltd. We had children sit on the cushions as picture books were read aloud. We alternated between normal storytelling and storytelling with the system (see Table 1). We switched the order (with and without) between morning test and afternoon test to prevent preference bias due to the ordering. Also, we told parents to not stop a child should they decide to move off the cushion. Children were free to come and go as they wanted. Between the second and third storytelling we put in a brief exercise play break. In total, four picture books were read per group. For each test we captured each child’s face on video.

Table 1.

Summary of procedure

Open image in new window

Video Coding and Depend Variables

Video Coding began when the reader opened the picture book and started to read then continued until the picture book completed. The video was divided into 15 s increments to elicit the rate of how often a set of variables occurred during that timeframe. We measured five different variables (attention to picture books, looking at mother, pointing at picture books, utterances, sitting on the cushion.): Attention to picture books: It was defined as the child looking at a picture book for 15 s. Looking at mother: It was scored when the child looks at the mother at least once every 15 s. Also, pointing at picture books and utterances was scored when these actions occurred at least once every 15 s. Utterances: it was scored that children talk about a picture book. Sitting on the cushion: It was defined as the child sitting on the cushion for 15 s. Coding was performed with the assistance of people not familiar with the contents of the experiment (hereinafter referred to naïve). The test on July 23, 2019, was analyzed by three people (author and two naïve) while the test on October 19, 2019, was analyzed by seven people (author and six naïve raters). And then we examined the agreement value between authors and naïve observers: attention to picture books of agreement value average is 88% (minimum/maximum values from 55% to 100%), looking at the mother is 96% (min/max values from 61% to 100%), pointing at picture books is 100% (min/max values from 91% to 100%), utterances is 96% (min/max values from 75% to 100%), and sitting on the cushion 95% (min/max values from 28% to 100%), all of the agreement value average maintained at least 85% or higher.

3.2 Result

Figure 3 shows average data of the percentage of 15 s intervals with Attention to picture books, sitting on the cushion, Looking at mother. We analyzed for haptic feedback factor (with vibration and without vibration) and order factor (the first half and the second half) using an ANOVA in each different variable. We found an interaction between haptic feedback factor and order factor in attention to picture books [F (1,30) = 9.272, p = .005]. There is no measurable effect of haptic feedback [F (1, 30) = 0.057, p = .813] and order [F (1,30) = 2.420, p = .130]. We noticed children’s attention to picture books reduced in the second half when there was no haptic feedback. Also, there was significant interaction in looking at mother [F (1, 30) = 4.937, p = .034]. There is no main effect of haptic feedback [F (1, 30) = 0.080, p = .779] and order [F (1, 30) = 2.564, p = .120]. Looking at mother increased in the second half when there was no haptic feedback. Regarding sitting on the cushion, we noticed it decreased in the second half regardless of haptic feedback (first half vs second half), [F (1, 30) = 15.498, p < .001]. Also, utterance had the same result (6% first half, 3% second half with haptic feedback condition and 7% first half, 4% second half, without haptic feedback condition), [F (1,30) = 5.094, p = .031]. Additionally, most children did not point to the picture books. Only four children pointed to picture book during the vibrotactile sessions, and this behavior occurred only once during the normal storytelling. Finally, we got feedback from their parents by using a free-form questionnaire about differences in the child’s behavior from the parent’s perspective. Table 2 is categorized feedback from parents.

Open image in new window

Table 2.

Examples of feedback comments from parents

Categories	Example of feedback
Discovering the child’s concentration	• “she gets bored of long stories, but I confirmed that she was concentrating because she thought it was fun.” (3 years 8 months old girls and mother) • “She can’t listen to storytelling too long at kids’ space, but today she listened to four books and I was surprised (though during the third one she seemed a little tired).” (3 years 8 months old girl and mother) • It was possible to return his attention to the picture book by the sound and vibration when he was distracted by toys. He won’t come back from toys at home. (3 years 3 months old boy and mother) • He always pays attention to the details of the picture, but today he was concentrating on getting the whole story. (3 years 5 months boy and mother)
Discovering children’s positiveness through story-telling experiences	• Normally he is shy and never leaves from me, but I was surprised because he sat alone on the cushion (3 years and 0 months boy/mother) He is such a baby, so I expected him get on my knees, but I was surprised when he returns to cushion himself. (3 years 7 months boy and mother)
Discovery of children’s sharing	• I was impressed when she looked at me sitting behind her when the cushion vibrated. (4 years 7 months girl and mother)

In this study, we aimed to design experience to grab children’s attention to picture books when multiple children listen to storytelling together. Then we developed the Kinder “BURU BURU” cushion which multiple children can experience the world of picture books using their body. And we investigated the effects of our system using haptic feedback to use behavior analyzed method. As a result of experiment that we confirmed that our system can reduced the declined children’s attention to picture book when long storytelling with multiple children. However, we found that the effect of the group experience was not enough to variables the children looking at mother. During the experiment, there were situations where children looked at each other who participated with friends. It is the possibility that more behavior will lead to joint attention. In the future, we would like to more clarify the effects of a group experience to storytelling, our system will be using continuous such as the environment where children know each other. Also, we believed that this method can helped other group work like elderly activity.