Abstract
Augmented reality (AR) technology can enhance picture book reading experience. The present study aimed to explore the influence of reading AR picture books on primary school students’ reading comprehension, story retelling, and reading motivation. Eighty second graders, who were from two classes at a rural primary school in a coastal city in East China, were recruited through convenience sampling to participate in this quasi-experimental study. The two classes were randomly assigned to be either the experimental group (AR picture book reading) or control group (print picture book reading), and both groups read three traditional Chinese picture books during reading classes throughout three weeks. T-test analyses revealed that, before the study began, the two groups did not have significant differences in reading comprehension, story retelling, or reading motivation. However, after the three weeks of instructional intervention, the experimental group significantly outperformed the control group in all three aspects. Furthermore, MANCOVA analysis showed that reading AR picture books was more effective in boosting participants’ performance on implicit questions during the reading comprehension tests. They also performed significantly higher on story retelling tests, especially when it came to story structures regarding settings and plots. In addition, AR picture book reading was more conducive to improving participants’ level of attention and confidence in reading. This work adds to the ongoing endeavors in incorporating AR picture books into classroom settings, and will inform future development of original Chinese picture books with AR technology.
Similar content being viewed by others
Data availability
The datasets generated during and/or analysed during the current study are available from the corresponding author on reasonable request.
References
Ahmadi, K., Maktabifard, L., & Momeni, E. (2015). Information behaviors of children and adolescents’ interaction with print and digital books. Human Information Interaction, 1(4), 319–328.
Akçayır, M., & Akçayır, G. (2017). Advantages and challenges associated with augmented reality for education: A systematic review of the literature. Educational Research Review, 20, 1–11.
Alhumaidan, H., Lo, K., & Selby, A. (2018). Co-designing with children a collaborative augmented reality book based on a primary school textbook. International Journal of Child-Computer Interaction, 15, 24–36.
Al-Imamy, S. (2020). Blending printed texts with digital resources through augmented reality interaction. Education and Information Technologies, 25, 2561–2576.
Altinpulluk, H. (2019). Determining the trends of using augmented reality in education between 2006–2016. Education and Information Technologies, 24, 1089–1114.
Aydoğdu, F. (2021). Augmented reality for preschool children: An experience with educational contents. British Journal of Educational Technology, 53, 326–348.
Azuma, R., Baillot, Y., Behringer, R., Feiner, S., Julier, S., & MacIntyre, B. (2001). Recent advances in augmented reality. Computer Graphics and Applications IEEE, 21(6), 34–47.
Azuma, R. T. (2004). Overview of augmented reality. Proceedings from SIGGRAPH 2004: The 31st International Conference on Computer Graphics and Interactive Techniques. New York, NY: ACM.
Bai, J., Zhang, H., Chen, Q., Cheng, X., & Zhou, Y. (2022). Technical Supports and Emotional Design in Digital Picture Books for Children: A Review. Procedia Computer Science, 201, 174–180. https://doi.org/10.1016/j.procs.2022.03.025
Billinghurst, M., Kato, H., & Poupyrev, I. (2001). The MagicBook: A transitional AR interface. Computers & Graphics, 25(5), 745–753. https://doi.org/10.1016/S0097-8493(01)00117-0
Bressler, D. M., & Bodzin, A. M. (2013). A mixed methods assessment of students’ flow experiences during a mobile augmented reality science game. Journal of Computer Assisted Learning, 29(6), 505–517.
Bus, A. G., Takacs, Z. K., & Kegel, C. A. (2015). Affordances and limitations of electronic storybooks for your children’s emergent literacy. Developmental Review, 35, 79–97. https://doi.org/10.1016/j.dr.2014.12.004
Caudell, T. P., & Mizell, D. W. (1992). Augmented reality: An application of heads-up display technology to manual manufacturing processes. In Proceedings of the twenty-fifth Hawaii international conference on system sciences.
Chang, Y.-L., Hou, H.-T., Pan, C.-Y., Sung, Y.-T., & Chang, K.-E. (2015). Apply an augmented reality in a mobile guidance to increase sense of place for heritage places. Journal of Educational Technology & Society, 18(2), 166–178.
Chang, K., Tai, Y., Liu, T., & Sung, Y. (2023). Embedding dialog reading into AR picture books. Interactive Learning Environments. https://doi.org/10.1080/10494820.2023.2192758
ChanLin, L. J. (2018). Bridging Children’s Reading with an Augmented Reality Story Library. Libri, 68, 219–229. https://doi.org/10.1515/libri-2018-0017
Chen, X. (2021). Repackaging Chinese culture through diverse visual arts: A multimodal approach to contemporary Chinese picturebooks. Bookbird: A Journal of International Children’s Literature, 59(1), 4–15. https://doi.org/10.1353/bkb.2021.0002
Chen, S. (2022). To explore the impact of augmented reality digital picture books in environmental education courses on environmental attitudes and environmental behaviors of children from different cultures. Frontiers in Psychology, 13. https://doi.org/10.3389/fpsyg.2022.1063659
Cheng, K.-H., & Tsai, C.-C. (2013). Affordances of augmented reality in science learning: Suggestions for future research. Journal of Science Education and Technology, 22(4), 449–462.
Cheng, K.-H., & Tsai, C.-C. (2014). Children and parents’ reading of an augmented reality picture book: Analyses of behavioral patterns and cognitive attainment. Computers & Education, 72, 302–312. https://doi.org/10.1016/j.compedu.2013.12.003
Cheng, K. H., & Tsai, C. C. (2016). The interaction of child–parent shared reading with an augmented reality (AR) picture book and parents’ conceptions of AR learning. British Journal of Educational Technology, 47(1), 203–222.
Chu, Y. (2020). On English Translation of Chinese Original Picture Books from the Perspective of Multimodality. Open Access Library Journal, 7, 1–19. https://doi.org/10.4236/oalib.1106208
Damayanti, I. L., & Febrianti, Y. (2020). Multimodal literacy: Unfolding reading path in children’s picture book and its potential for EFL classrooms. Indonesian Journal of Applied Linguistics, 9(3), 616–627. https://doi.org/10.17509/ijal.v9i3.23212
Danaei, D., Jamali, H. R., Mansourian, Y., & Rastegarpour, H. (2020). Comparing reading comprehension between children reading augmented reality and print storybooks. Computers & Education, 153, 1–10.
Dunleavy, M., Dede, C., & Mitchell, R. (2009). Affordances and limitations of immersive participatory augmented reality simulations for teaching and learning. Journal of Science Education and Technology, 18(1), 7–22.
Dünser A., Hornecker E. (2007) An Observational Study of Children Interacting with an Augmented Story Book. In: Hui K. et al. (eds) Technologies for E-Learning and Digital Entertainment. Edutainment 2007. Lecture Notes in Computer Science, vol 4469. Springer, Berlin, Heidelberg.
Ebadi, S., & Ashrafabadi, F. (2022). An exploration into the impact of augmented reality on EFL learners’ reading comprehension. Education and Information Technologies, 27, 9745–9765.
Fears, N. E., & Lockman, J. J. (2020). Case- and form-sensitive letter frequencies in children’s picture books. Early Childhood Research Quarterly, 53, 370–378. https://doi.org/10.1016/j.ecresq.2020.05.004
Ferrer-Torregrosa, J., Torralba, J., Jimenez, M., García, S., & Barcia, J. (2015). ARBOOK: Development and assessment of a tool based on augmented reality for anatomy. Journal of Science Education and Technology, 24(1), 119–124.
Furenes, M., Kucirkova, N., & Bus, A. (2021). A comparison of children’s reading on paper versus screen: A meta-analysis. Review of Educational Research, 91(4), 483–517.
Gopalan, V., Bakar, J., & Zulkifli, A. (2023). Systematic literature review on critical success factors in implementing augmented reality for science learning environment (2006–2021). Education and Information Technologies. https://doi.org/10.1007/s10639-023-11613-y
Green, M., McNair, L., Pierce, C., & Harvey, C. (2019). An investigation of augmented reality picture books: Meaningful experiences or missed opportunities? Journal of Educational Multimedia and Hypermedia, 28(4), 357–380.
Hsiao, K.-F., Chen, N.-S., & Huang, S.-Y. (2012). Learning while exercising for science education in augmented reality among adolescents. Interactive Learning Environments, 20(4), 331–349.
Hu, R., & Commeyras, M. (2008). A case study: Emergent biliteracy in English and Chinese of a 5-year-old Chinese child with worldless picture books. Reading Psychology, 29, 1–30.
Hu, T., Zhang, Q., Shen, Y., & Dong, H. (2017). Overview of augmented reality technology. Computer Knowledge and Technology, 13(34), 194–196.
Hung, Y. H., Chen, C. H., & Huang, S. W. (2017). Applying augmented reality to enhance learning: A study of different teaching materials. Journal of Computer Assisted Learning, 33(3), 252–266.
Hyun, E.-J., Choi, K., & Min, Y. H. (2011). Usability of Augmented Reality Picture Book for Young Children. The Journal of the Korea Contents Association, 11(12), 182–189.
Ibáñez, M., & Delgado-Kloos, C. (2018). Augmented reality for STEM learning: A systematic review. Computers & Education, 123, 109–123.
Keller, J. M. (2010). Motivational Design for Learning and Performance: The ARCS Model Approach. Springer.
Koch, J. (2016). TEACH3: Introduction to education. Boston, MA: Cengage Learning.
Lauricella, A., Barr, R., & Calvert, S. L. (2014). Parent-child interactions during traditional and computer storybook reading for children’s comprehension: Implications for electronic storybook design. International Journal of Child-Computer Interactions, 2, 17–25. https://doi.org/10.1016/j.ijcci.2014.07.001
Leung, W. S., & Blauw, F. F. (2020). An augmented reality approach to delivering a connected digital forensics training experience. In Kim, K. & Kim, H. Y. (Eds.), Information Science and Applications. Lecture Notes in Electrical Engineering, vol 621. Singapore: Springer. https://doi.org/10.1007/978-981-15-1465-4_36
Lin, H.-C.K., Hsieh, M.-C., Wang, C.-H., Sie, Z.-Y., & Chang, S.-H. (2011). Establishment and usability evaluation of an interactive AR learning system on conservation of fish. The Turkish Online Journal of Educational Technology, 10(4), 181–187.
Liu, D., & Park, J. W. (2019). A study on the design and presentation of virtual contents in AR picture books. 2019 IEEE 2nd International Conference on Computer and Communication Engineering Technology (CCET), 16–20.
Ma, L. (2018). On the budding period of Chinese original children’s picture books. Open Journal of Social Sciences, 6, 307–317.
Martin, D. J., & Loomis, K. S. (2013). Building teachers: A constructivist approach to introducing education. Cengage Learning.
Mayer, R. (2001). Multimedia learning. Cambridge University Press.
Mayer, R. E. (2009). Multimedia learning. Cambridge University Press.
Mayer, R. E. (2014). Introduction to multimedia learning. In R. E. Mayer (Ed.), The Cambridge handbook of multimedia learning (2nd ed., pp. 1–24). Cambridge University Press.
Mayer, R. E. (2017). Using multimedia for e-learning. Journal of Computer Assisted Learning, 33, 403–423. https://doi.org/10.1111/jcal.12197
Mayer, R. E., & Fiorella, L. (2014). Principles for reducing extraneous processing in multimedia learning: Coherence, signaling, redundancy, spatial contiguity, and temporal contiguity principles. In R. E. Mayer (Ed.), The Cambridge Handbook of Multimedia Learning (2nd ed., pp. 279–315). Cambridge University Press.
Mayer, R. E. (2005). Principles for reducing extraneous processing in multimedia learning: coherence, signaling, redundancy, spatial contiguity, and temporal contiguity principles. In R. E. Mayer (Ed.), The Cambridge handbook of multimedia learning. New York, NY: Cambridge University Press.
Morrow, L. M. (1986). Effects of structural guidance in story retelling on children’s dictation of original stories. Journal of Reading Behavior, 18(2), 135–152. https://doi.org/10.1080/10862968609547561
Munoz-Cristobal, J. A., Jorrin-Abellan, I. M., Asensio-Perez, J. I., Martinez-Mones, A., Prieto, L. P., & Dimitriadis, Y. (2015). Supporting teacher orchestration in ubiquitous learning environments: A study in primary education. Learning Technologies, IEEE Transactions on Learning, 8(1), 83–97.
Munzer, T. G., Miller, A. L., Weeks, H. M., Kaciroti, N., & Radesky, J. (2019). Differences in parent-toddler interactions with electronic versus print books. Pediatrics, 143(4), 1–10.
Pan, Z., López, M., Li, C., & Liu, M. (2021). Introducing augmented reality in early childhood literacy learning. Research in Learning Technology, 29, 1–21.
Paris, A. H., & Paris, S. G. (2003). Assessing narrative comprehension in young children. Reading Research Quarterly, 38(1), 36–76.
Radu, I. (2014). Augmented reality in education: A meta-review and cross-media analysis. Personal and Ubiquitous Computing, 18(6), 1533–1543.
Reich, S. M., Yau, J. C., & Warschauer, M. (2016). Tablet-based ebooks for young children: What does the research say? Journal of Developmental & Behavioral Pediatrics, 37(7), 585–591.
Schnotz, W. (2005). An integrated model of text and picture comprehension. In R. E. Mayer (Ed.), The Cambridge Handbook of Multimedia Learning (pp. 49–69). Cambridge University Press. https://doi.org/10.1017/CBO9780511816819.005
Schnotz, W. (2014). Integrated model of text and picture comprehension. In R. E. Mayer (Ed.), The Cambridge Handbook of Multimedia Learning (pp. 72–103). Cambridge University Press. https://doi.org/10.1017/CBO9781139547369.006
Sharp, D. L., Bransford, J. D., Goldman, S. R., Risko, V. J., Kinzer, C. K., & Vye, N. J. (1995). Dynamic visual support for story comprehension and mental model building by young, at-risk children. Educational Technology Research and Development, 43(4), 25–42.
Squire, K. D., & Jan, M. (2007). Mad City Mystery: Developing scientific argumentation skills with a place-based augmented reality game on handheld computers. Journal of Science Education and Technology, 16(1), 5–29.
Stanica, I.-C., Moldoveanu, A., Dascalu, M., Moldoveanu, F., Radoi, M., & Nemoianu, I. (2019). Emergent technologies to enrich reading outcomes through augmented reality. Revue Roumaine Des Sciences Techniques - Serie Électrotechnique Et Énergétique, 64, 95–100.
Strouse, G. A., & Ganea, P. A. (2017). A print book preference: Caregivers report higher child enjoyment and more adult–child interactions when reading print than electronic books. International Journal of Child-Computer Interaction, 12, 8–15. https://doi.org/10.1016/j.ijcci.2017.02.001
Suryani, Y. A., Utaminingsih, S., & Madjdi, A. H. (2021). Needs analysis of picture story book using augmented reality technology. Journal of Physics: Conference Series, 1823. https://doi.org/10.1088/1742-6596/1823/1/012083
Takacs, Z. K., & Bus, A. G. (2018). How pictures in picture storybooks support young children’s story comprehension: An eye-tracking experiment. Journal of Experimental Child Psychology, 174, 1–12. https://doi.org/10.1016/j.jecp.2018.04.013
Walczak, K., Wojciechowski, R., & Cellary, W. (2006). Dynamic interactive VR network services for education. Proceedings of the ACM Symposium on Virtual Reality Software and Technology, 277–286. https://doi.org/10.1145/1180495.1180552.
Wang, R. (2022). Application of augmented reality technology in children’s picture books based on educational psychology. Frontiers in Psychology, 13. https://doi.org/10.3389/fpsyg.2022.782958
Wee, S., Park, S., & Choi, J. (2015). Korean culture as portrayed in young children’s picture books: The pursuit of cultural authenticity. Children’s Literature in Education, 46, 70–87.
Wu, H.-K., Lee, S.W.-Y., Chang, H.-Y., & Liang, J.-C. (2013). Current status, opportunities and challenges of augmented reality in education. Computers & Education, 62, 41–49.
Xie, Z. (2022). Comparative Analysis between Chinese and Western Picture Books for Children in Safety Education. Open Journal of Social Sciences, 10, 328–343. https://doi.org/10.4236/jss.2022.1012022
Yamaji, N., Sawaguchi, M., & Ota, E. (2020). Talking with children about cancer: A content analysis of text in children’s picture books. Health, 12, 750–763. https://doi.org/10.4236/health.2020.127055
Yang, J. (2020). An empirical study on influences of AR E-book on reading learning of primary school students. Library Theory and Practice, 1, 41–47. Available at https://kns.cnki.net/kcms2/article/abstract?v=PhqKDHt8vRAXAC6afWW2DRldHjuneHkNOvBNd-bCqMCY_khNm82Zx1AvjGuCtsss1pWWroYFLv6L6k0kRt-nBl7IyKTaWB74E4JFrKTzZA4LGXx9plf69a-XS7EQleWjgf5C6SFCpuDSzeyYTs6gRw==&uniplatform=NZKPT&language=CHS
Yeari, M., Hadad, A., & Korat, O. (2023). The effects of amount, type and reoccurrence of interactions in electronic books on word learning and story comprehension by kindergartners. Education and Information Technologies. https://doi.org/10.1007/s10639-023-12077-w
Yilmaz, R. M., & Goktas, Y. (2017). Using augmented reality technology in storytelling activities: Examining elementary students’ narrative skill and creativity. Virtual Reality, 21(2), 75–89.
Yilmaz, R. M., Kucuk, S., & Goktas, Y. (2017). Are augmented reality picture books magic or real for preschool children aged five to six? British Journal of Educational Technology, 48(3), 824–841. https://doi.org/10.1111/bjet.12452
Yuen, S. C. Y., Yaoyuneyong, G., & Johnson, E. (2011). Augmented reality: An overview and five directions for AR in education. Journal of Educational Technology Development and Exchange, 4(1), 119–140.
Zhao, J., Zhu, M., Ruiter, L., & Chen, S. (2022) Linguistic indicators for text complexity in picture books for young Chinese children learning English as a foreign language. Frontiers in Education, 7. https://doi.org/10.3389/feduc.2022.758736
Acknowledgements
This work was supported by the National Social Science Fund of China (Grant Number: 20CZX011).
Author information
Authors and Affiliations
Contributions
Conceptualization, methodology, and original draft preparation: Shiyu Liu; Data collection and analysis: Yucheng Sui; Draft editing: Zhongnan You, Jiaxin Shi, Ziyang Wang, and Cheng Zhong. All authors read and approved the final manuscript.
Corresponding author
Ethics declarations
The authors do not have affiliations with or involvement in any organizations or entities with any financial or non-financial interests in the subject matter or materials enclosed in this manuscript.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Appendices
Appendix 1 Sample items in reading comprehension test on Xiao Xiao Nian
1.1 Sample explicit questions
-
1.
Who was the main character in the story?
-
A. little fox B. hedgehog C. Xiao Xiao Nian D. mankind
-
2.
Where did the story take place?
-
A. Ciba Town B. riverside C. by the pond D. prairie
1.2 Sample implicit questions
-
3.
Why was Xiao Xiao Nian happy?
-
A. Xiao Xiao Nian was happy because he went back home.
-
B. Xiao Xiao Nian was happy because he had a full stomach of delicious food.
-
C. Xiao Xiao Nian was happy because people in Ciba Town welcomed him.
-
D. Xiao Xiao Nian was happy because he got along with his friends.
-
4.
What was the theme of this story?
-
A. The importance of courage
-
B. The harmony between Nian and mankind
-
C. The importance of friendship
-
D. The importance of protecting the nature
Appendix 2 Story retelling test on Xiao Xiao Nian
2.1 Sample items on the guide sheet
-
1.
You just read this story about Xiao Xiao Nian in class. Could you retell the story as if you were telling it to a friend who has never heard it before?
-
2.
If a participant has difficulty beginning the story, suggest beginning with “When did this story happen?”
-
3.
If a participant has difficulty continuing retelling, encourage continuation by asking “Then what happened?”
2.2 Coding rubric
Story Structure | Elements | Codes |
---|---|---|
Setting | Character | (1) Xiao Xiao Nian, (2) Lao Lao Nian, (3) little goat, (4) little fox, (5) hedgehog, (6) little pig, (7) wild duck, (8) twin geckos, (9) mankind |
Location | (10) Ciba Town | |
Time | (11) once upon a time | |
Theme | Initiating Event | (12) Xiao Xiao Nian wanted to go to Ciba Town. (13) Lao Lao Nian warned Xiao Xiao Nian that mankind may hit him and spit on him. |
Goal | (14) Xiao Xiao Nian needed to arrive in Ciba Town. | |
Plot | Subgoal | (15) Xiao Xiao Nian wanted to get a heater in Ciba Town. (16) Xiao Xiao Nian wanted to eat dumplings in Ciba Town. |
Attempt | (17) Xiao Xiao Nian ran into a little goat. (18) Xiao Xiao Nian ran into a little fox. (19) Xiao Xiao Nian ran into a hedgehog. (20) Xiao Xiao Nian ran into a little pig. (21) Xiao Xiao Nian ran into a wild duck and twin geckos. | |
Result | (22) Xiao Xiao Nian and the animals went to Ciba Town together. (23) People in Ciba Town welcomed Xiao Xiao Nian and the animals. (24) Xiao Xiao Nian and the animals ate dumplings. (25) Xiao Xiao Nian had a full stomach of delicious food. (26) Xiao Xiao Nian found that mankind was no longer against Nian. (27) People gave Xiao Xiao Nian gifts. (28) Xiao Xiao Nian got the heater that he wanted. | |
Ending | Resolution | (29) The lights were turned on for everyone to go home. (30) Xiao Xiao Nian and the animals went home together. |
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Liu, S., Sui, Y., You, Z. et al. Reading better with AR or print picture books? A quasi-experiment on primary school students’ reading comprehension, story retelling and reading motivation. Educ Inf Technol (2023). https://doi.org/10.1007/s10639-023-12231-4
Received:
Accepted:
Published:
DOI: https://doi.org/10.1007/s10639-023-12231-4