Abstract
This study examines the impact of a mobile game app on science museum visitors’ level of engagement with exhibit content, compared to a non game-based version of the same app. Ask Dr. Discovery (Dr. D) is a question-asking app containing two versions: a Game Mode employing casual game mechanics and an Ask Mode providing a baseline version. We implemented both versions of Dr. D at two science museums located in the Southwestern United States with 1539 participants. In both conditions, participants could type or speak questions to receive vetted answers about museum content, but only Game Mode embedded question-asking within a simple game. Participants’ level of engagement was represented by the number of questions asked about exhibit content in Dr. D. Additionally, we explored the relationship between app engagement and participants’ self-reported level of interest in science. All participants completed pre- and post-questionnaires with questions related to science interest, impressions of the Dr. D app, and demographic information. Results in both museums indicated that users of Game Mode asked nearly twice as many questions on average as participants using Ask Mode. Science interest predicted engagement at one of two sites. Demographic variables, including gender, age, and race/ethnicity were not found to influence the rate of question asking in either mode. These results indicate that employing simple game mechanics in apps for museum visitors may lead to strong positive impacts on visitor engagement with museum content.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Abraham-Silver, L. (2006). Valuing informal science learning environments. The Science Teacher,73(1), 1–12.
Adams, M. (2012). Where have we been? What has changed? And where do we need to go next? Journal of Museum Education,37(2), 25–36.
Annetta, L., Minogue, J., Holmes, S., & Cheng, M. (2009). Investigating the impact of video games on high school students’ engagement and learning about genetics. Computers & Education,53(1), 74–85.
Apley, A., Frankel, S., Goldman, E., & Streitburger, K. (2011). Supporting Museums–serving communities: An evaluation of the Museums for America Program. Full Report. Institute of Museum and Library Services.
Barab, S., Arici, A., & Jackson, C. (2005). Eat your vegetables and do your homework: A design-based investigation of enjoyment and meaning in learning. Educational technology,65, 15–21.
Bickmore, T., Pfeifer, L., & Schulman, D. (2011). Relational agents improve engagement and learning in science museum visitors. In Proceedings of the 10th International Conference on Intelligent Virtual Agents, IVA’11 (pp. 55–67). Berlin, Heidelberg: Springer.
Bickmore, T. W., Vardoulakis, L. M. P., & Schulman, D. (2013). Tinker: A relational agent museum guide. Autonomous Agents and Multi-Agent Systems,27(2), 254–276.
Bogost, I. (2011). How to do things with videogames. Minneapolis, MN: University of Minnesota Press.
Cassell, J., & Jenkins, H. (Eds.). (2000). From barbie to mortal kombat. Cambridge, MA: The MIT Press.
Clark, D., Nelson, B., Sengupta, P., & D’Angelo, C. (2009). Rethinking science learning through digital games and simulations: genres, examples, and evidence. An NAS commissioned paper. Learning Science: Computer games, simulations, and education.
Clark, D. B., Virk, S., Sengupta, P., Brady, C., Martinez-Garza, M., Krinks, K., et al. (2016). SURGE’s evolution deeper into formal representations: The siren’s call of popular game-play mechanics. International Journal of Designs for Learning.,7(1), 107–146.
Converse, J. M., & Presser, S. (1986). Survey questions: Handcrafting the standardized questionnaire. Newbury Park, CA: Sage Publications.
Dickey, M. D. (2005). Engaging by design: How engagement strategies in popular computer and video games can inform instructional design. Education Training Research and Development,53(2), 67–83.
Dillman, D. A., Smyth, J. D., & Christian, L. M. (2014). Internet, mail, and mixed-mode surveys: The tailored design method. Hoboken, NJ: Wiley.
Edery, D., & Mollick, E. (2009). Changing the Game: How video games are transforming the future of business. New Jersey: FT Press.
Eshach, H. (2007). Bridging in-school and out-of-school learning: Formal, non-formal, and informal education. Journal of Science Education and Technology,16(2), 171–190.
Falk, J. H., Storksdieck, M., & Dierking, L. D. (2007). Investigating public science interest and understanding: evidence for the importance of free-choice learning. Public Understanding of Science,16(4), 455–469.
Federation of American Scientists. (2006). Summit on educational games: Harnessing the power of video games for learning. Washington, DC. Retrieved from https://fas.org/programs/ltp/policy_and_publications/summit/Summit%20on%20Educational%20Games.pdf.
Freeman, A., Adams Becker, S., Cummins, M., McKelroy, E., Giesinger, C., & Yuhnke, B. (2016). NMC Horizon report: 2016 (Museum ed.). Austin, Texas: The New Media Consortium.
Gee, J. P. (2003). What video games have to teach us about learning and literacy. New York: Palgrave Macmillan.
Gehlbach, H., Brown, S. W., Ioannou, A., Boyer, M. A., Hudson, N., Niv-Solomon, A.,… & Janik, L. (2008). Increasing interest in social studies: Social perspective taking and self-efficacy in stimulating simulations. Contemporary Educational Psychology, 33(4), 894–914.
Gerber, B. L., Cavallo, A. M., & Marek, E. A. (2001). Relationships among informal learning environments, teaching procedures and scientific reasoning ability. International Journal of Science Education,23(5), 535–549.
Ha, J., Pérez Cortés, L., Su, M., Nelson, B., Bowman, C., & Bowman, J. (in preparation). Group inquiry and engagement in museums using ask Dr. Discovery.
Hartmann, T., & Klimmt, C. (2006). Gender and computer games: Exploring females’ dislikes. Journal of Computer-Mediated Communication,11(4), 910–931.
Hayes, E. (2005). Women and videogaming: Gendered identities at play. Presented at the Games, Learning, and Society Conference, Madison, WI.
Hayes, E. (2008). Game content creation and IT proficiency: An exploratory study. Computers & Education,51(1), 97–108.
Smithsonian Institution. (2004). The evaluation of museum educational programs: A national perspective. Washington, DC: Office of Policy and Analysis, Smithsonian Institution.
Jenkins, H., Squire, K., & Tan, P. (2003). Entering the education arcade. ACM Computers in Entertainment,1(1), 1–11.
Johns, J., & Woolf, B. (2006, July). A dynamic mixture model to detect student motivation and proficiency. In Proceedings of the National Conference on Artificial Vol. 21, No. 1, p. 163). Menlo Park, CA; Cambridge, MA; London; AAAI Press; MIT Press; 1999.
Johnson, L., Adams, S., & Witchey, H. (2011). The NMC horizon report: 2011 (Museum ed.). Austin, TX: The New Media Consortium.
Johnson, L., Becker, S. A., Cummins, M., Estrada, V., Freeman, A., & Hall, C. (2016). NMC horizon report: 2016 higher (education ed., pp. 1–50). Austin: The New Media Consortium.
Joseph, E. (2005). Engagement tracing: using response times to model student disengagement. Artificial intelligence in education: Supporting learning through intelligent and socially informed technology,125, 88.
Kafai, Y. (2006). Playing and making games for learning: Instructionist and constructionist perspectives for game studies. Games and Culture,1(1), 36–40.
Katz, J. E., Goldman, K. H., & Foutz, S. (2011). Mobile phones for informal science center learning: A socio-technical analysis. na.
Ke, F. (2008). A case study of computer gaming for math: Engaged learning from gameplay? Computers & Education,51(4), 1609–1620.
Lane, H. C., Cahill, C., Foutz, S., Auerbach, D., Noren, D., Lussenhop, C., & Swartout, W. (2013). The Effects of a Pedagogical Agent for Informal Science Education on Learner Behaviors and Self-efficacy. In H. C. Lane, K. Yacef, J. Mostow, & P. Pavlik (Eds.) Artificial intelligence in education. AIED 2013. Lecture notes in computer science, vol 7926. Berlin: Springer.
Malone, T. W. (1981). Toward a theory of intrinsically motivating instruction. Cognitive Science,5(4), 333–369.
Martinez-Garza, M., Clark, D. B., & Nelson, B. (2013). Digital games and science learning: Research across the NRC strands of science proficiency. Studies in Science Education,49(2), 170–208.
McGonigal, J. (2011). Reality is broken. New York: Penguin Books.
Nelson, B., Bowman, C., & Bowman, J. (2017). Designing for data with ask Dr. Discovery: design approaches for facilitating museum evaluation with real-time data mining. Technology, Knowledge, and Learning.,22(3), 427–442.
Nelson, B., Erlandson, B., & Denham, A. (2011). Global channels for learning and assessment in complex game environments. British Journal of Educational Technology,42(1), 88–100.
Nelson, B., Kim, Y., & Slack, K. (2016). Visual signaling in a high-search virtual world-based assessment: A SAVE Science design study. Technology, Knowledge, and Learning.,21(2), 211–224.
Olson, K. (2010). An examination of questionnaire evaluation by expert reviewers. Field Methods,22(4), 295–318.
Pew Research Center. (2018). Mobile Fact Sheet. Retrieved July 16, 2018 from http://www.pewinternet.org/fact-sheet/mobile/.
Prensky, M. (2001). Digital game-based learning. New York: McGraw-Hill.
Proctor, N. (2015). Mobile in museums: From interpretation to conversation. The International Handbooks of Museum Studies,4(22), 499–525.
Ramsey-Gassert, L. (1997). Learning science beyond the classroom. The Elementary School Journal,97(4), 434–449.
Røtne, O., & Kaptelinin, V. (2013). Design choices and museum experience: A design-based study of a mobile museum app. In Human computer interaction (pp. 9–13). Springer, Berlin.
Rung, M. H., & Laursen, D. (2012). Adding to the experience: Use of smartphone applications by museum visitors. In The transformative museum proceedings, (pp. 314–324).
Shaffer, D. W. (2006). How computer games help children learn. New York: Palgrave McMillan.
Shavelson, R. J., & Towne, L. (2002). Scientific research in education. Committee on scientific principles for education research. Center for Education. Division of Behavioral and Social Sciences and Education. National Research Council. Washington, DC: National Academy Press.
Squire, K. (2011). Video games and learning: Teaching and participatory culture in the digital age. New York: Teachers College Press.
Steinkuehler, C. (2004). The literacy practices of massively multiplayer online gaming. Paper presented at the American Educational Research Association, San Diego, CA.
Steinkuehler, C., & Duncan, S. (2008). Scientific habits of mind in virtual worlds. Journal of Science and Technology,17(6), 530–543.
Vadeboncoeur, J. A. (2006). Engaging young people: Learning in informal contexts. Research in Education,30, 239–278.
Wellington, J. (1990). Formal and informal learning in science: Role of the interactive science centers. Physics Education,25, 247–253.
Funding
This work was supported by The National Science Foundation’s Directorate for Education and Human Resources [Grant Number 1438825].
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no conflict of interest.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Nelson, B.C., Bowman, C.D.D., Bowman, J.D. et al. Ask Dr. Discovery: the impact of a casual mobile game on visitor engagement with science museum content. Education Tech Research Dev 68, 345–362 (2020). https://doi.org/10.1007/s11423-019-09696-x
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11423-019-09696-x