Abstract
Mentoring promotes underserved students’ persistence in STEM but is difficult to scale up. Conversational virtual agents can help address this problem by conveying a mentor’s experiences to larger audiences. The present study examined college students’ \((N = 138)\) utilization of CareerFair.ai, an online platform featuring virtual agent-mentors that were self-recorded by sixteen real-life mentors and built using principles from the earlier MentorPal framework. Participants completed a single-session study which included 30 min of active interaction with CareerFair.ai, sandwiched between pre-test and post-test surveys. Students’ user experience and learning gains were examined, both for the overall sample and with a lens of diversity and equity across different, potentially underserved demographic groups. Findings included positive pre/post changes in intent to pursue STEM coursework and high user acceptance ratings (e.g., expected benefit, ease of use), with under-represented minority (URM) students giving significantly higher ratings on average than non-URM students. Self-reported learning gains of interest, actual content viewed on the CareerFair.ai platform, and actual learning gains were associated with one another, suggesting that the platform may be a useful resource in meeting a wide range of career exploration needs. Overall, the CareerFair.ai platform shows promise in scaling up aspects of mentoring to serve the needs of diverse groups of college students.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Appianing, J., Van Eck, R.N.: Development and validation of the value-expectancy stem assessment scale for students in higher education. Int. J. STEM Educ. 5(24) (2018)
Chelberg, K.L., Bosman, L.B.: The role of faculty mentoring in improving retention and completion rates for historically underrepresented STEM students. Int. J. High. Educ. 8(2), 39–48 (2019)
Chemers, M.M., Zurbriggen, E.L., Syed, M., Goza, B.K., Bearman, S.: The role of efficacy and identity in science career commitment among underrepresented minority students. J. Soc. Issues 67(3), 469–491 (2011)
Dawson, A.E., Bernstein, B.L., Bekki, J.M.: Providing the psychosocial benefits of mentoring to women in STEM: careerwise as an online solution. N. Dir. High. Educ. 2015(171), 53–62 (2015)
Domingo, C.R., et al.: More service or more advancement: institutional barriers to academic success for women and women of color faculty at a large public comprehensive minority-serving state university. J. Divers. High. Educ. 15(3), 365–379 (2022)
Fealing, K.H., Lai, Y., Myers, S.L., Jr.: Pathways vs. pipelines to broadening participation in the STEM workforce. J. Women Minorities Sci. Eng. 21(4), 271–293 (2015)
Mack, N.A., Cummings, R., Huff, E.W., Gosha, K., Gilbert, J.E.: Exploring the needs and preferences of underrepresented minority students for an intelligent virtual mentoring system. In: Stephanidis, C., Antona, M. (eds.) HCII 2019. CCIS, vol. 1088, pp. 213–221. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-30712-7_28
Martin-Hansen, L.: Examining ways to meaningfully support students in STEM. Int. J. STEM Educ. 5(1), 1–6 (2018)
McQuiggan, S.W., Rowe, J.P., Lee, S., Lester, J.C.: Story-based learning: the impact of narrative on learning experiences and outcomes. In: Woolf, B.P., Aïmeur, E., Nkambou, R., Lajoie, S. (eds.) ITS 2008. LNCS, vol. 5091, pp. 530–539. Springer, Heidelberg (2008). https://doi.org/10.1007/978-3-540-69132-7_56
Neely, A.R., Cotton, J., Neely, A.D.: E-mentoring: a model and review of the literature. AIS Trans. Hum.-Comput. Interact. 9(3), 220–242 (2017)
Nye, B., Swartout, W., Campbell, J., Krishnamachari, M., Kaimakis, N., Davis, D.: Mentorpal: Interactive virtual mentors based on real-life STEM professionals. In: Interservice/Industry Simulation, Training and Education Conference (2017)
Nye, B.D., et al.: Feasibility and usability of mentorpal, a framework for rapid development of virtual mentors. J. Res. Technol. Educ. 53(1), 1–23 (2020)
Okado, Y., Nye, B.D., Swartout, W.: Student acceptance of virtual agents for career-oriented mentoring: a pilot study for the careerfair.ai project. In: American Educational Research Association Annual Meeting (2023)
Reimers, N., Gurevych, I.: Sentence-BERT: sentence embeddings using Siamese BERT-networks. In: 9th EMNLP-IJCNLP Conference, pp. 3982–3992 (2019)
Saldana, J.: Fundamentals of Qualitative Research. Oxford University Press, Oxford (2011)
Swartout, W., et al.: Virtual humans for learning. AI Mag. 34(4), 13–30 (2013)
Traum, D., et al.: New dimensions in testimony: digitally preserving a holocaust survivor’s interactive storytelling. In: Schoenau-Fog, H., Bruni, L.E., Louchart, S., Baceviciute, S. (eds.) ICIDS 2015. LNCS, vol. 9445, pp. 269–281. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-27036-4_26
Venkatesh, V., Morris, M.G., Davis, G.B., Davis, F.D.: User acceptance of information technology: toward a unified view. MIS Q. 425–478 (2003)
Acknowledgments
This material is based upon work supported by the National Defense Education Program (NDEP) for Science, Technology, Engineering, and Mathematics (STEM) Education, Outreach, and Workforce Initiative Programs under Grant No. HQ0034-20-S-FO01. The views expressed in this publication do not necessarily reflect the official policies of the Department of Defense nor does mention of trade names, commercial practices, or organizations imply endorsement by the U.S. Government. We thank the CareerFair.ai project mentors, research assistants, and study participants.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Okado, Y., Nye, B.D., Aguirre, A., Swartout, W. (2023). Can Virtual Agents Scale Up Mentoring?: Insights from College Students’ Experiences Using the CareerFair.ai Platform at an American Hispanic-Serving Institution. In: Wang, N., Rebolledo-Mendez, G., Matsuda, N., Santos, O.C., Dimitrova, V. (eds) Artificial Intelligence in Education. AIED 2023. Lecture Notes in Computer Science(), vol 13916. Springer, Cham. https://doi.org/10.1007/978-3-031-36272-9_16
Download citation
DOI: https://doi.org/10.1007/978-3-031-36272-9_16
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-36271-2
Online ISBN: 978-3-031-36272-9
eBook Packages: Computer ScienceComputer Science (R0)