Skip to main content

Testing the Validity and Reliability of Intrinsic Motivation Inventory Subscales Within ASSISTments

  • Conference paper
  • First Online:
Artificial Intelligence in Education (AIED 2018)

Abstract

Online learning environments allow for the implementation of psychometric scales on diverse samples of students participating in authentic learning tasks. One such scale, the Intrinsic Motivation Inventory (IMI) can be used to inform stakeholders of students’ subjective motivational and regulatory styles. The IMI is a multidimensional scale developed in support of Self-Determination Theory [1,2,3], a strongly validated theory stating that motivation and regulation are moderated by three innate needs: autonomy, belonging, and competence. As applied to education, the theory posits that students who perceive volition in a task, those who report stronger connections with peers and teachers, and those who perceive themselves as competent in a task are more likely to internalize the task and excel. ASSISTments, an online mathematics platform, is hosting a series of randomized controlled trials targeting these needs to promote integrated learning. The present work supports these studies by attempting to validate four subscales of the IMI within ASSISTments. Iterative factor analysis and item reduction techniques are used to optimize the reliability of these subscales and limit the obtrusive nature of future data collection efforts. Such scale validation efforts are valuable because student perceptions can serve as powerful covariates in differentiating effective learning interventions.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 79.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 99.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Ryan, R.: Control and information in the intrapersonal sphere an extension of cognitive evaluation theory. J. Pers. Soc. Psychol. 43, 450–461 (1982)

    Article  Google Scholar 

  2. Ryan, R.M., Deci, E.L.: Self-determination theory and the facilitation of intrinsic motivation, social development, and well-being. Am. Psychol. 55, 68–78 (2000)

    Article  Google Scholar 

  3. Ryan, R.M., Deci, E.L.: An overview of self-determination theory. In: Deci, E.L., Ryan, R.M. (eds.) Handbook of Self-Determination Research. University of Rochester Press, Rochester (2002)

    Google Scholar 

  4. Brusilovsky, P., Millán, E.: User models for adaptive hypermedia and adaptive educational systems. In: Brusilovsky, P., Kobsa, A., Nejdl, W. (eds.) The Adaptive Web. LNCS, vol. 4321, pp. 3–53. Springer, Heidelberg (2007). https://doi.org/10.1007/978-3-540-72079-9_1

    Chapter  Google Scholar 

  5. Calvo, R.A., D’Mello, S.: Affect detection: an interdisciplinary review of models, methods, and their applications. IEEE Trans. Affect. Comput. 1(1), 18–37 (2010)

    Article  Google Scholar 

  6. Gray, G., McGuinness, C., Owende, P., Carthy, A.: A review of psychometric data analysis and application in modelling of academic achievement in tertiary education. J. Learn. Anal. 1(1), 75–106 (2014)

    Article  Google Scholar 

  7. Ryu, J., Baylor, A.L.: The psychometric structure of pedagogical agent persona. Tech. Inst. Cogn. Learn. 22, 291–314 (2005)

    Google Scholar 

  8. Santos, O.C., Kravcik, M., Boticario, J.G.: Preface to special issue on user modelling to support personalization in enhanced educational settings. Int. J. Artif. Intell. Educ. 26(3), 809–820 (2016)

    Article  Google Scholar 

  9. Intrinsic Motivation Inventory. http://selfdeterminationtheory.org/questionnaires/. Accessed 07 Feb 2018

  10. Deci, E., Vallerand, R., Pelletier, L., Ryan, R.: Motivation and education: the self-determination perspective. Educ. Psychol. 26, 325–346 (1991)

    Article  Google Scholar 

  11. McAuley, E., Duncan, T., Tammen, V.V.: Psychometric properties of the Intrinsic Motivation Inventory in a competitive sport setting: a confirmatory factor analysis. Res. Q. Exerc. Sport 60, 48–58 (1987)

    Article  Google Scholar 

  12. McAuley, E., Tammen, V.V.: The effects of subjective and objective competitive outcomes on intrinsic motivation. J. Sport Exerc. Psychol. 11, 84–93 (1989)

    Article  Google Scholar 

  13. Grolnick, W., Ryan, R.: Autonomy in children’s learning: an experimental and individual difference investigation. J. Pers. Soc. Psychol. 52, 890–898 (1987)

    Article  Google Scholar 

  14. Monteiro, V., Mata, L., Peixoto, F.: Intrinsic Motivation Inventory: psychometric properties in the context of first language and mathematics learning. Psicologia Reflexao e Critica 28(3), 434–443 (2015)

    Article  Google Scholar 

  15. Choi, J., Mogami, T., Medalia, A.: Intrinsic Motivation Inventory: an adapted measure for schizophrenia research. Schizophr. Bull. 36(5), 966–976 (2010)

    Article  Google Scholar 

  16. Williams, G.C., Deci, E.L.: Supporting autonomy to motivate glucose control in patients with diabetes. Diab. Care 21, 1644–1651 (1998)

    Article  Google Scholar 

  17. Ryan, R., Mims, V., Koestner, R.: Relation of reward and interpersonal context to intrinsic motivation: a review and test using Cognitive Evaluation Theory. J. Pers. Soc. Psychol. 45, 736–750 (1983)

    Article  Google Scholar 

  18. Deci, E., Eghrari, H., Patrick, B., Leone, D.: Facilitating internalization: the self-determination theory perspective. J. Pers. 62, 119–142 (1994)

    Article  Google Scholar 

  19. Filak, V., Sheldon, K.: Student psychological need satisfaction and college teacher-course evaluation. Educ. Psychol. 23, 235–247 (2003)

    Article  Google Scholar 

  20. Tsigilis, N., Theodosiou, A.: Temporal stability of the Intrinsic Motivation Inventory. Percept. Mot. Skills 97(1), 271–280 (2003)

    Article  Google Scholar 

  21. Heffernan, N., Heffernan, C.: The ASSISTments ecosystem: building a platform that brings scientists and teachers together for minimally invasive research on human learning and teaching. Int. J. Artif. Intell. Educ. 24(4), 470–497 (2014)

    Article  MathSciNet  Google Scholar 

  22. Ostrow, K.S., Heffernan, N.T., Williams, J.J.: Tomorrow’s edtech today: establishing a learning platform as a collaborative research tool for sound science. Teachers Coll. Rec. 119(3), 1–36 (2017)

    Google Scholar 

  23. Field, A.: Discovering statistics using IBM SPSS Statistics, 4th edn. SAGE Publications, London (2013)

    Google Scholar 

  24. Schell, K.L., Oswald, F.L.: Item grouping and item randomization in personality measurement. Pers. Individ. Differ. 55, 317–321 (2013)

    Article  Google Scholar 

  25. ASSISTments TestBed Resource Guide. https://www.assistmentstestbed.org. Accessed 06 Feb 2018

  26. Submission Data. https://osf.io/4gwuc/. Accessed 07 Feb 2018

Download references

Acknowledgments

We acknowledge funding from NSF grants (ACI-1440753, DRL-1252297, DRL-1109483, DRL-1316736, DGE-1535428, OAC-1724889, OAC-1636782 & DRL-1031398), the U.S. Department of Education (IES R305A120125 & R305C100024 and GAANN), the ONR, and the Gates Foundation. Thanks to S.O. & L.P.B.O.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Korinn S. Ostrow .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer International Publishing AG, part of Springer Nature

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Ostrow, K.S., Heffernan, N.T. (2018). Testing the Validity and Reliability of Intrinsic Motivation Inventory Subscales Within ASSISTments. In: Penstein Rosé, C., et al. Artificial Intelligence in Education. AIED 2018. Lecture Notes in Computer Science(), vol 10947. Springer, Cham. https://doi.org/10.1007/978-3-319-93843-1_28

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-93843-1_28

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-93842-4

  • Online ISBN: 978-3-319-93843-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics