Skip to main content

Learning Association Between Learning Objectives and Key Concepts to Generate Pedagogically Valuable Questions

  • Conference paper
  • First Online:
Artificial Intelligence in Education (AIED 2021)

Abstract

It has been shown that answering questions contributes to students learning effectively. However, generating questions is an expensive task and requires a lot of effort. Although there has been research reported on the automation of question generation in the literature of Natural Language Processing, these technologies do not necessarily generate questions that are useful for educational purposes. To fill this gap, we propose QUADL, a method for generating questions that are aligned with a given learning objective. The learning objective reflects the skill or concept that students need to learn. The QUADL method first identifies a key concept, if any, in a given sentence that has a strong connection with the given learning objective. It then converts the given sentence into a question for which the predicted key concept becomes the answer. The results from the survey using Amazon Mechanical Turk suggest that the QUADL method can be a step towards generating questions that effectively contribute to students’ learning.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 69.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 89.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    https://oli.cmu.edu.

  2. 2.

    https://rajpurkar.github.io/SQuAD-explorer/.

References

  1. Rivers, M.L.: Metacognition about practice testing: a review of learners’ beliefs, monitoring, and control of test-enhanced learning. Educ. Psychol. Rev. (2020)

    Google Scholar 

  2. Pan, S.C., Rickard, T.C.: Transfer of test-enhanced learning: meta-analytic review and synthesis. Psychol. Bull. 144(7), 710–756 (2018)

    Article  Google Scholar 

  3. Koedinger, K.R., et al.: Learning is not a spectator sport: doing is better than watching for learning from a MOOC. In: Proceedings of the Second (2015) ACM Conference on Learning@ Scale (2015)

    Google Scholar 

  4. Kurdi, G., et al.: A systematic review of automatic question generation for educational purposes. Int. J. Artif. Intell. Educ. 30(1), 121–204 (2020)

    Article  Google Scholar 

  5. Pan, L., et al.: Recent advances in neural question generation. arXiv preprint arXiv:1905.08949 (2019)

  6. Rajpurkar, P., Jia, R., Liang, P.: Know what you don't know: Unanswerable questions for SQuAD. arXiv preprint arXiv:1806.03822 (2018)

  7. Trischler, A., et al.: Newsqa: A machine comprehension dataset. arXiv preprint arXiv:1611.09830 (2016)

  8. Bajaj, P., et al.: Ms marco: A human generated machine reading comprehension dataset. arXiv preprint arXiv:1611.09268 (2016)

  9. Welbl, J., Liu, N.F., Gardner, M.: Crowdsourcing multiple choice science questions. arXiv preprint arXiv:1707.06209 (2017)

  10. Wang, Z., et al.: QG-net: a data-driven question generation model for educational content. In: Proceedings of the Fifth Annual ACM Conference on Learning at Scale (2018)

    Google Scholar 

  11. Kim, Y., et al.: Improving neural question generation using answer separation. In: Proceedings of the AAAI Conference on Artificial Intelligence (2019)

    Google Scholar 

  12. Nema, P., et al.: Let's Ask Again: Refine Network for Automatic Question Generation. arXiv preprint arXiv:1909.05355 (2019)

  13. Yuan, X., et al.: Machine comprehension by text-to-text neural question generation. arXiv preprint arXiv:1705.02012 (2017)

  14. Willis, A., et al.: Key phrase extraction for generating educational question-answer pairs. In: Proceedings of the Sixth (2019) ACM Conference on Learning@ Scale (2019)

    Google Scholar 

  15. Devlin, J., et al.: Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805 (2018)

Download references

Acknowledgements

The research reported here was supported by National Science Foundation Grant No. 2016966 and No. 1623702 to North Carolina State University.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Machi Shimmei .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2021 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Shimmei, M., Matsuda, N. (2021). Learning Association Between Learning Objectives and Key Concepts to Generate Pedagogically Valuable Questions. In: Roll, I., McNamara, D., Sosnovsky, S., Luckin, R., Dimitrova, V. (eds) Artificial Intelligence in Education. AIED 2021. Lecture Notes in Computer Science(), vol 12749. Springer, Cham. https://doi.org/10.1007/978-3-030-78270-2_57

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-78270-2_57

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-78269-6

  • Online ISBN: 978-3-030-78270-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics