Skip to main content

Experts’ View on Challenges and Needs for Fairness in Artificial Intelligence for Education

  • Conference paper
  • First Online:
Artificial Intelligence in Education (AIED 2022)

Abstract

In recent years, there has been a stimulating discussion on how artificial intelligence (AI) can support the science and engineering of intelligent educational applications. Many studies in the field are proposing actionable data mining pipelines and machine-learning models driven by learning-related data. The potential of these pipelines and models to amplify unfairness for certain categories of students is however receiving increasing attention. If AI applications are to have a positive impact on education, it is crucial that their design considers fairness at every step. Through anonymous surveys and interviews with experts (researchers and practitioners) who have published their research at top-tier educational conferences in the last year, we conducted the first expert-driven systematic investigation on the challenges and needs for addressing fairness throughout the development of educational systems based on AI. We identified common and diverging views about the challenges and the needs faced by educational technologies experts in practice, that lead the community to have a clear understanding on the main questions raising doubts in this topic. Based on these findings, we highlighted directions that will facilitate the ongoing research towards fairer AI for education.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 99.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 129.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    A pdf copy of the survey questions is available at https://bit.ly/FairAIEdSurvey.

References

  1. Abidi, S.M.R., Hussain, M., Xu, Y., Zhang, W.: Prediction of confusion attempting algebra homework in an intelligent tutoring system through machine learning techniques for educational sustainable development. Sustainability 11(1), 105 (2019)

    Article  Google Scholar 

  2. Abyaa, A., Khalidi Idrissi, M., Bennani, S.: Learner modelling: systematic review of the literature from the last 5 years. Educ. Tech. Res. Dev. 67(5), 1105–1143 (2019)

    Google Scholar 

  3. Alameda-Pineda, X., Redi, M., Otterbacher, J., Sebe, N., Chang, S.F.: FATE/MM 20: 2nd international workshop on fairness, accountability, transparency and ethics in multimedia. In: Proceedings of the 28th ACM International Conference on Multimedia, pp. 4761–4762 (2020)

    Google Scholar 

  4. Alboaneen, D., Almelihi, M., Alsubaie, R., Alghamdi, R., Alshehri, L., Alharthi, R.: Development of a web-based prediction system for students’ academic performance. Data 7(2), 21 (2022)

    Article  Google Scholar 

  5. Alsuliman, T., Humaidan, D., Sliman, L.: Ml and AI in the service of medicine: necessity or potentiality? Curr. Res. Transl. Med. 68(4), 245–251 (2020)

    Article  Google Scholar 

  6. Berendt, B., Littlejohn, A., Blakemore, M.: AI in education: learner choice and fundamental rights. Learn. Media Technol. 45(3), 312–324 (2020)

    Article  Google Scholar 

  7. Britto, J., Prabhu, S., Gawali, A., Jadhav, Y.: A machine learning based approach for recommending courses at graduate level. In: 2019 International Conference on Smart Systems and Inventive Technology (ICSSIT), pp. 117–121. IEEE (2019)

    Google Scholar 

  8. Caton, S., Haas, C.: Fairness in machine learning: a survey. arXiv preprint arXiv:2010.04053 (2020)

  9. Hajian, S., Bonchi, F., Castillo, C.: Algorithmic bias: from discrimination discovery to fairness-aware data mining. In: Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 2125–2126 (2016)

    Google Scholar 

  10. Holstein, K., Wortman Vaughan, J., Daumé III, H., Dudik, M., Wallach, H.: Improving fairness in machine learning systems: what do industry practitioners need? In: Proceedings of the 2019 CHI Conference on Human Factors in Computer Systems, pp. 1–16 (2019)

    Google Scholar 

  11. Iosifidis, V., Fetahu, B., Ntoutsi, E.: FAE: a fairness-aware ensemble framework. In: 2019 IEEE International Conference on Big Data (Big Data), pp. 1375–1380. IEEE (2019)

    Google Scholar 

  12. Liu, J., Eagan, J.: ADQDA: a cross-device affinity diagramming tool for fluid and holistic qualitative data analysis. Proc. ACM HC Interact. 5(ISS), 1–19 (2021)

    Google Scholar 

  13. Mehrabi, N., Morstatter, F., Saxena, N., Lerman, K., Galstyan, A.: A survey on bias and fairness in ML. ACM Comp. Surv. (CSUR) 54(6), 1–35 (2021)

    Article  Google Scholar 

  14. Mitchell, S., Potash, E., Barocas, S., D’Amour, A., Lum, K.: Prediction-based decisions and fairness: a catalogue of choices, assumptions, and definitions. arXiv preprint arXiv:1811.07867 (2018)

  15. Rastrollo-Guerrero, J.L., Gomez-Pulido, J.A., Duran-Dom., A.: Analyzing and predicting students’ performance by means of ml: a review. Appl. Sci. 10(3), 1042 (2020)

    Google Scholar 

  16. Renz, A., Hilbig, R.: Prerequisites for artificial intelligence in further education: identification of drivers, barriers, and business models of educational technology companies. Int. J. Educ. Technol. High. Educ. 17(1), 1–21 (2020). https://doi.org/10.1186/s41239-020-00193-3

    Article  Google Scholar 

  17. Shahbazi, Z., Byun, Y.C.: Toward social media content recommendation integrated with data science and ml approach for e-learners. Symmetry 12(11), 1798 (2020)

    Article  Google Scholar 

  18. Veale, M., Van Kleek, M., Binns, R.: Fairness and accountability design needs for algorithmic support in high-stakes public sector decision-making. In: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, pp. 1–14 (2018)

    Google Scholar 

  19. Verma, S., Rubin, J.: Fairness definitions explained. In: 2018 IEEE/ACM International Workshop on Software Fairness (FairWare), pp. 1–7. IEEE (2018)

    Google Scholar 

  20. Wang, J., Molina, M.D., Sundar, S.S.: When expert recommendation contradicts peer opinion: relative social influence of valence, group identity and artificial intelligence. Comput. Hum. Behav. 107, 106278 (2020)

    Article  Google Scholar 

Download references

Acknowledgments

Roberta Galici gratefully acknowledges the University of Cagliari for the financial support of her Ph.D. scholarship.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Roberta Galici .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2022 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Fenu, G., Galici, R., Marras, M. (2022). Experts’ View on Challenges and Needs for Fairness in Artificial Intelligence for Education. In: Rodrigo, M.M., Matsuda, N., Cristea, A.I., Dimitrova, V. (eds) Artificial Intelligence in Education. AIED 2022. Lecture Notes in Computer Science, vol 13355. Springer, Cham. https://doi.org/10.1007/978-3-031-11644-5_20

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-11644-5_20

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-11643-8

  • Online ISBN: 978-3-031-11644-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics