Skip to main content
SpringerLink
Log in

Responsible Educational Technology Research: From Open Science and Open Data to Ethics and Trustworthy Learning Analytics

  • Chapter
  • First Online:
Data Cultures in Higher Education

Part of the book series: Higher Education Dynamics ((HEDY,volume 59))

Abstract

This chapter unfolds some elements of responsible research in the educational technology field and provides examples about how these elements have been considered in initiatives by the Interactive and Distributed Technologies for Education (TIDE) research group at Universitat Pompeu Fabra in Barcelona. First, it focuses on open science, an ongoing movement that promotes, on the one hand, transparent and frequent open-access updates of the research progress and the collected data and, on the other hand, reproducible, accurate, and verifiable research, bringing benefits for the individual researchers, the research community, and the society. Second, the chapter discusses ethics perspectives in educational technology research, relevant when collecting and sharing data and also in the design and development of technologies, especially when they are based on data analytics or artificial intelligence techniques. The latter aspects relate to the capacity of educational software systems to support human agency and preserve human well-being.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  • Amarasinghe, I., & Hernández-Leo, D. (2021). Synergies between humans and machines to support the orchestration of CSCL scripts at different scales (pp. 279–280). Proceedings of the 14th International Conference on Computer-Supported Collaborative Learning.

    Google Scholar 

  • Amarasinghe, I., Hernández-Leo, D., & Hoppe, H. U. (2021). Deconstructing orchestration load – Comparing teacher support through mirroring and guiding. International Journal of Computer-Supported Collaborative Learning, 16, 307–338.

    Article  Google Scholar 

  • Beardsley, M. (2017). PsychoPy implementation of a multiple-list learning task (version V1) [data set]. Zenodo. https://doi.org/10.5281/zenodo.1120260

    Book  Google Scholar 

  • Beardsley, M., Vujovic, M., & Sayis, B. (2017). Open data for a multiple wordlist learning task (version V1) [data set]. Zenodo. https://doi.org/10.5281/zenodo.1123478

    Book  Google Scholar 

  • Beardsley, M., Hernández-Leo, D., & Ramirez-Melendez, R. (2018). Seeking reproducibility: Assessing a multimodal study of the testing effect. Journal of Computer Assisted Learning, 34(4), 378–386.

    Article  Google Scholar 

  • Beardsley, M., Santos, P., Hernández-Leo, D., & Michos, K. (2019). Ethics in educational technology research: Informing participants on data sharing risks. British Journal of Educational Technology, 50(3), 1019–1034.

    Article  Google Scholar 

  • Beardsley, M., Martínez Moreno, J., Vujovic, M., Santos, P., & Hernández-Leo, D. (2020). Enhancing consent forms to support participant decision making in multimodal learning data research. British Journal of Educational Technology, 51(5), 1631–1652.

    Article  Google Scholar 

  • Brody, B. A. (1998). The ethics of biomedical research: An international perspective. Oxford University Press.

    Google Scholar 

  • Burr, C., Taddeo, M., & Floridi, L. (2020). The ethics of digital well-being: A thematic review. Science and Engineering Ethics, 26, 2313–2343. https://doi.org/10.1007/s11948-020-00175-8

    Article  Google Scholar 

  • Campbell, F. A., Goldman, B. D., Boccia, M. L., & Skinner, M. (2004). The effect of format modifications and reading comprehension on recall of informed consent information by low-income parents: A comparison of print, video, and computer-based presentations. Patient Education and Counseling, 53(2), 205–216.

    Article  Google Scholar 

  • Carp, J. (2012). The secret lives of experiments: Methods reporting in the fMRI literature. NeuroImage, 63(1), 289–300.

    Article  Google Scholar 

  • Clow, D. (2012). The learning analytics cycle: Closing the loop effectively (pp. 134–138). Proceedings of the 2nd International Conference on Learning Analytics and Knowledge.

    Google Scholar 

  • Cormack, A. N. (2016). Downstream consent: A better legal framework for big data. Journal of Information Rights, Policy and Practice, 1(1).

    Google Scholar 

  • Corrin, L., De Barba, P. G., Lockyear, L., Gašević, D., Williams, D., Dawson, S., Mulder, R., Copeland, S., & Bakharia, A. (2016). Completing the loop: Returning meaningful learning analytic data to teachers. Australian Government Office for Learning and Teaching.

    Google Scholar 

  • Dantcheva, A., Elia, P., & Ross, A. (2015). What else does your biometric data reveal? A survey on soft biometrics. IEEE Transactions on Information Forensics and Security, 11(3), 441–467.

    Article  Google Scholar 

  • Drachsler, H., & Greller, W. (2016). Privacy and analytics: It’s a DELICATE issue: A checklist for trusted learning analytics (pp. 89–98). Proceedings of the 6th international conference on learning analytics & knowledge.

    Google Scholar 

  • Dranseika, V., Piasecki, J., & Waligora, M. (2017). Relevant information and informed consent in research: In defense of the subjective standard of disclosure. Science and Engineering Ethics, 23(1), 215–225.

    Article  Google Scholar 

  • EU. (2016). Regulation 2016/679 of the European Parliament and of the Council of 27 April 2016 on the protection of natural persons with regard to the processing of personal data and on the free movement of such data, and repealing Directive 95/46/EC (General Data Protection Regulation), OJ 2016 L 119/1 from http://ec.europa.eu/justice/data-protection/reform/files/regulation_oj_en.pdf

  • European Commission. (2015). Directorate-general for research and innovation, indicators for promoting and monitoring responsible research and innovation. Report from the Expert Group on policy indicators for responsible research and innovation, Publications Office. https://data.europa.eu/doi/10.2777/9742

    Google Scholar 

  • European Commission. (2019). Guidance: How to complete your ethics self-assessment. Retrieved February 17, 2021, from https://ec.europa.eu/research/participants/data/ref/h2020/grants_manual/hi/ethics/h2020_hi_ethics-self-assess_en.pdf

  • European Organization For Nuclear Research, OpenAIRE. (2013). Zenodo. https://doi.org/10.25495/7GXK-RD71

  • Faden, R. R., & Beauchamp, T. L. (1986). A history and theory of informed consent. Oxford University Press.

    Google Scholar 

  • Floridi, L. (2014). The onlife manifesto (pp. 264–313). Springer. https://doi.org/10.1007/978-3-319-04093-6_2

    Book  Google Scholar 

  • Flory, J., & Emanuel, E. (2004). Interventions to improve research participants’ understanding in informed consent for research: A systematic review. JAMA, 292(13), 1593–1601.

    Article  Google Scholar 

  • Franzoni, C., & Sauermann, H. (2014). Crowd science: The organization of scientific research in open collaborative projects. Research Policy, 43(1), 1–20.

    Article  Google Scholar 

  • Gallagher, M., Haywood, S. L., Jones, M. W., & Milne, S. (2010). Negotiating informed consent with children in school-based research: A critical review. Children and Society, 24(6), 471–482.

    Article  Google Scholar 

  • Guarino, P., Lamping, D. L., Elbourne, D., Carpenter, J., & Peduzzi, P. (2006). A brief measure of perceived understanding of informed consent in a clinical trial was validated. Journal of Clinical Epidemiology, 59(6), 608–614.

    Article  Google Scholar 

  • Hakami, E., & Hernandez-Leo, D. (2021). Investigating the wellbeing impacts of educational technologies supported by learning analytics: An application of the initial phase of IEEE P7010 recommended practice to a set of cases. Proceedings of the 11th International Conference on Learning Analytics & Knowledge. https://doi.org/10.1145/3448139.3448165

    Book  Google Scholar 

  • HLEG-AI (High-Level Expert Group on Artificial Intelligence). (2019). Ethics guidelines for trustworthy AI: Requirements of trustworthy AI. Retrieved July 05, 2021, from https://ec.europa.eu/futurium/en/ai-alliance-consultation/guidelines/1

  • Holmes, W., Iniesto, F., Sharples, M., & Scanlon, E. (2019). ETHICS in AIED: Who cares? An EC-TEL workshop (pp. 16–19). Proceedings of the 14th European Conference on Technology Enhanced Learning.

    Google Scholar 

  • IEEE Global Initiative on Ethics of Autonomous and Intelligent Systems. (2019). Ethically aligned design: A vision for prioritizing human well-being with autonomous and intelligent systems (1st ed.). IEEE. https://standards.ieee.org/content/ieee-standards/en/industry

    Google Scholar 

  • IEEE Recommended Practice for Assessing the Impact of Autonomous and Intelligent Systems on Human Well-Being. (2020). IEEE Std 7010–2020 (pp. 1–96). https://doi.org/10.1109/IEEESTD.2020.9084219

    Book  Google Scholar 

  • Ioannidis, J. P. (2018). Meta-research: Why research on research matters. PLoS Biology, 16(3), e2005468.

    Article  Google Scholar 

  • Joffe, S., Cook, E. F., Cleary, P. D., Clark, J. W., & Weeks, J. C. (2001). Quality of informed consent: A new measure of understanding among research subjects. Journal of the National Cancer Institute, 93(2), 139–147.

    Article  Google Scholar 

  • Kendeou, P., & O’Brien, E. J. (2016). Prior knowledge: Acquisition and revision. In P. Afflerbach (Ed.), Handbook of individual differences in reading: Text and context (pp. 151–163). Routledge Publishing.

    Google Scholar 

  • Kendeou, P., & Van Den Broek, P. (2007). The effects of prior knowledge and text structure on comprehension processes during reading of scientific texts. Memory & cognition, 35(7), 1567–1577.

    Google Scholar 

  • Koenig, J., Kemp, A. H., Beauchaine, T. P., Thayer, J. F., & Kaess, M. (2016). Depression and resting state heart rate variability in children and adolescents—A systematic review and meta-analysis. Clinical Psychology Review, 46, 136–150.

    Article  Google Scholar 

  • Krishna, V. V. (2020). Open Science and Its Enemies: Challenges for a Sustainable Science–Society Social Contract. Journal of Open Innovation: Technology, Market, and Complexity, 6(3), 61.

    Article  Google Scholar 

  • Lakens, D. (2013). Calculating and reporting effect sizes to facilitate cumulative science: A practical primer for t-tests and ANOVAs. Frontiers in Psychology, 4.

    Google Scholar 

  • Lin, H. (2007). The ethics of instructional technology: Issues and coping strategies experienced by professional technologists in design and training situations in higher education. Educational Technology Research and Development, 55(5), 411–437. https://doi.org/10.1007/s11423-006-9029-y

    Article  Google Scholar 

  • Lipson, M. Y. (1982). Learning new information from text: The role of prior knowledge and reading ability. Journal of Reading Behavior, 14(3), 243–261.

    Article  Google Scholar 

  • Lohr, S. (2012). The age of big data. New York Times, 11(2012).

    Google Scholar 

  • Makel, M. C., & Plucker, J. A. (2014). Facts are more important than novelty: Replication in the education sciences. Educational Researcher, 43(6), 304–316.

    Article  Google Scholar 

  • Manathunga, K., & Hernández-Leo, D. (2016a). PyramidApp configurations and participants behaviour dataset (version V1) [data set]. Zenodo. https://doi.org/10.5281/zenodo.375555

    Book  Google Scholar 

  • Manathunga, K., & Hernández-Leo, D. (2016b). PyramidApp: Scalable method enabling collaboration in the classroom (pp. 422–427). Proceedings of the 11th European Conference on Technology Enhanced Learning.

    Google Scholar 

  • Mandava, A., Pace, C., Campbell, B., Emanuel, E., & Grady, C. (2012). The quality of informed consent: Mapping the landscape. A review of empirical data from developing and developed countries. Journal of Medical Ethics, 38(6), 356–365.

    Article  Google Scholar 

  • Martínez, J., Santos, P., & Hernández-Leo, D. (2021). Teachers’ self-perception in maker education: Three approaches for STEM professional development. Proceedings of the 21st IEEE International Conference on Advanced Learning Technologies, (Online).

    Google Scholar 

  • McDaniel, M. A., & Fisher, R. P. (1991). Tests and test feedback as learning sources. Contemporary Educational Psychology, 16(2), 192–201.

    Article  Google Scholar 

  • Merton, R. K. (1942). Science and technology in a democratic order. Journal of legal and political sociology, 1(1), 115–126.

    Google Scholar 

  • Michos, K., Hernández-Leo, D., & Albó, L. (2018a). Teacher-led inquiry in technology-supported school communities (version V1) [data set]. Zenodo. https://doi.org/10.5281/zenodo.1403643

    Book  Google Scholar 

  • Michos, K., Hernández-Leo, D., & Albó, L. (2018b). Teacher-led inquiry in technology-supported school communities. British Journal of Educational Technology, 49(6), 1077–1095.

    Article  Google Scholar 

  • Miller, F. G., & Wertheimer, A. (2011). The fair transaction model of informed consent: An alternative to autonomous authorization. Kennedy Institute of Ethics Journal, 21(3), 201–218.

    Article  Google Scholar 

  • Nishimura, A., Carey, J., Erwin, P. J., Tilburt, J. C., Murad, M. H., & McCormick, J. B. (2013). Improving understanding in the research informed consent process: A systematic review of 54 interventions tested in randomized control trials. BMC Medical Ethics, 14(1), 28.

    Article  Google Scholar 

  • Nissenbaum, H. (2011). A contextual approach to privacy online. Daedalus, 140(4), 32–48.

    Article  Google Scholar 

  • Nosek, B.A., Alter, G., Banks, G.C., Borsboom, D., Bowman, S., Breckler, S., Buck, S., Chambers, C., Chin, G., Christensen, G. & Contestabile, M. (2016). Transparency and openness promotion (TOP) guidelines.

    Book  Google Scholar 

  • Ochoa, X., Lang, A. C., & Siemens, G. (2017). Multimodal learning analytics. The Handbook of Learning Analytics, 1, 129–141.

    Article  Google Scholar 

  • Pastötter, B., Schicker, S., Niedernhuber, J., & Bäuml, K. H. T. (2011). Retrieval during learning facilitates subsequent memory encoding. Journal of Experimental Psychology: Learning, Memory, and Cognition, 37(2), 287.

    Google Scholar 

  • Peirce, J. W. (2009). Generating stimuli for neuroscience using PsychoPy. Frontiers in Neuroinformatics, 2, 10.

    Google Scholar 

  • Prieto, L. P., Sharma, K., Kidzinski, Ł., & Dillenbourg, P. (2018). Orchestration load indicators and patterns: In-the-wild studies using mobile eye-tracking. IEEE Transactions on Learning Technologies, 11(2), 216–229. https://doi.org/10.1109/TLT.2017.2690687

    Article  Google Scholar 

  • Prinsloo, P., & Slade, S. (2015). Student privacy self-management: Implications for learning analytics (pp. 83–92). Proceedings of the 5th International Conference on Learning Analytics and Knowledge.

    Google Scholar 

  • Raffaghelli, J. E., & Manca, S. (2019). Is there a social life in open data? The case of open data practices in educational technology research. Publications 2019, 7(1), 9. https://doi.org/10.3390/PUBLICATIONS7010009

    Article  Google Scholar 

  • Renard, Y., Lotte, F., Gibert, G., Congedo, M., Maby, E., Delannoy, V., Bertrand, O., & Lécuyer, A. (2010). Openvibe: An open-source software platform to design, test, and use brain–computer interfaces in real and virtual environments. Presence: teleoperators and virtual environments, 19(1), 35–53.

    Article  Google Scholar 

  • Roediger, H. L., & Karpicke, J. D. (2006). The power of testing memory: Basic research and implications for educational practice. Perspectives on Psychological Science, 1(3), 181–210.

    Article  Google Scholar 

  • RStudio Team. (2015). RStudio: Integrated development for R. RStudio, Inc. http://www.rstudio.com/

    Google Scholar 

  • Schenker, Y., Fernandez, A., Sudore, R., & Schillinger, D. (2011). Interventions to improve patient comprehension in informed consent for medical and surgical procedures: A systematic review. Medical Decision Making, 31(1), 151–173.

    Article  Google Scholar 

  • Schmidt, S. (2009). Shall we really do it again? The powerful concept of replication is neglected in the social sciences. Review of General Psychology, 13(2), 90–100.

    Article  Google Scholar 

  • Schwendimann, B. A., Rodriguez-Triana, M. J., Vozniuk, A., Prieto, L. P., Boroujeni, M. S., Holzer, A., et al. (2016). Perceiving learning at a glance: A systematic literature review of learning dashboard research. IEEE Transactions on Learning Technologies, 10(1), 30–41. https://doi.org/10.1109/TLT.2016.2599522

    Article  Google Scholar 

  • Shaffer, D. W., Collier, W., & Ruis, A. R. (2016). A tutorial on epistemic network analysis: Analyzing the structure of connections in cognitive, social, and interaction data. Journal of Learning Analytics, 3(3), 9–45. https://doi.org/10.18608/jla.2016.33.3

    Article  Google Scholar 

  • Siemens, G., & Gasevic, D. (2012). Guest editorial-learning and knowledge analytics. Educational Technology & Society, 15(3), 1–2.

    Google Scholar 

  • Slade, S., & Prinsloo, P. (2013). Learning analytics: Ethical issues and dilemmas. American Behavioral Scientist, 57(10), 1510–1529.

    Article  Google Scholar 

  • Soller, A., Martínez, A., Jermann, P., & Muehlenbrock, M. (2005). From mirroring to guiding: A review of state of the art technology for supporting collaborative learning. International Journal on Artificial Intelligence in Education, 15(1/2), 261–290.

    Google Scholar 

  • Stodden, V., McNutt, M., Bailey, D. H., Deelman, E., Gil, Y., Hanson, B., Heroux, M. A., Ioannidis, J. P., & Taufer, M. (2016). Enhancing reproducibility for computational methods. Science, 354(6317), 1240–1241.

    Article  Google Scholar 

  • Sugarman, J., Lavori, P. W., Boeger, M., Cain, C., Edson, R., Morrison, V., & Yeh, S. S. (2005). Evaluating the quality of informed consent. Clinical Trials, 2(1), 34–41.

    Article  Google Scholar 

  • UNESCO. (2015). Rethinking education. Towards a global common good? UNESCO. Retrieved October 28, 2015, from http://unesdoc.unesco.org/images/0023/002325/232555e.pdf

    Google Scholar 

  • van der Zee, T., & Reich, J. (2018). Open educational. Science. https://doi.org/10.17605/OSF.IO/D9BME

  • Vujovic, M., Amarasinghe, I., & Hernández-Leo, D. (2021). Studying collaboration dynamics in physical learning spaces: Considering the temporal perspective through epistemic network analysis. Sensors, 21(9), 2898.

    Article  Google Scholar 

  • Wise, A., & Cui, Y. (2018). Envisioning learning analytics for the learning sciences (pp. 1799–1806). Proceedings of the 13th International Conference of the Learning Sciences.

    Google Scholar 

  • Wise, A. F., & Jung, Y. (2019). Teaching with analytics: Towards a situated model of instructional decision-making. Journal of Learning Analytics, 6(2), 53–69.

    Article  Google Scholar 

  • World Health Organization. (2009). Research ethics committees: Basic concepts for capacity-building. World Health Organization.

    Google Scholar 

Download references

Acknowledgments

TIDE-UPF acknowledges the support from the National Research Agency of the Spanish Ministry of Science and Innovation (PID2020-112584RB-C33/MICIN/AEI/10.13039/501100011033) and previously from TIN2017-85179-C3-3-R, MDM-2015-0502, AGAUR (2017 SGR 1698). DHL (Serra Húnter) acknowledges the support by ICREA under the ICREA Acadèmia programme, PS by the Ramon y Cajal programme, and EH by Jazan University, Saudi Arabia.

Author information

Authors and Affiliations

  1. TIDE, ICT Department, Universitat Pompeu Fabra, Barcelona, Spain

    Davinia Hernández-Leo, Ishari Amarasinghe, Marc Beardsley, Eyad Hakami, Aurelio Ruiz García & Patricia Santos

Authors
  1. Davinia Hernández-Leo
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Ishari Amarasinghe
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Marc Beardsley
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Eyad Hakami
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Aurelio Ruiz García
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Patricia Santos
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Davinia Hernández-Leo .

Editor information

Editors and Affiliations

  1. Universitat Oberta de Catalunya, Barcelona, Spain

    Juliana E. Raffaghelli

  2. Universitat Oberta de Catalunya, Barcelona, Spain

    Albert  Sangrà

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Hernández-Leo, D., Amarasinghe, I., Beardsley, M., Hakami, E., García, A.R., Santos, P. (2023). Responsible Educational Technology Research: From Open Science and Open Data to Ethics and Trustworthy Learning Analytics. In: Raffaghelli, J.E., Sangrà, A. (eds) Data Cultures in Higher Education . Higher Education Dynamics, vol 59. Springer, Cham. https://doi.org/10.1007/978-3-031-24193-2_7

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-24193-2_7

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-24192-5

  • Online ISBN: 978-3-031-24193-2

  • eBook Packages: EducationEducation (R0)

Publish with us

Policies and ethics

Search

Navigation