Abstract
This study presents a learning-oriented assessment experience and examines the impact of communication and relationships on student satisfaction and on the acceptance of self- and peer-assessment. To this end, an analysis was conducted based on the data collected from engineering students in a subject with a high degree of creativity. The answers of online surveys (n = 180) were examined by using the structural equation modelling technique (SEM). The results indicate that effective, frequent, and timely communication and quality relationships play an important role in ensuring that formative assessment, based on teamwork, feedback and self- and peer-assessment, is perceived as easy to implement and useful for learning and skills development, which also increases student satisfaction. In addition, these perceptions have an important impact on students' acceptance of self- and peer-assessment, although students show more confidence in the teacher's judgement and concern about the validity and reliability of their peers' marks.
Similar content being viewed by others
Data availability
The data that support the findings of this study are available from the corresponding author upon reasonable request.
References
Altinay, Z. (2017). Evaluating peer learning and assessment in online collaborative learning environments. Behaviour & Information Technology, 36(3), 312–320. https://doi.org/10.1080/0144929X.2016.1232752
Ashfaq, M., Yun, J., Waheed, A., Khan, M. S., & Farrukh, M. (2019). Customers’ Expectation, Satisfaction, and Repurchase Intention of Used Products Online: Empirical Evidence From China. SAGE Open, 9(2). https://doi.org/10.1177/2158244019846212
Bartholomew, S. R., Zhang, L., Garcia Bravo, E., & Strimel, G. J. (2019). A tool for formative assessment and learning in a graphics design course: Adaptive comparative judgement. The Design Journal, 22(1), 73–95.
Carless, D. (2006). Differing perceptions in the feedback process. Studies in Higher Education, 31(2), 219–233.
Carless, D. (2009). Trust, distrust and their impact on assessment reform. Assessment & Evaluation in Higher Education, 34(1), 79–89. https://doi.org/10.1080/02602930801895786
Carmines, E. G., & Zeller, R. A. (1979). Reliability and validity assessment. Sage Publications.
Champoux, J. E. (2010). Organizational behavior: Integrating individuals, groups, and organizations. Routledge.
Checa, C., De-Pablos-Heredero, C., Torres, Y. G., Montes-Botella, J. L., Barba, C., & García, A. (2020). Focused coordination models towards sustainability in higher education case of quevedo state technical university (ecuador). Sustainability, 12(14), 5760.
Chen, X., Xu, X., Wu, Y. J., & Pok, W. F. (2022). Learners’ Continuous Use Intention of Blended Learning: TAM-SET Model. Sustainability, 14(24), 16428. https://doi.org/10.3390/su142416428
Chin, W. W. (1998). The partial least squares approach to structural equation modeling. Modern Methods for Business Research, 295(2), 295–336.
Chiu, C. M., Hsu, M. H., Sun, S. Y., Lin, T. C., & Sun, P. C. (2005). Usability, quality, value and e-learning continuance decisions. Computers & Education, 45(4), 399–416. https://doi.org/10.1016/j.compedu.2004.06.001
Davis, F. D. (1989). Perceived usefulness, perceived ease of use, and user acceptance of information technology. Mis Quarterly, 13(3), 319–340. https://doi.org/10.2307/249008
Dikici, A. (2009). An application of digital portfolio with the peer, self and instructor assessments in art education. Online Submission. https://eric.ed.gov/?id=ED565161
Dong H., Wang, H., Han, J. (2022) Understanding Ecological Agricultural Technology Adoption in China Using an Integrated Technology Acceptance Model—Theory of Planned Behavior Model, Frontiers Environmental Science. Environmental Economics and Management, 10. https://doi.org/10.3389/fenvs.2022.927668
Estriegana, R., Medina-Merodio, J. A., & Barchino, R. (2019). Student acceptance of virtual laboratory and practical work: An extension of the technology acceptance model. Computers & Education, 135, 1–14. https://doi.org/10.1016/j.compedu.2019.02.010
Estriegana, R., Medina, J. A., Robina-Ramirez, R., & Barchino, R. (2021). Analysis of Cooperative Skills Development through Relational Coordination in a Gamified Online Learning Environment. Electronics, 10(16), 2032. https://doi.org/10.3390/electronics10162032
Falk, R. F., & Miller, N. B. (1992). A primer for soft modeling. University of Akron Press. https://psycnet.apa.org/record/1992-98610-000
Fathi, M., Ghobakhloo, M., & Syberfeldt, A. (2019). An interpretive structural modeling of teamwork training in higher education. Education Sciences, 9(1), 16.
Fornell, C., & Larcker, D. F. (1981). Evaluating structural equation models with unobservable variables and measurement error. Journal of Marketing Research, 18(1), 39–50. https://doi.org/10.2307/3151312
George, D., & Mallery, P. (2003). SPSS for Windows step by step: A simple guide and reference. 11.0 update (4th ed., p. 231). Boston: Allyn & Bacon.
Gittell, J. H. (2002). Coordinating mechanisms in care provider groups: Relational coordination as a mediator and input uncertainty as a moderator of performance effects. Management Science, 48(11), 1408–1426.
Gittell, J. H. (2009). High performance healthcare: Using the power of relationships to achieve quality, efficiency and resilience. McGraw-Hill.
Hair Jr, J., Hult, G. T. M., Ringle, C. M., & Sarstedt, M. (2016). A primer on partial least squares structural equation modeling (PLS-SEM). Sage Publications.
Hassell, D., & Yuch, L. (2020) International journal of innovative teaching and learning in higher education, 1(1) 1–17. https://doi.org/10.4018/IJITLHE.2020010104.
Henseler, J., Ringle, C. M., & Sarstedt, M. (2015). A new criterion for assessing discriminant validity in variance-based structural equation modeling. Journal of the Academy of Marketing Science, 43(1), 115–135.
Hernández, H. A., & Pascual Barrera, A. E. (2018). Validation of a research instrument for the design of a selfassessment methodology for the environmental management system. Revista de investigación agraria y ambiental, 9(1), 157–163.
Hulland, J. (1999). Use of partial least squares (PLS) in strategic management research: A review of four recent studies. Strategic Management Journal, 20(2), 195–204.
Hwang, G. J., & Chang, S. C. (2021). Facilitating knowledge construction in mobile learning contexts: A bi-directional peer-assessment approach. British Journal of Educational Technology, 52(1), 337–357.
Ibarra Saiz, M. S., Rodriguez Gomez, G., & Gomez Ruiz, M. A. (2012). Benefits of peer assessment and strategies for its practice at university. Revista De Educación, 359, 206–231.
Ibarra-Sáiz, M. S., Rodríguez-Gómez, G., & Boud, D. (2020). Developing student competence through peer assessment: The role of feedback, self-regulation and evaluative judgement. Higher Education, 80, 137–156. https://doi.org/10.1007/s10734-019-00469-2
Liu, N., & Carless, D. (2006). Peer feedback: The learning element of peer assessment. Teaching in Higher Education, 11(3), 279–290.
Lohmann, G., Pratt, M. A., Benckendorff, P., Strickland, P., Reynolds, P., & Whitelaw, P. A. (2019). Online business simulations: Authentic teamwork, learning outcomes, and satisfaction. Higher Education, 77(3), 455–472. https://doi.org/10.1007/s10734-018-0282-x
Ma, T., Li, Y., Yuan, H., Li, F., Yang, S., Zhan, Y., ... & Mu, D. (2023). Reflection on the teaching of student-centred formative assessment in medical curricula: an investigation from the perspective of medical students. BMC Medical Education, 23(1), 1–10.
Margalina, V., De-Pablos-Heredero, C., & Montes Botella, J. L. (2015). Achieving job satisfaction for instructors in E-learning: The relational coordination role. International Journal of Human Capital and Information Technology Professionals, 6(4), 64–79. https://doi.org/10.4018/IJHCITP.2015100104
Margalina, V., De-Pablos-Heredero, C., & Luis Montes-Botella, J. (2017). Achieving quality in e-learning through relational coordination. Studies in Higher Education, 42(9), 1655–1670. https://doi.org/10.1080/03075079.2015.1113953
Nunnally, J. C., & Bernstein, I. H. (1994). Psychometric Theory New York. NY: McGraw-Hill.
O’Leary, Z. (2017). The essential guide to doing your research project. London: SAGE Publications Ltd.
Panadero, E., & Jonsson, A. (2013). The use of scoring rubrics for formative assessment purposes revisited: A review. Educational Research Review, 9, 129–144. https://doi.org/10.1016/j.edurev.2013.01.002
Rakoczy, K., Pinger, P., Hochweber, J., Klieme, E., Schütze, B., & Besser, M. (2019). Formative assessment in mathematics: Mediated by feedback’s perceived usefulness and students’ self-efficacy. Learning and Instruction, 60, 154–165. https://doi.org/10.1016/j.learninstruc.2018.01.004
Ramdeo, S., Balwant, P., & Fraser, S. H. (2022). Not another team assignment! Student perceptions towards teamwork at university management programs. Higher Education, Skills and Work-Based Learning, 12(6), 1122–1137.
Sanchez, M. C., De PablosHeredero, C., & Medina Merodio, J. A. (2015). Relational coordination in online education. Interciencia, 40(12), 869–874.
Sanchez, G., del Carmen, M., De PablosHeredero, C., Medina Merodio, J. A., Robina-Ramirez, R., & Fernandez-Sanz, L. (2021). Relationships among relational coordination dimensions: Impact on the quality of education online with a structural equations model. Technological Forecasting and Social Change, 166, 120608. https://doi.org/10.1016/j.techfore.2021.120608
Seviour, M. (2015). Assessing academic writing on a pre-sessional EAP course: Designing assessment which supports learning. Journal of English for Academic Purposes, 18, 84–89.
Stiggins, R. (2006). Assessment for learning: A key to motivation and achievement. Edge: The Latest Information for the Education Practitioner, 2(2), 1–19.
Thompson, J., Teba, T., & Braglia, R. (2021). Qualified satisfaction: First-year architecture student perceptions of teamwork. International Journal of Art & Design Education, 40(1), 146–164. https://doi.org/10.1111/jade.12342
Topping, K. J. (2009). Peer assessment. Theory into Practice, 48(1), 20–27. https://doi.org/10.1080/00405840802577569
Venkatesh, V., & Davis, F. D. (2000). A theoretical extension of the technology acceptance model: Four longitudinal field studies. Management Science, 46(2), 186–204.
Wagner, M. L., Suh, D. C., & Cruz, S. (2011). Peer- and self-grading compared to faculty grading. American Journal of Pharmaceutical Education, 75(7), 130.
Wanner, T., & Palmer, E. (2018). Formative self-and peer assessment for improved student learning: The crucial factors of design, teacher participation and feedback. Assessment & Evaluation in Higher Education, 43(7), 1032–1047. https://doi.org/10.1080/02602938.2018.1427698
Werts, C. E., Linn, R. L., & Jöreskog, K. G. (1974). Intraclass reliability estimates: Testing structural assumptions. Educational and Psychological Measurement, 34(1), 25–33.
Zhang, S., Li, H., Wen, Y., Zhang, Y., Guo, T., & He, X. (2023). Exploration of a group assessment model to foster student teachers’ critical thinking. Thinking Skills and Creativity, 47, 101239.
Zhou, J., Zheng, Y., & Tai, J. H. (2020). Grudges and gratitude: The social-affective impacts of peer assessment. Assessment & Evaluation in Higher Education, 45(3), 345–358. https://doi.org/10.1080/02602938.2019.1643449
Author information
Authors and Affiliations
Corresponding authors
Ethics declarations
Conflict of interest
None.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Estriegana, R., Teixeira, A.M., Robina-Ramirez, R. et al. Impact of communication and relationships on student satisfaction and acceptance of self- and peer-assessment. Educ Inf Technol (2024). https://doi.org/10.1007/s10639-023-12276-5
Received:
Accepted:
Published:
DOI: https://doi.org/10.1007/s10639-023-12276-5