Skip to main content
SpringerLink
Log in

AppleTree system for effective computer-supported collaborative argumentation: an exploratory study

  • Development Article
  • Published:
Educational technology research and development Aims and scope Submit manuscript

Abstract

Nurturing twenty-first-century competency is one important agenda in this era, especially in developing collaborative learning and critical thinking skills. Yet, facilitating such a computer-supported collaborative learning (CSCL) environment is challenging. Although several technological platforms from past research studies were developed to support collaborative learning, having a system that comprises a collaboration script, and graph-based workspaces to facilitate explicit externalization of cognitive processes, at the same time, armed with learning analytics to monitor the collaboration and cognitive processes is rare. In this paper, the AppleTree system is presented to illustrate three unique features. Firstly, the AppleTree system is designed with a graph-based workspace to facilitate explicit externalization of knowledge co-constructions and argumentation. Secondly, the system is embedded with a four-phased switch to structure the CSCL process. Thirdly, the system possesses real-time learning analytics, including contribution counts, social network analysis, and the learning artifacts’ argumentation structure to promote the development of arguments. An exploratory case study was conducted to examine the design of the AppleTree system in an authentic classroom. Empirical findings showed that the AppleTree system helped regulate effective collaboration and supported learners in developing strong arguments. These results could address the social participation and interaction issues related to collaborative learning and enable the development of students’ argumentation skills. The implications of the study to educational technology and the CSCL research field are discussed.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18
Fig. 19

Similar content being viewed by others

Data availability

The data is not available due to the IRB's restrictions.

References

  • Anagün, ŞS. (2018). Teachers’ perceptions about the relationship between 21st century skills and managing constructivist learning environments. International Journal of Instruction, 11(4), 825–840. https://doi.org/10.12973/iji.2018.11452a

    Article  Google Scholar 

  • Aronson, E., Stephan, C., Sikes, J., Blaney, N., & Snapp, M. (1978). The Jigsaw classroom. CA Sage Publication.

    Google Scholar 

  • Asiksoy, G., & Ozdamli, F. (2017). An overview to research on education technology based on constructivist learning approach. Cypriot Journal of Educational Sciences, 12(3), 133–147.

    Google Scholar 

  • Belgiorno, F., Manno, I., Palmieri, G., & Scarano, V. (2010). Argumentation tools in a collaborative development environment. In Cooperative Design, Visualization, and Engineering: 7th International Conference, CDVE 2010, Calvia, Mallorca, Spain, September 19–22, 2010. Proceedings, (pp. 39–46).

  • Besnard, P., & Hunter, A. (2008). Elements of Argumentation. MIT press.

    Google Scholar 

  • Borge, M., & Mercier, E. (2019). Towards a micro-ecological approach to CSCL. International Journal of Computer-Supported Collaborative Learning, 14, 219–235.

    Google Scholar 

  • Bote-Lorenzo, M. L., Gómez-Sánchez, E., Vega-Gorgojo, G., Dimitriadis, Y. A., Asensio-Pérez, J. I., & Jorrín-Abellán, I. M. (2008). Gridcole: A tailorable grid service based system that supports scripted collaborative learning. Computers & Education, 51(1), 155–172.

    Google Scholar 

  • Bouyias, Y., & Demetriadis, S. (2012). iArgue: A web-based argumentation environment integrating collaboration scripting support and flexible fading techniques. Educational Technologies for Teaching Argumentation Skills. https://doi.org/10.2174/978160805015411201010198

    Article  Google Scholar 

  • Carson, J. G., & Nelson, G. L. (1996). Chinese students’ perceptions of ESL peer response group interaction. Journal of Second Language Writing, 5(1), 1–19.

    Google Scholar 

  • Cen, L., Ruta, D., Powell, L., Hirsch, B., & Ng, J. (2016). Quantitative approach to collaborative learning: Performance prediction, individual assessment, and group composition. International Journal of Computer-Supported Collaborative Learning, 11, 187–225.

    Google Scholar 

  • Chai, C. S., Koh, J. H. L., & Tsai, C. C. (2013). A review of technological pedagogical content knowledge. Journal of Educational Technology & Society, 16(2), 31–51.

    Google Scholar 

  • Chang, C. C., Tseng, K. H., & Lou, S. J. (2012). A comparative analysis of the consistency and difference among teacher-assessment, student self-assessment and peer-assessment in a Web-based portfolio assessment environment for high school students. Computers & Education, 58(1), 303–320.

    Google Scholar 

  • Chen, J., Wang, M., Kirschner, P. A., & Tsai, C. C. (2018). The role of collaboration, computer use, learning environments, and supporting strategies in CSCL: A meta-analysis. Review of Educational Research, 88(6), 799–843.

    Google Scholar 

  • Chen, W. (2023). Reframing and redesigning learning, assessment, and teacher professional development in a post-pandemic era. Learning: Research and Practice, 9(1), 1–3.

    Google Scholar 

  • Chen, W., Pi, Z., Tan, S. H. J., & Lyu, Q. (2022). Preparing pre-service teachers for instructional innovation with ICT via co-design practice. Australasian Journal of Educational Technology., 38(5), 133–145.

    Google Scholar 

  • Chen, W., Tan, J. S., & Pi, Z. (2021). The spiral model of collaborative knowledge improvement: An exploratory study of a networked collaborative classroom. International Journal of Computer-Supported Collaborative Learning, 16(1), 7–35.

    Google Scholar 

  • Chi, M. T., & Wylie, R. (2014). The ICAP framework: Linking cognitive engagement to active learning outcomes. Educational Psychologist, 49(4), 219–243.

    Google Scholar 

  • Costaguta, R., Santana-Mansilla, P., Lescano, G., & Missio, D. (2019). Mining associations between collaborative skills and group roles in collaborative e-learning environments. Journal of Information Technology Research, 12(2), 159–174.

    Google Scholar 

  • Dado, M., & Bodemer, D. (2017). A review of methodological applications of social network analysis in computer-supported collaborative learning. Educational Research Review, 22, 159–180.

    Google Scholar 

  • De Groot, R., Drachman, R., Hever, R., Schwarz, B. B., Hoppe, U., Harrer, A., De Laat, M., Wegerif, R., McLaren, B. M., & Baurens, B. (2007). Computer supported moderation of E-discussions: the ARGUNAUT approach. Proceedings of the Conference on Computer Supported Collaborative Learning, 8, 165–167.

    Google Scholar 

  • Dillenbourg, P., & Hong, F. (2008). The mechanics of CSCL macro scripts. International Journal of Computer-Supported Collaborative Learning, 3(1), 5–23.

    Google Scholar 

  • Fahnestock, J., & Secor, M. (1988). The stases in scientific and literary argument. Written Communication, 5(4), 427–443.

    Google Scholar 

  • Häkkinen, P., & Mäkitalo-Siegl, K. (2007). Educational perspectives on scripting cscl. In F. Fischer, I. Kollar, H. Mandl, & J. M. Haake (Eds.), Scripting computer-supported collaborative learning: Cognitive, computational and educational perspectives. Springer. https://doi.org/10.1007/978-0-387-36949-5_15

    Chapter  Google Scholar 

  • Han, J., Kim, K. H., Rhee, W., & Cho, Y. H. (2021). Learning analytics dashboards for adaptive support in face-to-face collaborative argumentation. Computers & Education, 163, 104041.

    Google Scholar 

  • Hu, G., & Lam, S. T. E. (2010). Issues of cultural appropriateness and pedagogical efficacy: Exploring peer review in a second language writing class. Instructional Science, 38(4), 371–394.

    Google Scholar 

  • Jeong, H., Hmelo-Silver, C. E., & Jo, K. (2019). Ten years of computer-supported collaborative learning: A meta-analysis of CSCL in STEM education during 2005–2014. Educational Research Review, 28, 100284.

    Google Scholar 

  • Kaendler, C., Wiedmann, M., Rummel, N., & Spada, H. (2015). Teacher competencies for the implementation of collaborative learning in the classroom: A framework and research review. Educational Psychology Review, 27(3), 505–536.

    Google Scholar 

  • Kirschner, P. A., Buckingham-Shum, S. J., & Carr, C. S. (Eds.). (2012). Visualizing argumentation: Software tools for collaborative and educational sense-making. Springer Science & Business Media.

    Google Scholar 

  • Kuhn, D., & Udell, W. (2003). The development of argument skills. Child Development, 74(5), 1245–1260.

    Google Scholar 

  • Liesa-Orús, M., Latorre-Cosculluela, C., Vázquez-Toledo, S., & Sierra-Sánchez, V. (2020). The technological challenge facing higher education professors: Perceptions of ICT tools for developing 21st century skills. Sustainability, 12(13), 5339.

    Google Scholar 

  • Lin, W. C., & Yang, S. C. (2011). Exploring students’ perceptions of integrating Wiki technology and peer feedback into English writing courses. English Teaching: Practice and Critique, 10(2), 88–103.

    Google Scholar 

  • Liu, A. L., & Nesbit, J. C. (2020a). Dashboards for computer-supported collaborative learning. Machine learning paradigms (pp. 157–182). Springer.

    Google Scholar 

  • Liu, A. L., & Nesbit, J. C. (2020b). Dashboards for computer-supported collaborative learning. In M. Virvou, E. Alepis, G. A. Tsihrintzis, & L. C. Jain (Eds.), Machine learning paradigms: Advances in learning analytics (pp. 157–182). Springer International Publishing.

    Google Scholar 

  • Liu, F., Du, J., Zhou, D. Q., & Huang, B. (2021). Exploiting the potential of peer feedback: The combined use of face-to-face feedback and e-feedback in doctoral writing groups. Assessing Writing, 47, 100482.

    Google Scholar 

  • Loll, F., & Pinkwart, N. (2013). LASAD: Flexible representations for computer-based collaborative argumentation. International Journal of Human-Computer Studies, 71(1), 91–109.

    Google Scholar 

  • Lonchamp, J. (2012). An instrumental perspective on CSCL systems. International Journal of Computer-Supported Collaborative Learning, 7(2), 211–237.

    Google Scholar 

  • Martinez-Maldonado, R. (2019). A handheld classroom dashboard: Teachers’ perspectives on the use of real-time collaborative learning analytics. International Journal of Computer-Supported Collaborative Learning, 14(3), 383–411.

    Google Scholar 

  • McBride, R. E., Xiang, P., Wittenburg, D., & Shen, J. (2002). An analysis of preservice teachers’ dispositions toward critical thinking: A cross-cultural perspective. Asia-Pacific Journal of Teacher Education, 30(2), 131–140.

    Google Scholar 

  • McLaughlin, M. W., & Talbert, J. E. (2006). Building school-based teacher learning communities: Professional strategies to improve stu-dent achievement. Teacher College Press.

    Google Scholar 

  • Meyer, B. J., Wijekumar, K., Middlemiss, W., Hiy, K., Lei, P. W., Meier, C., & Spielvogel, J. (2010). Web-based tutoring of the structure strategy with or without elaborated feedback or choice for fifth-and seventh-grade readers. Reading Research Quarterly, 45(1), 62–92.

    Google Scholar 

  • Miller, M., & Hadwin, A. (2015). Scripting and awareness tools for regulating collaborative learning: Changing the landscape of support in CSCL. Computers in Human Behavior, 52, 573–588.

    Google Scholar 

  • Molinari, G., Chanel, G., Bétrancourt, M., Pun, T., & Bozelle, C. (2013). Emotion feedback during computer-mediated collaboration: effects on self-reported emotions and perceived interaction. In N. Rummel, M. Kapur, M. Nathan, & S. Puntambekar (Eds.), To see the world and a grain of sand: Learning across levels of space, time, and scale: CSCL 2013 Conference Proceedings (pp. 336–343). International Society of the Learning Sciences.

    Google Scholar 

  • Morris, J. A., Miller, B. W., Anderson, R. C., Nguyen-Jahiel, K. T., Lin, T. J., Scott, T., Zhang, J., Sun, J., & Ma, S. (2018). Instructional discourse and argumentative writing. International Journal of Educational Research, 90, 234–247.

    Google Scholar 

  • Nesbit, J., Niu, H., & Liu, Q. (2019). Cognitive tools for scaffolding argumentation: Maximizing student engagement, motivation, and learning. In O. Adesope & A. Rud (Eds.), Contemporary technologies in education (pp. 97–117). Palgrave Macmillan.

    Google Scholar 

  • Ng, C. F. (2021). The physical learning environment of online distance learners in higher education–a conceptual model. Frontiers in Psychology, 12, 4130.

    Google Scholar 

  • Noroozi, O., Weinberger, A., Biemans, H. J., Mulder, M., & Chizari, M. (2012). Argumentation-based computer supported collaborative learning (ABCSCL): A synthesis of 15 years of research. Educational Research Review, 7(2), 79–106.

    Google Scholar 

  • Nuere, S., & de Miguel, L. (2020). The digital/technological connection with Covid-19: An unprecedented challenge in university teaching. Technology Knowledge and Learning, 26(4), 931–943.

    Google Scholar 

  • Palinscar, A. S., & Brown, A. L. (1984). Reciprocal teaching of comprehension-fostering and comprehension-monitoring activities. Cognition and Instruction, 1(2), 117–175.

    Google Scholar 

  • Pauli, R., Mohiyeddini, C., Bray, D., Michie, F., & Street, B. (2008). Individual differences in negative group work experiences in collaborative student learning. Educational Psychology, 28(1), 47–58.

    Google Scholar 

  • Pifarré, M., Cobos, R., & Argelagós, E. (2014). Incidence of group awareness information on students’ collaborative learning processes. Journal of Computer Assisted Learning, 30(4), 300–317.

    Google Scholar 

  • Qin, J., & Karabacak, E. (2010). The analysis of Toulmin elements in Chinese EFL university argumentative writing. System, 38(3), 444–456.

    Google Scholar 

  • Reis, R. C. D., Isotani, S., Rodriguez, C. L., Lyra, K. T., Jaques, P. A., & Bittencourt, I. I. (2018). Affective states in computer-supported collaborative learning: Studying the past to drive the future. Computers & Education, 120, 29–50.

    Google Scholar 

  • Remedios, L., Clarke, D., & Hawthorne, L. (2008). The silent participant in small group collaborative learning contexts. Active Learning in Higher Education, 9(3), 201–216.

    Google Scholar 

  • Reznitskaya, A., Anderson, R. C., & Kuo, L. J. (2007). Teaching and learning argumentation. The Elementary School Journal, 107(5), 449–472.

    Google Scholar 

  • Rios, J. A., Ling, G., Pugh, R., Becker, D., & Bacall, A. (2020). Identifying critical 21st-century skills for workplace success: A content analysis of job advertisements. Educational Researcher, 49(2), 80–89.

    Google Scholar 

  • Rodríguez-Triana, M. J., Martínez-Monés, A., Asensio-Pérez, J. I., & Dimitriadis, Y. (2015). Scripting andmonitoring meet each other: Aligning learning analytics and learning design to support teachers inorchestrating CSCL situations. British Journal of Educational Technology, 46(2), 330–343. https://doi.org/10.1111/bjet.12198

    Article  Google Scholar 

  • Saqr, M., & López-Pernas, S. (2021). Modelling diffusion in computer-supported collaborative learning: A large scale learning analytics study. International Journal of Computer-Supported Collaborative Learning, 16(4), 441–483.

    Google Scholar 

  • Scardamalia, M., & Bereiter, C. (1994). Computer support for knowledge-building communities. Journal of the Learning Sciences, 3(3), 265–283. https://doi.org/10.1207/s15327809jls0303_3

    Article  Google Scholar 

  • Scheuer, O., Loll, F., Pinkwart, N., & McLaren, B. M. (2010). Computer-supported argumentation: A review of the state of the art. International Journal of Computer-Supported Collaborative Learning, 5(1), 43–102.

    Google Scholar 

  • Schwarz, B. B., & Asterhan, C. S. (2011). E-moderation of synchronous discussions in educational settings: A nascent practice. Journal of the Learning Sciences, 20(3), 395–442.

    Google Scholar 

  • Schwarz, B. B., Swidan, O., Prusak, N., & Palatnik, A. (2021). Collaborative learning in mathematics classrooms: Can teachers understand progress of concurrent collaborating groups? Computers & Education, 165, 104151.

    Google Scholar 

  • Sedrakyan, G., Malmberg, J., Verbert, K., Järvelä, S., & Kirschner, P. A. (2020). Linking learning behavior analytics and learning science concepts: Designing a learning analytics dashboard for feedback to support learning regulation. Computers in Human Behavior, 107, 105512.

    Google Scholar 

  • Shum, S. J. B., Selvin, A. M., Sierhuis, M., Conklin, J., Haley, C. B., & Nuseibeh, B. (2006). Hypermedia support for argumentation-based rationale: 15 years on from gIBIS and QOC. Rationale Management in Software Engineering. https://doi.org/10.1007/978-3-540-30998-7_5.pdf

    Article  Google Scholar 

  • Soller, A. (2001). Supporting social interaction in an intelligent collaborative learning system. International Journal of Artificial Intelligence in Education, 12(1), 40–62.

    Google Scholar 

  • Sosa, T., Hall, A. H., Goldman, S. R., & Lee, C. D. (2016). Developing symbolic interpretation through literary argumentation. Journal of the Learning Sciences, 25(1), 93–132.

    Google Scholar 

  • Stahl, G., & Hakkarainen, K. (2021). Theories of CSCL. In U. Cress, C. Rosé, A. F. Wise, & J. Oshima (Eds.), International handbook of computer-supported collaborative learning computer-supported collaborative learning series. Springer.

    Google Scholar 

  • Sundgren, M. (2017). Blurring time and place in higher education with bring your own device applications: A literature review. Education and Information Technologies, 22(6), 3081–3119.

    Google Scholar 

  • Suthers, D. D. (2006). Technology affordances for intersubjective meaning making: A research agenda for CSCL. International Journal of Computer-Supported Collaborative Learning, 1(3), 315–337.

    Google Scholar 

  • Suthers, D., & Medina, R. (2011). Tracing interaction in distributed collaborative learning. Analyzing Interactions in CSCL: Methods Approaches and Issues, 12, 341–366.

    Google Scholar 

  • Tan, J. S., & Chen, W. (2022). Peer feedback to support collaborative knowledge improvement: What kind of feedback feed-forward? Computers & Education, 187, 104467.

    Google Scholar 

  • Tan, J.P.-L., Koh, E., Jonathan, C., & Yang, S. (2017). Learner dashboards a double-edged sword? Students’ sense-making of a collaborative critical reading and learning analytics environment for fostering 21st century literacies. Journal of Learning Analytics, 4(1), 117–140.

    Google Scholar 

  • Tan, S. C., Turgeon, A. J., & Jonassen, D. H. (2001). Develop critical thinking in group problem solving through computer-supported collaborative argumentation: A case study. Journal of Natural Resources and Life Sciences Education, 30(1), 97–103.

    Google Scholar 

  • Tchounikine, P. (2019). Learners’ agency and CSCL technologies: Towards an emancipatory perspective. International Journal of Computer-Supported Collaborative Learning, 14(2), 237–250.

    Google Scholar 

  • Teräs, M., Suoranta, J., Teräs, H., & Curcher, M. (2020). Post-Covid-19 education and education technology ‘solutionism’: A seller’s market. Postdigital Science and Education, 2(3), 863–878.

    Google Scholar 

  • Tham, R., & Tham, L. (2014). The effectiveness of game-based learning as an instructional strategy to engage students in higher education in Singapore. International Journal on E-Learning, 13(4), 483–496.

    Google Scholar 

  • Toulmin, S. E. (1958). The uses of argument. Philosophy, 34(130), 244–245.

    Google Scholar 

  • van Bruggen, J. M., Kirschner, P. A., & Jochems, W. (2002). External representation of argumentation in CSCL and the management of cognitive load. Learning and Instruction, 12(1), 121–138.

    Google Scholar 

  • Vivian, R., Falkner, K., Falkner, N., & Tarmazdi, H. (2016). A method to analyze computer science students’ teamwork in online collaborative learning environments. ACM Transactions on Computing Education (TOCE), 16(2), 1–28.

    Google Scholar 

  • Wang, Z., Gong, S. Y., Xu, S., & Hu, X. E. (2019). Elaborated feedback and learning: Examining cognitive and motivational influences. Computers & Education, 136, 130–140.

    Google Scholar 

  • Wise, A. F., Knight, S., & Shum, S. B. (2021). Collaborative learning analytics. In U. Cress, C. Rosé, A. F. Wise, & J. Oshima (Eds.), International handbook of computer-supported collaborative learning computer-supported collaborative learning series. Springer. https://doi.org/10.1007/978-3-030-65291-3_23

    Chapter  Google Scholar 

  • Wong, C. P., & Ng, D. (2020). The roles of school leaders in developing future-ready learners: The case of Singapore. International Journal of Educational Management, 35(1), 249–269. https://doi.org/10.1108/IJEM-06-2020-0283

    Article  Google Scholar 

  • Yilmaz, F. G. K., & Yilmaz, R. (2019). Impact of pedagogic agent-mediated metacognitive support towards increasing task and group awareness in CSCL. Computers & Education, 134, 1–14.

    Google Scholar 

  • Yin, R. K. (1981). The case study as a serious research strategy. Knowledge, 3(1), 97–114.

    Google Scholar 

  • Zheng, L., Niu, J., & Zhong, L. (2022). Effects of a learning analytics-based real-time feedback approach on knowledge elaboration, knowledge convergence, interactive relationships and group performance in CSCL. British Journal of Educational Technology, 53(1), 130–149. https://doi.org/10.1111/bjet.13156

    Article  Google Scholar 

Download references

Acknowledgements

This study was funded by Singapore Ministry of Education (MOE) under the Education Research Funding Programme (OER 07/17 CWL and OER 17/19 CWL) and administered by National Institute of Education (NIE), Nanyang Technological University (NTU), Singapore. Any opinions, findings, and conclusions or recommendations expressed in this material are those of the author(s) and do not necessarily reflect the views of the Singapore MOE and NIE.

Author information

Authors and Affiliations

  1. National Institute of Education, Nanyang Technological University, Singapore, Singapore

    Wenli Chen, Jesmine S. H. Tan & Qianru Lyu

  2. Faculty of Artificial Intelligence in Education at the Central China Normal University, Wuhan, China

    Si Zhang

  3. Shaanxi Normal University, Xi’an, China

    Zhongling Pi

Authors
  1. Wenli Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jesmine S. H. Tan
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Si Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Zhongling Pi
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Qianru Lyu
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Wenli Chen.

Ethics declarations

Conflict of interest

The authors declare that they have no conflicts of interest.

Ethical approval

Consent from participants of this research were obtained based on ethics approval by National Institute of Education, Nanyang Technological University, IRB ref: IRB-2019-04-014.

Research involving human and animal rights

All procedures performed in studies involving human participants were in accordance with the ethical standards of the institute.

Informed consent

Informed consent was obtained from all individual participants involved in the study.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Chen, W., Tan, J.S.H., Zhang, S. et al. AppleTree system for effective computer-supported collaborative argumentation: an exploratory study. Education Tech Research Dev 71, 2103–2136 (2023). https://doi.org/10.1007/s11423-023-10258-5

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11423-023-10258-5

Keywords

Search

Navigation