Skip to main content
SpringerLink
Log in

Investigation 10. Time Is Precious: Variable- and Event-Centered Approaches to Process Analysis in CSCL Research

  • Chapter
  • First Online:
Theoretical Investigations

Part of the book series: Computer-Supported Collaborative Learning Series ((CULS,volume 18))

  • 261 Accesses

Abstract

Although temporality is a key characteristic of the core concepts of CSCL—interaction, communication, learning, knowledge building, and technology use—and although CSCL researchers have privileged access to process data, the theoretical constructs and methods employed in research practice frequently neglect to make full use of information relating to time and order. This is particularly problematic when collaboration and learning processes are studied in groups that work together over weeks, and months, as is often the case. The quantitative method dominant in the social and learning sciences—variable-centered variance theory—is of limited value for studying change on longer timescales. We introduce the event-centered view of process as a more generally applicable approach, not only for quantitative analysis but also for providing closer links between qualitative and quantitative research methods. A number of methods for variable- and event-centered analysis of process data are described and compared, using examples from CSCL research. I conclude with suggestions on how experimental, descriptive, and design-oriented research orientations can become better integrated.

Received: 9 October 2008/Accepted: 29 May 2009/Published online: 27 June 2009 © International Society of the Learning Sciences, Inc.; Springer Science + Business Media, LLC 2009

Reimann, P. (2009). Time is precious: Variable- and event-centred approaches to process analysis in CSCL research. International Journal of Computer-Supported Collaborative Learning. 4(3), 239–257. https://doi.org/10.1007/s11412-009-9070-z.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 139.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 179.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 199.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  • Abbott, A. (1984). Event sequence and event duration: Colligation and measurement. Historical Methods, 17, 192–204.

    Article  Google Scholar 

  • Abbott, A. (1990). A primer on sequence methods. Organization Science, 1(4), 375–392.

    Article  Google Scholar 

  • Abbott, A., & Hrycak, A. (1990). Measuring resemblance in sequence data: An optimal matching analysis of musicians’ careers. American Journal of Sociology, 96, 144–185.

    Article  Google Scholar 

  • Abell, P. (1987). The syntax of social life: The theory and method of comparative narratives. Oxford, UK: Clarendon.

    Google Scholar 

  • Abell, P. (2004). Narrative explanations: An alternative to variable–centered explanation? Annual Review of Sociology, 30, 287–310.

    Article  Google Scholar 

  • Aristotle. (1941). In R. McKeon (Ed.), The basic works of Aristotle. New York, NY: Random House.

    Google Scholar 

  • Arrow, H., McGrath, J. E., & Behrdal, J. (2000). Small groups as complex systems: Formation, coordination, development and adaptation. Thousand Oaks, CA: Sage.

    Book  Google Scholar 

  • Box, G., & Jenkins, G. (1976). Time series analysis: Forecasting and control. San Francisco, CA: Holden-Day.

    Google Scholar 

  • Cassandras, C. G. (1993). Discrete event systems. Homewood, IL: Richard D. Irwin Inc.

    Google Scholar 

  • Chinn, C., Erkens, G., & Puntambekar, S. (Eds.). (2007). CSCL 2007-The Computer Supported Collaborative (CSCL) Conference 2007 (Rutgers, NJ, July 16th–21st, 2007). International Society of the Learning Sciences.

    Google Scholar 

  • Coleman, J. S. (1964). Introduction to mathematical sociology. New York, NY: Free.

    Google Scholar 

  • Cress, U. (2008). The need for considering multilevel analysis in CSCL research-an appeal for the use of more advanced statistical methods. International Journal of Computer-Supported Collaborative Learning, 3, 69–84.

    Article  Google Scholar 

  • Danto, A. C. (1985). Narration and knowledge. New York, NY: Columbia University Press.

    Google Scholar 

  • Dillenbourg, P., & Hong, F. (2008). The mechanics of CSCL macro scripts. International Journal of Computer-Supported Collaborative Learning, 3(1), 5–24.

    Article  Google Scholar 

  • Gill, A. (1962). Introduction to the theory of finite-state machines. New York, NY: McGraw-Hill.

    Google Scholar 

  • Goodwin, C. (2000). Action and embodiment within situated human interaction. Journal of Pragmatics, 32, 1489–1522.

    Article  Google Scholar 

  • Holmes, M. E. (1997). Optimal matching analysis of negotiation phase sequences in simulated and authentic hostage negotiations. Communication Reports, 10, 1–9.

    Article  Google Scholar 

  • Jones, C., Dirckinck-Holmfeld, L., & Linstroem, B. (2006). A relational, indirect, meso-level approach to CSCL design in the next decade. Computer-supported Collaborative Learning, 1(1), 35–56.

    Article  Google Scholar 

  • Kapur, M., Voiklis, J., & Kinzer, C. K. (2005). Problem solving as a complex, evolutionary activity: A methodological framework for analyzing problem-solving processes in a computer-supported collaborative environment. In T. Koschmann, D. Suthers, & T.-W. Chan (Eds.), Computer-supported collaborative learning 2005: The next 10 years! (pp. 252–261). Mahwah, NJ: Erlbaum.

    Google Scholar 

  • Kay, J., Maisonneuve, N., Yacef, K., & Zaiane, O. R. (2006). Mining patterns of events in students’ teamwork data. Paper presented at the proceedings of educational data mining workshop held in conjunction with ITS’ 06, Jhongli, Taiwan.

    Google Scholar 

  • Kay, J., Yacef, K., & Reimann, P. (2007). Visualisations for team learning: Small teams working on long-term. International Conference on Computer-supported Collaborative Learning (CSCL 2007) (pp. 351–353). New Brunswick, NJ: International Society of the Learning Sciences.

    Google Scholar 

  • Kemeny, J. G., & Snell, J. L. (1976). Finite Markov chains. New York, NY: Springer.

    Google Scholar 

  • Kollar, I., Fischer, F., & Hesse, F. W. (2006). Collaboration scripts—A conceptual analysis. Educational Psychological Review, 18, 159–185.

    Article  Google Scholar 

  • Koschmann, T. (2001). Revising the paradigms of instructional technology. Paper presented at the Meeting at the Crossroads. 8th Annual Conference of the Australasian Society for Computers in Learning in Tertiary Education (ASCILITE).

    Google Scholar 

  • Koschmann, T., Suthers, D., & Chan, T.-W. (Eds.). (2005). CSCL 2005-the next 10 years. Proceedings of the international conference on computer supported collaborative learning 2005. Mahwah, NJ: Erlbaum.

    Google Scholar 

  • Langley, A. (1999). Strategies for theorizing from process data. Academy of Management Review, 24(4), 691–710.

    Article  Google Scholar 

  • Markauskaite, L., & Reimann, P. (2008). Enhancingand scaling-up design-based research: The potential of e-research. Paper presented at the International Learning Science Conference-ICLS 2008, Utrecht, The Netherlands (24–28 July 2008) from http://www.fi.uu.nl/en/icls2008/343/paper343.pdf

  • McGrath, J. E., & Tschan, F. (2004). Temporal matters in social psychology: Examining the role of time in the lives of groups and individuals. Washington, DC: American Psychological Association.

    Google Scholar 

  • Mercer, N. (2008). The seeds of time: Why classroom dialogue needs a temporal analysis. The Journal of the Learning Sciences, 17, 33–59.

    Article  Google Scholar 

  • Miura, R. M. (1986). Some mathematical questions in biology: DNA sequence analysis (Vol. 17). Providence, RI: American Mathematical Society.

    Google Scholar 

  • Mochizuki, T., Kato, H., Yaegashi, K., Nishimori, T., Nagamori, Y., & Fujita, S. (2007). ProBoPortable: Does the cellular phone software promote emergent division of labor in project-based learning? In C. Chinn, G. Erkens, & S. Puntambekar (Eds.), Minds, mind, and society. Proceedings of the 6th international conference on computer-supported collaborative learning (CSCL 2007) (pp. 512–514). New Brunswick, NJ: International Society of the Learning Sciences.

    Google Scholar 

  • Mohr, L. (1982). Explaining organizational behavior. San Francisco, CA: Jossey-Bass.

    Google Scholar 

  • Muukkonen, H., Hakkarainen, K., Konsonen, K., Jalonen, S., Heikkil, A., Lonka, K., et al. (2007). Process- and context-sensitive research on academic knowledge practices: Developing CASS-tools and methods. In C. Chinn, G. Erkens, & S. Puntambekar (Eds.), Minds, mind, and society. Proceedings of the 6th international conference on computer-supported collaborative learning (CSCL 2007) (pp. 541–543). New Brunswick, NJ: International Society of the Learning Sciences.

    Google Scholar 

  • Olson, G. M., Herbsleb, J. D., & Rueter, H. H. (1994). Characterizing the sequential structure of interactive behaviors through statistical and grammatical techniques. Human-Computer Interaction, 9(3/4), 427–472.

    Article  Google Scholar 

  • Poole, M. S., & DeSanctis, G. (2004). Structuration theory in information systems research: Methods and controversies. In M. E. Whitman & Woszcynski (Eds.), The handbook of information systems research (pp. 206–249). Idea Group Publishing.

    Google Scholar 

  • Poole, M. S., & Roth, J. (1989). Decision making in small groups IV: A typology of group decision paths. Human Communication Research, 15(3), 323–356.

    Article  Google Scholar 

  • Poole, M. S., van de Ven, A., Dooley, K., & Holmes, M. E. (2000). Organizational change and innovation processes. Theories and methods for research. Oxford, UK: Oxford University Press.

    Google Scholar 

  • Rabiner, L. R. (1989). A tutorial on hidden markov models and selected applications in speech recognition. Proceedings of the IEEE, 77(2), 257–286.

    Article  Google Scholar 

  • Reimann, P., Frerejean, J., & Thompson, K. (2009). Using process mining to identify decision making processes in virtual teams (accepted). Paper presented at the international conference on computer- supported collaborative learning (CSCL2009). Rhodes/Greece.

    Google Scholar 

  • Reisig, W. (1985). Petri nets. An introduction. Berlin, Germany: Springer.

    Book  Google Scholar 

  • Ritter, F. E., Nerb, J., Lehtinen, E., & O’Shea, T. (Eds.). (2007). In order to learn: How the sequences of topics influences learning. Oxford University Press: Oxford, UK.

    Google Scholar 

  • Sanderson, P. M., & Fisher, C. (1994). Exploratory sequential data analysis: Foundations. Human-Computer Interaction, 9(3/4), 251–317.

    Article  Google Scholar 

  • Schegloff, E. A. (2007). Sequence organization in interaction. New York, NJ: Cambridge University Press.

    Book  Google Scholar 

  • Schümmer, T., Strijbos, J.-W., & Berkel, T. (2005). A new direction for log file analysis in CSCL: Experiences with a spatio-temporal metric. In T. Koschmann, D. Suthers, & T. W. Chan (Eds.), Computer supported collaborative learning 2005: The next 10 years! (pp. 567–576). Mahwah, NJ: Erlbaum.

    Google Scholar 

  • Sloane, F. C. (2008). Multilevel models in design research. A case from mathematics education. In A. E. Kelly, R. A. Lesh, & J. Y. Baek (Eds.), Handbook of design research methods in education (pp. 459–476). New York, NY: Routledge.

    Google Scholar 

  • Sloane, F. C., & Kelly, A. E. (2008). Design research and the study of change. In A. E. Kelly, R. A. Lesh, & J. Y. Baek (Eds.), Handbook of design research methods in education (pp. 441–448). New York, NY: Routledge.

    Google Scholar 

  • Soller, A., Wiebe, J., & Lesgold, A. (2002). A machine learning approach to assessing knowledge sharing during collaborative learning activities. In G. Stahl (Ed.), Proceedings of computer support for collaborative learning (pp. 128–137). Hillsdale, MI: Erlbaum.

    Google Scholar 

  • Stahl, G. (2006). Group cognition: Computer support for building collaborative knowledge. Cambridge, MA: MIT Press.

    Book  Google Scholar 

  • Strijbos, J. W., Martens, R. L., Prins, F. J., & Jochems, W. M. G. (2006). Content analysis: What are they talking about? Computers & Education, 46, 29–48.

    Article  Google Scholar 

  • Suppes, P., & Atkinson, R. C. (1960). Markov learning models for multiperson interactions. Stanford, CA: Stanford University Press.

    Google Scholar 

  • Suthers, D. D. (2006). A qualitative analysis of collaborative knowledge construction through shared representations. Research and Practice in Technology Enhanced Learning, 1(2), 115–142.

    Article  Google Scholar 

  • Suthers, D. D., Dwyer, N., Medina, R., & Vatrapu, R. (2007). A framework for eclectic analysis of collaborative interaction. In C. Chinn, G. Erkens, & S. Puntambekar (Eds.), Minds, mind, and society. Proceedings of the 6th international conference on computer-supported collaborative learning (CSCL 2007) (pp. 694–703). New Brunswick, NJ: International Society of the Learning Sciences.

    Google Scholar 

  • Van der Aalst, W. M. P., & Günther, C. W. (2007). Finding structure in unstructured processes: The case of process mining. In T. Basten, G. Juhas, & S. Shukla (Eds.), Proceedings the 7th international conference on applications of concurrency to system design (ACSD 2007; Bratislava, Slovak Republic) (pp. 3–12). Los Alamitos, CA: IEEE Computer Society.

    Google Scholar 

  • Wever, B. d., Schellens, T., Valcke, M., & Keer, H. v. (2006). Content analysis schemes to analyze transcripts of online asynchronous discussion groups: A review. Computers & Education, 46, 6–28.

    Article  Google Scholar 

  • Zumbach, J., & Reimann, P. (2003). Influence of feedback on distributed problem based learning. In B. Wasson, S. Ludvigsen, & U. Hoppe (Eds.), Designing for change in networked learning environments (pp. 219–228). Dordrecht, The Netherlands: Kluwer.

    Chapter  Google Scholar 

Download references

Acknowledgments

I would like to thank Anindito Aditomo and Fides-Ronja Voss for conducting the duration analysis on the CSCL 2005 and 2007 conference papers and a number of colleagues for feedback on earlier versions of this paper.

Author information

Authors and Affiliations

  1. Research Centre for Computer-supported Learning and Cognition (CoCo), University of Sydney, Sydney, NSW, Australia

    Peter Reimann

Authors
  1. Peter Reimann
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Peter Reimann .

Editor information

Editors and Affiliations

  1. Chatham, MA, USA

    Gerry Stahl

Rights and permissions

Reprints and permissions

Copyright information

© 2021 Springer Nature Switzerland AG

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Reimann, P. (2021). Investigation 10. Time Is Precious: Variable- and Event-Centered Approaches to Process Analysis in CSCL Research. In: Stahl, G. (eds) Theoretical Investigations. Computer-Supported Collaborative Learning Series, vol 18. Springer, Cham. https://doi.org/10.1007/978-3-030-49157-4_10

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-49157-4_10

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-49156-7

  • Online ISBN: 978-3-030-49157-4

  • eBook Packages: EducationEducation (R0)

Publish with us

Policies and ethics

Search

Navigation