Skip to main content

Choosing Units of Analysis in Temporal Discourse

  • Conference paper
  • First Online:
Advances in Quantitative Ethnography (ICQE 2021)

Abstract

Despite the promise of quantitative ethnographic approaches for visualizing the trajectories of change over time (temporal analysis) further work is needed to develop strategies for accurately representing phenomena. This holds especially true for identifying the relational context of discourse, which includes the creation of time units that group lines of data for the purpose of interpretation. While in-depth interpretive review of discourse may serve as the ‘gold standard’ for identification of thematic time units, this approach is tedious and may not be appropriate for larger datasets. Incremental approaches, such as creating a new unit for every ten lines of chronological data, are functional for larger datasets, but may lack nuance. This work introduces the Knowledge Building Discourse Explorer (KBDeX), which computationally identifies relational units using socio-semantic network analysis, allowing for the identification of time units based on characteristics of the discourse that can be systematically applied to larger datasets. To examine the utility of each approach, epistemic networks of COVID-19 press releases from seven countries were created with time units derived from the incremental and computational approaches, which were then compared to the interpretive approach. Results indicated that KBDeX and incremental network means were closer to the ‘gold standard’ interpretive approach in some instances. Two countries’ trajectories are examined in greater depth to understand when each approach might be most appropriate. The work concludes with a discussion of the affordances and constraints of each approach, and contexts in which they may be useful.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. D’Angelo, A.L.D., Ruis, A.R., Collier, W., Shaffer, D.W., Pugh, C.M.: Evaluating how residents talk and what it means for surgical performance in the simulation lab. Am. J. Surg. 220(1), 37–43 (2020)

    Article  Google Scholar 

  2. Barany, A., Shah, M., Foster, A.: Connecting curricular design and student identity change: an epistemic network analysis. In: Ruis, A.R., Lee, S.B. (eds.) ICQE 2021. CCIS, vol. 1312, pp. 155–169. Springer, Cham (2021). https://doi.org/10.1007/978-3-030-67788-6_11

    Chapter  Google Scholar 

  3. Hamilton, E., Hobbs, W.: Epistemic frames and political discourse modeling. In: Ruis, A.R., Lee, S.B. (eds.) ICQE 2021. CCIS, vol. 1312, pp. 32–46. Springer, Cham (2021). https://doi.org/10.1007/978-3-030-67788-6_3

    Chapter  Google Scholar 

  4. Brohinsky, J., Marquart, C., Wang, J., Ruis, A.R., Shaffer, D.W.: Trajectories in epistemic network analysis. In: Ruis, A.R., Lee, S.B. (eds.) ICQE 2021. CCIS, vol. 1312, pp. 106–121. Springer, Cham (2021). https://doi.org/10.1007/978-3-030-67788-6_8

    Chapter  Google Scholar 

  5. Zörgő, S., Swiecki, Z., Ruis, A.R.: Exploring the effects of segmentation on semi-structured interview data with epistemic network analysis. In: Ruis, A.R., Lee, S.B. (eds.) ICQE 2021. CCIS, vol. 1312, pp. 78–90. Springer, Cham (2021). https://doi.org/10.1007/978-3-030-67788-6_6

    Chapter  Google Scholar 

  6. Ohsaki, A., Oshima, J.: Socio-semantic network analysis of discourse using the network lifetime and the moving stanza window method. In: Eagan, B., Misfeldt, M., Siebert-Evenstone, A. (eds.) Advances in Quantitative Ethnography, Communications in Computer and Information Science, vol. 1112, pp. 326–333. Springer, Cham. (2019)

    Google Scholar 

  7. Li, A., Cornelius, S.P., Liu, Y.Y., Wang, L., Barabási, A.L.: The fundamental advantages of temporal networks. Science 358(6366), 1042–1046 (2017)

    Article  Google Scholar 

  8. Gee, J.P.: Situated language and learning: a critique of traditional schooling. Psychology Press (2004)

    Google Scholar 

  9. Gee, J.P.: An Introduction to Discourse Analysis: Theory and Method. 3rd edn. Routledge (2011)

    Google Scholar 

  10. Erikson, E.H.: Identity and the Life Cycle: Selected Papers. International Universities Press, New York (1959)

    Google Scholar 

  11. Csanadi, A., Eagan, B., Kollar, I., Shaffer, D.W., Fischer, F.: When coding-and-counting is not enough: Using epistemic network analysis (ENA) to analyze verbal data in CSCL research. Int. J. Comput.-Support. Collab. Learn. 13(4), 419–438 (2018)

    Article  Google Scholar 

  12. Ohsaki, A., Oshima, J.: Socio-semantic network analysis of knowledge-creation discourse on a real-time scale. In: Ruis, A.R., Lee, S.B. (eds.) ICQE 2021. CCIS, vol. 1312, pp. 170–184. Springer, Cham (2021). https://doi.org/10.1007/978-3-030-67788-6_12

    Chapter  Google Scholar 

  13. Siebert-Evenstone, A.L., Irgens, G.A., Collier, W., Swiecki, Z., Ruis, A.R., Shaffer, D.W.: In search of conversational grain size: modelling semantic structure using moving stanza windows. J. Learn. Anal. 4(3), 123–139 (2017)

    Google Scholar 

  14. Bakhtin, M.M.: The bildungsroman and its significance in the history of realism. In: Speech Genres and Other Late Essays. 2nd edn. University of Texas Press (1986)

    Google Scholar 

  15. Dyke, G., Kumar, R., Ai, H., Ros., C.P.: Challenging assumptions: using sliding window visualizations to reveal time-based irregularities in CSCL processes. In: van Aalst, J., Reiser, B. J., Hmelo-Silver, C., Thompson, K. (eds.) The Future of Learning: Proceedings of the 10th International Conference of the Learning Sciences (ICLS ʼ12), vol. 1, pp. 363–370. International Society of the Leaning Sciences, Sydney, Australia (2012)

    Google Scholar 

  16. Suthers, D.D., Desiato, C.: Exposing chat features through analysis of uptake between contributions. In: Proceedings of the 45th Hawaii International Conference on System Sciences (HICSS-45), pp. 3368–3377. IEEE Computer Society, Maui, HI, USA (2012)

    Google Scholar 

  17. Nash, P., Shaffer, D.W.: Epistemic trajectories: mentoring in a game design practicum. Instr. Sci. 41(4), 745–771 (2013)

    Article  Google Scholar 

  18. Espino, D., Lee, S., Eagan, B., Hamilton, E.: An initial look at the developing culture of online global meet-ups in establishing a collaborative, STEM media-making community. In: Lund, K., Niccolai, G.P., Lavoué, E., Hmelo-Silver, C., Gweon, G., Baker, M. (eds.) A Wide Lens: Combining Embodied, Enactive, Extended, and Embedded Learning in Collaborative Settings: International Conference on Computer Supported Collaborative Learning (CSCL), vol. 2, pp. 608–611. International Society of the Learning Sciences, Lyon, France (2019)

    Google Scholar 

  19. Barany, A., Foster, A.: Examining identity exploration in a video game participatory culture. In: Eagan, B., Misfeldt, M., Siebert-Evenstone, A. (eds.) ICQE 2019. CCIS, vol. 1112, pp. 3–13. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-33232-7_1

    Chapter  Google Scholar 

  20. Shah, M., Barany, A., Siebert-Evenstone, A.: “What would happen if humans disappeared from earth?” tracing and visualizing change in a pre-school child’s domain-related curiosities. In: Ruis, A.R., Lee, S.B. (eds.) ICQE 2021. CCIS, vol. 1312, pp. 232–247. Springer, Cham (2021). https://doi.org/10.1007/978-3-030-67788-6_16

    Chapter  Google Scholar 

  21. Lazer, D., et al.: Computational social science. Science 323(5915), 721–723 (2009)

    Article  Google Scholar 

  22. Oshima, J., Oshima, R., Matsuzawa, Y.: Knowledge building discourse explorer: a social network analysis application for knowledge building discourse. Educ. Tech. Res. Dev. 60(5), 903–921 (2012)

    Article  Google Scholar 

  23. Creswell, J.W.: Educational Research: Planning, Conducting, and Evaluating Quantitative and Qualitative Research, vol. vol. 4. Pearson, Boston, MA (2015)

    Google Scholar 

  24. Herzog, C., Handke, C., Hitters, E.: Analyzing talk and text II: thematic analysis. In: Van den Bulck, H., Puppis, M., Donders, K., Van Audenhove, L. (eds.) The Palgrave handbook of methods for media policy research, pp. 385–401. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-16065-4_22

    Chapter  Google Scholar 

Download references

Acknowledgements

Thank you to the organizers of the ICQE data challenges for connecting the team of authors on this project, and for facilitating our continued collaboration in this research.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Amanda Barany .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2022 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Barany, A., Philips, M., Kawakubo, A.J.T., Oshima, J. (2022). Choosing Units of Analysis in Temporal Discourse. In: Wasson, B., Zörgő, S. (eds) Advances in Quantitative Ethnography. ICQE 2021. Communications in Computer and Information Science, vol 1522. Springer, Cham. https://doi.org/10.1007/978-3-030-93859-8_6

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-93859-8_6

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-93858-1

  • Online ISBN: 978-3-030-93859-8

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics