Skip to main content

Assessing the Collaboration Quality in the Pair Program Tracing and Debugging Eye-Tracking Experiment

Part of the Lecture Notes in Computer Science book series (LNAI,volume 10331)

Abstract

We assessed the extent of collaboration of pairs of novice programmers as they traced and debugged fragments of code using cross-recurrence quantification analysis (CRQA). Specifically, we compared which among the pairs collaborated the most given a particular task. This was also a preliminary study that looked for patterns on how the pairs categorized according to expertise collaborated. We performed a CRQA to build cross-recurrence plots using the eye tracking data and computed for the CRQA metrics, such as recurrence rate (RR), determinism (DET), entropy (ENTR), and laminarity (LAM) using the CRP toolbox for MATLAB. Findings showed that Pair 3, which consisted of both high-performers, collaborated the most because of its highest RR and DET. However, its highest ENT and LAM implied that Pair 3 struggled the most in program comprehension. We found also that all the pairs as assessed through their RR’s started with low values, peaked in the middle, declined, and increased again when the task was about to end, regardless of how well partners knew each other prior to the task. This could mean that at the start the pairs were still independently assessing how to approach the task, then they started to collaborate once comfortable but then worked independently again in an attempt to finish.

Keywords

  • Eye-tracking
  • Collaboration
  • Cross-recurrence quantification

This is a preview of subscription content, access via your institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • DOI: 10.1007/978-3-319-61425-0_67
  • Chapter length: 4 pages
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
eBook
USD   84.99
Price excludes VAT (USA)
  • ISBN: 978-3-319-61425-0
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
Softcover Book
USD   109.99
Price excludes VAT (USA)

References

  1. Richardson, D.C., Dale, R.: Looking to understand: the coupling between speakers’ and listeners’ eye movements and its relationship to discourse comprehension. Cogn. Sci. 29(6), 1045–1060 (2005)

    CrossRef  Google Scholar 

  2. Pietinen, S., Bednarik, R., Glotova, T., Tenhunen, V., Tukiainen, M.: A method to study visual attention aspects of collaboration: eye-tracking pair programmers simultaneously. In: Proceedings of the 2008 Symposium on Eye Tracking Research & Applications, pp. 39–42. ACM (2008)

    Google Scholar 

  3. Zbilut, J.P., Giuliani, A., Webber, C.L.: Detecting deterministic signals in exceptionally noisy environments using cross-recurrence quantification. Phys. Lett. A 246(1), 122–128 (1998)

    CrossRef  Google Scholar 

  4. Nüssli, M.-A: Dual eye-tracking methods for the study of remote collaborative problem solving. École Polytechnique Fédérale de Lausanne (2011)

    Google Scholar 

  5. Jermann, P., Mullins, D., Nüssli, M.-A., Dillenbourg, P.: Collaborative gaze footprints: correlates of interaction quality. In: Proceedings of the Computer Supported Collaborative Learning (CSCL) Conference 2011, vol. 1. International Society of the Learning Sciences (ISLS) (2011)

    Google Scholar 

Download references

Acknowledgments

The authors would like to thank Ateneo de Davao University for allowing us to conduct the eye-tracking experiment and to Private Education Assistance Committee of the Fund for Assistance to Private Education for the grant entitled “Analysis of Novice Programmer Tracing and Debugging Skills using Eye Tracking Data.”

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Maureen Villamor .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and Permissions

Copyright information

© 2017 Springer International Publishing AG

About this paper

Cite this paper

Villamor, M., Paredes, Y.V., Samaco, J.D., Cortez, J.F., Martinez, J., Rodrigo, M.M. (2017). Assessing the Collaboration Quality in the Pair Program Tracing and Debugging Eye-Tracking Experiment. In: André, E., Baker, R., Hu, X., Rodrigo, M., du Boulay, B. (eds) Artificial Intelligence in Education. AIED 2017. Lecture Notes in Computer Science(), vol 10331. Springer, Cham. https://doi.org/10.1007/978-3-319-61425-0_67

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-61425-0_67

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-61424-3

  • Online ISBN: 978-3-319-61425-0

  • eBook Packages: Computer ScienceComputer Science (R0)