Abstract
Understanding business process models has been previously related to various factors. Those factors were determined using statistical approaches either on model repositories or on experiments based on comprehension questions. We noticed that, when asking comprehension questions on a process model, usually the expert explores only a part of the entire model to provide the answer. This paper formalizes this observation under the notion of Relevant Region. We conduct an experiment using eye-tracking to prove that the Relevant Region is indeed correlated to the answer given to the comprehension question. We also give evidence that it is possible to predict whether the correct answer will be given to a comprehension question, knowing the number and the time spent fixating Relevant Region elements. This paper sets the foundations for future improvements on model comprehension research and practice.
Chapter PDF
References
Recker, J., Rosemann, M., Green, P.F., Indulska, M.: Do Ontological Deficiencies in Modeling Grammars Matter? MIS Quarterly 35(1), 57–79 (2011)
Moody, D.L.: The “Physics” of Notations: Toward a Scientific Basis for Constructing Visual Notations in Software Engineering. IEEE Trans. Software Eng. 35(6), 756–779 (2009)
Dumas, M., La Rosa, M., Mendling, J., Mäesalu, R., Reijers, H.A., Semenenko, N.: Understanding Business Process Models: The Costs and Benefits of Structuredness. In: Ralyté, J., Franch, X., Brinkkemper, S., Wrycza, S. (eds.) CAiSE 2012. LNCS, vol. 7328, pp. 31–46. Springer, Heidelberg (2012)
Reijers, H.A., Mendling, J.: A Study into the Factors That Influence the Understandability of Business Process Models. IEEE Transactions on Systems, Man, and Cybernetics, Part A 41(3), 449–462 (2011)
Figl, K., Laue, R.: Cognitive Complexity in Business Process Modeling. In: Mouratidis, H., Rolland, C. (eds.) CAiSE 2011. LNCS, vol. 6741, pp. 452–466. Springer, Heidelberg (2011)
Melcher, J., Mendling, J., Reijers, H.A., Seese, D.: On Measuring the Understandability of Process Models. In: Rinderle-Ma, S., Sadiq, S., Leymann, F. (eds.) BPM 2009. LNBIP, vol. 43, pp. 465–476. Springer, Heidelberg (2010)
Kiepuszewski, B., ter Hofstede, A.H.M., Bussler, C.: On structured workflow modelling. In: Wangler, B., Bergman, L.D. (eds.) CAiSE 2000. LNCS, vol. 1789, pp. 431–445. Springer, Heidelberg (2000)
Laue, R., Mendling, J.: Structuredness and its significance for correctness of process models. Inf. Syst. E-Bus. Manage 8(3), 287–307 (2010)
Krogstie, J., Sindre, G., Jørgensen, H.D.: Process models representing knowledge for action: a revised quality framework. EJIS 15(1), 91–102 (2006)
Gemino, A., Wand, Y.: A framework for empirical evaluation of conceptual modeling techniques. Requir. Eng. 9(4), 248–260 (2004)
Mendling, J., Strembeck, M., Recker, J.: Factors of process model comprehension - Findings from a series of experiments. Dec. Supp. Syst. 53(1), 195–206 (2012)
Weidlich, M., Mendling, L., Weske, M.: Efficient Consistency Measurement Based on Behavioral Profiles of Process Models. IEEE Trans. Software Eng. 37(3), 410–429 (2011)
Weidlich, M., Polyvyanyy, A., Mendling, J., Weske, M.: Causal Behavioural Profiles – Efficient Computation, Applications, and Evaluation. Fundamenta Informaticae 113(3-4), 399–435 (2011)
Decker, G., Mendling, J.: Process instantiation. Data Knowl. Eng. 68(9), 777–792 (2009)
Hogrebe, F., Gehrke, N., Nüttgens, M.: Eye Tracking Experiments in Business Process Modeling: Agenda Setting and Proof of Concept. In: Proc. of EMISA, pp. 183–188 (2011)
Pinggera, J., Zugal, S., Weidlich, M., Fahland, D., Weber, B., Mendling, J., Reijers, H.A.: Tracing the Process of Process Modeling with Modeling Phase Diagrams. In: Daniel, F., Barkaoui, K., Dustdar, S. (eds.) BPM Workshops 2011, Part I. LNBIP, vol. 99, pp. 370–382. Springer, Heidelberg (2012)
Yoon, D., Narayanan, N.H.: Mental imagery in problem solving: An eye tracking study. In: Eye Tracking Research & Application: Proceedings of the 2004 Symposium on Eye Tracking Research & Applications, vol. 22(24), pp. 77–84 (2004)
Salvucci, D.D., Goldberg, J.H.: Identifying fixations and saccades in eye-tracking protocols. In: Proceedings of the 2000 Symposium on Eye Tracking Research & Applications, pp. 71–78. ACM (2000)
Granka, L.A., Joachims, T., Gay, G.: Eye-tracking analysis of user behavior in WWW search. In: Proceedings of the 27th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 478–479 (2004)
Holmqvist, K., Nyström, M., Andersson, R., Dewhurst, R., Jarodzka, H., Van de Weijer, J.: Eye tracking: A comprehensive guide to methods and measures. OUP Oxford (2011)
Baeza-Yates, R., Ribeiro-Neto, B.: Modern Information Retrieval. ACM Press, Addison-Wesley, New York (1999)
Hosmer, D., Lemeshow, S.: Applied logistic regression. Wiley-Interscience Publ. (2000)
Duchowski, A.: Eye Tracking Methodology: Theory and Practice. Springer (2007)
Salvucci, D.D., Anderson, J.R.: Automated eye-movement protocol analysis. Human-Computer Interaction 16(1), 39–86 (2001)
Zugal, S., Pinggera, J., Reijers, H.A., Reichert, M., Weber, B.: Making the Case for Measuring Mental Effort, http://bpm.q-e.at/wp-content/uploads/2012/09/eessmod_2012.pdf
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Petrusel, R., Mendling, J. (2013). Eye-Tracking the Factors of Process Model Comprehension Tasks. In: Salinesi, C., Norrie, M.C., Pastor, Ó. (eds) Advanced Information Systems Engineering. CAiSE 2013. Lecture Notes in Computer Science, vol 7908. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-38709-8_15
Download citation
DOI: https://doi.org/10.1007/978-3-642-38709-8_15
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-38708-1
Online ISBN: 978-3-642-38709-8
eBook Packages: Computer ScienceComputer Science (R0)