Skip to main content
SpringerLink
Log in

Conformance Testing: Measuring the Fit and Appropriateness of Event Logs and Process Models

  • Conference paper
Business Process Management Workshops (BPM 2005)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 3812))

Included in the following conference series:

Abstract

Most information systems log events (e.g., transaction logs, audit trails) to audit and monitor the processes they support. At the same time, many of these processes have been explicitly modeled. For example, SAP R/3 logs events in transaction logs and there are EPCs (Event-driven Process Chains) describing the so-called reference models. These reference models describe how the system should be used. The coexistence of event logs and process models raises an interesting question: “Does the event log conform to the process model and vice versa?”. This paper demonstrates that there is not a simple answer to this question. To tackle the problem, we distinguish two dimensions of conformance: fitness (the event log may be the result of the process modeled) and appropriateness (the model is a likely candidate from a structural and behavioral point of view). Different metrics have been defined and a Conformance Checker has been implemented within the ProM Framework.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. van der Aalst, W.M.P.: Business Alignment: Using Process Mining as a Tool for Delta Analysis. In: Grundspenkis, J., Kirikova, M. (eds.) Proceedings of the 5th Workshop on Business Process Modeling, Development and Support (BPMDS 2004). Caise 2004 Workshops, vol. 2, pp. 138–145. Riga Technical University, Latvia (2004)

    Google Scholar 

  2. van der Aalst, W.M.P., van Hee, K.M.: Workflow Management: Models, Methods, and Systems. MIT Press, Cambridge (2002)

    Google Scholar 

  3. van der Aalst, W.M.P., de Medeiros, A.K.A.: Process Mining and Security: Detecting Anomalous Process Executions and Checking Process Conformance. In: Busi, N., Gorrieri, R., Martinelli, F. (eds.) Second International Workshop on Security Issues with Petri Nets and other Computational Models (WISP 2004), pp. 69–84. STAR, Servizio Tipografico Area della Ricerca, CNR Pisa (2004)

    Google Scholar 

  4. van der Aalst, W.M.P., de Medeiros, A.K.A., Weijters, A.J.M.M.: Genetic Process Mining. In: Ciardo, G., Darondeau, P. (eds.) ICATPN 2005. LNCS, vol. 3536, pp. 48–69. Springer, Heidelberg (2005)

    Chapter  Google Scholar 

  5. van der Aalst, W.M.P., Song, M.: Mining Social Networks: Uncovering Interaction Patterns in Business Processes. In: Desel, J., Pernici, B., Weske, M. (eds.) BPM 2004. LNCS, vol. 3080, pp. 244–260. Springer, Heidelberg (2004)

    Chapter  Google Scholar 

  6. van der Aalst, W.M.P., van Dongen, B.F., Herbst, J., Maruster, L., Schimm, G., Weijters, A.J.M.M.: Workflow Mining: A Survey of Issues and Approaches. Data and Knowledge Engineering 47(2), 237–267 (2003)

    Article  Google Scholar 

  7. van der Aalst, W.M.P., Weijters, A.J.M.M. (eds.): Process Mining, Special Issue of Computers in Industry, vol. 53(3). Elsevier Science Publishers, Amsterdam (2004)

    Google Scholar 

  8. van der Aalst, W.M.P., Weijters, A.J.M.M., Maruster, L.: Workflow Mining: Discovering Process Models from Event Logs. IEEE Transactions on Knowledge and Data Engineering 16(9), 1128–1142 (2004)

    Article  Google Scholar 

  9. Agrawal, R., Gunopulos, D., Leymann, F.: Mining Process Models from Workflow Logs. In: Sixth International Conference on Extending Database Technology, pp. 469–483 (1998)

    Google Scholar 

  10. Cook, J.E., He, C., Ma, C.: Measuring Behavioral Correspondence to a Timed Concurrent Model. In: Proceedings of the 2001 International Conference on Software Maintenance, pp. 332–341 (2001)

    Google Scholar 

  11. Cook, J.E., Wolf, A.L.: Discovering Models of Software Processes from Event- Based Data. ACM Transactions on Software Engineering and Methodology 7(3), 215–249 (1998)

    Article  Google Scholar 

  12. Cook, J.E., Wolf, A.L.: Software Process Validation: Quantitatively Measuring the Correspondence of a Process to a Model. ACM Transactions on Software Engineering and Methodology 8(2), 147–176 (1999)

    Article  Google Scholar 

  13. Desel, J., Reisig, W., Rozenberg, G. (eds.): Lectures on Concurrency and Petri Nets. LNCS, vol. 3098. Springer, Heidelberg (2004)

    MATH  Google Scholar 

  14. Greco, G., Guzzo, A., Pontieri, L., Saccä, D.: Mining Expressive Process Models by Clustering Workflow Traces. In: Dai, H., Srikant, R., Zhang, C. (eds.) PAKDD 2004. LNCS (LNAI), vol. 3056, pp. 52–62. Springer, Heidelberg (2004)

    Chapter  Google Scholar 

  15. Grigori, D., Casati, F., Castellanos, M., Dayal, U., Sayal, M., Shan, M.C.: Business process intelligence. Computers in Industry 53(3), 321–343 (2004)

    Article  Google Scholar 

  16. Grigori, D., Casati, F., Dayal, U., Shan, M.C.: Improving Business Process Quality through Exception Understanding, Prediction, and Prevention. In: Apers, P., Atzeni, P., Ceri, S., Paraboschi, S., Ramamohanarao, K., Snodgrass, R. (eds.) Proceedings of 27th International Conference on Very Large Data Bases (VLDB 2001), pp. 159–168. Morgan Kaufmann, San Francisco (2001)

    Google Scholar 

  17. Herbst, J.: A Machine Learning Approach toWorkflow Management. In: Lopez de Mantaras, R., Plaza, E. (eds.) ECML 2000. LNCS (LNAI), vol. 1810, pp. 183–194. Springer, Heidelberg (2000)

    Chapter  Google Scholar 

  18. Keller, G., Teufel, T.: SAP R/3 Process Oriented Implementation. Addison Wesley, Reading (1998)

    Google Scholar 

  19. de Medeiros, A.K.A., Weijters, A.J.M.M., van der Aalst, W.M.P.: Genetic Process Mining: A Basic Approach and its Challenges. In: Castellanos, M., Weijters, T. (eds.) First International Workshop on Business Process Intelligence (BPI 2005), Nancy, France, September 2005, pp. 46–57 (2005)

    Google Scholar 

  20. Zur Mühlen, M., Rosemann, M.: Workflow-based Process Monitoring and Controlling Technical and Organizational Issues. In: Sprague, R. (ed.) Proceedings of the 33rd Hawaii International Conference on System Science (HICSS-33), pp. 1–10. IEEE Computer Society Press, Los Alamitos (2000)

    Google Scholar 

  21. Rozinat, A., van der Aalst, W.M.P.: Conformance Testing: Measuring the Alignment Between Event Logs and Process Models. BETA Working Paper Series, WP 144, Eindhoven University of Technology, Eindhoven (2005)

    Google Scholar 

  22. Sarbanes, P., Oxley, G., et al.: Sarbanes-Oxley Act of 2002 (2002)

    Google Scholar 

  23. Scheer, A.W.: ARIS: Business Process Modelling. Springer, Berlin (2000)

    Google Scholar 

  24. Weber, B., Reichert, M., Rinderle, S., Wild, W.: Towards a Framework for the Agile Mining of Business Processes. In: Castellanos, M., Weijters, T. (eds.) First International Workshop on Business Process Intelligence (BPI 2005), Nancy, France, September 2005, pp. 36–45 (2005)

    Google Scholar 

  25. Weijters, A.J.M.M., van der Aalst, W.M.P.: Rediscovering Workflow Models from Event-Based Data using Little Thumb. Integrated Computer-Aided Engineering 10(2), 151–162 (2003)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Technology Management, Eindhoven University of Technology, P.O. Box 513, NL-5600 MB, Eindhoven, The Netherlands

    A. Rozinat & W. M. P. van der Aalst

  2. Department of Business Process Technology, HPI University of Potsdam, P.O. Box 900460, D-14440, Potsdam, Germany

    A. Rozinat

Authors
  1. A. Rozinat
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. W. M. P. van der Aalst
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Cisco Systems, Inc., 95134, San Jose, CA, USA

    Christoph J. Bussler

  2. DERI – National University of Ireland, IDA Business Park, Galway, Ireland

    Armin Haller

Rights and permissions

Reprints and permissions

Copyright information

© 2006 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Rozinat, A., van der Aalst, W.M.P. (2006). Conformance Testing: Measuring the Fit and Appropriateness of Event Logs and Process Models. In: Bussler, C.J., Haller, A. (eds) Business Process Management Workshops. BPM 2005. Lecture Notes in Computer Science, vol 3812. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11678564_15

Download citation

  • DOI: https://doi.org/10.1007/11678564_15

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-32595-6

  • Online ISBN: 978-3-540-32596-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation