Skip to main content
SpringerLink
Log in

A Critical Evaluation Study of Model-Log Metrics in Process Discovery

  • Conference paper
Business Process Management Workshops (BPM 2010)

Part of the book series: Lecture Notes in Business Information Processing ((LNBIP,volume 66))

Included in the following conference series:

Abstract

The development of a well-defined evaluation framework for process discovery techniques is definitely one of the most important challenges within this subdomain of process mining. Any researcher in the field will acknowledge that such a framework is vital. With this paper, we aim to provide a tangible analysis of the currently available model-log evaluation metrics for mined control-flow models. Also, we will indicate strengths and weaknesses of the existing metrics and propose a number of opportunities for future research.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Tan, P.N., Steinbach, M., Kumar, V.: Introduction to Data Mining. Addison-Wesley, Reading (2005)

    Google Scholar 

  2. Weske, M.: Business Process Management: Concepts, Languages, Architectures. Springer, Heidelberg (2007)

    Google Scholar 

  3. Rozinat, A., Veloso, M., van der Aalst, W.M.P.: Using hidden markov models to evaluate the quality of discovered process models. BPM Center Report BPM-08-10 (2008)

    Google Scholar 

  4. Weijters, A.J.M.M., van der Aalst, W.M.P., Alves de Medeiros, A.K.: Process mining with the heuristicsminer algorithm. BETA Working Paper Series 166. Eindhoven University of Technology (2006)

    Google Scholar 

  5. Greco, G., Guzzo, A., Pontieri, L., Saccà, D.: Discovering expressive process models by clustering log traces. IEEE Trans. Knowl. Data Eng. 18(8), 1010–1027 (2006)

    Article  Google Scholar 

  6. Rozinat, A., van der Aalst, W.M.P.: Conformance checking of processes based on monitoring real behavior. Information Systems 33(1), 64–95 (2008)

    Article  Google Scholar 

  7. Alves de Medeiros, A.K.: Genetic Process Mining. PhD thesis, TU Eindhoven (2006)

    Google Scholar 

  8. Goedertier, S., Martens, D., Vanthienen, J., Baesens, B.: Robust process discovery with artificial negative events. Journal of Machine Learning Research 10, 1305–1340 (2009)

    MathSciNet  MATH  Google Scholar 

  9. Alves de Medeiros, A.K., Weijters, A.J.M.M., van der Aalst, W.M.P.: Genetic process mining: an experimental evaluation. Data Mining and Knowledge Discovery 14(2), 245–304 (2007)

    Article  MathSciNet  Google Scholar 

  10. Ferreira, H., Ferreira, D.: An integrated life cycle for workflow management based on learning and planning. International Journal of Cooperative Information Systems 15(4), 485–505 (2006)

    Article  Google Scholar 

  11. van der Aalst, W.M.P., Weijters, A.J.M.M., Maruster, L.: Workflow mining: Discovering process models from event logs. IEEE Trans. Knowl. Data Eng. 16(9), 1128–1142 (2004)

    Article  Google Scholar 

  12. Rozinat, A., de Medeiros, A.K.A., Günther, C.W., Weijters, A.J.M.M., van der Aalst, W.M.P.: The need for a process mining evaluation framework in research and practice. In: Business Process Management Workshops, pp. 84–89 (2007)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Decision Sciences and Information Management, Katholieke Universiteit Leuven, Naamsestraat 69, B-3000, Leuven, Belgium

    Jochen De Weerdt, Manu De Backer, Jan Vanthienen & Bart Baesens

  2. Department of HABE, Hogeschool Gent, Universiteit Gent, Voskenslaan 2, B-9000, Ghent, Belgium

    Manu De Backer

  3. Department of Management Information Systems, University of Antwerp, Prinsstraat 13, B-2000, Antwerp, Belgium

    Manu De Backer

Authors
  1. Jochen De Weerdt
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Manu De Backer
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Jan Vanthienen
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Bart Baesens
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Stevens Institute of Technology, Howe School of Technology Management, 07030, Hoboken, NY, USA

    Michael zur Muehlen

  2. Department of Computer Science, University of California, 93106-5110, Santa Barbara, CA, USA

    Jianwen Su

Rights and permissions

Reprints and permissions

Copyright information

© 2011 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

De Weerdt, J., De Backer, M., Vanthienen, J., Baesens, B. (2011). A Critical Evaluation Study of Model-Log Metrics in Process Discovery. In: zur Muehlen, M., Su, J. (eds) Business Process Management Workshops. BPM 2010. Lecture Notes in Business Information Processing, vol 66. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-20511-8_14

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-20511-8_14

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-20510-1

  • Online ISBN: 978-3-642-20511-8

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation