Semi-supervised Log Pattern Detection and Exploration Using Event Concurrence and Contextual Information

  • Xixi LuEmail author
  • Dirk Fahland
  • Robert Andrews
  • Suriadi Suriadi
  • Moe T. Wynn
  • Arthur H. M. ter Hofstede
  • Wil M. P. van der Aalst
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 10573)


Process mining offers a variety of techniques for analyzing process execution event logs. Although process discovery algorithms construct end-to-end process models, they often have difficulties dealing with the complexity of real-life event logs. Discovered models may contain either complex or over-generalized fragments, the interpretation of which is difficult, and can result in misleading insights. Detecting and visualizing behavioral patterns instead of creating model structures can reduce complexity and give more accurate insights into recorded behaviors. Unsupervised detection techniques, based on statistical properties of the log only, generate a multitude of patterns and lack domain context. Supervised pattern detection requires a domain expert to specify patterns manually and lacks the event log context. In this paper, we reconcile supervised and unsupervised pattern detection. We visualize the log and help users extract patterns of interest from the log or obtain patterns through unsupervised learning automatically. Pattern matches are visualized in the context of the event log (also showing concurrency and additional contextual information). Earlier patterns can be extended or modified based on the insights. This enables an interactive and iterative approach to identify complex and concrete behavioral patterns in event logs. We implemented our approach in the ProM framework and evaluated the tool using both the BPI Challenge 2012 log of a loan application process and an insurance claims log from a major Australian insurance company.


Pattern detection Log pattern Semi-supervised learning 


  1. 1.
    Leemans, S.J.J., Fahland, D., van der Aalst, W.M.P.: Discovering block-structured process models from event logs - a constructive approach. In: 2013 Proceedings of Application and Theory of Petri Nets and Concurrency, pp. 311–329 (2013)Google Scholar
  2. 2.
    Monroe, M., Lan, R., Lee, H., Plaisant, C., Shneiderman, B.: Temporal event sequence simplification. IEEE Trans. Vis. Comput. Graph. 19(12), 2227–2236 (2013)CrossRefGoogle Scholar
  3. 3.
    Jagadeesh Chandra Bose, R.P., van der Aalst, W.M.P.: Abstractions in process mining: a taxonomy of patterns. In: Dayal, U., Eder, J., Koehler, J., Reijers, H.A. (eds.) BPM 2009. LNCS, vol. 5701, pp. 159–175. Springer, Heidelberg (2009). doi: 10.1007/978-3-642-03848-8_12 CrossRefGoogle Scholar
  4. 4.
    Günther, C.W., Rozinat, A., van der Aalst, W.M.P.: Activity mining by global trace segmentation. In: Rinderle-Ma, S., Sadiq, S., Leymann, F. (eds.) BPM 2009. LNBIP, vol. 43, pp. 128–139. Springer, Heidelberg (2010). doi: 10.1007/978-3-642-12186-9_13 CrossRefGoogle Scholar
  5. 5.
    Mannhardt, F., de Leoni, M., Reijers, H.A., Aalst, W.M.P., van der Toussaint, P.J.: From low-level events to activities - a pattern-based approach. In: La Rosa, M., Loos, P., Pastor, O. (eds.) BPM 2016. LNCS, vol. 9850, pp. 125–141. Springer, Cham (2016). doi: 10.1007/978-3-319-45348-4_8 CrossRefGoogle Scholar
  6. 6.
    Maggi, F.M., Montali, M., Westergaard, M., van der Aalst, W.M.P.: Monitoring business constraints with linear temporal logic: an approach based on colored automata. In: Rinderle-Ma, S., Toumani, F., Wolf, K. (eds.) BPM 2011. LNCS, vol. 6896, pp. 132–147. Springer, Heidelberg (2011). doi: 10.1007/978-3-642-23059-2_13 CrossRefGoogle Scholar
  7. 7.
    Leemans, M., van der Aalst, W.M.P.: Discovery of frequent episodes in event logs. In: Ceravolo, P., Russo, B., Accorsi, R. (eds.) SIMPDA 2014. LNBIP, vol. 237, pp. 1–31. Springer, Cham (2015). doi: 10.1007/978-3-319-27243-6_1 CrossRefGoogle Scholar
  8. 8.
    Diamantini, C., Genga, L., Potena, D.: Behavioral process mining for unstructured processes. J. Intell. Inf. Syst. 47(1), 5–32 (2016)CrossRefGoogle Scholar
  9. 9.
    Suriadi, S., Andrews, R., ter Hofstede, A.H., Wynn, M.T.: Event log imperfection patterns for process mining: towards a systematic approach to cleaning event logs. Inf. Syst. 64, 132–150 (2017)CrossRefGoogle Scholar
  10. 10.
    Ferreira, D.R., Szimanski, F., Ralha, C.G.: Improving process models by mining mappings of low-level events to high-level activities. J. Intell. Inf. Syst. 43(2), 379–407 (2014)CrossRefGoogle Scholar
  11. 11.
    Tax, N., Sidorova, N., Haakma, R., van der Aalst, W.M.P.: Mining local process models. J. Innovation Digital Ecosyst. 3(2), 183–196 (2016)CrossRefGoogle Scholar
  12. 12.
    Baier, T., Rogge-Solti, A., Mendling, J., Weske, M.: Matching of events and activities: an approach based on behavioral constraint satisfaction. In: SAC, pp. 1225–1230. ACM (2015)Google Scholar
  13. 13.
    Song, M., van der Aalst, W.M.P.: Supporting process mining by showing events at a glance. In: Proceedings of WITS, pp. 139–145 (2007)Google Scholar
  14. 14.
    Lu, X., Fahland, D., van der Aalst, W.M.P.: Conformance checking based on partially ordered event data. In: Fournier, F., Mendling, J. (eds.) BPM 2014. LNBIP, vol. 202, pp. 75–88. Springer, Cham (2015). doi: 10.1007/978-3-319-15895-2_7 Google Scholar
  15. 15.
    Ponce-de-León, H., Rodríguez, C., Carmona, J., Heljanko, K., Haar, S.: Unfolding-based process discovery. In: Finkbeiner, B., Pu, G., Zhang, L. (eds.) ATVA 2015. LNCS, vol. 9364, pp. 31–47. Springer, Cham (2015). doi: 10.1007/978-3-319-24953-7_4 CrossRefGoogle Scholar
  16. 16.
    Mokhov, A., Carmona, J., Beaumont, J.: Mining conditional partial order graphs from event logs. In: Koutny, M., Desel, J., Kleijn, J. (eds.) Transactions on Petri Nets and Other Models of Concurrency XI. LNCS, vol. 9930, pp. 114–136. Springer, Heidelberg (2016). doi: 10.1007/978-3-662-53401-4_6 CrossRefGoogle Scholar
  17. 17.
    Diamantini, C., Genga, L., Potena, D., van der Aalst, W.M.P.: Building instance graphs for highly variable processes. Exp. Syst. Appl. 59, 101–118 (2016)CrossRefGoogle Scholar
  18. 18.
    Lu, X., et. al.: Semi-supervised log pattern detection and exploration using event concurrence and contextual information (extended version). BPM Center report BPM-17-01 (2017)Google Scholar
  19. 19.
    Leemans, S.J.J., Fahland, D., van der Aalst, W.M.P.: Scalable process discovery and conformance checking. Soft. Syst. Model. (2016)Google Scholar

Copyright information

© Springer International Publishing AG 2017

Authors and Affiliations

  • Xixi Lu
    • 1
    Email author
  • Dirk Fahland
    • 1
  • Robert Andrews
    • 2
  • Suriadi Suriadi
    • 2
  • Moe T. Wynn
    • 2
  • Arthur H. M. ter Hofstede
    • 2
  • Wil M. P. van der Aalst
    • 1
  1. 1.Eindhoven University of TechnologyEindhovenThe Netherlands
  2. 2.Queensland University of TechnologyBrisbaneAustralia

Personalised recommendations