Towards Creating Business Process Models from Images

Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11236)


Business process modeling is an integral task needed for efficient running of business operations. Often process models remain buried in unstructured documents as images or screenshots. Such embedded process model images may become quickly obsolete as the underlying business process evolves. Thus, there is value in digitizing the unstructured images. We propose a novel automated solution to transform a process model image into the standard Business Process Model and Notation (BPMN) format. Our deep-learning based approach performs well in practice achieving good precision and recall.


Business process models Image processing Deep learning 


  1. 1.
    Hull, R., Motahari Nezhad, H.R.: Rethinking BPM in a cognitive world: transforming how we learn and perform business processes. In: La Rosa, M., Loos, P., Pastor, O. (eds.) BPM 2016. LNCS, vol. 9850, pp. 3–19. Springer, Cham (2016). Scholar
  2. 2.
    OMG: About the Business Process Model and Notation Specification Version 2.0 (2011).
  3. 3.
    Mitchell, T.M.: Machine Learning. McGraw-Hill, Inc., New York City (1997)zbMATHGoogle Scholar
  4. 4.
    ITSEEZ: The Open Source Computer Vision Library Reference Manual, edn. April 2014Google Scholar
  5. 5.
    Smith, R.: An overview of the tesseract OCR engine. In: Proceedings of the Ninth International Conference on Document Analysis and Recognition, vol. 2 (2007)Google Scholar
  6. 6.
    Sethi, A., Sankaran, A., Panwar, N., Khare, S., Mani, S.: DLPaper2Code: auto-generation of code from deep learning research papers. CoRR abs/1711.03543 (2017).
  7. 7.
    Bhatia, S., Mitra, P.: Summarizing figures, tables, and algorithms in scientific publications to augment search results. ACM Trans. Inf. Syst. 30(1), 3:1–3:24 (2012)CrossRefGoogle Scholar
  8. 8.
    Ray Choudhury, S., Giles, C.L.: An architecture for information extraction from figures in digital libraries. In: Proceedings of the 24th International Conference on World Wide Web (2015)Google Scholar
  9. 9.
    Böschen, F., Scherp, A.: Formalization and preliminary evaluation of a pipeline for text extraction from infographics (2015)Google Scholar

Copyright information

© Springer Nature Switzerland AG 2018

Authors and Affiliations

  1. 1.IBM Research AIBengaluruIndia

Personalised recommendations