International Conference on Advanced Information Systems Engineering

CAiSE 2016: Advanced Information Systems Engineering pp 67-82

Micro-Benchmarking BPMN 2.0 Workflow Management Systems with Workflow Patterns

Conference paper

DOI: 10.1007/978-3-319-39696-5_5

Volume 9694 of the book series Lecture Notes in Computer Science (LNCS)
Cite this paper as:
Skouradaki M., Ferme V., Pautasso C., Leymann F., van Hoorn A. (2016) Micro-Benchmarking BPMN 2.0 Workflow Management Systems with Workflow Patterns. In: Nurcan S., Soffer P., Bajec M., Eder J. (eds) Advanced Information Systems Engineering. CAiSE 2016. Lecture Notes in Computer Science, vol 9694. Springer, Cham

Abstract

Although Workflow Management Systems (WfMSs) are a key component in workflow technology, research work for assessing and comparing their performance is limited. This work proposes the first micro-benchmark for WfMSs that can execute BPMN 2.0 workflows. To this end, we focus on studying the performance impact of well-known workflow patterns expressed in BPMN 2.0 with respect to three open source WfMSs. We executed all the experiments under a reliable environment and produced a set of meaningful metrics. This paper contributes to the area of workflow technology by defining building blocks for more complex BPMN 2.0 WfMS benchmarks. The results have shown bottlenecks on architectural design decisions, resource utilization, and limits on the load a WfMS can sustain, especially for the cases of complex and parallel structures. Experiments on a mix of workflow patterns indicated that there are no unexpected performance side effects when executing different workflow patterns concurrently, although the duration of the individual workflows that comprised the mix was increased.

Keywords

BenchmarkingMicro-benchmarkBPMN 2.0Workflow PatternsWorkflow Management Systems

Copyright information

© Springer International Publishing Switzerland 2016

Authors and Affiliations

  1. 1.Institute of Architecture of Application Systems (IAAS)University of StuttgartStuttgartGermany
  2. 2.Faculty of InformaticsUniversity of Lugano (USI)LuganoSwitzerland
  3. 3.Institute of Software Technology (ISTE)University of StuttgartStuttgartGermany