Skip to main content

Evaluation Patterns for Design Science Research Artefacts

  • Conference paper
Practical Aspects of Design Science (EDSS 2011)

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 286))

Included in the following conference series:

Abstract

Artefact evaluation is regarded as being crucial for Design Science Research (DSR) in order to rigorously proof an artefact’s relevance for practice. The availability of guidelines for structuring DSR processes notwithstanding, the current body of knowledge provides only rudimentary means for a design researcher to select and justify appropriate artefact evaluation strategies in a given situation. This paper proposes patterns that could be used to articulate and justify artefact evaluation strategies within DSR projects. These patterns have been synthesised from prior DSR literature concerned with evaluation strategies. They distinguish both ex ante as well as ex post evaluations and reflect current DSR approaches and evaluation criteria.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. March, S.T., Smith, G.: Design and Natural Science Research on Information Technology. Decision Support Systems 15(4), 251–266 (1995)

    Article  Google Scholar 

  2. Hevner, A.R., March, S.T., Park, J., Ram, S.: Design Science in Information Systems. MIS Quarterly 28(1), 75–105 (2004)

    Google Scholar 

  3. Pries-Heje, J., Baskerville, R., Venable, J.: Strategies for Design Research Evaluation. In: 16th European Conference on Information Systems, ECIS 2008, Galway, Ireland (2008)

    Google Scholar 

  4. Cleven, A., Gubler, P., Hüner, K.M.: Design Alternatives for the Evaluation of Design Science Research Artifacts. In: 4th International Conference on Design Science Research in Information Systems and Technology, Philadelphia, PA (2009)

    Google Scholar 

  5. March, S.T., Stortey, V.C.: Design Science in the Information Systems Discipline: An Introduction to the Special Issue one Design Science Reseaerch. MIS Quarterly 32(4), 725–730 (2008)

    Google Scholar 

  6. Peffers, K., Tuunanen, T., Rothenberger, M.A., Chatterjee, S.: A Design Science Research Methodology for Information Systems Research. Journal of Management Information Systems 24(3), 45–77 (2007)

    Article  Google Scholar 

  7. Sein, M.K., Henfridsson, O., Purao, S., Rossi, M., Lindgren, R.: Action Design Research. MIS Quarterly 35(1), 37–56 (2011)

    Google Scholar 

  8. Aier, S., Fischer, C.: Criteria for Progress for Information Systems Design Theories. Information Systems and E-Business Management 9(1), 133–172 (2011)

    Article  Google Scholar 

  9. Rosemann, M., Vessey, I.: Toward Improving the Relevance of Information Systems Research to Practice: The Role of Applicability Checks. MIS Quarterly 32(1), 1–22 (2008)

    Google Scholar 

  10. Sun, Y., Kantor, P.B.: Cross-Evaluation: A new model for information system evaluation. Journal of the American Society for Information Science and Technology 57(5), 614–628 (2006)

    Article  Google Scholar 

  11. Vaishnavi, V.K., Kuechler, W.: Improving and Innovating Information & Communication Technology: Design Science Research Methods and Patterns. Taylor Francis (2008)

    Google Scholar 

  12. Zelkovitz, M.V., Wallace, D.R.: Experimental Models for Validating Technology. IEEE Computer 31(5), 21–31 (1998)

    Google Scholar 

  13. Chen, P.P.: The Entity-Relationship Model. Towards a unified view of data. ACM Transactions on Database Systems 1(1), 9–36 (1976)

    Google Scholar 

  14. vom Brocke, J., Sonnenberg, C., Baumoel, U.: Linking Accounting and Process-aware Information Systems – Towards a Generalized Information Model For Process-oriented Accounting. In: 19th European Conference on Information Systems, ECIS 2011, Helsinki, Finland (2011)

    Google Scholar 

  15. Lee, J., Wyner, G.M., Pentland, B.T.: Process Grammar as a Tool for Business Process Design. MIS Quarterly 23(4), 757–778 (2008)

    Google Scholar 

  16. Sonnenberg, C., Huemer, C., Hofreiter, B., Mayrhofer, D., Braccini, A.: The REA-DSL: A Domain Specific Modeling Language for Business Models. In: Mouratidis, H., Rolland, C. (eds.) CAiSE 2011. LNCS, vol. 6741, pp. 252–266. Springer, Heidelberg (2011)

    Chapter  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2012 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Sonnenberg, C., vom Brocke, J. (2012). Evaluation Patterns for Design Science Research Artefacts. In: Helfert, M., Donnellan, B. (eds) Practical Aspects of Design Science. EDSS 2011. Communications in Computer and Information Science, vol 286. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-33681-2_7

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-33681-2_7

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-33680-5

  • Online ISBN: 978-3-642-33681-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics