Abstract
The consensus view is that the rigorous evaluation of design science (DS) artifacts is essential. There are many types of DS artifacts and many forms of evaluation; what is missing is guidance for how to perform the evaluation, more specifically, what evaluation methods to use with specific DS research outputs. Here we find and review 148 DS research articles published in a selected set of information systems (IS), computer science (CS) and engineering journals. We analyze the articles to develop taxonomies of DS artifact types and artifact evaluation methods; we apply these taxonomies to determine which evaluation methods are associated in the literature with particular artifacts. We show that there are several popular “artifact - evaluation method” combinations in the literature. The results inform DS researchers of usual and customary combinations of research artifacts and evaluation methods, potentially providing them with rationale and justification for an evaluation method selection.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Peffers, K., Tuunanen, T., Rothenberger, M., Chatterjee, S.: A Design Science Research Methodology for Information Systems Research. Journal of Management Information Systems 24, 45–78 (2008)
Hevner, A.R., March, S.T., Park, J.: Design Research in Information Systems Research. MIS Quarterly 28, 75–105 (2004)
McNaughton, B., Ray, P., Lewis, L.: Designing an Evaluation Framework for IT Service Management. Information & Management 47, 219–225 (2010)
Cleven, A., Gubler, P., Huner, K.: Design alternatives for the evaluation of design science research artifacts. In: Proceedings of the 4th International Conference on Design Science Research in Information Systems and Technology. ACM, Philadelphia (2009)
Son, S., Weitzel, T., Laurent, F.: Designing a process-oriented framework for IT performance management systems. The Electronic Journal of Information Systems Evaluation 8, 219–228 (2005)
Eekels, J., Roozenburg, N.F.M.: A methodological comparison of the structures of scientific research and engineering design: their similarities and differences. Design Studies 12, 197–203 (1991)
Nunamaker, J.F., Chen, M.: Systems Development in Information Systems Research. Journal of Management Information Systems 7, 89–106 (1991)
Walls, J., Widmeyer, G., El Sawy, O.: Assessing Information System Design Theory in Perspective: How Useful was our 1992 Initial Rendition. Journal of Information Technology Theory & Application (JITTA) 6, 43–58 (2004)
Walls, J., Widmeyer, G., El Sawy, O.: Building an Information System Design Theory for Vigilant EIS. Information Systems Research 3, 36–59 (1992)
Takeda, H., Veerkamp, P., Tomiyama, T., Yoshikawam, H.: Modeling design processes. AI Magazine 11, 37–48 (1990)
Sein, M.K., Henfridsson, O., Purao, S., Rossi, M., Lindgren, R.: Action design research. MIS Quarterly 35, 37–56 (2011)
AIS, http://ais.affiniscape.com/displaycommon.cfm?an=1&subarticlenbr=432
Chen, A.N.K., Goes, P.B., Marsden, J.R.: A query-driven approach to the design and managment of flexible database systems. Journal of Management Information Systems 19, 121–154 (2003)
Peffers, K., Gengler, C., Tuunanen, T.: Extending Critical Success Factors Methodology to Facilitate Broadly Participative Information Systems Planning. Journal of Management Information Systems 20, 51–85 (2003)
Kelly, G.A.: The Psychology of Personal Constructs. W W Norton & Company, New York (1955)
Mathiassen, L., Saarinen, T., Tuunanen, T., Rossi, M.: A Contingency Model for Requirements Development. Journal of Association of Information Systems 8, 569–597 (2007)
Baskerville, R., Wood-Harper, A.T.: Diversity in information systems action research methods. European Journal of Information Systems 7, 90–107 (1998)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Peffers, K., Rothenberger, M., Tuunanen, T., Vaezi, R. (2012). Design Science Research Evaluation. In: Peffers, K., Rothenberger, M., Kuechler, B. (eds) Design Science Research in Information Systems. Advances in Theory and Practice. DESRIST 2012. Lecture Notes in Computer Science, vol 7286. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-29863-9_29
Download citation
DOI: https://doi.org/10.1007/978-3-642-29863-9_29
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-29862-2
Online ISBN: 978-3-642-29863-9
eBook Packages: Computer ScienceComputer Science (R0)