Abstract
The centrality of information technology (IT) artifacts in Information Systems (IS) research makes it important to understand the relationship between artifacts and the theoretical constructs they purport to instantiate. Despite the central role of the IT artifact in IS research, there are no generally accepted principles for establishing instantiation validity – the extent to which an artifact is a valid instantiation of a theoretical construct or a manifestation of a design principle. We survey relevant knowledge in IS and identify potential guidelines that may address threats to instantiation validity. The guidelines are intended for researchers and reviewers when using IT artifacts in theory testing and when evaluating design science artifacts.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Komiak, S.Y.X., Benbasat, I.: The effects of personalization and familiarity on trust and adoption of recommendation agents. MIS Q. 30, 941–960 (2006)
Lukyanenko, R., Evermann, J., Parsons, J.: Instantiation validity in IS design research. In: Tremblay, M.C., VanderMeer, D., Rothenberger, M., Gupta, A., Yoon, V. (eds.) DESRIST 2014. LNCS, vol. 8463, pp. 321–328. Springer, Heidelberg (2014)
Boudreau, M.-C., Gefen, D., Straub, D.W.: Validation in Information Systems Research: A State-of-the-Art Assessment. MIS Q. 25, 1–16 (2001)
Straub, D., Boudreau, M.-C., Gefen, D.: Validation guidelines for IS positivist research. Commun. Assoc. Inf. Syst. 13, 1–63 (2004)
Venable, J., Pries-Heje, J., Baskerville, R.: A comprehensive framework for evaluation in design science research. In: Peffers, K., Rothenberger, M., Kuechler, B. (eds.) DESRIST 2012. LNCS, vol. 7286, pp. 423–438. Springer, Heidelberg (2012)
Rossi, M., Sein, M.K.: Design research workshop: a proactive research approach. Present. Deliv. IRIS. 26, 9–12 (2003)
Hevner, A., Chatterjee, S.: Design Research in Information Systems: Theory and Practice. Springer (2010)
Sonnenberg, C., vom Brocke, J.: Evaluations in the science of the artificial – reconsidering the build-evaluate pattern in design science research. In: Peffers, K., Rothenberger, M., Kuechler, B. (eds.) DESRIST 2012. LNCS, vol. 7286, pp. 381–397. Springer, Heidelberg (2012)
Eriksson, C., Åkesson, M., Kautz, K.-H.: Authentic and Concurrent Evaluation: Refining an Evaluation Approach in Design Science Research. In: PACIS 2011 Proc., pp. 1–13 (2011)
Purao, S.: Truth or dare: The ontology question in design science research. J. Database Manag. JDM. 24, 51–66 (2013)
Hevner, A., March, S., Park, J., Ram, S.: Design science in information systems research. MIS Q. 28, 75–105 (2004)
Walls, J.G., Widmeyer, G.R., Sawy, O.A.E.: Building an information system design theory for vigilant EIS. Inf. Syst. Res. 3, 36–59 (1992)
Gregor, S., Hovorka, D.S.: Causality: The elephant in the room in information systems epistemology. In: 19th Eur. Conf. Inf. Syst. (2011)
Chandra, L., Seidel, S., Gregor, S.: Prescriptive Knowledge in IS Research: Conceptualiz-ing Design Principles in Terms of Materiality, Action, and Boundary Conditions. In: Hawaii Int. Conf. Syst. Sci., pp. 4039–4047 (2015)
Venkatesh, V., Brown, S.A., Bala, H.: Bridging the qualitative-quantitative divide: Guide-lines for conducting mixed methods research in information systems. MIS Q. 37, 21–54 (2013)
Benbasat, I.: Laboratory experiments in information systems studies with a focus on indi-viduals: a critical appraisal. Harvard Business School, Cambridge (1989)
Tremblay, M.C., Hevner, A.R., Berndt, D.J.: Focus Groups for Artifact Refinement and Evaluation in Design Research. Commun. Assoc. Inf. Syst. 26, 599–618 (2010)
Sein, M., Henfridsson, O., Purao, S., Rossi, M., Lindgren, R.: Action design research. MIS Q. 35, 37 (2011)
Abraham, R., Aier, S., Winter, R.: Fail Early, Fail Often: Towards Coherent Feedback Loops in Design Science Research Evaluation. In: Int. Conf. Inf. Syst., pp. 1–12 (2014)
Moore, G.C., Benbasat, I.: Development of an Instrument to Measure the Perceptions of Adopting an Information Technology Innovation. Inf. Syst. Res. 2, 192–222 (1991)
Jarvenpaa, S.L., Dickson, G.W., DeSanctis, G.: Methodological issues in experimental IS research: experiences and recommendations. MIS Q. 141–156 (1985)
Snodgrass, J.G., Vanderwart, M.: A standardized set of 260 pictures: Norms for name agreement. J. Exp. Psychol. 6, 174–215 (1980)
Lukyanenko, R., Evermann, J.: A survey of cognitive theories to support data integration. In: AMCIS 2011 Proceedings, pp. 1–15 (2011)
Lukyanenko, R., Parsons, J.: Reconciling theories with design choices in design science research. In: vom Brocke, J., Hekkala, R., Ram, S., Rossi, M. (eds.) DESRIST 2013. LNCS, vol. 7939, pp. 165–180. Springer, Heidelberg (2013)
Arazy, O., Kumar, N., Shapira, B.: A theory-driven design framework for social recom-mender systems. J. Assoc. Inf. Syst. 11, 455–490 (2010)
Lukyanenko, R., Parsons, J., Wiersma, Y.: The IQ of the Crowd: Understanding and Im-proving Information Quality in Structured User-generated Content. Inf. Syst. Res. 25, 669–689 (2014)
Burton-Jones, A., Wand, Y., Weber, R.: Guidelines for Empirical Evaluations of Concep-tual Modeling Grammars. J. Assoc. Inf. Syst. 10, 495–532 (2009)
Kuechler, W., Vaishnavi, V.: A Framework for Theory Development in Design Science Research: Multiple Perspectives. J. Assoc. Inf. Syst. 13, 395–423 (2012)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer International Publishing Switzerland
About this paper
Cite this paper
Lukyanenko, R., Evermann, J., Parsons, J. (2015). Guidelines for Establishing Instantiation Validity in IT Artifacts: A Survey of IS Research. In: Donnellan, B., Helfert, M., Kenneally, J., VanderMeer, D., Rothenberger, M., Winter, R. (eds) New Horizons in Design Science: Broadening the Research Agenda. DESRIST 2015. Lecture Notes in Computer Science(), vol 9073. Springer, Cham. https://doi.org/10.1007/978-3-319-18714-3_35
Download citation
DOI: https://doi.org/10.1007/978-3-319-18714-3_35
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-18713-6
Online ISBN: 978-3-319-18714-3
eBook Packages: Computer ScienceComputer Science (R0)