Skip to main content

Guidelines for Establishing Instantiation Validity in IT Artifacts: A Survey of IS Research

  • Conference paper
New Horizons in Design Science: Broadening the Research Agenda (DESRIST 2015)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 9073))

Abstract

The centrality of information technology (IT) artifacts in Information Systems (IS) research makes it important to understand the relationship between artifacts and the theoretical constructs they purport to instantiate. Despite the central role of the IT artifact in IS research, there are no generally accepted principles for establishing instantiation validity – the extent to which an artifact is a valid instantiation of a theoretical construct or a manifestation of a design principle. We survey relevant knowledge in IS and identify potential guidelines that may address threats to instantiation validity. The guidelines are intended for researchers and reviewers when using IT artifacts in theory testing and when evaluating design science artifacts.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
EUR 32.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or Ebook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Similar content being viewed by others

References

  1. Komiak, S.Y.X., Benbasat, I.: The effects of personalization and familiarity on trust and adoption of recommendation agents. MIS Q. 30, 941–960 (2006)

    Google Scholar 

  2. Lukyanenko, R., Evermann, J., Parsons, J.: Instantiation validity in IS design research. In: Tremblay, M.C., VanderMeer, D., Rothenberger, M., Gupta, A., Yoon, V. (eds.) DESRIST 2014. LNCS, vol. 8463, pp. 321–328. Springer, Heidelberg (2014)

    Chapter  Google Scholar 

  3. Boudreau, M.-C., Gefen, D., Straub, D.W.: Validation in Information Systems Research: A State-of-the-Art Assessment. MIS Q. 25, 1–16 (2001)

    Article  Google Scholar 

  4. Straub, D., Boudreau, M.-C., Gefen, D.: Validation guidelines for IS positivist research. Commun. Assoc. Inf. Syst. 13, 1–63 (2004)

    Google Scholar 

  5. Venable, J., Pries-Heje, J., Baskerville, R.: A comprehensive framework for evaluation in design science research. In: Peffers, K., Rothenberger, M., Kuechler, B. (eds.) DESRIST 2012. LNCS, vol. 7286, pp. 423–438. Springer, Heidelberg (2012)

    Chapter  Google Scholar 

  6. Rossi, M., Sein, M.K.: Design research workshop: a proactive research approach. Present. Deliv. IRIS. 26, 9–12 (2003)

    Google Scholar 

  7. Hevner, A., Chatterjee, S.: Design Research in Information Systems: Theory and Practice. Springer (2010)

    Google Scholar 

  8. Sonnenberg, C., vom Brocke, J.: Evaluations in the science of the artificial – reconsidering the build-evaluate pattern in design science research. In: Peffers, K., Rothenberger, M., Kuechler, B. (eds.) DESRIST 2012. LNCS, vol. 7286, pp. 381–397. Springer, Heidelberg (2012)

    Chapter  Google Scholar 

  9. Eriksson, C., Åkesson, M., Kautz, K.-H.: Authentic and Concurrent Evaluation: Refining an Evaluation Approach in Design Science Research. In: PACIS 2011 Proc., pp. 1–13 (2011)

    Google Scholar 

  10. Purao, S.: Truth or dare: The ontology question in design science research. J. Database Manag. JDM. 24, 51–66 (2013)

    Article  Google Scholar 

  11. Hevner, A., March, S., Park, J., Ram, S.: Design science in information systems research. MIS Q. 28, 75–105 (2004)

    Google Scholar 

  12. Walls, J.G., Widmeyer, G.R., Sawy, O.A.E.: Building an information system design theory for vigilant EIS. Inf. Syst. Res. 3, 36–59 (1992)

    Article  Google Scholar 

  13. Gregor, S., Hovorka, D.S.: Causality: The elephant in the room in information systems epistemology. In: 19th Eur. Conf. Inf. Syst. (2011)

    Google Scholar 

  14. Chandra, L., Seidel, S., Gregor, S.: Prescriptive Knowledge in IS Research: Conceptualiz-ing Design Principles in Terms of Materiality, Action, and Boundary Conditions. In: Hawaii Int. Conf. Syst. Sci., pp. 4039–4047 (2015)

    Google Scholar 

  15. Venkatesh, V., Brown, S.A., Bala, H.: Bridging the qualitative-quantitative divide: Guide-lines for conducting mixed methods research in information systems. MIS Q. 37, 21–54 (2013)

    Google Scholar 

  16. Benbasat, I.: Laboratory experiments in information systems studies with a focus on indi-viduals: a critical appraisal. Harvard Business School, Cambridge (1989)

    Google Scholar 

  17. Tremblay, M.C., Hevner, A.R., Berndt, D.J.: Focus Groups for Artifact Refinement and Evaluation in Design Research. Commun. Assoc. Inf. Syst. 26, 599–618 (2010)

    Google Scholar 

  18. Sein, M., Henfridsson, O., Purao, S., Rossi, M., Lindgren, R.: Action design research. MIS Q. 35, 37 (2011)

    Google Scholar 

  19. Abraham, R., Aier, S., Winter, R.: Fail Early, Fail Often: Towards Coherent Feedback Loops in Design Science Research Evaluation. In: Int. Conf. Inf. Syst., pp. 1–12 (2014)

    Google Scholar 

  20. Moore, G.C., Benbasat, I.: Development of an Instrument to Measure the Perceptions of Adopting an Information Technology Innovation. Inf. Syst. Res. 2, 192–222 (1991)

    Article  Google Scholar 

  21. Jarvenpaa, S.L., Dickson, G.W., DeSanctis, G.: Methodological issues in experimental IS research: experiences and recommendations. MIS Q. 141–156 (1985)

    Google Scholar 

  22. Snodgrass, J.G., Vanderwart, M.: A standardized set of 260 pictures: Norms for name agreement. J. Exp. Psychol. 6, 174–215 (1980)

    Google Scholar 

  23. Lukyanenko, R., Evermann, J.: A survey of cognitive theories to support data integration. In: AMCIS 2011 Proceedings, pp. 1–15 (2011)

    Google Scholar 

  24. Lukyanenko, R., Parsons, J.: Reconciling theories with design choices in design science research. In: vom Brocke, J., Hekkala, R., Ram, S., Rossi, M. (eds.) DESRIST 2013. LNCS, vol. 7939, pp. 165–180. Springer, Heidelberg (2013)

    Chapter  Google Scholar 

  25. Arazy, O., Kumar, N., Shapira, B.: A theory-driven design framework for social recom-mender systems. J. Assoc. Inf. Syst. 11, 455–490 (2010)

    Google Scholar 

  26. Lukyanenko, R., Parsons, J., Wiersma, Y.: The IQ of the Crowd: Understanding and Im-proving Information Quality in Structured User-generated Content. Inf. Syst. Res. 25, 669–689 (2014)

    Article  Google Scholar 

  27. Burton-Jones, A., Wand, Y., Weber, R.: Guidelines for Empirical Evaluations of Concep-tual Modeling Grammars. J. Assoc. Inf. Syst. 10, 495–532 (2009)

    Google Scholar 

  28. Kuechler, W., Vaishnavi, V.: A Framework for Theory Development in Design Science Research: Multiple Perspectives. J. Assoc. Inf. Syst. 13, 395–423 (2012)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Roman Lukyanenko .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2015 Springer International Publishing Switzerland

About this paper

Cite this paper

Lukyanenko, R., Evermann, J., Parsons, J. (2015). Guidelines for Establishing Instantiation Validity in IT Artifacts: A Survey of IS Research. In: Donnellan, B., Helfert, M., Kenneally, J., VanderMeer, D., Rothenberger, M., Winter, R. (eds) New Horizons in Design Science: Broadening the Research Agenda. DESRIST 2015. Lecture Notes in Computer Science(), vol 9073. Springer, Cham. https://doi.org/10.1007/978-3-319-18714-3_35

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-18714-3_35

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-18713-6

  • Online ISBN: 978-3-319-18714-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics