Skip to main content
SpringerLink
Log in

Context may be King, but generalizability is the Emperor!

  • Commentary
  • Published:
Journal of Information Technology

Abstract

The relative importance of context and generalizability (or particularism and universalism) has long been debated in scientific research. Recently, Davison and Martinsons raised valid concerns about the possibility of false universalism in IS research, discussed its negative consequences, and made a call for explicitly including particularism in research design and reporting. In this commentary, we generally agree with the notion that context should matter more in IS research; yet, the importance of generalizability in research should not be downplayed. Specifically, we posit that generalizability should be given higher position in the scientific process and be the ultimate goal for researchers. Still, researchers need to fully understand the research context, which, in combination and replication, can help to cautiously make generalizable knowledge claims. Therefore, we characterize the relationship between context and generalizability as that of a “King” (as an analogy of the local role of context) versus the “Emperor” (as an analogy of the global role of generalizability).

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

References

  • Adomavicius, G., Sankaranarayanan, R., Sen, S. and Tuzhilin, A. (2005). Incorporating Contextual Information in Recommender Systems Using a Multidimensional Approach, ACM Transactions on Information Systems (TOIS) 23(1): 103–145.

    Article  Google Scholar 

  • Aronson, E., Wilson, T.D. and Sommers, S.R. (2013). Social Psychology, Boston: Pearson.

    Google Scholar 

  • Atasoy, H., Banker, R. and Pavlou, P.A. (2016). Firm-Level Evidence of the Longitudinal Effects of IT Use on Employment, Information Systems Research 27(1): 6–26.

    Article  Google Scholar 

  • Avgerou, C. (2001). The Significance of Context in Information Systems and Organizational Change, Information Systems Journal 11(1): 43–63.

    Article  Google Scholar 

  • Ba, S. and Pavlou, P.A. (2002). Evidence of the Effect of Trust Building Technology in Electronic Markets: Price Premiums and Buyer Behavior, MIS Quarterly 26(3): 243–268.

    Article  Google Scholar 

  • Barney, J.B. and Zhang, S. (2009). The Future of Chinese Management Research: A Theory of Chinese Management Versus a Chinese Theory of Management, Management and Organization Review 5(1): 15–28.

    Google Scholar 

  • Barro, R.J. and McCleary, R.M. (2003). Religion and Economic Growth Across Countries, American Sociological Review 68(5): 760–781.

    Article  Google Scholar 

  • Boudreau, M.-C., Gefen, D. and Straub, D.W. (2001). Validation in Information Systems Research: A State-of-the-art Assessment, MIS Quarterly 25(1): 1–16.

    Article  Google Scholar 

  • Boyd, B.K., Gove, S. and Hitt, M.A. (2005). Construct Measurement in Strategic Management Research: Illusion or Reality? Strategic Management Journal 26(3): 239–257.

    Article  Google Scholar 

  • Calder, B.J., Phillips, L.W. and Tybout, A.M. (1982). The Concept of External Validity, Journal of Consumer Research 9: 240–244.

    Article  Google Scholar 

  • Campbell, D.T. (1986). Relabeling Internal and External Validity for Applied Social Scientists, New Directions for Program Evaluation 31: 67–77.

    Article  Google Scholar 

  • Campbell, D.T. and Stanley, J.C. (1967). Experimental and Quasi Experimental Designs for Research. Chicago: Rand Mc Nally and Co Inc.

    Google Scholar 

  • Chang, A.C. and Li, P. (2015). Is Economics Research Replicable? Sixty Published Papers from Thirteen Journals Say ‘Usually Not’, SSRN. Retrieved from http://www.federalreserve.gov/econresdata/feds/2015/files/2015083pap.pdf.

  • Christenson, C. (1997). The Innovator’s Dilemma. Cambridge, MA: Harvard Business School Press.

    Google Scholar 

  • Deaton, A. (2010). Instruments, Randomization, and Learning About Development, Journal of Economic Literature 48: 424–455.

    Article  Google Scholar 

  • Dimoka, A. (2010). What Does the Brain Tell Us About Trust and Distrust? Evidence from a Functional Neuroimaging Study, MIS Quarterly 34(2): 373–396.

    Google Scholar 

  • Dimoka, A., Banker, R.D., Benbasat, I., Davis, F.D., Dennis, A.R., Gefen, D., Gupta, A., Ischebeck, A., Kenning, P.H., Pavlou, P.A., Müller-Putz, G., Riedl, R., vom Brocke, J. and Weber, B. (2012). On the Use of Neurophysiological Tools in is Research: Developing a Research Agenda for NeuroIS, MIS Quarterly 36(3): 679–719.

  • Dimoka, A., Hong, Y. and Pavlou, P.A. (2012b). On Product Uncertainty in Online Markets: Theory and Evidence, MIS Quarterly 36(2): 395–426.

    Google Scholar 

  • Dimoka, A., Pavlou, P.A. and Davis, F.D. (2010). Research Commentary – NeuroIS: The Potential of Cognitive Neuroscience for Information Systems Research, Information Systems Research 22(4): 687–702.

    Article  Google Scholar 

  • Dipboye, R.L. and Flanagan, M.F. (1979). Research Settings in Industrial and Organizational Psychology: Are Findings in the Field More Generalizable than in the Laboratory? American Psychologist 34(2): 141.

    Article  Google Scholar 

  • Ettlie, J. and Pavlou, P.A. (2006). Technology-Based New Product Development Partnerships, Decision Sciences 37(2): 117–148.

    Article  Google Scholar 

  • Gefen, D. and Pavlou, P.A. (2012). The Boundaries of Trust and Risk: The Quadratic Moderating Role of Institutional Structures, Information Systems Research 23(3): 940–959.

    Article  Google Scholar 

  • Gregor, S. (2006). The Nature of Theory in Information Systems, MIS Quarterly 30: 611–642.

    Google Scholar 

  • Heckman, J.J. and Urzua, S. (2010). Comparing IV with Structural Models: What Simple IV Can and Cannot Identify, Journal of Econometrics 156(1): 27–37.

    Article  Google Scholar 

  • Hong, W., Chan, F.K., Thong, J.Y., Chasalow, L.C. and Dhillon, G. (2013). A Framework and Guidelines for Context-Specific Theorizing in Information Systems Research, Information Systems Research 25(1): 111–136.

    Article  Google Scholar 

  • Hong, Y. and Pavlou, P.A. (2014). Product Fit Uncertainty: Nature, Effects, and Antecedents, Information Systems Research 25(2): 328–344.

    Article  Google Scholar 

  • Hong, Y., Wang, A. and Pavlou, P.A. (2015). Comparing Open and Sealed Bid Auctions: Evidence from Online Labor Markets, Information Systems Research (forthcoming).

  • Hubbard, R., Vetter, D.E. and Little, E.L. (1998). Replication in Strategic Management: Scientific Testing for Validity, Generalizability, and Usefulness, Strategic Management Journal 19(3): 243–254.

    Article  Google Scholar 

  • Imbens, G.W. (2010). Better LATE Than Nothing: Some Comments on Deaton (2009) and Heckman and Urzua (2009). Journal of the Economic Literature 48(2): 399–423.

    Article  Google Scholar 

  • Ioannidis, J.P. (2005). Why Most Published Research Findings are False, Chance 18(4): 40–47.

    Article  Google Scholar 

  • Joshi, A. and Roh, H. (2009). The Role of Context in Work Team Diversity Research: A Meta-Analytic Review, Academy of Management Journal 52(3): 599–627.

    Article  Google Scholar 

  • King, A.A. and Baatartogtokh, B. (2015). How Useful is the Theory of Disruptive Innovation? MIT Sloan Management Review 57(1): 77.

    Google Scholar 

  • Lee, A.S. and Baskerville, R.L. (2003). Generalizing Generalizability in Information Systems Research, Information Systems Research 14(3): 221–243.

    Article  Google Scholar 

  • Lee, A.S. and Baskerville, R.L. (2012). Conceptualizing Generalizability: New Contributions and a Reply, MIS Quarterly 36(3): 749–761.

    Google Scholar 

  • Lehrer, J. (2010). The Truth Wears Off, The New Yorker 13: 52.

    Google Scholar 

  • Leidner, D.E. and Kayworth, T. (2006). Review: A Review of Culture in Information Systems Research: Toward a Theory of Information Technology Culture Conflict, MIS Quarterly 30(2): 357–399.

    Google Scholar 

  • Li, L., Gao, P. and Mao, J. (2014). Research on IT in China: A Call for Greater Contextualization, Journal of Information Technology 29(3): 208–222.

    Article  Google Scholar 

  • Lukka, K. and Kasanen, E. (1995). The Problem of Generalizability: Anecdotes and Evidence in Accounting Research, Accounting, Auditing & Accountability Journal 8(5): 71–90.

    Article  Google Scholar 

  • Lynch, J.G., Jr. (1982). On the External Validity of Experiments in Consumer Research, Journal of Consumer Research 9: 225–239.

    Article  Google Scholar 

  • Lynch, J.G. (1983). The Role of External Validity in Theoretical Research, Journal of Consumer Research 10: 109–111.

    Article  Google Scholar 

  • Lynch, J.G. (1999). Theory and external validity, Journal of the Academy of Marketing Science 27(3): 367–376.

    Article  Google Scholar 

  • McGrath, J.E. and Brinberg, D. (1983). External Validity and the Research Process: A Comment on the Calder/Lynch Dialogue, Journal of Consumer Research 10(1): 115–124.

    Article  Google Scholar 

  • Miller, A. and Dess, G.G. (1993). Assessing Porter’s (1980) Model in Terms of Its Generalizability, Accuracy and Simplicity, Journal of Management Studies 30(4): 553–585.

    Article  Google Scholar 

  • Mingers, J. (2001). Combining IS Research Methods: Towards a Pluralist Methodology, Information Systems Research 12(3): 240–259.

    Article  Google Scholar 

  • Mook, D.G. (1983). In Defense of External Invalidity, American Psychologist 38(4): 379.

    Article  Google Scholar 

  • Open Science Collaboration. (2015). Estimating the Reproducibility of Psychological Science, Science 349(6251): aac4716.

  • Pang, M.-S., Tafti, A. and Krishnan, M.S. (2014). Information Technology and Administrative Efficiency in US State Governments: A Stochastic Frontier Approach, Management Information Systems Quarterly 38(4): 1079–1101.

    Google Scholar 

  • Pavlou, P.A. (2011). State of the Information Privacy Literature: Where are We Now and Where Should We Go? MIS Quarterly 35(4): 977–988.

    Google Scholar 

  • Pavlou, P.A. and Dimoka, A. (2006). The Nature and Role of Feedback Text Comments in Online Marketplaces: Implications for Trust Building, Price Premiums, and Seller Differentiation, Information Systems Research 17(4): 391–412.

    Article  Google Scholar 

  • Pavlou, P.A. and El Sawy, O.A. (2006). From IT Leveraging Competence to Competitive Advantage in Turbulent Environments: The Case of New Product Development, Information Systems Research 17(3): 198–227.

    Article  Google Scholar 

  • Pavlou, P.A. and Fygenson, M. (2006). Understanding and Predicting Electronic Commerce Adoption: An Extension of the Theory of Planned Behavior, MIS Quarterly 30(1): 115–143.

    Google Scholar 

  • Polit, D.F. and Beck, C.T. (2010). Generalization in Quantitative and Qualitative Research: Myths and Strategies, International Journal of Nursing Studies 47(11): 1451–1458.

    Article  Google Scholar 

  • Rai, A., Pavlou, P.A., Im, G. and Steve, D. (2012). Inter-firm IT Capability Profiles and Communications for Co-Creating Relational Value: Evidence from the Logistics Industry, MIS Quarterly 36(1): 233–262.

    Google Scholar 

  • Rosenzweig, P.M. (1994). When can Management Science Research be Generalized Internationally? Management Science 40(1): 28–39.

    Article  Google Scholar 

  • Rousseau, D.M. and Fried, Y. (2001). Location, Location, Location: Contextualizing Organizational Research, Journal of organizational behavior 22(1): 1–13.

    Article  Google Scholar 

  • Scandura, T.A. and Williams, E.A. (2000). Research Methodology in Management: Current Practices, Trends, and Implications for Future Research, Academy of Management Journal 43(6): 1248–1264.

    Article  Google Scholar 

  • Seddon, P.B. and Scheepers, R. (2012). Towards the Improved Treatment of Generalization of Knowledge Claims in IS Research: Drawing general Conclusions from Samples, European Journal of Information Systems 21(1): 6–21.

    Article  Google Scholar 

  • Seddon, P.B. and Scheepers, R. (2015). Generalization in IS Research: A Critique of the Conflicting Positions of Lee & Baskerville and Tsang & Williams, Journal of Information Technology 30(1): 30–43.

    Article  Google Scholar 

  • Shadish, W.R., Cook, T.D. and Campbell, D.T. (2002), Experimental and Quasi-Experimental Designs for Generalized Causal Inference. Belmont, CA: Wadsworth Cengage Learning.

    Google Scholar 

  • Short, J.C., Ketchen, D.J. and Palmer, T.B. (2002). The Role of Sampling in Strategic Management Research on Performance: A Two-Study Analysis, Journal of Management 28(3): 363–385.

    Article  Google Scholar 

  • Smith, H.J., Dinev, T. and Xu, H. (2011). Information Privacy Research: An Interdisciplinary Review, MIS Quarterly 35(4): 989–1016.

    Google Scholar 

  • Tsui, A.S. (2006). Contextualization in Chinese Management Research, Management and Organization Review 2(1): 1–13.

    Article  Google Scholar 

  • Venkatraman, V., Dimoka, A., Pavlou, P.A., Vo, K., Hampton, W., Bollinger, B., Hershfield, H.E., Ishihara, M. and Winer, R.S. (2014). Predicting Advertising Success Beyond Traditional Measures: New Insights from Neurophysiological Methods and Market Response Modeling, Journal of Marketing Research 52(4): 436–452.

    Article  Google Scholar 

  • Williams, J. and Tsang, E. (2012). Generalization and Hume’s Problem of Induction: Misconceptions and Clarifications, Management Information Systems Quarterly 36(3): 729–748.

    Google Scholar 

  • Yin, R. (1994). Case Study Research: Design and Methods. Beverly Hills, CA: Sage.

    Google Scholar 

  • Young, C. (2009). Model Uncertainty in Sociological Research: An Application to Religion and Economic Growth, American Sociological Review 74(3): 380–397.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Fox School of Business, Temple University, Philadelphia, USA

    Zhi (Aaron) Cheng, Angelika Dimoka & Paul A. Pavlou

Authors
  1. Zhi (Aaron) Cheng
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Angelika Dimoka
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Paul A. Pavlou
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Zhi (Aaron) Cheng.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Cheng, Z., Dimoka, A. & Pavlou, P.A. Context may be King, but generalizability is the Emperor!. J Inf Technol 31, 257–264 (2016). https://doi.org/10.1057/s41265-016-0005-7

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1057/s41265-016-0005-7

Search

Navigation