Journal of Information Technology

, Volume 32, Issue 1, pp 85–109 | Cite as

Engaging scientometrics in information systems

  • Nik R Hassan
  • Claudia Loebbecke
State of the Art


Although scientometrics is seeing increasing use in Information Systems (IS) research, in particular for evaluating research efforts and measuring scholarly influence; historically, scientometric IS studies are focused primarily on ranking authors, journals, or institutions. Notwithstanding the usefulness of ranking studies for evaluating the productivity of the IS field’s formal communication channels and its scholars, the IS field has yet to exploit the full potential that scientometrics offers, especially towards its progress as a discipline. This study makes a contribution by raising the discourse surrounding the value of scientometric research in IS, and proposes a framework that uncovers the multi-dimensional bases for citation behaviour and its epistemological implications on the creation, transfer, and growth of IS knowledge. Having identified 112 empirical research evaluation studies in IS, we select 44 substantive scientometric IS studies for in-depth content analysis. The findings from this review allow us to map an engaging future in scientometric research, especially towards enhancing the IS field’s conceptual and theoretical development.


research evaluation scientometrics bibliometrics citation analysis dimensions of citations sociology of science 


Supplementary material

41265_2016_20_MOESM1_ESM.doc (191 kb)
Supplementary Information


  1. Alvesson, M. and Sandberg, J. (2013). Constructing Research Questions: Doing interesting research, Thousand Oaks, CA: SAGE Publications.CrossRefGoogle Scholar
  2. Anderson, M.H. (2006). How Can We Know What We Think until We See What We Said?: A citation and citation context analysis of Karl Weick’s The Social Psychology of Organizing, Organization Studies 27(11): 1675–1692.CrossRefGoogle Scholar
  3. Ball, P. (2005). Index Aims for Fair Ranking of Scientists, Nature 436(7053): 900.CrossRefGoogle Scholar
  4. Banting, F.G. and Best, C.H. (1922). The Internal Secretion of the Pancreas, Journal of Laboratory and Clinical Medicine 7(5): 251–266.Google Scholar
  5. Banville, C. and Landry, M. (1989). Can the Field of MIS be Disciplined? Communications of the ACM 32(1): 48–60.CrossRefGoogle Scholar
  6. Bazeley, P. (2013). Qualitative Data Analysis: Practical strategies, London: SAGE.Google Scholar
  7. Benbasat, I. and Zmud, R.W. (1999). Empirical Research in Information Systems: The Practice of Relevance, MIS Quarterly 23(1): 3–16.CrossRefGoogle Scholar
  8. Benbasat, I. and Zmud, R. (2003). The Identity Crisis Within the IS Discipline: Defining and Communicating the discipline’s core Properties, MIS Quarterly 27(2): 183–194.Google Scholar
  9. Blumer, H. (1969). Symbolic Interactionism: Perspective and Method, Berkeley: University of California Press.Google Scholar
  10. Bontis, N. and Serenko, A. (2009). A Follow-up Ranking of Academic Journals, Journal of Knowledge Management 13(1): 16–26.CrossRefGoogle Scholar
  11. Bornmann, L. and Daniel, H.-D. (2008). What Do Citation Counts Measure? A review of studies on citing behavior, Journal of Documentation 64(1): 45–80.CrossRefGoogle Scholar
  12. Brooks, T.A. (1986). Evidence of Complex Citer Motivations, Journal of the American Society for Information Science 37(1): 34–36.CrossRefGoogle Scholar
  13. Brooks, T.A. (1995). People, Words, and Perceptions: A phenomenological investigation of textuality, Journal of the American Society for Information Science 46(2): 103–115.CrossRefGoogle Scholar
  14. Butler, T. (1998). Towards a Hermeneutic Method for Interpretive Research in Information Systems, Journal of Information Technology 13(4): 285–300.CrossRefGoogle Scholar
  15. Callon, M., Courtial, J.-P. and Laville, F. (1991). Co-Word Analysis as a Tool for Describing the Network of Interactions Between Basic and Technological Research: The case of polymer chemsitry, Scientometrics 22(1): 155–205.CrossRefGoogle Scholar
  16. Callon, M., Law, J. and Rip, A. (1986). Mapping the Dynamics of Science and Technology: Sociology of science in the real world, London: Palgrave Macmillan.CrossRefGoogle Scholar
  17. Chen, C. and Hicks, D. (2004). Tracing Knowledge Diffusion, Scientometrics 59(2): 199–211.CrossRefGoogle Scholar
  18. Cheon, M.J., Choong, C.L. and Grover, V. (1992). Research in MIS – Points of Work and Reference: A replication and extension of the Culnan and Swanson study, Data Base 23(2): 21–29.CrossRefGoogle Scholar
  19. Chua, C., Cao, L., Cousins, K. and Straub, D.W. (2002). Measuring Researcher-Production in Information Systems, Journal of the Association for Information Systems 3(6): 145–215.Google Scholar
  20. Chubin, D.E. and Moitra, S.D. (1975). Content Analysis of References: Adjunct or alternative to citation counting, Social Studies of Science 5(4): 423–441.CrossRefGoogle Scholar
  21. Clark, K.E. (1957). America's Psychologists: A survey of a growing profession, Washington DC: American Psychological Association.CrossRefGoogle Scholar
  22. Cocosila, M., Serenko, A. and Turel, O. (2009). A Scientometric Study of Information Systems Conferences: Exploring ICIS, PACIS and ASAC, Americas Conference on Information Systems (AMCIS), (6–9 August, San Francisco, CA) Paper 434.Google Scholar
  23. Cocosila, M., Serenko, A. and Turel, O. (2011). Exploring the Management Information Systems Discipline: A scientometric study of ICIS, PACIS and ASAC, Scientometrics 87(1): 1–16.CrossRefGoogle Scholar
  24. Cohen, A.M. and Hersh, W.R. (2005). A Survey of Current Work in Biomedical Text Mining, Briefings in Bioinformatics 6(1): 57–71.CrossRefGoogle Scholar
  25. Cole, J.R. and Cole, S. (1973). Social Stratification in Science, Chicago, IL: University of Chicago Press.Google Scholar
  26. Cole, M. and Avison, D. (2007). The Potential of Hermeneutics in Information Systems Research, European Journal of Information Systems 16(6): 820–833.CrossRefGoogle Scholar
  27. Cole, S. and Cole, J.R. (1967). Scientific Output And Recognition: A study in the operation of the reward system in science, American Sociological Review 32(3): 377–390.CrossRefGoogle Scholar
  28. Conway, M. (2006). The Subjective Precision of Computers: A methodological comparison with human coding in content analysis, Journalism & Mass Communication Quarterly 83(1): 183–200.CrossRefGoogle Scholar
  29. Cooper, R.B., Blair, D. and Pao, M. (1993). Communicating MIS Research: A citation study of journal influence, Information Processing and Management 29(1): 113–127.CrossRefGoogle Scholar
  30. Costanza, R., Stern, D., Fisher, B., He, L. and Ma, C. (2004). Influential Publications in Ecological Economics: A citation analysis, Ecological Economics 50(3–4): 261–292.CrossRefGoogle Scholar
  31. Coulter, N., Monarch, I. and Konda, S. (1998). Software Engineering as Seen Through its Research Literature: A study in co-word analysis, Journal of the American Society for Information Science 49(13): 1206–1223.CrossRefGoogle Scholar
  32. Cozzens, S.E. (1981). Taking the Measure of Science: A review of citation theories, Newsletter of the International Society for the Sociology of Knowledge 7(1–2): 16–21.Google Scholar
  33. Cozzens, S.E. (1985). Comparing the Sciences: Citation context analysis of papers from neuropharmacology and the sociology of science, Social Studies of Science 15(1): 127–153.CrossRefGoogle Scholar
  34. Cozzens, S.E. (1989). What do Citations Count? The rhetoric-first model, Scientometrics 15(5–6): 437–447.CrossRefGoogle Scholar
  35. Cronin, B. (1984). The Citation Process: The role and significance of citations in scientific communication, London: Taylor Graham.Google Scholar
  36. Cronin, B. (1998). Metatheorizing Citation, Scientometrics 43(1): 45–55.CrossRefGoogle Scholar
  37. Cronin, B. (2000). Semiotics and Evaluative Bibliometrics, Journal of Documentation 56(4): 440–453.CrossRefGoogle Scholar
  38. Cuellar, M., Takeda, H. and Truex, III D.P. (2008). The Hirsch family of bibliometric indices as an improved measure of IS academic journal impact, Americas Conference on Information Systems (AMCIS 2008), (14–17 August, Toronto, CA) Article 295.Google Scholar
  39. Culnan, M.J. (1986). The Intellectual Development Of Management Information Systems, 1972–1982: A co-citation analysis, Management Science 32(2): 156–172.CrossRefGoogle Scholar
  40. Culnan, M.J. (1987). Mapping the Intellectual Structure of MIS, 1980–85: A co-citation analysis, MIS Quarterly 11(3): 340–353.CrossRefGoogle Scholar
  41. Culnan, M.J. and Swanson, E.B. (1986). Research in Management Information Systems, 1980–1984: Points of work and reference, MIS Quarterly 10(3): 289–302.CrossRefGoogle Scholar
  42. DiMaggio, P.J. and Powell, W.W. (1983). The Iron Cage Revisited: Institutional isomorphism and collective rationality in organizational fields, American Sociological Review 48(2): 147–160.CrossRefGoogle Scholar
  43. Duncan, W.J., Ford, E.W., Rousculp, M.D. and Ginter, P.M. (2002). Community of Scholars: An exploratory study of management laureates, Scientometrics 55(3): 395–409.CrossRefGoogle Scholar
  44. Duriau, V.J., Reger, R.K. and Pfarrer, M.D. (2007). A Content Analysis of the Content Analysis Literature in Organization Studies: Research themes, data sources, and methodological refinements, Organizational Research Methods 10(1): 5–34.CrossRefGoogle Scholar
  45. Eom, S.B. (1996). Mapping the Intellectual Structure of Research in Decision Support Systems through Author Cocitation Analysis, Decision Support Systems 16(4): 315–338.CrossRefGoogle Scholar
  46. Eom, S.B. and Farris, R.S. (1996). The Contributions of Organizational Science to the Development of Decision Support Systems research Subspecialties, Journal of the American Society for Information Science 47(12): 941–952.CrossRefGoogle Scholar
  47. Eom, S.B., Lee, S.M. and Kim, J. (1993). The Intellectual Structure of Decision Support Systems (1971–1989), Decision Support Systems 10(1): 19–36.CrossRefGoogle Scholar
  48. Fairclough, N. (2003). Analysing Discourse: Textual Analysis for Social Research, London: Routledge.Google Scholar
  49. Fanelli, D. (2009). How Many Scientists Fabricate and Falsify Research? A systematic review and meta-analysis of survey data, PLoS ONE 4(5): e5738.CrossRefGoogle Scholar
  50. Gadamer, H.-G. (1976). Philosophical Hermeneutics, Berkeley: University of California Press.Google Scholar
  51. Gallivan, M. (2010). Analyzing Frequent Collaborators in the IS Field: What can we learn about IS coauthorship in general? Americas Conference on Information Systems (AMCIS 2010), (12–15 August, Lima, Peru) Paper 581.Google Scholar
  52. Garfield, E. (1955). Citation Indexes for Science: A new dimension in documentation through association of ideas, Science 122(3159): 108–111.CrossRefGoogle Scholar
  53. Garfield, E. (1963). Science Citation Index: Introduction, in science citation index, Philadelphia, PA: Institute for Scientific Information.Google Scholar
  54. Garfield, E. (1970). Citation Indexing, Historio-Bibliography, and the Sociology of Science, in Proceedings of the Third International Congress of Medical Librarianship, (Amsterdam, The Netherlands) Excerpta Medica, 187–204.Google Scholar
  55. Garfield, E. (1972). Citation Analysis as a Tool in Journal Evaluation, Science 178(4060): 471–479.CrossRefGoogle Scholar
  56. Garfield, E. (1979a). The Application of Citation Indexing to the Patent Literature, in Citation Indexing – Its theory and application in science, technology, and humanities, New York: John Wiley & Sons, pp. 37–40.Google Scholar
  57. Garfield, E. (1979b). The Citation Index as a Search Tool, in Citation Indexing – Its theory and application in science, technology, and humanities, New York: John Wiley & Sons, pp. 41–61.Google Scholar
  58. Garfield, E. (1979c). A Science-Management Tool, in Citation Indexing – Its theory and application in science, technology, and humanities, New York: John Wiley & Sons, pp. 62–80.Google Scholar
  59. Garfield, E. (2004). Historiographic Mapping of Knowledge Domains Literature, Journal of Information Science 30(2): 119–145.CrossRefGoogle Scholar
  60. Garfield, E. and Malin, M.V. (1968). Can Nobel Prize Winners be Predicted? University of Pennsylvania [WWW document] (accessed 30 December 2006).
  61. Garfield, E., Sher, I.H. and Torpie, R.J. (1964). The Use of Citation Data in Writing the History of Science, Philadelphia, PA: Institute for Scientific Information (ISI).Google Scholar
  62. Garfield, E. and Welljams-Dorof, A. (1990). The Impact of Fraudulent Research on the Scientific Literature: The Stephen E. Breuning case, Journal of the American Medical Association 263(10): 1424–1426.CrossRefGoogle Scholar
  63. Gephart, R. (1997). Hazardous Measures: An interpretive textual analysis of quantitative sensemaking during crises, Journal of Organizational Behavior 18(S1): 583–622.CrossRefGoogle Scholar
  64. Ghose, A. (2009). Internet Exchanges for used Goods: An empirical analysis of trade patterns and adverse selection, MIS Quarterly 33(2): 263–291.Google Scholar
  65. Gibbons, M. and Georghiou, L. (1987). Evaluation of Research: A selection of current practices, Paris: Organization for Economic Cooperation and Development (OECD).Google Scholar
  66. Gilbert, G.N. (1976). The Transformation of Research Findings into Scientific Knowledge, Social Studies of Science 6(3/4): 281–306.CrossRefGoogle Scholar
  67. Gilbert, G.N. (1977). Referencing as Persuasion, Social Studies of Science 7(1): 113–122.CrossRefGoogle Scholar
  68. Gilbert, G.N. (1978). Measuring the Growth of Science, Scientometrics 1(1): 9–34.CrossRefGoogle Scholar
  69. Goes, P.B. (2015). Editor’s Comment. Inflection Point: Looking back or looking forward? MIS Quarterly 39(3): iii–vii.Google Scholar
  70. Gray, P. (2009). Journal Self-Citation I: Overview of the journal self-citation papers – The wisdom of the IS crowd, Communications of the Association for Information Systems 25(1): 1–10.Google Scholar
  71. Griffith, B.C. and Mullins, N.C. (1972). Coherent Social Groups in Scientific Change, Science 177(4053): 959–964.CrossRefGoogle Scholar
  72. Griffith, B.C., Small, H.G., Stonehill, J.A. and Dey, S. (1974). The Structure of Scientific Literatures II: Toward a macro- and microstructure for science, Science Studies 4(4): 339–365.CrossRefGoogle Scholar
  73. Groot, T. and García-Valderrama, T. (2006). Research Quality and Efficiency: An analysis of assessments and management issues in Dutch economics and business research programs, Research Policy 35(9): 1362–1376.CrossRefGoogle Scholar
  74. Grover, V., Ayyagari, R., Gokhale, R. and Lim, J. (2006a). About Reference Disciplines and Reference Differences: A critique of Wade et al., Journal of the Association for Information Systems 7(5): 336–350.Google Scholar
  75. Grover, V., Ayyagari, R., Gokhale, R., Lim, J. and Coffey, J. (2006b). A Citation Analysis of the Evolution and State of Information Systems Within a Constellation of Reference Disciplines, Journal of the Association for Information Systems 7(5): 270–325.Google Scholar
  76. Hagstrom, W.O. (1971). Inputs, Outputs, and the Prestige of University Science Departments, Sociology of Education 44(4): 375–397.CrossRefGoogle Scholar
  77. Hamilton, S. and Ives, B. (1982). Knowledge Utilization among MIS Researchers, MIS Quarterly 20(3): 61–77.CrossRefGoogle Scholar
  78. Hansen, S., Lyytinen, K. and Markus, M.L. (2006). The Legacy of ‘Power and Politics’ in Disciplinary Discourse: A citation analysis, 27th International Conference for Information Systems (ICIS), (10–13 December, Milwaukee, WI).Google Scholar
  79. Hassan, N.R. (2014). Paradigm Lost … Paradigm Gained: A hermeneutical rejoinder to Banville and Landry’s ‘can the field of MIS be disciplined?’, European Journal of Information Systems 23(6): 600–615.CrossRefGoogle Scholar
  80. Hirsch, J.E. (2005). An Index to Quantify an Individual’s Scientific Research Output, Proceedings of the National Academy of Sciences of the United States of America 102(46): 16569–16572.CrossRefGoogle Scholar
  81. Hjørland, B. (2000). Relevance research: The missing perspective(s): ‘Non-relevance’ and ‘epistemological relevance’, Journal of the American Society for Information Science and Technology 51(2): 209–211.CrossRefGoogle Scholar
  82. Holsti, O.R. (1969). Content Analysis for the Social Sciences and Humanities, Reading, MA: Addison-Wesley Publishing Company.Google Scholar
  83. Husserl, E. (1911/1965). Philosophy as Rigorous Science, in Q. Lauer (ed.) Phenomenology and the Crisis of Philosophy, New York: Harper and Row.Google Scholar
  84. Igami, M. (2008). Exploration of the Evolution of Nanotechnology via Mapping of Patent Applications, Scientometrics 77(2): 289–308.CrossRefGoogle Scholar
  85. Jaffe, A.B. and Trajtenberg, M. (2002). Patents, Citations, and Innovations a Window on the Knowledge Economy, Cambridge, MA: MIT Press.Google Scholar
  86. Jaffe, A.B., Trajtenberg, M. and Henderson, R. (1993). Geographic Localization of Knowledge Spillovers as Evidenced by Patent Citations, Quarterly Journal of Economics 108(3): 577–598.CrossRefGoogle Scholar
  87. Kabanoff, B. (1997). Introduction: Computers can Read as well as Count: Computer-aided text analysis in organizational research, Journal of Organizational Behavior 18(S1): 507–511.CrossRefGoogle Scholar
  88. Kaplan, N. (1965). The Norms of Citation Behavior: Prolegomena to the footnote, American Documentation 16(3): 179–184.CrossRefGoogle Scholar
  89. Katerattanakul, P., Han, B. and Hong, S. (2003). Objective Quality Ranking of Computing Journals, Communications of the ACM 46(10): 111–114.CrossRefGoogle Scholar
  90. Katerattanakul, P., Han, B. and Rea, A. (2006). Is Information Systems a Reference Discipline? Communications of the ACM 49(5): 114–118.CrossRefGoogle Scholar
  91. Keen, P.G.W. (1980). MIS Research: Reference disciplines and a cumulative tradition, International Conference on Information Systems (ICIS), (Philadelphia, PA), ACM Press, 9–18.Google Scholar
  92. Klein, H.K. and Hirschheim, R. (2008). The Structure of the IS Discipline Reconsidered: Implications and reflections from a community of practice perspective, Information and Organization 18(4): 280–302.CrossRefGoogle Scholar
  93. Klein, H.K. and Myers, M.D. (1999). A Set of Principles for Conducting and Evaluating Interpretive Field Studies in Information Systems, MIS Quarterly 23(1): 67–94.CrossRefGoogle Scholar
  94. Korpela, K.M. (2010). How Long does it take for the Scientific Literature to Purge itself of Fraudulent Material?: The Breuning case revisited, Current Medical Research & Opinion 26(4): 843–847.CrossRefGoogle Scholar
  95. Kostoff, R.N., Stump, J.A., Johnson, D., Murday, J.S., Lau, C.G.Y. and Tolles, W.M. (2006). The Structure and Infrastructure of the Global Nanotechnology Literature, Journal of Nanoparticle Research 8(3–4): 301–321.CrossRefGoogle Scholar
  96. Kostoff, R.N., Toothman, D.R., Eberhart, H.J. and Humenik, J.A. (2001). Text Mining using Database Tomography and Bibliometrics: A review, Technological Forecasting and Social Change 68(3): 223–253.CrossRefGoogle Scholar
  97. Krippendorff, K. (2004). Content Analysis: An introduction to its methodology, Thousand Oaks, CA: Sage Publications.Google Scholar
  98. Latour, B. (1987). Science in Action: How to follow scientists and engineers through society, Cambridge, MA: Harvard University Press.Google Scholar
  99. Latour, B. and Woolgar, S. (1979). Laboratory Life: The social construction of scientific facts, Beverly Hills: Sage Publications.Google Scholar
  100. Law, J. and French, D. (1974). Normative and Interpretive Sociologies of Science, Sociological Review 22(4): 581–595.CrossRefGoogle Scholar
  101. Leydesdorff, L. (1987). Towards a Theory of Citation? Scientometrics 12(5–6): 305–309.CrossRefGoogle Scholar
  102. Leydesdorff, L. (1998). Theories of Citations? Scientometrics 43(1): 5–25.CrossRefGoogle Scholar
  103. Leydesdorff, L. and Amsterdamska, O. (1990). Dimensions of Citation Analysis, Science, Technology and Human Values 15(3): 305–335.CrossRefGoogle Scholar
  104. Lim, S., Saldanha, T., Malladi, S. and Melville, N.P. (2009). Theories used in information systems research: Identifying theory networks in leading IS journals, International Conference on Information Systems, (15–18 December, Phoenix, AZ), 1–10.Google Scholar
  105. Locke, K. and Golden-Biddle, K. (1997). Constructing Opportunities for Contribution: Structuring intertextual coherence and ‘problematizing’ in organizational studies, Academy of Management Journal 40(5): 1023–1062.CrossRefGoogle Scholar
  106. Loebbecke, C. and Leidner, D. (2012). The Contribution of Top IS Publications to Subsequent Research: A citation analysis, Communications of the Association for Information Systems 30(1): 423–438.Google Scholar
  107. Long, R., Crawford, A., White, M. and Davis, K. (2009). Determinants of Faculty Research Productivity in Information Systems: An empirical analysis of the impact of academic origin and academic affiliation, Scientometrics 78(2): 231–260.CrossRefGoogle Scholar
  108. Lowry, P.B., Romans, D. and Curtis, A. (2004). Global Journal Prestige and Supporting Disciplines: A scientometric study of information systems journals, Journal of the Association for Information Systems 5(2): 29–77.Google Scholar
  109. Luukkonen, T. (1997). Why has Latour’s Theory of Citations been Ignored by the Bibliometric Community? Discussion of sociological interpretations of citation analysis, Scientometrics 38(1): 27–37.CrossRefGoogle Scholar
  110. MacRoberts, M.H. and MacRoberts, B.R. (1986). Quantitative Measures of Communication in Science: A study of the formal level, Social Studies of Science 16(1): 151–172.CrossRefGoogle Scholar
  111. Marion, L.S., Garfield, E., Hargens, L.L., Lievrouw, L.A., White, H. and Concepción, C.S. (2003). Social Network Analysis and Citation Network Analysis: Complementary approaches to the study of scientific communication, Proceedings of the American Society for Information Science and Technology 40(1): 486–487.CrossRefGoogle Scholar
  112. Markus, M.L. (1983). Power, Politics, and MIS Implementation, Communications of the ACM 26(6): 430–444.CrossRefGoogle Scholar
  113. Marshakova-Shaikevich, I. (2001). Scientometric Perspectives of the Analysis of Chemical Terminology, Scientometrics 52(2): 323–336.CrossRefGoogle Scholar
  114. Matthes, J. and Kohring, M. (2008). The Content Analysis of Media Frames: Toward improving reliability and validity, Journal of Communication 58(2): 258–279.CrossRefGoogle Scholar
  115. McCain, K.W. (1983). The Author Cocitation Structure of Macroeconomics, Scientometrics 5(5): 277–289.CrossRefGoogle Scholar
  116. McKelvey, B. (1982). Organizational Systematics – Taxonomy, evolution, classification, Berkeley, CA: University of California Press.Google Scholar
  117. Merton, R.K. (1957). Priorities in Scientific Discovery, American Sociological Review 22(6): 635–659.CrossRefGoogle Scholar
  118. Merton, R.K. (1965). On the Shoulders of Giants: A shandean postscript, New York: Free Press.Google Scholar
  119. Merton, R.K. (1968a). The Matthew Effect in Science, Science 159(3810): 56–63.CrossRefGoogle Scholar
  120. Merton, R.K. (1968b). Social Theory and Social Structure, New York: Free Press.Google Scholar
  121. Merton, R.K. (1969). Behavior Patterns of Scientists, American Scientist 57(1): 1–23.Google Scholar
  122. Merton, R.K. (1973a). Singletons and Multiples in Scientific Discovery: A chapter in the sociology of science, in The Sociology of Science: Theoretical and empirical investigations, Chicago: University of Chicago Press, pp. 343–370.Google Scholar
  123. Merton, R.K. (1973b). The Sociology of Science: Theoretical and empirical investigations, Chicago, IL: The University of Chicago Press.Google Scholar
  124. Mingers, J. and Harzing, A.-W. (2007). Ranking Journals in Business and Management: A statistical analysis of the harzing data set, European Journal of Information Systems 16(4): 303–316.CrossRefGoogle Scholar
  125. Mingers, J. and Leydesdorff, L. (2015). A Review of Theory and Practice in Scientometrics, in arXiv, New York: Cornell University.Google Scholar
  126. Mizruchi, M.S. and Fein, L.C. (1999). The social Construction of Organizational Knowledge: A study of the uses of coercive, mimetic, and normative isomorphism, Administrative Science Quarterly 44(4): 653–683.CrossRefGoogle Scholar
  127. Mohr, L.B. (1982). Explaining Organizational Behavior, San Francisco, CA: Jossey-Bass Publishers.Google Scholar
  128. Moody, D., Iacob, M.-E. and Amrit, C. (2010). In Search of Paradigms: Identifying the theoretical foundations of the IS field, European Conference on Information Systems, (6–9 June, Pretoria, South Africa).Google Scholar
  129. Moody, D.L. (2000). Building Links between IS Research and Professional Practice: Improving the relevance and impact of IS research, International Conference on Information Systems (ICIS), (Brisbane, Australia) ACM Press, 351–360.Google Scholar
  130. Moravcsik, M.J. (1984). Life in a Multidimensional World, Scientometrics 6(2): 75–85.CrossRefGoogle Scholar
  131. Moravcsik, M.J. (1985). Applied Scientometrics: An assessment methodology for developing countries, Scientometrics 7(3–6): 165–176.CrossRefGoogle Scholar
  132. Moravcsik, M.J. and Murugesan, P. (1975). Some Results on the Function and Quality of Citations, Social Studies of Science 5(1): 86–92.CrossRefGoogle Scholar
  133. Morris, R. (1994). Computerized Content Analysis in Management Research: A demonstration of advantages & limitations, Journal of Management 20(4): 903–931.CrossRefGoogle Scholar
  134. Mulkay, M.J. (1974). Methodology in the Sociology of Science: Some reflections on the study of radio astronomy, Social Science Information 13(2): 107–119.CrossRefGoogle Scholar
  135. Mullins, N.C., Hargens, L.L., Hecht, P.K. and Kick, E.L. (1977). The Group Structure of Cocitation Clusters: A comparative study, American Sociological Review 42(4): 552–562.CrossRefGoogle Scholar
  136. Narin, F. (1976). Evaluative Bibliometrics: The use of publication and citation analysis in the evaluation of scientific activity, Cherry Hill, NJ: Computer Horizons.Google Scholar
  137. Narin, F., Hamilton, K.S. and Olivastro, D. (1997). The Increasing Linkage Between U.S. Technology and Public Science, Research Policy 26(3): 317–330.CrossRefGoogle Scholar
  138. Nath, R. and Jackson, W.M. (1991). Productivity of Management Information Systems Researchers: Does Lotka’s law apply? Information Processing and Management 27(2–3): 203–209.CrossRefGoogle Scholar
  139. Nerur, S.P., Mahapatra, R., Balijepally, V. and Mangalaraj, G. (2006). Is Information Systems a Reference Discipline? 39th Annual Hawaii International Conference on System Sciences (HICSS 39), (Lihue, Hawaii).Google Scholar
  140. Nerur, S.P., Sikora, R., Mangalaraj, G. and Balijepally, V. (2005). Assessing the Relative Influence of Journals in a Citation Network, Communications of the ACM 48(11): 71–74.CrossRefGoogle Scholar
  141. Neuendorf, K.A. (2002). The Content Analysis Guidebook, Thousand Oaks, CA: Sage Publications.Google Scholar
  142. Newton, I. (1676/1959). The Correspondence of Isaac Newton, in H.W. Turnbull, J.F. Scott and A.R. Hall (eds.) Vol. 1. Cambridge, UK: Royal Society at the University Press.Google Scholar
  143. Nicolaisen, J. (2007). Citation Analysis, Annual Review of Science and Technology 41(1): 609–641.CrossRefGoogle Scholar
  144. Noruzi, A. (2005). Google Scholar: The new generation of citation indexes, Libri 55(4): 170–180.CrossRefGoogle Scholar
  145. Oh, W., Choi, J.N. and Kim, K. (2006). Coauthorship Dynamics and Knowledge Capital: The patterns of cross-disciplinary collaboration in information systems research, Journal of Management Information Systems 22(3): 265–292.CrossRefGoogle Scholar
  146. Orlikowski, W.J. and Baroudi, J.J. (1991). Studying Information Technology in Organizations: Research approaches and assumptions, Information Systems Research 2(1): 1–28.CrossRefGoogle Scholar
  147. Orlikowski, W.J. and Iacono, C.S. (2001). Research Commentary: Desperately seeking the ‘IT’ in IT research – A call to theorizing the IT artifact, Information Systems Research 12(2): 121–134.CrossRefGoogle Scholar
  148. Oromaner, M. (1985). The Ortega Hypothesis and Influential Articles in American Sociology, Scientometrics 7(1–2): 3–10.CrossRefGoogle Scholar
  149. Ortega y Gasset, J. (1957). The Revolt of the Masses, New York: W. W. Norton & Company.Google Scholar
  150. Palevitz, B.A. (1997). The Ethics of Citation: A matter of science’s family values, The Scientist 11(12): 8.Google Scholar
  151. Park, T.K. (1993). The Nature of Relevance in Information Retrieval – An empirical study, Library Quarterly 63(3): 318–351.CrossRefGoogle Scholar
  152. Pavlou, P.A. and Dimoka, A. (2006). The Nature and Role of Feedback Text Comments in Online Marketplaces: Implications for trust building, price premiums, and seller differentiation, Information Systems Research 17(4): 392–414.CrossRefGoogle Scholar
  153. Pecorari, D. (2008). Academic Writing and Plagiarism: A linguistic analysis, New York: Continuum International Publishing Group.Google Scholar
  154. Peffers, K. and Hui, W. (2003). Collaboration and Author Order: Changing patterns in IS research, Communications of the Association for Information Systems 11(1): 166–190.Google Scholar
  155. Peffers, K. and Ya, T. (2003). Identifying and Evaluating the Universe of Outlets for Information Systems Research: Ranking the journals, The Journal of Information Technology Theory and Application 5(1): 63–84.Google Scholar
  156. Polites, G.L. and Watson, R.T. (2009). Using Social Network Analysis to Analyze Relationships Among IS Journals, Journal of the Association for Information Systems 10(8): 595–636.Google Scholar
  157. Price, D.J.d.S. (1963). Little Science, Big Science, New York: Columbia University Press.Google Scholar
  158. Price, D.J.d.S. (1965). Networks of Scientific Papers, Science 149(3683): 510–515.CrossRefGoogle Scholar
  159. Price, D.J.d.S. (1970). Citation Measures of Hard Science, Soft Science, Technology, and Non Science, in C.E. Nelson and D. Pollack (eds.) Communication among Scientists and Engineers, Lexington, MA: D. C. Heath and Company, pp. 3–22.Google Scholar
  160. Price, D.J.d.S. (1978). Editorial Statements, Scientometrics 1(1): 3–18.CrossRefGoogle Scholar
  161. Price, D.J.d.S. and Beaver, D. (1966). Collaboration in an Invisible College, American Psychologist 21(11): 1011–1018.CrossRefGoogle Scholar
  162. Rainer, R.K., Jr. and Miller, M.D. (2005). Examining Differences Across Journal Rankings, Communications of the ACM 48(2): 91–94.CrossRefGoogle Scholar
  163. Ramiller, N.C., Swanson, B. and Wang, P. (2008). Research Directions in Information Systems: Toward an institutional ecology, Journal of the Association for Information Systems 9(1): 1–22.CrossRefGoogle Scholar
  164. Roche, I., Besagni, D., François, C., Hörlesberger, M. and Schiebel, E. (2010). Identification and Characterisation of Technological Topics in the Field of Molecular Biology, Scientometrics 82(3): 663–676.CrossRefGoogle Scholar
  165. Salton, G. and McGill, M.J. (1983). Introduction to Modern Information Retrieval, New York: McGraw-Hill.Google Scholar
  166. Schubert, A. (2014). Sentences to Remember from the First 100 Volumes of the Journal Scientometrics, Scientometrics 100(1): 1–13.CrossRefGoogle Scholar
  167. Schutz, A. (1973). Concept and Theory Formulation in the Social Sciences, in M. Natanson (ed.) Collected Papers Vol. 1, The Hague: Martinus Nijhoff, pp. 48–66.Google Scholar
  168. SCImago (2007). SJR – Scimago journal & country rank [WWW document] (accessed 9 December 2012).
  169. Serenko, A., Bontis, N., Booker, L.D., Sadeddin, K. and Hardie, T. (2010). A Scientometric Analysis of Knowledge Management and Intellectual Capital Academic Literature (1994–2008), Journal of Knowledge Management 14(1): 3–23.CrossRefGoogle Scholar
  170. Serenko, A., Cox, R.A.K., Bontis, N. and Booker, L.D. (2011). The Superstar Phenomenon in the Knowledge Management and Intellectual Capital Academic Discipline, Journal of Informetrics 5(3): 333–345.Google Scholar
  171. Short, J.C., Broberg, J.C., Cogliser, C.C. and Brigham, K.H. (2010). Construct Validation Using Computer-Aided Text Analysis (CATA): An illustration using entrepreneurial orientation, Organizational Research Methods 13(2): 320–347.CrossRefGoogle Scholar
  172. Small, H. (1973). Co-Citation in the Scientific Literature: A new measure of the relationship between two documents, Journal of the American Society for Information Science 24(4): 265–269.CrossRefGoogle Scholar
  173. Small, H. (1978). Cited Documents as Concept Symbols, Social Studies of Science 8(3): 327–340.CrossRefGoogle Scholar
  174. Small, H. (2003). Paradigms, Citations, and Maps of Science: A personal history, Journal of the American Society for Information Science 54(5): 394–399.CrossRefGoogle Scholar
  175. Small, H. (2004). On the Shoulders of Robert Merton: Towards a normative theory of citation, Scientometrics 60(1): 71–79.CrossRefGoogle Scholar
  176. Small, H. and Griffith, B.C. (1974). The Structure of Scientific Literatures I: Identifying and graphing specialties, Science Studies 4(1): 17–40.CrossRefGoogle Scholar
  177. Sokal, A.D. (1996). Transgressing the Boundaries – Toward a transformative hermeneutics of quantum gravity, Social Text 46/47(Summer): 217–252.CrossRefGoogle Scholar
  178. Sokal, A.D. (2000). The Sokal Hoax: The sham that shook the academy, Lincoln: University of Nebraska Press.Google Scholar
  179. Stamper, R. (1991). The Semiotic Framework for Information Systems Research, in H.-E. Nissen, H.K. Klein and R. Hirschheim (eds.) Information Systems Research: Contemporary approaches and emergent traditions, North-Holland: Elsevier Science Publishers B. V., pp. 515–528.Google Scholar
  180. Straub, D. (2006). The Value of Scientometric Studies: An introduction to a debate on IS as a reference discipline, Journal of the Association for Information Systems 7(5): 241–246.Google Scholar
  181. Straub, D. (2012). Editorial: Does MIS have native theories, MIS Quarterly 36(2): iii–xii.Google Scholar
  182. Straub, D.W. (2015). The Critical Role of Historiography in Writing IS History, Communications of the Association for Information Systems 36(1): 593–598 Article 29.Google Scholar
  183. Stryker, J.E., Way, R.J., Hornik, R.C. and Yanovitzky, I. (2006). The Validation of Database Search Terms for Content Analysis: The case of cancer news coverage, Journalism & Mass Communication Quarterly 83(2): 413–430.CrossRefGoogle Scholar
  184. Swanson, D.R. (1990). Somatomedin C and Arginine: Implicit connections between mutually isolated literatures, Perspectives in Biology and Medicine 33(2): 157–186.CrossRefGoogle Scholar
  185. Swanson, D.R. and Smalheiser, N.R. (1997). An Interactive System for Finding Complementary Literatures: A stimulus to scientific discovery, Artificial Intelligence 91(2): 183–203.CrossRefGoogle Scholar
  186. Takeda, H., Cuellar, M., Truex, III D.P. and Vidgen, R. (2011). Networks of Innovation in IS research: An exploration of the relationship between co-authorship networks and H-family indices, in Proceedings of the European Conference on Information Systems (ECIS 2011), 9–11 June, Helsinki, Finland, pp. 1–14.Google Scholar
  187. Takeda, H., Truex, D.P. and Cuellar, M.J. (2010). Evaluating Scholarly Influence through Social Network Analysis: The next step in evaluating scholarly influence, Americas Conference on Information Systems (AMCIS 2010), (12–15 August, Lima, Peru).Google Scholar
  188. Taylor, H., Dillon, S. and Van Wingen, M. (2010). Focus and Diversity in Information Systems Research: Meeting the dual demands of a healthy applied discipline, MIS Quarterly 34(4): 647–667.Google Scholar
  189. Thomson Reuters (2008). Successful 2008 predictions, Thomson Reuters [WWW document] (accessed 23 October 2008).
  190. Thomson Reuters (2013). Science watch: Predicting Nobel Prizes, Thomson Reuters [WWW document] (27 March 2013).
  191. Thorne, F.C. (1977). The Citation Index, Another Case of Spurious Validity Journal of Clinical Psychology 33(4): 1157–1161.Google Scholar
  192. Todd, P.A., McKeen, J.D. and Gallupe, R.B. (1995). The Evolution of IS Job Skills: A content analysis of IS job advertisements from 1970 to 1990, MIS Quarterly 19(1): 1–27.CrossRefGoogle Scholar
  193. Truex, D., Cuellar, M., Takeda, H. and Vidgen, R. (2011). The Scholarly Influence of Heinz Klein: Ideational and social measures of his impact on IS research and IS scholars, European Journal of Information Systems 20(4): 422–439.CrossRefGoogle Scholar
  194. Truex, D.P., Cuellar, M. and Takeda, H. (2009). Assessing Scholarly Influence: Using the Hirsch indices to reframe the discourse, Journal of the Association for Information Systems 10(7): 560–594.Google Scholar
  195. Truex, D.P., Cuellar, M.J. and Takeda, H. (2008). Assessing Scholarly Influence: Proposing new metrics, in Proceedings of the International Conference on Information Systems (ICIS 2008), (Paris, France), 1–19.Google Scholar
  196. Vessey, I., Ramesh, V. and Glass, R.L. (2002). Research in Information Systems: An empirical study of diversity in the discipline and its journals, Journal of Management Information Systems 19(2): 129–174.Google Scholar
  197. Vidgen, R., Henneberg, S. and Naude, P. (2007). What Sort of Community is the European Conference on Information Systems? A social network analysis 1993–2005, European Journal of Information Systems 16(1): 5–19.CrossRefGoogle Scholar
  198. Wade, M., Biehl, M. and Kim, H. (2006a). If the Tree of IS Knowledge Falls in a Forest, will Anyone Hear? A commentary on Grover et al., Journal of the Association for Information Systems 7(5): 326–335.Google Scholar
  199. Wade, M., Biehl, M. and Kim, H. (2006b). Information Systems is not a Reference Discipline (and What We Can do About it), Journal of the Association for Information Systems 7(5): 247–269.Google Scholar
  200. Walsham, G. (1993). Interpreting Information Systems in Organizations, New York: John Wiley & Sons.Google Scholar
  201. Walsham, G. (1995a). The Emergence of Interpretivism in IS Research, Information Systems Research 6(4): 376–394.CrossRefGoogle Scholar
  202. Walsham, G. (1995b). Interpretive Case Studies in IS Research: Nature and method, European Journal of Information Systems 4(2): 74–81.CrossRefGoogle Scholar
  203. Walsham, G. (2006). Doing Interpretive Research, European Journal of Information Systems 15(3): 320–330.CrossRefGoogle Scholar
  204. Walstrom, K.A. and Leonard, L.N.K. (2000). Citation Classics from the Information Systems Literature, Information & Management 38(2): 59–72.CrossRefGoogle Scholar
  205. Wasko, M.M. and Faraj, S. (2005). Why Should I Share? Examining Social Capital and Knowledge Contribution in Electronic Networks of Practice, MIS Quarterly 29(1): 35–57.Google Scholar
  206. Wasserman, S., Faust, K., Iacobucci, D. and Granovetter, M. (1994). Social Network Analysis: Methods and applications, London: Cambridge University Press.CrossRefGoogle Scholar
  207. Weber, R.P. (1990). Basic Content Analysis: Quantitative applications in the social sciences, Thousand Oaks: Sage.CrossRefGoogle Scholar
  208. Webster, J. and Watson, R.T. (2002). Analyzing the Past to Prepare for the Future: Writing a literature review, MIS Quarterly 26(2): xiii–xxiii.Google Scholar
  209. Weick, K.E. (2001). Making Sense of the Organization, Malden, MA: Blackwell Publishers.Google Scholar
  210. Weick, K.E., Sutcliffe, K.M. and Obstfeld, D. (2005). Organizing and the Process of Sensemaking, Organization Science 16(4): 409–421.CrossRefGoogle Scholar
  211. Weinstock, M. (1971). Citation Indexes, in Encyclopedia of Library and Information Science. vol. 5. New York: Marcel Dekker, pp. 16–40.Google Scholar
  212. White, H.C. (1992). Identity and Control: A structural theory of social action, Princeton, NJ: Princeton University Press.Google Scholar
  213. White, H.D., Wellman, B. and Nazer, N. (2004). Does Citation Reflect Social Structure? Longitudinal Evidence From the ‘Globenet’ Interdisciplinary Research Group, Journal of the American Society for Information Science and Technology 55(2): 111–126.CrossRefGoogle Scholar
  214. Whitley, E.A. and Galliers, R.D. (2007). An Alternative Perspective on Citation Classics: Evidence from the first 10 years of the European conference on information systems, Information & Management 44(5): 441–455.CrossRefGoogle Scholar
  215. Wouters, P. (1998). The Signs of Science, Scientometrics 41(1–2): 225–241.CrossRefGoogle Scholar
  216. Wouters, P. (1999). The Citation Culture. PhD diss., University of Amsterdam.Google Scholar
  217. Xu, J. and Chau, M. (2006). The Social Identity of IS: Analyzing the collaboration network of the ICIS conferences (1980–2005), in Proceedings of the International Conference on Information Systems (ICIS 2006), (Milwaukee, WI), 569–590.Google Scholar
  218. Yoon, B. and Park, Y. (2004). A Text-Mining-Based Patent Network: Analytical tool for high-technology trend, Journal of High Technology Management Research 15(1): 37–50.CrossRefGoogle Scholar
  219. Zhang, P. (2015). The IS History Initiative: Looking forward by looking back, Communications of the Association for Information Systems 36(1): 477–514.Google Scholar
  220. Zucker, L.G., Darby, M.R. and Brewer, M.B. (1998). Intellectual Human Capital and the Birth of U.S. Biotechnology Enterprises, The American Economic Review 88(1): 290–306.Google Scholar

Copyright information

© Association for Information Technology Trust 2016

Authors and Affiliations

  1. 1.Department of Finance and MIS, University of Minnesota DuluthDuluthUSA
  2. 2.Department of Business, Media and Technology Management, University of CologneKoelnGermany

Personalised recommendations