Abstract
This study examines the question of whether the journal ranking VHB-JOURQUAL 2 can be considered as a good measure for the construct ”scientific quality„. Various rankings in business research provide the database for the analysis. The correlations between theses rankings are used to assess the validity of VHBJOURQUAL 2 along various validity criteria. The correlations with rankings that measure the same construct based on different methods show that VHB-JOURQUAL 2 has acceptable, but moderate convergent validity. The validity varies considerably across disciplines, showing that the heterogeneity of business administration is not sufficiently represented by this overall ranking. The variability is related to the variation in members per discipline represented by the German Association for Business Research. Furthermore, the measure shows a weak correlation with acceptance rates as an indicator of nomological validity in some disciplines.
Article PDF
Similar content being viewed by others
Avoid common mistakes on your manuscript.
References
Albers, Sönke (2009): Misleading Rankings of Research in Business, German Economic Review, 10(3): 352–363.
Axarloglou, Kostas and Vasilis Theoharakis (2003): Diversity In Economics: An Analysis of Journal Quality Perceptions, Journal of the European Economic Association, 1(6): 1402–1423.
Ballas, Apostolos and Vasilis Theoharakis (2003): Exploring Diversity In Accounting Through Faculty Journal Perceptions, Contemporary Accounting Research, 20(4): 619–644.
Buchholz, Klaus (1995): Criteria for the Analysis of Scientific Quality, Scientometrics, 32(2): 195–218.
Cabell Publishing (2009): Cabell’s Directories of Publishing Opportunities, http://www.cabells.com (Access date: 2009-09-09).
Campbell, Donald T. and Donald W. Fiske (1959): Convergent and Discriminant Validation by the Multitrait-Multimethod Matrix, Psychological Bulletin, 56(2): 81–105.
Coe, Robert and Irwin Weinstock (1984): Evaluating the Management Journals: A Second Look, Academy of Management Journal, 27(3): 660–666.
Cronbach, Lee J. (1951): Coefficient Alpha and the Internal Structure of Tests, Psychometrika, 16(3): 297–334.
Cronbach, Lee J. and Paul E. Meehl (1955): Construct Validity in Psychological Tests, Psychological Bulletin, 52(4): 281–302.
Eisend, Martin and Susanne Schmidt (2010): Success Factors of Internationalization Strategies in Business Research, in: Easwar Iyer and Robin Coulter (eds.): Enhancing Knowledge Development in Marketing. AMA Summer Educators Conference Proceedings, Vol 21, American Marketing Association: Chicago, 98–99.
Ellison, Glenn (2002): The Slowdown of the Economics Publishing Process, Journal of Political Economy, 110(5): 947–993.
Frey, Bruno S. and Katja Rost (2010): Do Rankings Reflect Research Quality?, Journal of Applied Economics, 13(1): 1–38.
Garfield, Eugene (2006): The History and Meaning of the Journal Impact Factor, Journal of the American Medical Association, 295(1): 90–93.
Harzing, Anne-Wil (2009): Journal Quality List, 34th ed., http://www.harzing.com (Access date: 2009-09-04).
Hennig-Thurau, Thorsten, Gianfranco Walsh, and Ulf Schrader (2004): VHB-JOURQUAL: Ein Ranking von betriebswirtschaftlich-relevanten Zeitschriften auf der Grundlage von Expertenurteilen, Schmalenbachs Zeitschrift für betriebswirtschaftliche Forschung, 56September): 520–545.
Krohn, Wolfgang and Günter Küppers (1990): Science as a Self-Organizing System. Outline of a Theoretical Model, in: Wolfgang Krohn, Günter Küppers, and Helga Nowotny (eds.): Selforganization: Portrait of a Scientific Revolution, Kluwer: Dordrecht, 208–222.
Lewis, Bruce R., Gary F. Templeton, and Xin Luo (2007): A Scientometric Investigation Into the Validity of IS Journal Quality Measures, Journal of the Association for Information Systems, 8(12): 619–633.
Maturana, Humberto (1990): Science and Daily Life: The Ontology of Scientific Explanations, in: Wolfgang Krohn, Günter Küppers, and Helga Nowotny (eds.): Selforganization: Portrait of a Scientific Revolution, Kluwer: Dordrecht, 12–35.
Müller, Anja and Olaf Storbeck (2009): Die BWL erfindet sich neu, http://www.handelsblatt.com/politik/oekonomie/_b=2284051,_p=30,_t=ftprint,doc_page=0;printpage (Access date: 2011-10-20).
Nienhüser, Werner and Hans-Gerd Ridder (2009): Editorial, Zeitschrift für Personalforschung, 23(1): 5–7.
Rost, Katja and Bruno S. Frey (2011): Quantitative and Qualitative Rankings of Scholars, Schmalenbach Business Review, 63(January): 63–91.
Schrader, Ulf and Thorsten Hennig-Thurau (2009): VHBJOURQUAL2: Method, Results, and Implications of the German Academic Association for Business Research’s Journal Ranking, Business Research, 2(2): 180–204.
Seggie, Steven H. and David A. Griffith (2009): What Does It Take to Get Promoted in Marketing Academia? Understanding Exceptional Publication Productivity in the Leading Marketing Journals, Journal of Marketing, 73(1): 122–132.
Seglen, Per O. (1997): Why the Impact Factor of Journals Should Not Be Used for Evaluating Research, British Medical Journal, 314(7079): 498–502.
Theoharakis, Vasilis and Andrew Hirst (2002): Perceptual Differences of Marketing Journals: A Worldwide Perspective, Marketing Letters, 13(4): 389–402.
Theoharakis, Vasilis and Nikolaos A. Mylonopoulos (2001): Global Perceptions of IS Journals, Communications of the ACM, 44(9): 29–33.
Theoharakis, Vasilis and Mary Skordia (2003): How Do Statisticians Perceive Statistics Journals, American Statistician, 57(2): 115–123.
Van Fleet, David D., Abagail McWilliams, and Donald S. Siegal (2000): A Theoretical and Empirical Analysis of Journal Rankings: The Case of Formal Lists, Journal of Management, 26(5): 839–861.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (https://creativecommons.org/licenses/by/4.0), which permits use, duplication, adaptation, distribution, and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.
About this article
Cite this article
Eisend, M. Is VHB-JOURQUAL2 a Good Measure of Scientific Quality? Assessing the Validity of the Major Business Journal Ranking in German-Speaking Countries. Bus Res 4, 241–274 (2011). https://doi.org/10.1007/BF03342756
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/BF03342756