Abstract
To improve the quality of journals in Taiwan, the National Science Council (NSC) of the Republic of China evaluates journals in the fields of humanities and social sciences periodically. This paper describes the evaluation of 46 management journals conducted by the authors, as authorized by the NSC. Both a subjective approach, with judgments solicited from 345 experts, and an objective approach, with data collected on four indicators: journal cross citation, dissertation citation, authors’ scholastic reputation, and author diversity, were used to make a comprehensive evaluation. Performance in the four indicators were aggregated using weights which were most favourable to all journals, in a compromise sense, to produce the composite indices. The subjective evaluation reflects the general image, or reputation, of journals while the objective evaluation discloses blind spots which have been overlooked by experts. The results show that using either approach alone would have produced results which are misleading, which suggests that both approaches should be used. All of the editors of the journals being evaluated agreed that the evaluation was appropriate and the results are reasonable.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Bauerly, R. J., Johnson, D. T. (2005), An evaluation of journals used in doctoral marketing programs, J. Academy of Marketing Science, 33: 313–329.
Bonnevie-Nebelong, E. (2006), Methods for journal evaluation: Journal citation identity, journal citation image and internationalisation, Scientometrics, 66: 411–424.
Butler, L. (2002), Identifying ‘highly-rated’ journals — An Australian case study, Scientometrics, 53: 207–227.
Coe, R., Weinstock, I. (1984), Evaluating the management journals: A second look, Academy of Management Journal, 27: 660–666.
De Luca, A., Termini, S. (1972), A definition of a nonprobabilistic entropy in the setting of fuzzy sets theory, Information and Control, 20: 301–312.
Dul, J., Karwowski, W., Vinken, J. (2005), Objective and subjective rankings of scientific journals in the field of ergonomics: 2004–2005, Human Factors and Ergonomics in Manufacturing, 15: 327–332.
Garfield, E. (1972), Citation analysis as a tool in journal evaluation, Science, 178: 471–479.
Gross, P. L. K., Gross, E. M. (1927), College libraries and chemical education, Science, 66: 385–389.
Horowitz, I. (2003), Preference-neutral attribute weights in the journal-ranking problem, J. Operational Research Society, 54: 452–457.
Jarley, P., Chandler, T. D., Faulk II, L. H. (1998), Are we playing the same game?: Publishing task environments and research productivity among management specialists, Human Relations, 51: 799–824.
Kao, C. (2007), The authorship and country spread of OR journals, Scientometrics (accepted).
Kao, C., Hung, H. T. (2003), Ranking university libraries with a posteriori weights, Libri, Int. J. Libraries and Information Sciences, 53: 282–290
Kao, C., Hung, H. T. (2005), Data envelopment analysis with common weights: the compromise solution approach, J. Operational Research Society, 56: 1196–1203
Linton, J. D., Thongpapanl, N. (2004), Perspective: Ranking the technology innovation management journals, J. Product Innovation Management, 21: 123–139.
Mcgrath, W. E. (1987), Ratings and rankings: Multiple comparisons of mean ratings, College and Research Libraries, 48: 169–172.
Maier, G. (2006), Impact factors and peer judgment: The case of regional science journals, Scientometrics, 69: 651–667.
Nisonger, T. E. (1999), JASIS and library and information science journal rankings: A review and analysis of the last half-century, J. American Society for Information Science, 50: 1004–1019.
Olson, J. E. (2005), Top-25-business-school professors rate journals in operations management and related fields, Interfaces, 35: 323–338.
Parameswaran, A., Sebastian, R. (2006), The value of South and Southeast Asian studies journal rankings, Serials Review, 32: 154–163.
Pasterkamp, G., Rotmans, J. I., De Kleijn, D. V. P., Borst, C. (2007), Citation frequency: A biased measure of research impact significantly influenced by the geographical origin of research articles, Scientometrics, 70: 153–165.
Turban, E., Zhou, D. N., Ma, H. (2004), A group decision support approach to evaluating journals, Information & Management, 42: 31–44.
Zeleny, M. (1982), Multiple Criteria Decision Making, McGraw-Hill, NY.
Zimmermann, H. J. (1996), Fuzzy Set Theory and Its Applications, 3rd ed., Kluwer-Academic, Boston, MA.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Kao, C., Lin, HW., Chung, SL. et al. Ranking Taiwanese management journals: A case study. Scientometrics 76, 95–115 (2008). https://doi.org/10.1007/s11192-007-1895-5
Received:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11192-007-1895-5