Advertisement

Scientometrics

, Volume 76, Issue 1, pp 95–115 | Cite as

Ranking Taiwanese management journals: A case study

  • Chiang Kao
  • Hsiou-Wei Lin
  • San-Lin Chung
  • Wei-Chi Tsai
  • Jyh-Shen Chiou
  • Yen-Liang Chen
  • Liang-Hsuan Chen
  • Shih-Chieh Fang
  • Hwei-Lan Pao
Article

Abstract

To improve the quality of journals in Taiwan, the National Science Council (NSC) of the Republic of China evaluates journals in the fields of humanities and social sciences periodically. This paper describes the evaluation of 46 management journals conducted by the authors, as authorized by the NSC. Both a subjective approach, with judgments solicited from 345 experts, and an objective approach, with data collected on four indicators: journal cross citation, dissertation citation, authors’ scholastic reputation, and author diversity, were used to make a comprehensive evaluation. Performance in the four indicators were aggregated using weights which were most favourable to all journals, in a compromise sense, to produce the composite indices. The subjective evaluation reflects the general image, or reputation, of journals while the objective evaluation discloses blind spots which have been overlooked by experts. The results show that using either approach alone would have produced results which are misleading, which suggests that both approaches should be used. All of the editors of the journals being evaluated agreed that the evaluation was appropriate and the results are reasonable.

Keywords

Subjective Evaluation Management Review Composite Index Objective Evaluation Management Journal 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Bauerly, R. J., Johnson, D. T. (2005), An evaluation of journals used in doctoral marketing programs, J. Academy of Marketing Science, 33: 313–329.CrossRefGoogle Scholar
  2. Bonnevie-Nebelong, E. (2006), Methods for journal evaluation: Journal citation identity, journal citation image and internationalisation, Scientometrics, 66: 411–424.CrossRefGoogle Scholar
  3. Butler, L. (2002), Identifying ‘highly-rated’ journals — An Australian case study, Scientometrics, 53: 207–227.CrossRefGoogle Scholar
  4. Coe, R., Weinstock, I. (1984), Evaluating the management journals: A second look, Academy of Management Journal, 27: 660–666.CrossRefGoogle Scholar
  5. De Luca, A., Termini, S. (1972), A definition of a nonprobabilistic entropy in the setting of fuzzy sets theory, Information and Control, 20: 301–312.CrossRefMathSciNetGoogle Scholar
  6. Dul, J., Karwowski, W., Vinken, J. (2005), Objective and subjective rankings of scientific journals in the field of ergonomics: 2004–2005, Human Factors and Ergonomics in Manufacturing, 15: 327–332.CrossRefGoogle Scholar
  7. Garfield, E. (1972), Citation analysis as a tool in journal evaluation, Science, 178: 471–479.CrossRefGoogle Scholar
  8. Gross, P. L. K., Gross, E. M. (1927), College libraries and chemical education, Science, 66: 385–389.CrossRefGoogle Scholar
  9. Horowitz, I. (2003), Preference-neutral attribute weights in the journal-ranking problem, J. Operational Research Society, 54: 452–457.zbMATHCrossRefGoogle Scholar
  10. Jarley, P., Chandler, T. D., Faulk II, L. H. (1998), Are we playing the same game?: Publishing task environments and research productivity among management specialists, Human Relations, 51: 799–824.Google Scholar
  11. Kao, C. (2007), The authorship and country spread of OR journals, Scientometrics (accepted).Google Scholar
  12. Kao, C., Hung, H. T. (2003), Ranking university libraries with a posteriori weights, Libri, Int. J. Libraries and Information Sciences, 53: 282–290Google Scholar
  13. Kao, C., Hung, H. T. (2005), Data envelopment analysis with common weights: the compromise solution approach, J. Operational Research Society, 56: 1196–1203zbMATHCrossRefGoogle Scholar
  14. Linton, J. D., Thongpapanl, N. (2004), Perspective: Ranking the technology innovation management journals, J. Product Innovation Management, 21: 123–139.CrossRefGoogle Scholar
  15. Mcgrath, W. E. (1987), Ratings and rankings: Multiple comparisons of mean ratings, College and Research Libraries, 48: 169–172.Google Scholar
  16. Maier, G. (2006), Impact factors and peer judgment: The case of regional science journals, Scientometrics, 69: 651–667.CrossRefGoogle Scholar
  17. Nisonger, T. E. (1999), JASIS and library and information science journal rankings: A review and analysis of the last half-century, J. American Society for Information Science, 50: 1004–1019.CrossRefGoogle Scholar
  18. Olson, J. E. (2005), Top-25-business-school professors rate journals in operations management and related fields, Interfaces, 35: 323–338.CrossRefGoogle Scholar
  19. Parameswaran, A., Sebastian, R. (2006), The value of South and Southeast Asian studies journal rankings, Serials Review, 32: 154–163.CrossRefGoogle Scholar
  20. Pasterkamp, G., Rotmans, J. I., De Kleijn, D. V. P., Borst, C. (2007), Citation frequency: A biased measure of research impact significantly influenced by the geographical origin of research articles, Scientometrics, 70: 153–165.CrossRefGoogle Scholar
  21. Turban, E., Zhou, D. N., Ma, H. (2004), A group decision support approach to evaluating journals, Information & Management, 42: 31–44.Google Scholar
  22. Zeleny, M. (1982), Multiple Criteria Decision Making, McGraw-Hill, NY.zbMATHGoogle Scholar
  23. Zimmermann, H. J. (1996), Fuzzy Set Theory and Its Applications, 3rd ed., Kluwer-Academic, Boston, MA.zbMATHGoogle Scholar

Copyright information

© Springer Science+Business Media B.V. 2008

Authors and Affiliations

  • Chiang Kao
    • 1
  • Hsiou-Wei Lin
    • 2
  • San-Lin Chung
    • 3
  • Wei-Chi Tsai
    • 4
  • Jyh-Shen Chiou
    • 5
  • Yen-Liang Chen
    • 6
  • Liang-Hsuan Chen
    • 1
  • Shih-Chieh Fang
    • 7
  • Hwei-Lan Pao
    • 8
  1. 1.Department of Industrial and Information ManagementNational Cheng Kung UniversityTainanTaiwan
  2. 2.Department of International BusinessNational Taiwan UniversityTaipeiTaiwan
  3. 3.Department of FinanceNational Taiwan UniversityTaipeiTaiwan
  4. 4.Department of Business AdministrationNational Cheng Chi UniversityTaipeiTaiwan
  5. 5.Department of International BusinessNational Cheng Chi UniversityTaipeiTaiwan
  6. 6.Department of Information ManagementNational Central UniversityChung-LiTaiwan
  7. 7.Department of Business AdministrationNational Cheng Kung UniversityTainanTaiwan
  8. 8.Department of Humanities and Social SciencesNational Science CouncilTaipeiTaiwan

Personalised recommendations