Skip to main content
Log in

On first quartile journals which are not of highest impact

  • Published:
Scientometrics Aims and scope Submit manuscript

Abstract

Here we study the relationship between journal quartile rankings of ISI impact factor (at the 2010) and journal classification in four impact classes, i.e., highest impact, medium highest impact, medium lowest impact, and lowest impact journals in subject category computer science artificial intelligence. To this aim, we use fuzzy maximum likelihood estimation clustering in order to identify groups of journals sharing similar characteristics in a multivariate indicator space. The seven variables used in this analysis are: (1) Scimago Journal Ranking (SJR); (2) H-Index (H); (3) ISI impact factor (IF); (4) 5-Year Impact Factor (5IF); (5) Immediacy Index (II); (6) Eigenfactor Score (ES); and (7) Article Influence Score (AIS). The fuzzy clustering allows impact classes to overlap, thereby accommodating for uncertainty related to the confusion about the impact class attribution for a journal and vagueness in impact classes definition. This paper demonstrates the complex relationship between quartiles of ISI impact factor and journal impact classes in the multivariate indicator space. And that several indicators should be used for a distinct analysis of structural changes at the score distribution of journals in a subject category. Here we propose it can be performed in a multivariate indicator space using a fuzzy classifier.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

Similar content being viewed by others

References

  • Abonyi, J., Balasko, B., & Feil B. (2011). Fuzzy clustering and data analysis toolbox. Department of Process Engineering at the University of Veszprem, Hungary. http://www.fmt.vein.hu/softcomp/fclusttoolbox. Accessed June 2011.

  • Adam, D. (2002). The counting house. Nature, 415, 726–729.

    Article  Google Scholar 

  • Bergstrom, C. (2007). Eigenfactor: Measuring the value and prestige of scholarly journals. College and Research Libraries News, 68(5), 314–316.

    Google Scholar 

  • Bezdek, J. C., & Dunn, J. C. (1975). Optimal fuzzy partitions: A heuristic for estimating the parameters in a mixture of normal distributions. IEEE Transactions on Computers, 24(8), 835–838.

    Article  MATH  Google Scholar 

  • Bollen, J., Rodriguez, M. A., & van de Sompel, H. (2006). Automatic metadata generation using associative networks. Scientometrics, 69(3), 669–687.

    Article  Google Scholar 

  • Burrough, P. A., & McDonnell, R. A. (1998). Principles of geographical information systems. Principles of geographical information systems. Oxford: Oxford University Press.

    Google Scholar 

  • Butler, L. (2004). What happens when funding is linked to publication counts?. In H. F. Moed (Ed.), Handbook of quantitative science and technology research (pp. 389–405). Dordrecht: Kluwer.

    Google Scholar 

  • Comisión Nacional Evaluadora de la Actividad Investigadora (CNEAI). (2011). http://www.educacion.gob.es/horizontales/ministerio/organismos/cneai.htm. Accessed June 2011.

  • Duda, R. O., Hart, P. E., & Stork, D. G. (2001). Pattern classification (2nd Ed., p. 680). New York: Wiley.

    MATH  Google Scholar 

  • Dunn, J. C. (1973). A fuzzy relative of the isodata process and its use in detecting compact well separated clusters. Journal of Cybernetics, 28, 32–57.

    Article  MathSciNet  Google Scholar 

  • Fisher, P., & Wood, J. (1998) What is a Mountain? Or the Englishman who went up a Boolean geographical concept but realised it was fuzzy. Geography, 83, 247–256.

    Google Scholar 

  • Garfield, E. (2006). The history and meaning of the journal impact factor. JAMA—Journal of the American Medical Association, 295(1), 90–93.

    Article  Google Scholar 

  • Gath, I., & Geva, A. B. (1989). Unsupervised optimal fuzzy clustering. IEEE Transactions on Pattern Analysis and Machine Intelligence, 11, 773–781.

    Article  Google Scholar 

  • González-Pereira, B., Guerrero-Bote, V. P., & Moya-Anegón, F. (2010). A new approach to the metric of journals’ scientific prestige: The SJR indicator. Journal of Informetrics, 4(3), 379–391.

    Article  Google Scholar 

  • Hirsch, J. E. (2005). An index to quantify an individual’s scientific research output. PNAS, 102(46), 16569–16572. doi:10.1073/pnas.0507655102.

    Article  Google Scholar 

  • Jiménez-Contreras, E., Moya-Anegón, F., & López-Cózar, E. (2003). The evolution of research activity in Spain: The impact of the National Commission for the Evaluation of Research Activity (CNEAI). Research Policy, 32, 123–142.

    Article  Google Scholar 

  • Journal Citation Reports. (2011). Thomson Reuters. http://thomsonreuters.com/products_services/science/science_products/a-z/journal_citation_reports. Accessed June 2011.

  • Kalaitzidakis, P., Thanasis, S., & Mamuneas, T. P. (2003). Rankings of academic journals and institutions in economics. Journal of the European Economic Association, 1(6), 1346–1366.

    Article  Google Scholar 

  • Kodrzycki, Y. K., & Yu, P. (2006). New approaches to ranking economics journals. Contributions to Economic Analysis and Policy, 5(1), article 24.

    Google Scholar 

  • Leydesdorff, L., Moya-Anegón, F., & Guerrero-Bote, V. P. (2010). Journal maps on the basis of Scopus data: A comparison with the Journal Citation Reports of the ISI. Journal of the American Society for Information Science and Technology, 61, 352–369.

    Google Scholar 

  • Liebowitz Stanley, J., & Palmer, J. P. (1984). Assessing the relative impacts of economics journals. Journal of Economic Literature, 1, 77–88.

    Google Scholar 

  • Ma, N., Guan, J., & Zhao, Y. (2008). Bringing PageRank to the citation analysis. Information Processing and Management, 44(2), 800–810.

    Article  Google Scholar 

  • McBratney, A. B., de Gruijter, J. J., & Brus, D. J. (1992). Spatial prediction and mapping of continuous soil classes. Geoderma, 54, 39–64.

    Article  Google Scholar 

  • McBratney, A. B., & Odeh, I. O. A. (1997). Application of fuzzy sets in soil science: Fuzzy logic, fuzzy measurements and fuzzy decisions. Geoderma, 77, 85–114.

    Article  Google Scholar 

  • OECD. (2010). In Performance-based funding for public research in tertiary education institutions: Workshop proceedings. OECD Publishing. http://dx.doi.org/10.1787/9789264094611-en.

  • Palacios-Huerta, I,, & Volij, O. (2004). The measurement of intellectual influence. Econometrica, 72(3), 963–977.

    Article  MATH  Google Scholar 

  • Pinski, G., & Francis, N. (1976). Citation influence for journal aggregates of scientific publications. Information Processing and Management, 12, 297–312.

    Article  Google Scholar 

  • Rousseau, S., Verbeke, T., & Rousseau, R. (2009). Evaluating environmental and resource economics journals: A TOP-curve approach. Review of Environmental Economics and Policy 3(2), 270–287.

    Article  Google Scholar 

  • SCImago Journal and Country Rank. (2011). SCImago Research Group. http://www.scimagojr.com. Accessed June 2011.

  • van Raan Anton, F. J. (2004). Measuring science. In F. Moed Henk, G. Wolfgang, & S. Ulrich (Eds.), Handbook of quantitative science and technology research (pp. 19–50). Dordrecht: Kluwer.

    Google Scholar 

Download references

Acknowledgments

This research was sponsored by the Spanish Board for Science and Technology (MICINN) under grant TIN2010-15157 cofinanced with European FEDER funds. Thanks are due to the reviewers for their constructive suggestions.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to J. A. García.

Rights and permissions

Reprints and permissions

About this article

Cite this article

García, J.A., Rodriguez-Sánchez, R., Fdez-Valdivia, J. et al. On first quartile journals which are not of highest impact. Scientometrics 90, 925–943 (2012). https://doi.org/10.1007/s11192-011-0534-3

Download citation

  • Received:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11192-011-0534-3

Keywords

Navigation