Skip to main content
SpringerLink
Log in

Dispersion measures for h-index: a study of the Brazilian researchers in the field of mathematics

  • Published:
Scientometrics Aims and scope Submit manuscript

Abstract

Although the h-index is considered a significant indicator to evaluate the researchers' performance, as it simultaneously measures aspects related to their scientific productivity and citation impact, several studies have pointed out its deficiencies and limitations. In this context, this study aims to evaluate the contribution of dci and dco indicators, two Hirsch-type indices, to measure the reasonableness of the h-index as a representation of the researcher’s scientific performance. The universe of analysis consisted of 116 Brazilian mathematicians holding CNPq grants. For each researcher, the number of articles, the number of citations per article and the year of publication were collected in the Scopus database. Then, for each researcher, the h-index and dci and dco indices were calculated. The dci and dco indicators allowed selective and productive researchers to be to distinguished more accurately. In addition, they contributed to estimate the possibility of the researcher to increase his/her h-index. The study concludes that the dci and dco indices were able to reliably measure the distribution dispersion of the researchers' citation impact together with their h-index. Consequently, they managed to estimate the representativeness of h-index as an indicator of the researchers' scientific performance in the field of mathematics in Brazil.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1

Source: Silva (2018) adapted from Hirsch (2005)

Fig. 2
Fig. 3
Fig. 4

Similar content being viewed by others

References

  • Adler, R., Ewing, J., & Taylor, P. (2008). Joint committee on quantitative assessment of research: citation statistics. A report from the International Mathematical Union (IMU) in cooperation with the International Council of Industrial and Applied Mathematics (ICIAM) and the Institute of Mathematical Statistics (IMS)

  • Ain, Q.-U., Riaz, H., & Afzal, M. T. (2019). Evaluation of h-index and its citation intensity based variants in the field of mathematics. Scientometrics, 119(1), 187–211.

    Article  Google Scholar 

  • Arunachalam, S. (2001). Mathematics research in India today: What does the literature reveal? Scientometrics, 52(2), 235–259.

    Article  Google Scholar 

  • Ayaz, S., & Afzal, M. T. (2016). Identification of conversion factor for completing-h index for the field of mathematics. Scientometrics, 109(3), 1511–1524.

    Article  Google Scholar 

  • Barata, R. B., & Goldbaum, M. (2003). A profile of researchers in public health with productivity grants from the Brazilian National Research Council (CNPq). Cadernos de Saúde Pública, 19(6), 1863–1876.

    Article  Google Scholar 

  • Behrens, H., & Luksch, P. (2011). Mathematics 1868–2008: a bibliometric analysis. Scientometrics, 86(1), 179–194.

    Article  MATH  Google Scholar 

  • Bornmann, L., Mutz, R., & Daniel, H.-D. (2008). Are there better indices for evaluation purposes than the h index? A comparison of nine different variants of the h index using data from biomedicine. Journal of the American Society for Information Science and Technology, 59(5), 830–837.

    Article  Google Scholar 

  • Braun, J. D. (2012). Effects of war on scientific production: mathematics in Croatia from 1968 to 2008. Scientometrics, 93(3), 931–936.

    Article  Google Scholar 

  • Braun, T., et al. (1994). World science in the eighties. National performances in publication output and citation impact 9851989 versus1980–1984-Part II life sciences, engineering, and mathematics. Scientometrics, 31(1), 3–30.

    Article  Google Scholar 

  • Braun, T., Glänzel, W., & Grupp, H. (1995). The scientometric weight of 50 nations in 27 science areas, 1989–1993. Part I. All fields combined, mathematics, engineering, chemistry and physics. Scientometrics, 33 (3), 263–293.

  • Braun, T., Glänzel, W., & Schubert, A. (1987). One more version of the facts and figures on publication output and relative citation impact in physics and mathematics 1978–1980. Scientometrics, 12(1–2), 3–16.

    Article  Google Scholar 

  • Braun, T., Glänzel, W., & Schubert, A. (1988). The newest version of the facts and figures on publication output and relative citation impact in physics. Scientometrics, 14(5–6), 365–382.

    Article  Google Scholar 

  • Braun, T., & Nagy, J. I. (1982). A comparative evaluation of some Hungarian and other national biology, chemistry, mathematics and physics journals. Scientometrics, 4(6), 439–455.

    Article  Google Scholar 

  • Braun, T., Szabadi-Peresztegi, Z., & Kovács-Németh, É. (2003). About Abels and similar international awards for ranked lists of awardees as science indicators of national merit in mathematics. Scientometrics, 56(2), 161–168.

    Article  Google Scholar 

  • Brunson, J. C., et al. (2014). Evolutionary events in a mathematical sciences research collaboration network. Scientometrics, 99(3), 973–998.

    Article  Google Scholar 

  • Castanha, R. C. G., & Grácio, M. C. C. (2013). Brazil’s scientific production in mathematics: Contribution to mainstream science (2002–2011). Journal of Scientometric Research, 2(3), 161–168.

    Article  Google Scholar 

  • Cavalcante, R. A., et al. (2008). Perfil dos pesquisadores da área de odontologia no Conselho Nacional de Desenvolvimento Científico e Tecnológico (CNPq). Revista brasileira de epidemiologia, 11(1), 106–113.

    Article  MathSciNet  Google Scholar 

  • Cock, J. C. A. N., et al. (2018). Operating with Bourdieu’s concepts: research productivity and academic hierarchies in education. Educação e Pesquisa, 44, e178938.

    Google Scholar 

  • Dang, Y., & Zhang, W. (2003). Internationalization of mathematical research. Scientometrics, 58(3), 559–570.

    Article  MathSciNet  Google Scholar 

  • Davis, P. M., & Fromerth, M. J. (2007). Does the arXiv lead to higher citations and reduced publisher downloads for mathematics articles? Scientometrics, 71(2), 203–215.

    Article  Google Scholar 

  • Dorta-González, P., & Dorta-González, M. I. (2010). Indicador bibliométrico basado en el índice h. Revista Española de Documentación Científica, 33(2), 225–245.

    Article  Google Scholar 

  • Egghe, L. (2006). An improvement of the h-index: the g-index. ISSI Newsletter, 2(1), 8–9.

    MathSciNet  Google Scholar 

  • Egghe, L. (2010). The Hirsch index and related impact measures. Annual review of information science and technology, 44, 65–114.

    Article  Google Scholar 

  • Eto, H. (1999). Relationship of mathematical programming with mathematics, economic / regional planning and other specialties. Scientometrics, 45(2), 311–324.

    Article  Google Scholar 

  • Garfield, E. (1979). Is citation analysis a legitimate evaluation tool? Scientometrics, 1(4), 359–375.

    Article  Google Scholar 

  • Gaskó, N., Lung, R. I., & Suciu, M. A. (2016). A new network model for the study of scientific collaborations: Romanian computer science and mathematics co-authorship networks. Scientometrics, 108(2), 613–632.

    Article  Google Scholar 

  • Ghani, R., et al. (2019). Comprehensive evaluation of h-index and its extensions in the domain of mathematics. Scientometrics, 118(3), 809–822.

    Article  Google Scholar 

  • Glänzel, W. (2003). Bibliometrics as a research field: a course on theory and application of bibliometric indicators. Course Handouts, Leuven. Retrieved from http://nsdl.niscair.res.in/jspui/bitstream/123456789/968/1/Bib_Module_KUL.pdf.

  • Glänzel, W. (2006). On the h-index – A mathematical approach to a new measure of publication activity and citation impact. Scientometrics, 67(2), 315–321.

    Article  Google Scholar 

  • Glänzel, W. (2010). The role of the h-index and the characteristic scores and scales in testing the tail properties of scientometric distributions. Scientometrics, 83, 697–709.

    Article  Google Scholar 

  • Glänzel, W., Leta, J., & Thijs, B. (2006). Science in Brazil. Part 1: a macro level comparative study. Scientometrics, 67(1), 67–86.

    Article  Google Scholar 

  • Hilario, C. M., & Grácio, M. C. C. (2017). Scientific collaboration in Brazilian researches: a comparative study in the information science, mathematics and dentistry fields. Scientometrics, 113(2), 929–950.

    Article  Google Scholar 

  • Hirsch, J. E. (2005). An index to quantify an individual’s scientific research output. Proceedings of the National Academy of Sciences of the United States of America, 102(46), 16569–16572.

    Article  MATH  Google Scholar 

  • Hirsch, J. E. (2010). An index to quantify an individual’s scientific research output that takes into account the effect of multiple coauthorship. Scientometrics, 85, 741–754.

    Article  Google Scholar 

  • Hirsch, J. E. (2019). hα: An index to quantify an individual’s scientific leadership. Scientometrics, 118, 673–686.

    Article  Google Scholar 

  • Jin, B. (2006). h-index: an evaluation indicator proposed by scientist. Science Focus, 1(1), 8–9.

    Google Scholar 

  • Jin, B. (2007). The AR-index: complementing the h-index. ISSI Newsletter, 3(1), 6.

    Google Scholar 

  • Jin, B., et al. (2007). The R- and AR indices: Complementing the h-index. Chinese Science Bulletin, 52(6), 855–863.

    Article  Google Scholar 

  • Kamdem, J., et al. (2016). Scientific Performance of Brazilian Researchers in Pharmacology with grants from CNPq: A comparative study within the Brazilian categories. Anais da Academia Brasileira de Ciências, 88(3), 1735–1742.

    Article  Google Scholar 

  • Klepa, T. C., & Pedroso, B. (2020). Analysis of the technical scientific production of the national council for scientific and technological development (CNPq) productivity fellows in pediatrics. Einstein, 18, 1–6.

    Google Scholar 

  • Korevaar, J. C., & Moed, H. F. (1996). Validation of bibliometric indicators in the field of mathematics. Scientometrics, 37(1), 117–130.

    Article  Google Scholar 

  • Leite, P., Mugnaini, R., & Leta, J. (2011). A new indicator for international visibility: exploring Brazilian scientific community. Scientometrics, 88, 311–319.

    Article  Google Scholar 

  • Leta, J., Glänzel, W., & Thijs, B. (2006). Science in Brazil. Part 2: Sectoral and institutional research profiles. Scientometrics, 67(1), 87–105.

    Article  Google Scholar 

  • Lima, R. A., Velho, L. M. L. S., & Faria, L. I. L. (2012). Bibliometria e "avaliação" da atividade científica: um estudo sobre o índice-h. Perspectivas em Ciência da Informação, 17 (3), 3–17. Available in: http://www.scielo.br/scielo.php?script=sci_a rttext&pid=S1413- 99362012000300002. Access: July 11th, 2018

  • Lindahl, J., & Danell, R. (2016). The information value of early career productivity in mathematics: a ROC analysis of prediction errors in bibliometricly informed decision making. Scientometrics, 109(3), 2241–2262.

    Article  Google Scholar 

  • Marques, F. (2013). Os limites do índice-h. Revista Pesquisa Fapesp, 207. Available in: <http://revistapesquisa.fapesp.br/2013/05/14/os-limites-do-indice-h/>. Access: June 27th, 2017

  • Mendes, P. H. C., et al. (2010). Perfil dos Pesquisadores Bolsistas de Produtividade Científica em Medicina no CNPq. Brasil. Revista Brasileira de Educação Médica, 34(4), 535–541.

    Article  Google Scholar 

  • Merlino-Santesteban, C. (2007). Investigación matemática argentina recogida en MathSci (2000–2005). Información, Cultura & Sociedad, 16, 83–105.

    Google Scholar 

  • Mombaque, W. S., et al. (2015). Perfil dos pesquisadores bolsistas de produtividade em pesquisa na área de Enfermagem. Revista de Enfermagem UFPE, 9(2), 844–850.

    Google Scholar 

  • Mugnaini, R., Jannuzzi, P. M., & Quoniam, L. (2004). Indicadores bibliométricos da produção científica brasileira: uma análise a partir da base Pascal. Ciência da Informação, 33(2), 123–131.

    Article  Google Scholar 

  • Oliveira, E. A., et al. (2012). Comparison of Brazilian researchers in clinical medicine: are criteria for ranking well-adjusted? Scientometrics, 90(2), 429–443.

    Article  Google Scholar 

  • Oliveira, E. A., et al. (2013). Is there a correlation between journal impact factor and researchers’ performance? A study comprising the fields of clinical nephrology and neurosciences. Scientometrics, 97(2), 149–160.

    Article  Google Scholar 

  • Pellizzon, R. F., Chiari, B. M., & Goulart, B. N. G. (2014). A profile of researchers in speech, language and hearing science with productivity grants from (CNPq). Revista CEFAC, 16(5), 1520–1532.

    Article  Google Scholar 

  • Picinin, C. T., et al. (2016). Comparison of performance of researchers recipients of CNPq productivity grants in the field of Brazilian production engineering. Scientometrics, 109(2), 855–870.

    Article  Google Scholar 

  • Pravdić, N., & Pekorari, R. (1985). The citing practices of the authors to the national journals in mathematics, physics, and chemistry. Scientometrics, 8(3–4), 233–246.

    Article  Google Scholar 

  • Conselho Nacional de Pesquisa (CNPq) (2018). Produtividade em Pesquisa – PQ. Available in: http://www.cnpq.br/documents/10157/5f43cefd-7a9a-4030-945e-4a0fa10a169a. Access in: 15/02/2018.Available in: http://eprints.rclis.org/7616/1/Hirsch_new_developments.pdf. Access in: Feb 6th, 2017.

  • Rodrigues, L. O., et al. (2017). Overview of the scientific production in the Pharmacy area in Brazil: profile and productivity of researchers granted with fellowships by the National Council for Scientific and Technological Development. Scientometrics, 110(3), 1157–1171.

    Article  Google Scholar 

  • Rosas, F.S. (2018). Indicadores de impacto científico para a avaliação dos programas de pós-graduação brasileiros: uma aplicação na área de Zootecnia. Programa de Pós-Graduação em Ciência da Informação. Doctoral dissertation. São Paulo State University

  • Rousseau, R. (2006). New developments related to the Hirsch index. Retrieved from http://eprints.rclis.org/7616/1/Hirsch_new_developments.pdf.

  • Sacco, A. M., et al. (2016). Perfil dos Bolsistas de Produtividade em Pesquisa do CNPq atuantes em Psicologia no Triênio 2012–2014. Psicologia: ciência e profissão, 36(2), 292–303.

    Google Scholar 

  • Santos, N. C. F., Cândido, L. F. O., & Kuppens, C. L. (2010). Produtividade em Pesquisa do CNPq: análise do perfil dos pesquisadores da Química. Quimica Nova, 33(2), 489–495.

    Article  Google Scholar 

  • Santos, S. M. C., et al. (2009). Perfil dos pesquisadores da Saúde Coletiva no Conselho Nacional de Desenvolvimento Científico e Tecnológico. Physis Revista de Saúde Coletiva, 19(3), 761–775.

    Article  Google Scholar 

  • Scarpelli, A. C., et al. (2008). Academic Trajectories of Dental Researchers Receiving CNPq’s Productivity Grants. Brazilian Dental Journal, 19(3), 252–256.

    Article  Google Scholar 

  • Schott, T. (1980). Fundamental research in a small country: Mathematics in Denmark 1928–1977. Minerva, 18(2), 243–283.

    Article  Google Scholar 

  • Scimago, G. (2006). El índice hde Hirsch: aportaciones a un debate. El profesional de la información, 15(4), 304–306.

    Article  Google Scholar 

  • Silva, D. D. (2018). Medida de dispersão para o índice h: proposta de um indicador do tipo h de Hirsch. Programa de Pós-Graduação em Ciência da Informação. Doctoral dissertation. São Paulo State University.

  • Silva, E. L., Menezes, E. M., & Pinheiro, L. V. (2003). Avaliação da produtividade científica dos pesquisadores nas áreas de Ciências Humanas e Sociais Aplicadas. Informação & Sociedade: Estudos, 13(2), 193–222.

    Google Scholar 

  • Smolinsky, L., & Lercher, A. (2012). Citation rates in mathematics: A study of variation by subdiscipline. Scientometrics, 91(3), 911–924.

    Article  Google Scholar 

  • Spilki, F. R. (2013). Perfil dos bolsistas de produtividade do Conselho Nacional de Desenvolvimento Científico e Tecnológico (CNPq) na área de Medicina Veterinária. Pesquisa Veterinária Brasileira, 33(2), 205–213.

    Article  Google Scholar 

  • Sturmer, G., & et. al. . (2013). Profile and scientific output analysis of physical therapy researchers with research productivity fellowship from the Brazilian National Council for Scientific and Technological Development. Brazilian Journal of Physical Therapy, 17(1), 41–48.

    Article  Google Scholar 

  • Thomaz, P. G., Assad, R. S., & Moreira, L. F. P. (2011). Uso do fator de impacto e do índice h para avaliar pesquisadores e publicações. Arquivo Brasileiro de Cardiologia, 96(2), 90–93.

    Article  Google Scholar 

  • Valle, M. E., & Sakuray, F. (2014). On the criteria for receiving a research productivity fellowship from the Brazilian National Council for Scientific and Technological Development in Mathematics. TEMA, 15(3), 237–248.

    Article  Google Scholar 

  • Vanz, S. A. S., & Stumpf, I. R. C. (2010). Procedimentos e ferramentas aplicados aos estudos bibliométricos. Informação & Sociedade, 20(2), 67–75.

    Google Scholar 

  • Wagner-Döbler, R. (1997). Time dependencies of Bradford distributions: Structures of journal output in 20th-century logic and 19th-century mathematics. Scientometrics, 39(3), 231–252.

    Article  Google Scholar 

  • Wagner-Döbler, R., & Berg, J. (1996). Nineteenth-Century Mathematics in the Mirror of Its Literature: A Quantitative Approach. Historia Mathematica, 23, 288–318.

    Article  MathSciNet  MATH  Google Scholar 

  • Wainer, J., & Vieira, P. (2013). Avaliação de bolsas de produtividade em pesquisa do CNPq e medidas bibliométricas: correlações para todas as grandes áreas. Perspectivas em Ciência da Informação, 18(2), 60–78.

    Article  Google Scholar 

  • Weber, J. L. A., et al. (2015). Perfil dos pesquisadores bolsistas de produtividade científica em Psicologia do Conselho Nacional de Desenvolvimento Científico e Tecnológico. Estudos de Psicologia, 32(1), 1–11.

    Article  Google Scholar 

  • Wendt, G. W., et al. (2013). Profile of researchers in Psychology with productivity grants from Brazil’s national council of technological and scientific development (CNPQ). Psicologia ciência e profissão, 33(3), 536–547.

    Article  Google Scholar 

  • Ye, F. Y., & Rousseau, R. (2010). Probing the h-core: an investigation of the tail-core ratio for rank distributions. Scientometrics, 84(2), 431–439.

    Article  Google Scholar 

  • Zhang, C. T. (2009). The e-Index, Complementing the h-Index for Excess Citations. PLoS ONE, 4(5), e5429.

    Article  Google Scholar 

  • Zhang, C. T. (2013). The h’-Index, Effectively Improving the h-Index Based on the Citation Distribution. PLoS ONE, 8(4), e59912.

    Article  Google Scholar 

  • Zhou, P., & Leydesdorff, L. (2007). The citation impacts and citation environments of Chinese journals in mathematics. Scientometrics, 72(2), 185–200.

    Article  Google Scholar 

  • Zhou, P., & Tian, H. (2014). Funded collaboration research in mathematics in China. Scientometrics, 99(3), 695–715.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Faculdade de Tecnologia de Garça, Centro Estadual de Educação Tecnológica Paula Souza, Av. Presidente Vargas, 2331, Garça, 17400-000, Brazil

    Deise Deolindo Silva

  2. São Paulo State University, Av. Hygino Muzzi Filho 737, Marília, 17525-900, Brazil

    Maria Cláudia Cabrini Grácio

Authors
  1. Deise Deolindo Silva
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Maria Cláudia Cabrini Grácio
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Maria Cláudia Cabrini Grácio.

Appendix

Appendix

See Table

Table 7 Bibliometric indicators for the PQ1 researchers in mathematics, according to data collected in Scopus, in January 2018
Full size table

7

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Silva, D.D., Grácio, M.C.C. Dispersion measures for h-index: a study of the Brazilian researchers in the field of mathematics. Scientometrics 126, 1983–2011 (2021). https://doi.org/10.1007/s11192-020-03848-0

Download citation

  • Received:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11192-020-03848-0

Keywords

Search

Navigation