, Volume 76, Issue 2, pp 369–390 | Cite as

A quantitative analysis of indicators of scientific performance

  • Sune LehmannEmail author
  • Andrew D. Jackson
  • Benny E. Lautrup


Condensing the work of any academic scientist into a one-dimensional indicator of scientific performance is a difficult problem. Here, we employ Bayesian statistics to analyze several different indicators of scientific performance. Specifically, we determine each indicator’s ability to discriminate between scientific authors. Using scaling arguments, we demonstrate that the best of these indicators require approximately 50 papers to draw conclusions regarding long term scientific performance with usefully small statistical uncertainties. Further, the approach described here permits statistical comparison of scientists working in distinct areas of science.


Citation Rate Citation Data Scientific Performance Citation Distribution Scientific Excellence 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Adam, D., Nature 415, 726 (2002).Google Scholar
  2. 2.
    Dellavalle, R. P., Hester, E. J., Heilig, L. F., Drake, A. L., Kuntzman, J.W., Graber, M., Schilling, L. M., Science 302, 787 (2003).CrossRefGoogle Scholar
  3. 3.
    Franck, G., Science 286, 53 (1999).CrossRefGoogle Scholar
  4. 4.
    Adams, J., Griliches, Z., Proceedings of the National Academy of Sciences, USA 93, 12664 (1996).Google Scholar
  5. 5.
    Lehmann, S., Jackson, A. D., Lautrup, B. E., Nature 444, 1003 (2006).CrossRefGoogle Scholar
  6. 6.
    XXXvan Raan, A. F. J., Journal of the American Society for Information Science 57, 408 (2005).Google Scholar
  7. 7.
    Hirsch, J. E., Proceedings of the National Academy of the Sciences 102, 16569 (2005).Google Scholar
  8. 8.
    Garfield, E., Essays of an Information Scientist, volume 1–15. ISI Press, (1977–1993).Google Scholar
  9. 9.
    XXXde Solla Price, D., Science 149, 510 (1965).CrossRefGoogle Scholar
  10. 10.
    Redner, S., European Physics Journal B 4, 131 (1998).CrossRefGoogle Scholar
  11. 11.
    Lehmann, S., Lautrup, B. E., Jackson, A. D., Physical Review E 68, 026113 (2003).Google Scholar
  12. 12.
    Redner, S., Physics Today 58, 49 (2005).CrossRefGoogle Scholar
  13. 13.
    Barabási, A.-L., Albert, R., Science 286, 509 (1999).CrossRefMathSciNetGoogle Scholar
  14. 14.
    Albert, R., Barabási, A.-L., Reviews of Modern Physics 74, 47 (2002).CrossRefMathSciNetGoogle Scholar
  15. 15.
    Dorogovtsev, S. N., Mendes, J. F. F., Advances in Physics 51, 1079 (2002).CrossRefGoogle Scholar
  16. 16.
    Newman, M. E. J., SIAM Review 45, 167 (2003).CrossRefMathSciNetzbMATHGoogle Scholar
  17. 17.
    Lehmann, S., Master’s Thesis, The Niels Bohr Institute, (2003). Available online at:
  18. 18.
    Kryssanov, V. V., Kuleshov, E. L., Rinaldo, F. J., Ogawaa, H., cs/0703115 (2007).Google Scholar
  19. 19.
    Simkin, M. V., Roychowdhury, V. P., Complex Systems 14, 269 (2003).Google Scholar
  20. 20.
    Newman, M. E. J., Contemporary Physics 46, 323 (2005).CrossRefGoogle Scholar
  21. 21.
    Seglen, P. O., Journal of the American Society for Information Science 45, 1 (1994).CrossRefGoogle Scholar
  22. 22.
    Lehmann, S., Jackson, A. D., Lautrup, B. E., Europhysics Letters 69, 298 (2005).CrossRefGoogle Scholar
  23. 23.
    Lotka, A., Journal of the Washington Academy of Sciences 16, 317 (1926).Google Scholar

Copyright information

© Springer Science+Business Media B.V. 2008

Authors and Affiliations

  • Sune Lehmann
    • 1
    • 2
    Email author
  • Andrew D. Jackson
    • 3
  • Benny E. Lautrup
    • 3
  1. 1.Center for Complex Network Research, Department of PhysicsNortheastern UniversityBostonUSA
  2. 2.Center for Cancer Systems Biology, Dana-Farber Cancer InstituteHarvard UniversityBostonUSA
  3. 3.The Niels Bohr InstituteCopenhagenDenmark

Personalised recommendations