Skip to main content
SpringerLink
Log in

The Rationale of Indicators for the Management of Scientific Achievements

  • INFORMATION ANALYSIS
  • Published:
Automatic Documentation and Mathematical Linguistics Aims and scope

Abstract

The problem of the substantiation of the optimal composition of indicators intended for assessing existing and predicting new scientific achievements is considered. The types of indicators that are commonly used in the management of scientific achievements are systematized. A differentiated approach to the selection of such indicators is proposed, depending on the sections of knowledge to which they relate. In addition to the scientometric parameters of knowledge sections, the factors that influence the formation of sets of indicators are listed. The development of a quantitative model of the ratio of types of indicators in their sets based on measures of sets and binary relations of order over numbers is presented. Within the framework of this model, an explanation is given for the prevalence of expert indicators. The decision on the composition of the indicator sets is made based on heuristic rules. An example of finding the optimal ratio of the types of indicators for predicting achievements in the natural sciences and assessing the results achieved in the humanities is given.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1.
Fig. 2.

Similar content being viewed by others

REFERENCES

  1. Syuntyurenko, O.V., Funding for fundamental research: The conceptual image of a decision support system using methods of scientometrics and data analysis, Inf. Ee Primeneniya, 2018, vol. 12, no. 1, pp. 118–127.

    Google Scholar 

  2. Khoroshevskii, V.F. and Efimenko, I.V., Semantic technologies in scientometrics: Objectives, problems, solutions, and prospects, in Kognitivno-semioticheskie aspekty modelirovaniya v gumanitarnoi sfere (Cognitive-Semiotic Aspects of Modeling in the Humanitarian Sphere), Kazan: Izd. Akad. Nauk, 2017, pp. 222–266.

  3. Markusova, V., Kotel’nikova, N., Zolotova, A., and Shukhaeva, A., Promising areas of scientific research: Global and domestic trends in the SCI-E database, 2009 and 2015, Inf. Innovatsii, 2017, no. S1, pp. 111–118.

  4. Filatova, T.E. and Ponomarev, V.V., The “black swan” theory, Materialy XVI mezhvuzovskoi nauchno-tekhnicheskoi konferentsii “Novye tekhnologii v uchebnom protsesse i proizvodstve” (Proc. XVI Interuniversity Scientific and Technical Conference “New Technologies in the Educational Process and Production”), Ryazan, 2018, pp. 486–488.

  5. Hicks, D., Wouters, P., Waltman, L., De Rijcke, S., and Rafols, I., Bibliometrics: The Leiden Manifesto for research metrics, Nature, 2015, vol. 520, no. 7548, pp. 429–431.

    Article  Google Scholar 

  6. Lazar, M.G., Plagiarism in scientific communications of the modern era, Uch. Zap. Ross. Gos. Gidrometeorol. Univ., 2019, no. 56, pp. 166–175.

  7. Vinogradova, T.V., Dobrosovestnost’ v nauchnykh issledovaniyakh: Analit. obzor (Integrity in Scientific Research: Analytical Overview), Moscow: INION RAN, 2017.

  8. Sidel’nikov, Yu.V., Sistemnyi analiz ekspertnogo prognozirovaniya (System Analysis of Expert Forecasting), Moscow: MAI, 2007.

  9. Methodology for Calculating the Qualitative Indicator of the State Assignment “Comprehensive Score for Publication Performance” for Scientific Organizations Subordinate to the Ministry of Science and Higher Education of the Russian Federation for 2020, 2020. https://minobrnauki.gov.ru/documents/?ELEMENT_ID=24754&sphrase_id=31318.

  10. Vinogradova, T.V., Bibliometrics and social sciences are not compatible?, Naukoved. Issled., 2016, no. 2016, pp. 90–106.

  11. Malashuk, N.M. and Pavlova, E.A., Problems and methods of evaluating the effectiveness of scientific research, in Al’manakh nauchnykh rabot molodykh uchenykh Universiteta informatsionnykh tekhnologii, mekhaniki i optiki (Almanac of Scientific Works of Young Scientists of the University of Information Technologies, Mechanics, and Optics), 2017, pp. 173–177.

  12. Feigel’man, M.V. and Tsirlina, G.A., Bibliometric heat as a consequence of the lack of scientific expertise, Upr. Bol’shimi Sist.: Sb. Tr., 2013, no. 44, pp. 335–342.

  13. Reia, S.M. and Fontanari, J.F., Wisdom of crowds: Much ado about nothing, arXiv, 2020. https://arxiv.org/pdf/2008.01485.pdf.

  14. Golubkov, E.P., Metody prinyatiya upravlencheskikh reshenii (Methods for Making Management Decisions), Moscow: Yurait, 2020, part 2.

  15. Mikhailov, O.V. and Aristov, I.V., “Hybrid” Hirsch indices in the assessment of scientific activity, Naukoved. Issled., 2015, no. 2015, pp. 110–116.

  16. Tsai, C.F., Hu, Y.H., and Ke, S.W.G., A Borda count approach to combine subjective and objective based MIS journal rankings, Online Inf. Rev., 2014, vol. 38, no. 4, pp. 469–483.

    Article  Google Scholar 

  17. Sakulin, S.A. and Alfimtsev, A.N., On the problem of practical application of fuzzy measures and the Choquet integral, Vestn. Mosk. Gos. Tekh. Univ. im. N.E. Baumana, Ser. Priborostr., 2012, no. 1, pp. 55–63.

  18. Bornmann, L. and Hug, S., Bibliometrics-based heuristics: What is their definition and how can they be studied? - Research note, Prof. Inf., 2020, vol. 29, no. 4. https://doi.org/10.3145/epi.2020.jul.20

Download references

Funding

This work was carried out as part of a study on the topic 0003-2019-0001 of the State Assignment of VINITI RAS and with the support of the Russian Foundation for Basic Research (RFBR project No. 20-07-00014).

Author information

Authors and Affiliations

  1. All-Russian Institute for Scientific and Technical Information (VINITI), Russian Academy of Sciences, 125190, Moscow, Russia

    P. A. Kalachikhin

Authors
  1. P. A. Kalachikhin
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to P. A. Kalachikhin.

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Kalachikhin, P.A. The Rationale of Indicators for the Management of Scientific Achievements. Autom. Doc. Math. Linguist. 55, 46–53 (2021). https://doi.org/10.3103/S0005105521020035

Download citation

  • Received:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.3103/S0005105521020035

Keywords:

Search

Navigation