Skip to main content

Advertisement

Log in

Hunting for the Elusive (the Appraisal of Research as a Conundrum)

  • Published:
Journal of the Knowledge Economy Aims and scope Submit manuscript

Abstract

The paper debunks the deep-rooted belief that proper appraisal of research is a job within reach of the average scientist. The main qualities of an individual expert that allow him to reveal the value of a research are profound knowledge of the subject, broad scientific outlook, and ability for conceptual linking. As the same person rarely combines them in full measure, judgments pretty often turn out to be imprecise and superficial. The scientific community as a whole is surely capable of redressing the defects and weaknesses of its individual members, but copes with the task quite satisfactorily chiefly in case of “standard” research with a small degree of novelty, while with pioneering works, it is mostly mistaken. Collective appraisals are bounded by the conceptual horizon of the age they are given in, the institutional involvement of those making them on its behalf, and the unification of attitudes that is conditioned by the “communal” nature of science as a social institution. That is why the scientific community virtually never attaches high value to breakthrough discoveries forthwith. And without transformation of the existing practice of “measuring” the value of research, this bias can scarcely be overcome.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  • Ashdown, A. A. (1953). Nobel Prizes to German, Hollander: High polymer pioneer, inventor of phase contrast microscopy win Nobel Prizes in chemistry and physics. Chemical and Engineering News, 31(46), 4760–4761.

    Article  Google Scholar 

  • Avery, O. T., MacLeod, C. M., & McCarty, M. (1944). Studies on the chemical nature of the substance inducing transformation of pneumococcal types. Journal of Experimental Medicine, 79(2), 137–158. https://doi.org/10.1084/jem.79.2.137

    Article  Google Scholar 

  • Ayoubi, C., Pezzoni, M., & Visentin, F. (2021). Does it pay to do novel science? The selectivity patterns in science funding. Science and Public Policy, 48(5), 635–648. https://doi.org/10.1093/scipol/scab031

    Article  Google Scholar 

  • Banks, J. (1795). A treatise on mills. for Richardson and Pennington.

    Google Scholar 

  • Blessed, G., Tomlinson, B., & Roth, M. (1968). The association between quantitative measures of dementia and of senile change in the cerebral grey matter of elderly subjects. British Journal of Psychiatry, 114(512), 797–811. https://doi.org/10.1192/bjp.114.512.797

    Article  Google Scholar 

  • Bloch, C., Sorensen, M. P., & Young, M. (2020). Tales of serendipity in highly cited research: An explorative study. Journal of the Knowledge Economy, 11(4), 1596–1613. https://doi.org/10.1007/s13132-019-00625-0

    Article  Google Scholar 

  • Braben, D. W. (2004). Pioneering research: A risk worth taking. Wiley – Interscience.

    Google Scholar 

  • Buckley, R. B. (1905). The irrigation works of India. Spon.

    Google Scholar 

  • Cancer Work Wins Nobel Prize in Medicine for Dr. Marcel Peyton Rous and Dr. Charles B. Huggins. (1966). Chemical and Engineering News, 44(44), 23.

    Google Scholar 

  • Carayannis, E., & Grigoroudis, E. (2016). Quadruple innovation helix and smart specialization: Knowledge production and national competitiveness. Foresight and STI Governance, 10(1), 31–42. https://doi.org/10.17323/1995-459x

    Article  Google Scholar 

  • Carayannis, E. G., & Campbell, D. F. J. (2021). Democracy of climate and climate for democracy: The evolution of quadruple and quintuple helix innovation systems. Journal of the Knowledge Economy, 12(7), 2050–2082. https://doi.org/10.1007/s13132-021-00778-x

    Article  Google Scholar 

  • Cassini, J. (1740). Élémens d’astronomie. L’imprimerie Royale.

    Google Scholar 

  • Clemmesen, J. (1978). Johannes Fibiger. Gongylonema and vitamin A in carcinogenesis. Acta Pathologica et Microbiologica Scandinavica, 270(Suppl), 1–13.

    Google Scholar 

  • Darcy, H., & Bazin, H. É. (1865). Recherches hydrauliques. Imprimerie Nationale.

    Google Scholar 

  • Daugherty, R. L. (1937). Hydraulics: A text on practical fluid mechanics. McGraw-Hill.

    Google Scholar 

  • Delambre, J.-B. (1814). Astronomie théorique et pratique (Vol. III). Courcier.

    Google Scholar 

  • Dubuat, P.-L.-G. (1816). Principes d’hydraulique et de pyrodynamique, verifiés par un grand nombre d’experiences. Firmin Didot.

    Google Scholar 

  • Einstein, A. (1905). Ist die Trägheit eines Körpers von seinem Energieinhalt abhängig? Annalen der Physik, Vierte Folge. Bd. 18, 323(13), 639–641.

    Article  Google Scholar 

  • Einstein, A. (1918). Nachtrag. Hr. Einstein bemerkt zu der vorliegenen Arbeit: Weyl, H. Gravitation und Elekrizitaet. Sitzungsberichte der Preussischen Aademie der Wissenschaften XXVI. Erster Halfband. Januar bis Juni. Stueck I – XXXII. 30. Mai. Gesamtsitzung, 478.

  • Ganguillet, E., & Kutter, W. R. (1889). A general formula for the uniform flow of water in rivers and other channels. Wiley.

    Google Scholar 

  • Heilbron, J. L., & Seidel, R. W. (1989). Lawrence and his laboratory: A history of the Lawrence Berkeley Laboratiry (Vol. I). University of California Press.

    Book  Google Scholar 

  • Huber, J. G. (2014). Walther Gerlach (1889 – 1979) und sein Weg zum erfolgreichen Experimentalphysiker bis etwa 1925 (Dissertation). Ludwig-Maximilians-Universität.

    Google Scholar 

  • Humphreys, A. A., & Abbot, H. L. (1861). Report upon the physics and hydraulics of the Mississippi River. J. B. Lippincott.

    Google Scholar 

  • Jeans, J. H. (1904). A suggested explanation of radioactivity. Nature, 70(1805), 101.

    Article  Google Scholar 

  • Johnson, M. J. (1857). On presenting the medal of the society to M. Scwabe. Monthly Notices of the Royal Astronomical Society, XVII(4), 126–132.

    Google Scholar 

  • Keill, J. (1718). Introductio ad veram astronomiam, seu Lectiones astronomicae. Theatro Sheldoniano.

    Google Scholar 

  • Keill, J. (1724). An introduction to the true astronomy: Or, astronomical lectures. Bernard Lintot.

    Google Scholar 

  • Keill, J. (1746). Institutions astronomiques, ou Leçons élémentaires d’astronomie. Guerin.

    Google Scholar 

  • Kohlrausch, F. (1896). Leitfaden der praktischen Physik. B. G. Teubner.

    Google Scholar 

  • Lalande, J. (1771). Astronomie (Vol. III). Desaint.

    Google Scholar 

  • Lawrence, E. O. (1937). Science and technology. Review of Scientific Instruments., 8(9), 311–313.

    Article  Google Scholar 

  • Lederberg, J. (1972). Reply to H. V. Wyatt. Nature, 239(5369), 234. https://doi.org/10.1038/239234a0

    Article  Google Scholar 

  • Lishman, W. A. Chair (1977). Senile and presenile dementias: A report of the MRC subcommittee. Medical Research Council.

    Google Scholar 

  • Long, R. (1764). Astronomy, in Five Books (Vol. II. P. 1 (b. 3)) Printed for the Author.

    Google Scholar 

  • Manning, R. (1891). On the flow of water in open channels and pipes. Transactions of the Institution of Civil Engineers of Ireland, XX, 161–199.

    Google Scholar 

  • Merton, R. K. (1973). The sociology of science: Theoretical and empirical investigations. The University of Chicago Press.

    Google Scholar 

  • Mouret, G. (1921). Antoine Chézy: Histoire d’une formule d’hydraulique. Annales des Ponts et Chaussées, 61(2), 165–269.

    Google Scholar 

  • Nicholson, J. M., & Ioannidis, J. P. A. (2012). Research grants: Conform and be funded. Nature, 492(7427), 34–36. https://doi.org/10.1038/492034a

    Article  Google Scholar 

  • (1870). On the periodicity of the solar spots. Nature, 1, 284–286.

    Article  Google Scholar 

  • Parker, P. A. M. (1949). The control of water as applied to irrigation, power and town water supply purposes. Routledge and Keagan Paul.

    Google Scholar 

  • Petrosyan, A. E. (2015). Within a nutshell (the mental roots of human insusceptibility to new ideas). Journal of the Knowledge Economy, 6(1), 157–189. https://doi.org/10.1007/s13132-012-0127-2

    Article  Google Scholar 

  • Petrosyan, A. E. (2016a). A straight-jacket for conceptual breakthroughs (the appraisal in science as a brake on the progress of knowledge). I. Why new ideas get dashed to pieces on the rocks of evaluation. International Journal of Innovation, Creativity and Change, 2(3), 108–135.

    Google Scholar 

  • Petrosyan, A. E. (2016b). A straightjacket for conceptual breakthroughs (the appraisal in science as a brake on the progress of knowledge). II. What to do to get out of the impasse of neophobia. International Journal of Innovation, Creativity and Change, 2(4), 28–67.

    Google Scholar 

  • Petrosyan, A. E. (2019). Regaining the soul lost (the limits of depersonalization in organizational management). Philosophy of Management, 18(2), 131–155. https://doi.org/10.1007/s40926-018-0092-3

    Article  Google Scholar 

  • Petrosyan, A. E. (2022). The pumpkin hour in science: How and why major achievements turn into marginal findings. Cosmos and History: The Journal of Natural and Social Philosophy, 18(2), 413–444.

    Google Scholar 

  • Phillips, J. A. (1803). General history of inland navigation, foreign and domestic. The Architectural Library.

    Google Scholar 

  • Planck, M. (1933). Wege zur physikalischen Erkenntnis. S. Hirzel.

    Book  Google Scholar 

  • Polanyi, M. (1962). Personal knowledge: Towards a post-critical philosophy. Routledge.

    Google Scholar 

  • Roth, M. (1971). Classification and aetiology in mental disorders of old age: Some recent developments. In D. W. K. Kay & A. Walk (Eds.), Recent Developments in Psychogeriatrics: A Symposium (pp. 1–17). Headley.

    Google Scholar 

  • Rutherford, E. (1937). The newer alchemy. At the University Press.

    Google Scholar 

  • Schwabe, H. (1838). Über die Flecken der Sonne. Astronomische Nachrichten, 15(350), 243–248.

    Google Scholar 

  • Schwabe, H. (1844). Sonnen-Beobachtungen im Jahre 1843. Astronomische Nachrichten, 21(495), 233–234.

    Google Scholar 

  • Seelig, C. (1954). Albert Einstein. Europa Verlag.

    Google Scholar 

  • Segre, E. (1987). And the sad augurs mock their own presage. In N. Metropolis, D. M. Kerr, & G.-C. Rota (Eds.), New directions in physics: The Los Alamos 40th Anniversary Volume (pp. 111–114). Academic Press.

    Chapter  Google Scholar 

  • Shammas, N. K., & Wang, L. K. (2016). Water engineering: Hydraulics, distribution, and treatment. Wiley.

    Google Scholar 

  • Stephan, P. E. (2010). The economics of science. In H. H. Bronwyn & N. Rosenberg (Eds.), Economics of Innovation (pp. 217–273). North Holland (Elsevier).

    Google Scholar 

  • Stolley, P. D., & Lasky, T. (1992). Johannes Fibiger and his Nobel Prize for the hypothesis that a worm causes stomach cancer. Annals of Internal Medicine, 116(9), 765–769. https://doi.org/10.7326/0003-4819-116-9-765

    Article  Google Scholar 

  • von Humboldt, A. (1850). Kosmos: Entwurf einer physischen Weltbeschreibung. Bd. III. Tubingen: J. W. Cotta.

    Google Scholar 

  • Wernstedt, W. (1965). Presentation speech. In Nobel Lectures, Including Presentation Speeches and Laureates’ Biographies: Physiology or Medicine, 1922-1941 (pp. 119–121). Elsevier.

    Google Scholar 

  • Weyl, H. (1918). Erwiderung der Verfassers. In Sitzungsberichte der Preussischen Akademie der Wissenschaften (Vol. XXVI, pp. 478–480). Erster Halfband Gesamtsitzung.

  • Weyl, H. (1919). Raum – Zeit – Materie: Vorlesungen ueber allgemaine Relativitaetstheorie. Julius Springer.

    Book  Google Scholar 

  • Weyl, H. (1989). Geometry and physics. In Mathematical Thinking. Science (in Russ.).

    Google Scholar 

  • Wilson, D. (2014). Quantifying the quiet epidemic: Diagnosing dementia in late 20th-century Britain. History of the Human Sciences, 27(5), 126–146. https://doi.org/10.1177/0952695114536715

    Article  Google Scholar 

  • Wolf, R. (1861). Die Sonne und ihre Flecken: Ein Vortrag vor gemischtem Publikum. Orell, Fussli & Co.

    Google Scholar 

  • Wyatt, H. V. (1975). Knowledge and prematurity: The journey from transformation to DNA. Perspectives in Biology and Medicine, 18(2), 149–156. https://doi.org/10.1353/pbm.1975.0014

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Armen E. Petrosyan.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Petrosyan, A.E. Hunting for the Elusive (the Appraisal of Research as a Conundrum). J Knowl Econ (2023). https://doi.org/10.1007/s13132-023-01287-9

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s13132-023-01287-9

Keywords

Navigation