Skip to main content
SpringerLink
Log in

The evidence of systematic noise in non-patent references: A study of New Zealand companies’ patents

  • Published:
Scientometrics Aims and scope Submit manuscript

Abstract

Since the pioneering studies of Carpenter & Narin (1983), and Narin & Noma (1985), non-patent references (NPRs) in patent documents have been widely used as an indicator of science-technology links. Meyer (2000) reviewed previous work in the patent citation literature and found that citation links between patents and papers are, if not explicitly, at least implicitly viewed as an indication of the contribution of science to technology. Using a sample of 850 patents of New Zealand companies granted by the USPTO between 1976 and 2004, we find evidence of systematic noise in NPR data. We suggest that future research should pay close attention to heterogeneity among countries, and that one should demonstrate more caution in applying and interpreting results based on the NPR methodology.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • Acosta, M., Coronado, D. (2003), Science-technology flows in Spanish regions: An analysis of scientific citations in patents, Research Policy, 32(10): 1783–1803.

    Article  Google Scholar 

  • Callaert, J., Van Looy, B., Verbeek, A., Debackere, K., Thijs, B. (2006), Traces of prior art: An analysis of non-patent references found in patent documents, Scientometrics, 69(1): 3–20.

    Article  Google Scholar 

  • Cameron, A. C., Trivendi, P. K. (1998), Regression Analysis for Count Data, Cambridge University Press, Cambridge, UK.

    Google Scholar 

  • Carpenter, M. P., Narin, F. (1983), Validation study: Patent citations as indicators of science and foreign dependence, World Patent Information, 5: 180–185.

    Article  Google Scholar 

  • Cockburn, I., Henderson, R. (1998), Absorptive capacity, coauthoring behaviour, and the organization of research in drug discovery, Journal of Industrial Economics, 46(2): 157–182.

    Article  Google Scholar 

  • Collins, P., Wyatt, S. (1988), Citations in patents to the basic research literature, Research Policy, 17(2): 65–74.

    Article  Google Scholar 

  • Fleming, L., Sorenson, O. (2004), Science as a map in technological search, Strategic Management Journal, 25(8–9): 909–928.

    Article  Google Scholar 

  • Gittelman, M., Kogut, B. (2003), Does good science lead to valuable knowledge? Biotechnology firms and the evolutionary logic of citation patterns, Management Science, 49(4): 366–382.

    Article  Google Scholar 

  • Grupp, H., Schmoch, U. (1992), Perception of scientification as measured by referencing between patents and papers. In: H. Grupp (Ed.), Dynamics of Science-Based Innovation. Springer-Verlag, Berlin, pp. 73–128.

    Google Scholar 

  • Hall, B., Jaffe, A., Trajtenberg, M. (2000), Market value and patent citations: A first look, NBER Working Paper 7741, Cambridge, MA

  • Hall, B. H., Jaffe, A. B., Trajtenberg, M. (2001), The NBER patent citations data file: Lessons, insights and methodological tools, NBER Working Paper 8498, Cambridge, MA.

  • Harhoff, D., Narin, F., Scherer, F. M., Vopel, K. (1999), Citation frequency and the value of patented inventions, Review of Economics and Statistics, 81(3): 511–515.

    Article  Google Scholar 

  • Hausman, J., Hall, B. H., Griliches, Z. (1984), Econometric models for count data with an application to the patents R&D relationship, Econometrica, 52(4): 909–938.

    Article  Google Scholar 

  • Henderson, R., Cockburn, I. (1994), Measuring competence? Exploring firm effects in drug discovery, Strategic Management Journal, Winter Special issue, 15: 63–84.

    Article  Google Scholar 

  • Jaffe, A. (1989), Real effects of academic research, American Economic Review, 79(5): 957–970.

    Google Scholar 

  • Lanjouw, J. O., Schankerman, M. (2004), Patent quality and research productivity: Measuring innovation with multiple indicators, Economic Journal, 114(495): 441–465.

    Article  Google Scholar 

  • Meyer, M. (2000), Does science push technology? Patents citing scientific literature. Research Policy, 29(3): 409–434.

    Article  Google Scholar 

  • Meyer-Krahmer, F., Schmoch, U. (1997), Chemistry, Information Technology, Biotechnology and Production Technology: A Comparison of Linking Mechanisms in Four Fields, Fraunhofer Institute for Systems and Innovation Research, Karlsruhe, Germany.

    Google Scholar 

  • Narin, F., Hamilton, K. S., Olivastro, D. (1997), The increasing linkage between US technology and public science, Research Policy, 26(3): 317–330.

    Article  Google Scholar 

  • Narin, F., Noma, E. (1985), Is technology becoming science? Scientometrics, 7(3–6): 369–381.

    Article  Google Scholar 

  • Narin, F., Olivastro, D. (1998), Linkage between patent and papers: An interim EPO/US comparison, Scientometrics, 41(1–2): 51–59.

    Article  Google Scholar 

  • Nelson, R. R. (1982), The role of knowledge in R&D efficiency, Quarterly Journal of Economics, 97(3): 453–470.

    Article  Google Scholar 

  • The New Zealand Business Who’s Who, various editions, New Zealand Financial Press Ltd, Auckland, New Zealand.

  • Sorenson, O., Fleming, L. (2004), Science and the diffusion of knowledge, Research Policy, 33(10): 1615–1634.

    Article  Google Scholar 

  • Sorensen, J. B., Stuart, T. E. (2000), Aging, obsolescence and organizational innovation, Administrative Science Quarterly, 45(1): 81–112.

    Article  Google Scholar 

  • Tijssen, R. J. W., Buter, R. K., Van Leeuwan, T. N. (2000), Technological relevance of science: An assessment of citation linkages between patents and research papers, Scientometrics, 47(2): 389–412.

    Article  Google Scholar 

  • Trajtenberg, M. (1990), A penny for your quotes: Patent citations and the value of innovations, Rand Journal of Economics, 21(1): 172–187.

    Article  Google Scholar 

  • Van Dalen, H. P., Henkens, K. (2001), What makes a scientific article influential? Scientometrics, 50(3): 455–482.

    Article  Google Scholar 

  • Van Looy, B., Debackere, K., Callaert, J., Tijssen, R., Van Leeuwen, T. (2006), Scientific capabilities and technological performance of national innovation systems: An exploration of emerging industrial relevant research domains, Scientometrics, 66(2): 295–310.

    Article  Google Scholar 

  • Van Looy, B., Zimmermann, E., Veugelers, R., Verbeek, A., Mello, J., Debackere, K. (2003), Do science-technology interactions pay off when developing technology? An exploratory investigation of 10 science-intensive technology domains, Scientometrics, 57(3): 355–367.

    Article  Google Scholar 

  • Verbeek, A., Debackere, K., Luwel, M., Andres, P., Zimmermann, E., Deleus, F. (2002), Linking science to technology: Using bibliographic reference in patents to build linkage schemes, Scientometrics, 54(3): 339–420.

    Article  Google Scholar 

  • Zucker, L. G., Darby, M. R. (1996), Star scientists and institutional transformation: Patterns of invention and innovation in the formation of biotechnology industry, Proceedings of the National Academy of Science, 93(23): 12709–12716.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Management, University of Otago, P. O. Box 56, Dunedin, New Zealand, 9001

    Zi-Lin He & Min Deng

Authors
  1. Zi-Lin He
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Min Deng
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Zi-Lin He.

Rights and permissions

Reprints and permissions

About this article

Cite this article

He, ZL., Deng, M. The evidence of systematic noise in non-patent references: A study of New Zealand companies’ patents. Scientometrics 72, 149–166 (2007). https://doi.org/10.1007/s11192-007-1702-3

Download citation

  • Received:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11192-007-1702-3

Keywords

Search

Navigation