Abstract
The objective of this work is to evaluate the impact of research and technology organizations (RTO) on firm competitiveness. To this end, we develop a framework that includes strategies to deal with the methodological problems highlighted in the literature. The main features of this framework are the definition and classification of different types of impacts, the estimation of (rough) quantitative measures of them and the development of a multivariate model to explain the different impacts including the traditional indicators of firm characteristics and their relationships. The empirical work is based on a database constructed from information from the responses to a questionnaire designed specifically to estimate the impact of RTOs on Spanish firms, and information from the Spanish Innovation Survey. Our findings show that firms are able to recognize the influence of these relationships on different technical, economic, investment and intangible impacts and to roughly estimate their economic impact, and that several characteristics of these relationships affect the impact of RTOs.
Similar content being viewed by others
Notes
An exception is the study by Brown et al. (1991) which covers a broader set of strategies.
That is, we compare two different treatments instead of one treatment versus non treatment.
This was the latest wave available at the start of this study.
Around 20% of firms wrongly categorized their partners. Some university institutes or PROs were categorized as TIs and, conversely, some TIs were put into the PRO category.
For a more in depth analysis of these differences, see Barge-Gil et al. (2008).
It is crucial to point out that the overall impact of PROs in productive sector competitiveness is much higher, as there are many indirect impacts stemming from training and academics’ own research. In other words, our analysis should not be seen as an evaluation of universities’ performance overall, but only of their more usual third mission activities. However, in the case of TIs our analysis can be regarded as an evaluation of these organizations as a whole since their activities are oriented entirely towards improving competitiveness through joint research and the provision of innovation services.
These impact categories are highly interrelated, especially over time. An examination of these interrelations, however, is beyond the scope of this study, but it is an interesting topic for future research.
In the sense that we limit the influences of outliers by applying winsorization.
Anecdotal evidence suggest that this result might be due not so much to the actual interaction with a university, but to the greater initial distance between the R&D and other firm departments in the case of those firms interacting with them, compared to the situation in firms that interact with TIs.
We are aware that the proper econometric way to perform the analysis would rely on instrumental variables. However, small sample size and the absence of good instruments led us to take the ‘more simple’ empirical strategy based on regressions with controls (Jaffe 2002).
The authors are grateful to an anonymous referee for highlighting this point.
Unfortunately, we do not have data on total money contracted during the previous 5 years. However, we think that 3 years is a good proxy for this ideal measure.
In the case of quantitative impact we proved both robust least squares and Tobit. The high number of zero values made us opt for the Tobit estimations.
References
Amara, N., & Landry, R. (2005). Sources of information as determinants of novelty of innovation in manufacturing firms. Evidence from the 1999 statistics Canada innovation survey. Technovation, 25, 245–259.
Arnold, E. (2004). Evaluating research and innovation policy: A systems world needs systems evaluations. Research Evaluation, 131, 3–17.
Arora, A., Fosfuri, A., & Gambardella, A. (2001). Markets for technology. The economics of innovation and corporate strategy. Cambridge, MA: The MIT Press.
Arundel, A., & Geuna, A. (2004). Proximity and the use of public science by innovative European firms. Economics of Innovation and New Technology, 13(6), 559–580.
Autio, E., Kanninen, S., & Gustafsson, R. (2008). First- and second-order additionality and learning outcomes in collaborative R&D programs. Research Policy, 37, 59–76.
Barge-Gil, A. (2009). Cooperation-based innovators and peripheral cooperators: An empirical analysis of their characteristics and behaviour. Paper presented at DRUID Conference, June, in Copenhaguen, Denmark. http://www2.druid.dk/conferences/viewabstract.php?id=5659&cf=32. Accessed May 18, 2009.
Barge-Gil, A., & Modrego-Rico, A. (2008). Are technology institutes a satisfactory tool for public intervention in the area of technology? A neoclassical and evolutionary evaluation. Environment and Planning C: Government and Policy, 26(4), 808–823.
Barge-Gil, A., Santamaría, L., & Modrego, A. (2008). Complementarities between universities and technology institutes. New lessons and perspectives. Paper presented at DRUID Conference, June, in Copenhaguen, Denmark. http://www2.druid.dk/conferences/viewpaper.php?id=3352&cf=29. Accessed May 16, 2008.
Bayona, C., García-Marco, T., & Huerta, E. (2001). Firms motivations for cooperative R&D: An empirical analysis of Spanish firms. Research Policy, 30, 1289–1307.
Becker, W., & Dietz, J. (2004). R&D cooperation and innovation activities of firms—evidence for the German manufacturing industry. Research Policy, 33, 209–223.
Beise, M., & Stahl, H. (1999). Public research and industrial innovations in Germany. Research Policy, 28, 397–422.
Belderbos, R., Carree, M., Diederen, B., Lokshin, B., & Veugelers, R. (2004). Heterogeneity in R&D cooperation strategies. International Journal of Industrial Organisation, 22, 1237–1263.
Bennet, R., & Robson, P. (1999). Intensity of interaction in supply of business advice and client impact: A comparison of consultancy, business associations and government support initiatives for SMEs. British Journal of Management, 10, 351–369.
Boekholt, P., Lankhuizen, M., Arnold, E., Clarke, J., Kuusisto, J., de Laat, B., et al. (2001). An international review of methods to measure relative effectiveness of technology policy instruments. Final Report. Technopolis. http://www.technopolis-group.com/resources/downloads/reports/261_EZ_Final_010723.pdf. Accessed 21 November 2007.
Bozeman, B. (1999). Commercialization of federal laboratory technology. Results of a study of industry partners. In R. P. Oakey (Ed.), New technology-based firms in the 1990s (Vol. 3, pp. 127–139). London: Paul Chapman Publishing.
Bozeman, B. (2000). Technology transfer and public policy: A review of research and theory. Research Policy, 29, 627–655.
Brown, M. A., Berry, L. G., & Goel, R. K. (1991). Guidelines for successfully transferring government sponsored innovations. Research Policy, 20, 121–143.
Buisseret, T., Cameron, H., & Georghiu, L. (1995). What difference does it make? Additionality in the public support of R&D in large firms. International Journal of Technology Management, 104–6, 587–600.
Carrincazeaux, C., Lung, Y., & Rallet, A. (2001). Proximity and localisation of corporate R&D activities. Research Policy, 30, 777–789.
Cassimann, B., & Veugelers, R. (2002). R&D cooperation and spillovers. Some empirical evidence from Belgium. American Economic Review, 92(4), 1169–1184.
Cohen, W., & Levinthal, D. (1990). Absorptive capacity: A new perspective on learning and innovation. Administrative Science Quarterly, 35(1), 128–152.
Cozzarin, B. (2008). Data and the measurement of R&D program impacts. Evaluation and Program Planning, 31, 284–298.
D’Este, P., & Patel, P. (2007). University-industry linkages in the UK: What are the factors underlying the variety of interactions with industry? Research Policy, 36, 1295–1313.
Dahl, M. S., & Pedersen, C. (2004). Knowledge flows through informal contacts in industrial clusters: Myth or reality? Research Policy, 33, 1673–1686.
Feller, I., Glasmeier, A., & Mark, M. (1996). Issues and perspectives on evaluating manufacturing modernization programs. Research Policy, 25, 309–319.
Fey, C., & Birkinshaw, J. (2005). External source of knowledge: Governance mode, and R&D performance. Journal of Management, 314, 597–621.
Fontana, R., Geuna, A., & Matt, M. (2006). Factors affecting university-industry R&D projects: The importance of searching, screening and signalling. Research Policy, 35, 309–323.
Fromhold-Eisebith, M., & Schartinger, D. (2002). Universities as agents in regional innovation systems. Evaluating patterns of knowledge intensive collaboration in Austria. In Z. Acs, H. de Groot, & P. Nijkamp (Eds.), The emergence of the knowledge economy (pp. 173–194). New York: Springer.
Gallouj, C. (1997). Asymmetry of information and the service relationship: Selection and evaluation of the service provider. International Journal of Service Industry Management, 8(1), 42–64.
Geisler, E. (2001). Explaining the generation and performance of intersector technology cooperation. A survey of the literature. Technology Analysis & Strategic Management, 13(2), 195–206.
Goe, W., Lentnek, B., MacPherson, A., & Phillips, D. (2000). The role of contacts requirement in producer service location. Environment and Planning A, 32, 131–145.
Guilhon, B. (2004). Markets for knowledge: Problems, scope, and economic implications. Economics of Innovation and New Technnology, 132, 165–181.
Hagedoorn, J. (2002). Inter-firm partnerships: An overview of major trends and patterns since 1960. Research Policy, 31, 477–492.
Ham, R. M., & Mowery, D. (1998). Improving the effectiveness of public-private R&D collaborations: Case studies at a US weapons laboratory. Research Policy, 26, 661–675.
Hassink, R. (1997). Technology transfer infrastructures: Some lessons from experiences in Europe, the US and Japan. European Planning Studies, 5(3), 351–370.
Heijs, J. (2004). Efectividad de las políticas de innovación en el fomento de la cooperación. Economía Industrial, 346, 97–114.
Howells, J., James, A., & Malik, K. (2003). The sourcing of technological knowledge: Distributed innovation processes and dynamic change. R&D Management, 33(4), 395–409.
Huergo, E. (2006). The role of technological management as a source of innovation: Evidence from Spanish manufacturing firms. Research Policy, 35, 1377–1388.
Izushi, H. (2003). Impact of the length of relationships upon the use of research institutes by SMEs. Research Policy, 32, 771–788.
Izushi, H. (2005). Creation of relational assets through the ‘library of equipment’ model: An industrial modernization approach of Japan’s local technology centres. Entrepreneurship & Regional Development, 173, 183–204.
Jaffe, A. (2002). Building programme evaluation into the design of public research-support programmes. Oxford Review of Economic Policy, 18(1), 22–34.
Lambrecht, J., & Pirnay, F. (2005). An evaluation of public support measures for private external consultancies to SMEs in the Walloon Region of Belgium. Entrepreneurship and Regional Development, 17, 89–108.
Lane, P., Koka, B., & Pathak, S. (2006). The reification of absorptive capacity: A critical review and rejuvenation of the construct. Academy of Management Review, 31(4), 833–863.
Laursen, K., & Salter, A. (2004). Searching high and low: What types of firms use universities as a source of innovation? Research Policy, 33, 1201–1215.
López, A. (2008). Determinants for R&D cooperation. Evidence from Spanish manufacturing firms. International Journal of Industrial Organisation, 26(1), 113–136.
Luukkonen, T. (2000). Additionality of EU framework programmes. Research Policy, 29, 711–724.
MacPherson, A. (1997). The role of producer service outsourcing in the innovation performance of New York state manufacturing firms. Annals of the Association of American Geographers, 871, 52–71.
Martin, S. (2003). The evaluation of strategic research partnerships. Technology Analysis & Strategic Management, 152, 159–176.
Meeus, M., Oerlemans, L., & Hage, J. (2004). Industry-public knowledge infrastructure interactions: Intra- and inter-organizational explanations of interactive learning. Industry and Innovation, 114, 327–352.
Miotti, L., & Sachwald, F. (2003). Co-operative R&D: Why and with whom? An integrated framework of analysis. Research Policy, 32, 1481–1499.
Modrego-Rico, A., Barge-Gil, A., & Núñez-Sánchez, R. (2005). Developing indicators to measure technology institutes’ performance. Research Evaluation, 14(2), 177–184.
Mol, M. (2005). Does being R&D intensive still discourage outsourcing? Research Policy, 34, 571–582.
Mole, K., Hart, M., Roper, S., & Saal, D. (2008). Differential gains from business link support and advice a treatment effects approach. Environment and Planning C: Government and Policy, 26, 315–334.
Mowery, D. (1999). Collaborative R&D. How effective is it? Issues in Science and Technology, Fall, 3, 7–44.
Mowery, D. (2003). Using cooperative research and development agreements as S&T indicators: What do we have and what would we like? Technology Analysis & Strategic Management, 152, 189–205.
Muscio, A. (2007). The impact of absorptive capacity on SMEs’ collaboration. Economics of Innovation and New Technology, 16(8), 653–668.
Narula, R. (2001). Choosing between internal and non-internal R&D activities: Some technological and economic factors. Technology Analysis & Strategic Management, 133, 365–387.
Narula, R. (2004). R&D collaboration by SMEs: new opportunities and limitations in the face of globalisation. Technovation, 24, 153–161.
Narula, R., & Hagedoorn, J. (1999). Innovating through strategic alliances: Moving towards international partnerships and contractual agreements. Technovation, 19, 283–294.
O’Farrell, P., & Hitchens, D. (1990). Research policy and review 32. Producer services and regional development: A review of some major conceptual policy and research issues. Environment and Planning A, 22, 1141–1154.
O’Farrell, P., & Moffat, L. (1991). An interaction model of business service production and consumption. British Journal of Management, 2, 205–221.
O’Farrell, P., & Moffat, L. (1995). Business services and their impact upon client performance. An exploratory interregional analysis. Regional Studies, 292, 111–124.
Okamuro, H. (2007). Determinants of successful R&D cooperation in Japanese small business: The impact of organizational and contractual characteristics. Research Policy, 36, 1529–1544.
Perkmann, M., & Walsh, K. (2007). University-industry relationships and open innovation. International Journal of Management Reviews, 9(4), 259–280.
Pietrobelli, C., & Rabellotti, R. (2007). Business Development centres in Italy: Close to firms, far from innovation. World Review of Science, Technology and Sustainable Development, 41, 38–55.
Preissl, B. (2006). Research and Technology Organizations in the service economy. Innovation, 19(1), 131–145.
Ranga, L. M., Miedema, J., & Jorna, R. (2008). Enhancing the innovative capacity of small firms through the triple helix interactions: Challenges and opportunities. Technology Analysis & Strategic Management, 206, 697–716.
Revilla, E., Sarkis, J., & Modrego, A. (2003). Evaluating performance of public-private research collaborations. A DEA analysis. Journal of the Operational Research Society, 54, 165–174.
Roessner, D. (2002). Outcome measurement in the USA: State of the art. Research Evaluation, 11(2), 85–93.
Rolfo, S., & Calabrese, G. (2003). Traditional SMEs and innovation: The role of the industrial policy in Italy. Entrepreneurship & Regional Development, 15(3), 253–271.
Rothwell, R., & Dodgson, M. (1991). External linkages and innovation in small and medium- sized enterprises. R&D Management, 21, 125–137.
Sakakibara, M. (1997). Heterogeneity of firm capabilities and cooperative research and development: An empirical examination of motives. Strategic Management Journal, 18, 143–164.
Santamaría, L., Barge-Gil, A., & Nieto, M. J. (2009). Is there innovation beyond R&D? The role played by other innovation activities. Universia Business Review, 22, 102–117.
Shapira, P., & Youtie, J. (1998). Evaluating industrial modernization: Methods, results and insights from the Georgia manufacturing extension alliance. Journal of Technology Transfer, 23(1), 17–27.
Shapira, P., Youtie, J., & Roessner, J. D. (1996). Current practices in the evaluation of US industrial modernization programs. Research Policy, 25, 185–214.
van Helleputte, J., & Reid, A. (2004). Tackling the paradox: Can attaining global research excellence can be compatible with local technology development? R&D Management, 341, 33–44.
Veugelers, R. (1998). Collaboration in R&D. An assessment of theoretical and empirical findings. The Economist, 149, 419–443.
Williams, D., & Rank, D. (1998). Measuring the economic benefits of research and development: The current state of the art. Research Evaluation, 71, 17–30.
Wren, C., & Storey, D. (2002). Evaluating the effect of soft business support upon small firm performance. Oxford Economic Papers, 54, 334–365.
Wood, P. (2002). Knowledge-intensive services and urban innovativeness. Urban Studies, 39(5–6), 993–1002.
Youtie, J., Bozeman, B., & Shapira, P. (1999). Using an evaluability assessment to select methods for evaluating state technology development programs: The case of the Georgia Research Alliance. Evaluation and Program Planning, 22, 55–64.
Acknowledgments
The authors acknowledge the financial support of FEDIT and the help provided by the Spanish Institute of Statistics. They also thank participants in DRUID 2009 Summer Conference for the comments received and Ángela Vásquez-Urriago for excellent research assistance. The usual disclaimer applies.
Author information
Authors and Affiliations
Corresponding author
Appendices
Rights and permissions
About this article
Cite this article
Barge-Gil, A., Modrego, A. The impact of research and technology organizations on firm competitiveness. Measurement and determinants. J Technol Transf 36, 61–83 (2011). https://doi.org/10.1007/s10961-009-9132-4
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10961-009-9132-4