Abstract
Europe has seen the importance of Research and Technology Organisations (RTOs) grow in recent years. This is hardly surprising given that their main mission is to harness science and technology to foster innovation that can improve the quality of life and boost economic competitiveness. In the current economic context, it is key to demonstrate the positive impact of their activities on the economy and society, i.e. spin-offs, considering that they receive public subsidies. Accordingly, the European Association of Research and Technology Organisations (EARTO) published a report in March 2018 that details the economic footprint of 9 of its members, which includes the French Alternative Energies and Atomic Energy Commission (CEA). This French organisation, whose budget represents 60% of the total budget from all 9 RTOs, was the subject of a separate calculation in the framework of the research carried out for the paper: data was provided by the CEA and simulation was performed on the basis of the model provided by IDEA Consult. This article deals with the provision of empirical results about the CEA and makes a comparison with the results obtained for the 9 RTOs using the same methodology. This case study highlights information that can be used to provide a more accurate assessment of the CEA’s economic impact based on its specificities compared with its European counterparts. In addition to estimating the economic spin-offs of technology transfers, it is equally important to take into account value creation associated with the procurement of high technology—the impact of “big science”—which is substantial in the CEA’s defence sector and undervalued in the economic model used by IDEA Consult. Thanks to a literature review summarising the advantages and limitations of the different impact assessment approaches and thanks to interviews at CEA management level—that helped us to better understand the impact-generating mechanisms—the paper opens new avenues of research to improve the methodology for measuring the impact of research organisations that are very diverse in their duties. The new methodology proposed takes into account the spillovers of their activities, as well as offering useful approaches for governments and the European Commission. More specifically, it proposes to apply the same methodology—in the opposite direction—to measure the spin-offs of the contract research activities (with a multiplier as in the methodology used by IDEA Consult) and to estimate the science market characterised by very specific calls for tender that generate innovation. Using the same model, we therefore propose to couple an estimate of the footprint of jobs and standard purchases, with an estimate of the spin-offs linked to both technology transfers (RTO to industry) and to high-tech purchases (industry to RTO).
This is a preview of subscription content, access via your institution.


Notes
Including solar photovoltaic, wind power, electric vehicles, Li-Ion batteries, carbon capture and storage, biofuels
High council for the evaluation of research and higher education
In March 2002, Barcelona’s European Council agreed to increase investment in R&D to 3% of the GDP by 2010.
Austin and Macauley (2000), p. 5
Such a test was performed in a study from the UK’s Economic and Social Data Service (ESDS) by Beagrie and Houghton (2012), which is relatively rare in the literature analysed.
For every European Currency Unit (ECU) invested by the European tax payer, almost 3 ECUs of measurable economic wealth is generated.
See the European project (2011–2013) called EvaRIO (Evaluation of Research Infrastructures in Open innovation and research systems)
For every Swiss franc spent by the CERN in the high-tech field between 1973 and 1987, 3 Swiss francs in new business with contractors was generated.
Multiplier effects associated with the expense of purchasing supercomputers: the 1 million euros spent on a supercomputer manufactured in France generated a total of €2.49 million in production, €0.96 million in added value, and 12 jobs. The multiplier effects of maintenance expenses were €2.82 million, €1.44 million and 7 jobs, respectively.
The 1 million euros in subsidies paid to the Dutch research organisation, TNO, generated €1.88 million in production, €1.15 million in added value (GDP) and 13.3 jobs.
The employment multiplier for STMicroélectronique was around 4 in 2012.
Two additional jobs for each job created in the public research organisation.
This means that for every £1 million of public money spent, between £2 million and £3 million are generated in the economy through the purchase of goods and services and wage spending.
French National Research Agency
French Environment and Energy Management Agency
Commissariat-General for Investment
A multiplier equal to 1.98 was applied. Averaged over Europe, this multiplier represents the total technology intensity of a country compared with its R&D effort (Knell 2008; Hauknes and Knell 2009): \( \sum \frac{Marketed\ products\ and\ equipments\ incorporating\ R\&D}{Countr{y}^{\prime }s\ total\ R\&D\ } \)
This type of modified footprint method has also been used to estimate the economic impact of CEA Tech (2017).
The “pôles de compétitivité” are the main instruments of the French cluster policy.
HPC has become a key technology for research, industry and services. It most generally refers to the practice of aggregating computing power in a way that delivers much higher performance than one could get out of a typical desktop computer or workstation in order to solve large problems in science, engineering or business.
References
Aghion, P. (2006). A primer on innovation and growth. Bruegel Policy Brief, issue 2006/06.
Alpe-Conchy, D. (2002). EISS Cadarache, IDEP Study, European ITER Site Studies.
Arrow, K. (1962). Economic welfare and the allocation of resources for invention. in R. Nelson (dir.), The Rate and Direction of Inventive Activity, Princeton, Princeton University Press, p. 609–626.
Austin, D. and Macauley, M. (1998). A quality-adjusted cost index for estimating future consumer surplus from innovation. Resources for the Future, Discussion Paper, 98-45, July.
Austin, D. and Macauley, M. (2000). Resources for the future, estimating future consumer benefits from ATP-funded innovation: The case of digital data storage. NIST GCR 00-790, Gaithersburg, MD: National Institute of Standards and Technology, April.
Autio, E., Hameri, A.-P., & Vuola, O. (2004). A framework of industrial knowledge spillovers in big-science centers. Research Policy, 33(1), 107–126. https://doi.org/10.1016/S0048-7333(03)00105-7.
Bach, L., & Wolff, S. (2017). The BETA-EvaRIO impact evaluation method: Towards a bridging approach? The Journal of Technology Transfer, First Online: 11 July 2017. https://doi.org/10.1007/s10961-017-9603-y.
Bach, L., Cohendet, P., Lambert, G., & Ledoux, M. J. (1992). Measuring and managing spinoffs: The case of the spinoffs generated by ESA programmes. In H. R. Hertzfeld & J. Greenberg (Eds.), Economics of space activity. Washington: AIAA.
Bach, L., Conde-Molist, N., Ledoux, M. J., Matt, M., & Schaeffer, V. (1995). Evaluation of the economic effects of BRITE EURAM programmes on the European industry. Scientometrics, 34(3), 325–349.
Bach, L., Cohendet, P., & Schenk, E. (2002). Technological transfers from the European space programs: A dynamic view and comparison with other R&D projects. The Journal of Technology Transfer, 27(4), 321–338. https://doi.org/10.1023/A:1020259522902.
Barge-Gil, A., & Modrego, A. (2011). The impact of research and technology organizations on firm competitiveness. Measurement and determinants. The Journal of Technology Transfer, 36(1), 61–83. https://doi.org/10.1007/s10961-009-9132-4.
Beagrie, C., & Houghton, J. W. (2012). Economic impact evaluation of the economic and social data service (ESDS). London: Economic and Social Research Council.
Ben Hassine, H., Mathieu, C. (2017). Evaluation de la politique des pôles de compétitivité: la fin d’une malédiction ? France Stratégie, Working Paper 2017–03.
Bianchi-Streit, M., Blackburne, N., Budde, R., Reitz, H., Sagnell, B., Schmied, H., Scorr, B. (1984). Economic utility resulting from CERN contracts (second study). CERN yellow Report, pp. 84-14, Geneva: CERN.
BIGGAR Economics. (2015). Economic contribution of the LERU universities. A Report to LERU (League of European Research Universities), 66p.
BIGGAR Economics. (2017). Economic contribution of the LERU universities. A Report to LERU (League of European Research Universities), 61p.
BIGGAR Economics. (2019). Economic impact of the University of Suffolk 2017/18. A report to University of Suffolk. Pentlands Science Park, Scotland.
Bilsen, V., Van Hoed, M. (2018). Economic footprint indicators for CEA. IDEA consult final report, February 2018, Prepared with the help of the CEA.
Bilsen, V., Debergh, P., De Voldere, I., Van Hoed, M. (2015). Economic footprint of 9 European RTOs in 2013-2014. IDEA Consult Final Report, December 2015 Prepared for EARTO – European Association of Research and Technology Organisations.
Bilsen, V., De Voldere, I., Van Hoed, M., Zeqo, K. (2018). Economic Footprint of 9 European RTOs in 2015-2016. IDEA Consult Final Report, March 2018 Prepared for EARTO – European Association of Research and Technology Organisations. http://www.earto.eu/fileadmin/content/03_Publications/2018/EARTO_Economic_Footprint_Study_-_Impact_of_9_RTOs_in_2015-2016_-_Final_Report.pdf.
Bloom, N., Charles, I. J., Van Reenen, J., & Webb, L. M. (2020). Are ideas getting harder to find? American Economic Review, 110(4), 1104–1144. https://doi.org/10.1257/aer.20180338.
Bornmann, L. (2013). What is societal impact of research and how can it be assessed? A literature survey. Journal of the American Society for Information Science and Technology, 64(2), 217–233.
Brécard, D., Fougeyrollas, A., Le Mouel, P., Lemiale, L., & Zagamé, P. (2006). Macro-economic consequences of European research policy: Prospects of the Nemesis model in the year 2030. Research Policy, 35, 910–924. https://doi.org/10.1016/j.respol.2006.03.001.
Bresnahan, T. (1986). Measuring the spillovers from technical advance: Mainframe computers in financial services. American Economic Review, American Economic Association, 76(4), 742–755.
CEA Tech. (2017). Etude d’impact économique de CEA Tech. CEA Report with EY Cabinet.
Conte, A. (2006). The evolution of the literature on technological change over time: A survey. Discussion Papers on Entrepreneurship, Growth and Public Policy, Max Planck Institute, 74 p.
Czarnitski, D., Hanel, P., & Rosa, J. M. (2011). Evaluating the impact of R&D tax credits on innovation: A microeconometric study on Canadian firms. Research Policy, 40(2), 217–229. https://doi.org/10.1016/j.respol.2010.09.017.
Donovan, C., Butler, L., Butt, A. J., Jones, T. H., & Hanney, S. R. (2014). Evaluation of the impact of National Breast Cancer Foundation-funded research. The Medical Journal of Australia, 200(4), 214–218. https://doi.org/10.5694/mja13.10798.
EARTO. (2019). Recommendations for European RD&I Policy Post-2020. EARTO, Impact Delivered Publication.
European Commission. (2017). The economic rationale for public R&I funding and its impact. Policy Brief Series. Research policy and organisation. Directorate-General for Research and Innovation. March 2017.
European Commission Communication. (2014). Research and innovation as sources of renewed growth, 339 final. Communication from the Commission to the European Parliament, the Council, the European Economic and Social Committee and the Committee and of the Regions, {SWD(2014) 181 final}.
Georghiou, L., & Roessner, J. (2000). Evaluating technology programs: Tools and methods. Research Policy, 29, 657–678. https://doi.org/10.1016/S0048-7333(99)00094-3.
Georghiou, L. et al. (2002). Assessing the socio-economic impacts of the framework programme. Manchester: PREST.
Hauknes, J., & Knell, M. (2009). Embodied knowledge and sectoral linkages: An input-output approach to the interaction of high- and low-tech industries. Research Policy, 38(3), 459–469.
Hertzfeld, H. (1985). Measuring the economic impact of federal research and development investments in civilian space activities. Paper presented to the National Academy of Sciences Workshop on “The Federal Role in Research and Development”, Nov. 21-22.
Hertzfeld, H. (1992). Measuring the returns to space research and development. In H. Hertzfeld & J. Greenberg (Eds.), Space Economics. Washington: American Institute of Astronautics.
INSEE Analyses (2014). Une inscription territoriale diffuse pour la centrale nucléaire de Fessenheim. with INSEE-Alsace and DREAL (Direction régionale de l’environnement, de l’aménagement et du logement), n°2, July.
Joly, P.-B., Gaunand, A., Colinet, L., Larédo, P., Lemarié, S., & Matt, M. (2015). ASIRPA: A comprehensive theory-based approach to assessing the societal impacts of a research organization. Research Evaluation, 24(4), 440–453. https://doi.org/10.1093/reseval/rvv015.
Knell, M. (2008). Product-embodied technological diffusion and intersectoral linkages in Europe. Prepared for the Innovation Watch Systematic Project, EuropeINNOVA.
Lafforgue, G., Berwald, A., & Popiolek, N. (2013). A note on the induced effects of carbon prices and R&D subsidies in carbon-free technologies. Energy Studies Review, 20, 71–89. https://doi.org/10.15173/esr.v20i2.549.
Lucas, R. E. (1988). On the mechanics of economic development. Journal of Monetary Economics, 22(1), 3–42.
Martin, J.-Ch., Binet, Th., Zaparucha, E. (2018). Impact économique, Evaluation des retombées socio-économiques des dépenses de GENCI de 2008 à 2016. Vertigo Lab, Darwin Ecosystème, in the rapport GENCI, étude d’impact de la très grande infrastructure de recherche GENCI, 2007–2017.
NASA. (2012). NASA’s spinoff 2012 report. National Aeronautics and Space Administration.
National Research Council. (2001). Energy research at DOE: Was it worth it? Energy efficiency and fossil energy research 1978 to 2000. Washington, DC: The National Academies Press. https://doi.org/10.17226/10165.
OECD. (2019). Reference framework for assessing the scientific and socio-economic impact of research infrastructures, OECD Science, Technology and Industry Policy Papers. N°65, Éditions OCDE, Paris. https://doi.org/10.1787/3ffee43b-en.
Office of Technology Assessment. (1986). Research funding as an investment: Can we measure the returns? A Technical Memorandum. Washington, DC: U.S. Congress, Office of Technology Assessment, OTA-TMSET-36. April.
Poliakov, E. V., and Hu, J. (2016). The economic footprint of the Dutch Research and Technology Organization TNO. TNO Report. TNO Working Paper Series, 2016–01.
Poliakov, E.V., Hu, J., Boonman, H.J., Heide, M.J.L. de (2019). A microeconomic assessment of RTO’s impact on firms output: The case of TNO. TNO Working Paper Series.
Prettner, K. and Werner, K. (2016). Why it pays off to pay us well: The impact of basic research on economic growth and welfare. Research Policy n°45(5) 1075–1090. https://doi.org/10.1016/j.respol.2016.03.001.
Reverdy Associés (2012). Analyse de l’impact de STMicroelectronics sur l’emploi et le pôle économique Grenoble-Isère. Chambre de Commerce et d’Industrie de Grenoble, Final Report final, May.
Romer, P. M. (1986). Increasing returns and long-run growth. Journal of Political Economy, 94(5), 1002–1037.
Romer, P. M. (1990). Endogenous technological change. Journal of Political Economy, 98(5, Part 2), s71–s102.
Ruegg, R., and Jordan, G. (2007). Overview of evaluation methods for R&D programs: A directory of evaluation methods relevant to technology development programs. US Department of Energy, Washington, DC: The National academies Press.
Simmonds, P., Kraemer-Mbula, E., Horvath, A., Stroyan, J., Zuijdam, F. (2013). Big science and innovation. Technopolis Report, 5th July.
Spaapen, J., & Van Drooge, L. (2011). Introducing ‘productive interactions’ in social impact assessment. Research Evaluation, 20(3), 211–218.
Syndex. (2012). CNPE de Fessenheim, Étude d’impact socioéconomique et conséquences d’une éventuelle fermeture. Final Report.
The Tauri Group. (2013). NASA socio-economic impact. Final report for NASA, April. https://www.nasa.gov/sites/default/files/files/SEINSI.pdf.
Trequattrini, R., Lombardi, R., Lardo, A., & Cuozzo, B. (2018). The impact of entrepreneurial universities on regional growth: A local intellectual capital perspective. Journal of the Knowledge Economy, 9(1), 199–211. https://doi.org/10.1007/s13132-015-0334-8.
Ulnicane, I. (2016). Research and innovation as sources of renewed growth? EU policy responses to the crisis. Journal of European Integration, 38(3), 327–341.
van Elk, R., ter Weel, B., van der Wiel, K., & Wouterse, B. (2019). Estimating the returns to public R&D investments: Evidence from production function models. De Economist, 167, 45–87. https://doi.org/10.1007/s10645-019-09331-3.
Van Roy, V., Nepelski, D. (2016). Assessment of framework conditions for the creation and growth of firms in Europe. Joint Research Centre, JRC Scientific and Policy Reports.
Veugelers, R. (2016). Getting the most from public R&D spending in times of budgetary austerity: Some insights from simpatico analysis. Bruegel Working Paper, January.
Waltman, L. (2016). A review of the literature on citation impact indicators. Journal of Informetrics, 10(2), 365–391. https://doi.org/10.1016/j.joi.2016.02.007.
Werner, B. M., & Souder, W. M. E. (1997). Measuring R&D performance - state of the art. Research-Technology Management, 40(2), 34–42. https://doi.org/10.1080/08956308.1997.11671115.
Acknowledgements
The author would like to warmly thank Muriel Attané, Secretary General of EARTO and her team, as well as Miriam Van Hoed, Expert at IDEA and her team, without whom this study and the discussions that followed could not have taken place. The author, however, remains responsible for the interpretations of the results of the footprint analysis model used. The author also wishes to thank all those at the CEA who devoted their precious time to provide the data needed for the footprint analysis.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Taverdet-Popiolek, N. Economic Footprint of a Large French Research and Technology Organisation in Europe: Deciphering a Simplified Model and Appraising the Results. J Knowl Econ 13, 44–69 (2022). https://doi.org/10.1007/s13132-020-00709-2
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s13132-020-00709-2
Keywords
- Economic impact of research
- Economic spin-offs of R&D
- Economic footprint
- Technology transfer
- Co-creation of knowledge
- Procurement of high technology
- Case study