Application of a checklist for quality assistance in environmental modelling to an energy model
Large, complex energy models present considerable challenges to develop and test. Uncertainty assessments of such models provide only partial guidance on the quality of the results. We have developed a model quality assistance checklist to aid in this purpose. The model checklist provides diagnostic output in the form of a set of pitfalls for the model application. The checklist is applied here to an energy model for the problem of assessing energy use and greenhouse gas emissions. Use of the checklist suggests that results on this issue are contingent on a number of assumptions that are highly value-laden. When these assumptions are held fixed, the model is deemed capable of producing moderately robust results of relevance to climate policy over the longer term. Checklist responses also indicate that a number of details critical to policy choices or outcomes on this issue are not captured in the model, and model results should therefore be supplemented with alternative analyses.
Keywordsquality assistance modelling climate energy
Unable to display preview. Download preview PDF.
- W. Keepin, Review of global energy and carbon dioxide projections, Ann. Rev. Energy 3(11) (1986) 357–392. Google Scholar
- S. Funtowicz and J. Ravetz, Uncertainty and Quality in Science for Policy (Kluwer, Dordrecht, 1990) 229 pp. Google Scholar
- J. van der Sluijs, Anchoring amid uncertainty. On the management of uncertainties in risk assessment of anthropogenic climate change, Universiteit Utrecht, Utrecht (1997) 260 pp. Google Scholar
- N. Oreskes, K. Shrader-Frechette and K. Belitz, Verification, validation, and confirmation of numerical models in the earth sciences, Science 263(3) (1994) 641–646. Google Scholar
- B. Beck, Model evaluation and performance, in: Encyclopedia of Environmetrics, Vol. 3 (John Wiley & Sons, New York, 2002) pp. 1275–1279. Google Scholar
- European Commission, White paper on governance. Report of the working group: Democratizing expertise and establishing scientific reference systems (Group 1b). Technical report, European Commission, Brussels (2001) 26 pp. Google Scholar
- C. Mann, Why software is so bad, Tech. Review 1(4) (2002) 33–38. Google Scholar
- J. van der Sluijs, J. Risbey and J. Ravetz, Uncertainty assessment of VOC emissions from paint in the Netherlands using the nusap system, Env. Mod. Ass. (2004) in press. Google Scholar
- J. Ravetz, Scientific Knowledge and Its Social Problems (Clarendon Press, Oxford, 1971), Reprint: Transaction, New Brunswick NJ (1996) 449 pp. Google Scholar
- N. Nakićenović, J. Alcamo, G. Davis, B. de Vries et al., Special report on emissions scenarios: A special report of the Intergovernmental Panel on Climate Change, Cambridge Univ. Press, Cambridge, UK (2000) 599 pp. Google Scholar
- B. De Vries, D. van Vuuren, M. den Elzen and M. Janssen, The TARGETS-IMAGE energy regional model (TIMER): Technical documentation. Technical report, National Institute for Public Health and the Environment, Bilthoven, NL (2002), Report 481508014. Google Scholar
- J. Alcamo, R. Leemans and E. Kreileman, eds., Global Change Scenarios for the 21st Century. Results from the IMAGE 2.1 Model (Elsevier Science, London, 1998) 572 pp. Google Scholar
- P. Kloprogge and J. van der Sluijs, Choice processes in modelling for policy support, in: Proceedings of the International Environmental Modelling and Software Society, Vol. 1, Lugano, June 2002, IEMSS, pp. 96–101. Google Scholar
- J. van der Sluijs, J. Risbey, S. Corral Quintana and J. Ravetz, Uncertainty management in complex models: the NUSAP method, in: Proceedings of the International Environmental Modelling and Software Society, Vol. 2, Lugano, June 2002, IEMSS, pp. 13–18. Google Scholar
- United Nations, United Nations Framework Convention on Climate Change. Text available at http://unfccc.int (1992).
- A. Petersen, P. Janssen, J. van der Sluijs, J. Risbey and J. Ravetz, RIVM/MNP guidance for uncertainty assessment and communication: Mini-checklist and quickscan questionnaire, Technical report, Netherlands Environmental Assessment Agency (2003) 15 pp. Google Scholar