Abstract
The principles of model evaluation in terms of quality assurance, model validation, and software evaluation were elaborated and discussed with the intention to develop a suitable evaluation protocol for chemical risk assessment models. Since scientific theories and the mathematical models embedded therein cannot be proved as true, a pragmatic meaning of validation is required, of which the primary purpose is to increase the level of confidence that is placed in the model. The accuracy of the model outcome is a necessary, but insufficient criterion for the quality assurance of models. A wider approach is required which examines the scientific inference that can be made about models relative to their intended purpose. By reviewing the literature on the validation problem, it was found that all the facets of validation can be assigned to generic (internal) and task-specific (external) properties of a model. Appropriate and detailed quality criteria for fate and exposure assessment software have been recently developed. They are based on common standards for software supplemented by specific requirements for this field of application. Altogether, quality assurance of a model includes internal and external validation and addresses evaluation of the respective software. It should focus not only on the predictive capability of a model, but also on the strength of the theoretical underpinnings, the evidence supporting the model conceptualization, the database, and the software.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Beck MB, Chen J (2000) Assuring the quality of models designed for predictive tasks. In: Saltelli A, Chan K, Scott M (eds) Mathematical and statistical methods for sensitivity analysis. Wiley, New York
Beck MB, Ravetz JR, Mulkey LA, Barnwell TO (1997) On the problem of model validation for predictive exposure assessments. Stoch Hydrol Hydraul 11: 229–254
Berding V (2000) Validation of a regional distribution model for environmental risk assessment of substances. Doctoral thesis. Department of Mathematics and Computer Science, University of Osnabrück
Berding V, Schwartz S, Trapp S, Matthies M (2000) Validierung von Umweltexpositions-modellen und in Modellen verwendeten Parametern. Umweltbundesamt Berichte Nr. 9/00, E. Schmidt, Berlin
Bredehoeft JD, Konikow LF (1993) Ground-water models: validate or invalidate. Ground Water 31:178–179
Caswell H (1976) The validation problem. In: Patten (ed) Systems analysis and simulation in ecology. Academic Press, New York, vol IV, pp 313 - 325
EC (1996) Technical guidance document in support of the Commission Directive 93/67/EEC on risk assessment for new notified substances and the Commission Regulation (EC) 1488/94 on risk assessment for existing substances, parts I-IV. Office for Official Publications of the European Communities, Luxembourg
Gayler S (1999) Bewertung computergestützter Umwelt-Simulationsmodelle. Doctoral thesis. Department of Mathematics and Computer Science, University of Osnabrück
Jager T (1995) Feasibility of validating the uniform system for the evaluation of substances (USES). RIVM Rep No 679102 026 Bilthoven
Knöll HD, Slotos T, Suk W (1996) Entwicklung und Qualitätssicherung von Anwendungs-software. Spektrum, Heidelberg
Knorr G (1997) Zertifizierung von Softwareprodukten nach DIN ISO/IEC 12119. Comput Recht 3: 180–182
Konikow LF, Bredehoeft JD (1992) Ground-water models cannot be validated. Adv Water Resour 15: 75–83
Leeuwen CJ, Hermens van JL (1995) Risk assessment of chemicals: an introduction. Kluwer Academic Publ, Dordrecht
Oreskes N, Shrader-Frechette K, Belitz K (1994) Verification, validation, and confirmation of numerical models in the earth sciences. Science 263: 641–646
Popper KR (1959) The logic of scientific discovery. Harper, New York
Popper KR (1963) Conjectures and refutations: the growth of scientific knowledge. Harper, New York
Ragas AMJ, Etienne RS, Willsemsen FH, Meent van de D (1999) Assessing model uncertainty for environmental decision making: a case study of the coherence of independently derived environmental quality objectives for air and water. Environ Toxicol Chem 18: 1856–1867
Robinson S (1999) Simulation, verification, validation, and confidence: a tutorial. Transactions 16: 63–69
Rykiel EJ Jr (1995) Testing ecological models: the meaning of validation. Ecol Model 90: 229–244
Sargent RG (1993) Validation of simulation models: general approach. In: Young (ed) Concise encyclopaedia of environmental systems. Pergamon Press, New York
Schwartz S (2000) Quality assurance of exposure models for environmental risk assessment of substances. Doctoral thesis. Department of Mathematics and Computer Science, University of Osnabrück
Schwartz S, Berding V, Trapp S, Matthies M (1998) Quality criteria for environmental risk assessment software - using the example of EUSES. Environ Sci Pollut Res 5: 217–222
Trapp S, Matthies M (1998) Chemodynamics and environmental modeling - an introduction. Springer, Berlin Heidelberg
Veerkamp W, Wolff C (1996) Fate and exposure models in relation to risk assessment - developments and validation criteria. Environ Sci Pollut Res 3: 91 -95
Wagner J, Matthies M (1996) Guidelines for selection and application of fate and exposure models. Environ Sci Pollut Res 3: 47–51
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2001 Springer-Verlag Berlin Heidelberg
About this chapter
Cite this chapter
Schwartz, S., Berding, V., Matthies, M. (2001). Evaluation Methodology for Fate and Exposure Models. In: Matthies, M., Malchow, H., Kriz, J. (eds) Integrative Systems Approaches to Natural and Social Dynamics. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-56585-4_23
Download citation
DOI: https://doi.org/10.1007/978-3-642-56585-4_23
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-62526-8
Online ISBN: 978-3-642-56585-4
eBook Packages: Springer Book Archive