Evaluation Methodology for Fate and Exposure Models

  • Stefan Schwartz
  • Volker Berding
  • Michael Matthies
Chapter

Abstract

The principles of model evaluation in terms of quality assurance, model validation, and software evaluation were elaborated and discussed with the intention to develop a suitable evaluation protocol for chemical risk assessment models. Since scientific theories and the mathematical models embedded therein cannot be proved as true, a pragmatic meaning of validation is required, of which the primary purpose is to increase the level of confidence that is placed in the model. The accuracy of the model outcome is a necessary, but insufficient criterion for the quality assurance of models. A wider approach is required which examines the scientific inference that can be made about models relative to their intended purpose. By reviewing the literature on the validation problem, it was found that all the facets of validation can be assigned to generic (internal) and task-specific (external) properties of a model. Appropriate and detailed quality criteria for fate and exposure assessment software have been recently developed. They are based on common standards for software supplemented by specific requirements for this field of application. Altogether, quality assurance of a model includes internal and external validation and addresses evaluation of the respective software. It should focus not only on the predictive capability of a model, but also on the strength of the theoretical underpinnings, the evidence supporting the model conceptualization, the database, and the software.

Keywords

Quality assurance Evaluation Validation Fate Exposure Models 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Beck MB, Chen J (2000) Assuring the quality of models designed for predictive tasks. In: Saltelli A, Chan K, Scott M (eds) Mathematical and statistical methods for sensitivity analysis. Wiley, New YorkGoogle Scholar
  2. Beck MB, Ravetz JR, Mulkey LA, Barnwell TO (1997) On the problem of model validation for predictive exposure assessments. Stoch Hydrol Hydraul 11: 229–254CrossRefGoogle Scholar
  3. Berding V (2000) Validation of a regional distribution model for environmental risk assessment of substances. Doctoral thesis. Department of Mathematics and Computer Science, University of OsnabrückGoogle Scholar
  4. Berding V, Schwartz S, Trapp S, Matthies M (2000) Validierung von Umweltexpositions-modellen und in Modellen verwendeten Parametern. Umweltbundesamt Berichte Nr. 9/00, E. Schmidt, BerlinGoogle Scholar
  5. Bredehoeft JD, Konikow LF (1993) Ground-water models: validate or invalidate. Ground Water 31:178–179CrossRefGoogle Scholar
  6. Caswell H (1976) The validation problem. In: Patten (ed) Systems analysis and simulation in ecology. Academic Press, New York, vol IV, pp 313 - 325Google Scholar
  7. EC (1996) Technical guidance document in support of the Commission Directive 93/67/EEC on risk assessment for new notified substances and the Commission Regulation (EC) 1488/94 on risk assessment for existing substances, parts I-IV. Office for Official Publications of the European Communities, LuxembourgGoogle Scholar
  8. Gayler S (1999) Bewertung computergestützter Umwelt-Simulationsmodelle. Doctoral thesis. Department of Mathematics and Computer Science, University of OsnabrückGoogle Scholar
  9. Jager T (1995) Feasibility of validating the uniform system for the evaluation of substances (USES). RIVM Rep No 679102 026 BilthovenGoogle Scholar
  10. Knöll HD, Slotos T, Suk W (1996) Entwicklung und Qualitätssicherung von Anwendungs-software. Spektrum, HeidelbergGoogle Scholar
  11. Knorr G (1997) Zertifizierung von Softwareprodukten nach DIN ISO/IEC 12119. Comput Recht 3: 180–182Google Scholar
  12. Konikow LF, Bredehoeft JD (1992) Ground-water models cannot be validated. Adv Water Resour 15: 75–83CrossRefGoogle Scholar
  13. Leeuwen CJ, Hermens van JL (1995) Risk assessment of chemicals: an introduction. Kluwer Academic Publ, DordrechtCrossRefGoogle Scholar
  14. Oreskes N, Shrader-Frechette K, Belitz K (1994) Verification, validation, and confirmation of numerical models in the earth sciences. Science 263: 641–646CrossRefGoogle Scholar
  15. Popper KR (1959) The logic of scientific discovery. Harper, New YorkGoogle Scholar
  16. Popper KR (1963) Conjectures and refutations: the growth of scientific knowledge. Harper, New YorkGoogle Scholar
  17. Ragas AMJ, Etienne RS, Willsemsen FH, Meent van de D (1999) Assessing model uncertainty for environmental decision making: a case study of the coherence of independently derived environmental quality objectives for air and water. Environ Toxicol Chem 18: 1856–1867CrossRefGoogle Scholar
  18. Robinson S (1999) Simulation, verification, validation, and confidence: a tutorial. Transactions 16: 63–69Google Scholar
  19. Rykiel EJ Jr (1995) Testing ecological models: the meaning of validation. Ecol Model 90: 229–244CrossRefGoogle Scholar
  20. Sargent RG (1993) Validation of simulation models: general approach. In: Young (ed) Concise encyclopaedia of environmental systems. Pergamon Press, New YorkGoogle Scholar
  21. Schwartz S (2000) Quality assurance of exposure models for environmental risk assessment of substances. Doctoral thesis. Department of Mathematics and Computer Science, University of OsnabrückGoogle Scholar
  22. Schwartz S, Berding V, Trapp S, Matthies M (1998) Quality criteria for environmental risk assessment software - using the example of EUSES. Environ Sci Pollut Res 5: 217–222CrossRefGoogle Scholar
  23. Trapp S, Matthies M (1998) Chemodynamics and environmental modeling - an introduction. Springer, Berlin HeidelbergCrossRefGoogle Scholar
  24. Veerkamp W, Wolff C (1996) Fate and exposure models in relation to risk assessment - developments and validation criteria. Environ Sci Pollut Res 3: 91 -95CrossRefGoogle Scholar
  25. Wagner J, Matthies M (1996) Guidelines for selection and application of fate and exposure models. Environ Sci Pollut Res 3: 47–51CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2001

Authors and Affiliations

  • Stefan Schwartz
  • Volker Berding
  • Michael Matthies

There are no affiliations available

Personalised recommendations