Abstract
The process of accrediting a model can roughly be divided into first gathering and evaluating results of conducted verification and validation (V& V) activities, and then aggregating these (raw) results into a total value: the accreditation decision. Especially the second part is not trivial, because results of V& V activities are quite manifold and at first sight not comparable with each other. Consider for example the evaluation of subject matter expert statements in contrast to real numbers as an outcome of statistical tests.
Classical decision analysis is one possibility to support the accreditation decision by using a structured, scientifically justified approach. For that purpose, mainly the concept of value tree analysis is used. In previous papers, the current state-of-the-art concerning decision analytic methodologies supporting VV&A was reviewed. Also a critical examination, describing gaps and deficiencies was conducted. A concept was drafted, how fuzzy value tree analysis, a branch of decision analysis incorporating fuzzy set theory, can be used to overcome some of these deficiencies, as there are: First, modeling subject matter experts statements, second, quantifying not only the value, but also the knowledge resp. ignorance about the model under study, and finally, being able to distinguish between compensational and non-compensational attributes in the value tree.
Fuzzy value tree analysis consists of the steps
-
establishing the value tree,
-
assigning values to attributes,
-
aggregating the attribute values, and
-
interpreting the result.
A raw draft of the concept, as well as a definition of attribute values in a fuzzy value tree analysis was dealt with in previous publications. The paper at hand takes these publications as a starting point and presents a concept how attribute values in a fuzzy value tree analysis can be aggregated, i. e. the aggregator is defined.
Starting from establishing requirements and constraints, these postulations are transformed into mathematical properties the aggregator must adhere to. After scanning the literature for possible fuzzy set theoretic operators, it is proven that the defined aggregator fulfills the mathematical properties established and therefore all requirements and constraints. The paper closes with illustrative examples.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Reference
Osman Balci, Michael L. Talbert, and Richard E. Nance. Application of the Analytic Hierarchy Process to Complex System Design Evalutation. Technical Report 24061-0106, Virginia Polytechnic Institute and State University, 1994.
Osman Balci, Robin J. Adams, David S. Myers, and Richard E. Nance. A Collaborative Evaluation Environment for Credibility Assessment of Modeling and Simulation Applications. In E. Yücesan, C.-H. Chen, J. L. Snowdon, and J. M. Charnes, editors, Proceedings of the 2002 Winter Simulation Conference, pages 214–220, 2002.
Robert O. Lewis. A Comprehensive VV&A Cost Estimating Tool. MORS SIMVAL, 1999.
Siegfried Pohl and Dirk Brade. Using Fuzzy Multi Attribute Decision Theory in the Accreditation of Models, Simulations, and Federation. Spring Simulation Interoperability Workshop, 05S-SIW-042, 2005.
Siegfried Pohl and Dirk Brade. Representing Results of V&V-Activities in Fuzzy Decision Analysis Value Trees. European Simulation Interoperability Workshop, 05E-SIW-012, 2005.
Paul Goodwin and George Wright. Decision Analysis for Management Judgement. John Wiley & Sons, 1991.
Helsinki University of Technology Systems Analysis Laboratory. Introduction to value tree analysis — http://www.mcda.hut.fi/valuetree/.
Osman Balci. Verification, Validation, and Certification of Modeling and Simulation Applications. In S. Chick, P. J. Sanchez, D. Ferrin, and D. J. Morrice, editors, Proceedings of the 2003 Winter Simulation Conference, pages 150–158, 2003.
Osman Balci. A Methodology for Certification of Modeling and Simulation Applications. ACM Transactions on Modeling and Computer Simulation, 11(4):352–377, Oktober 2001.
Hans-Jürgen Zimmermann and Lothar Gutsche. Multi-Criteria Anlyse. Springer Verlag, 1991.
Ralph L. Keeney and Howard Raiffa. Decisions with Multiple Objectives: Preferences and Value Tradeoffs. John Wiley & Sons, 1976.
Didier Dubois and Henry Prade, editors. Fundamentals of Fuzzy Sets. Kluwer Academic Publishers, 2000.
D. Dubois and H. Prade. Fuzzy Sets and Systems: Theory and Application. Academic Press, 1980.
Adolf Grauel. Fuzzy-Logik: Einf’uhrung in die Grundlagen mit Anwendungen. Bibliographisches Institut & F. A. Brockhaus AG, 1995.
Zadeh, L. A. The Concept of a Linguistic Variable and its Application to Approximate Reasoning. Technical Report Memorandum ERL-M 411, Berkeley, Oktober 1973.
Zimmermann, Hans-Jürgen. Fuzzy Set Theory and its Applications. Kluwer Academic Publishers, 1991.
Rüdiger von Nitzsch. Entscheidung bei Zielkonflikten: Ein PC-gestüztes Verfahren. Dissertation, T. H. Aachen, 1991.
Shu-Jen Chen and Ching-Lai Hwang. Fuzzy Multiple Attribute Decision Making. Springer Verlag, 1992.
Karl-Dieter Schwab. Ein auf dem Konzept der unscharfen Mengen basierendes Entscheidungsmodell bei mehrfacher Zielsetzung. Dissertation, T. H. Aachen, 1983.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer Science+Business Media, LLC
About this paper
Cite this paper
Pohl, S. (2006). Using Fuzzy Value Tree Analysis to Support The Verification, Validation, and Accreditation of Models and Simulations. In: Nejat Ince, A., Topuz, E. (eds) Modeling and Simulation Tools for Emerging Telecommunication Networks. Springer, Boston, MA . https://doi.org/10.1007/0-387-34167-6_20
Download citation
DOI: https://doi.org/10.1007/0-387-34167-6_20
Publisher Name: Springer, Boston, MA
Print ISBN: 978-0-387-32921-5
Online ISBN: 978-0-387-34167-5
eBook Packages: Computer ScienceComputer Science (R0)