Abstract
In this chapter, bounds on the average depth and the average weighted depth of decision trees are considered. Similar problems are studied in search theory [1], coding theory [77], design and analysis of algorithms (e.g., sorting) [38]. For any diagnostic problem, the minimum average depth of decision tree is bounded from below by the entropy of probability distribution (with a multiplier 1/log2 k for a problem over a k-valued information system). Among diagnostic problems, the problems with a complete set of attributes have the lowest minimum average depth of decision trees (e.g, the problem of building optimal prefix code [1] and a blood test study in assumption that exactly one patient is ill [23]). For such problems, the minimum average depth of decision tree exceeds the lower bound by at most one. The minimum average depth reaches the maximum on the problems in which each attribute is “indispensable” [44] (e.g., a diagnostic problem with n attributes and kn pairwise different rows in the decision table and the problem of implementing the modulo 2 summation function). These problems have the minimum average depth of decision tree equal to the number of attributes in the problem description.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this chapter
Cite this chapter
Chikalov, I. (2011). Bounds on Average Time Complexity of Decision Trees. In: Average Time Complexity of Decision Trees. Intelligent Systems Reference Library, vol 21. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-22661-8_2
Download citation
DOI: https://doi.org/10.1007/978-3-642-22661-8_2
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-22660-1
Online ISBN: 978-3-642-22661-8
eBook Packages: EngineeringEngineering (R0)