Skip to main content

A Hill-Climbing Approach for Optimizing Classification Trees

  • Chapter
Book cover Learning from Data

Part of the book series: Lecture Notes in Statistics ((LNS,volume 112))

Abstract

We consider the problem of minimizing the expected cost of determining the correct value of a binary-valued function when it is costly to inspect the values of its arguments. This type of problem arises in distributed computing, in the design of diagnostic expert systems, in reliability analysis of multi-component systems, and in many other applications. Any feasible solution to the problem can be described by a sequential inspection procedure which is usually represented by a binary classification tree. In this paper, we propose an efficient hill-climbing algorithm to search for the optimal or near-optimal classification trees. Computational results show that the hill-climbing approach was able to find optimal solutions for 95% of the cases tested.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. R.E. Barlow and F. Proschan, Statistical theory of reliability and life testing, Holt, Rinehart and Winston, New York, 1975.

    MATH  Google Scholar 

  2. Y. Ben-Dov, Optimal testing procedures for special structures of coherent system, Management Science 27, No. 12 (1981), 1410–1420.

    Article  MATH  Google Scholar 

  3. M.F. Chang, W. Shi and W.K. Fuchs, Optimal diagnosis procedures for kout-of-n system, IEEE Trans. on Computers 39 (4) (1990) 559–564.

    Article  Google Scholar 

  4. L.A. Cox, Y. Qiu and W. Kuehner, Heuristic least-cost computation of discrete classification functions with uncertain argument values, Annals of Operations research, 21 (1989) 1–30.

    Article  MathSciNet  MATH  Google Scholar 

  5. C.L. Sheng, Threshold Logic, Academic Press, New York, 1969.

    Google Scholar 

  6. R.E. Tarjan, Depth-first search and linear graph algorithms, SIAM J. Computing 1 (1972) 146–160.

    Article  MathSciNet  MATH  Google Scholar 

  7. W. Van de Velde, Incremental induction of topologically minimal trees, Proc. of the Seventh International Conference on Machine Learning (1990) 66–74.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 1996 Springer-Verlag New York, Inc.

About this chapter

Cite this chapter

Sun, X., Chiu, S.Y., Cox, L.A. (1996). A Hill-Climbing Approach for Optimizing Classification Trees. In: Fisher, D., Lenz, HJ. (eds) Learning from Data. Lecture Notes in Statistics, vol 112. Springer, New York, NY. https://doi.org/10.1007/978-1-4612-2404-4_11

Download citation

  • DOI: https://doi.org/10.1007/978-1-4612-2404-4_11

  • Publisher Name: Springer, New York, NY

  • Print ISBN: 978-0-387-94736-5

  • Online ISBN: 978-1-4612-2404-4

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics