Skip to main content

Three-Way Weighted Entropies and Three-Way Attribute Reduction

  • Conference paper
Rough Sets and Knowledge Technology (RSKT 2014)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 8818))

Included in the following conference series:

Abstract

Rough set theory (RS-Theory) is a fundamental model of granular computing (GrC) for uncertainty information processing, and information entropy theory provides an effective approach for its uncertainty representation and attribute reduction. Thus, this paper hierarchically constructs three-way weighted entropies (i.e., the likelihood, prior, and posterior weighted entropies) by adopting a GrC strategy from the concept level to classification level, and it further explores three-way attribute reduction (i.e., the likelihood, prior, and posterior attribute reduction) by resorting to a novel approach of Bayesian inference. From two new perspectives of GrC and Bayesian inference, this study provides some new insights into the uncertainty measurement and attribute reduction of information theory-based RS-Theory.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Pawlak, Z.: Rough sets. International Journal of Information and Computer Science 11(5), 341–356 (1982)

    Article  MathSciNet  MATH  Google Scholar 

  2. Shannon, C.E.: The mathematical theory of communication. The Bell System Technical Journal 27(3–4), 373–423 (1948)

    MathSciNet  Google Scholar 

  3. Miao, D.Q.: Rough set theory and its application in machine learning (Ph. D. Thesis). Beijing, Institute of Automation, The Chinese Academy of Sciences (1997)

    Google Scholar 

  4. Beaubouef, T., Petry, F.E., Arora, G.: Information-theoretic measures of uncertainty for rough sets and rough relational databases. Information Sciences 109(1-4), 185–195 (1998)

    Article  Google Scholar 

  5. Slezak, D.: Approximate entropy reducts. Fundamenta Informaticae 53, 365–390 (2002)

    MathSciNet  Google Scholar 

  6. Miao, D.Q., Hu, G.R.: A heuristic algorithm for reduction of knowledge. Chinese Journal of Computer Research & Development 36, 681–684 (1999)

    Google Scholar 

  7. Miao, D.Q., Wang, J.: An information representation of the concepts and operations in rough set theory. Journal of Software 10(2), 113–116 (1999)

    Google Scholar 

  8. Liang, J.Y., Qian, Y.H., Chu, D.Y., Li, D.Y., Wang, J.H.: The algorithm on knowledge reduction in incomplete information systems. Fuzziness and Knowledge-Based Systems 10, 95–103 (2002)

    Article  MATH  Google Scholar 

  9. Liang, J., Shi, Z., Li, D., Wierman, M.: Information entropy, rough entropy and knowledge granularity in incomplete information systems. International Journal of General Systems 35(6), 641–654 (2006)

    Article  MathSciNet  MATH  Google Scholar 

  10. Wang, G.Y., Yu, H., Yang, D.C.: Decision table reduction based on conditional information entropy. Chinese Journal of Computers 25, 759–766 (2002)

    MathSciNet  Google Scholar 

  11. Wang, G.Y., Zhao, J., An, J.J., Wu, Y.: A comparative study of algebra viewpoint and information viewpoint in attribute reduction. Fundamenta Informaticae 68(3), 289–301 (2005)

    MathSciNet  MATH  Google Scholar 

  12. Bishop, C.M.: Pattern Recognition and Machine Learning. Springer (2006)

    Google Scholar 

  13. Zadeh, L.A.: Towards a theory of fuzzy information granulation and its centrality in human reasoning and fuzzy logic. Fuzzy Sets and Systems 90, 111–127 (1997)

    Article  MathSciNet  MATH  Google Scholar 

  14. Lin, T.Y.: Granular computing: from rough sets and neighborhood systems to information granulation and computing with words. In: European Congress on Intelligent Techniques and Soft Computing, pp. 1602–1606 (1997)

    Google Scholar 

  15. Yao, Y.: An outline of a theory of three-way decisions. In: Yao, J., Yang, Y., Słowiński, R., Greco, S., Li, H., Mitra, S., Polkowski, L. (eds.) RSCTC 2012. LNCS, vol. 7413, pp. 1–17. Springer, Heidelberg (2012)

    Chapter  Google Scholar 

  16. Yao, Y.Y.: Three-way decisions with probabilistic rough sets. Information Sciences 180, 341–353 (2010)

    Article  MathSciNet  Google Scholar 

  17. Miao, D.Q., Zhang, X.Y.: Change uncertainty of three-way regions in knowledge-granulation. In: Liu, D., Li, T.R., Miao, D.Q., Wang, G.Y., Liang, J.Y. (eds.) Three-Way Decisions and Granular Computing, pp. 116–144. Science Press, Beijing (2013)

    Google Scholar 

  18. Zhang, X.Y., Miao, D.Q.: Quantitative information architecture, granular computing and rough set models in the double-quantitative approximation space on precision and grade. Information Sciences 268, 147–168 (2014)

    Article  MathSciNet  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Xianyong Zhang .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2014 Springer International Publishing Switzerland

About this paper

Cite this paper

Zhang, X., Miao, D. (2014). Three-Way Weighted Entropies and Three-Way Attribute Reduction. In: Miao, D., Pedrycz, W., Ślȩzak, D., Peters, G., Hu, Q., Wang, R. (eds) Rough Sets and Knowledge Technology. RSKT 2014. Lecture Notes in Computer Science(), vol 8818. Springer, Cham. https://doi.org/10.1007/978-3-319-11740-9_65

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-11740-9_65

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-11739-3

  • Online ISBN: 978-3-319-11740-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics