Rough–Fuzzy Entropy in Neighbourhood Characterization

  • Antonio Maratea
  • Alessio FeroneEmail author
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11874)


The Entropy has been used to characterize the neighbourhood of a sample on the base of its k Nearest Neighbour when data are imbalanced and many measures of Entropy have been proposed in the literature to better cope with vagueness, exploiting fuzzy logic, rough set theory and their derivatives. In this paper, a rough extension of Entropy is proposed to measure uncertainty and ambiguity in the neighbourhood of a sample, using the lower and upper approximations from rough–fuzzy set theory in order to compute the Entropy of the set of the k Nearest Neighbours of a sample. The proposed measure shows better robustness to noise and allows a more flexible modeling of vagueness with respect to the Fuzzy Entropy.


Rough–fuzzy Entropy Fuzzy classification Imbalanced classification 


  1. 1.
    Batuwita, R., Palade, V.: FSVM-CIL: fuzzy support vector machines for class imbalance learning. IEEE Trans. Fuzzy Syst. 18(3), 558–571 (2010)CrossRefGoogle Scholar
  2. 2.
    Boonchuay, K., Sinapiromsaran, K., Lursinsap, C.: Decision tree induction based on minority entropy for the class imbalance problem. Pattern Anal. Appl. 20(3), 769–782 (2017)MathSciNetCrossRefGoogle Scholar
  3. 3.
    Buckley, J.J.: Fuzzy Probability and Statistics. Springer, Heidelberg (2006). Scholar
  4. 4.
    Chen, Y., Wu, K., Chen, X., Tang, C., Zhu, Q.: An entropy-based uncertainty measurement approach in neighborhood systems. Inf. Sci. 279, 239–250 (2014)MathSciNetCrossRefGoogle Scholar
  5. 5.
    Dubois, D., Prade, H.: Rough fuzzy sets and fuzzy rough sets*. Int. J. Gen Syst 17(2–3), 191–209 (1990)CrossRefGoogle Scholar
  6. 6.
    Fan, Q., Wang, Z., Li, D., Gao, D., Zha, H.: Entropy-based fuzzy support vector machine for imbalanced datasets. Knowl.-Based Syst. 115, 87–99 (2017)CrossRefGoogle Scholar
  7. 7.
    Ferone, A., Galletti, A., Maratea, A.: Variable width rough-fuzzy c-means. In: 2017 13th International Conference on Signal-Image Technology Internet-Based Systems (SITIS), pp. 458–464, December 2017Google Scholar
  8. 8.
    Ferone, A., Maratea, A.: Integrating rough set principles in the graded possibilistic clustering. Inf. Sci. 477, 148–160 (2019)MathSciNetCrossRefGoogle Scholar
  9. 9.
    Kaleli, C.: An entropy-based neighbor selection approach for collaborative filtering. Knowl.-Based Syst. 56, 273–280 (2014)CrossRefGoogle Scholar
  10. 10.
    Lin, C.F., Wang, S.D.: Fuzzy support vector machines. IEEE Trans. Neural Netw. 13(2), 464–471 (2002)CrossRefGoogle Scholar
  11. 11.
    Maratea, A., Ferone, A.: Fuzzy entropy in imbalanced fuzzy classification. In: Esposito, A., et al. (ed.): Proceedings of Wirn, 2019. Springer, Heidelberg (2019, in press)Google Scholar
  12. 12.
    Sen, D., Pal, S.K.: Generalized rough sets, entropy, and image ambiguity measures. IEEE Trans. Syst. Man Cybern. Part B (Cybern.) 39(1), 117–128 (2009)CrossRefGoogle Scholar
  13. 13.
    Song, G., Rochas, J., Huet, F., Magoulés, F.: Solutions for processing k nearest neighbor joins for massive data on mapreduce. In: 2015 23rd Euromicro International Conference on Parallel, Distributed, and Network-Based Processing, March 2015, pp. 279–287 (2015)Google Scholar
  14. 14.
    Wygralak, M.: Rough sets and fuzzy sets-some remarks on interrelations. Fuzzy Sets Syst. 29(2), 241–243 (1989)MathSciNetCrossRefGoogle Scholar
  15. 15.
    Ziarko, W.: Probabilistic rough sets. In: Ślezak, D., Wang, G., Szczuka, M., Düntsch, I., Yao, Y. (eds.) RSFDGrC 2005. LNCS, vol. 3641, pp. 283–293. Springer, Heidelberg (2005). Scholar

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  1. 1.Department of Science and TechnologiesUniversity of Naples “Parthenope”NaplesItaly

Personalised recommendations