Abstract
The well known principle of curse of dimensionality links both dimensions of a dataset stating that as dimensionality increases samples become too sparse to effectively extract knowledge. Hence dimensionality reduction is essential when there are many features and not sufficient samples. We describe an algorithm for unsupervised dimensionality reduction that exploits a model of the hybridization of rough and fuzzy sets. Rough set theory and fuzzy logic are mathematical frameworks for granular computing forming a theoretical basis for the treatment of uncertainty in many real–world problems. The hybrid notion of rough fuzzy sets comes from the combination of these two models of uncertainty and helps to exploit, at the same time, properties like coarseness and vagueness. Experimental results demonstrated that the proposed approach can effectively reduce dataset dimensionality whilst retaining useful features when class labels are unknown or missing.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Bellman, R.: Adaptive Control Processes: A Guided Tour. Princeton University Press, Princeton (1961)
Das, S.K.: Feature selection with a linear dependence measure. IEEE Trans. Comput. 100(9), 1106–1109 (1971)
Dash, M., Liu, H.: Unsupervised Feature Selection. In: Proceedings of the Pacific and Asia Conference on Knowledge Discovery and Data Mining, pp. 110–121 (2000)
Dash, M., Liu, H.: Feature selection for classification. Intell. Data Anal. 1(3), 131–156 (1997)
Devijver, P., Kittler, J.: Pattern Recognition: A Statistical Approach. Prentice Hall, Upper Saddle River (1982)
Hall, M.A.: Correlation-based feature selection for discrete and numeric class machine learning. In: Proceedings of the 17th International Conference on Machine Learning, pp. 359–366 (2000)
Jensen, R., Shen, Q.: Interval-valued fuzzy-rough feature selection in datasets with missing values. In: IEEE International Conference on Fuzzy Systems, pp. 610–615 (2009)
Jensen, R., Shen, Q.: New approaches to fuzzy-rough feature selection. IEEE Trans. Fuzzy Syst. 17(4), 824–838 (2009)
Lin, T.Y., Cercone, N.: Rough sets and Data Mining: Analysis of Imprecise Data. Kluwer Academic Publishers, Berlin (1997)
Mitchell, T.: Machine Learning. McGraw-Hill, New York (1997)
Mitra, P., Murthy, C.A., Pal, S.K.: Unsupervised feature selection using feature similarity. IEEE Trans. Pattern Anal. Mach. Intell. 24(4), 1–13 (2002)
Pal, S.K., De, R.K., Basak, J.: Unsupervised feature evaluation: a neuro-fuzzy approach. IEEE Trans. Neural Netw. 11, 366–376 (2000)
Parthaláin, N.M., Shen, Q., Jensen, R.: A distance measure approach to exploring the rough set boundary region for attribute reduction. IEEE Trans. Knowl. Data Eng. 22(3), 305–317 (2010)
Parthaláin, N.M., Jensen, R.: Measures for unsupervised fuzzy-rough feature selection. Int. J. Hybrid Intell. Syst. 7(4), 249–259 (2010)
Pawlak, Z.: Rough sets. Int. J. Comput. Inform. Sci. 11, 341–356 (1982)
Pawlak, Z.: Granularity of knowledge, indiscernibility and rough sets. In: Proceedings of IEEE International Conference on Fuzzy Systems, pp. 106–110 (1998)
Pedrycz, W., Gomide, F.: Fuzzy Systems Engineering: Toward Human-Centric Computing. Wiley, Hoboken (2007)
Petrosino, A., Ferone, A.: Feature discovery through hierarchies of rough fuzzy sets. In: Chen, S.-M., Pedrycz, W. (eds.) Granular Computing and Intelligent Systems: Design with Information Granules of Higher Order and Higher Type, vol. 13, pp. 57–73. Springer, Heidelberg (2011)
Shen, Q., Chouchoulas, A.: A modular approach to generating fuzzy rules with reduced attributes for the monitoring of complex systems. Eng. Appl. Artif. Intell. 13(3), 263–278 (2002)
Thangavel, K., Pethalakshmi, A.: Performance analysis of accelerated Quickreduct algorithm. In: Proceedings of International Conference on Computational Intelligence and Multimedia Applications, pp. 318–322 (2007)
Tsang, E.C.C., Chen, D., Yeung, D.S., Wang, X.-Z., Lee, J.: Attributes reduction using fuzzy rough sets. IEEE Trans. Fuzzy Syst. 16(5), 1130–1141 (2008)
Velayutham, C., Thangavel, K.: Unsupervised quick reduct algorithm using rough set theory. J. Electron. Sci. Technol. 9(3), 193–201 (2011)
Witten, I.H., Frank, E.: Data Mining: Practical Machine Learning Tools with Java Implementations. Morgan Kaufmann, San Francisco (2000)
Zadeh, L.: Fuzzy sets. Inf. Control 8(3), 338–353 (1964)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2017 Springer International Publishing AG
About this paper
Cite this paper
Ferone, A., Petrosino, A. (2017). Feature Selection Through Composition of Rough–Fuzzy Sets. In: Petrosino, A., Loia, V., Pedrycz, W. (eds) Fuzzy Logic and Soft Computing Applications. WILF 2016. Lecture Notes in Computer Science(), vol 10147. Springer, Cham. https://doi.org/10.1007/978-3-319-52962-2_10
Download citation
DOI: https://doi.org/10.1007/978-3-319-52962-2_10
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-52961-5
Online ISBN: 978-3-319-52962-2
eBook Packages: Computer ScienceComputer Science (R0)