Abstract
In this study, a novel Takagi–Sugeno–Kang (TSK) fuzzy system termed as CLT–TSK in which the consequent of each fuzzy rule owns a common linear term is exploited to demonstrate its four distinctive merits. They are: (1) since much less parameters are involved, CLT–TSK has enhanced interpretability. (2) As an extensively used computational intelligence tool, a slightly changed function-link neural network (FLNN) is provably equivalent to CLT–TSK. As a result, FLNN is actually revisited with the first attempt from the philosophy of fuzzy models. (3) With a mild assumption that each component in Gaussian mixture model (GMM) equally contributes to the formulation of GMM in the sense of the effect of the intrinsic structure of training samples in each component on the corresponding label structure, CLT–TSK is theoretically proved to be equivalent to GMM, which actually helps us understand both CLT–TSK and FLNN from a new statistical perspective. (4) The output expression of CLT–TSK is exactly in accordance with the recently-drawn observation that a simple regression should be a basic yet very important component of final prediction models for various data modeling tasks. Owing to the equivalence among CLT–TSK, FLNN and GMM, their respective effective learning methods can be mutually employed from now on, and any new effort in training one model will actually provide a potential new learning method for another among these three models. In particular, with the help of our previous work about the least learning machine, we develop a fast-learning method for CLT–TSK in this study. Experimental results on different kinds of datasets demonstrate the promising classification and runtime performance of CLT–TSK.
Similar content being viewed by others
References
Sonbol AH, Fadali MS (2006) TSK fuzzy systems types II and III stability analysis: continuous case. IEEE Trans Syst Man Cybern Part B (Cybern) 36(1):2–12
Quah KH, Quek C (2006) FITSK: online local learning with generic fuzzy input Takagi–Sugeno–Kang fuzzy framework for nonlinear system estimation. IEEE Trans Syst Man Cybern Part B (Cybern) 36(1):166–178
Li J, Liu Z, Li C, Zheng Z (2020) Improved artificial immune system algorithm for type-2 fuzzy flexible job shop scheduling problem. IEEE Trans Fuzzy Syst. https://doi.org/10.1109/TFUZZ.2020.3016225
Zhang Z, Dong J (2021) A Novel H∞ control for T-S fuzzy systems with membership functions online optimization learning. IEEE Trans Fuzzy Syst. https://doi.org/10.1109/TFUZZ.2021.3053315
Wang J et al (2021) Manifold-regularized multitask fuzzy system modeling with low-rank and sparse structures in consequent parameters. IEEE Trans Fuzzy Syst. https://doi.org/10.1109/TFUZZ.2021.3062691
Mirzajani S, Aghababa MP, Heydari A (2019) Adaptive control of nonlinear fractional-order systems using T-S fuzzy method. Int J Mach Learn Cybern 10(3):527–540
Wang G, Lu J, Choi K, Zhang G (2020) A transfer-based additive LS-SVM classifier for handling missing data. IEEE Trans Cybern 50(2):739–752
Wang G, Zhang G, Choi K, Lu J (2019) Deep additive least squares support vector machines for classification with model transfer. IEEE Trans Syst Man Cybern Syst 49(7):1527–1540
Zuo H, Lu J, Zhang G, Liu F (2019) Fuzzy transfer learning using an infinite gaussian mixture model and active learning. IEEE Trans Fuzzy Syst 27(2):291–303
Pao YH, Takefuji Y (1992) Functional-link net computing: theory, system architecture, and functionalities. Computer 25:76–79
Everitt BS, Hand DJ (1981) Finite mixture distributions. Chapman and Hall, London
Park J, Sandberg IW (1991) Universal approximation using radial-basis function networks. Neural Comput 3(2):246–257
Zhang J, Cabric D, Wang F, Zhong Z (2017) Cooperative modulation classification for multipath fading channels via expectation-maximization. IEEE Trans Wirel Commun 16(10):6698–6711
LichtenbergJM, Şimşek Ö (2017) Simple regression model. In: Proceedings of the NIPS 2016 workshop on imperfect decision makers, PMLR 58, pp 13–25
Xu P et al (2019) Concise fuzzy system modeling integrating soft subspace clustering and sparse learning. IEEE Trans Fuzzy Syst 27(11):2176–2189
Zhou T, Chung F, Wang S (2017) Deep TSK fuzzy classifier with stacked generalization and triplely concise interpretability guarantee for large data. IEEE Trans Fuzzy Syst 25(5):1207–1221
Qin B, Nojima Y, Ishibuchi H, Wang S (2020) Realizing deep high-order TSK fuzzy classifier by ensembling interpretable zero-order TSK fuzzy subclassifiers. IEEE Trans Fuzzy Syst. https://doi.org/10.1109/TFUZZ.2020.3022574
Zhang Y, Ishibuchi H, Wang S (2018) Deep Takagi–Sugeno–Kang fuzzy classifier with shared linguistic fuzzy rules. IEEE Trans Fuzzy Syst 26(3):1535–1549
Zhang Y, Chung FL, Wang S (2019) Takagi-sugeno-kang fuzzy systems with dynamic rule weights. J Intell Fuzzy Syst 37(6):8535–8550
Kilic K, Uncu O, Turksen IB (2007) Comparison of different strategies of utilizing fuzzy clustering in structure identification. Inf Sci 177:5153–5162
Yang MS, Nataliani Y (2018) A feature-reduction fuzzy clustering algorithm based on feature-weighted entropy. IEEE Trans Fuzzy Syst 26(2):817–835
Wang J, Liu H, Qian X, Jiang Y, Deng Z, Wang S (2018) Cascaded hidden space feature mapping, fuzzy clustering, and nonlinear switching regression on large datasets. IEEE Trans Fuzzy Syst 26(2):640–655
Jang J-SR (1993) ANFIS: adaptive-network-based fuzzy inference systems. IEEE Trans Syst Man Cybern 23(3):665–685
Leski J (2005) TSK-fuzzy modeling based on -insensitive learning. IEEE Trans Fuzzy Syst 13(2):181–193
Gu X, Chung F, Wang S (2017) Bayesian Takagi–Sugeno–Kang fuzzy classifier. IEEE Trans Fuzzy Syst 25(6):1655–1671
Husmeier D (2000) The Bayesian evidence scheme for regularizing probability-density estimating neural networks. Neural Comput 12(11):2685–2717
Zhang L, Li HL, Qiao ZJ, Xu ZW (2014) A fast bp algorithm with wavenumber spectrum fusion for high-resolution spotlight SAR imaging. IEEE Geosci Remote Sens Lett 11(9):1460–1464
Yang S-S, Ho C-L, Lee C-M (2006) HBP: improvement in BP algorithm for an adaptive MLP decision feedback equalizer. IEEE Trans Circuits Syst II Express Briefs 53(3):240–244
Chen J, Fossorier MPC (2002) Density evolution for two improved BP-Based decoding algorithms of LDPC codes. IEEE Commun Lett 6(5):208–210
Dehuri S, Cho S-B (2010) A comprehensive survey on functional link neural networks and an adaptive PSO–BP learning for CFLNN. Neural Comput Appl 19:187–205
Hassim YMM, Ghazali R (2012) Training a functional link neural network using an artificial bee colony for solving a classification problems. Zool Res 33(3):298–303
Abu-Mahfouz I-A (2005) A comparative study of three artificial neural networks for the detection and classification of gear faults. Int J Gen Syst 34:261–277
Haring S, Kok J (1995) Finding functional links for neural networks by evolutionary computation. In: Van de Merckt T et al (eds) BENELEARN1995, proceedings of the fifth Belgian–Dutch conference on machine learning, Brussels
Jiang Y, Deng Z, Chung F, Wang S (2017) Realizing two-view TSK fuzzy classification system by using collaborative learning. IEEE Trans Syst Man Cybern Syst 47(1):145–160
Deng Z, Cao L, Jiang Y, Wang S (2015) Minimax probability TSK fuzzy system classifier: a more transparent and highly interpretable classification model. IEEE Trans Fuzzy Syst 23(4):813–826
Kreyzig E (1993) Advanced engineering mathematics, 7th edn. Wiley, Singapore
Mardia KV, Kent JT, Bibby JM (1979) Multivariate analysis. Academic, New York
Zeng J, Yin W (2018) On nonconvex decentralized gradient descent. IEEE Trans Signal Process 66(11):2834–2848
Wang S, Chung F, Wu J, Wang J (2014) Least learning machine and its experimental studies on regression capability. Appl Soft Comput 21:677–684
Wang S, Jiang Y, Chung F, Qian P (2015) Feedforward kernel neural networks, generalized least learning machine, and its deep learning with application to image classification. Appl Soft Comput 37:125–141
Ishibuchi H, Yamamoto T, Nakashima T (2005) Hybridization of fuzzy GBML approaches for pattern classification problems. IEEE Trans Syst Man Cybern B Cybern 35(2):359–365
Ishibuchi H, Mihara S, Nojima Y (2013) Parallel distributed hybrid fuzzy GBML models with rule set migration and training data rotation. IEEE Trans Fuzzy Syst 21(2):355–368
del Jesus M, Hoffmann F, Navascues L, Sanchez L (2004) Induction of fuzzy-rule-based classifiers with evolutionary boosting algorithms. IEEE Trans Fuzzy Syst 12(3):296–308
ChangC-C, Lin C-J (2005) LIBSVM: a library for support vector machines. [Online]. http://www.csie.ntu.edu.tw/∼cjlin/libsvm
Asheri H, Hosseini R, Araabi BN (2021) A new EM algorithm for flexibly tied GMMs with large number of components. Pattern Recognit 114:107836
Alcal-Fdez J, Fernndez A, Luengo J, Derrac J, Garca S, Snchez L, Herrera F (2011) KEEL data-mining software tool: data set repository integration of algorithms and experimental analysis framework. J Mult Valued Logic Soft Comput 17(2):255–287
Gu X, Wang F, Wang S (2017) Bayesian Takagi–Sugeno–Kang fuzzy classifier. IEEE Trans Fuzzy Syst 25(6):1655–1671
Demar J (2006) Statistical comparisons of classifiers over multiple data sets. J Mach Learn Res 7:1–30
Hodges JL, Lehmann EL (1962) Ranks methods for combination of independent experiments in analysis of variance. Ann Math Statist 33:482–497
Holm S (1979) A simple sequentially rejective multiple test procedure. Scand J Stat 6(2):65–70
BacheK, Lichman M (2015) UCI machine learning repository [Online]. http://archive.ics.uci.edu/ml
Acknowledgements
This work was supported in part by the National Natural Science Foundation of China under Grant 82072019, 61772198, and 61972181, by the Natural Science Foundation of Jiangsu Province under Grant BK20201441 and BK20191331, by Jiangsu Post-doctoral Research Funding Program under Grants with No. 2020Z020, and the Key Projects of the National Natural Science Foundation of China under Grant U20A20228.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Zhang, Y., Wang, G., Chung, Fl. et al. A fuzzy system with common linear-term consequents equivalent to FLNN and GMM. Int. J. Mach. Learn. & Cyber. 13, 1475–1492 (2022). https://doi.org/10.1007/s13042-021-01460-z
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s13042-021-01460-z