Hybrid Intelligent Systems Based on Fuzzy Logic and Deep Learning

  • Alexey AverkinEmail author
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11866)


The purpose of this lecture is to establish the fundamental links between two important areas of artificial intelligence - fuzzy logic and deep learning. This approach will allow researchers in the field of fuzzy logic to develop application systems in the field of strong artificial intelligence, which are also of interest to specialists in the field of machine learning. The lecture also examines how neuro-fuzzy networks make it possible to establish a link between symbolic and connectionist schools of artificial intelligence. A lot of methods of rule extraction from neural networks are also investigated.


Deep learning Neural networks Rule extraction Convolutional neural network Machine learning Artificial intelligence 


  1. 1.
    Craven, M., Shavlik, J.W.: Using sampling and queries to extract rules from trained neural networks. In: ICML, pp. 37–45 (1994)Google Scholar
  2. 2.
    Johansson, U., Lofstrom, T., Konig, R., Sonstrod, C., Niklasson, L.: Rule extraction from opaque models–a slightly different perspective. In: 5th International Conference on Machine Learning and Applications. ICMLA 2006, pp. 22–27 (2006)Google Scholar
  3. 3.
    Craven, M., Shavlik, J.: Rule extraction: where do we go from here. In: University of Wisconsin Machine Learning Research Group Working Paper, pp. 99–108 (1999)Google Scholar
  4. 4.
    Sethi, K.K., Mishra, D.K., Mishra, B.: KDRuleEx: a novel approach for enhancing user comprehensibility using rule extraction. In: 2012 Third International Conference Intelligent Systems, Modelling and Simulation (ISMS), pp. 55–60 (2012)Google Scholar
  5. 5.
    Andrews, R., Diederich, J., Tickle, A.B.: Survey and critique of techniques for extracting rules from trained artificial neural networks. Knowl.-Based Syst. 8(6), 373–389 (1995)CrossRefGoogle Scholar
  6. 6.
    Craven, M.W.: Extracting comprehensible models from trained neural networks. Ph.D. thesis, University of Wisconsin-Madison (1996)Google Scholar
  7. 7.
    Thrun, S.: Extracting provably correct rules from artificial neural networks. Technical report, University of Bonn, Institut für Informatik III (1993)Google Scholar
  8. 8.
    Fu, L.: Rule generation from neural networks. IEEE Trans. Syst. Man Cybern. 24(8), 1114–1124 (1994)CrossRefGoogle Scholar
  9. 9.
    Tsukimoto, H.: Extracting rules from trained neural networks. IEEE Trans. Neural Networks 11(2), 377–389 (2000)CrossRefGoogle Scholar
  10. 10.
    Sato, M., Tsukimoto, H.: Rule extraction from neural networks via decision tree induction. In: International Joint Conference on Neural Networks. Proceedings. IJCNN 2001, vol. 3, pp. 1870–1875 (2001)Google Scholar
  11. 11.
    Tickle, A.B., Andrews, R., Golea, M., Diederich, J.: The truth will come to light: directions and challenges in extracting the knowledge embedded within trained artificial neural networks. IEEE Trans. Neural Networks 9(6), 1057–1068 (1998)CrossRefGoogle Scholar
  12. 12.
  13. 13.
    Thrun, S.: Extracting rules from artificial neural networks with distributed representations. In: Advances in Neural Information Processing Systems, pp. 505–512 (1995)Google Scholar
  14. 14.
    Craven, M.W., Shavlik, J.W.: Extracting tree-structured representations of trained networks. In: Advances in Neural Information Processing Systems, pp. 24–30 (1996) Google Scholar
  15. 15.
    Taha, I.A., Ghosh, J.: Symbolic interpretation of artificial neural networks. IEEE Trans. Knowl. Data Eng. 11(3), 448–463 (1999)CrossRefGoogle Scholar
  16. 16.
    Towell, G.G., Shavlik, J.W.: Extracting refined rules from knowledge-based neural networks. Mach. Learn. 13(1), 71–101 (1993)Google Scholar
  17. 17.
    Setiono, R., Leow, W.K.: FERNN: an algorithm for fast extraction of rules from neural networks. Appl. Intell. 12(1–2), 15–25 (2000)CrossRefGoogle Scholar
  18. 18.
    Averkin, A., Yarushev, S.: Hybrid neural networks for time series forecasting. In: Kuznetsov, S.O., Osipov, G.S., Stefanuk, V.L. (eds.) RCAI 2018. CCIS, vol. 934, pp. 230–239. Springer, Cham (2018). Scholar
  19. 19.
    Pilato, G., Yarushev, S.A., Averkin, A.N.: Prediction and detection of user emotions based on neuro-fuzzy neural networks in social networks. In: Abraham, A., Kovalev, S., Tarassov, V., Snasel, V., Sukhanov, A. (eds.) IITI’18 2018. AISC, vol. 875, pp. 118–125. Springer, Cham (2019). Scholar
  20. 20.
    Averkin, G.P., Yarushev, S.A.: An approach for prediction of user emotions based on ANFIS in social networks. In: Second International Scientific and Practical Conference Fuzzy Technologies in the Industry, FTI 2018–CEUR Workshop Proceedings, pp. 126–134 (2018)Google Scholar
  21. 21.
    Zilke, J.R., Loza Mencía, E., Janssen, F.: DeepRED – rule extraction from deep neural networks. In: Calders, T., Ceci, M., Malerba, D. (eds.) DS 2016. LNCS (LNAI), vol. 9956, pp. 457–473. Springer, Cham (2016). Scholar
  22. 22.
    Fan, L.: Revisit fuzzy neural network: demystifying batch normalization and ReLU with generalized hamming network. In: NIPS 2017 (2017)Google Scholar
  23. 23.
    Fan, L.: Revisit Fuzzy Neural Network: Bridging the Gap between Fuzzy Ljgic and Deep Learning. Technical Report (2017)Google Scholar
  24. 24.
    Bonanno, D., Nock, K., Smith, L., Elmore, P., Petry, F.: An approach to explainable deep learning using fuzzy inference. In: Proceedings of the SPIE 10207, Next-Generation Analyst V, 102070D (2017)Google Scholar
  25. 25.
    Jang, S.R.: ANFIS: adaptive-network-based fuzzy inference systems. IEEE Trans. Syst. Man Cybernet. 23, 665–685 (1992)CrossRefGoogle Scholar
  26. 26.
    Bonanno, D., Nock, K., Smith, L., Elmore, P., Petry, F.: An approach to explainable deep learning using fuzzy inference. In: Hanratty, T.P., Llinas, J. (eds.) Next-Generation Analyst V. Proceedings of the SPIE, vol. 10207 (2017)Google Scholar
  27. 27.
    Goodfellow, I., et al.: Generative ad- versarial nets. In: Ghahramani, Z., Welling, M., Cortes, C., Lawrence,N. D., Weinberger, K.Q., éditeurs: Advances in Neural Information Processing Systems 27, pp. 2672–2680. Curran Associates, Inc. (2014)Google Scholar

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  1. 1.Federal Research Centre of Informatics and Computer Science of RAS, MoscowMoscowRussia

Personalised recommendations