Skip to main content
SpringerLink
Log in

A fuzzy logic-based system for the automation of human behavior recognition using machine vision in intelligent environments

  • Methodologies and Application
  • Published:
Soft Computing Aims and scope Submit manuscript

Abstract

The recent years have witnessed significant progress in the automation of human behavior recognition using machine vision in order to realize intelligent environments which are capable of detecting users’ actions and gestures so that the needed services can be provided automatically and instantly for maximizing the user comfort and safety as well as minimizing energy. However, the majority of traditional human behavior machine vision-based recognition approaches rely on assumptions (such as known spatial locations and temporal segmentations) or computationally expensive approaches (such as sliding window search through a spatio-temporal volume). Hence, it is difficult for such methods to scale up and handle the high uncertainty levels and complexities available in real-world applications. This paper proposes a novel fuzzy machine vision-based framework for efficient humans’ behavior recognition. A model-based feature set is utilized to extract visual feature cues including silhouette slices and movement speed from the human silhouette in video sequences which are analyzed as inputs by the proposed fuzzy system. We have employed fuzzy c-means clustering to learn the membership functions of the proposed fuzzy system. The behavior recognition was implemented via selecting the best candidate’s behavior category with the highest output degree as the recognized behavior. We have successfully tested our system on the publicly available Weizmann human action dataset where our fuzzy-based system produced an average recognition accuracy of 94.03 %, which outperformed the traditional non-fuzzy systems based on hidden Markov models and other state-of-the-art approaches which were applied on the Weizmann dataset.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4

Similar content being viewed by others

References

  • Acampora G, Foggia P, Saggese A, Vento M (2012) Combining neural networks and fuzzy systems for human behavior understanding. In: IEEE ninth international conference on advanced video and signal-based surveillance (AVSS), pp 88–93

  • Aggarwal JK, Ryoo MS (2011) Human activity analysis: a review. ACM Comput Surv (CSUR) 43:16

    Article  Google Scholar 

  • Ahad MAR, Tan J, Kim H, Ishikawa S (2011) Action dataset—a survey. In: SICE annual conference, SICE

  • Blank M, Gorelick L, Shechtman E, Irani M, Basri R (2005a) Actions as space-time shapes. In: International conference on computer vision, ICCV, pp 1395–1402

  • Blank M, Gorelick L, Shechtman E, Irani M, Basri R (2005b) Actions as space-time shapes. In: International conference on computer vision, ICCV

  • Chang J, Shyu J, Cho C (2009) Fuzzy rule inference based human activity recognition. In: Control applications, (CCA) & intelligent control, (ISIC), 2009 IEEE, pp 211–215

  • Chen X, He Z, Keller J, Anderson D, Skubic M (2006) Adaptive silhouette extraction in dynamic environments using fuzzy logic. In: Proceedings of the world congress in computational intelligence, WCCI

  • Doctor F, Hagras H, Callaghan V (2005) A fuzzy embedded agent-based approach for realizing ambient intelligence in intelligent inhabited environments. IEEE Trans Syst Man Cybern Part A 35(1):55–65

    Article  Google Scholar 

  • Dollar P, Rabaud V, Cottrell G, Belongie S (2005) Behavior recognition via sparse spatio-temporal features. In: IEEE international workshop on visual surveillance and performance evaluation of tracking and surveillance October, VS-PETS, pp 65–72

  • Efros AA, Berg AC, Mori G, Malik J (2003) Recognizing action at a distance. In: International conference on computer vision, ICCV, pp 726–733

  • Elgammal A, Shet V, Yacoob Y, Davis LS (2003) Learning dynamics for exemplar-based gesture recognition. In: IEEE conference on computer vision and pattern recognition, CVPR, pp 571–578

  • Fathi A, Mori G (2008) Action recognition by learning mid-level motion features. In: IEEE conference on computer vision and pattern recognition, CVPR, pp 1–8

  • Gokmen G, Akinci T, Tekta M, Onat N, Kocyigit G, Tekta N (2010) Evaluation of student performance in laboratory applications using fuzzy logic. Procedia-Social Behav Sci 2(2):902–909

    Article  Google Scholar 

  • Hagras H, Callaghan V, Cofley M, Clarke G (2003) A hierarchical fuzzy-genetic multi-agent architecture for intelligent buildings next term online learning, adaptation and control. Int J Inf Sci 150(1–2):33–57

    Google Scholar 

  • Ioannidou IA, Paraskevopoulos S, Tzionas P (2006) An interactive computer graphics interface for the introduction of fuzzy inference in environmental education. Interact Comput 18(4):683–708

    Article  Google Scholar 

  • Jhuang H, Serre T, Wolf L, Poggio T (2007) A biologically inspired system for action recognition. In: International conference on computer vision, ICCV, pp 1–8

  • Katz B, Lin J, Stauffer C, Grimson E (2003) Answering questions about moving objects in surveillance videos. In: AAAI spring symposium on new directions in question answer

  • Ke Y, Sukthankar R, Hebert M (2007) Event detection in crowded videos. In: International conference on computer vision, ICCV, pp 1–8

  • Laptev I, Marszalek M, Schmid C, Rozenfeld B (2008) Learning realistic human actions from movies. In: IEEE conference on computer vision and pattern recognition, CVPR, pp 1–8

  • Laptev I, Perez P (2007) Retrieving actions in movies. In: International conference on computer vision, ICCV, pp 1–8

  • Liu J, Shah M (2008) Learning human actions via information maximization. In: IEEE conference on computer vision and pattern recognition, CVPR, pp 1–8

  • Medjahed H, Istrate D, Boudy J, Dorizzi B (2009) Human activities of daily living recognition using fuzzy logic for elderly home monitoring. In: IEEE international conference on Fuzzy systems, 2009. FUZZ-IEEE 2009, IEEE. pp 2001–2006

  • Mendel J (2001) Uncertain rule-based fuzzy logic systems: introduction and new directions. Prentice-Hall, Upper Saddle River

    Google Scholar 

  • Niebles JC, Fei-Fei L (2007) A hierarchical model of shape and appearance for human action classification (2007) IEEE conference on computer vision and pattern recognition, pp 1–8

  • Nowozin S, Bakir G, Tsuda K (2007) Discriminative subsequence mining for action classification. In: International conference on computer vision, ICCV, pp 1–8

  • Pal NR, Bezdek JC (1995) On cluster validity for the fuzzy c-means model. IEEE Trans Fuzzy Syst 3:370–379

  • Schindler K, Gool LV (2008) Action snippets: how many frames does human action recognition require?. In: IEEE conference on computer vision and pattern recognition, CVPR, pp 1–8

  • Schuldt C, Laptev I, Caputo B (2004) Recognizing human actions: a local svm approach. In: International conference on pattern recognition, ICPR, pp 32–36

  • Scovanner P, Ali S, Shah M (2007) A 3-dimensional SIFT descriptor and its application to action recognition. In: International conference on multimedia MULTIMEDIA, pp 357–360

  • Thurau C, Hlavac V (2008) Pose primitive based human action recognition in videos or still images. In: IEEE conference on computer vision and pattern recognition, CVPR, pp 1–8

  • Vezzani R, Baltieri D, Cucchiara R (2010) HMM based action recognition with projection histogram features. In: ICPR contest on semantic description of human activities (SDHA), in proceedings of the ICPR contests

  • Wang Y, Mori G (2008) Learning a discriminative hidden part model for human action recognition. Neural Information Processing Systems Foundation, NIPS, pp 1721–1728

  • Wang Y, Sabzmeydani P, Mori G (2007) Semi-latent dirichlet allocation: a hierarchical model for human action recognition. In: International conference on computer vision, ICCV workshop on human motion, pp 240–254

  • Weinland D, Boyer E (2008) Action recognition using exemplar-based embed-ding. In: IEEE conference on computer vision and pattern recognition, CVPR, pp 1–7

  • Weinland D, Ronfard R, Boyer E (2010) A survey of vision-based methods for action representation, segmentation and recognition. INRIA, Report, vol. RR-7212, pp 54–111

  • Yamato J, Ohya J, Ishii K (1992) Recognizing human action in time-sequential images using hidden markov model. In: IEEE conference on computer vision and pattern recognition, CVPR, pp 379–385

  • Yao B, Hagras H, Ghazzawi DA, Alhaddad MJ (2012) An interval type-2 fuzzy logic system for human silhouette extraction in dynamic environments. In: International conference on autonomous and intelligent systems, AIS, pp 126–134

Download references

Author information

Authors and Affiliations

  1. The Intelligent Environments Group, School of Computer Science and Electronic Engineering, University of Essex, Colchester, UK

    Bo Yao & Hani Hagras

  2. King Abdulaziz University, Jidda, Saudi Arabia

    Mohammed J. Alhaddad & Daniyal Alghazzawi

Authors
  1. Bo Yao
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Hani Hagras
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Mohammed J. Alhaddad
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Daniyal Alghazzawi
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Bo Yao.

Additional information

Communicated by G. Acampora.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Yao, B., Hagras, H., Alhaddad, M.J. et al. A fuzzy logic-based system for the automation of human behavior recognition using machine vision in intelligent environments. Soft Comput 19, 499–506 (2015). https://doi.org/10.1007/s00500-014-1270-4

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00500-014-1270-4

Keywords

Search

Navigation