Evolving Systems

, Volume 7, Issue 4, pp 277–285 | Cite as

Adaptive cow movement detection using evolving spiking neural network models

  • Tao Gao
  • Nikola Kasabov
Original Paper


For the need of automatic and intelligent dairy cow farming, it is important to combine more information technologies with the surveillance system. Different gestures may provide different healthy status information of the cow, in order to timely detect the abnormal activity and reduce the workload of breeder, a system which imitates the cognition of human brain is proposed in this paper. First, AdaBoost method is used to detect the position of cow in the surveillance video sequence, and then the 3D Evolving Spiking Neural Network Model is training to recognize different gestures and classify the activity in the real-time video surveillance. Experiment shows the average accuracy of detection and classification of the proposed system is about 80 %, and the performance is robust in complex natural environment. The proposed method can be used as the base of whole alert system which can help breeders to discover abnormal activity and to prevent the diseases in advance, so as to improve the welfare of dairy cow and the quality of milk.


Diary cow farming Cow detection Gesture classification AdaBoost NeuCube Evolving Spiking Neural Network Video surveillance 



This work is supported by National Natural Science Foundation of China (Nos. 71102174, 51306058), the Fundamental Research Funds for the Central Universities (No. 2014QN46), the Hebei Science and Technology Support Project (No. 15212204D), the Tianjin Science and Technology Support Project (No. 15ZCZDNC00130), and State Scholarship Fund for Visiting Scholar by the China Scholarship Council (No. 201406735004).


  1. Binh NT, Nigam S, Khare A (2014) Towards classification based human activity recognition in video sequences. In: Proceedings of international conference on context aware systems and applications, pp 209–218Google Scholar
  2. Blank M, Gorelick L, Shechtman E, Irani M, Basri R (2005) Actions as space-time shapes. In: Tenth IEEE international conference on computer vision (ICCV 2005), vol 2, pp 1395–1402Google Scholar
  3. Buonomano D, Maass W (2009) State-dependent computations: spatio-temporal processing in cortical networks. Nat Rev Neurosci 10:113–125CrossRefGoogle Scholar
  4. Capecci E, Kasabov N, Wang GY (2015) Analysis of connectivity in NeuCube spiking neural network models trained on EEG data for the understanding of functional changes in the brain: a case study on opiate dependence treatment. Neural Netw 68:62–77CrossRefGoogle Scholar
  5. Chen Y, Hu J, Kasabov N, Hou Z, Cheng L (2013) NeuCubeRehab: a pilot study for EEG classification in rehabilitation practice based on spiking neural networks. In: Neural Information Processing, Lecture Notes in Computer Science, vol 8228, pp 70–77Google Scholar
  6. Cheng Z, Qin L, Huang Q, Yan S, Tian Q (2014) Recognizing human group action by layered model with multiple cues. Neurocomputing 136:124–135CrossRefGoogle Scholar
  7. Collobert R, Bengio S (2001) SVMTorch: support vector machines for large-scale regression problems. J Mach Learn Res 1:143–160MathSciNetzbMATHGoogle Scholar
  8. Fiasché M, Schliebs S, Nobili L (2012) Integrating neural networks and chaotic measurements for modelling epileptic brain. In: Artificial Neural Networks and Machine Learning (ICANN 2012), Lecture Notes in Computer Science, vol 7552, pp 653–660Google Scholar
  9. Haley DB, de Passillé AM, Rushen J (2001) Assessing cow comfort: effects of two floor types and two tie stall designs on the behavior of lactating dairy cows. Appl Anim Behav Sci 71(2):105–117CrossRefGoogle Scholar
  10. Hu MK (1962) Visual pattern recognition by moment invariants. IRE Trans Inf Theory 8(2):179–187CrossRefzbMATHGoogle Scholar
  11. Ikizler-Cinbis N, Sclaroff S (2010) Object, scene and actions: combining multiple features for human action recognition. In: European Conference on Computer Vision (ECCV’10) Springer, Berlin, pp 494–507Google Scholar
  12. Junejo IN, Dexter E, Laptev I, Perez P (2011) View-independent action recognition from temporal self-similarities. IEEE Trans Pattern Anal Mach Intell 33(1):172–185CrossRefGoogle Scholar
  13. Kasabov N (2012) NeuCube EvoSpike architecture for spatio-temporal modelling and pattern recognition of brain signals. In: ANNPR 2012, LNAI 7477, pp 225–243Google Scholar
  14. Kasabov N (2014) NeuCube: a spiking neural network architecture for mapping, learning and understanding of spatio-temporal brain data. Neural Netw 52:62–76CrossRefGoogle Scholar
  15. Kasabov N, Capecci E (2015) Spiking neural network methodology for modelling, classification and understanding of EEG spatio-temporal data measuring cognitive processes. Inf Sci 294:565–575MathSciNetCrossRefGoogle Scholar
  16. Kasabov N, Scott N, Tu E, Othman M, Doborjeh M, Marks S, Sengupta N, Murli N, Hartono R, Espinosa-Ramos I, Capecci E, Zhou L, Alvi F, Wang G, Taylor D, Feigin V, Gulyaev S, Mahmoud M, Hou Z-G, Yang J (2015) Evolving spatio-temporal data machines based on the NeuCube neuromorphic framework: design methodology and selected applications. Neural Networks Journal, Special Issue on Neural Network Learning in Big Data, ElsevierGoogle Scholar
  17. Kwong KH, Tsung TW, Goh HG et al (2009) Wireless sensor networks in agriculture: cattle monitoring for farming industries. In: Progress in electromagnetics research symposium, Beijing, pp. 1719–1723Google Scholar
  18. Ling Y, Caixing L, Tiansheng H, Haoen Z, Kwong KH (2010) Design of system for monitoring dairy cattle’s behavioral features based on wireless sensor networks. Trans CSAE 26(3):203–208Google Scholar
  19. Liu J, Shah M, Kuipers B, Savarese S (2011) Cross-view action recognition via view knowledge transfer. In: 2011 IEEE conference on computer vision and pattern recognition (CVPR), pp 3209–3216Google Scholar
  20. Liu Y, Jia LK, Yu WY (2014) Capturing human motion based on modified hidden markov model in multi-view image sequences. J Multimedia 9(1):92–98Google Scholar
  21. Martiskainen P, Jarvinen M, Skon J et al (2009) Cow behavior pattern recognition using a three-dimensional accelerometer and support vector machines. Appl Anim Behav Sci 119(1):32–38CrossRefGoogle Scholar
  22. Murli N, Kasabov N, Handaga B (2014) Classification of fMRI data in the NeuCube evolving spiking neural network architecture. Proc Int Conf Neural Inf Process 1:421–428Google Scholar
  23. Nadimi ES, Sogaard HT, Bak T (2008) ZigBee-based wireless sensor networks for classifying the behaviour of a herd of animals using classification trees. Biosyst Eng 100(2):167–176CrossRefGoogle Scholar
  24. Nigam S, Deb K, Khare A (2013) Moment invariants based object recognition for different pose and appearances in real scenes. In: Proceedings of IEEE international conference on informatics, electronics and vision, pp 1–5Google Scholar
  25. Qian H, Mao Y, Xiang W, Wang Z (2010) Recognition of human activities using SVM multi-class classifier. Pattern Recognit Lett 31(2):100–111CrossRefGoogle Scholar
  26. Rebecca NH, Dave LS, Greg JB-H (2009) Monitoring animal behaviour and environmental interactions using wireless sensor networks, GPS Collars and Satellite Remote Sensing. Sensors 9(5):3586–3603CrossRefGoogle Scholar
  27. Robert B, White BJ, Renter DG (2009) Evaluation of three-dimensional accelerometers to monitor and classify behavior patterns in cattle. Comput Electron Agric 67(1):80–84CrossRefGoogle Scholar
  28. Russell BC, Torralba A, Murphy KP, Freeman WT (2008) LabelMe: a database and web-based tool for image annotation. Int J Comput Vis 7(1–3):157–173CrossRefGoogle Scholar
  29. Schliebs S, Fiasché M, Kasabov N (2012) Constructing robust liquid state machines to process highly variable data streams. In: Artificial Neural Networks and Machine Learning (ICANN 2012), Lecture Notes in Computer Science, vol 7552, pp 604–611Google Scholar
  30. Schuldt C, Laptev I, Caputo B (2004) Recognizing human actions: a local SVM approach. In: Proceedings of the 17th international conference on pattern recognition (ICPR’04), vol 3, pp 32–36Google Scholar
  31. Torralba A, Murphy KP, Freeman WT (2004) Sharing features: efficient boosting procedures for multiclass object detection. Proc IEEE Comput Soc Conf Comput Vis Pattern Recognit 2:762–769Google Scholar
  32. Wang Y, Huang K, Tan T (2007) Human activity recognition based on R transform. In: IEEE conference on computer vision and pattern recognition (CVPR’07), pp 1–8Google Scholar
  33. Wark T, Swain D, Crossman C et al (2009) Sensor and actuator networks: protecting environmentally sensitive areas. IEEE Pervasive Comput 8(1):30–36CrossRefGoogle Scholar
  34. Watanabe N, Sakanoue S, Kawamura K et al (2008) Development of an automatic classification system for eating, ruminating and resting behavior of cattle using an accelerometer. Grassl Sci 54(4):231–237CrossRefGoogle Scholar
  35. Weinland D, Ronfard R, Boyer E (2006) Free viewpoint action recognition using motion history volumes. Comput Vis Image Underst 104(2):249–257CrossRefGoogle Scholar
  36. Zhao Y, Belkasim S (2012) Multiresolution Fourier descriptors for multiresolution shape analysis. IEEE Signal Process Lett 19(10):692–695CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2016

Authors and Affiliations

  1. 1.Department of AutomationNorth China Electric Power UniversityBaodingChina
  2. 2.Knowledge Engineering and Discovery Research InstituteAuckland University of TechnologyAucklandNew Zealand

Personalised recommendations