Design and implementing wireless multimedia sensor network for movement detection using FPGA local co-processing

  • Hamzeh Varshovi
  • Yousef Seifi KavianEmail author
  • Karim Ansari-Asl


In recent years, many researches have been conducted on designing wireless multimedia sensor networks. But, implementing these networks faces several challenges. One of these challenges is the bulky nature of the multimedia data which needs powerful radios with high data rates for transmission and requires much more energy. So, in some applications it is more efficient to process the data locally and send the results to the base station which allows WMSNs to be implemented using simple and cheap network nodes. In this paper a wireless multimedia sensor network has been designed which processes the images locally using small FPGA processors in order to detect possible motions and the time and location of the detected movements will be sent to the base station. The network is implemented to perform two motion detection algorithms separately using Spartan 6 FPGAs and the local results of motion detection and global result of the network are presented.


Wireless multimedia sensor networks Image processing FPGA Local processing 



This work was supported in part by Shahid Chamran University of Ahvaz under Grant Number 96/3/02/16670.


  1. 1.
    Amaricai A, Gavriliu CE, Boncalo O (2014) An FPGA sliding window-based architecture harris corner detector. In: 24th international conference on field programmable logic and applications (FPL). Munich, Germany, p 1–4Google Scholar
  2. 2.
    Aziz SM, Pham DM (2013) Energy efficient image transmittion in wireless multimedia sensor networks. IEEE Commun Lett 17(6):1084–1087CrossRefGoogle Scholar
  3. 3.
    Barnich O, Van Droogenbroeck M (2011) ViBe: a universal background subtraction algorithm for video sequences. IEEE Trans Image Process 20(6):1709–1724MathSciNetCrossRefGoogle Scholar
  4. 4.
    Chaple G, Daruwala R (2014) Design of Sobel operator based image edge detection algorithm on FPGA. In: International conference on communication and signal processing (ICCSP). Melmaruvathur, p 788–792Google Scholar
  5. 5.
    Chen J, Zhang L, Kuo Y (2013) Coverage-enhancing algorithm based on overlap-sense ratio in wireless multimedia sensor networks. IEEE Sensors J 13(6):2077–2083CrossRefGoogle Scholar
  6. 6.
    Chen HC, Wong CC, Feng HM (2017) Wireless image fuzzy recognition system for human activity. Multimed Tools Appl 76(23):25231–25251CrossRefGoogle Scholar
  7. 7.
    Chowdary MK, Babu SS, Babu SS, Khan H (2013) FPGA implementation of moving object detection in frames by using background subtraction algorithm. In: International conference on communications and signal processing (ICCSP). Melmaruvathur, India, p 1032–1036Google Scholar
  8. 8.
    Dash P, Pujari S, Nayak S (2014) Implementation of edge detection using FPGA & model based approach. In: International conference on information communication and embedded systems. Chennai, India, p 1–6Google Scholar
  9. 9.
    Demir AK, Demiray HE, Baydere S (2014) Cross-layer QoS architecture for wireless multimedia sensor networks. Wirel Netw 20(4):655–670CrossRefGoogle Scholar
  10. 10.
    Ghadi M, Laouamer L, Moulahi T (2016) Securing data exchange in wireless multimedia sensor networks: perspectives and challenges. Multimed Tools Appl 75(6):3425–3451CrossRefGoogle Scholar
  11. 11.
    Gujrathi P, Priya RA, Malathi P (2014) Detecting moving object using background subtraction algorithm in FPGA. In: Fourth international conference on advances in computing and communications (ICACC). Cochin, India, p 117–120Google Scholar
  12. 12.
    Guo G, Kaye ME, Zhang Y (2015) Enhancement of Gaussian background modelling algorithm for moving object detection & its implementation on FPGA. In: 28th Canadian conference on electrical and computer engineering (CCECE). Halifax, NS, Canada, p 118–122Google Scholar
  13. 13.
    Hamid Z, Hussain FB (2014) QoS in wireless multimedia sensor networks: a layered and cross-layered approach. Wirel Pers Commun 75(1):729–757CrossRefGoogle Scholar
  14. 14.
    Hasan KK, Ngah UK, Salleh MFM (2014) Efficient hardware-based image compression schemes for wireless sensor networks: a survey. Wirel Pers Commun 77(2):1415–1436CrossRefGoogle Scholar
  15. 15.
    KaewTraKulPong P, Bowden R (2002) An improved adaptive background mixture model for real-time tracking with shadow detection. In: Video-based surveillance systems. Springer, Boston, p 135–144Google Scholar
  16. 16.
    Kim K, Chalidabhongse TH, Harwood D, Davis L (2005) Real-time foreground–background segmentation using codebook model. Real-time imaging 11(3):172–185CrossRefGoogle Scholar
  17. 17.
    Kim YM, Park J, Lim J, Yoo J (2017) An energy-efficient compression scheme for wireless multimedia sensor networks. Multimed Tools Appl 76(19):19707–19722CrossRefGoogle Scholar
  18. 18.
    Li L, Huang W, Gu IY, Tian Q (2003) Foreground object detection from videos containing complex background. In: Proceedings of the eleventh ACM international conference on multimedia. ACM, p 2–10Google Scholar
  19. 19.
    Liu Y, Nie L, Han L, Zhang L, Rosenblum DS (2015) Action2Activity: recognizing complex activities from sensor data. IJCAI2015:1617–1623Google Scholar
  20. 20.
    Liu Y, Nie L, Liu L, Rosenblum DS (2016) From action to activity: sensor-based activity recognition. Neurocomputing 181:108–115CrossRefGoogle Scholar
  21. 21.
    Lloret J, Bosch I, Sendra S, Serrano A (2011) A wireless sensor network for vineyard monitoring that uses image processing. Sensors 11(6):6165–6196CrossRefGoogle Scholar
  22. 22.
    Lopez-Bravo A, Diaz-Carmona J, Ramirez-Agundis A, Padilla-Medina A, Prado-Olivarez J (2013) FPGA-based video system for real time moving object detection. In: International conference on electronics, communications and computing (CONIELECOMP). Puebla, Mexico, p 92–97Google Scholar
  23. 23.
    Manzanera A (2007) Σ-Δ Background subtraction and the Zipf law. In: Rueda L, Mery D, Kittler J (eds) Progress in pattern recognition, image analysis and applications. CIARP 2007. Lecture notes in computer science, vol 4756. Springer, Berlin, HeidelbergGoogle Scholar
  24. 24.
    Mekonnen T, Porambage P, Harjula E, Ylianttila M (2017) Energy consumption analysis of high quality multi-tier wireless multimedia sensor network. IEEE Access 5:15848–15858CrossRefGoogle Scholar
  25. 25.
    Nandhini SA, Radha S (2017) Efficient compressed sensing-based security approach for video surveillance application in wireless multimedia sensor networks. Comput Electr Eng 60:175–192CrossRefGoogle Scholar
  26. 26.
    Pawaskar MMC, Narkhede MNS, Athalye MSS (2014) Detection of moving object based on background subtraction. International Journal of Emerging Trends & Technology in Computer Science 3(3):215–218Google Scholar
  27. 27.
    Possa PR, Mahmoudi SA, Harb N, Valderrama C, Manneback P (2014) A multi-resolution FPGA-based architecture for real-time edge and corner detection. IEEE Trans Comput 63(10):2376–2388MathSciNetCrossRefGoogle Scholar
  28. 28.
    Rehman YAU, Tariq M, Sato T (2016) A novel energy efficient object detection and image transmission approach for wireless multimedia sensor networks. IEEE Sensors J 16(15):5942–5949CrossRefGoogle Scholar
  29. 29.
    Rodrigues IN, de Melo CL, da Frota Botinelly VM, de Oliveira JP (2015) FPGA hardware architecture with parallel data processing to detect moving objects using the background image subtraction technique. In: CHILEAN conference on electrical, electronics engineering, information and communication technologies (CHILECON). Santiago, Chile, p 841–846Google Scholar
  30. 30.
    Rodriguez-Gomez R, Fernandez-Sanchez EJ, Diaz J, Ros E (2015) Codebook hardware implementation on FPGA for background subtraction. J Real-Time Image Proc 10(1):43–57CrossRefGoogle Scholar
  31. 31.
    Shen B, Zhang WY, Qi DP, Wu XY (2015) Wireless multimedia sensor network based subway tunnel crack detection method. International Journal of Distributed Sensor Networks 11(6):184639CrossRefGoogle Scholar
  32. 32.
    Wang H (2013) Communication-resource-aware adaptive watermarking for multimedia authentication in wireless multimedia sensor networks. J Supercomput 64(3):883–897CrossRefGoogle Scholar
  33. 33.
    Wang P, Dai R, Akyildiz IF (2013) A differential coding-based scheduling framework for wireless multimedia sensor networks. IEEE Transactions on Multimedia 15(3):684–697CrossRefGoogle Scholar
  34. 34.
    Wang R, Yu Z, Liu M, Wang Y, Chang Y (2014) Real-time visual static hand gesture recognition system and its FPGA-based hardware implementation. In: 12th international conference on signal processing (ICSP). Zhejiang, China, p 434–439Google Scholar
  35. 35.
    Yap FG, Yen HH (2014) A survey on sensor coverage and visual data capturing/processing/transmittion in vireless visual sensor networks. Sensors 14(2):3506–3527CrossRefGoogle Scholar
  36. 36.
    Zhang B, Mei K, Zheng N (2013) Reconfigurable processor for binary image processing. IEEE transactions on circuits and systems for video technology 23(5):823–831CrossRefGoogle Scholar
  37. 37.
    Zhang X, Wang Y, Wang D, Li Y (2017) Adaptive image compression based on compressive sensing for video sensor nodes. Multimed Tools Appl 77(11):13679–13699CrossRefGoogle Scholar
  38. 38.
    Zivkovic Z (2004) Improved adaptive Gaussian mixture model for background subtraction. In: 17th international conference on the proceedings of pattern recognition ICPR 2:28–31Google Scholar

Copyright information

© Springer Science+Business Media, LLC, part of Springer Nature 2019

Authors and Affiliations

  1. 1.Electrical Engineering Department, Faculty of EngineeringShahid Chamran University of AhvazAhvazIran

Personalised recommendations