Skip to main content
Log in

A Method to Control Home Appliances Based on Writing Commands Over the Air

  • Published:
Journal of Control, Automation and Electrical Systems Aims and scope Submit manuscript

Abstract

This paper presents a live, free, and real-time video- based pointing method, which allows the users to write hand gesture-based control commands over the air in front of an installed camera in order to control the home appliances. The proposed method has four main parts, viz: finger tracking, OCR analysis, appliance control circuit, and appliance-monitoring system, respectively. The proposed system is tested on two test beds, i.e., computer and mobile device based. Moreover, the proposed system is tested for three different types of communication links, which are dedicated wire, Bluetooth, and global system for mobile (GSM). Results of the performed tests indicate an improvement of 92.023 % in the overall accuracy gained by the proposed system. It is observed that the average recognition time required for per input character is 0.52 s. The average time observed for processing and acknowledgment (from DMG to computer/mobile) is 0.23, 2, 15 s for dedicated wire, Bluetooth, and GSM–SMS-based communication links, respectively.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11

Similar content being viewed by others

References

  • Baig, F., Beg, S., & Khan, M. F. (2012). Controlling home appliances remotely through voice command. International Journal of Computer Applications, 48(17), 1–4.

    Article  Google Scholar 

  • Baig, F., Beg, S., & Khan, M. F. (2013). Zigbee based home appliances controlling through spoken commands using handheld devices. International Journal of Smart Home, 7(1), 19–26.

    Google Scholar 

  • Bhuiyan, M., & Picking, R. (2009). Gesture-controlled user interfaces, what have we done and what’s next?. Technical report. Centre for Applied Internet Research (CAIR), Wrexham, UK.

  • Billinghurst, M., (2013). Gesture based Instruction. Book name: Haptic input, chapter 14, 24 August, 2011. http://www.billbuxton.com/input14.Gesture.pdf, visited on 7 October.

  • Das, S., et al. (2014). Embedded system for home automation using SM. First international conference on automation, control, energy and systems (ACES), pp. 1–6.

  • Edlinger, G., Holzner, C., & Guger, C. (2011). A hybrid brain-computer interface for smart home control. Human Computer Interaction–Interaction (HCII), Part 2 Environments, 6762, 417–426.

  • Foulds, R., & Moynahan, A. (1996). Computer recognition of the gestures of people with disabilities. Workshop on integration of gesture in language and speech ’96, Wilmington, DE, USA.

  • Guger, C., Holzner, C., Grönegress, C., Edlinger, G., & Slater, M. (2013). Control of a smart home with a brain-computer interface. http://www.gtec.at/content/download/1825/11409/version/2/, visited on 7 October, 2013.

  • Hannuksela, J., Huttunen, S., Sangi, P., & Heikkila, J. (2007). Motion-based finger tracking for user interaction with mobile devices. In proceedings 4th European conference visual media production, pp. 1–6, London, UK.

  • Harun, H., & Mansor, W., (2009). EOG signal detection for home appliances activation. 5th International colloquium on signal processing & its applications (CSPA), pp. 195–197.

  • Karam, M., & Schraefel, M.C. (2005). A taxonomy of gestures in human computer interaction. ACM transactions on computer–human interactions, technical report, technical report ECSTR-IAM05-009, Electronics and Computer Science, University of Southampton.

  • Krishna, Y. B., & Nagendram, S. (2012). Zigbee based voice control system for smart home. International Journal of Computer Technology & Applications, 3(1), 163–168.

    Google Scholar 

  • Patel, B., Shah, V., & Kshirsagar, R. (2011). Microcontroller based gesture recognition system for the handicap people. Journal of Engineering Research and Studies, II(IV), 113–115.

    Google Scholar 

  • Routhu, A., Gollapudi, P., Dhanavanthri, S., & Nagamalla, VK. (2013). Tongue drive system(TDS). http://ece.gmu.edu/~jkaps/courses/ece511-f11/project/Team7-Final.pdf, visited on 7 October, 2013.

  • Solanki, UV., & Desai, NH., (2011). Hand gesture based remote control for home appliances: Handmote. IEEE WICT proceeding, pp. 419–423.

  • Vikram, S., Li, L., & Russell, S., (2013). Handwriting and gestures in the air, recognizing on the fly. CHI 2013 extended abstracts, April 27–May 2, 2013. Paris: France.

  • Wu, C-H., & Lin, CH., (2013). Depth-based hand gesture recognition for home appliance control. IEEE 17th international symposium on consumer electronics (ISCE), pp. 279–280.

  • Yilmaz, A., Javed, O., & Shah, M. (2006). Object tracking: A survey. ACM Computer Survey, 38(4), 1–45. (Article 13).

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Muhammad Fahad Khan.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Baig, F., Beg, S., Khan, M.F. et al. A Method to Control Home Appliances Based on Writing Commands Over the Air. J Control Autom Electr Syst 26, 421–429 (2015). https://doi.org/10.1007/s40313-015-0184-4

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s40313-015-0184-4

Keywords

Navigation