Skip to main content

Advertisement

Log in

ANTON: Activity Recognition-Based Smart Home Control System

  • Original Research
  • Published:
SN Computer Science Aims and scope Submit manuscript

Abstract

Due to the increasingly fast-paced life in the city, people have become exhausted. In addition, the increasing severity of aging also reminds society of the need to reduce the difficulty of using electrical appliances. To change this situation, smart homes came into being, which can also greatly reduce the energy consumed by users at home. In this paper, based on a data set that records sensor data under different activities provided by a mobile phone worn on the waist, an activity recognition tool has been developed to provide a new control strategy for smart homes. This tool classifies user activities including standing, sitting, lying, walking, going upstairs and downstairs by analyzing data from the sensors. It realizes real-time transmission and update of human body movement data through the signal of Micro Controller Unit (MCU). Then, we use customized machine learning algorithm based on experiment data and a method based solely on human movement data to analyze and identify user activity. The main superiority of this system is that the hardware used is simple, efficient, and cost-effective. After evaluating the proposed system, we have found that it has obtained more than 85% accurate recognition of human activities. Different from the current mainstream algorithms based solely on machine learning, we have also introduced data related to human kinematics to better fit the training model. For users with different physical conditions, different parameters can be configured for better versatility.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12

Similar content being viewed by others

References

  1. Stojkoska BR, Trivodaliev K. A review of Internet of Things for smart home: challenges and solutions. J Clean Prod. 2017;140:1454–64.

    Article  Google Scholar 

  2. Wilson C, Hargreaves T, Hauxwellbaldwin R. Smart homes and their users: a systematic analysis and key challenges. Ubiquitous Comput. 2015;19:463–76.

    Article  Google Scholar 

  3. Luria M, Hoffman G, Zuckerman O. Comparing social robot, screen and voice interfaces for smart-home control. In: 2017 CHI Conference, 2017;580–628. https://doi.org/10.1145/3025453.3025786

  4. Piyathilaka L, Kodagoda S. Gaussian mixture based HMM for human daily activity recognition using 3D skeleton features. In: IEEE 8th Conference on industrial electronics and applications (ICIEA), Melbourne, 2013;567–72. https://doi.org/10.1109/ICIEA.2013.6566433

  5. Chen Z, Zhang L, Jiang C, Cao Z, Cui W. WiFi CSI based passive human activity recognition using attention based BLSTM. IEEE Trans Mob Comput. 2019;18(11):2714–24. https://doi.org/10.1109/TMC.2018.2878233.

    Article  Google Scholar 

  6. Lei X, Tu G H, Liu AX. The insecurity of home digital voice assistants–Amazon alexa as a case study. 2018 IEEE Conference on Communications and Network Security (CNS), 2018;1–9. https://doi.org/10.1109/CNS.2018.8433167

  7. Peng X. The human body posture recognition system based on multi-sensor. Harbin: Harbin Institute of Technology; 2017.

    Google Scholar 

  8. Cumin J, Lefebvre G, Ramparany F. Human activity recognition using place-based decision fusion in smart homes. In: CONTEX 1017, Springer, 2017;137–50.

  9. Willis JD. Ambulation monitoring and fall detection system using dynamic belief networks. Clayton: School of Computer Science and Software Engineering, Monash University; 2000.

    Google Scholar 

  10. Tapia EM, Intille SS, Haskell WL, Larson K, Wright AH, King A, Friedman RH. Real-time recognition of physical activities and their intensities using wireless accelerometers and a heart rate monitor. In: Proceedings of the 11th IEEE International Symposium on wearable computers, 2007.

  11. Brouke AK, Lyonw GM. A threshold-based fall-detection algorithm using a bi-axial gyroscope sensor. Med Eng Phys. 2006;30:84–9.

    Article  Google Scholar 

  12. Yao Y, Fu Y. Contour model-based hand-gesture recognition using the kinect sensor. IEEE Trans Circ Syst Vid Technol. 2014;24:1935–44.

    Article  Google Scholar 

  13. Weng H, Zhan M. Multi-feature gesture recognition based on vision. New Delhi pp: CEA; 2012. p. 123–7.

    Google Scholar 

  14. Wojtczuk P, Binnie D, Armitage A, Chamberlain T, Giebeler C. A touchless passive infrared gesture sensor. In: Proceedings of the adjunct publication of the 26th Annual ACM Symposium on User interface software and technology, 2013;67–8. https://doi.org/10.1145/2508468.2514713

  15. Lustrek M, Kaluza B. Fall detection and activity recognition with machine learning. Informatica. 2009;33:205–12.

    Google Scholar 

  16. Jiang S, Pang G, Wu M, Kuang L. An improved k-nearest neighbor algorithm for text categorization. Expert Syst Appl. 2012;39(1):1503–9.

    Article  Google Scholar 

  17. Almalawi A, Fahad A, Tari Z, Cheema M, Khalil I. kNNVWC: an efficient k-nearest neighbors approach based on various-widths clustering. IEEE Trans Knowl Data Eng. 2016;28(1):68–81.

    Article  Google Scholar 

  18. Jones ZM, Linder FJ. Exploratory data analysis using random forests. J Open Source Softw. 2016;1(6):92.

    Article  Google Scholar 

  19. Paul A, Mukherjee D, Prasad D, Prasun G, Abhinandan C, Appa R, Kundu S. Improved random forest for classification. IEEE Trans Image Process. 2018;27:4012–24.

    Article  MathSciNet  Google Scholar 

  20. Albawi S, Mohammed TA. Understanding of a convolutional nerual network. In: The International Conference on engineering and technology 2017, 2017;1–6. https://doi.org/10.1109/ICEngTechnol.2017.8308186

  21. ”Human Activity Recognition with Smartphones,” 11 2019. [Online]. https://archive.ics.uci.edu/ml/machine-learning-databases/00240/.

  22. Bao Z, Ma P, Tong J, Wang C. Research on the velocity characteristics of human walking. Lab Res Explor. 2000;6:39–42.

    Google Scholar 

  23. Lu W, Tong Z, Chu J. Dynamic hand gesture recognition with leap motion controller. IEEE Signal Process Lett. 2016;23(9):1188–92. https://doi.org/10.1109/LSP.2016.2590470.

    Article  Google Scholar 

  24. Lee S-M, Yoon SM, Cho H. Human activity recognition from accelerometer data using Convolutional Neural Network. In: 2017 IEEE International Conference on big data and smart computing (BigComp), Jeju, 2017;131–34. https://doi.org/10.1109/BIGCOMP.2017.7881728.

  25. Wu D, Sharma N, Blumenstein M. Recent advances in video-based human action recognition using deep learning: a review. In: 2017 International Joint Conference on neural networks (IJCNN), Anchorage, AK, 2017;2865–872. https://doi.org/10.1109/IJCNN.2017.7966210.

  26. Wang W. Bluetooth 4.2: the preferred wireless technology standard for the Internet of Things. Electron Technol Appl. 2015;2:21.

    Google Scholar 

  27. Saini R, Kumar P, Roy PP, et al. A novel framework of continuous human-activity recognition using Kinect. Neurocomputing. 2018;311:99–111.

    Article  Google Scholar 

  28. Saini R, Kumar P, Kaur B, et al. Kinect sensor-based interaction monitoring system using the BLSTM neural network in healthcare. Int J Mach Learn Cybern. 2019;10(9):2529–40.

    Article  Google Scholar 

  29. Ahmed SA, Dogra DP, Kar S, et al. Trajectory-based surveillance analysis: a survey. IEEE Trans Circuits Syst Video Technol. 2018;29(7):1985–97.

    Article  Google Scholar 

  30. Yahaya SW, Lotfi A, Mahmud M. Detecting anomaly and its sources in activities of daily living. SN Comput Sci. 2021;2(1):1–18.

    Article  Google Scholar 

  31. Thapliyal H, Nath RK, Mohanty SP. Smart home environment for mild cognitive impairment population: solutions to improve care and quality of life. IEEE Consum Electron Mag. 2017;7(1):68–76.

    Article  Google Scholar 

  32. Fu Z, He X, Wang E, et al. Personalized Human Activity Recognition Based on Integrated Wearable Sensor and Transfer Learning. Sensors. 2021;21(3):885.

    Article  Google Scholar 

Download references

Acknowledgements

The authors would like to extend sincere thanks to the University of Nottingham Ningbo China for supporting this research project under the Faculty Inspiration Grant (I01190900047).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Pushpendu Kar.

Ethics declarations

Conflict of Interest

On behalf of all authors, the corresponding author states that there is no conflict of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

This article is part of the topical collection “Technologies and components for Smart Cities” guest edited by Himanshu Thapliyal, Saraju P. Mohanty, Srinivas Katkoori and Kailash Chandra Ray.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Zhao, P., Kar, P. & Ardakani, S.P. ANTON: Activity Recognition-Based Smart Home Control System. SN COMPUT. SCI. 2, 428 (2021). https://doi.org/10.1007/s42979-021-00824-0

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s42979-021-00824-0

Keywords

Navigation