Mobile Networks and Applications

, Volume 19, Issue 3, pp 303–317 | Cite as

Energy-Efficient Motion Related Activity Recognition on Mobile Devices for Pervasive Healthcare

  • Yunji LiangEmail author
  • Xingshe Zhou
  • Zhiwen Yu
  • Bin Guo


Activity recognition plays an important role for pervasive healthcare such as health monitoring, assisted living and pro-active services. Despite of the continuous and transparent sensing with various built-in sensors in mobile devices, activity recognition on mobile devices for pervasive healthcare is still a challenge due to the constraint of resources, such as battery limitation, computation workload, etc. Keeping in view the demand of energy-efficient activity recognition, we propose a hierarchical method to recognize user activities based on a single tri-axial accelerometer in smart phones for health monitoring. Specifically, the contribution of this paper is two-fold. First, it is demonstrated that the activity recognition based on the low sampling frequency is feasible for the long-term activity monitoring. Second, this paper presents a hierarchical recognition scheme. The proposed algorithm reduces the opportunity of usage of time-consuming frequency-domain features and adjusts the size of sliding window to improve recognition accuracy. Experimental results demonstrate the effectiveness of the proposed algorithm, with more than 85 % recognition accuracy rate for 11 activities and 3.2 h extended battery life for mobile phones. Our energy efficient recognition algorithm extends the battery time for activity recognition on mobile devices and contributes to the health monitoring for pervasive healthcare.


Energy-efficient Activity recognition Healthcare Mobile devices Tri-axial accelerometer 



This work was partially supported by the National Basic Research Program of China (No. 2012CB316400), the National Natural Science Foundation of China (No. 61222209, 61103063), the Program for New Century Excellent Talents in University (No. NCET-12-0466), the Specialized Research Fund for the Doctoral Program of Higher Education (No. 20126102110043), the Natural Science Basic Research Plan in Shaanxi Province of China (No. 2012JQ8028), and the Doctorate Foundation of Northwestern Polytechnical University.


  1. 1.
    Mihailidis A, Boger JN, Craig T, Hoey J (2008) The COACH prompting system to assist older adults with dementia through handwashing: an efficacy study. BMC Geriatr 8(28):1−18Google Scholar
  2. 2.
    Tang L, Zhou X, Zhi Y, Liang Y, Zhang D, Ni H (2011) MHS: a multimedia system for improving medication adherence in elderly care. IEEE Syst J 5(4):506–617CrossRefGoogle Scholar
  3. 3.
    Chen J, Chi P, Chu H, Chen C, Huang P (2010) A smart kitchen for nutrition-aware cooking. IEEE Pervasive Comput 9(4):58–65CrossRefGoogle Scholar
  4. 4.
    Ni H, Abdulrazak B, Zhang D, Wu S, Yu Z, Zhou X, Wang S (2012) Towards non-intrusive sleep pattern recognition in elder assistive environment. J Ambient Intell Human Comput 3(2):167–175CrossRefGoogle Scholar
  5. 5.
    Kawahara Y, Ryu N, Asami T (2009) Monitoring daily energy expenditure using a 3-axis accelerometer with a low-power microprocessor. Int J Hum Comput Interact 1:145–154Google Scholar
  6. 6.
    Ryu N, Kawahara Y, Asami T (2008) A calorie count application for a mobile phone based on METS value. In: Proceedings of 5th annual IEEE communications society conference on sensor, mesh and ad hoc communications and networks, San Francisco, pp 583–584Google Scholar
  7. 7.
    Rothney MP, Neumann M, Beziat A, Chen KY (2007) An artificial neural network model of energy expenditure using nonintegrated acceleration signals. J Appl Physiol 103:1419–1427CrossRefGoogle Scholar
  8. 8.
    Sánchez D, Tentori M, Favela J (2008) Activity recognition for the smart hospital. IEEE Intell Syst 23(2):50–57CrossRefGoogle Scholar
  9. 9.
    Bouten C, Koekkoek K, Verduin M, Kodde R, Janssen JD (1997) A triaxial accelerometer and portable data processing unit for the assessment of daily physical activity. IEEE Trans Biomed Eng 44:136–147CrossRefGoogle Scholar
  10. 10.
    Khan AM, Lee Y, Lee SY, Kim T (2010) A triaxial accelerometer-based physical-activity recognition via augmented-signal features and a hierarchical recognizer. IEEE Trans Inf Technol Biomed 14:1166–1172CrossRefGoogle Scholar
  11. 11.
    Kwapisz JR, Weiss GM, Moore SA (2010) Activity recognition using cell phone accelerometers. ACM SIGKDD Explorations Newsletter 12Google Scholar
  12. 12.
    Maurer U, Smailagic A, Siewiorek DP, Deisher M (2006) Activity recognition and monitoring using multiple sensors on different body positions. In: Proceedings of international workshop on wearable and implantable body sensor networks, Cambridge, pp 113–116Google Scholar
  13. 13.
    Krahnstoever N, Rittscher J, Tu P, Chen K, Tomlinson T (2005) Activity recognition using visual tracking and RFID. In: Proceedings of the 7th IEEE workshop on applications of computer vision, vol 1, pp 494–500Google Scholar
  14. 14.
    Inomata T, Naya F, Kuwahara N, Hattori F, Koqure K (2009) Activity recognition from interactions with objects using dynamic bayesian network. In: Proceedings of 3rd ACM international workshop on context-awareness for self-managing systems, Nara, pp 39–42Google Scholar
  15. 15.
    Patterson DJ, Fox D, Kautz H, Philipose M (2005) Fine grained activity recognition by aggregating abstract object usage. In: Proceedings of the 9th international symposium on wearable computers, Osaka, pp 44–51Google Scholar
  16. 16.
    Wu J, Osuntogun A, Choudhury T, Philipose M, Rehg JM (2007) A scalable approach to activity recognition based on object use. In: Proceedings of the 11th international conference on computer vision, Rio de Janeiro, pp 1–8Google Scholar
  17. 17.
    Bouchard K, Bouchard B, Bouzouane A (2011) Qualitative spatial activity recognition using a complete platform based on passive RFID tags: experiments and results. In: Proceedings of ICOST 2011, Montreal, pp 308–312Google Scholar
  18. 18.
    Yang J, Lee J, Choi J (2011) Activity recognition based on RFID object usage for smart mobile devices. J Comput Sci Technol 26:239–246CrossRefzbMATHGoogle Scholar
  19. 19.
    Chen L, Nugent CD, Cook D, Yu Z (2011) Knowledge-driven activity recognition in intelligent environment. Pervasive Mob Comput 7:285–286CrossRefGoogle Scholar
  20. 20.
    Mizuno H, Nagai H, Sasaki K, Hosaka H, Sugimoto C, Khalil K, Tatsuta S (2007) Wearable sensor system for human behavior recognition. In: Proceedings of 4th international conference on solid-state sensors, actuators and microsystems, Lyon, pp 435–438Google Scholar
  21. 21.
    Cho Y, Nam Y, Choi Y, Cho W (2008) SmartBuckle: human activity recognition using a 3-axis accelerometer and a wearable camera. In: Proceedings of HealthNet’08, BrechenridgeGoogle Scholar
  22. 22.
    Lukowicz P, Ward JA, Junker H, et al (2004) Recognizing workshop activity using body worn microphone and accelerometers. Pervasive Comput Lect Notes Comput Sci 3001:18–32CrossRefGoogle Scholar
  23. 23.
    Ward JA, Lukowicz P, Gerhard T, Starner TE (2006) Activtiy recogntion of assembly tasks using body-worn microphones and accelerometers. IEEE Trans Pattern Anal Mach Intell 28:1553–1566CrossRefGoogle Scholar
  24. 24.
    Inooka H, Ohtaki Y, Hayasaka H, Suzuki A, Naqatomi R (2006) Development of advanced portable device for daily physical assessment. In: Proceedings of SICE-ICASE international joint conference, Busan, pp 5878–5881Google Scholar
  25. 25.
    Choudhury T, Consolvo S, Harrison B, Consolvo S, Haehnel D, et al (2008) The mobile sensing platform: an embedded activity recognition system. IEEE Pervasive Comput 7:32–41CrossRefGoogle Scholar
  26. 26.
    Ribeiro PC, Santos-Victor J (2006) Human activity recognition from video: modeling, feature selection and classification architecture. In: Proceedings of international workshop on human activity recognition and modeling, Oxford, pp 1175–1178Google Scholar
  27. 27.
    Gupta S, Mooney RJ (2010) Using closed captions as supervision for video activity recognition. In: Proceedings of national conference on artificial intelligence, Atlanta, pp 1083–1088Google Scholar
  28. 28.
    Fusier F, Valentin V, Bremond F, Thonnat M, Borg M, Thirde D, Ferryman J (2007) Video understanding for complex activity recognition. Mach Vis Appl 18:167–188CrossRefzbMATHGoogle Scholar
  29. 29.
    Györbíró N, Fábían A, Hományi G (2009) An activity recognition system for mobile phones. Mob Netw Appl 14:82–91CrossRefGoogle Scholar
  30. 30.
    Kern N, Schiele B, Schmidt A (2003) Multi-sensor activity context detection for wearable computing. Ambient Intell Lect Notes Comput Sci 2875:220–232CrossRefGoogle Scholar
  31. 31.
    Bao L, Intille SS (2004) Activity recognition from user-annotated acceleration data. Pervasive Comput Lect Notes Comput Sci 3001:1–17CrossRefGoogle Scholar
  32. 32.
    Mannini A, Sabatini AM (2010) Machine learning methods for classifying human physical activity from on-body accelerometers. Sensor 10:1154–1175CrossRefGoogle Scholar
  33. 33.
    Krishnan NC, Juillard C, Colbry D (2009) Recognition of hand movements using wearable accelerometers. J Ambient Intell Smart Environ 1:143–155Google Scholar
  34. 34.
    Ruch N, Rumo M, Mader U (2011) Recognition of activities in children by two uniaxial accelerometers in free-living conditions. Eur J Appl Physiol 111:1917–1927CrossRefGoogle Scholar
  35. 35.
    He Z, Liu Z, Jin L, Zhen L, Huang J (2008) Weightlessness feature—a novel feature for single tri-axial accelerometer based activity recognition. In: Proceedings of 19th international conference on pattern recognition, Tampa, pp 1–4Google Scholar
  36. 36.
    Ravi N, Dander N, Mysore P, Littman ML (2005) Activity recognition from accelerometer data. In: Proceedings of the 20th national conference on artificial intelligence and the 17th innovative applications of artificial intelligence conference, pp 1541–1546Google Scholar
  37. 37.
    Mathie MJ, Celler BG, Lovell NH, Coster ACF (2004) Classification of basic daily movements using a triaxial accelerometer. Med Biol Eng Comput 42:679–687CrossRefGoogle Scholar
  38. 38.
    Krassing G, Tantinger D, Hofmann C, Wittenberg T, Struck M (2010) User-friendly system for recognition of activities with an accelerometer. In: Proceedings of 4th international conference on pervasive computing technologies for healthcare, Erlangen, pp 1–8Google Scholar
  39. 39.
    Lee M, Khan AM, Kim J, Cho Y, Kim T (2010) A single tri-axial accelerometer-based real-time personal life log system capable of activity classification and exercise information generation. In: Proceedings of 2010 annual international conference of the IEEE engineering in medicine and biology society, pp 1390–1393Google Scholar
  40. 40.
    Wang Y, Lin J, Annavaram M, Quinn JA, Jason H, Bhaskar K, Sadeh N (2009) A framework of energy efficient mobile sensing for automatic user state recognition. In: Proceedings of the 7th ACM international conference on mobile systems, applications, and services, New York, pp 179–192Google Scholar
  41. 41.
    Zappi P, Lombriser C, Stiefmeier T, Farella E, Roggen D, Benini L, Troster G (2008) Activity recognition from on-body sensors: accuracy-power trade-off by dynamic sensor selection. Wirel Sens Netw Lect Notes Comput Sci 4943:17–33CrossRefGoogle Scholar
  42. 42.
    Li X, Cao H, Chen E, Tian J (2012) Learning to infer the status of heavy-duty senors for energy efficient context-sensing. ACM Trans Intell Syst Technol 3(2):1–23Google Scholar
  43. 43.
    Lane ND , Xu Y, Lu H, Hu S, Choudhury T, Campbell AT, Zhao F (2011) Enabling large-scale human activity inference on Smartphones using Community Similarity Networks (CSN). In: Proceedings of the 13th internation conference on ubiquitous computing, Beijing, pp 355–364Google Scholar
  44. 44.
    Yan Z, Subbaraju V, Chakraborty D, Misra A, Aberer K (2012) Energy-efficient continuous activity recognition on mobile phones, an activity-adaptive approach. In: Proceedings of the 16th internation symposium on wearable computers, Newcastle, pp 17–24Google Scholar

Copyright information

© Springer Science+Business Media New York 2013

Authors and Affiliations

  1. 1.School of Computer ScienceNorthwestern Polytechnical UniversityXianPeople’s Republic of China

Personalised recommendations