Online Hidden Conditional Random Fields to Recognize Activity-Driven Behavior Using Adaptive Resilient Gradient Learning

  • Ahmad Shahi
  • Jeremiah D. Deng
  • Brendon J. Woodford
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 10634)


In smart home applications, accurate sensor-based human activity recognition is based on learning patterns online from collections of sequential sensor events. A more challenging problem is to discover and learn unknown activities that have not been observed or predefined. This is because in a real-world environment, it is impractical to presume that users/residents will only accomplish a set of predefined activities over a long-term period. To address the issues of classifying sequential data where there are multiple sensor-based activities which might be overlapping, we propose an Online Hidden Condition Random Field (OHCRF) using Resilient Gradient Algorithm (RGA) to recognize human activity behaviors. The discriminative nature of our OHCRF models the sequential observations of an online stream, resolving the level of biased data and over-fitting. The proposed adaptive RGA approach is used to update OHCRF’s parameters for online learning. Compared with Stochastic Gradient Descent (SGD), the proposed adaptive RGA converges faster, and has an efficient and transparent adaptation process. Experimentally, we demonstrate that our proposed approach can outperform the state-of-the-art methods for sequential sensor-based activity recognition involving datasets acquired from residents in smart home test-beds.


CRF Online learning Activity recognition Smart home 


  1. 1.
    Bao, L., Intille, S.S.: Activity recognition from user-annotated acceleration data. In: Ferscha, A., Mattern, F. (eds.) Pervasive 2004. LNCS, vol. 3001, pp. 1–17. Springer, Heidelberg (2004). doi: 10.1007/978-3-540-24646-6_1 CrossRefGoogle Scholar
  2. 2.
    Canzian, L., Musolesi, M.: Trajectories of depression: unobtrusive monitoring of depressive states by means of smartphone mobility traces analysis. In: Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing, pp. 1293–1304. ACM (2015)Google Scholar
  3. 3.
    Consolvo, S., Landay, J.A., McDonald, D.W.: Invisible computing-designing for behavior change in everyday life. Computer 42(6), 86 (2009)CrossRefGoogle Scholar
  4. 4.
    Dawadi, P.N., Cook, D.J., Schmitter-Edgecombe, M.: Automated cognitive health assessment from smart home-based behavior data. IEEE J. Biomed. Health Inf. 20(4), 1188–1194 (2016)CrossRefGoogle Scholar
  5. 5.
    Fleury, A., Vacher, M., Noury, N.: SVM-based multimodal classification of activities of daily living in health smart homes: sensors, algorithms, and first experimental results. IEEE Trans. Inf Technol. Biomed. 14(2), 274–283 (2010)CrossRefGoogle Scholar
  6. 6.
    Gunawardana, A., Mahajan, M., Acero, A., Platt, J.C.: Hidden conditional random fields for phone classification. In: Interspeech, pp. 1117–1120. Citeseer (2005)Google Scholar
  7. 7.
    Hoare, J.R., Parker, L.E.: Using on-line conditional random fields to determine human intent for peer-to-peer human robot teaming. In: IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 4914–4921. IEEE (2010)Google Scholar
  8. 8.
    Kapoor, A., Picard, R.W.: A real-time head nod and shake detector. In: Proceedings of the 2001 Workshop on Perceptive User Interfaces, pp. 1–5. ACM (2001)Google Scholar
  9. 9.
    Kumar, S., et al.: Discriminative random fields: a discriminative framework for contextual interaction in classification. In: Ninth IEEE International Conference on Computer Vision, pp. 1150–1157. IEEE (2003)Google Scholar
  10. 10.
    Lafferty, J., McCallum, A., Pereira, F., et al.: Conditional random fields: probabilistic models for segmenting and labeling sequence data. In: Proceedings of the Eighteenth International Conference on Machine Learning, ICML, vol. 1, pp. 282–289 (2001)Google Scholar
  11. 11.
    McCallum, A., Rohanimanesh, K., Sutton, C.: Dynamic conditional random fields for jointly labeling multiple sequences. In: NIPS-2003 Workshop on Syntax, Semantics and Statistics (2003)Google Scholar
  12. 12.
    Quattoni, A., Wang, S., Morency, L.P., Collins, M., Darrell, T.: Hidden conditional random fields. IEEE Trans. Pattern Anal. Mach. Intell. 29(10), 1848–1853 (2007)CrossRefGoogle Scholar
  13. 13.
    Rashidi, P., Cook, D.J., Holder, L.B., Schmitter-Edgecombe, M.: Discovering activities to recognize and track in a smart environment. IEEE Trans. Knowl. Data Eng. 23(4), 527–539 (2011)CrossRefGoogle Scholar
  14. 14.
    Riedmiller, M., Braun, H.: A direct adaptive method for faster backpropagation learning: the RPROP algorithm. In: IEEE International Conference on Neural Networks, pp. 586–591. IEEE (1993)Google Scholar
  15. 15.
    Sminchisescu, C., Kanaujia, A., Metaxas, D.: Conditional models for contextual human motion recognition. Comput. Vis. Image Underst. 104(2), 210–220 (2006)CrossRefGoogle Scholar
  16. 16.
    Sutton, C., McCallum, A., et al.: An introduction to conditional random fields. Found. Trends® Mach. Learn. 4(4), 267–373 (2012)CrossRefMATHGoogle Scholar
  17. 17.
    Tapia, E.M., Intille, S.S., Larson, K.: Activity recognition in the home using simple and ubiquitous sensors. In: Ferscha, A., Mattern, F. (eds.) Pervasive 2004. LNCS, vol. 3001, pp. 158–175. Springer, Heidelberg (2004). doi: 10.1007/978-3-540-24646-6_10 CrossRefGoogle Scholar
  18. 18.
    Torres, R.L.S., Ranasinghe, D.C., Shi, Q., van den Hengel, A.: Learning from imbalanced multiclass sequential data streams using dynamically weighted conditional random fields. CoRR abs/1603.03627 (2016).
  19. 19.
    Van Kasteren, T., Noulas, A., Englebienne, G., Kröse, B.: Accurate activity recognition in a home setting. In: Proceedings of the 10th International Conference on Ubiquitous Computing, pp. 1–9. ACM (2008)Google Scholar
  20. 20.
    Wang, S.B., Quattoni, A., Morency, L.P., Demirdjian, D., Darrell, T.: Hidden conditional random fields for gesture recognition. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 2, pp. 1521–1527. IEEE (2006)Google Scholar
  21. 21.
    Ye, J., Stevenson, G., Dobson, S.: KCAR: A knowledge-driven approach for concurrent activity recognition. Pervasive Mob. Comput. 19, 47–70 (2015)CrossRefGoogle Scholar

Copyright information

© Springer International Publishing AG 2017

Authors and Affiliations

  • Ahmad Shahi
    • 1
  • Jeremiah D. Deng
    • 1
  • Brendon J. Woodford
    • 1
  1. 1.Department of Information ScienceUniversity of OtagoDunedinNew Zealand

Personalised recommendations