Discriminative Temporal Smoothing for Activity Recognition from Wearable Sensors

  • Jaakko Suutala
  • Susanna Pirttikangas
  • Juha Röning
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4836)


This paper describes daily life activity recognition using wearable acceleration sensors attached to four different parts of the human body. The experimental data set consisted of signals recorded from 13 different subjects performing 17 daily activities. Furthermore, to attain more general activities, some of the most specific classes were combined for a total of 9 different activities. Simple time domain features were calculated from each sensor device. For the recognition task, we propose a novel sequential learning method that combines discriminative learning of individual input-output mappings using support vector machines (SVM) with generative learning to smooth temporal time-dependent activity sequences with a trained hidden Markov model (HMM) type transition probability matrix. The experiments show that the accuracy of the proposed method is superior to various conventional discriminative and generative methods alone, and it achieved a total recognition rate of 94% and 96% studying 17 and 9 different daily activities, respectively.


Support Vector Machine Hide Markov Model Activity Recognition Generative Learning Wearable Sensor 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Bao, L., Intille, S.: Activity recognition from user-annotated acceleration data. In: Ferscha, A., Mattern, F. (eds.) PERVASIVE 2004. LNCS, vol. 3001, pp. 1–17. Springer, Heidelberg (2004)Google Scholar
  2. 2.
    Lester, J., Choudhury, T., Kern, N., Borriello, G., Hannaford, B.: A hybrid discriminative/generative approach for modeling human activities. In: Proceedings of the Nineteenth International Joint Conference on Artificial Intelligence, Edinburgh, Scotland, pp. 766–722 (2005)Google Scholar
  3. 3.
    Ward, J.A., Lukowicz, P., Troster, G., Starner, T.E.: Activity recognition of assembly tasks using body-worn microphones and accelerometers. IEEE Trans. Pattern Anal. Mach. Intell. 28(10), 1553–1567 (2006)CrossRefGoogle Scholar
  4. 4.
    Herbrich, R.: Learning Kernel Classifiers. The MIT Press, USA (2002)Google Scholar
  5. 5.
    Schölkopf, B., Smola, A.: Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond. The MIT Press, USA (2001)Google Scholar
  6. 6.
    Shawe-Taylor, J., Cristianini, N.: Kernel Methods for Pattern Analysis. Cambridge University Press, UK (2004)Google Scholar
  7. 7.
    Jebara, T.: Machine Learning: Discriminative and Generative. Kluwer Academic Publishers, Dordrecht (2004)zbMATHGoogle Scholar
  8. 8.
    Ng, A.Y., Jordan, M.I.: Classification with hybrid generative/discriminative models. In: NIPS 2001. Advances in Neural Information Processing Systems, vol. 14 (2001)Google Scholar
  9. 9.
    Rabiner, L.R.: A tutorial on hidden markov models and selected applications in speech recognition. Proceedings of the IEEE 77(2), 257–286 (1989)CrossRefGoogle Scholar
  10. 10.
    Forney, G.D.: The viterbi algorithm. Proceedings of the IEEE 61, 268–277 (1973)MathSciNetCrossRefGoogle Scholar
  11. 11.
    Pirttikangas, S., Fujinami, K., Nakajima, T.: Feature selection and activity recognition from wearable sensors. In: Youn, H.Y., Kim, M., Morikawa, H. (eds.) UCS 2006. LNCS, vol. 4239, pp. 516–527. Springer, Heidelberg (2006)CrossRefGoogle Scholar
  12. 12.
    Pentland, A.: Smart rooms. Scientific American 274, 68–76 (1996)CrossRefGoogle Scholar
  13. 13.
    Essa, I.A.: Ubiquitous sensing for smart and aware environments: Technologies towards the building of an aware home. IEEE Personal Communications, Special issue on networking the physical world, pp. 47–49 (October 2000)Google Scholar
  14. 14.
    Rhodes, B.J., Minar, N., Weaver, J.: Wearable computing meets ubiquitous computing: reaping the best of both worlds. In: Proc. Third International Symposium on Wearable Computers. Digest of Papers, San Francisco, California, USA, pp. 141–149 (October 18-19, 1999)Google Scholar
  15. 15.
    Huynh, T., Schiele, B.: Analyzing features for activity recognition. In: sOc-EUSAI 2005: Proceedings of the 2005 joint conference on Smart objects and ambient intelligence, pp. 159–163. ACM Press, New York (2005)CrossRefGoogle Scholar
  16. 16.
    Maurer, U., Smailagic, A., Siewiorek, D.P., Deisher, M.: Activity recognition and monitoring using multiple sensors on different body positions. In: BSN 2006. Proceedings of the International Workshop on Wearable and Implantable Body Sensor Networks, pp. 113–116. IEEE Computer Society, Washington, DC (2006)CrossRefGoogle Scholar
  17. 17.
    Kern, N., Schiele, B.: Multi-sensor activity context detection for wearable computing. In: European Symposium on Ambient Intelligence, Eindhoven, The Netherlands (November 2003)Google Scholar
  18. 18.
    Mäntylä, V.-M., Mäntyjärvi, J., Seppänen, T., Tuulari, E.: Hand gesture recognition of a mobile device user. In: ICME 2000. IEEE International Conference on Multimedia and Expo., New York, USA, vol. 1, pp. 281–284 (2000)Google Scholar
  19. 19.
    Brashear, H., Starner, T., Lukowicz, P., Junker, H.: Using multiple sensors for mobile sign language recognition. In: ISWC 2003. Proceedings of the 7th IEEE International Symposium on Wearable Computers, pp. 45–52. IEEE Computer Society, Washington, DC (2003)CrossRefGoogle Scholar
  20. 20.
    Van Laerhoven, K., Cakmakci, O.: What shall we teach our pants? In: ISWC 2000: Proceedings of the 4th IEEE International Symposium on Wearable Computers, p. 77. IEEE Computer Society, Washington, DC (2000)CrossRefGoogle Scholar
  21. 21.
    Chieu, H.L., Lee, W.S., Kaelbling, L.P.: Activity recognition from physiological data using conditional random fields. In: Singapore-MIT Alliance Symposium (2006)Google Scholar
  22. 22.
    Naphade, M.R., Wang, R., Huang, T.S.: Classifying motion picture soundtrack for video indexing. In: Proceedings of IEEE International Conference on Multimedia and Expo., pp. 1160–1163. IEEE Computer Society Press, Los Alamitos (2001)Google Scholar
  23. 23.
    Dietterich, T.: Machine learning for sequential data: A review. In: Caelli, T.M., Amin, A., Duin, R.P.W., Kamel, M.S., de Ridder, D. (eds.) SPR 2002 and SSPR 2002. LNCS, vol. 2396, pp. 15–30. Springer, Heidelberg (2002)CrossRefGoogle Scholar
  24. 24.
    Jaakkola, T., Haussler, D.: Exploiting generative models in discriminative classifiers. In: NIPS 1998. Advances in Neural Information Processing Systems, vol. 11 (1998)Google Scholar
  25. 25.
    Altun, Y., Tsochantaridis, I., Hofmann, T.: Hidden markov support vector machines. In: ICML 2003. Proceedings of the International Conference of Machine Learning (2003)Google Scholar
  26. 26.
    Altun, Y., Hofmann, T., Smola, A.: Gaussian process classification for segmenting and annotating sequences. In: ICML 2004. Proceedings of the International Conference of Machine Learning (2004)Google Scholar
  27. 27.
    Cristianini, N., Shawe-Taylor, J.: An Introduction to Support Vector Machines and Other Kernel-based Learning Methods. Cambridge University Press, UK (2000)Google Scholar
  28. 28.
    Platt, J.: Fast training of support vector machines using sequential minimal optimization. In: Smola, A., Bartlett, P., Schölkopf, B., Schuurmans, D. (eds.) Advances in Kernel Methods - Support Vector Learning, pp. 185–208. MIT Press, Cambridge (1999)Google Scholar
  29. 29.
    Platt, J.: Probabilistic outputs for support vector machines and comparisons to regularized likelihood methods. In: Smola, A., Bartlett, P., Schölkopf, B., Schuurmans, D. (eds.) Advances in Kernel Methods - Support Vector Learning, pp. 61–74. MIT Press, Cambridge (1999)Google Scholar
  30. 30.
    Hastie, T., Tibshirani, R.: Classification by pairwise coupling. In: Jordan, M.I., Kearns, M.J. (eds.) NIPS 1998. Advances in Neural Information Processing Systems, vol. 10, MIT Press, Cambridge (1998)Google Scholar
  31. 31.
    Wu, T.-F., Lin, C.-J., Weng, R.C.: Probability estimates for multi-class classification by pairwise coupling. Journal of Machine Learning Research 5, 975–1005 (2004)MathSciNetGoogle Scholar
  32. 32.
    Duan, K.-B., Keerthi, S.: Which is the best multiclass SVM method: An empirical study. In: Oza, N.C., Polikar, R., Kittler, J., Roli, F. (eds.) MCS 2005. LNCS, vol. 3541, pp. 278–285. Springer, Heidelberg (2005)Google Scholar
  33. 33.
    The Spider: Machine learning toolbox for matlab. Software available:
  34. 34.
    Chang, C.-C., Lin, C.-J.: LIBSVM: A Library for Support Vector Machines, Software available (2001),
  35. 35.
    Hidden Markov Model (HMM) toolbox for matlab. Software available:

Copyright information

© Springer-Verlag Berlin Heidelberg 2007

Authors and Affiliations

  • Jaakko Suutala
    • 1
  • Susanna Pirttikangas
    • 1
  • Juha Röning
    • 1
  1. 1.Intelligent Systems Group, Infotech Oulu, Computer Engineering Laboratory, 90014 University of OuluFinland

Personalised recommendations