Skip to main content

Advertisement

SpringerLink
Log in

Exploring data- and knowledge-driven methods for adaptive activity learning with dynamically available contexts

  • Regular Paper
  • Published:
CCF Transactions on Pervasive Computing and Interaction Aims and scope Submit manuscript

Abstract

Various aspects of human activity recognition have been researched so far and a variety of methods have been used to address them. Most of this research assumed that the data sources used for the recognition task are static. In real environments, however, sensors can be added or can fail and be replaced by different types of sensors. It is therefore important to create an activity recognition model that is able to leverage dynamically available sensors. To approach this problem, we propose methods for activity learning and activity recognition adaptation in environments with dynamic sensor deployments. In our previous work, we proposed sensor and activity context models to address sensor heterogeneity and also a learning-to-rank method for activity learning and its adaptation based on the proposed context models. However, most of the existing solutions, including our previous work, require labelled data for training. To tackle this problem and further improve the recognition accuracy, in this paper, we propose a knowledge-based method for activity recognition and activity model adaptation with dynamically available contexts in an unsupervised manner. We also propose a semi-supervised data selection method for activity model adaptation, so the activity model can be adapted without labelled data. We use comprehensive datasets to demonstrate effectiveness of the proposed methods, and show their advantage over the conventional machine learning algorithms in terms of recognition accuracy.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18
Fig. 19

Similar content being viewed by others

Notes

  1. https://en.wikipedia.org/wiki/Additive_smoothing.

References

  • Alam, M.A.U., Pathak, N., Roy, N.: Mobeacon: an ibeacon-assisted smartphone-based real time activity recognition framework. In: Proceedings of the 12th EAI International Conference on Mobile and Ubiquitous Systems: Computing, Networking and Services on 12th EAI International Conference on Mobile and Ubiquitous Systems: Computing, Networking and Services, pp. 130–139. ICST (Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering) (2015)

  • Bottou, L.: Large-scale machine learning with stochastic gradient descent. In: Proceedings of COMPSTAT’2010, pp. 177–186. Springer (2010)

  • Cao, H., Nguyen, M.N., Phua, C., Krishnaswamy, S., Li, X.-L.: An integrated framework for human activity classification. In: Proceedings of the 2012 ACM Conference on Ubiquitous Computing, pp. 331–340. ACM (2012)

  • Cheng, H.-T., Griss, M., Davis, P., Li, J., You, D.: Towards zero-shot learning for human activity recognition using semantic attribute sequence model. In: Proceedings of the 2013 ACM International Joint Conference on Pervasive and Ubiquitous Computing, pp. 355–358. ACM (2013)

  • Gonzalez, L.I.L., Amft, O.: Mining relations and physical grouping of building-embedded sensors and actuators. In: 2015 IEEE international Conference on Pervasive Computing and Communications (PerCom), pp 2–10. IEEE (2015)

  • Gu, T., Chen, S., Tao, X., Lu, J.: An unsupervised approach to activity recognition and segmentation based on object-use fingerprints. Data Knowl. Eng. 69(6), 533–544 (2010)

    Article  Google Scholar 

  • Gu, T., Wu, Z., Tao, X., Pung, H. K., Lu, J.: epsicar: An emerging patterns based approach to sequential, interleaved and concurrent activity recognition. In: IEEE International Conference on Pervasive Computing and Communications, 2009. PerCom 2009, pp 1–9. IEEE (2009)

  • Hammerla, N. Y., Plötz, T.: Let’s (not) stick together: pairwise similarity biases cross-validation in activity recognition. In: Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing, pp. 1041–1051. ACM (2015)

  • Henricksen, K., Indulska, J.: A software engineering framework for context-aware pervasive computing. In: Proceedings of the Second IEEE Annual Conference on Pervasive Computing and Communications, 2004. PerCom 2004. pp. 77–86. IEEE (2004)

  • Hu, P., Indulska, J., Robinson, R.: An autonomic context management system for pervasive computing. In: IEEE International Conference on Pervasive Computing and Communications, 2008. PerCom 2008. Sixth Annual, pp. 213–223. IEEE (2008)

  • Lukowicz, P., Poxrucker, A., Weppner, J., Bischke, B., Kuhn, J., Hirth, M.: Glass-physics: using google glass to support high school physics experiments. In: Proceedings of the 2015 ACM International Symposium on Wearable Computers, pp. 151–154. ACM (2015)

  • Maekawa, T., Watanabe, S.: Unsupervised activity recognition with user’s physical characteristics data. In: 2011 15th Annual International Symposium on Wearable Computers (ISWC), pp. 89–96. IEEE (2011)

  • Maekawa, T., Yanagisawa, Y., Kishino, Y., Ishiguro, K., Kamei, K., Sakurai, Y., Okadome, T.: Object-based activity recognition with heterogeneous sensors on wrist. In: International Conference on Pervasive Computing, pp. 246–264. Springer (2010)

  • Meng, J., Li, H., Han, Z.: Sparse event detection in wireless sensor networks using compressive sensing. In: 43rd Annual Conference on Information Sciences and Systems, 2009. CISS 2009, pp. 181–185. IEEE (2009)

  • Perkowitz, M., Philipose, M., Fishkin, K., Patterson, D.J.: Mining models of human activities from the web. In: Proceedings of the 13th international conference on World Wide Web, pp. 573–582. ACM (2004)

  • Reiss, A., Stricker, D.: Personalized mobile physical activity recognition. In: Proceedings of the 2013 International Symposium on Wearable Computers, pp. 25–28. ACM (2013)

  • Riboni, D., Bettini, C.: Cosar: hybrid reasoning for context-aware activity recognition. Pers. Ubiquitous Comput. 15(3), 271–289 (2011)

    Article  Google Scholar 

  • Riboni, D., Bettini, C., Civitarese, G., Janjua, Z. H., Helaoui, R.: Fine-grained recognition of abnormal behaviors for early detection of mild cognitive impairment. In: 2015 IEEE International Conference on Pervasive Computing and Communications (PerCom), pp. 149–154. IEEE (2015)

  • Roggen, D., Calatroni, A., Rossi, M., Holleczek, T., Förster, K., Tröster, G., Lukowicz, P., Bannach, D., Pirkl, G., Ferscha, A., et al: Collecting complex activity datasets in highly rich networked sensor environments. In: 2010 Seventh International Conference on Networked Sensing Systems (INSS), pp. 233–240. IEEE (2010)

  • Stikic, M., Larlus, D., Schiele, B.: Multi-graph based semi-supervised learning for activity recognition. In: 2009 International Symposium on Wearable Computers, pp. 85–92. IEEE (2009)

  • Sun, F.-T., Yeh, Y.-T., Cheng, H.-T., Kuo, C., Griss, M.: Nonparametric discovery of human routines from sensor data. In: 2014 IEEE International Conference on Pervasive Computing and Communications (PerCom), pp. 11–19. IEEE (2014)

  • Tapia, E. M., Choudhury, T., Philipose, M.: Building reliable activity models using hierarchical shrinkage and mined ontology. In: International Conference on Pervasive Computing, pp. 17–32. Springer (2006)

  • Van Kasteren, T., Englebienne, G., Kröse, B.J.: Transferring knowledge of activity recognition across sensor networks. In: International Conference on Pervasive Computing, pp. 283–300. Springer (2010)

  • Van Kasteren, T., Noulas, A., Englebienne, G., Kröse, B.: Accurate activity recognition in a home setting. In: Proceedings of the 10th International Conference on Ubiquitous Computing, pp. 1–9. ACM (2008)

  • Vapnik, V.: The Nature of Statistical Learning Theory. Springer, Heidleberg (2013)

    MATH  Google Scholar 

  • Wang, S., Pentney, W., Popescu, A.-M., Choudhury, T., Philipose, M.: Common sense based joint training of human activity recognizers. IJCAI 7, 2237–2242 (2007)

    Google Scholar 

  • Wen, J., Indulska, J., Zhong, M.: Adaptive activity learning with dynamically available context. In: 2016 IEEE International Conference on Pervasive Computing and Communications (PerCom), pp. 1–11. IEEE (2016)

  • Wen, J., Loke, S., Indulska, J., Zhong, M.: Sensor-based activity recognition with dynamically added context. In: proceedings of the 12th EAI International Conference on Mobile and Ubiquitous Systems: Computing, Networking and Services on 12th EAI International Conference on Mobile and Ubiquitous Systems: Computing, Networking and Services, pp. 1–10. ICST (Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering) (2015a)

  • Wen, J., Zhong, M., Indulska, J.: Creating general model for activity recognition with minimum labelled data. In: Proceedings of the 2015 ACM International Symposium on Wearable Computers, pp. 87–90. ACM (2015b)

  • Wu, J., Osuntogun, A., Choudhury, T., Philipose, M., Rehg, J. M.: A scalable approach to activity recognition based on object use. In: IEEE 11th International Conference on Computer Vision, 2007. ICCV 2007, pp. 1–8. IEEE (2007)

  • Wyatt, D., Philipose, M., Choudhury, T.: Unsupervised activity recognition using automatically mined common sense. AAAI 5, 21–27 (2005)

    Google Scholar 

  • Yedidia, J.S., Freeman, W.T., Weiss, Y.: Constructing free-energy approximations and generalized belief propagation algorithms. IEEE Trans. Inf. Theory 51(7), 2282–2312 (2005)

    Article  MathSciNet  MATH  Google Scholar 

  • Zhan, K., Faux, S., Ramos, F.: Multi-scale conditional random fields for first-person activity recognition. In: 2014 IEEE International Conference on Pervasive Computing and Communications (PerCom), pp. 51–59. IEEE (2014)

  • Zhou, B., Cheng, J., Sundholm, M., Reiss, A., Huang, W., Amft, O., Lukowicz, P.: Smart table surface: A novel approach to pervasive dining monitoring. In: 2015 IEEE International Conference on Pervasive Computing and Communications (PerCom), pp. 155–162. IEEE (2015)

Download references

Author information

Authors and Affiliations

  1. Guilin University of Technology, Guilin, China

    Jiahui Wen & Xiaohui Cheng

  2. Airborne Troops Training Base, Guilin, China

    Jiahui Wen

  3. The University of Queensland, Brisbane, Australia

    Jadwiga Indulska, Mingyang Zhong & Jingwei Ma

Authors
  1. Jiahui Wen
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jadwiga Indulska
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Mingyang Zhong
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Xiaohui Cheng
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Jingwei Ma
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Jadwiga Indulska.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Wen, J., Indulska, J., Zhong, M. et al. Exploring data- and knowledge-driven methods for adaptive activity learning with dynamically available contexts. CCF Trans. Pervasive Comp. Interact. 1, 24–46 (2019). https://doi.org/10.1007/s42486-018-0001-9

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s42486-018-0001-9

Keywords

Search

Navigation