Abstract
Deep neural network has promoted the development of human activity recognition research and becomes an indispensable tool for it. Deep neural networks, such as LSTM, can automatically learn important features from the data of human activities. But parts of these data are irrelevant and correspond to the Null activity [3], which can affect the recognition performance. Therefore, we propose a uniqueness attention mechanism to solve this problem. Every human activity consists of many atom motions. Some of these atom motions only occur in one single human activity. This kind of motion is more effective to discriminate human activities, and should therefore receive more attention. We design a model, named LSTM with Uniqueness Attention. When we identify the category of an unknown activity, our model first discover unknown activity’s atom motions which are unique to a known activity, and then use these motions to discriminate this unknown activity. In this way, irrelevant information can be filtered out. Moreover, by discovering an activity’s unique atom motion, we can get more insights to understand this human activity. We evaluate our approach on two public datasets and obtain state-of-the-art results. We also visualize this uniqueness attention, which has an excellent interpretability and goes pretty well with common sense.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Perez, A., Labrador, M.A., Barbeau, S.J.: G-Sense: a scalable architecture for global sensing and monitoring. IEEE Netw. 24(4), 57–64 (2010). https://doi.org/10.1109/MNET.2010.5510920
LeCun, Y., Bengio, Y., Hinton, G.: Deep learning. Nature 521(7553), 436–444 (2015). https://doi.org/10.1038/nature14539
Yang, J.B., Nguyen, M.N., San, P.P., Li, X.L., Krishnaswamy, S.: Deep convolutional neural networks on multichannel time series for human activity recognition. In: Proceedings of the 24th International Conference on Artificial Intelligence, Buenos Aires, Argentina, pp. 3995–4001 (2015)
Westerterp, K.R.: Assessment of physical activity: a critical appraisal. Eur. J. Appl. Physiol. 105(6), 823–828 (2009)
Parkka, J., et al.: Activity classification using realistic data from wearable sensors. In: International Conference of the IEEE Engineering in Medicine, vol. 10, no. 1, pp. 119–128(2006). https://doi.org/10.1109/TITB.2005.856863
Tapia, E.M., et al.: Real-time recognition of physical activities and their intensities using wireless accelerometers and a heart rate monitor. In: Proceedings of the International Symposium on Wearable Computers, pp. 1–4 (2007). https://doi.org/10.1109/ISWC.2007.4373774
Kao, T.P., Lin, C., Wang, J.: Development of a portable activity detector for daily activity recognition. In: Proceedings of the International Symposium on Industrial Electronics, pp. 115–120 (2009). https://doi.org/10.1109/ISIE.2009.5222001
Maurer, U., Smailagic, A., Siewiorek, D.P., Deisher, M.E.: Activity recognition and monitoring using multiple sensors on different body positions. In: Proceedings of the Wearable and Implantable Body Sensor Networks, pp. 113–116 (2006). https://doi.org/10.1109/BSN.2006.6
Bao, L., Intille, S.S.: Activity recognition from user-annotated acceleration data. In: Ferscha, A., Mattern, F. (eds.) Pervasive 2004. LNCS, vol. 3001, pp. 1–17. Springer, Heidelberg (2004). https://doi.org/10.1007/978-3-540-24646-6_1
Chen, Y., Yang, J., Liou, S., Lee, G., Wang, J.: Online classifier construction algorithm for human activity detection using a tri-axial accelerometer. Appl. Math. Comput. 205(2), 849–860 (2008). https://doi.org/10.1016/j.amc.2008.05.099
Ermes, M., Parkka, J., Cluitmans, L.: Advancing from offline to online activity recognition with wearable sensors. In: International Conference of the IEEE Engineering in Medicine and Biology Society, pp. 4451–4454 (2008). https://doi.org/10.1109/IEMBS.2008.4650199
He, Z.Y., Jin, L.W.: Activity recognition from acceleration data based on discrete cosine transform and SVM. In: 2009 IEEE International Conference on Systems, Man and Cybernetics, pp. 5041–5044. IEEE, New York (2009). https://doi.org/10.1109/ICSMC.2009.5346042
Altun, K., Barshan, B.: Human activity recognition using inertial/magnetic sensor units. In: Salah, A.A., Gevers, T., Sebe, N., Vinciarelli, A. (eds.) HBU 2010. LNCS, vol. 6219, pp. 38–51. Springer, Heidelberg (2010). https://doi.org/10.1007/978-3-642-14715-9_5
Plotz, T., Hammerla, N.Y., Olivier, P.: Feature learning for activity recognition in ubiquitous computing. In: International Joint Conference on Artificial Intelligence, pp. 1729–1734 (2011). https://doi.org/10.5591/978-1-57735-516-8/IJCAI11-290
Alsheikh, M.A., Selim, A., Niyato, D., Doyle, L., Lin, S., Tan, H.: Deep activity recognition models with triaxial accelerometers. In: National Conference on Artificial Intelligence (2016)
Murad, A., Pyun, J.-Y.: Deep recurrent neural networks for human activity recognition. Sensors 17(11), 2556 (2017). https://doi.org/10.3390/s17112556
Zeng, M., et al.: Convolutional neural networks for human activity recognition using mobile sensors. In: 2014 6th International Conference on Mobile Computing, Applications and Services, pp. 197–205 (2014). https://doi.org/10.4108/icst.mobicase.2014.257786
Chen, Y., Xue, Y.: A deep learning approach to human activity recognition based on single accelerometer. In: 2015 IEEE International Conference on Systems, Man, and Cybernetics, pp. 1488–1492. IEEE (2015). https://doi.org/10.1109/SMC.2015.263
Hammerla, N.Y., Halloran, S., Plotz, T.: Deep, convolutional, and recurrent models for human activity recognition using wearables. In: Proceedings of the International Joint Conference on Artificial Intelligence, pp. 1533–1540 (2016)
Ordonez, F.J., Roggen, D.: Deep convolutional and LSTM recurrent neural networks for multimodal wearable activity recognition. Sensors 16(1), 115 (2016). https://doi.org/10.3390/s16010115
Zeng, M., et al.: Understanding and improving recurrent networks for human activity recognition by continuous attention. In: Proceedings of the 2018 ACM International Symposium on Wearable Computers, pp. 56–63. ACM, Singapore (2018). https://doi.org/10.1145/3267242.3267286
Bahdanau, D., Cho, K., Bengio, Y.: Neural machine translation by jointly learning to align and translate, arXiv (2014)
Luong, M.-T., Pham, H., Manning, C.D.: Effective approaches to attention-based neural machine translation, arXiv (2015)
Hu, D.: An introductory survey on attention mechanisms in NLP problems, arXiv (2018)
Hochreiter, S., Schmidhuber, J.: Long short-term memory. Neural Comput. 9(8), 1735–1780 (1997)
Chavarriaga, R., Sagha, H., Calatroni, A.: The opportunity challenge: a benchmark database for on-body sensor-based activity recognition. Pattern Recognit. Lett. 34, 2033–2042 (2013). https://doi.org/10.1016/j.patrec.2012.12.014
Reiss, A., Stricker, D.: Introducing a new benchmarked dataset for activity monitoring. In: ISWC, pp. 108–109(2012). https://doi.org/10.1109/ISWC.2012.13
Rueda, F.M. Fink, G.A.: Learning attribute representation for human activity recognition. In: International Conference on Pattern Recognition, pp. 523–528. https://doi.org/10.1109/icpr.2018.8545146
Acknowledgement
This work was supported by Zhejiang Provincial Natural Science Foundation of China (NO. LY17F020008).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Zheng, Z., Shi, L., Wang, C., Sun, L., Pan, G. (2019). LSTM with Uniqueness Attention for Human Activity Recognition. In: Tetko, I., Kůrková, V., Karpov, P., Theis, F. (eds) Artificial Neural Networks and Machine Learning – ICANN 2019: Image Processing. ICANN 2019. Lecture Notes in Computer Science(), vol 11729. Springer, Cham. https://doi.org/10.1007/978-3-030-30508-6_40
Download citation
DOI: https://doi.org/10.1007/978-3-030-30508-6_40
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-30507-9
Online ISBN: 978-3-030-30508-6
eBook Packages: Computer ScienceComputer Science (R0)