Gamification for High-Quality Dataset in Mobile Activity Recognition

  • Nattaya MairitthaEmail author
  • Sozo Inoue
Conference paper
Part of the Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering book series (LNICST, volume 240)


This paper presents a gamification concept for getting high-quality user-annotated datasets in the context of mobile activity recognition, as well as a cheating detection algorithm. The novel idea behind this concept is that users are motivated by getting feedback about the quality of their labeling activity as rewards or gamification element. For that, the collected sensor data and labels are used as training data for a machine learning algorithm for determining the dataset quality based on the resulting accuracy. By using the proposed method, the results show that the gamification elements increase the quantity (labels from the proposed method is higher than the naive by at least 305) and the quality (the accuracy of the proposed data outperformed the original data by at least 4.3%) of the labels. Besides, the cheating detection algorithm could detect cheating with the accuracy of more than 70% that is fascinating work.


Mobile activity recognition Quality of dataset Gamification 


  1. 1.
    Kwapisz, J.R., Weiss, G.M., Moore, S.A.: Activity recognition using cell phone accelerometers. ACM SigKDD Explor. Newsl. 12(2), 74–82 (2011)CrossRefGoogle Scholar
  2. 2.
    Bao, L., Intille, S.S.: Activity recognition from user-annotated acceleration data. In: Ferscha, A., Mattern, F. (eds.) Pervasive 2004. LNCS, vol. 3001, pp. 1–17. Springer, Heidelberg (2004). Scholar
  3. 3.
    Weiss, G.M., Provost, F.: Learning when training data are costly: the effect of class distribution on tree induction. J. Artif. Intell. Res. 19, 315–354 (2003)zbMATHGoogle Scholar
  4. 4.
    Inoue, S., Ueda, N., Nohara, Y., Nakashima, N.: Mobile activity recognition for a whole day: recognizing real nursing activities with big dataset. In: Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing, pp. 1269–1280. ACM, September 2015Google Scholar
  5. 5.
    L’Heureux, A., Grolinger, K., Higashino, W.A., Capretz, M.A.: A gamification framework for sensor data analytics. In: 2017 IEEE International Congress on Internet of Things (ICIOT), pp. 74–81. IEEE, June 2017Google Scholar
  6. 6.
    Markey, A.R.: Three essays on boredom (2014)Google Scholar
  7. 7.
    Deterding, S., Dixon, D., Khaled, R., Nacke, L.: From game design elements to gamefulness: defining gamification. In: Proceedings of the 15th International Academic MindTrek Conference: Envisioning Future Media Environments, pp. 9–15. ACM, September 2011Google Scholar
  8. 8.
    Hamari, J., Koivisto, J., Sarsa, H.: Does gamification work?-a literature review of empirical studies on gamification. In: 2014 47th Hawaii International Conference on System Sciences (HICSS), pp. 3025–3034. IEEE, January 2014Google Scholar
  9. 9.
    Glas, R.: Breaking reality: exploring pervasive cheating in Foursquare (2015)Google Scholar
  10. 10.
    Fawcett, T.: An introduction to ROC analysis. Pattern Recogn. Lett. 27(8), 861–874 (2006)MathSciNetCrossRefGoogle Scholar

Copyright information

© ICST Institute for Computer Sciences, Social Informatics and Telecommunications Engineering 2018

Authors and Affiliations

  1. 1.Kyushu Institute of TechnologyKitakyushu-shiJapan

Personalised recommendations