Skip to main content
SpringerLink
Log in

SOS: Real-time and accurate physical assault detection using smartphone

  • Published:
Peer-to-Peer Networking and Applications Aims and scope Submit manuscript

Abstract

Motivated by the reports about assaults on women, we take the first step to explore possibility of using off-the-shelf smartphone for physical assault detection. There are several kinds of crime offenses against persons, such as gunshot, battery, abuse, kidnapping and so on, which are distinguished by form, severity, duration, etc. In this paper, we aim at detecting those severe and non-instantaneous physical assaults using accelerometer in smartphone. We collected 100 surveillance videos involving aggravated assaults, and extract the the pattern of actions for an individual under assaulting. The most difficult one among challenges in our design is the extraordinary complexity and diversity of actions under assaulting, which lead to an extremely hard, if not impossible, to perform fine-grained recognition. To this end, we decide to focus on the intensity and irregularity characteristics of aggravated assaults, based on which several features from time domain and frequency domain are extracted. Moreover, we proposed a combinatorial classification scheme considering individuality of user’s ADLs (Activities of Daily Living) and universality of differences between ADLs and assaults to most people. The data we used for training and testing are collected from simulated aggravated assaults which are performed by our volunteers in controlled settings. Our experiment results showed that aggravated assaults could be distinguished with the majority of ADLs in our proposed feature space, and our proposed system could correctly detect most instances of aggravated assault (FNR = 11.75 %) with low false alarm rate (0.067 times per day) and short delay (6.89 s).

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11

Similar content being viewed by others

References

  1. Lane ND, Miluzzo E, Lu H, Peebles D, Choudhury T, Campbell AT (2010) A survey of mobile phone sensing. Commun Mag 48(9):140–150

    Article  Google Scholar 

  2. Campbell AT, Eisenman SB, Lane ND, Miluzzo E, Peterson RA, Lu H, Zheng X, Musolesi M, Fodor K, Ahn GS (2008) The rise of people-centric sensing. Internet Comput 12(4):12–21

    Article  Google Scholar 

  3. Ladha C, Hammerla NY, Olivier P, Plötz T (2013) ClimbAX: skill assessment for climbing enthusiasts. In: Ubicomp 2013. ACM, pp 235–244

  4. Buman MP, Hekler EB, Haskell WL, Pruitt L, Conway TL, Cain KL, Sallis JF, Saelens BE, Frank LD, King AC (2010) Objective light-intensity physical activity associations with rated health in older adults. Am J Epidemiol 172(10):1155–1165

    Article  Google Scholar 

  5. Dai J, Teng J, Bai X, Shen Z, Xuan D (2010) Mobile phone based drunk driving detection. In: Pervasive computing technologies for healthcare (PervasiveHealth), 2010 4th International conference on-no permissions. IEEE, pp 1–8

  6. Parate A, Chiu MC, Chadowitz C, Ganesan D, Kalogerakis E (2014) RisQ: recognizing smoking gestures with inertial sensors on a wristband. In: Mobisys 2014. ACM, pp 149–161

  7. Kim Y, Lee S, Hwang I, Ro H, Lee Y, Moon M, Song J (2014) High5: promoting interpersonal hand-to-hand touch for vibrant workplace with electrodermal sensor watches. In: Ubicomp 2014. ACM, pp 15–19

  8. NIBRS, http://www.fbi.gov/about-us/cjis/ucr/nibrs

  9. Gómez D, Bernardos AM, Portillo JI, Tarrío P, Casar JR (2013) A review on mobile applications for citizen emergency management. In: Highlights on practical applications of agents and multi-agent systems. Springer, Berlin, Heidelberg, pp 190–201

  10. EmergenSee, http://emergensee.com

  11. iGoSafely, http://www.igosafely.com

  12. Motion Coprocessor, https://en.wikipedia.org/wiki/Apple_motion_coprocessors https://en.wikipedia.org/wiki/Apple_motion_coprocessors

  13. Wu W, Dasgupta S, Ramirez EE, Peterson C, Norman GJ (2012) Classification accuracies of physical activities using smartphone motion sensors. J Med Internet Res 14(5):e130

    Article  Google Scholar 

  14. Györbíró N, Fábián á, Hományi G (2009) An activity recognition system for mobile phones. Mobile Networks and Applications 14(1):82–91

    Article  Google Scholar 

  15. Eren H, Makinist S, Akin E, Yilmaz A (2012) Estimating driving behavior by a smartphone. In: Intelligent vehicles symposium (IV). IEEE, pp 234–239

  16. Gu T, Chen S, Tao X, Lu J (2010) An unsupervised approach to activity recognition and segmentation based on object-use fingerprints. Data Knowl Eng 69(6):533–544

    Article  Google Scholar 

  17. Kwapisz JR, Weiss GM, Moore SA (2011) Activity recognition using cell phone accelerometers. ACM SigKDD Explorations Newsletter 12(2):74–82

    Article  Google Scholar 

  18. Tax DM, Duin RP (2004) Support vector data description. Mach Learn 54(1):45–66

    Article  MATH  Google Scholar 

  19. Platt J (1999) Probabilistic outputs for support vector machines and comparisons to regularized likelihood methods. Advances in large margin classifiers 10(3):61–74

    Google Scholar 

  20. Ward JA, Lukowicz P, Gellersen HW (2011) Performance metrics for activity recognition. ACM Trans Intell Syst Technol (TIST) 2(1):6

    Google Scholar 

  21. Tax DM (2014) DDtools, the Data Description Toolbox for Matlab, version 2.1.1

  22. Duin RP, Juszczak P, Pacl P, Pkalska E, de Ridder D, Tax DM, Verzakov S (2007) PR-Tools4.1, A Matlab toolbox for pattern recognition

  23. Bogomolov A, Lepri B, Staiano J, Oliver N, Pianesi F, Pentland A (2014) Once upon a crime: towards crime prediction from demographics and mobile data. In: ICMI 2014. ACM, pp 427– 434

  24. Lane ND, Xu Y, Lu H, Hu S, Choudhury T, Campbell AT, Zhao F (2011) Enabling large-scale human activity inference on smartphones using community similarity networks (csn). In: Ubicomp 2011. ACM, pp 355–364

  25. Lara OD, Labrador MA (2013) A survey on human activity recognition using wearable sensors. Commun Surv Tutorials 15(3):1192–1209

    Article  Google Scholar 

  26. Yatani K, Truong KN (2012) Bodyscope: a wearable acoustic sensor for activity recognition. In: Ubicomp 2012. ACM, pp 341–350

  27. Lu H, Frauendorfer D, Rabbi M, Mast MS, Chittaranjan GT, Campbell AT, Gatica-Perez D, Choudhury T (2012) Stresssense: detecting stress in unconstrained acoustic environments using smartphones. In: Ubicomp 2012. ACM , pp 351–360

  28. Tapia EM, Intille SS, Haskell W, Larson K, Wright J, King A, Friedman R (2007) Real-time recognition of physical activities and their intensities using wireless accelerometers and a heart rate monitor. In: 2007 11th IEEE International symposium on wearable computers. IEEE, pp 37–40

  29. Lee Y, Min C, Hwang C, Lee J, Hwang I, Ju Y, Yoo C, Moon M, Lee U, Song J (2013) Sociophone: everyday face-to-face interaction monitoring platform using multi-phone sensor fusion. In: Mobisys 2013. ACM, pp 375–388

  30. Kang S, Lee J, Jang H, Lee H, Lee Y, Park S, Song J (2008) Seemon: scalable and energy-efficient context monitoring framework for sensor-rich mobile environments. In: Mobisys 2008. ACM, pp 267–280

  31. Chu D, Lane ND, Lai TTT, Pang C, Meng X, Guo Q, Li F, Zhao F (2011) Balancing energy, latency and accuracy for mobile sensor data classification. In: Sensys 2011. ACM , pp 54–67

  32. Kong Q, Maekawa T (2013) Sharing training data among different activity classes. In: Ubicomp 2013. ACM, pp 701–712

  33. Cheng HT, Sun FT, Griss M, Davis P, Li J, You D (2013) Nuactiv: recognizing unseen new activities using semantic attribute-based learning. In: Mobisys 2013. ACM, pp 361–374

  34. Gu B, Sheng VS, Tay KY, Romano W, Li S (2015) Incremental support vector learning for ordinal regression. IEEE Transactions on Neural networks and learning systems

  35. Stikic M, Van Laerhoven K, Schiele B (2008) Exploring semi-supervised and active learning for activity recognition. In: 2008 12th IEEE International symposium on wearable computers (ISWC). IEEE, pp 81–88

  36. Bagaveyev S, Cook DJ (2014) Designing and evaluating active learning methods for activity recognition. In: Ubicomp 2014. ACM, pp 469–478

  37. Yin J, Yang Q, Pan JJ (2008) Sensor-based abnormal human-activity detection. IEEE Trans Knowl Data Eng 20(8):1082–1090

    Article  Google Scholar 

  38. Zheng Y, Jeon B, Xu D, Wu QJ, Zhang H (2015) Image segmentation by generalized hierarchical fuzzy C-means algorithm. J Intell Fuzzy Syst 28(2):961–973

    Google Scholar 

  39. Gu B, Sheng VS, Wang Z, Ho D, Osman S, Li S (2015) Incremental learning for-Support vector regression. Neural Networks. Elsevier 67:140–150

    Article  Google Scholar 

Download references

Acknowledgments

This paper is supported by the National Science and Technology Major Project under No. 2012ZX03005-009, National Science Foundation of China under No. U1301256, No. 61170058, No. 61572342, No. 61303206, Natural Science Foundation of Jiangsu Province under Grant No. BK20151240, Special Project on IoT of China NDRC (2012-2766), Priority Academic Program Development of Jiangsu Higer Education Institutions(PAPD), and Jiangsu Collaborative Innovation Center on Atmospheric Environment and Equipment Technology(CICAEET). Any opinions, findings, conclusions, or recommendations expressed in this paper are those of author(s) and do not necessarily reflect the views of the funding agencies (NSFC).

Author information

Authors and Affiliations

  1. School of Computer Science and Technology, University of Science and Technology of China, Hefei, Anhui, China

    Zehao Sun, Zhenyu Zhu, Hansong Guo & Liusheng Huang

  2. Department of Information Systems, University of Texas at Dallas, Dallas, TX, USA

    Shaojie Tang

  3. School of Computer Science and Technology, Soochow University, Suzhou, Jiangsu, China

    He Huang

  4. Nanjing University of Information Science and Technology, Nanjing, Jiangsu, China

    He Huang & Yu-e Sun

  5. School of Urban Rail Transportation, Soochow University, Suzhou, Jiangsu, China

    Yu-e Sun

Authors
  1. Zehao Sun
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Shaojie Tang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. He Huang
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Zhenyu Zhu
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Hansong Guo
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Yu-e Sun
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Liusheng Huang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to He Huang.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Sun, Z., Tang, S., Huang, H. et al. SOS: Real-time and accurate physical assault detection using smartphone. Peer-to-Peer Netw. Appl. 10, 395–410 (2017). https://doi.org/10.1007/s12083-016-0428-5

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12083-016-0428-5

Keywords

Search

Navigation