Flexible Inference for Cyberbully Incident Detection

  • Haoti Zhong
  • David J. MillerEmail author
  • Anna Squicciarini
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11053)


We study detection of cyberbully incidents in online social networks, focusing on session level analysis. We propose several variants of a customized convolutional neural networks (CNN) approach, which processes users’ comments largely independently in the front-end layers, but while also accounting for possible conversational patterns. The front-end layer’s outputs are then combined by one of our designed output layers – namely by either a max layer or by a novel sorting layer, proposed here. Our CNN models outperform existing baselines and are able to achieve classification accuracy of up to 84.29% for cyberbullying and 83.08% for cyberaggression.



Work from Dr. Squicciarini and Haoti Zhong was partly supported by the National Science Foundation under Grant 1453080 and Grant 1421776.


  1. 1.
    Bengio, Y., Ducharme, R., Vincent, P., Jauvin, C.: A neural probabilistic language model. JMLR 3, 1137–1155 (2003)zbMATHGoogle Scholar
  2. 2.
    Berson, I.R., Berson, M.J., Berson, M.J.: Emerging risks of violence in the digital age: lessons for educators from an online study of adolescent girls in the united states. J. Sch. Violence 1(2), 51–71 (2002)MathSciNetCrossRefGoogle Scholar
  3. 3.
    Chatzakou, D., Kourtellis, N., Blackburn, J., De Cristofaro, E., Stringhini, G., Vakali, A.: Mean birds: detecting aggression and bullying on twitter. arXiv preprint arXiv:1702.06877 (2017)
  4. 4.
    Chen, Y., Zhou, Y., Zhu, S., Xu, H.: Detecting offensive language in social media to protect adolescent online safety. In: PASSAT, pp. 71–80. IEEE (2012)Google Scholar
  5. 5.
    Corcoran, L., Guckin, C.M., Prentice, G.: Cyberbullying or cyber aggression?: A review of existing definitions of cyber-based peer-to-peer aggression. Societies 5(2), 245–255 (2015)CrossRefGoogle Scholar
  6. 6.
    Dadvar, M., Trieschnigg, D., de Jong, F.: Experts and machines against bullies: a hybrid approach to detect cyberbullies. In: Sokolova, M., van Beek, P. (eds.) AI 2014. LNCS (LNAI), vol. 8436, pp. 275–281. Springer, Cham (2014). Scholar
  7. 7.
    Dadvar, M., Trieschnigg, D., Ordelman, R., de Jong, F.: Improving cyberbullying detection with user context. In: Serdyukov, P., et al. (eds.) ECIR 2013. LNCS, vol. 7814, pp. 693–696. Springer, Heidelberg (2013). Scholar
  8. 8.
    Dhingra, B., Zhou, Z., Fitzpatrick, D., Muehl, M., Cohen, W.W.: Tweet2Vec: character-based distributed representations for social media. arXiv preprint arXiv:1605.03481 (2016)
  9. 9.
    Dinakar, K., Reichart, R., Lieberman, H.: Modeling the detection of textual cyberbullying. In: The Social Mobile Web (2011)Google Scholar
  10. 10.
    Djuric, N., Zhou, J., Grbovic, M., et al.: Hate speech detection with comment embeddings. In: WWW, pp. 29–30. ACM (2015)Google Scholar
  11. 11.
    Duchi, J., Hazan, E., Singer, Y.: Adaptive subgradient methods for online learning and stochastic optimization. JMLR 12, 2121–2159 (2011)MathSciNetzbMATHGoogle Scholar
  12. 12.
    Galán-García, P., de la Puerta, J.G., Gómez, C.L., Santos, I., Bringas, P.G.: Supervised machine learning for the detection of troll profiles in Twitter social network: application to a real case of cyberbullying. In: Herrero, Á., et al. (eds.) SOCO 2013-CISIS 2013-ICEUTE 2013, vol. 239, pp. 419–428. Springer, Cham (2014). Scholar
  13. 13.
    Glorot, X., Bordes, A., Bengio, Y.: Domain adaptation for large-scale sentiment classification: a deep learning approach. In: ICML, pp. 513–520 (2011)Google Scholar
  14. 14.
    Hinduja, S., Patchin, J.W.: Social influences on cyberbullying behaviors among middle and high school students. J. Youth Adolesc. 42(5), 711–722 (2013)CrossRefGoogle Scholar
  15. 15.
    Hosseinmardi, H., Mattson, S.A., Rafiq, R.I., Han, R., Lv, Q., Mishra, S.: Detection of cyberbullying incidents on the Instagram social network. CoRR abs/1503.03909 (2015)Google Scholar
  16. 16.
    Hosseinmardi, H., Rafiq, R.I., Han, R., Lv, Q., Mishra, S.: Prediction of cyberbullying incidents in a media-based social network. In: ASONAM, pp. 186–192. IEEE (2016)Google Scholar
  17. 17.
    Huang, Q., Singh, V.K., Atrey, P.K.: Cyber bullying detection using social and textual analysis. In: SAM, pp. 3–6. ACM (2014)Google Scholar
  18. 18.
    Juvonen, J., Graham, S.: Bullying in schools: the power of bullies and the plight of victims. Annu. Rev. Psychol. 65, 159–185 (2014)CrossRefGoogle Scholar
  19. 19.
    Kalchbrenner, N., Grefenstette, E., Blunsom, P.: A convolutional neural network for modelling sentences. arXiv preprint arXiv:1404.2188 (2014)
  20. 20.
    Kim, Y.: Convolutional neural networks for sentence classification. arXiv preprint arXiv:1408.5882 (2014)
  21. 21.
    Kontostathis, A., Reynolds, K., Garron, A., Edwards, L.: Detecting cyberbullying: query terms and techniques. In: WebSci, pp. 195–204. ACM (2013)Google Scholar
  22. 22.
    Kowalski, R.M., Limber, S.P., Limber, S., Agatston, P.W.: Cyberbullying: Bullying in the Digital Age. Wiley, Hoboken (2012)Google Scholar
  23. 23.
    Lai, S., Xu, L., Liu, K., Zhao, J.: Recurrent convolutional neural networks for text classification. In: AAAI, vol. 333, pp. 2267–2273 (2015)Google Scholar
  24. 24.
    Langos, C.: Cyberbullying: the challenge to define. Cyberpsychol. Behav. Soc. Netw. 15(6), 285–289 (2012)CrossRefGoogle Scholar
  25. 25.
    LeCun, Y., et al.: Backpropagation applied to handwritten zip code recognition. Neural Comput. 1(4), 541–551 (1989)CrossRefGoogle Scholar
  26. 26.
    Li, Y., McLean, D., Bandar, Z.A., O’shea, J.D., Crockett, K.: Sentence similarity based on semantic nets and corpus statistics. IEEE Trans. Knowl. Data Eng. 18(8), 1138–1150 (2006)CrossRefGoogle Scholar
  27. 27.
    Mikolov, T., Chen, K., Corrado, G., Dean, J.: Efficient estimation of word representations in vector space. arXiv preprint arXiv:1301.3781 (2013)
  28. 28.
    Nahar, V., Unankard, S., Li, X., Pang, C.: Sentiment analysis for effective detection of cyber bullying. In: Sheng, Q.Z., Wang, G., Jensen, C.S., Xu, G. (eds.) APWeb 2012. LNCS, vol. 7235, pp. 767–774. Springer, Heidelberg (2012). Scholar
  29. 29.
    Nobata, C., Tetreault, J., Thomas, A., Mehdad, Y., Chang, Y.: Abusive language detection in online user content. In: WWW, Republic and Canton of Geneva, Switzerland, pp. 145–153. International World Wide Web Conferences Steering Committee (2016)Google Scholar
  30. 30.
    Rodkin, P.C., Farmer, T.W., Pearl, R., Acker, R.V.: They’re cool: social status and peer group supports for aggressive boys and girls. Soc. Dev. 15(2), 175–204 (2006)CrossRefGoogle Scholar
  31. 31.
    Salmivalli, C., Isaacs, J.: Prospective relations among victimization, rejection, friendlessness, and children’s self-and peer-perceptions. Child Dev. 76(6), 1161–1171 (2005)CrossRefGoogle Scholar
  32. 32.
    Srivastava, N., Hinton, G.E., Krizhevsky, A., Sutskever, I., Salakhutdinov, R.: Dropout: a simple way to prevent neural networks from overfitting. JMLR 15(1), 1929–1958 (2014)MathSciNetzbMATHGoogle Scholar
  33. 33.
    Tang, D., Qin, B., Liu, T.: Document modeling with gated recurrent neural network for sentiment classification. In: EMNLP, pp. 1422–1432 (2015)Google Scholar
  34. 34.
    Teow, L.-N., Loe, K.-F.: An effective learning method for max-min neural networks. In: IJCAI, pp. 1134–1139 (1997)Google Scholar
  35. 35.
    Xu, K., et al.: Show, attend and tell: neural image caption generation with visual attention. In: ICML, pp. 2048–2057 (2015)Google Scholar
  36. 36.
    Yin, D., Xue, Z., Hong, L., Davison, B.D., Kontostathis, A., Edwards, L.: Detection of harassment on web 2.0. In: Proceedings of the Content Analysis in the WEB, vol. 2, pp. 1–7 (2009)Google Scholar
  37. 37.
    Zalaquett, C.P., Chatters, S.J.: Cyberbullying in college. Sage Open 4(1), 1–8 (2014). Scholar
  38. 38.
    Zhong, H., et al.: Content-driven detection of cyberbullying on the Instagram social network. In: IJCAI, pp. 3952–3958 (2016)Google Scholar

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  • Haoti Zhong
    • 1
  • David J. Miller
    • 1
    Email author
  • Anna Squicciarini
    • 2
  1. 1.Electrical Engineering DepartmentPennsylvania State UniversityState CollegeUSA
  2. 2.College of Information Sciences and TechnologyPennsylvania State UniversityState CollegeUSA

Personalised recommendations