Skip to main content
SpringerLink
Log in

Towards Cyberbullying-free social media in smart cities: a unified multi-modal approach

  • Focus
  • Published:
Soft Computing Aims and scope Submit manuscript

Abstract

Smart cities are shifting the presence of people from physical world to cyber world (cyberspace). Along with the facilities for societies, the troubles of physical world, such as bullying, aggression and hate speech, are also taking their presence emphatically in cyberspace. This paper aims to dig the posts of social media to identify the bullying comments containing text as well as image. In this paper, we have proposed a unified representation of text and image together to eliminate the need for separate learning modules for image and text. A single-layer Convolutional Neural Network model is used with a unified representation. The major findings of this research are that the text represented as image is a better model to encode the information. We also found that single-layer Convolutional Neural Network is giving better results with two-dimensional representation. In the current scenario, we have used three layers of text and three layers of a colour image to represent the input that gives a recall of 74% of the bullying class with one layer of Convolutional Neural Network.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

Similar content being viewed by others

Notes

  1. www.facebook.com.

  2. www.twitter.com.

  3. www.instagram.com.

  4. https://www.youtube.com/.

  5. https://www.reddit.com.

  6. https://www.recode.net/2015/12/7/11621218/streaming-video-now-accounts-for-70-percent-of-broadband-usage.

  7. Our dataset will be available on request through the author’s mail-id (kirtics518@gmail.com).

References

  • Al-garadi MA, Varathan KD, Ravana SD (2016) Cybercrime detection in online communications: the experimental case of cyberbullying detection in the Twitter network. Comput Hum Behav 63:433–443

    Article  Google Scholar 

  • Ali AM, Angelov P (2018) Anomalous behaviour detection based on heterogeneous data and data fusion. Soft Comput 22(10):3187–3201

    Article  Google Scholar 

  • Alkhammash EH, Jussila J, Lytras MD, Visvizi A (2019) Annotation of smart cities Twitter micro-contents for enhanced citizen’s engagement. IEEE Access 7:116267–116276

    Article  Google Scholar 

  • Badjatiya P, Gupta S, Gupta M, Varma V (2017) Deep learning for hate speech detection in tweets. In: Proceedings of the 26th international conference on world wide web companion. International world wide web conferences steering committee, pp 759–760

  • Berry KJ, Mielke PW Jr (1988) A generalization of Cohen’s kappa agreement measure to interval measurement and multiple raters. Educ Psychol Meas 48(4):921–933

    Article  Google Scholar 

  • Bhat CS, Ragan MA, Selvaraj PR, Shultz BJ (2017) Online bullying among high-school students in India. Int J Adv Couns 39(2):112–124

    Article  Google Scholar 

  • Bohra A, Vijay D, Singh V, Akhtar SS, Shrivastava M (2018) A dataset of Hindi-English code-mixed social media text for hate speech detection. In: Proceedings of the second workshop on computational modeling of people’s opinions, personality, and emotions in social media, pp 36–41

  • Burnap P, Williams ML (2015) Cyber hate speech on Twitter: an application of machine classification and statistical modeling for policy and decision making. Policy Internet 7(2):223–242

    Article  Google Scholar 

  • Chatzakou D, Kourtellis N, Blackburn J, De Cristofaro E, Stringhini G, Vakali A (2017) Mean birds: detecting aggression and bullying on Twitter. In: Proceedings of the 2017 ACM on web science conference. ACM, pp 13–22

  • Chen Y, Zhou Y, Zhu S, Xu H (2012) Detecting offensive language in social media to protect adolescent online safety. In: Privacy, security, risk and trust (PASSAT), 2012 international conference on and 2012 international conference on social computing (SocialCom). IEEE, pp 71–80

  • Chen H, Mckeever S, Delany SJ (2017) Harnessing the power of text mining for the detection of abusive content in social media. In: Advances in computational intelligence systems, Springer, New York. pp 187–205

  • Chui K, Lytras M, Visvizi A (2018) Energy sustainability in smart cities: artificial intelligence, smart monitoring, and optimization of energy consumption. Energies 11(11):2869

    Article  Google Scholar 

  • Dadvar M, De Jong F (2012) Cyberbullying detection: a step toward a safer internet yard. In: Proceedings of the 21st international conference on world wide web. ACM, pp 121–126

  • Dadvar M, Trieschnigg D, de Jong F (2014) Experts and machines against bullies: A hybrid approach to detect cyberbullies. In: Canadian conference on artificial intelligence, Springer, New York, pp 275–281

  • Davidson T, Warmsley D, Macy M, Weber I (2017) Automated hate speech detection and the problem of offensive language. arXiv preprint arXiv:1703.04009

  • Dinakar K, Jones B, Havasi C, Lieberman H, Picard R (2012) Common sense reasoning for detection, prevention, and mitigation of cyberbullying. ACM Trans Interact Intell Syst (TiiS) 2(3):18

    Google Scholar 

  • Hosseinmardi H, Mattson SA, Rafiq RI, Han R, Lv Q, Mishr S (2015) Prediction of cyberbullying incidents on the Instagram social network. arXiv preprint arXiv:1508.06257

  • Hosseinmardi H, Rafiq RI, Han R, Lv Q, Mishra S (2016) Prediction of cyberbullying incidents in a media-based social network. In: 2016 IEEE/ACM international conference on advances in social networks analysis and mining (ASONAM), pp 186–192. IEEE

  • Jones LM, Mitchell KJ, Finkelhor D (2013) Online harassment in context: trends from three youth internet safety surveys (2000, 2005, 2010). Psychol Violence 3(1):53

    Article  Google Scholar 

  • Kornblum J (2008) Cyberbullying grows bigger and meaner with photos, video. USA Today, dated July 17, 2008, Retrieved from https://cybercrimes.wordpress.com/2008/07/17/cyberbullying-growsbigger-and-meaner-with-photos-video/

  • Kumari K, Singh JP, Dwivedi YK, Rana NP (2019) Aggressive social media post detection system containing symbolic images. In: Conference on e-Business, e-Services and e-Society. Springer, New York, pp 415–424

  • League AD (2011) Glossary of cyberbullying terms. adl.org, Retrieved from https://www.sd35.bc.ca/wp-content/uploads/sites/2/2015/05/glossary_of_cyberbullying_terms.pdf. Accessed 23 Nov 2017

  • Lytras M, Visvizi A (2018) Who uses smart city services and what to make of it: toward interdisciplinary smart cities research. Sustainability 10(6):1998

    Article  Google Scholar 

  • Lytras M, Visvizi A, Daniela L, Sarirete A, Ordonez De Pablos P (2018) Social networks research for sustainable smart education. Sustainability 10(9):2974

    Article  Google Scholar 

  • Nahar V, Li X, Pang C (2013) An effective approach for cyberbullying detection. Commun Inf Sci Manag Eng 3(5):238

    Google Scholar 

  • Paavola J, Helo T, Jalonen H, Sartonen M, Huhtinen A (2016) Understanding the trolling phenomenon: the automated detection of bots and cyborgs in the social media. J Inf Warf 15(4):100–111

    Google Scholar 

  • Pater JA, Miller AD, Mynatt ED (2015) This digital life: a neighborhood-based study of adolescents’ lives online. In: Proceedings of the 33rd annual ACM conference on human factors in computing systems. ACM, pp 2305–2314

  • Reynolds K, Kontostathis A, Edwards L (2011) Using machine learning to detect cyberbullying. In: 2011 10th international conference on machine learning and applications and workshops (ICMLA), vol. 2, pp 241–244. IEEE

  • Salawu S, He Y, Lumsden J (2017) Approaches to automated detection of cyberbullying: a survey. IEEE Trans Affect Comput 1:1–1

    Google Scholar 

  • Seiler SJ, Navarro JN (2014) Bullying on the pixel playground: investigating risk factors of cyberbullying at the intersection of children’s online-offline social lives. Cyberpsychology. https://doi.org/10.5817/CP2014-4-6

    Article  Google Scholar 

  • Singh VK, Ghosh S, Jose C (2017) Toward multimodal cyberbullying detection. In: Proceedings of the 2017 CHI conference extended abstracts on human factors in computing systems. ACM, pp 2090–2099

  • Steiner-Correa F, Viedma-del Jesus MI, Lopez-Herrera A (2018) A survey of multilingual human-tagged short message datasets for sentiment analysis tasks. Soft Comput 22(24):8227–8242

    Article  Google Scholar 

  • Sui X, Chen Z, Guo L, Wu K, Ma J, Wang G (2017) Social media as sensor in real world: movement trajectory detection with microblog. Soft Comput 21(3):765–779

    Article  Google Scholar 

  • Tommasel A, Rodriguez JM, Godoy D (2018) Textual aggression detection through deep learning. In: Proceedings of the first workshop on trolling, aggression and cyberbullying (TRAC-2018), pp 177–187

  • Torres-Ruiz MJ, Lytras MD (2016) Urban computing and smart cities applications for the knowledge society. Int J Knowl Soc Res (IJKSR) 7(1):113–119

    Article  Google Scholar 

  • Van Royen K, Poels K, Daelemans W, Vandebosch H (2015) Automatic monitoring of cyberbullying on social networking sites: from technological feasibility to desirability. Telemat Inform 32(1):89–97

    Article  Google Scholar 

  • Visvizi A, Jussila J, Lytras MD, Ijäs M (2019) Tweeting and mining OECD-related microcontent in the post-truth era: a cloud-based app. Comput Human Behav. https://doi.org/10.1016/j.chb.2019.03.022

    Article  Google Scholar 

  • Visvizi A, Lytras MD (2018) Rescaling and refocusing smart cities research: from mega cities to smart villages. J Sci Technol Policy Manag 9(2):134–145

    Article  Google Scholar 

  • Visvizi A, Lytras MD, Damiani E, Mathkour H (2018) Policy making for smart cities: innovation and social inclusive economic growth for sustainability. J Sci Technol Policy Manag 9(2):126–133

    Article  Google Scholar 

  • Wang L, Zhang J, Liu P, Choo K-KR, Huang F (2017) Spectral-spatial multi-feature-based deep learning for hyperspectral remote sensing image classification. Soft Comput 21(1):213–221

    Article  Google Scholar 

  • Waseem Z, Hovy D (2016) Hateful symbols or hateful people? Predictive features for hate speech detection on twitter. In: Proceedings of the NAACL student research workshop, pp 88–93

  • Yin D, Xue Z, Hong L, Davison BD, Kontostathis A, Edwards L (2009) Detection of harassment on web 2.0. Proc Content Anal WEB 2:1–7

    Google Scholar 

  • Zhao R, Mao K (2016) Cyberbullying detection based on semantic-enhanced marginalized denoising auto-encoder. IEEE Trans Affect Comput 99:1–1

    Google Scholar 

Download references

Acknowledgements

The first author would like to acknowledge the Ministry of Electronics and Information Technology (MeitY), Government of India, for the financial support provided to her during the research work through Visvesvaraya Ph.D. Scheme for Electronics and IT.

Author information

Authors and Affiliations

  1. National Institute of Technology Patna, Patna, India

    Kirti Kumari & Jyoti Prakash Singh

  2. School of Management, Swansea University Bay Campus, Swansea, UK

    Yogesh Kumar Dwivedi

  3. School of Management, University of Bradford, Bradford, West Yorkshire, UK

    Nripendra Pratap Rana

Authors
  1. Kirti Kumari
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jyoti Prakash Singh
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Yogesh Kumar Dwivedi
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Nripendra Pratap Rana
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Kirti Kumari.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest.

Ethical approval

This article does not contain any studies with human participants or animals performed by any of the authors.

Additional information

Communicated by Miltiadis D. Lytras.

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Kumari, K., Singh, J.P., Dwivedi, Y.K. et al. Towards Cyberbullying-free social media in smart cities: a unified multi-modal approach. Soft Comput 24, 11059–11070 (2020). https://doi.org/10.1007/s00500-019-04550-x

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00500-019-04550-x

Keywords

Search

Navigation