Abstract
The automatic categorization of crime news is useful to create statistics on the type of crimes occurring in a certain area. This assignment can be treated as a text categorization problem. Several studies have shown that the use of word embeddings improves outcomes in many Natural Language Processing (NLP), including text categorization. The scope of this paper is to explore the use of word embeddings for Italian crime news text categorization. The approach followed is to compare different document pre-processing, Word2Vec models and methods to obtain word embeddings, including the extraction of bigrams and keyphrases. Then, supervised and unsupervised Machine Learning categorization algorithms have been applied and compared. In addition, the imbalance issue of the input dataset has been addressed by using Synthetic Minority Oversampling Technique (SMOTE) to oversample the elements in the minority classes. Experiments conducted on an Italian dataset of 17,500 crime news articles collected from 2011 till 2021 show very promising results. The supervised categorization has proven to be better than the unsupervised categorization, overcoming 80% both in precision and recall, reaching an accuracy of 0.86. Furthermore, lemmatization, bigrams and keyphrase extraction are not so decisive. In the end, the availability of our model on GitHub together with the code we used to extract word embeddings allows replicating our approach to other corpus either in Italian or other languages.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
Notes
- 1.
Code available at: https://github.com/SemanticFun/Word2Vec-for-text-categorization/.
- 2.
ModenaToday newspaper: https://www.modenatoday.it/.
- 3.
Gazzetta di Modena newspaper: https://gazzettadimodena.gelocal.it/modena.
- 4.
- 5.
- 6.
- 7.
References
Ghankutkar, S., Sarkar, N., Gajbhiye, P., Yadav, S., Kalbande, D., Bakereywala, N.: Modelling machine learning for analysing crime news. In: 2019 International Conference on Advances in Computing, Communication and Control (ICAC3), pp. 1–5 (2019). https://doi.org/10.1109/ICAC347590.2019.9036769
Hassan, M., Rahman, M.Z.: Crime news analysis: Location and story detection. In: 2017 20th International Conference of Computer and Information Technology (ICCIT), pp. 1–6 (2017). https://doi.org/10.1109/ICCITECHN.2017.8281798
Velásquez, D., et al.: I read the news today, oh boy: the effect of crime news coverage on crime perception and trust. In: IZA Discussion Papers 12056, Institute of Labor Economics (IZA), December 2018. https://doi.org/10.1016/j.worlddev.2020.105111, https://ideas.repec.org/p/iza/izadps/dp12056.html
Ghosh, D., Chun, S.A., Shafiq, B., Adam, N.R.: Big data-based smart city platform: Real-time crime analysis. In: Kim, Y., Liu, S.M. (eds.) Proceedings of the 17th International Digital Government Research Conference on Digital Government Research, DG.O 2016, Shanghai, China, 08–10 June 2016, pp. 58–66. ACM (2016). https://doi.org/10.1145/2912160.2912205
Chawla, N.V., Bowyer, K.W., Hall, L.O., Kegelmeyer, W.P.: SMOTE: synthetic minority over-sampling technique. J. Artif. Int. Res. 16(1), 321–357 (2002). https://doi.org/10.1613/jair.953
Bonisoli, G., Rollo, F., Po, L.: Using word embeddings for Italian crime news categorization. In: Ganzha, M., Maciaszek, L.A., Paprzycki, M., Slezak, D. (eds.) Proceedings of the 16th Conference on Computer Science and Intelligence Systems, Online, 2–5 September 2021, pp. 461–470 (2021). https://doi.org/10.15439/2021F118
Srinivasa, K., Thilagam, P.S.: Crime base: towards building a knowledge base for crime entities and their relationships from online news papers. Inf. Process. Manage. 56(6), 102059 (2019). https://doi.org/10.1016/j.ipm.2019.102059
Po, L., Rollo, F.: Building an urban theft map by analyzing newspaper crime reports. In: 2018 13th International Workshop on Semantic and Social Media Adaptation and Personalization (SMAP), pp. 13–18 (2018). https://doi.org/10.1109/SMAP.2018.8501866
Dasgupta, T., Naskar, A., Saha, R., Dey, L.: CrimeProfiler: crime information extraction and visualization from news media. In: Proceedings of the International Conference on Web Intelligence. WI 2017, pp. 541–549. Association for Computing Machinery, New York, NY, USA (2017). https://doi.org/10.1145/3106426.3106476
Rollo, F., Po, L.: Crime event localization and deduplication. In: Pan, J.Z., et al. (eds.) ISWC 2020. LNCS, vol. 12507, pp. 361–377. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-62466-8_23
Po, L., Rollo, F., Trillo Lado, R.: Topic detection in multichannel Italian newspapers. In: Calì, A., Gorgan, D., Ugarte, M. (eds.) IKC 2016. LNCS, vol. 10151, pp. 62–75. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-53640-8_6
Rollo, F.: A key-entity graph for clustering multichannel news: student research abstract. In: Seffah, A., Penzenstadler, B., Alves, C., Peng, X. (eds.) Proceedings of the Symposium on Applied Computing, SAC 2017, Marrakech, Morocco, 3–7 April 2017, pp. 699–700. ACM (2017). https://doi.org/10.1145/3019612.3019930
Bergamaschi, S., Po, L., Sorrentino, S.: Comparing topic models for a movie recommendation system. In: Monfort, V., Krempels, K. (eds.) WEBIST 2014 - Proceedings of the 10th International Conference on Web Information Systems and Technologies, vol. 2, Barcelona, Spain, 3–5 April 2014, pp. 172–183. SciTePress (2014). https://doi.org/10.5220/0004835601720183
Po, L., Malvezzi, D.: Community detection applied on big linked data. J. Univ. Comput. Sci. 24(11), 1627–1650 (2018). https://doi.org/10.3217/jucs-024-11-1627
Bracewell, D.B., Yan, J., Ren, F., Kuroiwa, S.: Category classification and topic discovery of Japanese and English news articles. Electron. Notes Theor. Comput. Sci. 225, 51–65 (2009). https://doi.org/10.1016/j.entcs.2008.12.066
Jiang, T., Li, J.P., Haq, A.U., Saboor, A., Ali, A.: A novel stacking approach for accurate detection of fake news. IEEE Access 9, 22626–22639 (2021). https://doi.org/10.1109/ACCESS.2021.3056079
Do, T.H., Berneman, M., Patro, J., Bekoulis, G., Deligiannis, N.: Context-aware deep Markov random fields for fake news detection. IEEE Access 9, 130042–130054 (2021). https://doi.org/10.1109/ACCESS.2021.3113877
Kaliyar, R.K., Goswami, A., Narang, P.: FakeBERT: fake news detection in social media with a BERT-based deep learning approach. Multimed. Tools Appl. 80(8), 11765–11788 (2021). https://doi.org/10.1007/s11042-020-10183-2
Dhar, A., Mukherjee, H., Dash, N.S., Roy, K.: Text categorization: past and present. Artif. Intell. Rev. 54(4), 3007–3054 (2020). https://doi.org/10.1007/s10462-020-09919-1
Li, Q., Peng, H., Li, J., Xia, C., Yang, R., Sun, L., Yu, P.S., He, L.: A survey on text classification: from shallow to deep learning. CoRR (2020)
Wang, C., Nulty, P., Lillis, D.: A comparative study on word embeddings in deep learning for text classification. In: Proceedings of the 4th International Conference on Natural Language Processing and Information Retrieval. NLPIR 2020, pp. 37–46. Association for Computing Machinery, New York, NY, USA (2020). https://doi.org/10.1145/3443279.3443304
Moreo, A., Esuli, A., Sebastiani, F.: Word-class embeddings for multiclass text classification. Data Mining Knowl. Disc. 35(3), 911–963 (2021). https://doi.org/10.1007/s10618-020-00735-3
Fesseha, A., Xiong, S., Emiru, E.D., Diallo, M., Dahou, A.: Text classification based on convolutional neural networks and word embedding for low-resource languages: Tigrinya. Information 12(2), 52 (2021). https://doi.org/10.3390/info12020052
Borg, A., Boldt, M., Rosander, O., Ahlstrand, J.: E-mail classification with machine learning and word embeddings for improved customer support. Neural Comput. App. 33(6), 1881–1902 (2020). https://doi.org/10.1007/s00521-020-05058-4
Christodoulou, E., Gregoriades, A., Pampaka, M., Herodotou, H.: Application of classification and word embedding techniques to evaluate tourists’ hotel-revisit intention. In: Filipe, J., Smialek, M., Brodsky, A., Hammoudi, S. (eds.) Proceedings of the 23rd International Conference on Enterprise Information Systems, ICEIS 2021, Online Streaming, 26–28 April 2021, vol. 1, pp. 216–223. SciTePress (2021). https://doi.org/10.5220/0010453502160223
Semberecki, P., Maciejewski, H.: Deep learning methods for subject text classification of articles. In: Ganzha, M., Maciaszek, L.A., Paprzycki, M. (eds.) Proceedings of the 2017 Federated Conference on Computer Science and Information Systems, FedCSIS 2017, Prague, Czech Republic, 3–6 September 2017. Annals of Computer Science and Information Systems, vol. 11, pp. 357–360 (2017). https://doi.org/10.15439/2017F414
Vita, M., KrÃz, V.: Word2vec based system for recognizing partial textual entailment. In: Ganzha, M., Maciaszek, L.A., Paprzycki, M. (eds.) Proceedings of the 2016 Federated Conference on Computer Science and Information Systems, FedCSIS 2016, GdaÅ„sk, Poland, 11–14 September 2016. IEEE Annals of Computer Science and Information Systems, vol. 8, pp. 513–516 (2016). https://doi.org/10.15439/2016F419
Lin, T.: Performance of Different Word Embeddings on Text Classification (2019). https://towardsdatascience.com/nlp-performance-of-different-word-embeddings-on-text-classification-de648c6262b. Accessed 7 June 2021
Lilleberg, J., Zhu, Y., Zhang, Y.: Support vector machines and word2vec for text classification with semantic features. In: Ge, N., et al. (eds.) 14th IEEE International Conference on Cognitive Informatics & Cognitive Computing, ICCI*CC 2015, Beijing, China, 6–8 July 2015, pp. 136–140. IEEE Computer Society (2015). https://doi.org/10.1109/ICCI-CC.2015.7259377
Mikolov, T., Chen, K., Corrado, G., Dean, J.: Efficient estimation of word representations in vector space. In: Bengio, Y., LeCun, Y. (eds.) 1st International Conference on Learning Representations, ICLR 2013, Scottsdale, Arizona, USA, 2–4 May 2013, Workshop Track Proceedings (2013). http://arxiv.org/abs/1301.3781
Bojanowski, P., Grave, E., Joulin, A., Mikolov, T.: Enriching word vectors with subword information. Trans. Assoc. Comput. Linguist. 5, 135–146 (2016). https://doi.org/10.1162/tacl_a_00051
Pennington, J., Socher, R., Manning, C.D.: Glove: global vectors for word representation. In: Moschitti, A., Pang, B., Daelemans, W. (eds.) Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing, EMNLP 2014, 25–29 October 2014, Doha, Qatar, A Meeting of SIGDAT, a Special Interest Group of The ACL, pp. 1532–1543. ACL (2014). https://doi.org/10.3115/v1/d14-1162
Kim, Y.: Convolutional neural networks for sentence classification. In: Moschitti, A., Pang, B., Daelemans, W. (eds.) Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing, EMNLP 2014, 25–29 October 2014, Doha, Qatar, A Meeting of SIGDAT, a Special Interest Group of The ACL, pp. 1746–1751. ACL (2014). https://doi.org/10.3115/v1/d14-1181
Lai, S., Xu, L., Liu, K., Zhao, J.: Recurrent convolutional neural networks for text classification. In: Bonet, B., Koenig, S. (eds.) Proceedings of the Twenty-Ninth AAAI Conference on Artificial Intelligence, 25–30 January 2015, Austin, Texas, USA, pp. 2267–2273. AAAI Press (2015). https://doi.org/10.1109/IJCNN.2019.8852406, http://www.aaai.org/ocs/index.php/AAAI/AAAI15/paper/view/9745
Zhang, X., Zhao, J.J., LeCun, Y.: Character-level convolutional networks for text classification. In: Cortes, C., Lawrence, N.D., Lee, D.D., Sugiyama, M., Garnett, R. (eds.) Advances in Neural Information Processing Systems 28: Annual Conference on Neural Information Processing Systems 2015, 7–12 December 2015, Montreal, Quebec, Canada, pp. 649–657 (2015). https://proceedings.neurips.cc/paper/2015/hash/250cf8b51c773f3f8dc8b4be867a9a02-Abstract.html
Johnson, R., Zhang, T.: Deep pyramid convolutional neural networks for text categorization. In: Barzilay, R., Kan, M. (eds.) Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics, ACL 2017, Vancouver, Canada, 30 July–4 August, Volume 1: Long Papers, pp. 562–570. Association for Computational Linguistics (2017). https://doi.org/10.18653/v1/P17-1052
Dieng, A.B., Wang, C., Gao, J., Paisley, J.W.: Topic-RNN: a recurrent neural network with long-range semantic dependency. In: 5th International Conference on Learning Representations, ICLR 2017, Toulon, France, 24–26 April 2017, Conference Track Proceedings. OpenReview.net (2017). https://openreview.net/forum?id=rJbbOLcex
Tai, K.S., Socher, R., Manning, C.D.: Improved semantic representations from tree-structured long short-term memory networks. In: Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing of the Asian Federation of Natural Language Processing, ACL 2015, 26–31 July 2015, Beijing, China, Volume 1: Long Papers, pp. 1556–1566. The Association for Computer Linguistics (2015). https://doi.org/10.3115/v1/p15-1150
Vidal, M.T., RodrÃguez, E.S., Reyes-Ortiz, J.A.: Classification of criminal news over time using bidirectional LSTM. In: Lu, Y., et al. (eds.) ICPRAI 2020. LNCS, vol. 12068, pp. 702–713. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-59830-3_61
Cheng, J., Dong, L., Lapata, M.: Long short-term memory-networks for machine reading. In: Su, J., Carreras, X., Duh, K. (eds.) Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, EMNLP 2016, Austin, Texas, USA, 1–4 November 2016, pp. 551–561. The Association for Computational Linguistics (2016). https://doi.org/10.18653/v1/d16-1053
Devlin, J., Chang, M., Lee, K., Toutanova, K.: BERT: pre-training of deep bidirectional transformers for language understanding. In: Burstein, J., Doran, C., Solorio, T. (eds.) Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, NAACL-HLT 2019, Minneapolis, MN, USA, 2–7 June 2019, Volume 1 (Long and Short Papers), pp. 4171–4186. Association for Computational Linguistics (2019). https://doi.org/10.18653/v1/n19-1423
Yang, Z., Dai, Z., Yang, Y., Carbonell, J.G., Salakhutdinov, R., Le, Q.V.: Xlnet: Generalized autoregressive pretraining for language understanding. In: Wallach, H.M., Larochelle, H., Beygelzimer, A., d’Alché-Buc, F., Fox, E.B., Garnett, R. (eds.) Advances in Neural Information Processing Systems 32: Annual Conference on Neural Information Processing Systems 2019, NeurIPS 2019, 8–14 December 2019, Vancouver, BC, Canada, pp. 5754–5764 (2019). https://proceedings.neurips.cc/paper/2019/hash/dc6a7e655d7e5840e66733e9ee67cc69-Abstract.html
Sanwaliya, A., Shanker, K., Misra, S.C.: Categorization of news articles: a model based on discriminative term extraction method. In: Laux, F., Strömbäck, L. (eds.) The Second International Conference on Advances in Databases, Knowledge, and Data Applications, DBKDA 2010, Menuires, France, 11–16 April 2010, pp. 149–154. IEEE Computer Society (2010). https://doi.org/10.1109/DBKDA.2010.18
Tahrawi, M.: Arabic text categorization using logistic regression. Int. J. Intell. Syst. App. 7, 71–78 (2015). https://doi.org/10.5815/ijisa.2015.06.08
Wongso, R., Luwinda, F.A., Trisnajaya, B.C., Rusli, O., Rudy: News article text classification in Indonesian language. In: ICCSCI, pp. 137–143 (2017). https://doi.org/10.1016/j.procs.2017.10.039
Totis, P., Stede, M.: Classifying Italian newspaper text: news or editorial? In: Cabrio, E., Mazzei, A., Tamburini, F. (eds.) Proceedings of the Fifth Italian Conference on Computational Linguistics (CLiC-it 2018), Torino, Italy, 10–12 December 2018. CEUR Workshop Proceedings, vol. 2253 (2018). https://doi.org/10.4000/books.aaccademia.3645,http://ceur-ws.org/Vol-2253/paper02.pdf
Camastra, F., Razi, G.: Italian text categorization with lemmatization and support vector machines. In: Esposito, A., Faundez-Zanuy, M., Morabito, F.C., Pasero, E. (eds.) Neural Approaches to Dynamics of Signal Exchanges. SIST, vol. 151, pp. 47–54. Springer, Singapore (2020). https://doi.org/10.1007/978-981-13-8950-4_5
Bondielli, A., Ducange, P., Marcelloni, F.: Exploiting categorization of online news for profiling city areas. In: 2020 IEEE Conference on Evolving and Adaptive Intelligent Systems, EAIS 2020, Bari, Italy, 27–29 May 2020, pp. 1–8. IEEE (2020). https://doi.org/10.1109/EAIS48028.2020.9122777
Bai, Y., Wang, J.: News classifications with labeled LDA. In: Fred, A.L.N., Dietz, J.L.G., Aveiro, D., Liu, K., Filipe, J. (eds.) KDIR 2015 - Proceedings of the International Conference on Knowledge Discovery and Information Retrieval, Part of the 7th International Joint Conference on Knowledge Discovery, Knowledge Engineering and Knowledge Management (IC3K 2015), vol. 1, Lisbon, Portugal, 12–14 November 2015, pp. 75–83. SciTePress (2015). https://doi.org/10.5220/0005610600750083
Li, Z., Shang, W., Yan, M.: News text classification model based on topic model. In: 15th IEEE/ACIS International Conference on Computer and Information Science, ICIS 2016, Okayama, Japan, 26–29 June 2016, pp. 1–5. IEEE Computer Society (2016). https://doi.org/10.1109/ICIS.2016.7550929
He, C., Hu, Y., Zhou, A., Tan, Z., Zhang, C., Ge, B.: A web news classification method: fusion noise filtering and convolutional neural network. In: SSPS 2020: 2020 2nd Symposium on Signal Processing Systems, Guangdong China, July 2020, pp. 80–85. ACM (2020). https://doi.org/10.1145/3421515.3421523
Zhu, Y.: Research on news text classification based on deep learning convolutional neural network. Wirel. Commun. Mob. Comput. 2021, 1–6 (2021). https://doi.org/10.1155/2021/1508150
Duan, J., Zhao, H., Qin, W., Qiu, M., Liu, M.: News text classification based on MLCNN and BiGRU hybrid neural network. In: 3rd International Conference on Smart BlockChain, SmartBlock 2020, Zhengzhou, China, 23–25 October 2020, pp. 137–142. IEEE (2020). https://doi.org/10.1109/SmartBlock52591.2020.00032
Kim, D., Koo, J., Kim, U.: EnvBERT: multi-label text classification for imbalanced, noisy environmental news data. In: Lee, S., Choo, H., Ismail, R. (eds.) 15th International Conference on Ubiquitous Information Management and Communication, IMCOM 2021, Seoul, South Korea, 4–6 January 2021, pp. 1–8. IEEE (2021). https://doi.org/10.1109/IMCOM51814.2021.9377411
Nugroho, K.S., Sukmadewa, A.Y., Yudistira, N.: Large-scale news classification using BERT language model: spark NLP approach. In: 6th International Conference on Sustainable Information Engineering and Technology 2021. SIET 2021, pp. 240–246. Association for Computing Machinery, New York, NY, USA (2021). https://doi.org/10.1145/3479645.3479658
Thaipisutikul, T., Tuarob, S., Pongpaichet, S., Amornvatcharapong, A., Shih, T.K.: Automated classification of criminal and violent activities in Thailand from online news articles. In: 13th International Conference on Knowledge and Smart Technology, KST 2021, Bangsaen, Chonburi, Thailand, 21–24 January 2021, pp. 170–175. IEEE (2021). https://doi.org/10.1109/KST51265.2021.9415789
Mikolov, T., Sutskever, I., Chen, K., Corrado, G.S., Dean, J.: Distributed representations of words and phrases and their compositionality. In: Burges, C.J.C., Bottou, L., Ghahramani, Z., Weinberger, K.Q. (eds.) Advances in Neural Information Processing Systems 26: 27th Annual Conference on Neural Information Processing Systems 2013. Proceedings of a Meeting Held 5–8 December 2013, Lake Tahoe, Nevada, United States, pp. 3111–3119 (2013). https://proceedings.neurips.cc/paper/2013/hash/9aa42b31882ec039965f3c4923ce901b-Abstract.html
Rose, S., Engel, D., Cramer, N., Cowley, W.: 1. Automatic Keyword Extraction from Individual Documents, pp. 1–20. John Wiley & Sons Ltd., Hoboken (2010). https://doi.org/10.1002/9780470689646.ch1, https://onlinelibrary.wiley.com/doi/abs/10.1002/9780470689646.ch1
Kumar, L., Kumar, M., Neti, L.B.M., Misra, S., Kocher, V., Padmanabhuni, S.: An empirical study on application of word embedding techniques for prediction of software defect severity level. In: Ganzha, M., Maciaszek, L.A., Paprzycki, M., Slezak, D. (eds.) Proceedings of the 16th Conference on Computer Science and Intelligence Systems, Online, 2–5 September 2021, pp. 477–484 (2021). https://doi.org/10.15439/2021F100
Di Gennaro, G., Buonanno, A., Di Girolamo, A., Ospedale, A., Palmieri, F.A.N., Fedele, G.: An analysis of word2vec for the Italian language. In: Esposito, A., Faundez-Zanuy, M., Morabito, F.C., Pasero, E. (eds.) Progresses in Artificial Intelligence and Neural Systems. SIST, vol. 184, pp. 137–146. Springer, Singapore (2021). https://doi.org/10.1007/978-981-15-5093-5_13
Rousseeuw, P.J.: Silhouettes: a graphical aid to the interpretation and validation of cluster analysis. J. Comput. Appl. Math. 20, 53–65 (1987). https://doi.org/10.1016/0377-0427(87)90125-7
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 Springer Nature Switzerland AG
About this paper
Cite this paper
Rollo, F., Bonisoli, G., Po, L. (2022). Supervised and Unsupervised Categorization of an Imbalanced Italian Crime News Dataset. In: Ziemba, E., Chmielarz, W. (eds) Information Technology for Management: Business and Social Issues. FedCSIS-AIST ISM 2021 2021. Lecture Notes in Business Information Processing, vol 442. Springer, Cham. https://doi.org/10.1007/978-3-030-98997-2_6
Download citation
DOI: https://doi.org/10.1007/978-3-030-98997-2_6
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-98996-5
Online ISBN: 978-3-030-98997-2
eBook Packages: Computer ScienceComputer Science (R0)