Abstract
Information overload reduces the capability of machines to find relevant information. Furthermore, when dynamic topics or emerging events occur that arouse the interest of the community, unofficial or unreliable sources of information quickly emerge that, instead of satisfying the information needs of users, increase misinformation. To address this issue, this paper proposes a method to create domain-specific corpora of text that can offer immediate answers on a particular topic. The approach involves creating a vocabulary of the domain and then creating a textual corpus from Wikipedia pages related to the different terms of the domain. The authors tested this method by creating a specialized corpus for the pollution domain and implementing a process to answer queries about the domain. Preliminary results show that the Q &A system could provide accurate and up-to-date information on the topic, based on Wikipedia, a free-content platform that users continuously feed.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Almotairi, M., Fkih, F.: A review on question answering systems: Domains, modules, techniques and challenges. In: 38th International Business Information Management Association (IBIMA) (11 2021)
Azerkovich, I.: Employing Wikipedia data for coreference resolution in Russian. In: Filchenkov, A., Pivovarova, L., Žižka, J. (eds.) Artificial Intelligence and Natural Language, pp. 107–112. Springer International Publishing, Cham (2018)
Chen, D., Fisch, A., Weston, J., Bordes, A.: Reading wikipedia to answer open-domain questions. In: Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (ACL), vol. 1, pp. 1870–1879. ACM (Mar 2017)
Chicaiza, J., Bouayad-Agha, N.: Enabling a question-answering system for COVID using a hybrid approach based on wikipedia and Q/A Pairs. In: Nagar, A.K., Jat, D.S., Marín-Raventós, G., Mishra, D.K. (eds.) Intelligent Sustainable Systems, pp. 251–261. Springer Nature Singapore, Singapore (2022)
Chicaiza, J., Piedra, N., Lopez-Vargas, J., Tovar-Caro, E.: Domain categorization of open educational resources based on linked data. In: Klinov, P., Mouromtsev, D. (eds.) Knowledge Engineering and the Semantic Web, pp. 15–28. Springer International Publishing, Cham (2014)
Deckelmann, S.: Wikipedia’s value in the age of generative ai. Tech. rep., Wikimedia (Jul 2023). https://wikimediafoundation.org/news/2023/07/12/wikipedias-value-in-the-age-of-generative-ai/
Frąckiewicz, M.: The importance of data quality in nlp. Tech. rep., TS2-Space (May 2023). https://ts2.space/en/the-importance-of-data-quality-in-nlp/
Han-Joon, K., Jiyun, K., Jinseog, K., Pureum, L.: Towards perfect text classification with wikipedia-based semantic naïve bayes learning. Neurocomputing 315, 128–134 (2018). https://doi.org/10.1016/j.neucom.2018.07.002
Jemielniak, D.: Wikipedia: Why is the common knowledge resource still neglected by academics? Gigascience 8(12) (2019)
Kia, M.A., Garifullina, A., Kern, M., Chamberlain, J., Jameel, S.: Adaptable closed-domain question answering using contextualized CNN-attention models and question expansion. IEEE Access 10, 45080–45092 (2022). https://doi.org/10.1109/ACCESS.2022.3170466
Krishnan, A., Ziehe, S., Pannach, F., Sporleder, C.: Employing Wikipedia as a resource for named entity recognition in morphologically complex under-resourced languages. In: Proceedings of the 14th Workshop on Building and Using Comparable Corpora (BUCC 2021), pp. 28–39. INCOMA Ltd. (Sep 2021)
Lee, M.: A mathematical investigation of hallucination and creativity in gpt models. Mathematics 11(10) (2023). https://doi.org/10.3390/math11102320
Lymperopoulos, P., Qiu, H., Min, B.: Concept Wikification for COVID-19. In: Proceedings of The 2020 Conference on Empirical Methods in Natural Language Processing (Aug 2020)
Manning, C.D., Raghavan, P., Schütze, H.: Introduction to information retrieval. Cambridge University Press (2008). https://doi.org/10.1017/CBO9780511809071
Mernyei, P., Cangea, C.: Wiki-CS: A Wikipedia-Based Benchmark for Graph Neural Networks. arXiv e-prints (Jul 2020). https://doi.org/10.48550/arXiv.2007.02901
Neelima, A., Mehrotra, S.: A comprehensive review on word embedding techniques, pp. 538–543 (2023). https://doi.org/10.1109/ICISCoIS56541.2023.10100347
Peng, B., et al.: Check your facts and try again: Improving large language models with external knowledge and automated feedback (Feb 2023). https://doi.org/10.48550/arXiv.2302.12813
Rodriguez-Ferreira, T., Rabadán, A., Hervás, R., Díaz, A.: Improving information extraction from wikipedia texts using basic english. In: International Conference on Language Resources and Evaluation (2016)
Sankarasubramaniam, Y., Ramanathan, K., Ghosh, S.: Text summarization using wikipedia. Inform. Process. Manage. 50(3), 443–461 (2014). https://doi.org/10.1016/j.ipm.2014.02.001
Steiner, T., Verborgh, R.: Disaster Monitoring with Wikipedia and Online Social Networking Sites: Structured Data and Linked Data Fragments to the Rescue? (Jan 2015)
Sugandhika, C., Ahangama, S.: Assessing information quality of wikipedia articles through google’s e-a-t model. IEEE Access 10, 52196–52209 (2022). https://doi.org/10.1109/ACCESS.2022.3172962
Wu, F., Weld, D.S.: Open information extraction using wikipedia. In: Proceedings of the 48th Annual Meeting of the Association for Computational Linguistics, pp. 118–127. ACL ’10, Association for Computational Linguistics, USA (2010)
Acknowledgements
The authors would like to thank the Universidad Técnica Particular de Loja for sponsoring this research. The work is supported by the project PROY_PROY_ARTIC_CE_2022_3693.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2024 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Chicaiza, J., Martínez-Velásquez, M., Soto-Coronel, F., Bouayad-Agha, N. (2024). Creating Textual Corpora Based on Wikipedia and Knowledge Graphs. In: Rocha, Á., Adeli, H., Dzemyda, G., Moreira, F., Poniszewska-Marańda, A. (eds) Good Practices and New Perspectives in Information Systems and Technologies. WorldCIST 2024. Lecture Notes in Networks and Systems, vol 987. Springer, Cham. https://doi.org/10.1007/978-3-031-60221-4_32
Download citation
DOI: https://doi.org/10.1007/978-3-031-60221-4_32
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-60220-7
Online ISBN: 978-3-031-60221-4
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)