Abstract
This paper extracted the entity relation from unstructured text in the industrial robot prognostics and health management (PHM) data for the construction of a knowledge graph. Traditionally, there is a disadvantage of error propagation in the pipeline method. At the same time, the industrial robot PHM corpus has a relation overlap problem, which reduces the accuracy of relations extraction. To solve this problem, we proposed a joint entity relations extraction model combining BiLSTM-CRF and multi-head selection. In this model, the encoding layer is shared by entity extraction tasks and relations extraction tasks. Moreover, BiLSTM-CRF is introduced for named entity recognition tasks, and the entity recognition information is utilized by the multi-head selection structure to solve the problem of overlapping relations. The results show that the model can effectively extract the entity relations of unstructured text in the robot PHM data, and the overall F1-score for entity relations extraction reaches 87.64. It is an increase of 2.92% and 13.5%, compared with the BiLSTM-ED-CNN model and the pipeline method using the same model.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Bekoulis, G., Deleu, J., Demeester, T., Develder, C.: Joint entity recognition and relation extraction as a multi-head selection problem. Expert Syst. Appl. 114 (2018)
Sun, C.: Joint entity relation extraction with deep learning. East China Normal University (2019). (in Chinese)
Jie, Y., Yue, Z., Linwei, L., Xingxuan, L.: YEDDA: a lightweight collaborative text span annotation tool. In: Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (2018)
Suncong, Z., Yuexing, H., Dongyuan, L., et al.: Joint entity and relation extraction based on a hybrid neural network. Neurocomputing 257(9), 59–66 (2017)
Miwa, M., Bansal, M.: End-to-end relation extraction using LSTMs on sequences and tree structures. In: Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics 2016, pp. 1105–1116 (2016)
Lample, G., Ballesteros, M., Subramanian, S., Kawakami, K.: ChrisDyer: Neural Architectures for Named Entity Recognition. HLT-NAACL 2016, pp. 260–270 (2016)
Suncong, Z., Feng, W., Hongyun, B., et al.: Joint extraction of entities and relations based on a novel tagging scheme. In: Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics 2017, pp. 1227–1236 (2017)
Lafferty, J., McCallum, A., Pereira, F.C.N.: Conditional randomfields: probabilistic models for segmenting and labeling sequence data (2001)
Yang, Y.J., Xu, B., Hu, J.W., Tong, M.H., Zhang, P., Zheng, L.: Accurate and efficient method for constructing domain knowledge graph. Ruan Jian Xue Bao/J. Softw. 29(10), 2931–2947 (2018). (in Chinese)
Cowie, J., Lehnert, W.: Information extraction. Commun. ACM 39(1), 80–91 (1996)
Mikolov, T., Chen, K., Corrado, G., et al.: Efficient Estimation of Word Representations in Vector Space. Comput. Sci. (2013)
Abadi, M., Barham, P., Chen, J., et al.: TensorFlow: a system for large-scale machine learning. In: 12th {USENIX} symposium on operating systems design and implementation ({OSDI} 16) 2016, pp. 265–283 (2016)
Kingma, D.P., Ba, J.: Adam: a method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014)
Zhou, P., Shi, W., Tian, J., et al.: Attention-based bidirectional long short-term memory networks for relation classification. In: Proceedings of the 54th annual meeting of the association for computational linguistics, vol. 2: Short papers 2016, pp. 207–212 (2016)
Zhiheng, H., Xu, W., Yu, K.: Bidirectional LSTM-CRF models for sequence tagging. arXiv preprint arXiv:1508.01991Â (2015)
Acknowledgement
This paper is supported by the Key Technology Project of Foshan City in 2019 (1920001001367), National Natural Science and Guangdong Joint Fund Project (U2001201), Guangdong Natural Science Fund Project (2018A030313061, 2021A1515011243), Research and Development Projects of National Key fields (2018YFB1004202), Guangdong Science and Technology Plan Project (2019B010139001) and Guangzhou Science and Technology Plan Project (201902020016).
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Lin, S., Xiao, H., Liu, S., Jiang, W., Xiong, M., He, Z. (2021). Enity Relation Extraction of Industrial Robot PHM Based on BiLSTM-CRF and Multi-head Selection. In: Tan, Y., Shi, Y., Zomaya, A., Yan, H., Cai, J. (eds) Data Mining and Big Data. DMBD 2021. Communications in Computer and Information Science, vol 1453. Springer, Singapore. https://doi.org/10.1007/978-981-16-7476-1_19
Download citation
DOI: https://doi.org/10.1007/978-981-16-7476-1_19
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-16-7475-4
Online ISBN: 978-981-16-7476-1
eBook Packages: Computer ScienceComputer Science (R0)