Skip to main content
SpringerLink
Log in

The joint knowledge reasoning model based on knowledge representation learning for aviation assembly domain

  • Article
  • Published:
Science China Technological Sciences Aims and scope Submit manuscript

Abstract

Knowledge graph technology is widely applied in the domain of general knowledge reasoning with an excellent performance. For fine-grained professional fields, professional knowledge graphs can provide more accurate information in practical industrial scenarios. Based on an aviation assembly domain-specific knowledge graph, the article constructs a joint knowledge reasoning model, which combines a named entity recognition model and a subgraph embedding learning model. When performing knowledge reasoning tasks, the two models vectorize entities, relationships and entity attributes in the same space, so as to share parameters and optimize learning efficiency. The knowledge reasoning model, which provides intelligent question answering services, is able to reduce the assembly error rate and improve the assembly efficiency. The system can accurately solve general knowledge reasoning problems in the assembly process in actual industrial scenarios of general assembly and component assembly under interference-free conditions. Finally, this paper compares the proposed knowledge reasoning model based on knowledge representation learning and the question-answering system based on large-scale pre-trained models. In the application scenario of system functional testing in general assembly, the joint model attains an accuracy rate of 95%, outperforming GPT with 78% accuracy and enhanced representation through knowledge integration with 71% accuracy.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

References

  1. Wu J, Wang J, You Z. An overview of dynamic parameter identification of robots. Robot Comput-Integ Manuf, 2010, 26: 414–419

    Article  Google Scholar 

  2. Huang W, Wang C, Zhang R, et al. Voxposer: Composable 3D value maps for robotic manipulation with language models. arXiv: 2307.05973

  3. Wu J, Wang X, Zhang B, et al. Multi-objective optimal design of a novel 6-DOF spray-painting robot. Robotica, 2021, 39: 2268–2282

    Article  Google Scholar 

  4. Xu X, Xiong H, Wang Y, et al. Knowledge-enhanced semantic communication system with OFDM transmissions. Sci China Inf Sci, 2023, 66: 172302

    Article  MathSciNet  Google Scholar 

  5. Ji S, Pan S, Cambria E, et al. A survey on knowledge graphs: Representation, acquisition, and applications. IEEE Trans Neural Netw Learn Syst, 2022, 33: 494–514

    Article  MathSciNet  Google Scholar 

  6. Liu K. A survey on neural relation extraction. Sci China Tech Sci, 2020, 63: 1971–1989

    Article  Google Scholar 

  7. Tian L, Zhou X, Wu Y P, et al. Knowledge graph and knowledge reasoning: A systematic review. J Electron Sci Tech, 2022, 20: 100159

    Article  Google Scholar 

  8. Chen X, Jia S, Xiang Y. A review: Knowledge reasoning over knowledge graph. Expert Syst Appl, 2020, 141: 112948

    Article  Google Scholar 

  9. Xie Z, Zeng Z, Zhou G, et al. Topic enhanced deep structured semantic models for knowledge base question answering. Sci China Inf Sci, 2017, 60: 110103

    Article  Google Scholar 

  10. Zhang B, Zhu J, Su H. Toward the third generation artificial intelligence. Sci China Inf Sci, 2023, 66: 121101

    Article  MathSciNet  Google Scholar 

  11. Qiu X P, Sun T X, Xu Y G, et al. Pre-trained models for natural language processing: A survey. Sci China Tech Sci, 2020, 63: 1872–1897

    Article  Google Scholar 

  12. Radford A, Narasimhan K, Salimans T, et al. Improving language understanding by generative pre-training. Technical Report. OpenAI, 2018

  13. Sun Y, Wang S, Feng S, et al. ERNIE 3.0: Large-scale knowledge enhanced pre-training for language understanding and generation. arXiv: 2107.02137

  14. Liu Y, Ding L, Yang Z W, et al. Domain knowledge discovery from abstracts of scientific literature on Nickel-based single crystal superalloys. Sci China Tech Sci, 2023, 66: 1815–1830

    Article  Google Scholar 

  15. Turing A M. Computing machinery and intelligence. Mind, 1950, 59: 433–460

    Article  MathSciNet  Google Scholar 

  16. Etzioni O. Search needs a shake-up. Nature, 2011, 476: 25–26

    Article  Google Scholar 

  17. Berant J, Chou A, Frostig R, et al. Semantic parsing on freebase from question-answer pairs. In: Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing. Seattle: Association for Computational Linguistics, 2013. 1533–1544

    Google Scholar 

  18. Bordes A, Usunier N, Garcia-Durán A, et al. Translating embeddings for modeling multi-relational data. In: Proceedings of the 26th International Conference on Neural Information Processing Systems. New York: Curran Associates Inc., 2013. 2787–2795

    Google Scholar 

  19. Reddy S, Lapata M, Steedman M. Large-scale semantic parsing without question-answer pairs. Trans Assoc Comput Linguist, 2014, 2: 377–392

    Article  Google Scholar 

  20. Steedman M. Surface Structure and Interpretation. Cambridge, Massachusetts: The MIT Press, 1996. 271–276

    Google Scholar 

  21. Li D, Mirella L. Language to logical form with neural attention. arXiv: 1601.01280

  22. Jia R, Liang P. Data recombination for neural semantic parsing. In: Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). Berlin: Association for Computational Linguistics, 2016. 06: 12–22

    Google Scholar 

  23. Bordes A, Usunier N, Garcia-Duran A, et al. Translating embeddings for modeling multi-relational data. In: Proceedings of the 26th International Conference on Neural Information Processing Systems. New York: Curran Associates Inc., 2013

    Google Scholar 

  24. Socher R, Chen D, Manning C D, et al. Reasoning with neural tensor networks for knowledge base completion. In: Proceedings of the 26th International Conference on Neural Information Processing Systems. New York: Curran Associates Inc., 2013

    Google Scholar 

  25. Socher R, Perelygin A, Wu J Y, et al. Recursive deep models for semantic compositionality over a sentiment treebank. In: Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing. Seattle: Association for Computational Linguistics, 2013

    Google Scholar 

  26. Keramatfar A, Rafiee M, Amirkhani H. Graph neural networks: A bibliometrics overview. Machine Learn Appl, 2022, 10: 100401

    Google Scholar 

  27. Li X, Sun L, Ling M, et al. A survey of graph neural network based recommendation in social networks. Neurocomputing, 2023, 549: 126441

    Article  Google Scholar 

  28. Ji B, Li S, Xu H, et al. Span-based joint entity and relation extraction augmented with sequence tagging mechanism. Sci China Inf Sci, 2022, doi: https://doi.org/10.1007/s11432-022-3608-y

  29. Bordes A, Chopra S, Weston J. Question answering with subgraph em-beddings. In: Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP). Doha: Association for Computational Linguistics, 2014. 615–620

    Google Scholar 

  30. Sutton C. An introduction to conditional random fields. FNT Machine Learn, 2012, 4: 267–373

    Article  Google Scholar 

  31. Hammerton J. Named entity recognition with long short-term memory. In: Proceedings of the Seventh Conference on Natural Language Learning at HLT-NAACL 2003. Edmonton: Association for Computational Linguistics, 2003

    Book  Google Scholar 

  32. Lample G, Ballesteros M, Subramanian S, et al. Neural architectures for named entity recognition. arXiv: 1603.01360

  33. Bordes A, Chopra S, Weston J. Question answering with subgraph embeddings. In: Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing, EMNLP. Doha: Association for Computational Linguistics, 2014. 615–620

    Google Scholar 

  34. Bordes A, Weston J, Usunier N. Open question answering with weakly supervised embedding models. In: Proceedings of the 2014th European Conference on Machine Learning and Knowledge Discovery in Databases. Berlin, Heidelberg: Springer-Verlag, 2014

    Book  Google Scholar 

  35. Hao Y, Liu H, He S, et al. Pattern-revising enhanced simple question answering over knowledge bases. In: Proceedings of the 27th International Conference on Computational Linguistics. New Mexico: Association for Computational Linguistics, 2018

    Google Scholar 

  36. Zhang R, Wang Y, Mao Y, et al. Question answering in knowledge bases. ACM Trans Inf Syst, 2019, 37: 1–26

    Google Scholar 

  37. Dubey M, Banerjee D, Chaudhuri D, et al. Earl: Joint entity and relation linking for question answering over knowledge graphs. In: Proceedings of the the Semantic Web-ISWC 2018. Cham: Springe, 2018

    Google Scholar 

  38. Liu P, Qian L, Zhao X, et al. The construction of knowledge graphs in the aviation assembly domain based on a joint knowledge extraction model. IEEE Access, 2023, 11: 26483–26495

    Article  Google Scholar 

  39. Editorial Board of the Aviation Manufacturing Engineering Manual. Aviation Manufacturing Engineering Manual: Aircraft Assembly. Beijing: Aviation Industry Press, 2010

    Google Scholar 

  40. Cai Q, Yates A. Large-scale semantic parsing via schema matching and lexicon extension. In: Proceedings of the 51st Annual Meeting of the Association for Computational Linguistics (ACL 2013). Sofia: Association for Computational Linguistics, 2013. 423–433

    Google Scholar 

  41. Bollacker K, Evans C, Paritosh P, et al. Freebase: A collaboratively created graph database for structuring human knowledge. In: Proceedings of the 2008 ACM SIGMOD International Conference on Management of Data. New York: Association for Computing Machinery, 2008

    Book  Google Scholar 

  42. Usbeck R, Ngomo A C N, Haarmann B, et al. 7th Open Challenge on Question Answering over Linked Data (Qald-7). In: Semantic Web Challenges. Cham: Springer International Publishing, 2017

    Book  Google Scholar 

  43. Bizer C, Lehmann J, Kobilarov G, et al. DBpedia—A crystallization point for the Web of Data. J Web Semantics, 2009, 7: 154–165

    Article  Google Scholar 

  44. Camastra F, Vinciarelli A. Markovian Models for Sequential Data. London: Springer, 2008. 265–303

    Google Scholar 

  45. Goyal A, Gupta V, Kumar M. Recent named entity recognition and classification techniques: A systematic review. Comput Sci Rev, 2018, 29: 21–43

    Article  Google Scholar 

  46. Niu F, Recht B, Re C, et al. Hogwild!: A lock-free approach to parallelizing stochastic gradient descent. In: Proceedings of the 24th International Conference on Neural Information Processing Systems. Granada, 2011. 24: 693–701

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. State Key Laboratory of Digital Manufacturing Equipment and Technology, Department of Mechanical, Huazhong University of Science and Technology, Wuhan, 430074, China

    PeiFeng Liu, XingWei Zhao & Bo Tao

  2. School of Transportation and Logistics Engineering, Wuhan University of Technology (WHUT), Wuhan, 430063, China

    Lu Qian

  3. Shanghai Aircraft Manufacturing Co., Ltd., Shanghai, 201324, China

    Hu Lu & Lei Xue

Authors
  1. PeiFeng Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Lu Qian
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Hu Lu
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Lei Xue
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. XingWei Zhao
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Bo Tao
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to XingWei Zhao.

Additional information

This work was supported by the National Natural Science Foundation of China (Grant Nos. 52275020, 62293514, and 91948301).

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Liu, P., Qian, L., Lu, H. et al. The joint knowledge reasoning model based on knowledge representation learning for aviation assembly domain. Sci. China Technol. Sci. 67, 143–156 (2024). https://doi.org/10.1007/s11431-023-2506-4

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11431-023-2506-4

Search

Navigation