Skip to main content
Log in

Joint entity–relation knowledge embedding via cost-sensitive learning

  • Published:
Frontiers of Information Technology & Electronic Engineering Aims and scope Submit manuscript

Abstract

As a joint-optimization problem which simultaneously fulfills two different but correlated embedding tasks (i.e., entity embedding and relation embedding), knowledge embedding problem is solved in a joint embedding scheme. In this embedding scheme, we design a joint compatibility scoring function to quantitatively evaluate the relational facts with respect to entities and relations, and further incorporate the scoring function into the max-margin structure learning process that explicitly learns the embedding vectors of entities and relations using the context information of the knowledge base. By optimizing the joint problem, our design is capable of effectively capturing the intrinsic topological structures in the learned embedding spaces. Experimental results demonstrate the effectiveness of our embedding scheme in characterizing the semantic correlations among different relation units, and in relation prediction for knowledge inference.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  • Bollacker, K., Evans, C., Paritosh, P., et al., 2008. Freebase: a collaboratively created graph database for structuring human knowledge. Proc. Int. Conf. on ACM SIGMOD Management of Data, p.1247–1250. https://doi.org/10.1145/1376616.1376746

    Google Scholar 

  • Bordes, A., Weston, J., Collobert, R., et al., 2011. Learning structured embeddings of knowledge bases. Proc. Comput. Sci., 108: 345–354. https://doi.org/10.1016/j.procs.2017.05.045

    Google Scholar 

  • Bordes, A., Usunier, N., Garcia-Duran, A., et al., 2013. Translating embeddings for modeling multi-relational data. NIPS, p.2787–2795.

    Google Scholar 

  • Bordes, A., Glorot, X., Weston, J., et al., 2014. A semantic matching energy function for learning with multirelational data. Mach. Learn., 94(2): 233–259. https://doi.org/10.1007/s10994-013-5363-6

    Article  MathSciNet  Google Scholar 

  • Chang, K.W., Yih, W.T., Meek, C., 2013. Multi-relational latent semantic analysis. Proc. Conf. on Empirical Methods in Natural Language Processing, p.1602–1612.

    Google Scholar 

  • Duchi, J., Hazan, E., Singer, Y., 2011. Adaptive subgradient methods for online learning and stochastic optimization. J. Mach. Learn. Res., 12: 2121–2159.

    MathSciNet  MATH  Google Scholar 

  • Elisseeff, A., Weston, J., 2001. A kernel method for multilabelled classification. NIPS, p.681–687.

    Google Scholar 

  • García-Durán, A., Bordes, A., Usunier, N., 2015. Composing Relationships with Translations. Technical Report No. hal-01167811, CNRS-Heudiasyc, Compiègne.

    Book  Google Scholar 

  • Getoor, L., Mihalkova, L., 2011. Learning statistical models from relational data. Proc. Int. Conf. on ACM SIGMOD Management of Data, p.1195–1198. https://doi.org/10.1145/1989323.1989451

    Google Scholar 

  • Hoffmann, R., Zhang, C., Ling, X., et al., 2011. Knowledgebased weak supervision for information extraction of overlapping relations. Proc. 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies, p.541–550.

    Google Scholar 

  • Jenatton, R., Roux, N.L., Bordes, A., et al., 2012. A latent factor model for highly multi-relational data. NIPS, p.3167–3175.

    Google Scholar 

  • Lin, Y.K., Liu, Z.Y., Luan, H.B., et al., 2015. Modeling relation paths for representation learning of knowledge bases. arXiv: 1506.00379. http://arxiv.org/abs/1506.00379

    Book  Google Scholar 

  • Maaten, L.V.D., Hinton, G., 2008. Visualizing data using t-SNE. J. Mach. Learn. Res., 9: 2579–2605.

    MATH  Google Scholar 

  • Miller, G.A., 1995. WordNet: a lexical database for English. Commun. ACM, 38(11): 39–41. https://doi.org/10.1145/219717.219748

    Article  Google Scholar 

  • Nickel, M., Tresp, V., Kriegel, H.P., 2011. A three-way model for collective learning on multi-relational data. Proc. 28th Int. Conf. on Machine Learning, p.809–816.

    Google Scholar 

  • Singhal, A., 2012. Introducing the Knowledge Graph: Things, not Strings. Google. https://21stcenturylibrary.com/2012/05/21/introducinggoogles-knowledge-graph-things-not-strings [Accessed on May 21, 2012].

    Google Scholar 

  • Socher, R., Chen, D., Manning, C.D., et al., 2013. Reasoning with neural tensor networks for knowledge base completion. NIPS, p.926–934.

    Google Scholar 

  • Wang, Z., Zhang, J.W., Feng, J.L., et al., 2014. Knowledge graph embedding by translating on hyperplanes. Proc. 28th Conf. on Artificial Intelligence, p.1112–1119.

    Google Scholar 

  • Waters, R., 2012. Google to unveil search results overhaul. Financial Times, May.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Zhong-fei Zhang.

Additional information

Project supported by the National Basic Research Program (973) of China (No. 2015CB352302) and the National Natural Science Foundation of China (Nos. U1509206 and 61472353)

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Yu, Sk., Zhao, Xy., Li, X. et al. Joint entity–relation knowledge embedding via cost-sensitive learning. Frontiers Inf Technol Electronic Eng 18, 1867–1873 (2017). https://doi.org/10.1631/FITEE.1601255

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1631/FITEE.1601255

Key words

CLC number

Navigation