Skip to main content

Report on the First Knowledge Graph Reasoning Challenge 2018

Toward the eXplainable AI System

  • Conference paper
  • First Online:
Semantic Technology (JIST 2019)

Abstract

A new challenge for knowledge graph reasoning started in 2018. Deep learning has promoted the application of artificial intelligence (AI) techniques to a wide variety of social problems. Accordingly, being able to explain the reason for an AI decision is becoming important to ensure the secure and safe use of AI techniques. Thus, we, the Special Interest Group on Semantic Web and Ontology of the Japanese Society for AI, organized a challenge calling for techniques that reason and/or estimate which characters are criminals while providing a reasonable explanation based on an open knowledge graph of a well-known Sherlock Holmes mystery story. This paper presents a summary report of the first challenge held in 2018, including the knowledge graph construction, the techniques proposed for reasoning and/or estimation, the evaluation metrics, and the results. The first prize went to an approach that formalized the problem as a constraint satisfaction problem and solved it using a lightweight formal method; the second prize went to an approach that used SPARQL and rules; the best resource prize went to a submission that constructed word embedding of characters from all sentences of Sherlock Holmes novels; and the best idea prize went to a discussion multi-agents model. We conclude this paper with the plans and issues for the next challenge in 2019.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    https://en.wikipedia.org/wiki/Canon_of_Sherlock_Holmes.

  2. 2.

    http://challenge.knowledge-graph.jp/.

  3. 3.

    http://knowledge-graph.jp/visualization/.

  4. 4.

    https://www.darpa.mil/program/explainable-artificial-intelligence.

  5. 5.

    More precisely, it is possible in the EventKG schema, but the graph becomes complicated and is hard to construct such that specific information is difficult to find in the graph.

References

  1. Mehdi, G., et al.: Semantic rule-based equipment diagnostics. In: d’Amato, C., et al. (eds.) ISWC 2017. LNCS, vol. 10588, pp. 314–333. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-68204-4_29

    Chapter  Google Scholar 

  2. Brina, O., Cotton, C.: Explanation and justification in machine learning: a survey. In: Proceedings of IJCAI 2017 Workshop on Explainable AI (2017)

    Google Scholar 

  3. Fauna\(\_\)of\(\_\)India Wiki. https://en.wikipedia.org/wiki/Fauna_of_India. Accessed 18 Jan 2019

  4. Mineshima, K., Tanaka, R., Gomez, P.M., Miyao, Y., Bekki, D.: Building compositional semantics and higher-order inference system for a wide-coverage Japanese CCG parser. In: Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, pp. 2236–2242 (2016)

    Google Scholar 

  5. Kitagawa, K., Shiramatsu, S., Kamiya, A.: Developing a method for quantifying degree of discussion progress towards automatic facilitation of web-based discussion. In: Lujak, M. (ed.) AT 2018. LNCS (LNAI), vol. 11327, pp. 162–169. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-17294-7_12

    Chapter  Google Scholar 

  6. Ikeda, Y., Shiramatsu, S.: Generating questions asked by facilitator agents using preceding context in web-based discussion. In: Proceedings of the 2nd IEEE International Conference on Agents, pp. 127–132 (2017)

    Google Scholar 

  7. Noble, D., Rittel, H.W.: Issue-based information systems for design. In: Proceedings of the Computing in Design Education, pp. 275–286 (1988)

    Google Scholar 

  8. Gottschalk, S., Demidova, E.: EventKG: a multilingual event-centric temporal knowledge graph. In: Gangemi, A., et al. (eds.) ESWC 2018. LNCS, vol. 10843, pp. 272–287. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-93417-4_18

    Chapter  Google Scholar 

  9. Rospocher, M., et al.: Building event-centric knowledge graphs from news. J. Web Semant. 37–38, 132–151 (2016)

    Article  Google Scholar 

  10. Lombardo, V., Damiano, R., Pizzo, A.: Drammar: a comprehensive ontological resource on drama. In: Vrandečić, D., et al. (eds.) ISWC 2018. LNCS, vol. 11137, pp. 103–118. Springer, Cham (2018). https://doi.org/10.1007/978-3-030-00668-6_7

    Chapter  Google Scholar 

  11. van Hage, W.R., Malaise, V., Segers, R., Hollink, L., Schreiber, G.: Design and use of the simple event model (SEM). J. Web Semant. 9(2), 128–136 (2011)

    Article  Google Scholar 

Download references

Acknowledgments

We would like to express our gratitude to all the participants in the workshops, technical meetings, and other events that have been held so far. This work was supported by JSPS KAKENHI Grant Number 19H04168.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Takahiro Kawamura .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Kawamura, T. et al. (2020). Report on the First Knowledge Graph Reasoning Challenge 2018. In: Wang, X., Lisi, F., Xiao, G., Botoeva, E. (eds) Semantic Technology. JIST 2019. Lecture Notes in Computer Science(), vol 12032. Springer, Cham. https://doi.org/10.1007/978-3-030-41407-8_2

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-41407-8_2

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-41406-1

  • Online ISBN: 978-3-030-41407-8

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics