Explaining Conclusions from Diverse Knowledge Sources

  • J. William Murdock
  • Deborah L. McGuinness
  • Paulo Pinheiro da Silva
  • Chris Welty
  • David Ferrucci
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4273)


The ubiquitous non-semantic web includes a vast array of unstructured information such as HTML documents. The semantic web provides more structured knowledge such as hand-built ontologies and semantically aware databases. To leverage the full power of both the semantic and non-semantic portions of the web, software systems need to be able to reason over both kinds of information. Systems that use both structured and unstructured information face a significant challenge when trying to convince a user to believe their results: the sources and the kinds of reasoning that are applied to the sources are radically different in their nature and their reliability. Our work aims at explaining conclusions derived from a combination of structured and unstructured sources. We present our solution that provides an infrastructure capable of encoding justifications for conclusions in a single format. This integration provides an end-to-end description of the knowledge derivation process including access to text or HTML documents, descriptions of the analytic processes used for extraction, as well as descriptions of the ontologies and many kinds of information manipulation processes, including standard deduction. We produce unified traces of extraction and deduction processes in the Proof Markup Language (PML), an OWL-based formalism for encoding provenance for inferred information. We provide a browser for exploring PML and thus enabling a user to understand how some conclusion was reached.


Entity Annotation Unstructured Information Unstructured Information Management Architecture Information Manipulation Generate Knowledge Base 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


  1. Ando, R.: Exploiting Unannotated Corpora for Tagging and Chunking. In: Proc. of ACL (2004)Google Scholar
  2. Buchanan, B.G., Shortliffe, E.H. (eds.): Rule-Based Expert Systems: The MYCIN Experiments of the Stanford Heuristic Programming Project. Addison-Wesley Publishing Company, Reading (1984)Google Scholar
  3. Buneman, P., Khanna, S., Tan, W.: Why and Where: A Characterization of Data Provenance. In: Proc. of 8th International Conference on Database Theory (2001)Google Scholar
  4. Cimiano, P., Völker, J.: Text2Onto - A Framework for Ontology Learning and Data-driven Change Discovery. In: Montoyo, A., Muńoz, R., Métais, E. (eds.) NLDB 2005. LNCS, vol. 3513, pp. 227–238. Springer, Heidelberg (2005)CrossRefGoogle Scholar
  5. Cowell, A., McGuinness, D., Varley, C., Thurman, D.: Knowledge-Worker Requirements for Next Generation Query Answering and Explanation Systems. In: Proc. of the Workshop on Intelligent User Interfaces for Intelligence Analysis, International Conference on Intelligent User Interfaces (IUI 2006), Sydney, Australia (2006)Google Scholar
  6. Cui, Y., Widom, J., Wiener, J.: Tracing the Lineage of View Data in a Warehousing Environment. ACM Trans. on Database Systems 25(2), 179–227 (2000)CrossRefGoogle Scholar
  7. Davis, R.: Interactive Transfer of Expertise: Acquisition of New Inference Rules. Artificial Intelligence 12(2), 121–157 (1979)CrossRefGoogle Scholar
  8. Dill, S., Eiron, N., Gibson, D., Gruhl, D., Guha, R., Jhingran, A., Kanungo, T., Rajagopalan, S., Tomkins, A., Tomlin, J.A., Zien, J.Y.: SemTag and Seeker: Bootstrapping the semantic web via automated semantic annotation. In: 12th International World Wide Web Conference (WWW), Budapest, Hungary (2003)Google Scholar
  9. Ferrucci, D.: Text Analysis as Formal Inference for the Purposes of Uniform Tracing and Explanation Generation. IBM Research Report RC23372 (2004)Google Scholar
  10. Ferrucci, D., Lally, A.: UIMA by Example. IBM Systems Journal 43(3), 455–475 (2004)CrossRefGoogle Scholar
  11. Goel, A., Murdock, J.W.: Meta-Cases: Explaining Case-Based Reasoning. In: Goel, A.K., Murdock, J.W. (eds.) 3rd European Workshop on Case-Based Reasoning, Lausanne, Switzerland (1996)Google Scholar
  12. Leake, D.: Evaluating Explanations: A Content Theory. Lawrence Erlbaum, Mahwah (1992)Google Scholar
  13. McGuinness, D.: Explaining Reasoning in Description Logics. Ph.D. Thesis, Rutgers University. Tech Report LCSR-TR-277 (1996)Google Scholar
  14. McGuinness, D., Pinheiro da Silva, P.: Explaining Answers from the Semantic Web: The Inference Web Approach. Journal of Web Semantics 1(4), 397–413 (2004)Google Scholar
  15. McGuinness, D.L., da Silva, P.P., Chang, C.: IWBase: Provenance Metadata Infrastructure for Explaining and Trusting Answers from the Web. Technical Report KSL-04-07, Knowledge Systems Laboratory, Stanford University, USA (2004)Google Scholar
  16. McGuinness, D., Pinheiro da Silva, P., Murdock, J.W., Ferrucci, D.: Exposing Extracted Knowledge Supporting Answers. Stanford Knowledge Systems Laboratory Technical Report KSL-05-03, Knowledge Systems Laboratory, Stanford University, USA (2005), http://www.ksl.stanford.edu/KSL_Abstracts/KSL-05-03.html
  17. McGuinness, D.L., Zeng, H., da Silva, P.P., Ding, L., Narayanan, D., Bhaowal, M.: Investigations into Trust for Collaborative Information Repositories: A Wikipedia Case Study. In: WWW 2006 Workshop on the Models of Trust for the Web (MTW 2006), May 22, 2006, Edinburgh, Scotland (2006)Google Scholar
  18. Maynard, D., Yankova, M., Kourakis, A., Kokossis, A.: Ontology-based information extraction for market monitoring and technology watch. In: ESWC Workshop End User Apects of the Semantic Web, Heraklion, Crete (May 2005)Google Scholar
  19. Moldovan, D.I., Rus, V.: Transformation of WordNet Glosses into Logic Forms. In: 14th International Florida Artificial Intelligence Research Society Conference, Key West, Florida, pp. 459–463 (2001)Google Scholar
  20. da Silva, P.P., McGuinness, D., Fikes, R.: A Proof Markup Language for Semantic Web Services. Information Systems 31(4-5), 381–395 (2006)CrossRefGoogle Scholar
  21. da Silva, P.P., Hayes, P., McGuinness, D.L., Fikes, R.E., Deshwal, P.: Towards Checking Hybrid Proofs. Technical Report KSL-05-01, Knowledge Systems Laboratory, Stanford University, USA (2005)Google Scholar
  22. da Silva, P.P., McGuinness, D., McCool, R.: Knowledge Provenance Infrastructure. IEEE Data Engineering Bulletin 26(4), 26–32 (2003)Google Scholar
  23. Swartout, W., Paris, C., Moore, J.: Explanations in Knowledge Systems: Design for Explainable Expert Systems. IEEE Expert Systems 6(3), 58–64 (1991)CrossRefGoogle Scholar
  24. Welty, C., Murdock, J.W.: Towards Knowledge Acquisition from Information Extraction. In: Cruz, I., Decker, S., Allemang, D., Preist, C., Schwabe, D., Mika, P., Uschold, M., Aroyo, L.M. (eds.) ISWC 2006. LNCS, vol. 4273, pp. 709–722. Springer, Heidelberg (2006)CrossRefGoogle Scholar
  25. Zaihrayeu, I., da Silva, P.P., McGuinness, D.: IWTrust: Improving User Trust in Answers from the Web. In: Herrmann, P., Issarny, V., Shiu, S.C.K. (eds.) iTrust 2005. LNCS, vol. 3477, pp. 384–392. Springer, Heidelberg (2005)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • J. William Murdock
    • 1
  • Deborah L. McGuinness
    • 2
  • Paulo Pinheiro da Silva
    • 3
  • Chris Welty
    • 1
  • David Ferrucci
    • 1
  1. 1.IBM Watson Research CenterHawthornUSA
  2. 2.Knowledge Systems, Artificial Intelligence LaboratoryStanford UniversityStanfordUSA
  3. 3.Department of Computer ScienceThe University of Texas at El PasoEl PasoUSA

Personalised recommendations