Skip to main content

Fast Methods with Magic Sampling for Knowledge Discovery in Deductive Databases with Large Deduction Results

  • Conference paper
Book cover Advances in Database Technologies (ER 1998)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 1552))

Included in the following conference series:

  • 502 Accesses

Abstract

The ability of the deductive database to handle recursive queries is one of its most useful features. It opens up new possibilities for users to view and analyze data. This ability to handle recursive queries, however, still cannot be fully utilized because when recursive rules are involved, the amount of deduced facts can become very large, making it difficult and sometimes impossible to store, view or analyze the query results. In order to overcome this problem, we have proposed the DSK method and the DSK(S) method to discover characteristic rules from large amount of deduction results without having to store all of them. In this paper, we propose two new methods, the DSK(T) method and the DSK(ST) method which are faster than the DSK method and the DSK(S) method respectively. In addition, we propose a new sampling method called magic sampling, which is used by the two methods to achieve the improvement in speed. Magic sampling works when linear recursive rules are involved and the magic set algorithm is used for deduction.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. R. Agrawal, T. Imielinski, and A. Swami, “Mining Association Rules between Sets of Items in Large Databases,” Proc. of the ACM SIGMOD International Conference on Management of Data, vol. 22, no. 2, pp. 207–216, 1993.

    Article  Google Scholar 

  2. R. Agrawal and R. Srikant, “Fast Algorithms for Mining Association Rules,” Proc. of the 20th VLDB Conference, pp. 487–499, 1994.

    Google Scholar 

  3. F. Bancilhon, D. Maier, Y. Sagiv, and J. D. Ullman, “Magic Sets and Other Strange Ways to Implement Logic Programs,” Proc. of the fifth ACM SIGMODSIGA CT Symposium on Principles of Database Systems, pp. 1–15, 1986.

    Google Scholar 

  4. F. Bancilhon and R. Ramakrishnan, “An Amateur’s Introduction to Recursive Query Processing Strategies,” Proc. of ACM SIGMOD’86, vol. 15, no. 2, pp. 16–52, 1986.

    Article  Google Scholar 

  5. J. Barwise and J. Etchemendy, The Language of First-order Logic, 3rd Edition, Revised and Expanded, CSLI, 1992.

    MATH  Google Scholar 

  6. C. Been and R. Ramakrishnan, “On the Power of Magic,” Proc. of the sixth ACM SIGMOD-SIGACT Symposium on Principles of Database Systems, pp. 269–283, 1987.

    Google Scholar 

  7. Y. Cai, N. Cercone, and J. Han, “Attribute-Oriented Induction in Relational Databases,” in Knowledge Discovery in Databases, G. Piatetsky-Shapiro and W. J. Frawley (Eds.), AAAI Press/The MIT Press, pp. 213–228, 1991.

    Google Scholar 

  8. U. M. Fayyad, G. Piatetsky-Shapiro, and P. Smyth, “From Data Mining to Knowledge Discovery: An Overview,” in Advances in Knowledge Discovery and Data Mining, U. M. Fayyad, G. Piatetsky-Shapiro, P. Smyth, and R. Uthurusamy (Eds.), AAAI Press/The MIT Press, pp. 1–34, 1996.

    Google Scholar 

  9. W. J. Frawley, G. Piatetsky-Shapiro, and C. J. Matheus, “Knowledge Discovery in Databases: An Overview,” in Knowledge Discovery in Databases, G. Piatetsky-Shapiro and W. J. Frawley (Eds.), AAAI Press/The MIT Press, pp. 1–27, 1991.

    Google Scholar 

  10. C. Goh, M. Tsukamoto, and S. Nishio, “Knowledge Discovery in Deductive Databases with Large Deduction Results: The First Step,” IEEE Trans. on Knowledge and Data Engineering, vol. 8, no. 6, pp. 952–956, 1996.

    Article  Google Scholar 

  11. J. Han, Y. Cai, and N. Cercone, “Knowledge Discovery in Databases: an Attribute-Oriented Approach,” Proc. of the 18th VLDB Conference, pp. 547–559, 1992.

    Google Scholar 

  12. J. Han, Y. Cal, and N. Cercone, “Data-Driven Discovery of Quantitative Rules in Relational Databases,” IEEE Trans. on Knowledge and Data Engineering, vol. 5, no. 1, pp. 29–40, 1993.

    Article  Google Scholar 

  13. J. Han, Y. Fu, Y. Huang, Y. Cal, and N. Cercone, “DBLearn: A System Prototype for Knowledge Discovery in Relational Databases,” Proc. of ACM SIGMOD’94, vol. 23, no. 2, pp. 516, 1994.

    Article  Google Scholar 

  14. S. Nishio, H. Kawano, J. Han, “Knowledge Discovery in Object-Oriented Databases: The First Step,” Proc. of the AAAI Knowledge Discovery in Databases Workshop 1993, pp. 299, 1993.

    Google Scholar 

  15. H. Kawano, K. Sonoo, S. Nishio, and T. Hasegawa, “Accuracy Evaluation of Rules Derived from Sample Data in VLKD,” Proc. of the ORSA/TIMS Joint National Meeting, p.144, Anaheim, California, U.S.A., Nov. 3–6, 1991.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 1999 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Goh, CL., Tsukamoto, M., Nishio, S. (1999). Fast Methods with Magic Sampling for Knowledge Discovery in Deductive Databases with Large Deduction Results. In: Kambayashi, Y., Lee, D.L., Lim, EP., Mohania, M.K., Masunaga, Y. (eds) Advances in Database Technologies. ER 1998. Lecture Notes in Computer Science, vol 1552. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-49121-7_2

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-49121-7_2

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-65690-6

  • Online ISBN: 978-3-540-49121-7

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics