Data Mining and Knowledge Discovery

, Volume 4, Issue 2–3, pp 163–192 | Cite as

Scalable Techniques for Mining Causal Structures

  • Craig Silverstein
  • Sergey Brin
  • Rajeev Motwani
  • Jeff Ullman


Mining for association rules in market basket data has proved a fruitful area of research. Measures such as conditional probability (confidence) and correlation have been used to infer rules of the form “the existence of item A implies the existence of item B.” However, such rules indicate only a statistical relationship between A and B. They do not specify the nature of the relationship: whether the presence of A causes the presence of B, or the converse, or some other attribute or phenomenon causes both to appear together. In applications, knowing such causal relationships is extremely useful for enhancing understanding and effecting change. While distinguishing causality from correlation is a truly difficult problem, recent work in statistics and Bayesian learning provide some avenues of attack. In these fields, the goal has generally been to learn complete causal models, which are essentially impossible to learn in large-scale data mining applications with a large number of variables.

In this paper, we consider the problem of determining casual relationships, instead of mere associations, when mining market basket data. We identify some problems with the direct application of Bayesian learning ideas to mining large databases, concerning both the scalability of algorithms and the appropriateness of the statistical techniques, and introduce some initial ideas for dealing with these problems. We present experimental results from applying our algorithms on several large, real-world data sets. The results indicate that the approach proposed here is both computationally feasible and successful in identifying interesting causal structures. An interesting outcome is that it is perhaps easier to infer the lack of causality than to infer causality, information that is useful in preventing erroneous decision making.

data mining text mining market basket association rules causality 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. Agrawal, R., Imielinski, T., and Swami, A. 1993. Mining association rules between sets of items in large databases. In Proceedings of the ACM SIGMOD International Conference on the Management of Data, pp. 207–216.Google Scholar
  2. Agresti, A. 1990. Categorical Data Analysis. New York: John Wiley & Sons.Google Scholar
  3. Balke, A. and Pearl, J. 1994. Probabilistic evaluation of counterfactual queries. In Proceedings of the Tenth Conference on Uncertainty in Artificial Intelligence, Seattle, WA, pp. 46–54.Google Scholar
  4. Brin, S., Motwani, R., and Silverstein, C. 1997. Beyond market baskets: Generalizing association rules to correlations. In Proceedings of the 1997 ACM SIGMOD Conference on Management of Data, Tucson, AZ, pp. 265–276.Google Scholar
  5. Cooper, G. 1997. A simple constraint-based algorithm for efficiently mining observational databases for causal relationships. Data Mining and Knowledge Discovery, 2:203–224.CrossRefGoogle Scholar
  6. Cooper, G. and Herskovits, E. 1992. A Bayesian method for the induction of probabilistic networks from data. Machine Learning, 9:309–347.Google Scholar
  7. Heckerman, D. 1995.ABayesian approach to learning causal networks. In Proceedings of the Eleventh Conference on Uncertainty in Artificial Intelligence, pp. 285–295.Google Scholar
  8. Heckerman, D. 1997. Bayesian networks for data mining. Data Mining and Knowledge Discovery, 1:79–119.CrossRefGoogle Scholar
  9. Heckerman, D., Geiger, D., and Chickering, D. 1994. Learning Bayesian networks: The combination of knowledge and statistical data. In Proceedings of the Tenth Conference on Uncertainty in Artificial Intelligence, pp. 293–301.Google Scholar
  10. Heckerman, D., Meek, C., and Cooper, G. 1997. A Bayesian approach to causal discovery. Technical Report MSR-TR-97-05, Microsoft Research.Google Scholar
  11. Mendenhall, W., Scheaffer, R., and Wackerly, D. 1986. Mathematical Statistics with Applications. Duxbury Press, 3rd edition.Google Scholar
  12. Pearl, J. 1993. From Bayesian networks to causal networks. In Proceedings of the Adaptive Computing and Information Processing Seminar, pp. 25–27Google Scholar
  13. Pearl, J. 1995. Causal diagrams for empirical research. Biometrika, 82:669–709.CrossRefzbMATHMathSciNetGoogle Scholar
  14. Pearl, J. and Verma, T.S. 1991. A theory of inferred causation. In Proceedings of the Second International Conference on the Principles of Knowledge Representation and Reasoning, pp. 441–452.Google Scholar
  15. Spirtes, P., Glymour, C., and Scheines, R. 1993. Causation, Prediction, and Search. New York: Springer-Verlag.Google Scholar

Copyright information

© Kluwer Academic Publishers 2000

Authors and Affiliations

  • Craig Silverstein
    • 1
  • Sergey Brin
    • 2
  • Rajeev Motwani
    • 3
  • Jeff Ullman
    • 4
  1. 1.Department of Computer ScienceStanford UniversityStanfordUSA
  2. 2.Department of Computer ScienceStanford UniversityStanfordUSA
  3. 3.Department of Computer ScienceStanford UniversityStanfordUSA
  4. 4.Department of Computer ScienceStanford UniversityStanfordUSA

Personalised recommendations