Skip to main content
Log in

Application of Bayesian Network Learning Methods to Waste Water Treatment Plants

  • Published:
Applied Intelligence Aims and scope Submit manuscript

Abstract

Bayesian Networks have been proposed as an alternative to rule-based systems in domains with uncertainty. Applications in monitoring and control can benefit from this form of knowledge representation. Following the work of Chong and Walley, we explore the possibilities of Bayesian Networks in the Waste Water Treatment Plants (WWTP) monitoring and control domain. We show the advantages of modelling knowledge in such a domain by means of Bayesian networks, put forth new methods for knowledge acquisition, describe their applications to a real waste water treatment plant and comment on the results. We also show how a Bayesian Network learning environment was used in the process and which characteristics of data in the domain suggested new ways of representing knowledge in network form but with uncertainty representations formalisms other than probability. The results of applying a possibilistic extension of current learning methods are also shown and compared.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. J. Pearl, Probabilistic Reasoning in Intelligent Systems: Networks of Plausible Inference, Morgan Kaufmann: San Mateo, CA, 1988.

    Google Scholar 

  2. H.G. Chong and W.G. Walley, "Rule-based versus probabilistic approaches to the diagnosis of faults in wastewater treatment processes," Artificial Intelligence in Engineering, no. 1, pp. 265-273, 1996.

  3. M. S´anchez, "DAI-DEPUR: An integrated multilevel supervisory architecture for waste water treatment plants," PhD Thesis, Universitat Polit´ecnica de Catalunya, Barcelona, 1996.

    Google Scholar 

  4. T. Serra, M. Sànchez, J. Lafuente, U. Cort´es, and M. Poch, "Iscwap: A knowledge-based system for supervising activated sludge processes," Computers and Chemical Engineering, vol. 21, pp. 211-221, 1996.

    Google Scholar 

  5. J. B´ejar and U. Cort´es, "Linneo: herramienta para la adquisicion de conocimiento y generacion de reglas de clasifi-caci´on en dominios poco estructurados," in Actas del III Congreso Iberoamericano de Inteligencia Artificial (IBERAMIA92), 1992.

  6. P. Kayek, T. Havranek, and R. Jirousek, Uncertain Information Processing in Expert Systems, CRC Press, 1992.

  7. P. Hayek and J.J. Vald´es, "Algebraic foundations of uncertainty processing in rule-based expert systems (group theoretical approach)," Computers and Artificial Intelligence, no. 10, pp. 29-42, 1990.

    Google Scholar 

  8. P. Hayek and J.J. Vald´es, "Generalized algebraic foundations of uncertainty processing in rule-based expert systems," Computers and Artificial Intelligence, no. 10, pp. 29-42, 1991.

    Google Scholar 

  9. P. Hayek and J.J. Vald´es, "An analyisis of mycin-like expert systems," Mathware and Soft Computing, vol. 2, no. 1, pp. 45-68, 1994.

    Google Scholar 

  10. J.J. Vald´es, "Logical and algebraic foundations of uncertainty processing in rule-based system of artificial intelligence," PhD Thesis, Institute of Mathematics, Academy of Sciences of Czechoslovakia, 1987.

  11. C. Sierra, "MILORD: arquitectura multinivell per a sistemes experts en classificaci´o," PhD Thesis, Dept. LSI, UPC, 1989.

    Google Scholar 

  12. D.A. Heckerman, "On the expresiveness of rule-based systems for reasoning with uncertainty," in Proceedings of the AAAI, Seattle, Washington, 1987.

  13. J.J. Vald´es, "An integrated environment for uncertainty processing using graphical models," in Proceedings of the International Conference on Information Processing and Management of Uncertainty, Palma de Mallorca, Spain, 1992, pp. 537-540.

  14. S.L. Lauritzen and D.J. Spiegelhalter, "Local computation with probabilities in graphical structures and their applications to expert systems," Journal of the Royal Statistics Society, vol. 50, no. 2, 1988.

  15. R.E. Neapolitan, Probabilistic Reasoning in Expert Systems, Wiley-Interscience, 1990.

  16. D. Geiger and J. Pearl, "On the logic of causal models," in Uncertainty in Artificial Intelligence, edited by R.D. Shachter, T.S. Levitt, L.N. Kanal, and F. Lemmer, North-Holland: Amsterdam, vol. 4, pp. 3-14, 1990.

    Google Scholar 

  17. D. Kahneman, P. Slovic, and A. Tversky, Judgement under Uncertainty: Heuristics and Biases, Cambridge University Press, 1982.

  18. A. Darwiche and J. Pearl, "Symbolical causal networks," in Proceedings of AAAI-91, 1991.

  19. G.F. Cooper, "Probabilistic inference using belief networks is np-hard," Technical Report KSL-87-27, Stanford University, Stanford, California, 1987.

    Google Scholar 

  20. R.R. Bouckaert, "Bayesian belief networks: From construction to inference," PhD Thesis, Universiteit Utrecht, Faculteit Wiskunde en Informatica, 1995.

  21. R. Sang¨uesa, "Learning possibilistic causal networks from data," PhD Thesis, Facultad de Inform´atica de Barcelona, Dept. LSI, 1997.

  22. G.F. Cooper and E. Herskovits, "A Bayesian method for the induction of probabilistic networks from data," Machine Learning, vol. 9, pp. 320-347, 1992.

    Google Scholar 

  23. W. Lam and F. Bacchus, "Using causal information and local measures to learn Bayesian belief networks," in Proceedings of Bayesian Network Application to WWTP 39 the Ninth Conference on Uncertainty in Artificial Intelligence, 1993, pp. 243-250.

  24. J. Suzuki, "Construction of Bayesian networks from databases based on a mdl scheme," in Proceedings of the Ninth Conference on Uncertainty in Artificial Intelligence,Washington, DC, 1993, pp. 266-273.

  25. J. Pearl and T. Verma, "A theory of inferred causation," in Proceedings of the Second International Conference on Knowledge Representation and Reasoning, Morgan Kaufmann: San Mateo, CA, 1991.

    Google Scholar 

  26. J. Pearl and T.S. Verma, "A statistical semantics for causation," Statistics and Computing, no. 2, pp. 91-95, 1991.

    Google Scholar 

  27. D. Geiger, A. Paz, and J. Pearl, "Learning simple causal structures," International Journal of Inteligent Systems, vol. 8, pp. 149-163, 1993.

    Google Scholar 

  28. J.F. Huete, "Aprendizaje de redes de creencia mediante la detecci ´on de independencias: modelos no probabil´?sticos." PhD Thesis, Universidad de Granada, Granada, 1995.

    Google Scholar 

  29. W. Buntine, "Theory refinement on Bayesian networks," in Proceedings of the Seventh Conference on Uncertainty in Artificial Intelligence, Los Angeles, California, 1991, Morgan Kaufmann, pp. 52-60.

    Google Scholar 

  30. M. Singh and M. Valtorta, "Construction of Bayesian network structures from data: Asurvey and an efficient algorithm," International Journal of Approximate Reasoning, vol. 12, pp. 111-131, 1995.

    Google Scholar 

  31. S. Kullback and R.A. Leibler, "Information and sufficiency," Annals of Mathematical Statistics, vol. 22, pp. 79-86, 1951.

    Google Scholar 

  32. W. Lam and F. Bacchus, "Learning belief networks, an approach based on the mdl principle," Computational Intelligence, pp. 104-127, 1994.

  33. E.H. Herskovits and G. Cooper, "Kutat´o an entropy-driven system for the construction of probabilistic expert systems from data," in Proceedings of the Sixth Conference on Uncertainty in Artificial Intelligence, 1990.

  34. D. Geiger, A. Paz, and J. Pearl, "Learning causal trees from dependence information," in Proceedings of the Eigth National Conference on Artificial Intelligence, 1990, pp. 770-776.

  35. M. Singh and M. Valtorta, "An algorithm for the construction of Bayesian network structures from data," in Proceedings of the Ninth Conference on Uncertainty in Artificial Intelligence, Morgan Kaufmann, 1993, pp. 259-265.

  36. L.R. Rodr´guez, "Depurnet: Aplicaci´o de xarxes bayesianes a entorns industrials," Master's Thesis, Facultat d'Informàtica de Barcelona, 1997.

  37. W. Lam and F. Bacchus, "Using new data to refine a Bayesian network," in Proceedings of the Tenth Conference on Uncerainty in Artificial Intelligence, 1994, pp. 383-390.

  38. C.K. Chow and C.N. Liu, "Approximating discrete probability distributions with dependence trees," IEEE Transactions on Information Theory, vol. 14, pp. 462-467, 1968.

    Google Scholar 

  39. R. Sang¨uesa and U. Cort´es, "Prior knowledge for learning networks in non-probabilistic settings," in Proceedings of the CANEW98, First International Workshop on Causal Networks, Iberamia98, Lisbon, Portugal, 1998, pp. 10-18.

  40. W. Buntine, "Graphical models for discovering knowledge," in Advances in Knowledge Discovery and Data Mining, edited by U.M. Fayyad, G. Piatetsky-Shapiro, P. Smyth, and R. Uthurusamy, pp. 59-82, 1995.

  41. J. Cab´os, "Aprenentatge i manipulaci´o de xarxes de creences," Master's Thesis, LSI, Dept., Technical University of Catalonia, 1996.

  42. R. Castelo and A. Siebes, "Priors on network structures. Biasing the search for Bayesian networks," in Proceedings of CANEW98, First International Workshop on Causal Networks, Iberamia98, Lisbon, Portugal, 1998, pp. 21-30.

  43. D. Dubois and H. Prade, Th´eorie des possibilit´es. Application ´a la repr´esentation des connaissances en informatique, Masson: Paris, 1986.

    Google Scholar 

  44. R.R. Bouckaert, "Optimizing causal orderings for generating dags from data," in Proceedings Conference on Uncertainty in Artificial Intelligence, 1992, pp. 9-16.

  45. P. Fonck and E. Straszecka, "Building influence graphs in the framework of possibility theory," Annales Univ. Sci. Budapest, Sect. Comp., pp. 101-106, 1991.

  46. P. Fonck, "Reseaux d'inference pour le raisonnement possibiliste," PhD Thesis, Universit´e de Liege, 1993.

  47. R. Borgelt and R. Kruse, "Some experimental results on learning probabilistic and possibilistic networks with different evaluations measures," in Proceedings ofFAPR-ECSQUARU'97, 1997, pp. 71-81.

  48. R. Sang¨uesa, U. Cort´es, and J. Cab´os, "Possibilistic conditional independence: Asimilarity-based measure and its application to causal network learning," International Journal of Approximate Reasoning, vol. 18, pp. 145-167, 1998.

    Google Scholar 

  49. R. Sang¨uesa and U. Cort´es, "A parallel algorithm for building possibilistic causal networks," International Journal of Approximate Reasoning, vol. 18, pp. 251-270, 1988.

    Google Scholar 

  50. R. Sang¨uesa and U. Cort´es, "Learning causal networks from data: A survey and a new algorithm to learn possibilistic causal networks from data," AI Communications, vol.4, no. 19, pp. 1-31, 1997.

    Google Scholar 

  51. R. Sang¨uesa, "Learning causal networks from data; A survey," Technical Report LSI-96-19-R, Dept. de Llenguatges i Sistemes Inform´atics, Universitat Polit´ecnica de Catalunya, Barcelona, 1996.

    Google Scholar 

  52. L.M. De Campos and J.F. Huete, "Learning non-probabilistic belief networks," in Proceedings of the Second European Conference on Quantitative and Symbolic Approaches to Reasoning under Uncertainty, 1993.

  53. R. Sang¨uesa, J. Cab´os, and U. Cort´es, "Experimentaci´on con m´etodos h´ibridos de aprendizaje de redes bayesianas," Technical Report LSI-96-R, Dept. de Llenguatges i Sistemes Inform´atics, Universitat Polit´ecnica de Catalunya, Barcelona, 1996.

    Google Scholar 

  54. R. Sang¨uesa, "Measures for learning possibilistic belief networks," in Florida Artificial Intelligence and Reasoning Symposium, Miami, FL, USA.

  55. M. Ramoni and P. Sebastiani, "Learning Bayesian networks from incomplete databases," in Proceedings of the Twelveth International Confernece on Uncertainty in Artificial Intelligence, 1997.

  56. M. Goldszmidt and N. Friedman, "Sequential update of Bayesian networks," in Proceedings of the Thirdteenth International Conference on Uncertainty in Artificcial Intellligence, 1997.

  57. J. Pearl and A. Paz, "Graphoids: A graph-based logic for reasoning about relevance relations," Technical Report, Cognitive Science Laboratory, Computer Science Department, University of California, Los Angeles, 1985.

    Google Scholar 

  58. D. Geiger, T.S. Verma, and J. Pearl, "Identifying independence in Bayesian networks," Networks, no. 20, pp. 507-534, 1990.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Rights and permissions

Reprints and permissions

About this article

Cite this article

Sangüesa, R., Burrell, P. Application of Bayesian Network Learning Methods to Waste Water Treatment Plants. Applied Intelligence 13, 19–40 (2000). https://doi.org/10.1023/A:1008375228885

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1023/A:1008375228885

Navigation