Abstract
Bayesian Networks have been proposed as an alternative to rule-based systems in domains with uncertainty. Applications in monitoring and control can benefit from this form of knowledge representation. Following the work of Chong and Walley, we explore the possibilities of Bayesian Networks in the Waste Water Treatment Plants (WWTP) monitoring and control domain. We show the advantages of modelling knowledge in such a domain by means of Bayesian networks, put forth new methods for knowledge acquisition, describe their applications to a real waste water treatment plant and comment on the results. We also show how a Bayesian Network learning environment was used in the process and which characteristics of data in the domain suggested new ways of representing knowledge in network form but with uncertainty representations formalisms other than probability. The results of applying a possibilistic extension of current learning methods are also shown and compared.
Similar content being viewed by others
References
J. Pearl, Probabilistic Reasoning in Intelligent Systems: Networks of Plausible Inference, Morgan Kaufmann: San Mateo, CA, 1988.
H.G. Chong and W.G. Walley, "Rule-based versus probabilistic approaches to the diagnosis of faults in wastewater treatment processes," Artificial Intelligence in Engineering, no. 1, pp. 265-273, 1996.
M. S´anchez, "DAI-DEPUR: An integrated multilevel supervisory architecture for waste water treatment plants," PhD Thesis, Universitat Polit´ecnica de Catalunya, Barcelona, 1996.
T. Serra, M. Sànchez, J. Lafuente, U. Cort´es, and M. Poch, "Iscwap: A knowledge-based system for supervising activated sludge processes," Computers and Chemical Engineering, vol. 21, pp. 211-221, 1996.
J. B´ejar and U. Cort´es, "Linneo: herramienta para la adquisicion de conocimiento y generacion de reglas de clasifi-caci´on en dominios poco estructurados," in Actas del III Congreso Iberoamericano de Inteligencia Artificial (IBERAMIA92), 1992.
P. Kayek, T. Havranek, and R. Jirousek, Uncertain Information Processing in Expert Systems, CRC Press, 1992.
P. Hayek and J.J. Vald´es, "Algebraic foundations of uncertainty processing in rule-based expert systems (group theoretical approach)," Computers and Artificial Intelligence, no. 10, pp. 29-42, 1990.
P. Hayek and J.J. Vald´es, "Generalized algebraic foundations of uncertainty processing in rule-based expert systems," Computers and Artificial Intelligence, no. 10, pp. 29-42, 1991.
P. Hayek and J.J. Vald´es, "An analyisis of mycin-like expert systems," Mathware and Soft Computing, vol. 2, no. 1, pp. 45-68, 1994.
J.J. Vald´es, "Logical and algebraic foundations of uncertainty processing in rule-based system of artificial intelligence," PhD Thesis, Institute of Mathematics, Academy of Sciences of Czechoslovakia, 1987.
C. Sierra, "MILORD: arquitectura multinivell per a sistemes experts en classificaci´o," PhD Thesis, Dept. LSI, UPC, 1989.
D.A. Heckerman, "On the expresiveness of rule-based systems for reasoning with uncertainty," in Proceedings of the AAAI, Seattle, Washington, 1987.
J.J. Vald´es, "An integrated environment for uncertainty processing using graphical models," in Proceedings of the International Conference on Information Processing and Management of Uncertainty, Palma de Mallorca, Spain, 1992, pp. 537-540.
S.L. Lauritzen and D.J. Spiegelhalter, "Local computation with probabilities in graphical structures and their applications to expert systems," Journal of the Royal Statistics Society, vol. 50, no. 2, 1988.
R.E. Neapolitan, Probabilistic Reasoning in Expert Systems, Wiley-Interscience, 1990.
D. Geiger and J. Pearl, "On the logic of causal models," in Uncertainty in Artificial Intelligence, edited by R.D. Shachter, T.S. Levitt, L.N. Kanal, and F. Lemmer, North-Holland: Amsterdam, vol. 4, pp. 3-14, 1990.
D. Kahneman, P. Slovic, and A. Tversky, Judgement under Uncertainty: Heuristics and Biases, Cambridge University Press, 1982.
A. Darwiche and J. Pearl, "Symbolical causal networks," in Proceedings of AAAI-91, 1991.
G.F. Cooper, "Probabilistic inference using belief networks is np-hard," Technical Report KSL-87-27, Stanford University, Stanford, California, 1987.
R.R. Bouckaert, "Bayesian belief networks: From construction to inference," PhD Thesis, Universiteit Utrecht, Faculteit Wiskunde en Informatica, 1995.
R. Sang¨uesa, "Learning possibilistic causal networks from data," PhD Thesis, Facultad de Inform´atica de Barcelona, Dept. LSI, 1997.
G.F. Cooper and E. Herskovits, "A Bayesian method for the induction of probabilistic networks from data," Machine Learning, vol. 9, pp. 320-347, 1992.
W. Lam and F. Bacchus, "Using causal information and local measures to learn Bayesian belief networks," in Proceedings of Bayesian Network Application to WWTP 39 the Ninth Conference on Uncertainty in Artificial Intelligence, 1993, pp. 243-250.
J. Suzuki, "Construction of Bayesian networks from databases based on a mdl scheme," in Proceedings of the Ninth Conference on Uncertainty in Artificial Intelligence,Washington, DC, 1993, pp. 266-273.
J. Pearl and T. Verma, "A theory of inferred causation," in Proceedings of the Second International Conference on Knowledge Representation and Reasoning, Morgan Kaufmann: San Mateo, CA, 1991.
J. Pearl and T.S. Verma, "A statistical semantics for causation," Statistics and Computing, no. 2, pp. 91-95, 1991.
D. Geiger, A. Paz, and J. Pearl, "Learning simple causal structures," International Journal of Inteligent Systems, vol. 8, pp. 149-163, 1993.
J.F. Huete, "Aprendizaje de redes de creencia mediante la detecci ´on de independencias: modelos no probabil´?sticos." PhD Thesis, Universidad de Granada, Granada, 1995.
W. Buntine, "Theory refinement on Bayesian networks," in Proceedings of the Seventh Conference on Uncertainty in Artificial Intelligence, Los Angeles, California, 1991, Morgan Kaufmann, pp. 52-60.
M. Singh and M. Valtorta, "Construction of Bayesian network structures from data: Asurvey and an efficient algorithm," International Journal of Approximate Reasoning, vol. 12, pp. 111-131, 1995.
S. Kullback and R.A. Leibler, "Information and sufficiency," Annals of Mathematical Statistics, vol. 22, pp. 79-86, 1951.
W. Lam and F. Bacchus, "Learning belief networks, an approach based on the mdl principle," Computational Intelligence, pp. 104-127, 1994.
E.H. Herskovits and G. Cooper, "Kutat´o an entropy-driven system for the construction of probabilistic expert systems from data," in Proceedings of the Sixth Conference on Uncertainty in Artificial Intelligence, 1990.
D. Geiger, A. Paz, and J. Pearl, "Learning causal trees from dependence information," in Proceedings of the Eigth National Conference on Artificial Intelligence, 1990, pp. 770-776.
M. Singh and M. Valtorta, "An algorithm for the construction of Bayesian network structures from data," in Proceedings of the Ninth Conference on Uncertainty in Artificial Intelligence, Morgan Kaufmann, 1993, pp. 259-265.
L.R. Rodr´guez, "Depurnet: Aplicaci´o de xarxes bayesianes a entorns industrials," Master's Thesis, Facultat d'Informàtica de Barcelona, 1997.
W. Lam and F. Bacchus, "Using new data to refine a Bayesian network," in Proceedings of the Tenth Conference on Uncerainty in Artificial Intelligence, 1994, pp. 383-390.
C.K. Chow and C.N. Liu, "Approximating discrete probability distributions with dependence trees," IEEE Transactions on Information Theory, vol. 14, pp. 462-467, 1968.
R. Sang¨uesa and U. Cort´es, "Prior knowledge for learning networks in non-probabilistic settings," in Proceedings of the CANEW98, First International Workshop on Causal Networks, Iberamia98, Lisbon, Portugal, 1998, pp. 10-18.
W. Buntine, "Graphical models for discovering knowledge," in Advances in Knowledge Discovery and Data Mining, edited by U.M. Fayyad, G. Piatetsky-Shapiro, P. Smyth, and R. Uthurusamy, pp. 59-82, 1995.
J. Cab´os, "Aprenentatge i manipulaci´o de xarxes de creences," Master's Thesis, LSI, Dept., Technical University of Catalonia, 1996.
R. Castelo and A. Siebes, "Priors on network structures. Biasing the search for Bayesian networks," in Proceedings of CANEW98, First International Workshop on Causal Networks, Iberamia98, Lisbon, Portugal, 1998, pp. 21-30.
D. Dubois and H. Prade, Th´eorie des possibilit´es. Application ´a la repr´esentation des connaissances en informatique, Masson: Paris, 1986.
R.R. Bouckaert, "Optimizing causal orderings for generating dags from data," in Proceedings Conference on Uncertainty in Artificial Intelligence, 1992, pp. 9-16.
P. Fonck and E. Straszecka, "Building influence graphs in the framework of possibility theory," Annales Univ. Sci. Budapest, Sect. Comp., pp. 101-106, 1991.
P. Fonck, "Reseaux d'inference pour le raisonnement possibiliste," PhD Thesis, Universit´e de Liege, 1993.
R. Borgelt and R. Kruse, "Some experimental results on learning probabilistic and possibilistic networks with different evaluations measures," in Proceedings ofFAPR-ECSQUARU'97, 1997, pp. 71-81.
R. Sang¨uesa, U. Cort´es, and J. Cab´os, "Possibilistic conditional independence: Asimilarity-based measure and its application to causal network learning," International Journal of Approximate Reasoning, vol. 18, pp. 145-167, 1998.
R. Sang¨uesa and U. Cort´es, "A parallel algorithm for building possibilistic causal networks," International Journal of Approximate Reasoning, vol. 18, pp. 251-270, 1988.
R. Sang¨uesa and U. Cort´es, "Learning causal networks from data: A survey and a new algorithm to learn possibilistic causal networks from data," AI Communications, vol.4, no. 19, pp. 1-31, 1997.
R. Sang¨uesa, "Learning causal networks from data; A survey," Technical Report LSI-96-19-R, Dept. de Llenguatges i Sistemes Inform´atics, Universitat Polit´ecnica de Catalunya, Barcelona, 1996.
L.M. De Campos and J.F. Huete, "Learning non-probabilistic belief networks," in Proceedings of the Second European Conference on Quantitative and Symbolic Approaches to Reasoning under Uncertainty, 1993.
R. Sang¨uesa, J. Cab´os, and U. Cort´es, "Experimentaci´on con m´etodos h´ibridos de aprendizaje de redes bayesianas," Technical Report LSI-96-R, Dept. de Llenguatges i Sistemes Inform´atics, Universitat Polit´ecnica de Catalunya, Barcelona, 1996.
R. Sang¨uesa, "Measures for learning possibilistic belief networks," in Florida Artificial Intelligence and Reasoning Symposium, Miami, FL, USA.
M. Ramoni and P. Sebastiani, "Learning Bayesian networks from incomplete databases," in Proceedings of the Twelveth International Confernece on Uncertainty in Artificial Intelligence, 1997.
M. Goldszmidt and N. Friedman, "Sequential update of Bayesian networks," in Proceedings of the Thirdteenth International Conference on Uncertainty in Artificcial Intellligence, 1997.
J. Pearl and A. Paz, "Graphoids: A graph-based logic for reasoning about relevance relations," Technical Report, Cognitive Science Laboratory, Computer Science Department, University of California, Los Angeles, 1985.
D. Geiger, T.S. Verma, and J. Pearl, "Identifying independence in Bayesian networks," Networks, no. 20, pp. 507-534, 1990.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Sangüesa, R., Burrell, P. Application of Bayesian Network Learning Methods to Waste Water Treatment Plants. Applied Intelligence 13, 19–40 (2000). https://doi.org/10.1023/A:1008375228885
Issue Date:
DOI: https://doi.org/10.1023/A:1008375228885