Abstract
The chapter reviews current research results integrating machine learning and agent technologies. Although complementary solutions from both fields are discussed the focus is on using agent technology in the field of machine learning with a particular interest on applying agent-based solutions to supervised learning. The chapter contains a short review of applications, in which machine learning methods have been used to support agent learning capabilities. This is followed by a corresponding review of machine learning methods and tools in which agent technology plays an important role. Final part gives a more detailed description of some example machine learning models and solutions where the paradigm of the asynchronous team of agents has been implemented to support the machine learning methods, and which have been developed by the authors and their research group. It is argued that agent technology is particularly useful in case of dealing with the distributed machine learning problems. As an example of such applications a more detailed description of the agent-based framework for the consensus-based distributed data reduction is given in the final part of the chapter.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Abraham, A., Jain, R., Thomas, J., Han, S.Y.: D-SCIDS: Distributed Soft Computing Intrusion Detection System. Journal of Network and Computer Applications 30, 81–98 (2007)
Acampora, G., Cadenas, J.M., Loia, V., Ballester, E.M.: A Multi-Agent Memetic System for Human-Based Knowledge Selection. IEEE Transactions on System, Men, and Cybernetics, Part A 41(5), 946–960 (2011)
Albashiri, K.A., Coenen, F., Leng, P.: EMADS: An Extendible Multi-agent DataMiner. Knowledge-Based Systems 22, 523–528 (2009)
Arevian, G., Wermter, S., Panchev, C.: Symbolic State Transducers and Recurrent Neural Preference Machines for Text Mining. International Journal of Approximate Reasoning 32, 237–258 (2003)
Asuncion, A., Newman, D.J.: UCI Machine Learning Repository. School of Information and Computer Science. University of California, Irvine (2007), http://www.ics.uci.edu/learn/MLRepository.html
Bacardit, J., Butz, M.V.: Data Mining in Learning Classifier Systems: Comparing XCS with GAssist. In: Kovacs, T., Llorà , X., Takadama, K., Lanzi, P.L., Stolzmann, W., Wilson, S.W. (eds.) IWLCS 2003. LNCS (LNAI), vol. 4399, pp. 282–290. Springer, Heidelberg (2007)
Bacardit, J., Garrell, J.M.: Bloat Control and Generalization Pressure Using the Minimum Description Length Principle for a Pittsburgh Approach Learning Classifier System. In: Kovacs, T., Llorà , X., Takadama, K., Lanzi, P.L., Stolzmann, W., Wilson, S.W. (eds.) IWLCS 2003. LNCS (LNAI), vol. 4399, pp. 59–79. Springer, Heidelberg (2007)
Bacardit, J., Krasnogor, N.: Empirical Evaluation of Ensemble Techniques for a Pittsburgh Learning Classifier System. In: Bacardit, J., Bernadó-Mansilla, E., Butz, M.V., Kovacs, T., Llorà , X., Takadama, K. (eds.) IWLCS 2006 and IWLCS 2007. LNCS (LNAI), vol. 4998, pp. 255–268. Springer, Heidelberg (2008)
Balter, J., Labarre-Vila, A., Zibelin, D., Garbay, C.: A Knowledge-driven Agent-centred Framework for Data Mining in EMG. C. R. Biologies 325, 375–382 (2002)
Barbucha, D., Czarnowski, I., Jędrzejowicz, P., Ratajczak-Ropel, E., Wierzbowska, I.: An Implementation of the JADE-base A-Team Environment. International Transactions on System Science and Applications 3(4), 319–328 (2008)
Boylu, F., Aytug, H., Koehler, G.J.: Principal-Agent Learning. Decision Support Systems 47, 75–81 (2009)
Bull, L., Kovacs, T.: Foundations of Learning Classifier Systems: An Introduction. Studies in Fuzziness and Soft Computing 183, 1–17 (2005)
Busoniu, L., Babuska, R., De Schutter, B.: A Comprehensive Survey of Multiagent Reinforcement Learning. IEEE Transactions on Systems, Man, and Cybernetics, Part C: Applications and Reviews 38(2), 156–172 (2008)
Cordon, J.C., Herrera, F.: Learning Fuzzy Rules Using Ant Colony Optimization. In: Proceedings of ANT 2000 International Workshop on Ant Algorithms, pp. 13–21 (2002)
Czarnowski, I.: Distributed Data Reduction through Agent Collaboration. In: Håkansson, A., Nguyen, N.T., Hartung, R.L., Howlett, R.J., Jain, L.C. (eds.) KES-AMSTA 2009. LNCS (LNAI), vol. 5559, pp. 724–733. Springer, Heidelberg (2009)
Czarnowski, I.: Prototype Selection Algorithms for Distributed Learning. Pattern Recognition 43, 2292–2300 (2010)
Czarnowski, I.: Distributed Learning with Data Reduction. In: Nguyen, N.T. (ed.) TCCI IV 2011. LNCS, vol. 6660, pp. 3–121. Springer, Heidelberg (2011)
Czarnowski, I., Jędrzejowicz, P.: An Approach to Instance Reduction in Supervised Learning. In: Coenen, F., Preece, A., Macintosh, A. (eds.) Research and Development in Intelligent Systems XX, pp. 267–282. Springer, London (2004)
Czarnowski, I., Jędrzejowicz, P.: An Agent-Based PLA for the Cascade Correlation Learning Architecture. In: Duch, W., Kacprzyk, J., Oja, E., Zadrożny, S. (eds.) ICANN 2005. LNCS, vol. 3697, pp. 197–202. Springer, Heidelberg (2005)
Czarnowski, I., Jędrzejowicz, P.: An Agent-based Approach to ANN Training. Knowlwedge-Based Systems 19, 304–308 (2006)
Czarnowski, I., Jędrzejowicz, P.: An Agent-Based Approach to the Multiple-Objective Selection of Reference Vectors. In: Perner, P. (ed.) MLDM 2007. LNCS (LNAI), vol. 4571, pp. 117–130. Springer, Heidelberg (2007)
Czarnowski, I., Jędrzejowicz, P.: An Agent-based Algorithm for Data Reduction. In: Bramer, M., Coenen, F., Petridis, M. (eds.) Research and Development of Intelligent Systems XXIV, pp. 351–356. Springer, London (2007)
Czarnowski, I., Jędrzejowicz, P.: A Comparison Study of Strategies for Combining Classifiers from Distributed Data Sources. In: Kolehmainen, M., Toivanen, P., Beliczynski, B. (eds.) ICANNGA 2009. LNCS, vol. 5495, pp. 609–618. Springer, Heidelberg (2009)
Czarnowski, I., Jędrzejowicz, P.: Cluster Integration for the Cluster-Based Instance Selection. In: Pan, J.-S., Chen, S.-M., Nguyen, N.T. (eds.) ICCCI 2010, Part I. LNCS (LNAI), vol. 6421, pp. 353–362. Springer, Heidelberg (2010)
Czarnowski, I., Jędrzejowicz, P.: An Approach to Data Reduction and Integrated Machine Classification. New Generation Computing 28, 21–40 (2010)
Czarnowski, I., Jędrzejowicz, P.: An agent-based framework for distributed Learning. Engineering Applications of Artificial Intelligence 24, 93–102 (2011)
Czarnowski, I., Jędrzejowicz, P.: A Consensus-Based Approach to the Distributed Learning. In: Proceedings IEEE SMC 2011, Anchorage, pp. 936–941 (2011)
Czarnowski, I., Jędrzejowicz, P., Wierzbowska, I.: An A-Team Approach to Learning Classifiers from Distributed Data Sources. International Journal of Intelligent Information and Database Systems 4(3), 245–263 (2010)
Danilowicz, C., Nguyen, N.T.: Consensus Methods for Solving Inconsistency of Replicated Datain Distributed Systems. Distributed and Parallel Databases 14, 353–369 (2003)
The European Network of Excellence on Intelligence Technologies for Smart Adaptive Systems. EUNITE World Competition in domain of Intelligent Technologies (2002), http://neuron.tuke.sk/competition2
Fan, W., Gordon, M., Pathak, P.: An integrated Two-stage Model for Intelligent Information Routing. Decision Support Systems 42(1), 362–374 (2006)
Gifford, C.M.: Collective Machine Learning: Team Learning and Classification in Multi-Agent Systems. Ph.D. dissertation, University of Kansas (2009)
Gifford, C.M., Agah, A.: Collaborative Multi-agent Rock Facies Classification from Wireline Well Log Data. Engineering Applications of Artificial Intelligence 23, 1158–1172 (2010)
Hofmann, T., Basilico, J.: Collaborative Machine Learning. In: Hemmje, M., Niederée, C., Risse, T. (eds.) From Integrated Publication and Information Systems to Information and Knowledge Environments. LNCS, vol. 3379, pp. 173–182. Springer, Heidelberg (2005)
Hoen, P.J., Tuyls, K.: Analyzing Multi-agent Reinforcement Learning Using Evolutionary Dynamics. In: Boulicaut, J.-F., Esposito, F., Giannotti, F., Pedreschi, D. (eds.) ECML 2004. LNCS (LNAI), vol. 3201, pp. 168–179. Springer, Heidelberg (2004)
Holland, J.H.: Escaping Brittleness: The possibilities of General-Purpose Learning Algorithms Applied to Parallel Rule-Based Systems. In: Michalski, R.S., Carbonell, J.G., Mitchell, T.M. (eds.) Machine Learning, An Artificial Intelligence Approach, vol. II, pp. 593–623. Morgan Kaufmann, Palo Alto (1986)
Hong, T.-P., Tung, Y.-F., Wang, S.-L., Wu, M.-T., Wu, Y.-L.: An ACS-based Framework for Fuzzy Data Mining. Expert Systems with Applications 36, 11844–11852 (2009)
Ishiwaka, Y., Sato, T., Kakazu, Y.: An Approach to the Pursuit Problem on a Heterogeneous Multiagent System Using Reinforcement Learning. Robotics and Autonomous Systems 43, 245–256 (2003)
Jansen, W.A.: Intrusion Detection with Mobile Agents. Computer Communications 25, 1392–1401 (2002)
Jędrzejowicz, P.: A-Teams and Their Applications. In: Nguyen, N.T., Kowalczyk, R., Chen, S.-M. (eds.) ICCCI 2009. LNCS, vol. 5796, pp. 36–50. Springer, Heidelberg (2009)
Jędrzejowicz, P.: Machine Learning and Agents. In: O’Shea, J., Nguyen, N.T., Crockett, K., Howlett, R.J., Jain, L.C. (eds.) KES-AMSTA 2011. LNCS (LNAI), vol. 6682, pp. 2–15. Springer, Heidelberg (2011)
Jędrzejowicz, J., Jędrzejowicz, P.: A Family of GEP-Induced Ensemble Classifiers. In: Nguyen, N.T., Kowalczyk, R., Chen, S.-M. (eds.) ICCCI 2009. LNCS (LNAI), vol. 5796, pp. 641–652. Springer, Heidelberg (2009)
Jędrzejowicz, J., Jędrzejowicz, P.: Two Ensemble Classifiers Constructed from GEP-Induced Expression Trees. In: Jędrzejowicz, P., Nguyen, N.T., Howlet, R.J., Jain, L.C. (eds.) KES-AMSTA 2010, Part II. LNCS (LNAI), vol. 6071, pp. 200–209. Springer, Heidelberg (2010)
Jennings, N., Sycara, K., Wooldridge, M.: A Roadmap of Agent Research and Development. Autonomous Agents and Multi-Agent Systems 1, 7–38 (1998)
Jiang, C., Sheng, Z.: Case-based Reinforcement Learning for Dynamic Inventory Control in a Multi-agent Supply-chain System. Expert Systems with Applications 36, 6520–6526 (2009)
Kitakoshi, D., Shioya, H., Nakano, R.: Empirical Analysis of an On-line Adaptive System Using a Mixture of Bayesian Networks. Information Science 180, 2856–2874 (2010)
Klusch, M., Lodi, S., Moro, G.: Agent-Based Distributed Data Mining: The KDEC Scheme. In: Klusch, M., Bergamaschi, S., Edwards, P., Petta, P. (eds.) Intelligent Information Agents. LNCS (LNAI), vol. 2586, pp. 104–122. Springer, Heidelberg (2003)
Li, J., Sheng, Z., Ng, K.C.: Multi-goal Q-learning of Cooperative Teams. Expert Systems with Applications 38, 1565–1574 (2011)
Liau, C.J.: Belief, Information Acquisition, and Trust in Multi-agent Systems - A modal Logic Formulation. Artificial Intelligence 149(1), 31–60 (2003)
Loizos, M.: Partial Observability and Learnability. Artificial Intelligence 174, 639–669 (2010)
Luo, J., Wang, M., Hu, J., Shi, Z.: Distributed Data Mining on Agent Grid: Issues, Platform and Development Toolkit. Future Generation Computer Systems 23, 61–68 (2007)
Mannor, S., Shamma, J.S.: Multi-agent Learning for Engineers. Artificial Intelligence 171, 417–422 (2007)
Masoumi, B., Meybodi, M.R.: Speeding up Learning Automata Based Multiagent Systems Using the Concepts of Stigmergy and Entropy. Expert Systems with Applications 38(7), 8105–8118 (2011)
Moskovitch, R., Elovici, Y., Rokach, L.: Detection of Unknown Computer Worms Based on Behavioral Classification of the Host. Computational Statistics and Data Analysis 52, 4544–4566 (2008)
Negatu, A., D’Mello, S., Franklin, S.: Cognitively Inspired Anticipatory Adaptation and Associated Learning Mechanisms for Autonomous Agents. In: Butz, M.V., Sigaud, O., Pezzulo, G., Baldassarre, G. (eds.) ABiALS 2006. LNCS (LNAI), vol. 4520, pp. 108–127. Springer, Heidelberg (2007)
Nguyen, N.T.: Using Distance Functions to Solve Representation Choice Problems. Fundamenta. Informaticae 48, 295–314 (2001)
Nguyen, N.T.: Consensus System for Solving Conflicts in Distributed Systems. Information Science 147, 91–122 (2002)
Nowé, A., Verbeeck, K., Peeters, M.: Learning Automata as a Basis for Multi Agent Reinforcement Learning. In: Tuyls, K., Hoen, P.J., Verbeeck, K., Sen, S. (eds.) LAMAS 2005. LNCS (LNAI), vol. 3898, pp. 71–85. Springer, Heidelberg (2006)
Parpinelli, R.S., Lopes, H.S., Freitas, A.A.: An Ant Colony Based System for Data Mining: Application to medical data. In: Proceedings of Genetic and Evolutionary Computation Conference, pp. 791–798 (2001)
Pazzani, M., Billsus, D.: Learning and Revising User Profiles: The Identification of Interesting Web Sites. Machine Learning 27(3), 313–331 (1997)
Preux, P., Delepoulle, S., Darcheville, J.-C.: A Generic Architecture for Adaptive Agents Based on Reinforcement Learning. Information Science 161, 37–55 (2004)
Prodromidis, A., Chan, P.K., Stolfos, S.J.: Meta-learning in Distributed Data Mining Systems: Issues and Approaches. In: Kargupta, H., Chan, P. (eds.) Advances in Distributed and Parallel Knowledge Discovery, vol. 3. AAAI/MIT Press, Menlo Park (2000)
Quinlan, J.R.: C4.5: Programs for Machine Learning. Morgan Kaufmann, SanMateo (1993)
Quteishat, A., Lim, C.P., Tweedale, J., Jain, L.C.: A Neural Network-based Multi-agent Classifier System. Neurocomputing 72, 1639–1647 (2009)
Raicevic, P.: Parallel Reinforcement Learning Using Multiple Reward Signals. Neurocomputing 69, 2171–2179 (2006)
Rosaci, D.: CILIOS: Connectionist Inductive Learning and Inter-ontology Similarities for Recommending Information Agents. Information Systems 32, 793–825 (2007)
Sardinha, J.A.R.P., Garcia, A., de Lucena, C.J.P., Milidiú, R.L.: A Systematic Approach for Including Machine Learning in Multi-agent Systems. In: Bresciani, P., Giorgini, P., Henderson-Sellers, B., Low, G., Winikoff, M. (eds.) AOIS 2004. LNCS (LNAI), vol. 3508, pp. 198–211. Springer, Heidelberg (2005)
Shoham, Y., Powers, R., Grenager, T.: If Multi-agent Learning is the Answer, what is the Question? Artificial Intelligence 171(7), 365–377 (2007)
Sian, S.: Extending Learning to Multiple Agents: Issues and a Model for Multi-Agent Machine Learning (Ma-Ml). In: Kodratoff, Y. (ed.) EWSL 1991. LNCS, vol. 482, pp. 440–456. Springer, Heidelberg (1991)
da Silva, J.C., Giannella, C., Bhargava, R., Kargupta, H., Klusch, M.: Distributed Data Mining and Agents. Engineering Applications of Artificial Intelligence 18, 791–807 (2005)
Sliwko, L., Nguyen, N.T.: Using Multi-agent Systems and Consensus Methods for Information Retrival in Internet. International Journal Itelligence Information and Databases Systems 1(2), 181–198 (2007)
Smith, R.E., Jiang, M.K., Bacardit, J., Stout, M., Krasnogor, N., Hirst, J.D.: A Learning Classifier System with Mutual-information-based Fitness. Evolutionary Intelligence 1(3), 31–50 (2010)
Stolfo, S., Prodromidis, L., Tselepis, S., Lee, W., Fan, D.W.: JAM: Java Agentsfor Meta-learning over Distributed Databases. In: 3rd International Conference on Knowledge Discovery and Data Mining, pp. 74–81. AAAI Press, NewportBeach (1997)
Sutton, R.S., Barto, A.G.: Reinforcement Learning. An Introduction. MIT Press, Cambridge (1998)
Symeonidis, A.L., Chatzidimitriou, K.C., Athanasiadis, I.N., Mitkas, P.A.: Data Mining for Agent Reasoning: A synergy for Training Intelligent Agents. Engineering Applications of Artificial Intelligence 20, 1097–1111 (2007)
Symeonidis, A.L., Athanasiadis, I.N., Mitkas, P.A.: A Retraining Methodology for Enhancing Agent Intelligence. Knowledge-Based Systems 20, 388–396 (2008)
Takadama, K., Inoue, H., Shimohara, K., Okada, M., Katai, O.: Agent Architecture Based on an Interactive Self-reflection Classifier System. Artificial Life and Robotics 5, 103–108 (2001)
Talukdar, S., Baerentzen, L., Gove, A., De Souza, P.: Asynchronous Teams: Cooperation Schemes for Autonomous Agents. Journal of Heuristics 4(4), 295–321 (1998)
Tozicka, J., Rovatsos, M., Pechoucek, M., Urban, U.: MALEF: Framework for Distributed Machine Learning and Data Mining. International Journal of Intelligent Information and Database Systems 2(1), 6–24 (2008)
Tweedale, J., Ichalkaranje, N., Sioutis, C., Jarvis, B., Consoli, A., Phillips-Wren, G.E.: Innovations in Multi-agent Systems. Journal of Network and Computer Applications 30(3), 1089–1115 (2007)
Wang, Y.-C., Usher, J.M.: Application of Reinforcement Learning for Agent-based Production Scheduling. Engineering Applications of Artificial Intelligence 18, 73–82 (2005)
Wilson, S.W.: State of XCS Classifier System Research. In: Lanzi, P.L., Stolzmann, W., Wilson, S.W. (eds.) IWLCS 1999. LNCS (LNAI), vol. 1813, pp. 63–81. Springer, Heidelberg (2000)
Yu, L., Yue, W., Wang, S., Lai, K.K.: Support Vector Machine Based Multiagent Ensemble Learning for Credit Risk Evaluation. Expert Systems with Applications 37, 1351–1360 (2010)
Zhang, W.-R., Zhang, L.: A Multiagent Data Warehousing (MADWH) and Multiagent Data Mining (MADM) Approach to Brain Modeling and Neurofuzzy Control. Information Science 167, 109–127 (2004)
Zhang, S., Wu, X., Zhang, C.: Multi-Database Mining. IEEE Computational Intelligence Bulletin 2(1), 5–13 (2003)
Zhu, X., Bin, L., Wu, X., He, D., Zhang, C.: CLAP: Collaborative Pattern Mining for Distributed Information Systems. Decision Support Systems 52, 40–51 (2011)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag Berlin Heidelberg
About this chapter
Cite this chapter
Czarnowski, I., Jędrzejowicz, P. (2013). Machine Learning and Multiagent Systems as Interrelated Technologies. In: Czarnowski, I., Jędrzejowicz, P., Kacprzyk, J. (eds) Agent-Based Optimization. Studies in Computational Intelligence, vol 456. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-34097-0_1
Download citation
DOI: https://doi.org/10.1007/978-3-642-34097-0_1
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-34096-3
Online ISBN: 978-3-642-34097-0
eBook Packages: EngineeringEngineering (R0)