Skip to main content

Co-evolutionary Multi-task Learning for Modular Pattern Classification

  • Conference paper
  • First Online:
Neural Information Processing (ICONIP 2017)

Part of the book series: Lecture Notes in Computer Science ((LNTCS,volume 10639))

Included in the following conference series:

Abstract

Modularity in the learning process is a means by which effective decision making can be maintained when some of the input features are missing. In this paper, co-evolutionary multi-task learning algorithm is used for pattern classification which is robust to situations when some input features are unavailable during the deployment stage of decision support or control systems. The main feature of the algorithm is the ability to make decisions with some degree of error given misinformation. The results show that the method produces results comparable to non-modular methods while having modular features for dynamic and robust pattern classification.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    https://github.com/rohitash-chandra/CMTL-patternclassification.

References

  1. Angeline, P., Saunders, G., Pollack, J.: An evolutionary algorithm that constructs recurrent neural networks. IEEE Trans. Neural Netw. 5(1), 54–65 (1994)

    Article  Google Scholar 

  2. Caruana, R.: Multitask learning. In: Thrun, S., Pratt, L. (eds.) Learning to Learn, pp. 95–133. Springer, Boston (1998)

    Chapter  Google Scholar 

  3. Chandra, R., Frean, M., Zhang, M.: On the issue of separability for problem decomposition in cooperative neuro-evolution. Neurocomputing 87, 33–40 (2012)

    Article  Google Scholar 

  4. Chandra, R., Ong, Y.S., Goh, C.K.: Co-evolutionary multi-task learning for dynamic time series prediction. CoRR abs/1703.01887 (2017). http://arxiv.org/abs/1703.01887

  5. Chandra, R., Ong, Y.S., Goh, C.K.: Co-evolutionary multi-task learning with predictive recurrence for multi-step chaotic time series prediction. Neurocomputing 243, 21–34 (2017)

    Article  Google Scholar 

  6. Chandra, R., Zhang, M.: Cooperative coevolution of Elman recurrent neural networks for chaotic time series prediction. Neurocomputing 186, 116–123 (2012)

    Article  Google Scholar 

  7. Clune, J., Mouret, J.B., Lipson, H.: The evolutionary origins of modularity. Proc. R. Soc. Lond. B Biol. Sci. 280(1755), 20122863 (2013). doi:10.1098/rspb.2012.2863

    Article  Google Scholar 

  8. Dash, M., Liu, H.: Feature selection for classification. Intell. Data Anal. 1(3), 131–156 (1997)

    Article  Google Scholar 

  9. Ellefsen, K.O., Mouret, J.B., Clune, J.: Neural modularity helps organisms evolve to learn new skills without forgetting old skills. PLoS Comput. Biol. 11(4), 1–24 (2015)

    Article  Google Scholar 

  10. Geschwind, N., Behan, P.: Left-handedness: association with immune disease, migraine, and developmental learning disorder. Proc. Natl. Acad. Sci. 79(16), 5097–5100 (1982)

    Article  Google Scholar 

  11. Hansen, N., Müller, S.D., Koumoutsakos, P.: Reducing the time complexity of the derandomized evolution strategy with covariance matrix adaptation (CMA-ES). Evol. Comput. 11(1), 1–18 (2003)

    Article  Google Scholar 

  12. Happel, B.L., Murre, J.M.: Design and evolution of modular neural network architectures. Neural Netw. 7(6–7), 985–1004 (1994)

    Article  Google Scholar 

  13. Johnson, M.K.: A multiple-entry, modular memory system. Psychol. Learn. Motiv. 17, 81–123 (1983). Academic Press

    Article  Google Scholar 

  14. Lee, M.H., Meng, Q., Chao, F.: Developmental learning for autonomous robots. Robot. Auton. Syst. 55(9), 750–759 (2007)

    Article  Google Scholar 

  15. Lichman, M.: UCI Machine Learning Repository. School of Information and Computer Science, University of California, Irvine (2013). http://archive.ics.uci.edu/ml

  16. Meunier, D., Lambiotte, R., Bullmore, E.T.: Modular and hierarchically modular organization of brain networks. Front. Neurosci. 4, 200 (2010). doi:10.3389/fnins.2010.00200

    Article  Google Scholar 

  17. Miller, W.T.: Real-time application of neural networks for sensor-based control of robots with vision. IEEE Trans. Syst. Man Cybern. 19(4), 825–831 (1989)

    Article  Google Scholar 

  18. Potter, M.A., Jong, K.A.: A cooperative coevolutionary approach to function optimization. In: Davidor, Y., Schwefel, H.-P., Männer, R. (eds.) PPSN 1994. LNCS, vol. 866, pp. 249–257. Springer, Heidelberg (1994). doi:10.1007/3-540-58484-6_269

    Chapter  Google Scholar 

  19. Potter, M.A., De Jong, K.A.: Cooperative coevolution: an architecture for evolving coadapted subcomponents. Evol. Comput. 8(1), 1–29 (2000)

    Article  Google Scholar 

  20. Saeys, Y., Inza, I., Larrañaga, P.: A review of feature selection techniques in bioinformatics. Bioinformatics 23(19), 2507–2517 (2007)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Rohitash Chandra .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer International Publishing AG

About this paper

Cite this paper

Chandra, R. (2017). Co-evolutionary Multi-task Learning for Modular Pattern Classification. In: Liu, D., Xie, S., Li, Y., Zhao, D., El-Alfy, ES. (eds) Neural Information Processing. ICONIP 2017. Lecture Notes in Computer Science(), vol 10639. Springer, Cham. https://doi.org/10.1007/978-3-319-70136-3_73

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-70136-3_73

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-70135-6

  • Online ISBN: 978-3-319-70136-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics