Skip to main content
SpringerLink
Log in

Machine Learning-Based Decision Making in Evolutionary Multiobjective Clustering

  • Conference paper
  • First Online:
Advances in Computational Intelligence (MICAI 2022)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 13612))

Included in the following conference series:

Abstract

Clustering is an important optimization problem which is at the core of many data mining and machine learning applications. Evolutionary multiobjective clustering algorithms optimize multiple partition quality criteria simultaneously, producing a set of trade-off solutions in a single execution. How can a final solution be selected from this set of candidate trade-offs? Decision making is concerned with such a task, acknowledging that obtaining a single solution may represent the ultimate goal in practice. Given the limitations of current techniques, we explore a novel approach to decision making: tackling this task as a supervised learning problem. Our approach attempts to learn from the decision-making process in example (training) problems, with the aim of later applying the learned model to lead the identification of final solutions in new applications. In this paper, we present preliminary results on the evaluation of this proposal. Our experiments include comparisons with respect to a set of decision-making approaches from the literature and consider a collection of synthetic clustering problems with diverse characteristics. The results obtained are promising, highlighting the relevance of devising alternative decision-making strategies, the effectiveness of our proposal, and motivating further research on this matter.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 69.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 89.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Abu Khurma, R., Aljarah, I.: A review of multiobjective evolutionary algorithms for data clustering problems. In: Aljarah, I., Faris, H., Mirjalili, S. (eds.) Evolutionary Data Clustering: Algorithms and Applications. AIS, pp. 177–199. Springer, Singapore (2021). https://doi.org/10.1007/978-981-33-4191-3_8

    Chapter  Google Scholar 

  2. Bandyopadhyay, S., Maulik, U., Mukhopadhyay, A.: Multiobjective genetic clustering for pixel classification in remote sensing imagery. IEEE Trans. Geosci. Remote Sens. 45(5), 1506–1511 (2007). https://doi.org/10.1109/TGRS.2007.892604

    Article  Google Scholar 

  3. Bandyopadhyay, S., Mukhopadhyay, A., Maulik, U.: An improved algorithm for clustering gene expression data. Bioinformatics 23(21), 2859 (2007)

    Article  Google Scholar 

  4. Breiman, L.: Random forests. Mach. Learn. 45(1), 5–32 (2001)

    Article  Google Scholar 

  5. Deb, K., Gupta, S.: Understanding knee points in bicriteria problems and their implications as preferred solution principles. Eng. Optim. 43(11), 1175–1204 (2011). https://doi.org/10.1080/0305215X.2010.548863

    Article  MathSciNet  Google Scholar 

  6. Delattre, M., Hansen, P.: Bicriterion cluster analysis. IEEE Trans. Pattern Anal. Mach. Intell. PAMI-2(4), 277–291 (1980). https://doi.org/10.1109/TPAMI.1980.4767027

  7. Garcia-Piquer, A., Sancho-Asensio, A., Fornells, A., Golobardes, E., Corral, G., Teixidó-Navarro, F.: Toward high performance solution retrieval in multiobjective clustering. Inf. Sci. 320, 12–25 (2015). https://doi.org/10.1016/j.ins.2015.04.041

    Article  MathSciNet  Google Scholar 

  8. Garza-Fabre, M., Handl, J., Knowles, J.: An improved and more scalable evolutionary approach to multiobjective clustering. IEEE Trans. Evol. Comput. 22(4), 515–535 (2018). https://doi.org/10.1109/TEVC.2017.2726341

  9. Handl, J., Knowles, J.: An evolutionary approach to multiobjective clustering. IEEE Trans. Evol. Comput. 11(1), 56–76 (2007). https://doi.org/10.1109/TEVC.2006.877146

    Article  Google Scholar 

  10. Handl, J., Knowles, J.: Evolutionary multiobjective clustering. In: Yao, X., et al. (eds.) PPSN 2004. LNCS, vol. 3242, pp. 1081–1091. Springer, Heidelberg (2004). https://doi.org/10.1007/978-3-540-30217-9_109

    Chapter  Google Scholar 

  11. Handl, J., Knowles, J.: Exploiting the trade-off — the benefits of multiple objectives in data clustering. In: Coello Coello, C.A., Hernández Aguirre, A., Zitzler, E. (eds.) EMO 2005. LNCS, vol. 3410, pp. 547–560. Springer, Heidelberg (2005). https://doi.org/10.1007/978-3-540-31880-4_38

    Chapter  Google Scholar 

  12. Huang, D., Wang, C.D., Lai, J.H.: Locally weighted ensemble clustering. IEEE Trans. Cybernet. 48, 1460–1473 (2018). https://doi.org/10.1109/TCYB.2017.2702343

  13. José-García, A., Handl, J., Gómez-Flores, W., Garza-Fabre, M.: An evolutionary many-objective approach to multiview clustering using feature and relational data. Appl. Soft Comput. 108, 107425 (2021). https://doi.org/10.1016/j.asoc.2021.107425

    Article  Google Scholar 

  14. Liu, Y., Özyer, T., Barker, K.: Integrating multi-objective genetic algorithm and validity analysis for locating and ranking alternative clustering. Informatica (Slovenia) 29, 33–40 (2005)

    Google Scholar 

  15. Matake, N., Hiroyasu, T., Miki, M., Senda, T.: Multiobjective clustering with automatic k-determination for large-scale data. In: Proceedings of the 9th Annual Conference on Genetic and Evolutionary Computation, pp. 861–868, GECCO 2007. Association for Computing Machinery, London (2007). https://doi.org/10.1145/1276958.1277126

  16. Maulik, U., Bandyopadhyay, S., Mukhopadhyay, A.: Multiobjective Genetic Algorithm-Based Fuzzy Clustering, pp. 89–121. Springer, Heidelberg (2011). https://doi.org/10.1007/978-3-642-16615-0_5

  17. Mukhopadhyay, A., Maulik, U., Bandyopadhyay, S.: Multiobjective genetic algorithm-based fuzzy clustering of categorical attributes. IEEE Trans. Evol. Comput. 13(5), 991–1005 (2009)

    Article  Google Scholar 

  18. Mukhopadhyay, A., Maulik, U., Bandyopadhyay, S.: A survey of multiobjective evolutionary clustering. ACM Comput. Surv. 47(4), 61:1–61:46 (2015). https://doi.org/10.1145/2742642

  19. Mukhopadhyay, A., Maulik, U., Bandyopadhyay, S.: Multiobjective genetic clustering with ensemble among pareto front solutions: application to MRI brain image segmentation. In: 2009 Seventh International Conference on Advances in Pattern Recognition, pp. 236–239 (2009). https://doi.org/10.1109/ICAPR.2009.51

  20. Özyer, T., Liu, Y., Alhajj, R., Barker, K.: Multi-objective genetic algorithm based clustering approach and its application to gene expression data. In: Yakhno, T. (ed.) ADVIS 2004. LNCS, vol. 3261, pp. 451–461. Springer, Heidelberg (2004). https://doi.org/10.1007/978-3-540-30198-1_46

    Chapter  Google Scholar 

  21. Qian, X., Zhang, X., Jiao, L., Ma, W.: Unsupervised texture image segmentation using multiobjective evolutionary clustering ensemble algorithm. In: IEEE Congress on Evolutionary Computation, pp. 3561–3567 (2008). https://doi.org/10.1109/CEC.2008.4631279

  22. Rand, W.M.: Objective criteria for the evaluation of clustering methods. J. Am. Stat. Assoc. 66(336), 846–850 (1971)

    Article  Google Scholar 

  23. Shirakawa, S., Nagao, T.: Evolutionary image segmentation based on multiobjective clustering. In: IEEE Congress on Evolutionary Computation, pp. 2466–2473 (2009). https://doi.org/10.1109/CEC.2009.4983250

  24. Strehl, A., Ghosh, J.: Cluster ensembles - a knowledge reuse framework for combining multiple partitions. J. Mach. Learn. Res. 3, 583–617 (2003). https://doi.org/10.1162/153244303321897735

  25. Zhu, S., Xu, L., Goodman, E.D.: Evolutionary multi-objective automatic clustering enhanced with quality metrics and ensemble strategy. Knowl.-Based Syst. 188, 105018 (2020). https://doi.org/10.1016/J.KNOSYS.2019.105018

Download references

Author information

Authors and Affiliations

  1. Center for Research and Advanced Studies, Cinvestav Campus Tamaulipas, 87130, Ciudad Victoria, Tamaulipas, Mexico

    Aarón Leonardo Sánchez-Martínez, Mario Garza-Fabre, Ricardo Landa & Edwin Aldana-Bobadilla

  2. National Council of Science and Technology of Mexico, Conacyt, Mexico City, Mexico

    Edwin Aldana-Bobadilla

Authors
  1. Aarón Leonardo Sánchez-Martínez
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Mario Garza-Fabre
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Ricardo Landa
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Edwin Aldana-Bobadilla
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Mario Garza-Fabre .

Editor information

Editors and Affiliations

  1. Instituto Politécnico Nacional, Mexico, Mexico

    Obdulia Pichardo Lagunas

  2. Centro de Investigación Científica y de Educación Superior de Ensenada, Ensenada, Baja California, Mexico

    Juan Martínez-Miranda

  3. Instituto Politécnico Nacional, Mexico, Mexico

    Bella Martínez Seis

Rights and permissions

Reprints and permissions

Copyright information

© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Sánchez-Martínez, A.L., Garza-Fabre, M., Landa, R., Aldana-Bobadilla, E. (2022). Machine Learning-Based Decision Making in Evolutionary Multiobjective Clustering. In: Pichardo Lagunas, O., Martínez-Miranda, J., Martínez Seis, B. (eds) Advances in Computational Intelligence. MICAI 2022. Lecture Notes in Computer Science(), vol 13612. Springer, Cham. https://doi.org/10.1007/978-3-031-19493-1_10

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-19493-1_10

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-19492-4

  • Online ISBN: 978-3-031-19493-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation