Skip to main content
SpringerLink
Log in

Dual preferred learning embedded asynchronous differential evolution with adaptive parameters for engineering applications

  • Published:
Sādhanā Aims and scope Submit manuscript

Abstract

Balance in exploration and exploitation is the basic requirement of any optimization algorithm, lack of which can easily lead to premature convergence of algorithm. Asynchronous Differential Evolution (ADE), a variant of Differential Evolution (DE) algorithm has strong exploration and parallel optimization characteristics. It immediately updates the population with better individuals unlike DE in which the population is updated in next generation only. This feature leads to faster convergence but increases the chances of getting stuck in local optima. To improve the performance of ADE, the mutation operation of the algorithm is enhanced with dual preferred learning (DPL) mutation, and to balance exploration and exploitation, the control parameters are made adaptive in this work. The proposed algorithm is named as DADE (DPL based adaptive ADE). DPL enables learning from individuals having better fitness and diversity hence the proposed combination enhances the convergence rate and population diversity. In addition, inclusion of adaptive control parameters make algorithm more robust. The algorithm is investigated on 25 widely used bench-mark functions and compared with several state-of-the-art algorithms. Non-parametric statistical analysis of the proposed algorithm is also presented backing its performance. Further, it is also tested for engineering design problems. The simulation results show that the proposed work provides promising results and outperforms the competitive algorithms.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Figure 1
Figure 2
Figure 3
Figure 4
Figure 5
Figure 6

Similar content being viewed by others

References

  1. Storn R and Price K 1995 Differential evolution–a simple and efficient heuristic for global optimization over continuous spaces (Tech. Rep.), Berkeley, CA. TR-95-012

  2. Storn R and Price K 1997 Differential evolution–a simple and efficient heuristic for global optimization over continuous spaces. J. Glob. Optim. 11(4): 341–359

    Article  MathSciNet  MATH  Google Scholar 

  3. Rogalsky T, Kocabiyik S and Derksen R W 2000 Differential evolution in aerodynamic optimization. Can. Aeronaut. Space J. 46(4): 183–190

    Google Scholar 

  4. Ilonen J, Kamarainen J K and Lampinen J 2003 Differential evolution training algorithm for feed-forward neural networks. Neural Process. Lett. 17(1): 93–105

    Article  Google Scholar 

  5. Storn R 1996 On the usage of differential evolution for function optimization. In: Proceedings of North American Fuzzy Information Processing. IEEE, pp. 519–523

  6. Monakhov O G, Monakhova E A and Pant M 2016 Application of differential evolution algorithm for optimization of strategies based on financial time series. Numer. Anal. Appl. 2: 150–158

    Article  MATH  Google Scholar 

  7. Dehmollaian M 2010 Through-wall shape reconstruction and wall parameters estimation using differential evolution. IEEE Geosci. Remote Sens. Lett. 8(2): 201–205

    Article  Google Scholar 

  8. Gao Z, Pan Z and Gao J 2014 A new highly efficient differential evolution scheme and its application to waveform inversion. IEEE Geosci. Remote Sens. Lett. 11(10): 1702–1706

    Article  Google Scholar 

  9. Gao Z, Pan Z and Gao J 2016 Multimutation differential evolution algorithm and its application to seismic inversion. IEEE Trans. Geosci. Remote Sens. 54(6): 3626–3636

    Article  Google Scholar 

  10. Zhabitskaya E and Zhabitsky M 2011 Asynchronous differential evolution. In: International Conference on Mathematical Modeling and Computational Physics. Springer, Berlin, Heidelberg, pp. 328–333

  11. Vaishali, Sharma T K, Abraham A and Rajpurohit J 2018 Trigonometric Probability Tuning in Asynchronous Differential Evolution. In: Soft Computing: Theories and Applications. Springer, Singapore, pp. 267–278

  12. Vaishali and Sharma T K 2016 Asynchronous differential evolution with convex mutation. In: Proceedings of fifth international conference on soft computing for problem solving. Springer, Singapore, pp. 915–928

  13. Yadav V, Yadav AK, Kaur M and Singh D 2021 Trigonometric mutation and successful-parent-selection based adaptive asynchronous differential evolution. J. Ambient Intell. Humaniz. Comput. 1–8

  14. Zelinka I and Lampinen J 2000 On stagnation of the differential evolution algorithm. In: Proceedings of Mendel, 6th International Mendel Conference on Soft Computing

  15. Holland J H 1992 Genetic algorithms. Sci. Am. 267: 66–72

    Article  Google Scholar 

  16. Hansen N, Müller S D and Koumoutsakos P 2003 Reducing the time complexity of the derandomized evolution strategy with covariance matrix adaptation (CMAES). Evolut. Comput. 11: 1–18

    Article  Google Scholar 

  17. Rechenberg I 1994 Evolution strategy. Comput. Intel Imitat. Life. 1

  18. Yao X, Liu Y and Lin G 1999 Evolutionary programming made faster. Evolut. Comput. IEEE Trans. 3: 82–102

    Article  Google Scholar 

  19. Fogel DB 1998 Artificial intelligence through simulated evolution. Wiley-IEEE Press, pp. 227–296

  20. Koza JR 1992 Genetic programming: on the programming of computers by means of natural selection. MIT press.

  21. Kennedy J and Eberhart R 1995 Particle swarm optimization, in Neural Networks. In: Proceedings, IEEE International Conference. pp. 1942–1948

  22. Dorigo M, Birattari M and Stutzle T 2006 Ant colony optimization. Comput. Intell. Magaz IEEE. 1: 28–39

    Article  Google Scholar 

  23. Yang X-S 2010 A new metaheuristic bat-inspired algorithm. In: Nature inspired cooperative strategies for optimization (NICSO 2010). Springer, pp. 65–74

  24. Yang X-S and Deb S (2009) Cuckoo search via Lévy flights. In: Nature & Biologically Inspired Computing, NaBIC. pp. 210–14

  25. Mucherino A and Seref O 2007 Monkey search: a novel metaheuristic search for global optimization. In: AIP conference proceedings. p. 162

  26. Martin R, Stephen W 2006 Termite: A swarm intelligent routing algorithm for mobile wireless ad-hoc networks. In: Stigmergic optimization. Springer, Berlin, Heidelberg, pp. 155–184

  27. Abbass H A 2001 MBO: Marriage in honey bees optimization – a haplometrosis polygynous swarming approach. In: Evolutionary computation, Proceedings of the 2001 congress. pp. 207–214

  28. Lu X and Zhou Y 2008 A novel global convergence algorithm: bee collecting pollen algorithm. In: Advanced intelligent computing theories and applications. With Aspects of Artificial Intelligence, ed.: Springer, p. 518–25

  29. Gandomi A H and Alavi A H 2012 Krill herd: a new bio-inspired optimization algorithm. Commun. Nonlinear. Sci. Numer. Simul. 17(12): 4831–4845

  30. Li X 2003 A new intelligent optimization-artificial fish swarm algorithm. Doctor thesis, Zhejiang University of Zhejiang, China

  31. Hatamlou A 2012 Black hole: a new heuristic optimization approach for data clustering. Inf. Sci. 222: 175–184

    Article  MathSciNet  Google Scholar 

  32. Rashedi E, Nezamabadi-Pour H and Saryazdi S 2009 GSA: a gravitational search algorithm. Inf. Sci. 179: 2232–2248

    Article  MATH  Google Scholar 

  33. Erol O K and Eksin I 2006 A new optimization method: big bang–big crunch. Adv. Eng. Softw. 37: 106–111

    Article  Google Scholar 

  34. Webster B and Bernhard P J 2003 A local search optimization algorithm based on natural principles of gravitation. In: Proceedings of the 2003 international conference on information and knowledge engineering (IKE’03), Las Vegas.Nevada, USA, pp. 255–61

  35. Shah-Hosseini H 2011 Principal components analysis by the galaxy-based search algorithm: a novel metaheuristic for continuous optimisation. Int. J. Comput. Sci. Eng. 6: 132–140

    Google Scholar 

  36. Milani A and Santucci V 2010 Asynchronous Differential Evolution. In: Proc. 2010 IEEE Congr. Evol. Comput. pp. 1210–1216

  37. Zhabitsky M and Zhabitskaya E 2013 Asynchronous differential evolution with adaptive correlation matrix. In: Proceedings of the 15th annual conference on Genetic and evolutionary computation. pp. 455-462

  38. Zhabitskaya E I, Vand Zemlyanaya E and Kiselev M A 2015 Numerical analysis of SAXS-data from vesicular systems by asynchronous differential evolution method. Matematicheskoe Modelirovanie. 27(7): 58–64

    MathSciNet  MATH  Google Scholar 

  39. Vaishali, Sharma T K, Abraham A and Rajpurohit J (2016) Enhanced Asynchronous Differential Evolution Using Trigonometric Mutation. In: International Conference on Soft Computing and Pattern Recognition. Springer, Cham., pp. 386–397

  40. Sharma T K 2018 Modified mutation in asynchronous differential evolution. Int. J. Appl. Evolut. Comput. (IJAEC). 9(1): 52–63

    Article  Google Scholar 

  41. Zhabitskaya E and Zhabitsky M 2012 Asynchronous differential evolution with restart. In: International Conference on Numerical Analysis and Its Applications. Springer, Berlin, Heidelberg, pp. 555–561

  42. Zhabitskaya E 2011 Constraints on control parameters of asynchronous differential evolution. In: International Conference on Mathematical Modeling and Computational Physics. Springer, Berlin, Heidelberg, pp. 322–327

  43. Zhabitskaya E, Zemlyanaya E, Kiselev M and Gruzinov A 2016 The Parallel Asynchronous Differential Evolution Method as a Tool to Analyze Synchrotron Scattering Experimental Data from Vesicular Systems. In: EPJ Web of Conferences, EDP Sciences, Vol. 108, p. 02047

  44. Zhabitskaya E I, Zemlyanaya E V and Kiselev M A 2014 Unilameller DMPC vesicles structure analysis using parallel asynchronous differential evolution. Discrete Continuous Models Appl. Comput. Sci. 15(2): 253–258

    Google Scholar 

  45. Zhabitsky M 2016 Comparison of the Asynchronous Differential Evolution and JADE Minimization Algorithms. In: EPJ Web of Conferences, EDP Sciences, Vol. 108, p. 02048

  46. Liu J and Lampinen J 2002 On Setting the Control Parameter of the Differential Evolution Method. In: Proc. of 8th Int. Conf. Soft Computing (MENDEL 2002), pp. 11–18

  47. Gämperle R, Müller S D and Koumoutsakos P 2002A Parameter Study for Differential Evolution. WSEAS NNA-FSFS-EC 2002. Interlaken, Switzerland, pp. 293–298

  48. Liu J and Lampinen J 2005 A fuzzy adaptive differential evolution algorithm. Soft computing: a fusion of foundations. Methodol. Appl. 9(6): 448–462

    MATH  Google Scholar 

  49. Al-Dabbagh R D, Neri F, Idris N and Baba M S 2018 Algorithmic design issues in adaptive differential evolution schemes: Review and taxonomy. Swarm Evolut. Comput. 43: 284–311

    Article  Google Scholar 

  50. Tanabe R and Fukunaga A 2013 Success-History Based Parameter Adaptation for Differential Evolution. In: IEEE Congress on Evolutionary Computation (CEC). pp. 71–78

  51. Fu C M, Jiang C, Chen G S and Liu Q M 2017 An adaptive differential evolution algorithm with an aging leader and challengers mechanism. Appl. Soft Comput. 57: 60–73

    Article  Google Scholar 

  52. Sun G, Yang B, Yang Z and Xu G 2020 An adaptive differential evolution with combined strategy for global numerical optimization. Soft Comput. 24: 6277–6296. https://doi.org/10.1007/s00500-019-03934-3

    Article  Google Scholar 

  53. Zhao X, Xu G, Rui L, Liu D, Liu H and Yuan J 2019 A failure remember-driven self-adaptive differential evolution with top-bottom strategy. Swarm Evolut. Comput. 45: 1–4

    Article  Google Scholar 

  54. Duan M, Yang H, Wang S and Liu Y 2019 Self-adaptive dual-strategy differential evolution algorithm. Plos one. 14(10): e0222706. https://doi.org/10.1371/journal.pone.0222706

    Article  Google Scholar 

  55. Duan M, Yang H, Liu H and Chen J 2019 A differential evolution algorithm with dual preferred learning mutation. Appl. Intell. 49(2): 605–627

    Article  Google Scholar 

  56. Zhong X, Cheng P 2020 An Improved Differential Evolution Algorithm Based on Dual-Strategy. Mathematical Problems in Engineering. 2020.

  57. Awad NH, Ali MZ, Liang JJ et al. (2017) CEC 2017 special session on single objective numerical optimization single bound constrained real-parameter numerical optimization 2017

  58. Wu G, Mallipeddi R, and Suganthan P N 2017 Problem definitions and evaluation criteria for the CEC 2017 competition on constrained real-parameter optimization. Technical Report, National University of Defense Technology, Changsha, Hunan, PR China and Kyungpook National University, Daegu, South Korea and Nanyang Technological University, Singapore

  59. Choi T J and Lee Y 2018 Asynchronous differential evolution with self adaptive parameter control for global numerical optimization. In: MATEC Web of Conferences. EDP Sciences, Vol. 189, pp. 03020

  60. Tanabe R and Fukunaga A S 2014 Improving the search performance of SHADE using linear population size reduction. In: 2014 IEEE congress on Evolutionary Computation (CEC). IEEE, pp. 1658–1665

  61. Bilel N, Mohamed N, Zouhaier A and Lotfi R 2019 An efficient evolutionary algorithm for engineering design problems. Soft Comput. 23(15): 6197–6213

    Article  Google Scholar 

  62. Wu G, Mallipeddi R, Suganthan P N, Wang R and Chen H 2016 Differential evolution with multi-population based ensemble of mutation strategies. Inf. Sci. 329: 329–345

    Article  Google Scholar 

  63. Wang S H, Li Y Z, and Yang H Y 2019 Self-adaptive mutation differential evolution algorithm based on particle swarm optimization. Appl. Soft Comput. 81: 105496

  64. García S, Molina D, Lozano M and Herrera F 2009 A study on the use of non-parametric tests for analyzing the evolutionary algorithms’ behaviour: a case study on the CEC’2005 special session on real parameter optimization. J. Heuristics. 15(6): 617–644

    Article  MATH  Google Scholar 

  65. Kannan B and Kramer S N 1994 An augmented lagrange multiplier-based method for mixed integer discrete continuous optimization and its applications to mechanical design. J. Mech. Des. 116(2): 405–411

    Article  Google Scholar 

  66. Coello Coello C A and Mezura Montes E 2002 Constraint-handling in genetic algorithms through the use of dominance-based tournament selection. Adv. Eng. Inform. 16: 193–203

    Article  Google Scholar 

  67. Huang F, Wang L and He Q 2007 An effective co-evolutionary differential evolution for constrained optimization. Appl. Math. Comput. 186: 340–356

    MathSciNet  MATH  Google Scholar 

  68. He Q and Wang L 2007 An effective co-evolutionary particle swarm optimization for constrained engineering design problems. Eng. Appl. Artif. Intell. 20: 89–99

    Article  Google Scholar 

  69. Coello Coello C A 2000 Use of a self-adaptive penalty approach for engineering optimization problems. Comput. Ind. 41: 113–127

    Article  MATH  Google Scholar 

  70. Mirjalili S, Mirjalili S M and Lewis A 2014 Grey wolf optimizer. Adv. Eng. Soft-ware. 69: 46–61. https://doi.org/10.1016/j.advengsoft.2013.12.007

    Article  Google Scholar 

  71. Dhiman G and Kumar V 2017 Spotted hyena optimizer: a novel bio-inspired based metaheuristic technique for engineering applications. Adv. Eng. Softw. 114: 48–70

    Article  Google Scholar 

  72. Kaveh A and Talatahari S 2010 An improved ant colony optimization for constrained engineering design problems. Eng. Comput. Int. J. Comput-Aided Eng. 27: 155–182

    MATH  Google Scholar 

  73. Arora J S 2004 Introduction to optimum design. Elsevier, Academic Press

    Book  Google Scholar 

  74. Belegundu A D and Arora J S 1985 A Study of mathematical programming methods for structural optimization. Part I: Theory. Int. J. Numer. Meth. Eng. 21: 1583–1599

    Article  MATH  Google Scholar 

  75. Xu Yang and Qiu Ting Ting 2021 Human activity recognition and embedded application based on convolutional neural network. J. Artif. Intell. Technol. 1(1): 51–60

    Article  Google Scholar 

  76. Singh D, Kumar V, Yadav V and Kaur M 2021 Deep neural network-based screening model for COVID-19-infected patients using chest X-ray images. Int. J. Pattern Recogn. Artif. Intell. 35(3): 2151004

    Article  Google Scholar 

  77. Jiang D, Hu G, Qi G and Mazur N 2021 A fully convolutional neural network-based regression approach for effective chemical composition analysis using near-infrared spectroscopy in cloud. J. Artif. Intell. Technol. 1(1): 74–82

    Article  Google Scholar 

  78. Kaur Manjit and Singh Dilbag 2021 Multi-modality medical image fusion technique using multi-objective differential evolution based deep neural networks. J. Ambient Intell. Hum. Comput. 12(2): 2483–2493

    Article  Google Scholar 

  79. Ghosh S, Shivakumara P, Roy P, Pal U and Lu T 2020 Graphology based handwritten character analysis for human behaviour identification. CAAI Trans. Intell. Technol. 5(1): 55–65

    Article  Google Scholar 

  80. Kaur Manjit and Singh Dilbag 2021 Multiobjective evolutionary optimization techniques based hyperchaotic map and their applications in image encryption. Multidimensional Syst. Signal Process. 32(1): 281–301

    Article  MATH  Google Scholar 

  81. Gupta B, Tiwari M and Lamba S S 2019 Visibility improvement and mass segmentation of mammogram images using quantile separated histogram equalisation with local contrast enhancement. CAAI Trans. Intell. Technol. 4(2): 73–79

    Article  Google Scholar 

  82. Kaur Manjit, Singh Dilbag and Kumar Vijay 2020 Color image encryption using minimax differential evolution-based 7D hyper-chaotic map. Appl. Phys. B 126(9): 1–19

    Article  Google Scholar 

  83. Basavegowda H S and Dagnew G 2020 Deep learning approach for microarray cancer data classification. CAAI Trans. Intell. Technol. 5(1): 22–33

    Article  Google Scholar 

  84. Hu G, Chen S-HK and Mazur N 2021 Deep neural network-based speaker-aware information logging for augmentative and alternative communication. J. Artif. Intell. Technol. 1(2): 138–143

    Article  Google Scholar 

  85. Gianchandani Neha, Jaiswal Aayush, Singh Dilbag, Kumar Vijay and Kaur Manjit 2020 Rapid COVID-19 diagnosis using ensemble deep transfer learning models from chest radiographic images. J. Ambient Intell. Hum. Comput.. https://doi.org/10.1007/s12652-020-02669-6

    Article  Google Scholar 

  86. Rajpurohit J, Sharma T K and AbrahamVaishali A A 2017 Glossary of metaheuristic algorithms. Int. J. Comput. Inf. Syst. Ind. Manag. Appl. 9: 181–205

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Computer and Communication Engineering, Manipal University Jaipur, Jaipur, Rajasthan, India

    Vaishali Yadav

  2. ASET, Amity University Rajasthan, Jaipur, Rajasthan, India

    Ashwani Kumar Yadav

  3. Computer Science Engineering, School of Engineering and Applied Sciences, Bennett University, Greater Noida, India

    Manjit Kaur & Dilbag Singh

Authors
  1. Vaishali Yadav
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Ashwani Kumar Yadav
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Manjit Kaur
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Dilbag Singh
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Ashwani Kumar Yadav.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Yadav, V., Yadav, A.K., Kaur, M. et al. Dual preferred learning embedded asynchronous differential evolution with adaptive parameters for engineering applications. Sādhanā 46, 180 (2021). https://doi.org/10.1007/s12046-021-01677-2

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s12046-021-01677-2

Keywords

Search

Navigation