Abstract
Differential search (DSA) is a recently proposed evolutionary algorithm mimicking the Brownian motion-like random movement existing in living beings. Though it has displayed promise for global optimization, the original DSA suffers from relatively poor search capability, especially for exploitation. In this study, an augmented DSA (ADSA) is proposed by integrating memetic framework with multiple strategies. In ADSA, a sub-gradient strategy is combined to improve local exploitation, and the dynamic Lévy flight technique is developed to strengthen the global exploration. Moreover, a mutation operator based on differential search is used to increase swarm diversity. An intelligent selection method is implemented to adaptively adjust the strategies based on historical performance. To fully benchmark the proposed algorithm, 35 test functions of various properties in 30-D and 100-D are adopted in numerical experiments. Seven canonical optimization algorithms are involved for experimental comparison. In addition, two real-world problems are also tested to verify ADSA’s practical applicability. Numerical results reveal the efficiency and effectiveness of ADSA.
Similar content being viewed by others
References
Chu X, Wu T, Weir JD, Shi Y, Niu B, Li L (2018) Learning–Interaction–diversification framework for swarm intelligence optimizers: a unified perspective. Neural Comput Appl. https://doi.org/10.1007/s00521-018-3657-0
Kennedy J, Eberhart RC (1995) Particle swarm optimization. In: Proceedings of the 1995 IEEE international conference on neural networks. Piscataway, New Jersey, USA, pp 1942–1948
Shi Y, Eberhart R (1998) A modified particle swarm optimizer. In: IEEE WCCI, IEEE, pp 69–73
Saha S, Das R (2018) Exploring differential evolution and particle swarm optimization to develop some symmetry-based automatic clustering techniques: application to gene clustering. Neural Comput Appl 30(3):735–757
Dorigo M, Birattari M, Stutzle T (2006) Ant colony optimization. IEEE Comput Intell M 1(4):28–39
Dorigo M, Stützle T (2003) The ant colony optimization metaheuristic: Algorithms, applications, and advances. Handbook of metaheuristics. Springer, Boston, pp 250–285
Karaboga D, Akay B (2009) A comparative study of Artificial Bee Colony algorithm. Appl Math Comput 214(1):108–132
Karaboga D, Gorkemli B, Ozturk C, Karaboga N (2014) A comprehensive survey: artificial bee colony (ABC) algorithm and applications. Artif Intell Rev 42(1):21–57
Chu X, Cai F, Cui C, Hu M, Li L, Qin Q (2018) Adaptive recommendation model using meta-learning for population-based algorithms. Inf Sci 476:192–210
Qin Q, Cheng S, Chu X, Lei X, Shi Y (2017) Solving non-convex/non-smooth economic load dispatch problems via an enhanced particle swarm optimization. Appl Soft Comput 59:229–242
Chu X, Chen J, Cai F, Li L, Qin Q (2018) Adaptive brainstorm optimisation with multiple strategies. Memet Comput 10(4):383–396
Chu X, Xu S, Cai F, Chen J, Qin Q (2018) An efficient auction mechanism for regional logistics synchronization. J Intell Manuf. https://doi.org/10.1007/s10845-018-1410-2
Milner S, Davis C, Zhang H, Llorca J (2012) Nature-inspired self-organization, control, and optimization in heterogeneous wireless networks. IEEE Trans Mob Comput 11(7):1207–1222
Zhang H, Cao X, Ho JK, Chow TW (2017) Object-level video advertising: an optimization framework. IEEE Trans Ind Inform 13(2):520–531
Marinakis Y, Marinaki M, Migdalas A (2019) A multi-adaptive particle swarm optimization for the vehicle routing problem with time windows. Inf Sci 481:311–329
Wu Z, Tazvinga H, **a XH (2015) Demand side management of photovoltaic-battery hybrid system. Appl Energy 148:294–304
Chaudhry R, Tapaswi S, Kumar N (2019) Fz enabled multi-objective pso for multicasting in IoT based wireless sensor networks. Inf Sci 498:1–20
Łapa K (2019) Meta-optimization of multi-objective population-based algorithms using multi-objective performance metrics. Inf Sci 489:193–204
Amirsadri S, Mousavirad SJ, Ebrahimpour-Komleh H (2018) A Lévy flights-based grey wolf optimizer combined with back-propagation algorithm for neural network training. Neural Comput Appl 30(12):3707–3720
Chou JS, Ngo NT (2018) Engineering strength of fiber-reinforced soil estimated by swarm intelligence optimized regression system. Neural Comput Appl 30(7):2129–2144
Civicioglu P (2012) Transforming geocentric cartesian coordinates to geodetic coordinates by using differential search algorithm. Comput Geosci-UK 46(3):229–247
Abaci K, Yamacli V (2016) Differential search algorithm for solving multi-objective optimal power flow problem. Int J Electr Power 79:1–10
Bouchekara EH, Abido MA (2014) Optimal power flow using differential search algorithm. Electr Power Compon Syst 42(15):1683–1699
Yousoff SNM, Baharin A, Abdullah A (2017) Differential search algorithm in deep neural network for the predictive analysis of xylitol production in escherichia coli. Asian simulation conference. Springer, Singapore, pp 53–67
Arul R, Velusami S, Ravi G (2015) Solving combined economic emission dispatch problems using self-adaptive differential harmony search algorithm. In: International conference on circuit, power and computing technologies, IEEE, pp 757–762.
RayapudiSrinivasaRao Satish K, Narasimham SVL (2011) Optimal conductor size selection in distribution systems using the harmony search algorithm with a differential operator. Electr Mach Power Syst 40(1):41–56
Sandeepdhar GD, Rout S, Badhai H, Swain M, Bhattacharya A (2015) Differential search algorithm for different economic dispatch problem. In: International conference on energy, power and environment: towards sustainable growth, IEEE, pp 1–6.
Sulaiman MH (2013) Differential search algorithm for economic dispatch with valve-point effects, In: ICEAS, Tokyo, Toshi Center Hotel, pp 111–117
Kumar V, Chhabra JK, Kumar D (2016) Data clustering using differential search algorithm. Pertan J Sci Technol 24(2):295–306
Liu B (2014) Composite differential search algorithm. J Appl Math 2014(119):1–15
Guha D, Roy PK, Banerjee S (2016) Quasi-oppositional differential search algorithm applied to load frequency control. Eng Sci Technol Int J 19(4):1635–1654
Chen G-z, Wang J-q, Li R-z (2015) Parameter identification of the 2-chlorophenol oxidation model using improved differential search algorithm. J Chem-NY 2015:1–10
Islam NN, Hannan MA, Shareef H, Mohamad A (2015) Bijective differential search algorithm for robust design of dam** controller in multimachine power system. Appl Mech Mater 785:424–428
Kumar V, Chhabra JK, Kumar D (2015) Differential search algorithm for multiobjective problems. Procedia Comput Sci 48:22–28
Liu J, Wu C, Cao J, Wang X, Teo KL (2016) A binary differential search algorithm for the 0–1 multidimensional knapsack problem. Appl Math Model 40(23–24):9788–9805
Faria P, Soares J, Vale Z (2015) Definition of the demand response events duration using differential search algorithm for aggregated consumption shifting and generation scheduling. In: ISAP, IEEE, pp 1–7
Yang XS (2010) Firefly algorithm, Levy flights and global optimization. In: Research and development in intelligent systems XXVI, Springer, pp 209–218
Boyd S, Mutapcic A (2003) Subgradient methods. In: Lecture notes of EE392o, Stanford University, Autumn Quarter, pp 1–21
Trianni V, Tuci E, Passino KM, Marshall JAR (2011) Swarm Cognition: an interdisciplinary approach to the study of self-organising biological collectives. Swarm Intell 5(1):3–18
Vagelis P, Manolis P (2011) A hybrid particle swarm - gradient algorithm for global structural optimization. Comput-Aided Civ Inf 26(1):48–68
Spall JC (1992) Multivariate stochastic approximation using a simultaneous perturbation gradient approximation. IEEE T Autom Control 37(3):332–341
Yang XS (2010) Nature-inspired metaheuristic algorithms. Luniver Press
Sharma H, Bansal JC, Arya KV, Yang XS (2016) Lévy flight artificial bee colony algorithm. Int J Syst Sci 47(2016):4750–4756
Hu M, Wu T, Weir JD (2012) An intelligent augmentation of particle swarm optimization with multiple adaptive methods. Inf Sci 213:68–83
Chu X, Hu M, Wu T, Weir JD, Lu Q (2014) AHPS2: an optimizer using adaptive heterogeneous particle swarms. Inf Sci 280:26–52
Liang JJ, Qin AK, Suganthan PN, Baskar S (2006) Comprehensive learning particle swarm optimizer for global optimization of multimodal functions. IEEE T Evol Comput 10(3):281–295
Karaboga D, Basturk B (2007) A powerful and efficient algorithm for numerical function optimization: artificial bee colony (ABC) algorithm. J Global Optim 39(3):459–471
Yang XS, Deb S (2009) Cuckoo search via Lévy flights. In: NaBIC 2009, IEEE, pp 210–214
Tang R, Fong S, Yang XS, Deb S (2012) Wolf search algorithm with ephemeral memory. In: ICDIM 2012, IEEE, pp 165–172
Yang XS (2010) Firefly algorithm, stochastic test functions and design optimisation. Int J Bio-Inspir Com 2(2):78–84
Das S, Suganthan PN (2011) Problem definitions and evaluation criteria for CEC 2011 competition on testing evolutionary algorithms on real world optimization problems. In: Jadavpur University, Nanyang Technological University, Kolkata, pp 341–359
Bai X, Tao R, Wang Z, Wang Y (2013) ISAR imaging of a ship target based on parameter estimation of multicomponent quadratic frequency-modulated signals. IEEE Trans Geosci Remote Sens 52(2):1418–1429
Moloi NP, Ali MM (2005) An iterative global optimization algorithm for potential energy minimization. Comput Optim Appl 30(2):119–132
Liang JJ, Qu BY, Suganthan PN (2014) Problem definitions and evaluation criteria for the CEC 2014 special session and competition on single objective real-parameter numerical optimization. In: Computational intelligence laboratory, Zhengzhou University, Zhengzhou China and Technical Report, Nanyang Technological University, Singapore, p 635
Acknowledgements
This work was partially supported by the National Natural Science Foundation of China (Grant No. 71971142 and 71871146), the Major Research plan of the National Natural Science Foundation of China (No. 91846301), the Major Project for National Natural Science Foundation of China (Grant No. 71790615), and the Natural Science Foundation of Guangdong Province (Grant No. 2016A030310067).
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
No conflict of interest exists in the submission of this manuscript. I would like to declare on behalf of my co-authors that this manuscript is the authors’ original work and has not been published nor has it been submitted simultaneously elsewhere.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Appendices
Appendix 1: Benchmark functions
See Table 11.
Appendix 2: Algorithm pseudo-code of DSA
Appendix 3: Algorithm pseudo-code of ADSA
Rights and permissions
About this article
Cite this article
Chu, X., Gao, D., Chen, J. et al. Adaptive differential search algorithm with multi-strategies for global optimization problems. Neural Comput & Applic 31, 8423–8440 (2019). https://doi.org/10.1007/s00521-019-04538-6
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00521-019-04538-6