Abstract
The particle swarm optimization (PSO) is a population-based stochastic optimization technique by the social behavior of bird flocking and fish schooling. The PSO has a high convergence rate. It is prone to losing diversity along the iterative optimization process and may get trapped into a poor local optimum. Overcoming these defects is still a significant problem in PSO applications. In contrast, the backtracking search optimization algorithm (BSA) has a robust global exploration ability, whereas, it has a low local exploitation ability and converges slowly. This paper proposed an improved PSO with BSA called PSOBSA to resolve the original PSO algorithm’s problems that BSA’s mutation and crossover operators were modified through the neighborhood to increase the convergence rate. In addition to that, a new mutation operator was introduced to improve the convergence accuracy and evade the local optimum. Several benchmark problems are used to test the performance and efficiency of the proposed PSOBSA. The experimental results show that PSOBSA outperforms other well-known metaheuristic algorithms and several state-of-the-art PSO variants in terms of global exploration ability and accuracy, and rate of convergence on almost all of the benchmark problems.
Similar content being viewed by others
References
Gharehchopogh FS, Shayanfar H, Ghoglizadeh H (2019) A comprehensive survey on symbiotic organisms search algorithms. Artif Intell Rev 53:1–48
Stodola P (2020) Hybrid ant colony optimization algorithm applied to the multi-depot vehicle routing problem. Nat Comput 19:1–13
Gharehchopogh FS, Gholizadeh H (2019) A comprehensive survey: Whale Optimization Algorithm and its applications. Swarm Evol Comput 48:1–24
Srivastava S, Sahana SK (2019) A survey on traffic optimization problem using biologically inspired techniques. Nat Comput 19:1–15
Benyamin A, Farhad SG, Saeid B (2021) Discrete farmland fertility optimization algorithm with metropolis acceptance criterion for traveling salesman problems. Int J Intell Syst 36(3):1270–1303
Storn R, Price K (1997) Differential evolution—a simple and efficient heuristic for global optimization over continuous spaces. J Glob Optim 11(4):341–359
Rashedi E, Nezamabadi-Pour H, Saryazdi S (2009) GSA: a gravitational search algorithm. Inf Sci 179(13):2232–2248
Rao RV, Savsani VJ, Vakharia D (2011) Teaching–learning-based optimization: a novel method for constrained mechanical design optimization problems. Comput Aided Des 43(3):303–315
Gandomi AH, Alavi AH (2012) Krill herd: a new bio-inspired optimization algorithm. Commun Nonlinear Sci Numer Simul 17(12):4831–4845
Ghaemi M, Feizi-Derakhshi M-R (2014) Forest optimization algorithm. Expert Syst Appl 41(15):6676–6687
Shayanfar H, Gharehchopogh FS (2018) Farmland fertility: a new metaheuristic algorithm for solving continuous optimization problems. Appl Soft Comput 71:728–746
Eskandar H et al (2012) Water cycle algorithm—a novel metaheuristic optimization method for solving constrained engineering optimization problems. Comput Struct 110:151–166
Sadollah A et al (2015) Water cycle algorithm with evaporation rate for solving constrained and unconstrained optimization problems. Appl Soft Comput 30:58–71
Mirjalili S, Lewis A (2016) The whale optimization algorithm. Adv Eng Softw 95:51–67
Chen Y et al (2019) Simplified hybrid fireworks algorithm. Knowl Based Syst 173:128–139
Faramarzi A et al (2020) Marine predators algorithm: a nature-inspired metaheuristic. Expert Syst Appl 152:113377
Kaveh A, Dadras Eslamlou A (2020) Water strider algorithm: a new metaheuristic and applications. Structures 25:520–541
Bogar E, Beyhan S (2020) Adolescent Identity Search Algorithm (AISA): a novel metaheuristic approach for solving optimization problems. Appl Soft Comput 95:106503
Yilmaz S, Sen S (2020) Electric fish optimization: a new heuristic algorithm inspired by electrolocation. Neural Comput Appl 32(15):11543–11578
Yazdani M, Jolai F (2016) Lion optimization algorithm (LOA): a nature-inspired metaheuristic algorithm. J Comput Des Eng 3(1):24–36
Faramarzi A et al (2020) Equilibrium optimizer: a novel optimization algorithm. Knowl Based Syst 191:105190
Kennedy J, Eberhart R (1995) Particle swarm optimization. In: Proceedings of ICNN'95-international conference on neural networks, vol 4. IEEE, pp 1942–1948
Civicioglu P (2013) Backtracking search optimization algorithm for numerical optimization problems. Appl Math Comput 219(15):8121–8144
Duan H, Luo Q (2014) Adaptive backtracking search algorithm for induction magnetometer optimization. IEEE Trans Magn 50(12):1–6
Song X et al (2015) Backtracking search algorithm for effective and efficient surface wave analysis. J Appl Geophys 114:19–31
Wang L, Zhong Y, Yin Y, Zhao W, Wang B, Xu Y (2015) A hybrid backtracking search optimization algorithm with differential evolution. Math Probl Eng 2015:769245. https://doi.org/10.1155/2015/769245
Su Z, Wang H, Yao P (2016) A hybrid backtracking search optimization algorithm for nonlinear optimal control problems with complex dynamic constraints. Neurocomputing 186:182–194
Wang H, Hu Z, Sun Y, Su Q, **a X (2018) Modified backtracking search optimization algorithm inspired by simulated annealing for constrained engineering optimization problems. Comput Intell Neurosci 2018:9167414. https://doi.org/10.1155/2018/9167414
Liu B et al (2005) Improved particle swarm optimization combined with chaos. Chaos Solitons Fractals 25(5):1261–1271
Da Y, **urun G (2005) An improved PSO-based ANN with simulated annealing technique. Neurocomputing 63:527–533
Liang JJ et al (2006) Comprehensive learning particle swarm optimizer for global optimization of multimodal functions. IEEE Trans Evol Comput 10(3):281–295
Yu J, Wang S, ** L (2008) Evolving artificial neural networks using an improved PSO and DPSO. Neurocomputing 71(4–6):1054–1060
Zhan Z-H et al (2009) Adaptive particle swarm optimization. IEEE Trans Syst Man Cybern Part B (Cybern) 39(6):1362–1381
Alfi A, Fateh M-M (2011) Intelligent identification and control using improved fuzzy particle swarm optimization. Expert Syst Appl 38(10):12312–12317
Tang D et al (2014) A quantum-behaved particle swarm optimization with memetic algorithm and memory for continuous non-linear large scale problems. Inf Sci 289:162–189
Guedria NB (2016) Improved accelerated PSO algorithm for mechanical engineering optimization problems. Appl Soft Comput 40:455–467
Ouyang H-B et al (2016) Hybrid harmony search particle swarm optimization with global dimension selection. Inf Sci 346:318–337
Meng A et al (2016) Accelerating particle swarm optimization using crisscross search. Inf Sci 329:52–72
Meng A-B et al (2014) Crisscross optimization algorithm and its application. Knowl Based Syst 67:218–229
Taherkhani M, Safabakhsh R (2016) A novel stability-based adaptive inertia weight for particle swarm optimization. Appl Soft Comput 38:281–295
Tam JH et al (2019) A new hybrid GA−ACO−PSO algorithm for solving various engineering design problems. Int J Comput Math 96:883–991
Lin G-H et al (2018) Hybrid particle swarm optimization with differential evolution for numerical and engineering optimization. Int J Autom Comput 15(1):103–114
Chen K, Zhou F-Y, Yuan X-F (2019) Hybrid particle swarm optimization with spiral-shaped mechanism for feature selection. Expert Syst Appl 128:140–156
Lin G et al (2019) A hybrid binary particle swarm optimization with tabu search for the set-union knapsack problem. Expert Syst Appl 135:201–211
Nickabadi A, Ebadzadeh MM, Safabakhsh R (2011) A novel particle swarm optimization algorithm with adaptive inertia weight. Appl Soft Comput 11(4):3658–3670
Kamboj VK (2016) A novel hybrid PSO–GWO approach for unit commitment problem. Neural Comput Appl 27(6):1643–1655
Premalatha K, Natarajan AM (2009) Hybrid PSO and GA for global maximization. Int J Open Probl Compt Math 2(4):597–608
Jordehi AR (2015) Enhanced leader PSO (ELPSO): a new PSO variant for solving global optimisation problems. Appl Soft Comput 26:401–417
** M et al (2008) An improved quantum-behaved particle swarm optimization algorithm with weighted mean best position. Appl Math Comput 205(2):751–759
Tongur V, Ülker E (2018) PSO-based improved multi-flocks migrating birds optimization (IMFMBO) algorithm for solution of discrete problems. Soft Comput 23:1–16
Jia D et al (2011) A hybrid particle swarm optimization algorithm for high-dimensional problems. Comput Ind Eng 61(4):1117–1122
Beheshti Z, Shamsuddin SM (2015) Non-parametric particle swarm optimization for global optimization. Appl Soft Comput 28:345–359
Gao H et al (2013) Particle swarm optimization based on intermediate disturbance strategy algorithm and its application in multi-threshold image segmentation. Inf Sci 250:82–112
Sun Y, Zhang L, Gu XJN (2012) A hybrid co-evolutionary cultural algorithm based on particle swarm optimization for solving global optimization problems. Neurocomputing 98:76–89
Zhang Y (2021) Backtracking search algorithm with specular reflection learning for global optimization. Knowl Based Syst 212:106546
Raja MAZ et al (2020) Design of backtracking search optimization paradigm for joint amplitude-angle measurement of sources lying in Fraunhofer zone. Measurement 149:106977
Guha D, Roy P, Banerjee S (2020) Quasi-oppositional backtracking search algorithm to solve load frequency control problem of interconnected power system. Iran J Sci Technol Trans Electr Eng 44(2):781–804
Xu X et al (2020) Multi-objective learning backtracking search algorithm for economic emission dispatch problem. Soft Comput 25:2433–2452
Zhou J et al (2019) An improved backtracking search algorithm for casting heat treatment charge plan problem. J Intell Manuf 30(3):1335–1350
Tian Z (2020) Backtracking search optimization algorithm-based least square support vector machine and its applications. Eng Appl Artif Intell 94:103801
Eberhart R, Simpson P, Dobbins R (1996) Computational intelligence PC tools. Academic Press Professional, Inc.
Yu X, Gen M (2010) Introduction to evolutionary algorithms. Springer Science & Business Media
Eberhart R, Kennedy J (1995) A new optimizer using particle swarm theory. In: MHS'95. Proceedings of the sixth international symposium on micro machine and human science. IEEE, pp 39–43
Kennedy J, Mendes R (2006) Neighborhood topologies in fully informed and best-of-neighborhood particle swarms. IEEE Trans Syst Man Cybern Part C (Appl Rev) 36(4):515–519
Kennedy J (1999) Small worlds and mega-minds: effects of neighborhood topology on particle swarm performance. In: Proceedings of the 1999 congress on evolutionary computation-CEC99 (Cat. No. 99TH8406), vol 3. IEEE, pp 1931–1938
Eberhart RC, Shi Y, Kennedy J (2001) Swarm intelligence. Elsevier
Kennedy J, Mendes R (2002) Population structure and particle swarm performance. In: Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No. 02TH8600), vol 2. IEEE, pp 1671–1676
Modiri-Delshad M, Rahim NA (2014) Solving non-convex economic dispatch problem via backtracking search algorithm. Energy 77:372–381
Wang L, Zhong Y, Yin Y, Zhao W, Wang B, Xu Y (2015) A hybrid backtracking search optimization algorithm with differential evolution. Math Probl Eng 2015:769245. https://doi.org/10.1155/2015/769245
Ali MM, Khompatraporn C, Zabinsky ZB (2005) A numerical evaluation of several stochastic algorithms on selected continuous global optimization test problems. J Glob Optim 31(4):635–672
Molga M, Smutnicki C (2005) Test functions for optimization needs. Test Funct Optim Needs 101:48
Yang XS (2010) Test problems in optimization. ar**v:1008.0549
Jamil M, Yang XS (2013) A literature survey of benchmark functions for global optimisation problems. Int J Math Model Numer Optim 4(2):150–194
Eberhart R, Kennedy J (1995) Particle swarm optimization. In: Proceedings of the IEEE international conference on neural networks, vol 4. Citeseer, pp 1942–1948
Mirjalili S, Mirjalili SM, Lewis A (2014) Grey wolf optimizer. Adv Eng Softw 69:46–61
Mirjalili S et al (2017) Salp Swarm Algorithm: a bio-inspired optimizer for engineering design problems. Adv Eng Softw 114:163–191
Eberhart RC, Shi Y (2000) Comparing inertia weights and constriction factors in particle swarm optimization. In: Proceedings of the 2000 congress on evolutionary computation. CEC00 (Cat. No. 00TH8512), vol 1. IEEE, pp 84–88
Price K, Storn RM, Lampinen JA (2006) Differential evolution: a practical approach to global optimization. Springer Science & Business Media
Chen Y et al (2018) Particle swarm optimizer with crossover operation. Eng Appl Artif Intell 70:159–169
Zhan Z-H et al (2011) Orthogonal learning particle swarm optimization. IEEE Trans Evol Comput 15(6):832–847
Beheshti Z, Shamsuddin SMH (2014) CAPSO: centripetal accelerated particle swarm optimization. Inf Sci 258:54–79
Zhan D et al (2016) Improving particle swarm optimization: using neighbor heuristic and Gaussian cloud learning. Intell Data Anal 20(1):167–182
Chen Y et al (2017) Particle swarm optimizer with two differential mutation. Appl Soft Comput 61:314–330
Mendes R, Kennedy J, Neves J (2004) The fully informed particle swarm: simpler, maybe better. IEEE Trans Evol Comput 8(3):204–210
Gong Y-J et al (2016) Genetic learning particle swarm optimization. IEEE Trans Cybern 46(10):2277–2290
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Zaman, H.R.R., Gharehchopogh, F.S. An improved particle swarm optimization with backtracking search optimization algorithm for solving continuous optimization problems. Engineering with Computers 38 (Suppl 4), 2797–2831 (2022). https://doi.org/10.1007/s00366-021-01431-6
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00366-021-01431-6