Abstract
Recently, optimization makes an important role in our day-to-day life. Evolutionary and population-based optimization algorithms are widely employed in several of engineering areas. The design of an optimization algorithm is a challenging endeavor caused of physical phenomena in order to obtain appropriate local and global search operators. Generally, local operators are fast. In contrast, global operators are used to find best solution in the search space; therefore they are slower compare to the local ones. The best review-knowledge of papers show that there are many optimization algorithms such as genetic algorithm, particle swarm optimization, artificial bee colony and etc in the engineering as a powerful tools. However, there is not a comprehensive review for theirs topologies and performance; therefore, the main goal of this paper is filling of this scientific gap. Moreover, several aspects of optimization heuristic designs and analysis are discussed in this paper. As a result, detailed explanation, comparison, and discussion on AI are achieved. Furthermore, some future research fields on AI are well summarized.
Similar content being viewed by others
References
Abbass HA (2001a) A monogenous MBO approach to satisfiability. In: Proceedings of international conference on computational intelligence for modelling, control and automation, CIMCA’2001, Las Vegas, NV, USA
Abbass HA (2001b) Marriage in honey-bee optimization (MBO): a haplometrosis polygynous swarming approach. In: Proceedings of the congress on evolutionary computation (CEC2001), Seoul, Korea, May 2001, pp 207–214
Abedinia O, Amjady N, Ghasemi A (2014) A new meta heuristic algorithm based on shark smell optimization. Complexity. doi:10.1002/cplx.21634
Affenzeller M, Wagner S (2005) Offspring selection: a new self-adaptive selection scheme for genetic algorithms. Proceedings of the international conference on adaptive and natural computing algorithms (ICANNGA). Part II, Computer science, Springer, pp 218–221
Affenzeller M, Wagneret S, Winkler S (2007) Self-adaptive population size adjustment for genetic algorithms. In: Proceedings of the 11th International conference on computer aided systems theory (EUROCAST 2007) computer science, vol 4739. Springer, pp 820–828
Afshar A, Bozog Haddad O, Marino MA, Adams BJ (2007) Honeybee mating optimization (HBMO) algorithm for optimal reservoir operation. J Franklin Inst 344:452–462
Ahmed SG (2014) Automatic generation of basis test paths using variable length genetic algorithm. Inf Process Lett 114(6):304–316
Akbari R, Ziarati K (2011) A rank based particle swarm optimization algorithm with dynamic adaptation. J Comput Appl Math 235:2694–2714
Ali AF, Hassanien AE (2013) Minimizing molecular potential energy function using genetic Nelder–Mead algorithm. In: International conference on computer engineering and systems (ICCES), pp 177–183
Alkhatib H, Duveau J (2013) Dynamic genetic algorithms for robust design of multimachine power system stabilizers. Electr Power Energy Syst 45:242–251
Arul R, Ravib G, Velusami S (2013) Chaotic self-adaptive differential harmony search algorithm based dynamic economic dispatch. Electr Power Energy Syst 50:85–96
Atashpaz-Gargari E, Lucas C (2007) Imperialist competitive algorithm: an algorithm for optimization inspired by imperialistic competition. IEEE Congr Evolut Comput 7:4661–4666
Banerjee A, Mukherjee V, Ghoshal SP (2014) An opposition-based harmony search algorithm for engineering optimization problems. Ain Shams Eng J 5(1):85–101
Bergh FVD (1999) Particle swarm weight initialization in multi-layer perceptron artificial neural networks. In: Development and practice of artificial intelligence techniques, pp 41–45
Chaturvedi KT, Pandit M, Srivastava L (2008) Self-organizing hierarchical particle swarm optimization for nonconvex economic dispatch. IEEE Trans Power Syst 23(3):1079–1087
Chen C-H, Chen Y (2007) Real Coded ECGA for economic dispatch, GECCO ’07, July 7–11, 2007. England, United Kingdom
Chen C (2007) Non-convex economic dispatch: a direct search approach. Energy Convers Manag 48(1):219–225
Chen J, Quan-ke P, Jun-qing L (2012) Harmony search algorithm with dynamic control parameters. Appl Math Comput 219(2):592–604
Chen Z, Yuan X, Tian H, Ji B (2014) Improved gravitational search algorithm for parameter identification of water turbine regulation system. Energy Convers Manag 78:306–315
Chiang CL (2005) Improved genetic algorithm for power economic dispatch of units with valve-point effects and multiple fuels. IEEE Trans Power Systems 20(4):1690–1699
Chiou JP, Wang FS (1998) A hybrid method of differential evolution with application to optimal control problems of a bioprocess system. In: IEEE International Conference on Evolutionary Computation, pp 627–632
Contreras J, Amaya I, Correa R (2014) An improved variant of the conventional harmony search algorithm. Appl Math Comput 227:821–830
Doğan A, Serdar O, Celal Y, Tianjun L (2014) Artificial bee colony algorithm with dynamic population size to combined economic and emission dispatch problem. Electr Power Energy Syst 54:144–153
Dorigo M, Di Caro G (1999) The ant colony optimization meta-heuristic. In: Corne D, Dorigo M, Glover F (eds) New ideas in optimization. McGraw Hill, London, pp 11–32
Enayatifar R, Yousefi M, Abdullah AH, Darus AN (2013) LAHS: a novel harmony search algorithm based on learning automata. Commun Nonlinear Sci Numer Simul 18(12):3481–3497
Eslami M, Shareef H, Mohamed A (2010) Optimal tuning of power system stabilizers using modified particle swarm optimization. In: Proceedings of the 14th international middle east power systems conference (MEPCON’10), Cairo University, Egypt, December 19–21, Paper ID 184
Eusuff MM, Lansey KE (2003) Optimizing of water distribution network design using the shuffled frog lea** algorithm. J Water Resour Plan Manag 129(3):210–225
Firouzia BB, Farjah E, Abarghooee RA (2013) An efficient scenario-based and fuzzy self-adaptive learning particle swarm optimization approach for dynamic economic emission dispatch considering load and wind power uncertainties. Energy 50(1):232–244
Fuh-Yuh J, Wei-Chiang H (2013) Application of seasonal SVR with chaotic gravitational search algorithm in electricity forecasting. Appl Math Model 37(23):9643–9651
Gandomi AH, Alavi AH (2012) Krill herd: a new bio-inspired optimization algorithm. Nonlinear Sci Numer Simul 17(12):4831–4845
Gao W, Liu S, Huang L (2014) Enhancing artificial bee colony algorithm using more information-based search equations. Inf Sci 270(20):112–133
Gaoa WF, Liu SY, Huang LL (2013) A novel artificial bee colony algorithm with Powell’s method. Appl Soft Comput 13:3763–3775
Geem ZW, Kim J-H, Loganathan GV (2001) A new heuristic optimization algorithm: harmony search. Simulation 76(2):60–68
Ghasemi A (2013) A fuzzified multi objective interactive honey bee mating optimization for environmental/economic power dispatch with valve point effect. Electr Power Energy Syst 49:308–321
Ghasemi A, Valipour K, Tohidi A (2014) Multi objective optimal reactive power dispatch using a new multi objective strategy. Electr Power Energy Syst 57:318–334
Ghasemi A, Shayanfar HA, Mohammad SN, Abedinia O (2011) Optimal placement and tuning of robust multimachine PSS via HBMO, In: Proceedings of the international conference on artificial intelligence, pp 201–218
Ghorbani N, Babaei E (2016) Exchange market algorithm. Appl Soft Comput. Accepted
Goldberg DE (2000) Genetic algorithms in search optimisation and machine learning. Springer, Berlin
Hindi KS, Ghani MRA (1991) Dynamic economic dispatch for large-scale power systems: a Lagrangian relaxation approach. Electr Power Syst Res 13(1):51–56
Hsing-Chih T (2014) Integrating the artificial bee colony and bees algorithm to face constrained optimization problems. Inf Sci 258(10):80–93
Jabr RA, Coonick AH, Cory BJ (2000) A homogeneous linear programming algorithm for the security constrained economic dispatch problem. IEEE Trans Power Syst 15(3):930–936
Javidan J, Ghasemi A (2012) Environmental/economic power dispatch using multi-objective honey bee mating optimization. Int Rev Electr Eng 7(1):3667–3675
Karaboga D, Akay B (2009) A comparative study of artificial bee colony algorithm. Appl Math Comput 2(14):108–132
Karaboga D, Gorkemli B, Ozturk C, Karaboga N (2012) A comprehensive survey: artificial bee colony (ABC) algorithm and applications. Artif Intell Rev 42(1):21–57
Kashan AH (2014) League championship algorithm (LCA): an algorithm for globaloptimization inspired by sport championships. Appl Soft Comput 16:171–1200
Kennedy J (1998) The behavior of particles. Evolut Programm VII 1447:579–589
Kennedy J, Eberhart RC (1995) Particle swarm optimization. Proceedings of IEEE international conference on neural networks 1:1942–1948
Kennedy J, Eberhart R (1997) A discrete binary version of the particle swarm optimization algorithm. In: Proceedings of 1997 conference on systems, man, and, cybernetics, pp 4104–4109
Khajehzadeh M, Tahaa M, Shafiea A, Eslami M (2012) A modified gravitational search algorithm for slope stability analysis. Eng Appl Artif Intell 25(8):1589–1597
Khalili M, Kharrat R, Salahshoor K, Haghighat Sefat M (2014) Global dynamic harmony search algorithm: GDHS. Appl Math Comput 228:195–219
Khatibinia M, Khosravi Sh (2014) A hybrid approach based on an improved gravitational searchalgorithm and orthogonal crossover for optimal shape design of concrete gravity dams. Appl Soft Comput 16:223–233
Khorsandi A, Hosseinian SH, Ghazanfari A (2013) Modified artificial bee colony algorithm based on fuzzy multi-objective technique for optimal power flow problem. Electr Power Syst Res 95:206–213
Kirkpatrick S, Gelatt CD, Vecchi MP (1983) Optimization by simulated annealing. Science 220(4598):671–680
Kumar JV, Vinod Kumar DM, Edukondalu K (2013) Strategic bidding using fuzzy adaptive gravitational search algorithm in a pool based electricity market. Appl Soft Comput 13:2445–2455
Kumar V, Chhabra JK, Kumar D (2014) Parameter adaptive harmony search algorithm for unimodal and multimodal optimization problems. J Comput Sci 5(2):144–155
Kumari MS, Sydulu M (2009) A fast computational genetic algorithm for economic load dispatch. Int J Recent Trends Eng 1(1):349–356
Lam AYS, Li VOK (2010) Chemical-reaction-inspired metaheuristic for optimization. IEEE Trans Evolt Comput 14(3):381–399
Lee S, Mun S (2014) Improving a model for the dynamic modulus of asphalt using the modified harmony search algorithm. Expert Syst Appl 41(8):3856–3860
Liu SC, Zhang JH, Liu ZQ, Wang HQ (2010) Reactive power optimization and voltage control using an improved genetic algorithm. In: Proceedings of IEEE international conference on power system technology (POWERCON), pp 1–5
Lu F, Ge Y, Gao L (2010) A novel genetic algorithm with multiple sub-population parallel search mechanism. In: Proceedings of the 6th international conference on natural computation (ICNC), vol 5, pp 2249–2253
Mahdad B, Srairi K, Bouktir T (2010) Optimal power flow for large-scale power system with shunt FACTS using efficient parallel GA. Electr Power Energy Syst 32(5):507–517
Mahmoud Maheri R, Narimani MM (2014) An enhanced harmony search algorithm for optimum design of side sway steel frames. Comput Struct 136:78–89
Moradi MH, Abedini M (2011) A combination of genetic algorithm and particle swarm optimization for optimal DG location and sizing in distribution systems. Electr Power Energy Syst 34(1):66–74
Narimani MR, Vahed AA, Azizipanah R, Javidsharifi M (2014) Enhanced gravitational search algorithm for multi-objective distribution feeder reconfiguration considering reliability, loss and operational cost. IET Gener Transm Distrib 8(1):55–69
Niknam T, Mojarrad HD, Nayeripour M (2010) A new fuzzy adaptive particle swarm optimization for non-smooth economic dispatch. Energy 35:1764–1778
Niknam T, Mojarrad HD, Meymand HZ, Firouzi BB (2011) A new honey bee mating optimization algorithm for non-smooth economic dispatch. Energy 36:896–908
Oca M, Stutzle T, Van den Enden K, Dorigo M (2011) Incremental social learning in particle swarms. IEEE Trans Syst Man Cybern B 41(2):368–384
Osórioa GJ, Matiasa JCO, Catalão JPS (2014) Electricity prices forecasting by a hybrid evolutionary-adaptive methodology. Energy Convers Manag 80:363–373
Papageorgiou LG, Fraga ES (2007) A mixed integer quadratic programming formulation for the economic dispatch of generators with prohibited operating zones. Electr Power Syst Res 77(10):1292–1296
Parsopoulos KE, Vrahatis MN (2004) On the computation of all global minimizers through particle swarm optimization. IEEE Trans Evol Comput 8(3):211–224
Pehlivanoglu YV (2013) A new particle swarm optimization method enhanced with a periodic mutation strategy and neural networks. IEEE Trans Evolut Comput 17(3):436–452
Pellerin E, Pigeon L, Delisle S (2004) Self-adaptive parameters in genetic algorithms. In: Proceedings of conference on data mining and knowledge discovery: theory, tools, and technology VI, vol 5433. SPIE, pp 53–64
Pereira AGC, Roveda JAF, Amorim CL, Simioli MCV, Roveda SRMM (2013) Convergence analysis of an elitist non-homogeneous genetic algorithm with mutation probability adjusted by a fuzzy controller. In: IFSA world congress and NAFIPS annual meeting (IFSA/NAFIPS), pp 19–23
Phiri A, Folly KA (2008) Application of breeder GA to power system controller design. IEEE swarm intelligence symposium 2008, September. St. Louis, MO, pp 21–23
Poursalehi N, Zolfaghari A, Minuchehr A, Valavi K (2013) Self-adaptive global best harmony search algorithm applied to reactor core fuel management optimization. Ann Nucl Energy 62:86–102
Quan-Ke P, Suganthan PN, Liang JJ, Fatih Tasgetiren M (2011) A local-best harmony search algorithm with dynamic sub-harmony memories for lot-streaming flow shop scheduling problem. Expert Syst Appl 38(4):3252–3259
Rajabioun R (2011) Cuckoo optimization algorithm. Appl. Soft Comput 11:5508–5518
Rashedi E, Nezamabadi-pour H, Saryazdi S (2009) GSA: a gravitational search algorithm. Inf Sci 179:2232–2248
Ratnaweera A, Halgamuge SK, Watson HC (2004) Self-organizing hierarchical particle swarm optimizer with time-varying acceleration coefficients. IEEE Trans Evolut Comput 8:240–255
Rocha MC, Saraiva JT (2013) A discrete evolutionary PSO based approach to the multiyear transmission expansion planning problem considering demand uncertainties. Electr Power Energy Syst 45:427–442
Sadollah A, Bahreininejad A, Eskandar H, Hamdi M (2013) Mine blast algorithm: a new population based algorithm for solving constrained engineering optimization problems. Appl Soft Comput 13:2592–2612
Safari A, Shayanfar HA, Kazemi A (2013) Robust PWMSC dam** controller tuning on the augmented Lagrangian PSO algorithm. IEEE Trans Power Syst 28(4):4665–4673
Safari A, Shayeghi H (2011) Iteration particle swarm optimization procedure for economic load dispatch with generator constraints. Expert Syst Appl 38(5):6043–6048
Sarafrazi S, Nezamabadi-pour H, Saryazdi S (2011) Disruption: a new operator in gravitational search algorithm. Sci Iran D 18(3):539–548
Sasikala J, Ramaswamy M (2010) Optimal gamma based fixed head hydrothermal scheduling using genetic algorithm. Expert Syst Appl 37:3352–3357
Semenkin E, Semenkina M (2012) Self-configuring genetic algorithm with modified uniform crossover operator. In: Proceedings of the 3rd international conference on advances in swarm intelligence (ICSI), Computer science, vol 7331. Springer, pp 414–421
Shaw B, Mukherjee V, Ghoshal SP (2014) Solution of reactive power dispatch of power systems by an opposition-based gravitational search algorithm. Electr Power Energy Syst 55:29–40
Shayeghi H, Ghasemi A (2011a) Multiple PSS design using an improved honey bee mating optimization algorithm to enhance low frequency oscillations. Int Rev Electr Eng 6(7):3122–3123
Shayeghi H, Ghasemi A (2011b) Solving economic load dispatch problems with valve point effects using artificial bee colony algorithm. Int Rev Electr Eng 6(5):2569–2577
Shi Y, Eberhart RC (1999) Empirical study of particle swarm optimization. In: Proceedings of the congress on evolutionary computation, pp 1945–1949
Shi Y, Eberhart RC (1998) Parameter selection in particle swarm optimization. In: Porto VW, Saravanan N, Waagen D, Eiben AE (eds) Evolutionary Programming, vol VII. Springer, Berlin, pp 591–600
Shi Y, Eberhart RC (2001) Particle swarm optimization with fuzzy adaptive inertia weight. In: Proceeding of workshop on particle swarm optimization, Indianapolis, pp 101–106
Soleimanpour-moghadam M, Nezamabadi-pour H, Farsangi MM (2014) A quantum inspired gravitational search algorithm for numerical function optimization. Inf Sci 267(20):83–100
Songfeng L, Chengfu S, Zhengding L (2010) An improved quantum-behaved particle swarm optimization method for short-term combined economic emission hydrothermal scheduling. Energy Convers Manag 51:561–571
Srinivasa KG, Venugopal KR, Patnaik LM (2007) A self-adaptive migration model genetic algorithm for data mining applications. Inf Sci 177(20):4295–4313
Tan WS, Hassan MY, Rahman HA, Abdullah MP, Hussin F (2013) Multi-distributed generation planning using hybrid particle swarm optimisation- gravitational search algorithm including voltage rise issue. IET Gener Transm Distrib 7(9):929–942
Teng WZ, Jun ZH, Ying H, Kai Ch, Yi WT (2011) Fire distribution optimization based on quantum immune genetic algorithm. In: International conference on information technology, computer engineering and management sciences (ICM), pp 95–98
Togan V, Daloglu AT (2008) An improved genetic algorithm with initial population strategy and self-adaptive member grou**. Comput Struct 86(12):1204–1218
Tongchim S, Chongstitvatana P (2002) Parallel genetic algorithm with parameter adaptation. Inf Process Lett 82(1):47–54
Wang Y, Zhou J, Zhou C, Wanga Y, Qin H, Lu Y (2012) An improved self-adaptive PSO technique for short-term hydrothermal scheduling. Expert Syst Appl 39:2288–2295
Wang L, Ling-po L (2013) An effective differential harmony search algorithm for the solving non-convex economic load dispatch problems. Electr Power Energy Syst 44:832–843
Wu B, Qian C, Ni W, Fan S (2012) Hybrid harmony search and artificial bee colony algorithm for global optimization problems. Comput Math Appl 64(8):2621–2634
**ang WL, Mei-qing A (2013) An efficient and robust artificial bee colony algorithm for numerical optimization. Comput Oper Res 40(5):1256–1265
**ong H, **ong K, Tang Q (2009) A novel variable-boundary-coded quantum genetic algorithm for function optimization. In: Eighth IEEE international conference on dependable, autonomic and secure computing, pp 279–285
Yadav P, Kumar R, Panda SK, Chang CS (2012) An intelligent tuned harmony search algorithm for optimisation. Inf Sci 196:47–72
Yamamoto K, Inoue O (1995) New evolutionary direction operator for genetic algorithms. AIAA J 33(10):1990–1993
Yang XS (2008) Nature-inspired metaheuristic algorithms. Luniver Press, Beckington
Yan T (2010) An improved genetic algorithm and its blending application with neural network. In: 2nd international workshop on intelligent systems and applications (ISA), pp 1–4
Yang XS (2010) A new metaheuristic bat-inspired algorithm. Proceedings of nature inspired cooperative strategies for optimization (NISCO 2010), vol 284. Springer, Berlin, pp 65–74
Yang XS (2012) Flower pollination algorithm for global optimization, UCNC 2012. LNCS 7445:240–249
Yang X, Yuan J, Yuan J, Mao H (2007) A modified particle swarm optimizer with dynamic adaptation. J Appl Math Comput 189:1205–1213
Yuan X, Zhao J, Yang Y, Wang Y (2014) Hybrid parallel chaos optimization algorithm with harmony search algorithm. Appl Soft Comput 17:12–22
Zhan ZH, Zhang J, Li Y, Shi YH (2011) Orthogonal learning particle swarm optimization. IEEE Trans Evolut Comput 15(6):832–847
Zhang J, Zhuang J, Du H, Wang S (2009) Self-organizing genetic algorithm based tuning of PID controllers. Inf Sci 179(7):1007–1018
Zhang H, Wang Z, Liu D (2014) A comprehensive review of stability analysis of continuous-time recurrent neural networks. IEEE Trans Neural Netw Learn Syst 25(7):1229–1262
Zhang W, Ma D, Wei JJ, Liang HF (2014) A parameter selection strategy for particle swarm optimization based on particle positions. Expert Syst Appl 41:3576–3584
Zhang H, Feng T, Yang GH, Liang H (2015) Distributed cooperative optimal control for multiagent systems on directed graphs: an inverse optimal approach. IEEE Trans Cybern 45(7):1315–1326
Zhang L, Tang Y, Hua C, Guan X (2015) A new particle swarm optimization algorithm with adaptive inertiaweight based on Bayesian techniques. Appl Soft Comput 28:138–149
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Nabaei, A., Hamian, M., Parsaei, M.R. et al. Topologies and performance of intelligent algorithms: a comprehensive review. Artif Intell Rev 49, 79–103 (2018). https://doi.org/10.1007/s10462-016-9517-3
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10462-016-9517-3