Abstract
Comparing the results obtained by two or more algorithms in a set of problems is a central task in optimizing or machine learning. Drawing conclusions from these comparisons may require the use of statistical tools such as hypothesis testing. In this paper, we investigate the utilization of parametric multi compared statistical tests on our proposed approach’s performance and the rest of the metaheuristics for solving engineering problems. Our proposed strategy (BSGM) includes the Bat algorithm, Simulated annealing, Gaussian distribution, and a novel mutation operator. The proposed method balances the Bat algorithm’s critical exploitation and global exploration of the Simulated annealing. The literature’s common engineering problems were analyzed in the competition between our BSGM approach and the latest swarm intelligence algorithms. We showed that all algorithms do not produce the same performance using multi compared analysis of variance (ANOVA). The benchmark results also show that our BSGM method provides encouraging results and can compare with the latest metaheuristics according to high-quality solutions and a small number of function evaluations.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Alihodzic, A., Tuba, M.: Improved bat algorithm applied to multilevel image thresholding. Sci. World J. 2014(Article ID 176718), 16 (2014). https://doi.org/10.1155/2014/176718
Alihodzic, A., Tuba, M.: Improved hybridized bat algorithm for global numerical optimization. In: 16th IEEE International Conference on Computer Modelling and Simulation, UKSim-AMSS 2014, pp. 57–62 (2014). https://doi.org/10.1109/UKSim.2014.97
Bacanin, N., Tuba, M.: Artificial bee colony (ABC) algorithm for constrained optimization improved with genetic operators. Studies Inf. Control 21(2), 137–146 (2012). https://doi.org/10.24846/v21i2y201203
Bacanin, N., Tuba, M.: Firefly algorithm for cardinality constrained mean-variance portfolio optimization problem with entropy diversity constraint. Sci. World J. 2014, 115–139 (2014). https://doi.org/10.1155/2014/721521
Brajevic, I., Tuba, M.: An upgraded artificial bee colony algorithm (abc) for constrained optimization problems. J. Intell. Manuf. 24(4), 729–740 (2013). https://doi.org/10.1007/s10845-011-0621-6
Brown, M.B., Forsythe, A.B.: Robust tests for the equality of variances. J. Amer. Stat. Assoc. 69(346), 364–367 (1974). https://doi.org/10.1080/01621459.1974.10482955
Demsar, J.: Statistical comparisons of classifiers over multiple data sets. J. Mach. Learn. Res. 7, 1–30 (2006). http://jmlr.org/papers/v7/demsar06a.html
Derrac, J., García, S., Hui, S., Suganthan, P.N., Herrera, F.: Analyzing convergence performance of evolutionary algorithms: a statistical approach. Inf. Sci. 289, 41–58 (2014). https://doi.org/10.1016/j.ins.2014.06.009
Eftimov, T., Korošec, P.: Identifying practical significance through statistical comparison of meta-heuristic stochastic optimization algorithms. Appl. Soft Comput, 85, 105, 862 (2019). https://doi.org/10.1016/j.asoc.2019.105862
Eftimov, T., Korošec, P.: A novel statistical approach for comparing meta-heuristic stochastic optimization algorithms according to the distribution of solutions in the search space. Inf. Sci. 489, 255–273 (2019). https://doi.org/10.1016/j.ins.2019.03.049. https://www.sciencedirect.com/science/article/pii/S0020025519302610
Fister, I., Fister, J., Yang, X., Brest, J.: A comprehensive review of firefly algorithms. Swarm Evol. Comput. 13(1), 34–46 (2013). https://doi.org/10.1016/j.swevo.2013.06.001
Gandomi, A.H., Yang, Alavi, A.H., Talatahari, S.: Bat algorithm for constrained optimization tasks. Neural Comput. Appl. 22(6), 1239–1255 (2013). https://doi.org/10.1007/s00521-012-1028-9
Gandomi, A.H., Yang, X.S., Alavi, A.H.: Mixed variable structural optimization using Firefly Algorithm. Comput. Struct. 89(23–24), 2325–2336 (2011). https://doi.org/10.1016/j.compstruc.2011.08.002
Gandomi, A.H., Yang, X.S., Alavi, A.H.: Cuckoo search algorithm: a metaheuristic approach to solve structural optimization problems. Eng. Comput. 29(1), 17–35 (2013). https://doi.org/10.1007/s00366-011-0241-y
García, S., Herrera, F.: An extension on “statistical comparisons of classifiers over multiple data sets” for all pairwise comparisons. J. Mach. Learn. Res. 9(89), 2677–2694 (2008). http://jmlr.org/papers/v9/garcia08a.html
García, S., Molina, D., Lozano, M., Herrera, F.: A study on the use of non-parametric tests for analyzing the evolutionary algorithms? behaviour: a case study on the cec2005 special session on real parameter optimization. J. Heuristics 15(6), 617–644 (2008). https://doi.org/10.1007/s10732-008-9080-4
shi He, X., Ding, W.J., Yang, X.S.: Bat algorithm based on simulated annealing and Gaussian perturbations. Neural Comput. Appl. 25(2), 459–468 (2013). https://doi.org/10.1007/s00521-013-1518-4
Hogg, R.V., McKean, J.W., Craig, A.T.: Introduction to Mathematical Statistics, 8th edn. Pearson, London (2019)
IBM Corp.: IBM SPSS Statistics for Windows. https://hadoop.apache.org
Karaboga, D.: An idea based on honey bee swarm for numerical optimization. Technical Report - TR06, pp. 1–10 (2005)
Keselman, H., Rogan, J.: A comparison of the modified-tukey and scheffe methods of multiple comparison for pairwise contrasts. J. Amer. Stat. Ass. - J AMER STATIST ASSN 73, 47–52 (1978). https://doi.org/10.1080/01621459.1978.10479996
Kirkpatrick, S., Jr., C.G., Vecchi, M.: Optimization by simulated annealing. Science 220(4598), 671–680 (1983). https://doi.org/10.1126/science.220.4598.671
Long, W., Liang, X., Huang, Y., Chen, Y.: An effective hybrid cuckoo search algorithm for constrained global optimization. Neural Comput. Appl. 25(3–4), 911–926 (2014). https://doi.org/10.1007/s00521-014-1577-1
Nigdeli, S.M., Bekda, G., Yang, X.S.: Application of the flower pollination algorithm in structural engineering. Model. Optim. Sci. Technol. 7, 25–42 (2015). https://doi.org/10.1007/978-3-319-26245-1_2
Shapiro, S.S., Wilk., M.B.: An analysis of variance test for normality (complete samples). Biometrika 52(3/4), 591–611 (1965). https://doi.org/10.2307/2333709
Shilane, D., Martikainen, J., Dudoit, S., Ovaska, S.J.: A general framework for statistical performance comparison of evolutionary computation algorithms. Inf. Sci. 178(14), 2870–2879 (2008). https://doi.org/10.1016/j.ins.2008.03.007
Tuba, M., Alihodzic, A., Bacanin, N.: Cuckoo search and bat algorithm applied to training feed-forward. Neural Netw. 585, 139–162 (2014). https://doi.org/10.1007/978-3-319-13826-8_8
Tuba, M., Bacanin, N., Alihodzic, A.: Firefly algorithm for multi-objective RFID network planning problem. Telecommun. Forum Telfor (TELFOR) 95–98 (2014). https://doi.org/10.1109/TELFOR.2014.7034365
Tuba, M., Jovanovic, R.: Improved ant colony optimization algorithm with pheromone correction strategy for the traveling salesman problem. Int. J. Comput. Commun. Control 8(3), 477–485 (2013). https://doi.org/10.15837/ijccc.2013.3.7
Črepinšek, M., Liu, S.H., Mernik, M.: Exploration and exploitation in evolutionary algorithms: a survey. ACM Comput. Surv. 45(3), 35:1–35:33 (2013). https://doi.org/10.1145/2480741.2480752
Yang, X.S.: A new metaheurisitic bat-inspired algorithm. Studies Comput. Intell. 284, 65–74 (2010). https://doi.org/10.1007/978-3-642-12538-6_6
Yang, X.S.: Review of meta-heuristics and generalised evolutionary walk algorithm. Int. J. Bio-Inspired Comput. 3(2), 77–84 (2011). https://doi.org/10.1504/IJBIC.2011.039907
Yang, X.S.: Efficiency analysis of swarm intelligence and randomization techniques. J. Comput. Theor. Nanosci. 9(2), 189–198 (2012). https://doi.org/10.1166/jctn.2012.2012
Yang, X.S.: Free lunch or no free lunch: That is not just a question? Int. J. Artif. Intell. Tools 21(3), 5360–5366 (2012). https://doi.org/10.1142/S0218213012400106
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this chapter
Cite this chapter
Alihodzic, A. (2022). Statistical Measurements of Metaheuristics for Solving Engineering Problems. In: Fidanova, S. (eds) Recent Advances in Computational Optimization. WCO 2020. Studies in Computational Intelligence, vol 986. Springer, Cham. https://doi.org/10.1007/978-3-030-82397-9_1
Download citation
DOI: https://doi.org/10.1007/978-3-030-82397-9_1
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-82396-2
Online ISBN: 978-3-030-82397-9
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)