Statistical Measurements of Metaheuristics for Solving Engineering Problems

  • Chapter
  • First Online:
Recent Advances in Computational Optimization (WCO 2020)

Part of the book series: Studies in Computational Intelligence ((SCI,volume 986))

Included in the following conference series:

  • 263 Accesses

Abstract

Comparing the results obtained by two or more algorithms in a set of problems is a central task in optimizing or machine learning. Drawing conclusions from these comparisons may require the use of statistical tools such as hypothesis testing. In this paper, we investigate the utilization of parametric multi compared statistical tests on our proposed approach’s performance and the rest of the metaheuristics for solving engineering problems. Our proposed strategy (BSGM) includes the Bat algorithm, Simulated annealing, Gaussian distribution, and a novel mutation operator. The proposed method balances the Bat algorithm’s critical exploitation and global exploration of the Simulated annealing. The literature’s common engineering problems were analyzed in the competition between our BSGM approach and the latest swarm intelligence algorithms. We showed that all algorithms do not produce the same performance using multi compared analysis of variance (ANOVA). The benchmark results also show that our BSGM method provides encouraging results and can compare with the latest metaheuristics according to high-quality solutions and a small number of function evaluations.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
EUR 32.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or Ebook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
EUR 29.95
Price includes VAT (Germany)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
EUR 139.09
Price includes VAT (Germany)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
EUR 181.89
Price includes VAT (Germany)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free ship** worldwide - see info
Hardcover Book
EUR 181.89
Price includes VAT (Germany)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free ship** worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Alihodzic, A., Tuba, M.: Improved bat algorithm applied to multilevel image thresholding. Sci. World J. 2014(Article ID 176718), 16 (2014). https://doi.org/10.1155/2014/176718

  2. Alihodzic, A., Tuba, M.: Improved hybridized bat algorithm for global numerical optimization. In: 16th IEEE International Conference on Computer Modelling and Simulation, UKSim-AMSS 2014, pp. 57–62 (2014). https://doi.org/10.1109/UKSim.2014.97

  3. Bacanin, N., Tuba, M.: Artificial bee colony (ABC) algorithm for constrained optimization improved with genetic operators. Studies Inf. Control 21(2), 137–146 (2012). https://doi.org/10.24846/v21i2y201203

  4. Bacanin, N., Tuba, M.: Firefly algorithm for cardinality constrained mean-variance portfolio optimization problem with entropy diversity constraint. Sci. World J. 2014, 115–139 (2014). https://doi.org/10.1155/2014/721521

    Article  Google Scholar 

  5. Brajevic, I., Tuba, M.: An upgraded artificial bee colony algorithm (abc) for constrained optimization problems. J. Intell. Manuf. 24(4), 729–740 (2013). https://doi.org/10.1007/s10845-011-0621-6

    Article  Google Scholar 

  6. Brown, M.B., Forsythe, A.B.: Robust tests for the equality of variances. J. Amer. Stat. Assoc. 69(346), 364–367 (1974). https://doi.org/10.1080/01621459.1974.10482955

    Article  MATH  Google Scholar 

  7. Demsar, J.: Statistical comparisons of classifiers over multiple data sets. J. Mach. Learn. Res. 7, 1–30 (2006). http://jmlr.org/papers/v7/demsar06a.html

  8. Derrac, J., García, S., Hui, S., Suganthan, P.N., Herrera, F.: Analyzing convergence performance of evolutionary algorithms: a statistical approach. Inf. Sci. 289, 41–58 (2014). https://doi.org/10.1016/j.ins.2014.06.009

    Article  Google Scholar 

  9. Eftimov, T., Korošec, P.: Identifying practical significance through statistical comparison of meta-heuristic stochastic optimization algorithms. Appl. Soft Comput, 85, 105, 862 (2019). https://doi.org/10.1016/j.asoc.2019.105862

  10. Eftimov, T., Korošec, P.: A novel statistical approach for comparing meta-heuristic stochastic optimization algorithms according to the distribution of solutions in the search space. Inf. Sci. 489, 255–273 (2019). https://doi.org/10.1016/j.ins.2019.03.049. https://www.sciencedirect.com/science/article/pii/S0020025519302610

  11. Fister, I., Fister, J., Yang, X., Brest, J.: A comprehensive review of firefly algorithms. Swarm Evol. Comput. 13(1), 34–46 (2013). https://doi.org/10.1016/j.swevo.2013.06.001

    Article  Google Scholar 

  12. Gandomi, A.H., Yang, Alavi, A.H., Talatahari, S.: Bat algorithm for constrained optimization tasks. Neural Comput. Appl. 22(6), 1239–1255 (2013). https://doi.org/10.1007/s00521-012-1028-9

  13. Gandomi, A.H., Yang, X.S., Alavi, A.H.: Mixed variable structural optimization using Firefly Algorithm. Comput. Struct. 89(23–24), 2325–2336 (2011). https://doi.org/10.1016/j.compstruc.2011.08.002

    Article  Google Scholar 

  14. Gandomi, A.H., Yang, X.S., Alavi, A.H.: Cuckoo search algorithm: a metaheuristic approach to solve structural optimization problems. Eng. Comput. 29(1), 17–35 (2013). https://doi.org/10.1007/s00366-011-0241-y

    Article  Google Scholar 

  15. García, S., Herrera, F.: An extension on “statistical comparisons of classifiers over multiple data sets” for all pairwise comparisons. J. Mach. Learn. Res. 9(89), 2677–2694 (2008). http://jmlr.org/papers/v9/garcia08a.html

  16. García, S., Molina, D., Lozano, M., Herrera, F.: A study on the use of non-parametric tests for analyzing the evolutionary algorithms? behaviour: a case study on the cec2005 special session on real parameter optimization. J. Heuristics 15(6), 617–644 (2008). https://doi.org/10.1007/s10732-008-9080-4

    Article  MATH  Google Scholar 

  17. shi He, X., Ding, W.J., Yang, X.S.: Bat algorithm based on simulated annealing and Gaussian perturbations. Neural Comput. Appl. 25(2), 459–468 (2013). https://doi.org/10.1007/s00521-013-1518-4

  18. Hogg, R.V., McKean, J.W., Craig, A.T.: Introduction to Mathematical Statistics, 8th edn. Pearson, London (2019)

    Google Scholar 

  19. IBM Corp.: IBM SPSS Statistics for Windows. https://hadoop.apache.org

  20. Karaboga, D.: An idea based on honey bee swarm for numerical optimization. Technical Report - TR06, pp. 1–10 (2005)

    Google Scholar 

  21. Keselman, H., Rogan, J.: A comparison of the modified-tukey and scheffe methods of multiple comparison for pairwise contrasts. J. Amer. Stat. Ass. - J AMER STATIST ASSN 73, 47–52 (1978). https://doi.org/10.1080/01621459.1978.10479996

    Article  Google Scholar 

  22. Kirkpatrick, S., Jr., C.G., Vecchi, M.: Optimization by simulated annealing. Science 220(4598), 671–680 (1983). https://doi.org/10.1126/science.220.4598.671

  23. Long, W., Liang, X., Huang, Y., Chen, Y.: An effective hybrid cuckoo search algorithm for constrained global optimization. Neural Comput. Appl. 25(3–4), 911–926 (2014). https://doi.org/10.1007/s00521-014-1577-1

    Article  Google Scholar 

  24. Nigdeli, S.M., Bekda, G., Yang, X.S.: Application of the flower pollination algorithm in structural engineering. Model. Optim. Sci. Technol. 7, 25–42 (2015). https://doi.org/10.1007/978-3-319-26245-1_2

  25. Shapiro, S.S., Wilk., M.B.: An analysis of variance test for normality (complete samples). Biometrika 52(3/4), 591–611 (1965). https://doi.org/10.2307/2333709

  26. Shilane, D., Martikainen, J., Dudoit, S., Ovaska, S.J.: A general framework for statistical performance comparison of evolutionary computation algorithms. Inf. Sci. 178(14), 2870–2879 (2008). https://doi.org/10.1016/j.ins.2008.03.007

    Article  Google Scholar 

  27. Tuba, M., Alihodzic, A., Bacanin, N.: Cuckoo search and bat algorithm applied to training feed-forward. Neural Netw. 585, 139–162 (2014). https://doi.org/10.1007/978-3-319-13826-8_8

  28. Tuba, M., Bacanin, N., Alihodzic, A.: Firefly algorithm for multi-objective RFID network planning problem. Telecommun. Forum Telfor (TELFOR) 95–98 (2014). https://doi.org/10.1109/TELFOR.2014.7034365

  29. Tuba, M., Jovanovic, R.: Improved ant colony optimization algorithm with pheromone correction strategy for the traveling salesman problem. Int. J. Comput. Commun. Control 8(3), 477–485 (2013). https://doi.org/10.15837/ijccc.2013.3.7

  30. Črepinšek, M., Liu, S.H., Mernik, M.: Exploration and exploitation in evolutionary algorithms: a survey. ACM Comput. Surv. 45(3), 35:1–35:33 (2013). https://doi.org/10.1145/2480741.2480752

  31. Yang, X.S.: A new metaheurisitic bat-inspired algorithm. Studies Comput. Intell. 284, 65–74 (2010). https://doi.org/10.1007/978-3-642-12538-6_6

  32. Yang, X.S.: Review of meta-heuristics and generalised evolutionary walk algorithm. Int. J. Bio-Inspired Comput. 3(2), 77–84 (2011). https://doi.org/10.1504/IJBIC.2011.039907

    Article  Google Scholar 

  33. Yang, X.S.: Efficiency analysis of swarm intelligence and randomization techniques. J. Comput. Theor. Nanosci. 9(2), 189–198 (2012). https://doi.org/10.1166/jctn.2012.2012

    Article  Google Scholar 

  34. Yang, X.S.: Free lunch or no free lunch: That is not just a question? Int. J. Artif. Intell. Tools 21(3), 5360–5366 (2012). https://doi.org/10.1142/S0218213012400106

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Adis Alihodzic .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Alihodzic, A. (2022). Statistical Measurements of Metaheuristics for Solving Engineering Problems. In: Fidanova, S. (eds) Recent Advances in Computational Optimization. WCO 2020. Studies in Computational Intelligence, vol 986. Springer, Cham. https://doi.org/10.1007/978-3-030-82397-9_1

Download citation

Publish with us

Policies and ethics

Navigation