SpringerLink
Log in

Feature Selection with a Binary Flamingo Search Algorithm and a Genetic Algorithm

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

In data mining, feature selection (FS) has become a significant data pre-processing tool that maximises the model's generalisation and minimises the feature size. Due to the large search area, the classical optimization techniques repeatedly fail to construct global optimization. Several hybrid models integrating various search policies have recently been offered; however, they mostly deal with low dimensional datasets. This paper proposes a hybrid version of binary flamingo search with a genetic algorithm (HBFS-GA) to overcome the FS problem using a wrapper model. A genetic algorithm (GA) and a flamingo search algorithm (FSA) are combined in the proposed work. HBFS-GA executes on continuous search, but the FS is in discrete space. By utilizing transfer functions (TFs), the continuous search has been transformed into a discrete one. To determine the best TF and investigate HBFS-GA, the proposed model used eight distinct TFs. Following that, the performance of the proposed HBFS-GA is evaluated using 18 different UCI datasets and many metrics. The optimal variation is chosen, and the performance of existing wrapper-based and filter-based FS models is investigated. The existing wrapper-based models include BPSO, BGA, BACO, BCS, BGWO, BBAT, BGEO, and BCSO. Some filter-based methods include a gain ratio and correlation bases FS, information gain and relief, respectively. Besides, the proposed HBFS-GA is evaluated using 30 functions from CEC’2019 and CEC’2020 benchmarks. Consequently, the proposed HBFS-GA has accomplished better outcomes than existing models. While analysing the classification accuracy with eighteen datasets, the lung cancer dataset obtains higher accuracy of 99.51% with less computation time of 0.031s.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
EUR 32.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or Ebook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Algorithm 1
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9

Similar content being viewed by others

References

  1. Abdel-Basset M, El-Shahat D, El-henawy I, de Albuquerque VHC, Mirjalili S (2020) A new fusion of grey wolf optimizer algorithm with a two-phase mutation for featureselection. Expert Syst Appli 139:112824

    Article  Google Scholar 

  2. Abdel-Basset M, Ding W, El-Shahat D (2021) A hybrid Harris Hawks optimization algorithm with simulated annealing for feature selection. Artificial Intel Rev 54(1):593–637

    Article  Google Scholar 

  3. Abdollahzadeh B, Gharehchopogh FS (2021) A multi-objective optimization algorithm for feature selection problems. Engin Comput:1–19

  4. Adamu A, Abdullahi M, Junaidu SB, Hassan IH (2021) An hybrid particle swarm optimization with crow search algorithm for feature selection. Mach Learn Appl 6:100108

    Google Scholar 

  5. Ahmed S, Ghosh KK, Singh PK, Geem ZW, Sarkar R (2020) Hybrid of harmony search algorithm and ring theory-based evolutionary algorithm for feature selection. IEEE Access 8:102629–102645

    Article  Google Scholar 

  6. Almazini H, Ku-Mahamud K (2021) Grey wolf optimization parameter control for feature selection in anomaly detection. Int J Int Eng Syst 14(2):474–483

    Google Scholar 

  7. Al-Tashi Q, Abdulkadir SJ, Rais HM, Mirjalili S, Alhussian H, Ragab MG, Alqushaibi A (2020) Binary multi-objective grey wolf optimizer for feature selection in classification. IEEE Access 8:106247–106263

    Article  Google Scholar 

  8. Alwajih R, Abdulkadir SJ, Al Hussian H, Aziz N, Al-Tashi Q, Mirjalili S, Alqushaibi A (2022) Hybrid binary whale with harris hawks for feature selection. Neural Comput Appl:1–19

  9. Alweshah M, Khalaileh SA, Gupta BB, Almomani A, Hammouri AI, Al-Betar MA (2020) The monarch butterfly optimization algorithm for solving feature selection problems. Neural Comput Appl:1–15

  10. Alweshah M, Alkhalaileh S, Albashish D, Mafarja M, Bsoul Q, Dorgham O (2021) A hybrid mine blast algorithm for feature selection problems. Soft Comput 25(1):517–534

    Article  Google Scholar 

  11. Alzaqebah M, Jawarneh S, Mohammad RMA, Alsmadi MK, Al-Marashdeh I, Ahmed EA, Alrefai N, Alghamdi FA (2021) Hybrid feature selection method based on particle swarm optimization and adaptive local search method. Int J Electri Comput Eng 11(3):2414

    Google Scholar 

  12. Arora S, Anand P (2019) Binary butterfly optimization approaches for feature selection. Expert Systemswith Applications 116:147–160

    Article  Google Scholar 

  13. Bezdan T, Cvetnic D, Gajic L, Zivkovic M, Strumberger I and Bacanin N (2021) Feature selection by firefly algorithm with improved initialization strategy. In 7th Conference on the Engineering of Computer Based Systems, pp. 1-8

  14. Chakraborty S, Saha AK, Sharma S, Chakraborty R and Debnath S (2021) A hybrid whale optimization algorithm for global optimization. J Ambient Int Human Comput, pp. 1-37

  15. Chantar H, Thaher T, Turabieh H, Mafarja M, Sheta A (2021) BHHO-TVS: A binary harris hawks optimizer with time-varying scheme for solving data classification problems. Appl Sci 11(14):6516

    Article  Google Scholar 

  16. Chen K, Zhou FY, Yuan XF (2019) Hybrid particle swarm optimization with spiral-shaped mechanism for feature selection. Expert Syst Appli 128:140–156

    Article  Google Scholar 

  17. De Souza RCT, dos Santos Coelho L, De Macedo CA, Pierezan J (2018) A V-shaped binary crow search algorithm for feature selection. In 2018 IEEE congress on evolutionary computation (CEC). IEEE, pp. 1-8

  18. El-Kenawy ESM, Eid MM, Saber M, Ibrahim A (2020) MbGWO-SFS: Modified binary grey wolf optimizer based on stochastic fractal search for feature selection. IEEE Access 8:107635–107649

    Article  Google Scholar 

  19. Eluri RK, Devarakonda N (2022) Binary Golden Eagle Optimizer with Time-Varying Flight Length for feature selection. Knowledge-Based Syst 247:108771

    Article  Google Scholar 

  20. Emary E, Zawbaa HM (2019) Feature selection via Lèvy Antlion optimization. Pattern Anal Appli 22(3):857–876

    Article  Google Scholar 

  21. Emary E, Zawbaa HM (2019) Feature selection via Lèvy Antlion optimization. Patt Analy Appl 22(3):857–876

    Article  Google Scholar 

  22. Ghosh M, Adhikary S, Ghosh KK, Sardar A, Begum S, Sarkar R (2019) Genetic algorithm based cancerous gene identification from microarray data using ensemble of filter methods. Med Biol Engin Comput 57(1):159–176

    Article  Google Scholar 

  23. Ghosh KK, Guha R, Bera SK, Kumar N, Sarkar R (2021) S-shaped versus V-shaped transfer functions for binary Manta ray foraging optimization in feature selection problem. Neural Comput Appl:1–15

  24. Gupta S, Chug A (2021) An Extensive Analysis of Machine Learning Based Boosting Algorithms for Software Maintainability Prediction

  25. Habib M, Aljarah I, Faris H, Mirjalili S (2020) Multi-objective particle swarm optimization: theory, literature review, and application in feature selection for medical diagnosis. Evolut Mach Learn Techniq:175–201

  26. Hamdia KM, Zhuang X, Rabczuk T (2021) An efficient optimization approach for designing machine learning models based on genetic algorithm. Neural Comput Appl 33(6):1923–1933

    Article  Google Scholar 

  27. Hans R, Kaur H (2020) Binary multi-verse optimization (BMVO) approaches for feature selection.

  28. Hussien AG, Hassanien AE, Houssein EH, Bhattacharyya S, Amin M (2019) S-shaped binary whale optimization algorithm for feature selection. In: Recent trends in signal and image processing. Springer, Singapore, pp 79–87

    Chapter  Google Scholar 

  29. Ibrahim RA, Ewees AA, Oliva D, Elaziz MA, Lu S (2019) Improved salp swarm algorithm based on particle swarm optimization for feature selection. J Ambient Int Human Comput 10(8):3155–3169

    Article  Google Scholar 

  30. Jia H, **ng Z, Song W (2019) A New Hybrid Seagull Optimization Algorithm for Feature Selection. IEEE Access 7:49614–49631

    Article  Google Scholar 

  31. Jia H, Sun K, Li Y, Cao N (2022) Improved marine predators algorithm for feature selection and SVM optimization. KSII Trans Int Inform Syst (TIIS) 16(4):1128–1145

    Google Scholar 

  32. Katoch S, Chauhan SS, Kumar V (2021) A review on genetic algorithm: past, present, and future. Multimed Tools Appl 80(5):8091–8126

    Article  Google Scholar 

  33. Kılıç F, Kaya Y, Yildirim S (2021) A novel multi population based particle swarm optimization for feature selection. Knowledge-Based Syst 219:106894

    Article  Google Scholar 

  34. Lambora A, Gupta K, Chopra K (2019) Genetic algorithm-A literature review. In: In 2019 international conference on machine learning, big data, cloud and parallel computing (COMITCon). IEEE, pp 380–384

    Google Scholar 

  35. Li AD, Xue B, Zhang M (2021) Improved binary particle swarm optimization for feature selection with new initialization and search space reduction strategies. Appl Soft Comput 106:107302

    Article  Google Scholar 

  36. Long W, Xu M, Jiao J, Wu T, Tang M, Cai S (2022) A velocity-based butterfly optimization algorithm for high-dimensional optimization and feature selection. Expert Syst Appli 201:117217

    Article  Google Scholar 

  37. Mafarja MM and Mirjalili S (Oct. 2017) Hybrid Whale Optimization Algorithm with simulated annealing for feature selection, Neurocomput, 260: 302-312,.

  38. Mafarja M, Jarrar R, Ahmad S and Abusnaina AA (2018) Feature selection using Binary Particle Swarmoptimization with time varying inertia weight strategies. ACM International Conference proceeding Series

  39. Mafarja M, Aljarah I, Heidari AA, Hammouri AI, Faris H, Ala’M AZ and Mirjalili S (2018) Evolutionary population dynamics and grasshopper optimization approaches for feature selection problems. Knowledge-Based Sys, 145: 25-45.

  40. Mafarja M, Aljarah I, Faris H, Hammouri AI, Ala’M AZ, Mirjalili S (2019) Binary grasshopper optimisation algorithm approaches for feature selection problems. Expert Syst Appl 117:267–286

    Article  Google Scholar 

  41. Mafarja M, Qasem A, Heidari AA, Aljarah I, Faris H, Mirjalili S (2020) Efficient hybrid nature-inspired binary optimizers for feature selection. Cognitive Comput 12(1):150–175

    Article  Google Scholar 

  42. Mafarja M, Heidari AS, Faris H, Mirjalili S, Aljarah I (2020) Dragonfly algorithm: theory, literature review, and application in feature selection. Nature-inspired optimizers, pp. 47-67

  43. Malathi T, Manimekalai M (2021) Optimization Based Feature Selection Method For Weather Dataset. Annals of the Romanian Soc Cell Bio, pp. 18515-18527

  44. Mandal AK, Sen R, Chakraborty B (2021) Feature selection in classification using self-adaptive owl search optimization algorithm with elitism and mutation strategies. J Int Fuzzy Syst 40(1):535–550

    Google Scholar 

  45. Manosij G, Ritam G, Sarkar R, Abraham A (2020) A wrapper-filter feature selection technique based on ant colony optimization. Neural Comput Appl 32(12):7839–7857

    Article  Google Scholar 

  46. Mohamed AW, Hadi AA, Mohamed AK, Awad NH (2020) Evaluating the performance of adaptive gainingsharing knowledge based algorithm on cec 2020 benchmark problems. In: 2020 IEEE Congress on Evolutionary Computation (CEC). IEEE., pp. 1-8

  47. Neggaz N, Ewees AA, Abd Elaziz M, Mafarja M (2020) Boosting salp swarm algorithm by sine cosine algorithm and disrupt operator for feature selection. Expert Syst Appli 145:113103

    Article  Google Scholar 

  48. Pandey AC, Rajpoot DS, Saraswat M (2020) Feature selection method based on hybrid data transformation and binary binomial cuckoo search. J Ambient Int Human Comput 11(2):719–738

    Article  Google Scholar 

  49. Paniri M, Dowlatshahi MB, Nezamabadi-pour H (2020) MLACO: A multi-label feature selection algorithm based on ant colony optimization. Knowledge-Based Syst 192:105285

    Article  Google Scholar 

  50. Paniri M, Dowlatshahi MB, Nezamabadi-pour H (2021) Ant-TD: Ant colony optimization plus temporal difference reinforcement learning for multi-label feature selection. Swarm Evolut Comput 64:100892

    Article  Google Scholar 

  51. Qaraad M, Amjad S, Hussein NK, Elhosseini MA (2022) Large scale salp-based grey wolf optimization for feature selection and global optimization. Neural Comput Appl 1-26

  52. Rezk H, Arfaoui J and Gomaa MR (2021) Optimal parameter estimation of solar PV panel based on hybrid particle swarm and grey wolf optimization algorithms

  53. Rostami O, Kaveh M (2021) Optimal feature selection for SAR image classification using biogeography-based optimization (BBO), artificial bee colony (ABC) and support vector machine (SVM): a combined approach of optimization and machine learning. Comput Geosci 25(3):911–930

    Article  MATH  Google Scholar 

  54. Salgotra R, Singh U, Saha S, Gandomi AH (2020) Improving cuckoo search: incorporating changes for CEC 2017 and CEC 2020 benchmark problems. In 2020 IEEE Congress on Evolutionary Computation (CEC), IEEE, pp. 1-7

  55. Sayed GI, Tharwat A, Hassanien AE (2019) Chaotic dragonfly algorithm: an improved metaheuristic algorithm for feature selection. App Int 49(1):188–205

    Article  Google Scholar 

  56. Song Y (2022) Research on the Application of Computer Graphic Advertisement Design Based on a Genetic Algorithm and TRIZ Theory. Int J Interact Multimed Artificial Int 7(4)

  57. Sun Z, Zhang J, Dai L, Li C, Zhou C, **n J, Li S (2019) Mutual information based multi-label feature selection via constrained convex optimization. Neurocomputing 329:447–456

    Article  Google Scholar 

  58. Taradeh M, Mafarja M, Heidari AA, Faris H, Aljarah I, Mirjalili S and Fujita H. (2019) Anevolutionary gravitational search-based feature selection

  59. Tawhid MA, Dsouza KB (2020) Hybrid binary bat enhanced particle swarm optimization algorithm for solving feature selection problems. Appl Comput Inform

  60. Tubisha M, Alswaitti M, Mirjalili S, Al-Garadi MA, Rana TA (2020) Dynamic butterfly optimization algorithm for feature selection. IEEE Access 8:194303–194314

    Article  Google Scholar 

  61. Tubishat M, Idris N, Shuib L, Abushariah MAM, Mirjalili S (2020) Improved Salp Swarm Algorithm based on opposition based learning and novel local search algorithm for feature selection. Expert Syst Appl 145:113122

    Article  Google Scholar 

  62. Wang Z and Liu J (2021) Flamingo Search Algorithm and Its Application to Path Planning Problem. In: 2021 4th International Conference on Artificial Intelligence and Pattern Recognition, pp. 567-573

  63. Wei B, Zhang W, **a X, Zhang Y, Yu F, Zhu Z (2019) Efficient feature selection algorithm based on particle swarm optimization with learning memory. IEEE Access 7:166066–166078

    Article  Google Scholar 

  64. Zakeri A, Hokmabadi A (2019) Efficient feature selection method using real-valued grasshopper optimization algorithm. Expert Systems with Applications 119:61–72

    Article  Google Scholar 

  65. Zhang Y, Liu R, Wang X, Chen H and Li C (2020) Boosted binary Harris hawks optimizer and feature selection. Engineering with Computers 1-30.

  66. Zhang X, Xu Y, Yu C, Heidari AA, Li S, Chen H, Li C (2020) Gaussian mutational chaotic fruit fly-built optimization and feature selection. Expert Syst Appli 141:112976

    Article  Google Scholar 

  67. Zhang Y, Gong D, Gao X, Tian T, Sun X (2020) Binary differential evolution with self-learning for multi-objective feature selection. Inform Sci 507:67–85

    Article  MathSciNet  MATH  Google Scholar 

  68. Zhiheng W, Jianhua L (2021) Flamingo search algorithm: A new swarm intelligence optimization algorithm. IEEE Access 9:88564–88582

    Article  Google Scholar 

Download references

Data Availability Statement

Data sharing does not apply to this article.

Funding

No funding is provided for the preparation of the manuscript.

Author information

Authors and Affiliations

  1. School of Computer Science and Engineering, VIT-AP University, Amaravati, Andhra Pradesh, 522237, India

    Rama Krishna Eluri & Nagaraju Devarakonda

Authors
  1. Rama Krishna Eluri
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Nagaraju Devarakonda
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

All authors have equal contributions to this work.

Corresponding author

Correspondence to Rama Krishna Eluri.

Ethics declarations

Conflict of Interest

Authors declare that they have no conflict of interest.

Ethical Approval

This article does not contain any studies with human participants or animals performed by any authors.

Consent to participate

All the authors involved have agreed to participate in this submitted article.

Consent to Publish

All the authors involved in this manuscript give full consent for publication of this submitted article.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Eluri, R.K., Devarakonda, N. Feature Selection with a Binary Flamingo Search Algorithm and a Genetic Algorithm. Multimed Tools Appl 82, 26679–26730 (2023). https://doi.org/10.1007/s11042-023-15467-x

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-023-15467-x

Keywords

Search

Navigation