SpringerLink
Log in

Selective ensemble of doubly weighted fuzzy extreme learning machine for tumor classification

  • Regular Paper
  • Published:
Progress in Artificial Intelligence Aims and scope Submit manuscript

Abstract

Malignant epithelial cell tumor also known as cancer is a deadly disease requiring a very costly and complex treatment. Early and accurate diagnosis of tumor plays an important role in reducing the mortality rate. With the rapid development of gene chip technology, gene expression data based tumor classification is helpful for accurate decision-making and has achieved great attention of researchers. Due to gene expression data having the properties of multi-class imbalance, high noise and high-dimensional small samples, in this paper, selective ensemble of doubly weighted fuzzy extreme learning machine (SEN-DWFELM) is presented for tumor classification. In view of good generalization performance of extreme learning machine (ELM), feature weighted fuzzy membership is embedded in ELM for eliminating classification error from noise samples. It considers the influence of feature importance on classification to acquire more accurate fuzzy membership. Simultaneously, by removing features with smaller weights it reduces the dimensionality of samples to improve training efficiency. Considering imbalanced learning, the weighted scheme is also introduced to enhance the effect of minority class samples on classification. Furthermore, doubly weighted fuzzy extreme learning machine (DWFELM) based selective ensemble algorithm is proposed to make classification performance more robust. Partial-based DWFELMs are selected using binary version of an improved whale optimization algorithm, and the selected base DWFELMs are integrated by majority voting. Finally, the proposed SEN-DWFELM is compared with conventional ensemble methods and variants of SEN-DWFELM on various gene expression data. Experimental results show that SEN-DWFELM remarkably outperforms other competitors in accordance with classification performance and can effectively deal with tumor diagnosis problems.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
EUR 32.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or Ebook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price includes VAT (Germany)

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

References

  1. Chen, W., Sun, K., Zeng, R., et al.: Cancer incidence and mortality in China, 2014. Chin. J. Cancer Res. 30(1), 1–12 (2018)

    Article  Google Scholar 

  2. Kar, S., Sharma, K.D., Maitra, M.: Gene selection from microarray gene expression data for classification of cancer subgroups employing PSO and adaptive K-nearest neighborhood technique. Expert Syst. Appl. 42(1), 612–627 (2015)

    Article  Google Scholar 

  3. Sun, L., Zhang, X.Y., Qian, Y.H., Xu, J.C., Zhang, S.G.: Feature selection using neighborhood entropy-based uncertainty measures for gene expression data classification. Inf. Sci. 502, 18–41 (2019)

    Article  MathSciNet  Google Scholar 

  4. Huang, G.B., Zhu, Q.Y., Siew, C.K.: Extreme learning machine: theory and applications. Neurocomputing 70(1), 489–501 (2006)

    Article  Google Scholar 

  5. Wu, C., Li, Y.Q., Zhao, Z.B., Liu, B.: Extreme learning machine with autoencoding receptive fields for image classification. Neural Comput. Appl. 32, 8157–8173 (2020)

    Article  Google Scholar 

  6. Wong, P.K., Huang, W., Vong, C.M., Yang, Z.X.: Adaptive neural tracking control for automotive engine idle speed regulation using extreme learning machine. Neural Comput. Appl. 32, 14399–14409 (2020)

    Article  Google Scholar 

  7. Mohammed, A.A., Minhas, R., Wu, Q.M.J., Sid-Ahmed, M.A.: Human face recognition based on multidimensional PCA and extreme learning machine. Pattern Recognit. 44(10), 2588–2597 (2012)

    Google Scholar 

  8. Kaya, Y., Uyar, M.: A hybrid decision support system based on rough set and extreme learning machine for diagnosis of hepatitis disease. Appl. Soft Comput. 13(8), 3429–3438 (2013)

    Article  Google Scholar 

  9. Lan, Y., Soh, Y.C., Huang, G.B.: Ensemble of online sequential extreme learning machine. Neurocomputing 72(13), 3391–3395 (2009)

    Article  Google Scholar 

  10. Zhou, Z.H., Wu, J., Tang, W.: Ensembling neural networks: many could be better than all. Artif. Intell. 137(1–2), 239–263 (2002)

    Article  MathSciNet  Google Scholar 

  11. Shigei, N., Miyajima, H., Maeda, M., et al.: Bagging and AdaBoost algorithms for vector quantization. Neurocomputing 73(1), 106–114 (2009)

    Article  Google Scholar 

  12. Li, K., Kong, X., Lu, Z., Liu, W., Yin, J.: Boosting weighted ELM for imbalanced learning. Neurocomputing 128, 15–21 (2014)

    Article  Google Scholar 

  13. Cao, J.W., Lin, Z.P., Huang, G.B., Liu, N.: Voting based extreme learning machine. Inf. Sci. 185(1), 66–77 (2012)

    Article  MathSciNet  Google Scholar 

  14. Lu, H.J., An, C.L., Zheng, E.H., Lu, Y.: Dissimilarity based ensemble of extreme learning machine for gene expression data classification. Neurocomputing 128, 22–30 (2014)

    Article  Google Scholar 

  15. Zhang, W.B., Ji, H.B.: Fuzzy extreme learning machine for classification. Electron. Lett. 49(7), 448–449 (2013)

    Article  Google Scholar 

  16. He, H., Garcia, E.A.: Learning from imbalanced data. IEEE Trans. Knowl. Data Eng. 21(9), 1263–1284 (2009)

    Article  Google Scholar 

  17. Chawla, N.V., Bowyer, K.W., Hall, L.O., Kegelmeyer, W.P.: SMOTE: synthetic minority over-sampling technique. J. Artif. Intell. Res. 16(1), 321–357 (2002)

    Article  Google Scholar 

  18. Liu, X.Y., Wu, J., Zhou, Z.H.: Exploratory undersampling for class-imbalance learning. IEEE Trans. Syst. Man Cybern. Part B 39(2), 539–550 (2009)

    Article  Google Scholar 

  19. Gupta, U., Gupta, D.: Bipolar fuzzy based least squares twin bounded support vector machine. Fuzzy Set. Syst. 449, 120–161 (2022)

    Article  MathSciNet  Google Scholar 

  20. Hazarika, B.B., Gupta, D.: Density-weighted support vector machines for binary class imbalance learning. Neural Comput. Appl. 33(9), 4243–4261 (2021)

    Article  Google Scholar 

  21. Gupta, D.: Training primal K-nearest neighbor based weighted twin support vector regression via unconstrained convex minimization. Appl. Intell. 47(3), 962–991 (2017)

    Article  Google Scholar 

  22. Hazarika, B.B., Gupta, D.: Density weighted twin support vector machines for binary class imbalance learning. Neural Process. Lett. 54(2), 1091–1130 (2022)

    Article  Google Scholar 

  23. Hancer, E., Xue, B., Zhang, M.J.: Differential evolution for filter feature selection based on information theory and feature ranking. Knowl.-based Syst. 140, 103–119 (2018)

    Article  Google Scholar 

  24. Mirjalili, S., Lewis, A.: The whale optimization algorithm. Adv. Eng. Softw. 95, 51–67 (2016)

    Article  Google Scholar 

  25. Yan, Z.P., Zhang, J.Z., Zeng, J., Tang, J.L.: Nature-inspired approach: an enhanced whale optimization algorithm for global optimization. Math. Comput. Simul. 185, 17–46 (2021)

    Article  MathSciNet  Google Scholar 

  26. Sun, Y.J., Wang, X.L., Chen, Y.H., Liu, Z.J.: A modified whale optimization algorithm for large-scale global optimization problems. Expert Syst. Appl. 114, 563–577 (2018)

    Article  Google Scholar 

  27. Fan, Q., Chen, Z.J., Li, Z., **a, Z.H., Yu, J.Y., Wang, D.Z.: A new improved whale optimization algorithm with joint search mechanisms for high-dimensional global optimization problems. Eng. Comput. 37(3), 1851–1878 (2021)

    Article  Google Scholar 

  28. Wang, J.Z., Du, P., Niu, T., Yang, W.D.: A novel hybrid system based on a new proposed algorithm-multi-objective whale optimization algorithm for wind speed forecasting. Appl. Energy 208, 344–360 (2017)

    Article  Google Scholar 

  29. Aziz, M.A.E., Ewees, A.A., Hassanien, A.E.: Whale optimization algorithm and moth-flame optimization for multilevel thresholding image segmentation. Expert Syst. Appl. 83, 242–256 (2017)

    Article  Google Scholar 

  30. Mafarja, M.M., Mirjalili, S.: Hybrid whale optimization algorithm with simulated annealing for feature selection. Neurocomputing 260, 302–312 (2017)

    Article  Google Scholar 

  31. Gao, L.Y., Ye, M.Q., Lu, X.J., Huang, D.B.: Hybrid method based on information gain and support vector machine for gene selection in cancer classification. Genom. Proteom. Bioinf. 15(6), 389–395 (2017)

    Article  Google Scholar 

  32. Rani, M.J., Devaraj, D.: Two-stage hybrid gene selection using mutual information and genetic algorithm for cancer data classification. J. Med. Syst. 43(8), 235 (2019)

    Article  Google Scholar 

  33. Tavasoli, N., Rezaee, K., Momenzadeh, M., Sehhati, M.: An ensemble soft weighted gene selection-based approach and cancer classification using modified metaheuristic learning. J. Comput. Des. Eng. 8(4), 1172–1189 (2021)

    Google Scholar 

  34. Lu, H.J., Chen, J.Y., Yan, K., **, Q., Xue, Y., Gao, Z.G.: A hybrid feature selection algorithm for gene expression data classification. Neurocomputing 256, 56–62 (2017)

    Article  Google Scholar 

  35. Mondal, M., Semwal, R., Raj, U., Aier, I., Varadwaj, P.K.: An entropy-based classification of breast cancerous genes using microarray data. Neural Comput. Appl. 32(7), 2397–2404 (2020)

    Article  Google Scholar 

  36. Shukla, A.K., Singh, P., Vardhan, M.: Gene selection for cancer types classification using novel hybrid metaheuristics approach. Swarm Evol. Comput. 54, 100661 (2020)

    Article  Google Scholar 

  37. Dabba, A., Tari, A., Meftali, S., Mokhtari, R.: Gene selection and classification of microarray data method based on mutual information and moth flame algorithm. Expert Syst. Appl. 166, 114012 (2021)

    Article  Google Scholar 

  38. Wang, Y., Wang, A.N., Ai, Q., Sun, H.J.: Enhanced kernel-based multilayer fuzzy weighted extreme learning machines. IEEE Access 8, 166246–166260 (2020)

    Article  Google Scholar 

  39. Wang, Y., Wang, A.N., Ai, Q., Sun, H.J.: An adaptive kernel-based weighted extreme learning machine approach for effective detection of Parkinson’s disease. Biomed. Signal Process. Control 38, 400–410 (2017)

    Article  Google Scholar 

  40. Bartlett, P.L.: The sample complexity of pattern classification with neural networks: the size of the weights is more important than the size of the network. IEEE Trans. Inf. Theory 44(2), 525–536 (1998)

    Article  MathSciNet  Google Scholar 

  41. Zong, W.W., Huang, G.B., Chen, Y.Q.: Weighted extreme learning machine for imbalance learning. Neurocomputing 101(3), 229–242 (2013)

    Article  Google Scholar 

  42. Palma-Mendoza, R.J., Rodriguez, D., De-Marcos, L.: Distributed ReliefF-based feature selection in spark. Knowl. Inf. Syst. 57(1), 1–20 (2018)

    Article  Google Scholar 

  43. Alotaibi, A.S.: Hybrid model based on ReliefF algorithm and k-nearest neighbor for erythemato-squamous diseases forecasting. Arab. J. Sci. Eng. 47(2), 1299–1307 (2022)

    Article  Google Scholar 

  44. Tizhoosh, R.H.: Opposition-based learning: A new scheme for machine intelligence. In: International Conference on Computational Intelligence for Modelling, Control and Automation, pp. 695–701 (2005)

  45. Rahnamayan, S., Tizhoosh, H.R., Salama, M.M.A.: Quasi-oppositional differential evolution. In: 2007 IEEE Congress on Evolutionary Computation, pp. 2229-2236 (2007)

  46. Kennedy, J., Eberhart, R.: Particle swarm optimization. In: Proceedings of IEEE International Conference on Neural Network, pp. 1942–1948 (1995)

  47. Kennedy, J., Eberhart, R.C.: A discrete binary version of the particle swarm algorithm. In: Proceedings of IEEE International Conference on Systems, Man and Cybernetics, pp. 4104–4108 (1997)

  48. http://www.gems-system.org/

  49. Wang, Y., Wang, A.N., Ai, Q., Sun, H.J.: Ensemble based fuzzy weighted extreme learning machine for gene expression classification. Appl. Intell. 49, 1161–1171 (2019)

    Article  Google Scholar 

Download references

Acknowledgements

This work was supported by talent scientific research fund of LIAONING PETROCHEMICAL UNIVERSITY (No.2023XJJL-006).

Author information

Authors and Affiliations

  1. School of Artificial Intelligence and Software, Liaoning Petrochemical University, Fushun, 113001, China

    Yang Wang

Authors
  1. Yang Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Yang Wang.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Wang, Y. Selective ensemble of doubly weighted fuzzy extreme learning machine for tumor classification. Prog Artif Intell (2024). https://doi.org/10.1007/s13748-024-00319-y

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s13748-024-00319-y

Keywords

Search

Navigation