SpringerLink
Log in

Hybrid Whale Optimization and Canonical Correlation based COVID-19 Classification Approach

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

The COVID-19 worldwide pandemic has become a great challenge for medical systems. Early detection of coronavirus increases the cure rate and saves the lives of patients. Therefore, a computer-assisted diagnostic tool is necessary to assist radiologists to quickly classify cases of pneumonia as COVID-19 or not. In this paper, we developed an approach that automatically detects COVID-19 disease. This approach relies on an optimized convolutional neural networks (CNNs) to extract deep features from both the computed tomography (CT) scans and the X-ray images. Then, features selection process is applied on CT and X-ray features to eliminate the redundant and irrelevant features and also select more accurate, appropriate, and discriminative ones. The selected CT and X-ray features are combined together using features fusion method to form a final deep feature descriptor for classification. CT and X-ray features are extracted using an optimized CNN architecture model containing thirteen convolutional layers. Sparse Filtering (SF), Features Transformation (FT), Particle Swarm Optimization (PSO), Grey Wolf Optimization (GWO), Hybrid Whale Optimization (HWO), and Entropy Mutual Information (EMI) Techniques are utilized for features selection. Furthermore, various features fusion algorithms are evaluated such as; CNN-based Fusion, Fuzzy Fusion, Canonical Correlation, Neuro Fuzzy, Curvelet based Fusion, and Discrete Wavelet Transform (DWT). Besides, for both augmented and un-augmented CT and X-ray images, we evaluate various optimization algorithms (OA), mini-batch size (M-B) values, and learning rates (LR) to reveal the optimal parameters of the proposed CNN architecture model. Regarding optimization, adaptive moment estimation (Adam) algorithm showed better performance than root mean square propagation (RMS prop), and stochastic gradient descent with momentum (SGDM). The proposed approach achieves a remarkable accuracy (99.43%) for augmented images using Hybrid Whale Optimization (HWO) technique with Canonical Correlation based fusion approach. The proposed approach is superior to traditional pre-trained CNNs and the state-of-the-art classification techniques.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
EUR 32.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or Ebook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12

Similar content being viewed by others

Data availability

The data used to support the findings of this study are available from the corresponding author upon request.

References

  1. Singhal T (2020) A review of coronavirus disease-2019 (COVID-19). Indian J Pediatr 281–286. https://doi.org/10.1007/s12098-020-03263-6 

  2. https://www.who.int/dg/speeches/detail/who-directorgeneral-s-opening-remarks-at-the-mediabriefing-on-covid-19, 27-july-2020

  3. Phan L, Nguyen T, Luong Q, Nguyen T, Nguyen H, Le H, Nguyen T, Cao T, Pham Q (2020) Importation and human-to-human transmission of a novel coronavirus in Vietnam. New England J Med 872–874. https://doi.org/10.1056/NEJMc2001272 

  4. Ai T, Yang Z, Hou H, Zhan C, Chen C, Lv W (2020) Correlation of chest CT and RT-PCR testing in coronavirus disease 2019 (COVID-19) in China: A Report of 1014 Cases. Radiology. https://doi.org/10.1148/radiol.2020200642

  5. Bernheim A, Mei X, Huang M, Yang Y, Fayad ZA, Zhang N (2020) Chest CT findings in coronavirus disease-19 (COVID-19): relationship to duration of infection. Radiology. https://doi.org/10.1148/radiol.2020200463

  6. Apostolopoulos I, Bessiana T (2020) Covid-19: Automatic detection from X-Ray images utilizing transfer Learning with convolutional neural networks. ar**v:2003.11617

  7. Chen J, Wu L, Zhang J, Zhang L, Gong D, Zhao Y (2020) Deep learning-based model for detecting 2019 novel coronavirus pneumonia on high-resolution computed tomography: a prospective study. MedRxiv. https://doi.org/10.1101/2020.02.25.20021568

  8. Sajjad M, Khan S, Muhammad K, Wanqing W, Ullah A, WookBaik S (2019) Multi-grade brain tumor classification using deep CNN with extensive data augmentation. J Comput Sci 174–182

  9. Braman N, Prasanna P, Whitney J, Singh S, Beig N, Etesami M, Bates D, Gallagher K, Bloch B, Vulchi M, Turk P, Bera K, Abraham J, Sikov W, Somlo G, Harris L, Gilmore H, Plecha D, Varadan V, Madabhushi A (2019) Association of peritumoral radiomics with tumor biology and pathologic response to preoperative targeted therapy for HER2 (ERBB2)-Positive breast Cancer. JAMA Netw. https://doi.org/10.1001/jamanetworkopen

  10. Cheng and Zhi J (2016) Computer-aided diagnosis with deep learning architecture: applications to breast lesions in US images and pulmonary nodules in CT scan. Scientific reports 1–13

  11. Iandola FN, Han S, Moskewicz MW, Ashraf K, Dally WJ, Keutzer K (2016) SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and <0.5MB model size. Available: https://arxiv.org/abs/1602.07360, [Online]

  12. Das S (2017) CNN Architectures: LeNet, AlexNet, VGG, GoogLeNet, ResNet and more. Medium, Available: https://medium.com/analytics-vidhya/cnns-architectures-lenet-alexnet-vgg-googlenet-resnet-and-more-666091488df, [Online]

  13. Simonyan K, Zisserman A (2014) Very deep convolutional networks for large-scale image recognition. Available: https://arxiv.org/abs/1409.1556, [Online]

  14. Zeng G, He Y, Yu Z, Yang X, Yang R, Zhang L (2016) Preparation of novel high copper ions removal membranes by embedding organosilane-functionalized multi-walled carbon nanotube. J Chem Technol Biotechnol 91(8):2322–2330

    Article  Google Scholar 

  15. He K, Zhang X, Ren S, Sun J (2015) Deep residual learning for image recognition. Available: https://arxiv.org/abs/1512.03385, [Online]

  16. Huang G, Liu Z, Van Der Maaten L, Weinberger KQ (2017) Densely connected convolutional networks. in 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2261–2269

  17. Chollet F (2017) Xception: Deep learning with depthwise separable convolutions. in 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 1800–1807

  18. Szegedy C, Ioffe S, Vanhoucke V, Alemi A (2016) Inception-v4, inception-resnet and the impact of residual connections on learning. 31st AAAI Conf Artif Intell AAAI 2017 4:12

  19. Qin Z, Zhang Z, Chen X, Wang C, Peng Y (2018) Fd-Mobilenet: Improved mobilenet with a fast downsampling strategy. in 2018 25th IEEE International Conference on Image Processing (ICIP), 1363–1367

  20. Li L, Qin L, Xu Z, Yin Y, Wang X, Kong B (2020) Artificial intelligence distinguishes COVID-19 from community acquired pneumonia on chest CT. Radiology. https://doi.org/10.1148/radiol.2020200905

  21. Yousefzadeh M et al. (2020) Ai-Corona: Radiologist-assistant deep learning framework for COVID-19 diagnosis in chest CT scans. Available: https://www.medrxiv.org/content/10.1101/2020.05.04.20082081v1 https://doi.org/10.1101/2020.05.04.20082081v1. [Online]

  22. Hemdan E, Shouman M, Karar M (2020) Covidx-net: A framework of deep learning classifiers to diagnose covid-19 in x-ray images. ar**v:2003.11055

  23. Xu X et al (2020) Deep learning system to screen coronavirus disease 2019 Pneumonia. Available: https://arxiv.org/abs/2002.09334, [Online]

  24. ** et al (2020) AI-assisted CT imaging analysis for COVID-19 Screening: Building and deploying a medical AI system in four weeks. Available: https://www.medrxiv.org/content/https://doi.org/10.1101/2020.03.19.20039354v1, [Online]

  25. Javaheri T et al (2020) CovidCTNet: An open-source deep learning approach to identify covid-19 using CT image. Available: https://arxiv.org/abs/2005.03059. [Online]

  26. Horry MJ et al (2020) X-Ray image based COVID-19 detection using pre-trained deep learning models, Available: https://engrxiv.org/wx89s/, [Online]

  27. He et al (2020) Sample-efficient deep learning for COVID-19 Diagnosis Based on CT Scans. Available: https://www.medrxiv.org/content/10.1101/2020.04.13.20063941v1, [Online]

  28. Singh D, Kumar V, Vaishali, Kaur M (2020) Classification of COVID-19 patients from chest CT images using multi-objective differential evolution-based convolutional neural networks. European Journal of Clinical Microbiology & Infectious Diseases 39(7).https://doi.org/10.1007/s10096-020-03901-z

  29. Shi F, **a L, Shan F, Wu D, Wei Y, Yuan H (2020) Large-scale screening of COVID-19 from community acquired pneumonia using infection size-aware classification. ar**v:2003.09860

  30. Barstugan M, Ozkaya U, Ozturk S (2020) Coronavirus (COVID-19) Classification using CT images by machine learning methods, ar**v:2003.09424

  31. ** C, Cheny W, Cao Y, Xu Z, Zhang X, Deng L (2020) Development and evaluation of an AI System for COVID-19 diagnosis. MedRxiv, https://doi.org/10.1101/2020.03.20.20039834

  32. Sun Q, Zeng S, Liu Y, Heng P, **a D (2005) A new method of feature fusion and its application in image recognition. Pattern Recognition 38

  33. Ozkaya U, Ozturk S, Barstugan M (2020) Coronavirus (COVID-19) Classification using deep features fusion and ranking technique, ar**v:2004.03698

  34. Zhang J, **e Y, Li Y, Shen C, **a Y (2020) COVID-19 screening on chest x-ray images using deep learning based anomaly detection. ar**v:2003.12338

  35. Ghoshal B, Tucker A (2020) Estimating uncertainty and interpretability in deep learning for coronavirus (COVID-19) Detection. ar**v:2003.10769

  36. Wang L, WongA (2020) Covid-net: A tailored deep convolutional neural network design for detection of covid-19 cases from chest radiography images. ar**v:2003.09871

  37. Suhail Parvaze P, Bhattacharjee R, Verma YK, Singh RK, Yadav V, Singh A, Khanna G et al (2022) Quantification of radiomics features of peritumoral vasogenic edema extracted from FLAIR images in glioblastoma and isolated brain metastasis, using T1‐DCE perfusion analysis. NMR in Biomedicine (2022): e4884

  38. Suhail PP, Bhattacharjee R, Singh A, Ahlawat S, Patir R, Vaishya S, Shah TJ, Gupta RK (2022) Radiomics-based evaluation and possible characterization of Dynamic Contrast Enhanced (DCE) perfusion derived different sub-regions of glioblastoma. Eur J Radiol (2022): 110655

  39. Hasnat A, Bohn’e J, Milgram J, Gentric S, Chen L (2017) Deep Visage: Making face recognition simple yet with powerful generalization skills. In: Proceedings of the CVPR, pp 1–12

  40. Yakopcic C, Alom M, Taha T (2017) Extremely parallel memristor crossbar architecture for convolutional neural network implementation. In Proceedings of the International Joint Conference on Neural Networks (IJCNN), 1696–1703

  41. Zennaro FM, Chen K (2018) Towards understanding sparse filtering: A theoretical perspective. Neural Netw 98(2018):154–177

    Article  Google Scholar 

  42. Li X, Zhao H, Yu L, Chen H, Deng W, Deng W (2022) Feature extraction using parameterized multisynchrosqueezing transform. IEEE Sensors J 22(14)

  43. Pereira G, Particle Swarm Optimization, https://www.researchgate.net/publication/228518470, All content following this page was uploaded by Gonçalo Pereira on 08 July 2014

  44. Muro C, Escobedo R, Spector L, Cop**er R (2011) Wolf-Pack (Canis Lupus) hunting strategies emerge from simple rules in computational simulations. Behav Proc 88:192–197

    Article  Google Scholar 

  45. Mirjalili S, Lewis A (2016) The whale optimization algorithm. Adv Eng Softw 95:51–67

    Article  Google Scholar 

  46. Can-Tao L, Bao-Gang H (2009) Mutual Information Based on Renyi’s Entropy Feature Selection. 978–1–4244–4738–1/09/$25.00 ©2009 IEEE, pp 816–820

  47. Ran R, Deng L, Jiang T, Hu J, Chanussot J (2023) GuidedNet: A General CNN fusion framework via high-resolution guidance for hyperspectral image super-resolution. IEEE Trans Cybern 53(7)

  48. Dammavalam SR et al (February 2012) Quality assessment of pixel-level image fusion using fuzzy logic. IJSC 3(1):13–25

    Article  Google Scholar 

  49. Gao L et al (2021) The labeled multiple canonical correlation analysis for information fusion. ar**v:2103.00359v1 [cs.CV], pp. 1–12

  50. Srinivasa Rao D, et al (2012) Comparison of fuzzy and neuro fuzzy image fusion techniques and its applications. Intl J Comput Appl (0975 – 8887), Volume 43– No. 20, pp 31–37

  51. Hossam El-Din Moustafa, Yasmeen Abdullah (2015) Fusion of multi-focus color images based on wavelet transform and curvelet transform. Mansoura Engineering Journal, (MEJ), Vol. 40, Issue 4: [the 8th International Engineering Conference, pp E64 – E71

  52. Shruti J, Mohit S, Dubey P, Anish V (2019) Multi-sensor image fusion using intensity hue saturation technique. Springer Commun Comput Inform Sci 1076:147–157

    Article  Google Scholar 

  53. El-Shafai W, Abd El-Samie F (2020) Extensive and augmented COVID-19 X-Ray and CT Chest Images Dataset. https://doi.org/10.17632/8h65ywd2jr.2

Download references

Author information

Authors and Affiliations

  1. Department of Electrical Engineering, Faculty of Engineering, Sinai University, El Arish, 45511, Egypt

    Essam Abdellatef

  2. Department of Electrical Engineering, Faculty of Engineering, Suez University, Suez, 43221, Egypt

    M. I. Fath Allah

Authors
  1. Essam Abdellatef
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. M. I. Fath Allah
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Essam Abdellatef.

Ethics declarations

Ethical approval

All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards.

Informed consent

Informed consent was obtained from all individual participants included in the study.

Conflict of interest

The authors declare that they have no conflict of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Abdellatef, E., Allah, M.I.F. Hybrid Whale Optimization and Canonical Correlation based COVID-19 Classification Approach. Multimed Tools Appl (2024). https://doi.org/10.1007/s11042-024-18153-8

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s11042-024-18153-8

Keywords

Search

Navigation