SpringerLink
Log in

Performance Analysis of Fusion Methods for the Multimodal Fusion of CT/MRI, MRI/PET and PET/CT Brain Images

  • Conference paper
  • First Online:
Recent Trends in Electronics and Communication (VCAS 2020)

Part of the book series: Lecture Notes in Electrical Engineering ((LNEE,volume 777))

Included in the following conference series:

  • 1556 Accesses

Abstract

Multimodal medical image fusion is one of the emerging technologies in the field of biomedical research and disease analysis. Not only it is aiding the medical experts in assessing the various disorders, but also it is responsible for bringing out the embedded diagnostic information content out of the input source images. When fusion is performed, all the redundancies and irregularities get removed from the source images along with an improved visual quality of final fused image. This paper is aimed at finding the best fusion method for the multimodal fusion of CT/MRI, MRI/PET and PET/CT brain images. A total of 60 brain images that were acquired using imaging modalities such as CT, MRI and PET have been used for performing the fusion. Various fusion methods such as PBM, DWT, SWT and PCA have been explored, and their performance is analyzed via use of image quality assessment metrics like entropy, SSIM, PSNR and RMSE which are widely used by researchers. Simulation results along with comparison tables are also presented in the paper which justifies the effectiveness of proposed fusion method when compared to other approaches. Finally, it has been concluded that the proposed fusion method, i.e., PCA is the best outperforming fusion method for the multimodal fusion of CT/MRI, MRI/PET and PET/CT brain images.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Subscribe and save

Springer+ Basic
EUR 32.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or Ebook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Hardcover Book
USD 219.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Free ship** worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. B. Rajalingam, R. Priya, Multimodality medical image fusion based on hybrid fusion techniques. Int. J. Eng. Manufact. Sci. 7(1) (2017)

    Google Scholar 

  2. H.M. El-Hoseny, W. Abd Elrahman, E.M. El-Rabaie, O.S. Faragallah, F.E. Abd El-Sami, Medical image fusion: a literature review present solutions and future directions. Menoufia J. Electron. Eng. Res. 26(2), 321–350 (2017)

    Article  Google Scholar 

  3. A.P. James, B.V. Dasarathy, Medical image fusion: a survey of the state of the art. Inf. Fusion 19, 4–19 (2014)

    Article  Google Scholar 

  4. F.E. El-Gamal, M. Elmogy, A. Atwan, Current trends in medical image registration and fusion. Egypt. Inf. J. 17(1), 99–124 (2016)

    Google Scholar 

  5. J.J. Lewis, R.J. O’Callaghan, S.G. Nikolov, D.R. Bull, N. Canagarajah, Pixel- and region-based image fusion with complex wavelets. Inf. Fusion 8(2), 119–130 (2007)

    Article  Google Scholar 

  6. H. Tian, Y. Fu, Image fusion algorithm based on regional variance and multi-wavelet bases, in 2nd International Conference on Future Computer and Communication, vol. 2 (2010), pp. 792–795

    Google Scholar 

  7. C. He, Q. Liu, H. Li, H. Wang, Multimodal medical image fusion based on IHS and PCA. Proc. Eng. 7, 280–285 (2010)

    Article  Google Scholar 

  8. H. Tan, X, Huang, Pixel saliency metric based pixel-level medical image fusion, in International Conference on Computational Problem-Solving (ICCP) (2011)

    Google Scholar 

  9. A. Srivastava, V. Singhal, A.K. Aggarawal, Comparative analysis of multimodal medical image fusion using PCA and wavelet transforms. Int. J. Latest Technol. Eng. Manag. Appl. Sci. (IJLTEMAS) VI(IV) (2017)

    Google Scholar 

  10. A. Purushotham, G.U. Rani, A. Naik, Image fusion using DWT and PCA. Int. J. Adv. Res. Comput. Sci. Softw. Eng. 5(4) (2015)

    Google Scholar 

  11. Himanshi, V. Bhaterja, A. Krishn, A. Sahu, An improved medical image fusion approach using PCA and complex wavelets, in IEEE International Conference on Medical Imaging, m-Health and Emerging Communication Systems (MedCom) (2014), pp. 442–447

    Google Scholar 

  12. V. Jagruti, Implementation of discrete wavelet transform based image fusion. IOSR J. Electron. Commun. Eng. 9(2), 107–109 (2014)

    Article  Google Scholar 

  13. J. Agarwal, S.S. Bedi, Implementation of hybrid image fusion technique for feature enhancement in medical diagnosis. Hum. Cent. Comput. Inf. Sci. 5(1) (2015)

    Google Scholar 

  14. G.B. Hajma, A. Sarma, A novel multi-focus image fusion algorithm using stationary wavelet transform. IJCSITS 6(4) (2016)

    Google Scholar 

  15. M.D. Chaudhary, A.B. Upadhyay, Fusion of local and global features using stationary wavelet transform for efficient content based image retrieval, in IEEE Students’ Conference on Electrical, Electronics and Computer Science (2014)

    Google Scholar 

  16. K.P. Indira, R. Hemamalini, R Indhumathi, Pixel based medical image fusion techniques using discrete wavelet transform and stationary wavelet transform. Indian J. Sci. Technol. 8(26) (2015)

    Google Scholar 

  17. S. Jadhav, Image fusion based on wavelet transforms. Int. J. Eng. Res. 3(7), 442–445 (2014)

    Article  Google Scholar 

  18. V. Bhateja, H. Patel, A. Krishn, A. Sahu, A. Lay-Ekuakille, Multimodal medical image sensor fusion framework using Cascade of wavelet and Contourlet transform domains. IEEE Sens. J. 15(12), 6783–6790 (2015)

    Article  Google Scholar 

  19. M. Vani, S. Saravanakumar, Multi focus and multi modal image fusion using wavelet transform, in 3rd International Conference on Signal Processing, Communication and Networking (ICSCN) (2015)

    Google Scholar 

  20. A. Wang, S. Hai**g, G. Yueyang, The application of wavelet transform to multi-modality medical image fusion, in 2006 IEEE International Conference on Networking, Sensing and Control (2006)

    Google Scholar 

  21. V.P. Tank, Image fusion based on wavelet and Curvelet transform. IOSR J. VLSI Sig. Process. 1(5), 32–36 (2013)

    Google Scholar 

  22. K.N. Murthy, J. Kusuma, Fusion of medical image using STSVD, in Proceedings of the 5th International Conference on Frontiers in Intelligent Computing: Theory and Applications, Advances in Intelligent Systems and Computing, vol 516 (Springer, 2017)

    Google Scholar 

  23. S. Masood, M. Sharif, Y. Mussarat, M.A. Shahid, A. Rehman, Image fusion methods: a survey. JESTR 10(6), 186–195 (2017)

    Google Scholar 

  24. Chavan, S., Pawar, A., Talbar, S.: Multimodality Medical Image Fusion using Rotated Wavelet Transform. Advances in Intelligent Systems Research, Volume 137 (2017).

    Google Scholar 

  25. H.M. El-Hoseny, E.M. El-Rabaie, W.A. Elrahman, F.E.A. El-Samie, Medical image fusion techniques based on combined discrete transform domains, in 34th National Radio Science Conference (NRSC) (Alexandria, Egypt, 2017)

    Google Scholar 

  26. S. Singh, R.S. Anand, D. Gupta, CT and MR image information fusion scheme using a cascaded framework in ripplet and NSST domain. IET Image Proc. 12(5), 696–707 (2018)

    Article  Google Scholar 

  27. Y. Na, L. Zhao, Y. Yang, M. Ren, Guided filter-based images fusion algorithm for CT and MRI medical images. IET Image Proc. 12(1), 138–148 (2018)

    Article  Google Scholar 

  28. C. Huang, G. Tian, Y. Lan, Y. Peng, E.Y.K. Ng, Y. Hao, Y. Cheng, W. Che, A new pulse coupled neural network (PCNN) for brain medical image fusion empowered by shuffled frog lea** algorithm. Front. Neurosci. 13, 210 (2019)

    Article  Google Scholar 

  29. M. Yin, X. Liu, Y. Liu, X. Chen, Medical image fusion with parameter-adaptive pulse coupled neural network in nonsubsampled shearlet transform domain. IEEE Trans. Instrum. Meas. 68(1), 49–64 (2019)

    Article  Google Scholar 

  30. A. Saboori, J. Birjandtalab, PET–MRI image fusion using adaptive filter based on spectral and spatial discrepancy. Sig. Image Video Process. 13(1), 135–143 (2019), Article 1338

    Google Scholar 

  31. S.P. Yadav, S. Yadav, Image fusion using hybrid methods in multimodality medical images. Med. Biol. Eng. Comput. 58, 669–687 (2020)

    Article  Google Scholar 

  32. K.A. Johnson, J.A. Becker, The whole brain ATLAS. Database for brain images. http://www.med.harvard.edu/aanlib/home.html

  33. G. Pajares, J. Manuel de la Cruz, A wavelet-based image fusion tutorial. Pattern Recogn. 37(9), 1855–1872 (2004)

    Google Scholar 

  34. V. Naidu, Image fusion technique using multi-resolution singular value decomposition. Def. Sci. J. 61(5), 479 (2011)

    Article  MathSciNet  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Dr B R Ambedkar National Institute of Technology (NIT), Jalandhar, Punjab, India

    Twinkle & Bar**der Singh Saini

Authors
  1. Twinkle
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Bar**der Singh Saini
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Department of Electronics and Communication Engineering, Motilal Nehru National Institute of Technology, Allahabad, Uttar Pradesh, India

    Amit Dhawan

  2. Department of Electronics and Communication Engineering, Motilal Nehru National Institute of Technology, Allahabad, Uttar Pradesh, India

    Vijay Shanker Tripathi

  3. Department of Information and Communication Technology, Atal Bihari Vajpayee Indian Institute of Information Technology and Management, Gwalior, Madhya Pradesh, India

    Karm Veer Arya

  4. Department of Electrical and Computer Engineering, University of Waterloo, Waterloo, ON, Canada

    Kshirasagar Naik

Rights and permissions

Reprints and permissions

Copyright information

© 2022 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Twinkle, Saini, B.S. (2022). Performance Analysis of Fusion Methods for the Multimodal Fusion of CT/MRI, MRI/PET and PET/CT Brain Images. In: Dhawan, A., Tripathi, V.S., Arya, K.V., Naik, K. (eds) Recent Trends in Electronics and Communication. VCAS 2020. Lecture Notes in Electrical Engineering, vol 777. Springer, Singapore. https://doi.org/10.1007/978-981-16-2761-3_74

Download citation

  • DOI: https://doi.org/10.1007/978-981-16-2761-3_74

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-16-2760-6

  • Online ISBN: 978-981-16-2761-3

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics

Search

Navigation