Hybrid Pixel-Based Method for Multimodal Medical Image Fusion Based on Integration of Pulse-Coupled Neural Network (PCNN) and Genetic Algorithm (GA)

  • Conference paper
  • First Online:
Advances in Machine Learning and Computational Intelligence

Part of the book series: Algorithms for Intelligent Systems ((AIS))

Abstract

The method by which data from multiple images is incorporated into a single image in order to enhance the quality of the image and reduce the artifacts, randomness and redundancy is known as image fusion. Image fusion plays a vital role in medical diagnosis and treatment. In this paper, a new image fusion algorithm using pulse-coupled neural network (PCNN) with genetic algorithm (GA) optimization has been proposed. Sixteen different sets of CT and PET images have been utilized to validate the performance of the proposed technique. Initially, PCNN has been applied to N layers of the image, and then, fusion coefficient is figured out of Layer N by using genetic algorithm (GA). The fused image obtained contains both functional and anatomical information which is present in individual CT and PET images. The proposed algorithm has been compared with pulse-coupled neural network (PCNN) via subjective and objective analyses. Experimental results illustrate the effectiveness of the proposed algorithm than the existing image fusion techniques.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Springer+ Basic
EUR 32.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or Ebook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now
Chapter
EUR 29.95
Price includes VAT (Germany)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
EUR 160.49
Price includes VAT (Germany)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Hardcover Book
EUR 213.99
Price includes VAT (Germany)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free ship** worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. P. Hill, M. Ebrahim Al-Mualla, D. Bull, Perceptual image fusion using wavelets. IEEE Trans. Image Process. 26(3), 1076–1088

    Google Scholar 

  2. N. Mittal, et al., Decomposition & Reconstruction of Medical Images in Matlab Using Different Wavelet Parameters, in 1st International Conference on Futuristic Trend In Computational Analysis and Knowledge Management. IEEE (2015). ISSN 978-1-4799-8433-6/15

    Google Scholar 

  3. K.P. Indira, et al., Impact of Co-efficient Selection Rules on the Performance of Dwt Based Fusion on Medical Images, in International Conference On Robotics, Automation, Control and Embedded Systems-Race. IEEE (2015)

    Google Scholar 

  4. Y. Yang, M. Ding, S. Huang, Y. Que, W. Wan, M. Yang, J. Sun, Multi-Focus Image Fusion Via Clustering PCA Based Joint Dictionary Learning, vol. 5, pp.16985–16997, Sept 2017

    Google Scholar 

  5. A. Ellmauthaler, C.L. Pagliari, et al., Image fusion using the undecimated wavelet transform with spectral factorization and non orthogonal filter banks. IEEE Trans. Image Process. 22(3), 1005–1017 (2013)

    Google Scholar 

  6. V. Bhateja, H. Patel, A. Krishn, A. Sahu, Multimodal medical image sensor fusion framework using cascade of wavelet and contourlet transform domains. IEEE Sens. J. 15(12), 6783–6790 (2015)

    Article  Google Scholar 

  7. B. Erol, M. Amin, Generalized PCA Fusion for Improved Radar Human Motion Recognition, in IEEE Radar Conference (RadarConf), Boston, MA, USA (2019), pp. 1–5

    Google Scholar 

  8. V.S. Petrovic, C.S. Xydeas, Gradient based multi resolution image fusion. IEEE Trans. Image Process. 13(2), 228–237 (2004)

    Google Scholar 

  9. P.J. Burt, E.H. Adelson, The Laplacian pyramid as a compact image code. IEEE Trans. Commun. 31(4), 532–540 (1983)

    Article  Google Scholar 

  10. J. Tian, L. Chen, Adaptive multi-focus image fusion using a waveletbased statistical sharpness measure. Signal Process. 92(9), 2137–2146 (2012)

    Article  Google Scholar 

  11. M.D. Nandeesh, M. Meenakshi, A Novel Technique of Medical Image Fusion Using Stationary Wavelet Transform and Principal Component Analysis, in 2015 International Conference on Smart Sensors and Systems (IC-SSS), Bangalore (2015), pp. 1–5

    Google Scholar 

  12. Q.M. Gaurav Bhatnagar, W. Jonathan, Z. Liu, Directive contrast based multimodal Medical image fusion in NSCT domain. IEEE Trans. Multimedia 15(5), 1014–1024 (2013)

    Article  Google Scholar 

  13. S. Das. M.K. Kundu, A neuro-fuzzy approach for medical image fusion. IEEE Trans. Biomed. Eng. 60(12), 3347–3353 (2013)

    Google Scholar 

  14. T. Lu, C. Tian, X. Kai, Exploiting quality-guided adaptive optimization for fusing multimodal medical images. IEEE Access 7, 96048–96059 (2019)

    Article  Google Scholar 

  15. D. Gai, X. Shen, H. Cheng, H. Chen, Medical image fusion via PCNN based on edge preservation and improved sparse representation in NSST domain. IEEE Access 7, 85413–85429

    Google Scholar 

  16. O. Hajer, O. Mourali, E. Zagrouba, Non-subsampled shearlet transform based MRI and PET brain image fusion using simplified pulse coupled neural network and weight local features in YIQ colour space. IET Image Proc. 12(10), 1873–1880 (2018)

    Article  Google Scholar 

  17. Y. Jia, C. Rong, Y. Wang, Y. Zhu, Y. Yang, A Multi-Focus Image Fusion Algorithm Using Modified Adaptive PCNN Model, in 12th International Conference on Natural Computation, Fuzzy Systems and Knowledge Discovery (ICNC-FSKD). IEEE (2016), pp. 612–617

    Google Scholar 

  18. N. Wang, W. Wang, An Image Fusion Method Based on Wavelet and Dual-Channel Pulse Coupled Neural Network, in 2015 IEEE International Conference on Progress in Informatics and Computing (PIC) (2015), pp. 270–274

    Google Scholar 

  19. M. Arif, N. Aniza Abdullah, S. Kumara Phalianakote, N. Ramli, M. Elahi, Maximizing Information of Multimodality Brain Image Fusion using Curvelet Transform with Genetic Algorithm, in IEEE 2014 International Conference on Computer Assisted System in Health (CASH) (2014), pp. 45–51

    Google Scholar 

  20. L. Fu, L. Yifan, L. **n, Image Fusion Based on Nonsubsampled Contourlet Transform and Pulse Coupled Neural Networks, in IEEE Fourth International Conference on Intelligent Computation Technology and Automation, vol. 2 (2011), pp. 180–183

    Google Scholar 

  21. C.W Lacewell, M. Gebril, R. Buaba, A. Homaifar, Optimization of Image Fusion using Genetic Algorithm and Discrete Wavelet Transform, in Proceedings of the IEEE 2010 National Aerospace and Electronics Conference (NAECON) (2010), pp. 116–121

    Google Scholar 

  22. X. Wang, L. Chen, Image Fusion Algorithm Based on Spatial Frequency-Motivated Pulse Coupled Neural Networks in Wavelet Based Contourlet Transform Domain, in 2nd Conference on Environmental Science and Information Application Technology, vol. 2. IEEE (2010), pp. 411–414

    Google Scholar 

  23. Y. Yang, J. Dang, Y. Wang, Medical Image Fusion Method Based on Lifting Wavelet Transform and Dual-channel PCNN, in 9th IEEE Conference on Industrial Electronics and Applications (2014), pp. 1179–1182

    Google Scholar 

  24. Y. Wang, J. Dang, Q. Li, S. Li, Multimodal Medical Image Fusion Using Fuzzy Radial Basis Function Neural Networks, in IEEE, Proceedings of the 2007 International Conference on Wavelet Analysis and Pattern Recognition, vol. 2 (2007), pp. 778–782

    Google Scholar 

  25. T. Li, Y. Wang, Multi scaled combination of MR and SPECT images in neuroimaging: a simplex method based variable-weight fusion. Comput. Method Programs Biomed. 105:35–39

    Google Scholar 

  26. C.W Lacewell, M. Gebril, R. Buaba, A., Optimization of Image Fusion using Genetic Algorithm and Discrete Wavelet Transform, in Proceedings of the IEEE 2010 National Aerospace and Electronics Conference (NAECON) (2010), pp. 116–121

    Google Scholar 

  27. R. Gupta, D. Awasthi, Wave-Packet Image Fusion Technique Based on Genetic Algorithm, in IEEE, 5th International Conference on Confluence The Next Generation Information Technology Summit (2014), pp. 280–285

    Google Scholar 

  28. A. Krishn, V. Bhateja, Himanshi, A. Sahu, Medical Image Fusion Using Combination of PCA and Wavelet Analysis, in IEEE International Conference on Advances in Computing, Communications and Informatics (2014), pp. 986–991

    Google Scholar 

  29. A. Sahu, V. Bhateja, A. Krishn, Himanshi, Medical Image Fusion with Laplacian Pyramids, in IEEE, 2014 International Conference on Medical Imaging, m-Health and Emerging Communication Systems (2014), pp. 448–453

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to R. Indhumathi .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2021 Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Indhumathi, R., Nagarajan, S., Indira, K.P. (2021). Hybrid Pixel-Based Method for Multimodal Medical Image Fusion Based on Integration of Pulse-Coupled Neural Network (PCNN) and Genetic Algorithm (GA). In: Patnaik, S., Yang, XS., Sethi, I. (eds) Advances in Machine Learning and Computational Intelligence. Algorithms for Intelligent Systems. Springer, Singapore. https://doi.org/10.1007/978-981-15-5243-4_82

Download citation

  • DOI: https://doi.org/10.1007/978-981-15-5243-4_82

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-15-5242-7

  • Online ISBN: 978-981-15-5243-4

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics

Navigation