Abstract
The method by which data from multiple images is incorporated into a single image in order to enhance the quality of the image and reduce the artifacts, randomness and redundancy is known as image fusion. Image fusion plays a vital role in medical diagnosis and treatment. In this paper, a new image fusion algorithm using pulse-coupled neural network (PCNN) with genetic algorithm (GA) optimization has been proposed. Sixteen different sets of CT and PET images have been utilized to validate the performance of the proposed technique. Initially, PCNN has been applied to N layers of the image, and then, fusion coefficient is figured out of Layer N by using genetic algorithm (GA). The fused image obtained contains both functional and anatomical information which is present in individual CT and PET images. The proposed algorithm has been compared with pulse-coupled neural network (PCNN) via subjective and objective analyses. Experimental results illustrate the effectiveness of the proposed algorithm than the existing image fusion techniques.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
P. Hill, M. Ebrahim Al-Mualla, D. Bull, Perceptual image fusion using wavelets. IEEE Trans. Image Process. 26(3), 1076–1088
N. Mittal, et al., Decomposition & Reconstruction of Medical Images in Matlab Using Different Wavelet Parameters, in 1st International Conference on Futuristic Trend In Computational Analysis and Knowledge Management. IEEE (2015). ISSN 978-1-4799-8433-6/15
K.P. Indira, et al., Impact of Co-efficient Selection Rules on the Performance of Dwt Based Fusion on Medical Images, in International Conference On Robotics, Automation, Control and Embedded Systems-Race. IEEE (2015)
Y. Yang, M. Ding, S. Huang, Y. Que, W. Wan, M. Yang, J. Sun, Multi-Focus Image Fusion Via Clustering PCA Based Joint Dictionary Learning, vol. 5, pp.16985–16997, Sept 2017
A. Ellmauthaler, C.L. Pagliari, et al., Image fusion using the undecimated wavelet transform with spectral factorization and non orthogonal filter banks. IEEE Trans. Image Process. 22(3), 1005–1017 (2013)
V. Bhateja, H. Patel, A. Krishn, A. Sahu, Multimodal medical image sensor fusion framework using cascade of wavelet and contourlet transform domains. IEEE Sens. J. 15(12), 6783–6790 (2015)
B. Erol, M. Amin, Generalized PCA Fusion for Improved Radar Human Motion Recognition, in IEEE Radar Conference (RadarConf), Boston, MA, USA (2019), pp. 1–5
V.S. Petrovic, C.S. Xydeas, Gradient based multi resolution image fusion. IEEE Trans. Image Process. 13(2), 228–237 (2004)
P.J. Burt, E.H. Adelson, The Laplacian pyramid as a compact image code. IEEE Trans. Commun. 31(4), 532–540 (1983)
J. Tian, L. Chen, Adaptive multi-focus image fusion using a waveletbased statistical sharpness measure. Signal Process. 92(9), 2137–2146 (2012)
M.D. Nandeesh, M. Meenakshi, A Novel Technique of Medical Image Fusion Using Stationary Wavelet Transform and Principal Component Analysis, in 2015 International Conference on Smart Sensors and Systems (IC-SSS), Bangalore (2015), pp. 1–5
Q.M. Gaurav Bhatnagar, W. Jonathan, Z. Liu, Directive contrast based multimodal Medical image fusion in NSCT domain. IEEE Trans. Multimedia 15(5), 1014–1024 (2013)
S. Das. M.K. Kundu, A neuro-fuzzy approach for medical image fusion. IEEE Trans. Biomed. Eng. 60(12), 3347–3353 (2013)
T. Lu, C. Tian, X. Kai, Exploiting quality-guided adaptive optimization for fusing multimodal medical images. IEEE Access 7, 96048–96059 (2019)
D. Gai, X. Shen, H. Cheng, H. Chen, Medical image fusion via PCNN based on edge preservation and improved sparse representation in NSST domain. IEEE Access 7, 85413–85429
O. Hajer, O. Mourali, E. Zagrouba, Non-subsampled shearlet transform based MRI and PET brain image fusion using simplified pulse coupled neural network and weight local features in YIQ colour space. IET Image Proc. 12(10), 1873–1880 (2018)
Y. Jia, C. Rong, Y. Wang, Y. Zhu, Y. Yang, A Multi-Focus Image Fusion Algorithm Using Modified Adaptive PCNN Model, in 12th International Conference on Natural Computation, Fuzzy Systems and Knowledge Discovery (ICNC-FSKD). IEEE (2016), pp. 612–617
N. Wang, W. Wang, An Image Fusion Method Based on Wavelet and Dual-Channel Pulse Coupled Neural Network, in 2015 IEEE International Conference on Progress in Informatics and Computing (PIC) (2015), pp. 270–274
M. Arif, N. Aniza Abdullah, S. Kumara Phalianakote, N. Ramli, M. Elahi, Maximizing Information of Multimodality Brain Image Fusion using Curvelet Transform with Genetic Algorithm, in IEEE 2014 International Conference on Computer Assisted System in Health (CASH) (2014), pp. 45–51
L. Fu, L. Yifan, L. **n, Image Fusion Based on Nonsubsampled Contourlet Transform and Pulse Coupled Neural Networks, in IEEE Fourth International Conference on Intelligent Computation Technology and Automation, vol. 2 (2011), pp. 180–183
C.W Lacewell, M. Gebril, R. Buaba, A. Homaifar, Optimization of Image Fusion using Genetic Algorithm and Discrete Wavelet Transform, in Proceedings of the IEEE 2010 National Aerospace and Electronics Conference (NAECON) (2010), pp. 116–121
X. Wang, L. Chen, Image Fusion Algorithm Based on Spatial Frequency-Motivated Pulse Coupled Neural Networks in Wavelet Based Contourlet Transform Domain, in 2nd Conference on Environmental Science and Information Application Technology, vol. 2. IEEE (2010), pp. 411–414
Y. Yang, J. Dang, Y. Wang, Medical Image Fusion Method Based on Lifting Wavelet Transform and Dual-channel PCNN, in 9th IEEE Conference on Industrial Electronics and Applications (2014), pp. 1179–1182
Y. Wang, J. Dang, Q. Li, S. Li, Multimodal Medical Image Fusion Using Fuzzy Radial Basis Function Neural Networks, in IEEE, Proceedings of the 2007 International Conference on Wavelet Analysis and Pattern Recognition, vol. 2 (2007), pp. 778–782
T. Li, Y. Wang, Multi scaled combination of MR and SPECT images in neuroimaging: a simplex method based variable-weight fusion. Comput. Method Programs Biomed. 105:35–39
C.W Lacewell, M. Gebril, R. Buaba, A., Optimization of Image Fusion using Genetic Algorithm and Discrete Wavelet Transform, in Proceedings of the IEEE 2010 National Aerospace and Electronics Conference (NAECON) (2010), pp. 116–121
R. Gupta, D. Awasthi, Wave-Packet Image Fusion Technique Based on Genetic Algorithm, in IEEE, 5th International Conference on Confluence The Next Generation Information Technology Summit (2014), pp. 280–285
A. Krishn, V. Bhateja, Himanshi, A. Sahu, Medical Image Fusion Using Combination of PCA and Wavelet Analysis, in IEEE International Conference on Advances in Computing, Communications and Informatics (2014), pp. 986–991
A. Sahu, V. Bhateja, A. Krishn, Himanshi, Medical Image Fusion with Laplacian Pyramids, in IEEE, 2014 International Conference on Medical Imaging, m-Health and Emerging Communication Systems (2014), pp. 448–453
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Indhumathi, R., Nagarajan, S., Indira, K.P. (2021). Hybrid Pixel-Based Method for Multimodal Medical Image Fusion Based on Integration of Pulse-Coupled Neural Network (PCNN) and Genetic Algorithm (GA). In: Patnaik, S., Yang, XS., Sethi, I. (eds) Advances in Machine Learning and Computational Intelligence. Algorithms for Intelligent Systems. Springer, Singapore. https://doi.org/10.1007/978-981-15-5243-4_82
Download citation
DOI: https://doi.org/10.1007/978-981-15-5243-4_82
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-15-5242-7
Online ISBN: 978-981-15-5243-4
eBook Packages: EngineeringEngineering (R0)