Abstract
The rapid increment of morbidity of brain stroke in the last few years have been a driving force towards fast and accurate segmentation of stroke lesions from brain MRI images. With the recent development of deep-learning, computer-aided and segmentation methods of ischemic stroke lesions have been useful for clinicians in early diagnosis and treatment planning. However, most of these methods suffer from inaccurate and unreliable segmentation results because of their inability to capture sufficient contextual features from the MRI volumes. To meet these requirements, 3D convolutional neural networks have been proposed, which, however, suffer from huge computational requirements. To mitigate these problems, we propose a novel Dimension Fusion Edge-guided network (DFENet) that can meet both of these requirements by fusing the features of 2D and 3D CNNs. Unlike other methods, our proposed network uses a parallel partial decoder (PPD) module for aggregating and upsampling selected features, rich in important contextual information. Additionally, we use an edge-guidance and enhanced mixing loss for constantly supervising and improvising the learning process of the network. The proposed method is evaluated on publicly available Anatomical Tracings of Lesions After Stroke (ATLAS) dataset, resulting in mean DSC, IoU, Precision and Recall values of 0.5457, 0.4015, 0.6371, and 0.4969 respectively. The results, when compared to other state-of-the-art methods, outperforms them by a significant margin. Therefore, the proposed model is robust, accurate, superior to the existing methods, and can be relied upon for biomedical applications.
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1007%2Fs42979-021-00835-x/MediaObjects/42979_2021_835_Fig1_HTML.png)
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1007%2Fs42979-021-00835-x/MediaObjects/42979_2021_835_Fig2_HTML.png)
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1007%2Fs42979-021-00835-x/MediaObjects/42979_2021_835_Fig3_HTML.png)
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1007%2Fs42979-021-00835-x/MediaObjects/42979_2021_835_Fig4_HTML.png)
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1007%2Fs42979-021-00835-x/MediaObjects/42979_2021_835_Fig5_HTML.png)
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1007%2Fs42979-021-00835-x/MediaObjects/42979_2021_835_Fig6_HTML.png)
Similar content being viewed by others
References
Badrinarayanan V, Kendall A, Cipolla R. Segnet: a deep convolutional encoder-decoder architecture for image segmentation. IEEE Trans Pattern Anal Mach Intell. 2017;39(12):2481–95.
Basak H, Rana A. F-unet: a modified u-net architecture for segmentation of stroke lesion. CVIP. 2020;1:32–43.
Basak H, Kundu R, Agarwal A, Giri S. Single image super-resolution using residual channel attention network. In: 2020 IEEE 15th International conference on industrial and information systems (ICIIS), IEEE. 2020;219–24.
Basak H, Kundu R, Chakraborty S, Das N. Cervical cytology classification using pca & gwo enhanced deep features selection. ar**v preprint. 2021. ar**v:2106.04919.
Basak H, Kundu R. Comparative study of maturation profiles of neural cells in different species with the help of computer vision and deep learning. In: International symposium on signal processing and intelligent recognition systems, Springer. 2020;352–66.
Bernal J, Kushibar K, Asfaw DS, Valverde S, Oliver A, Martí R, Lladó X. Deep convolutional neural networks for brain image analysis on magnetic resonance imaging: a review. Artif Intell Med. 2019;95:64–81.
Chattopadhyay S, Basak H. Multi-scale attention u-net (msaunet): a modified u-net architecture for scene segmentation. ar**v preprint. 2020. ar**v:2009.06911.
Chen LC, Zhu Y, Papandreou G, Schroff F, Adam H. Encoder-decoder with atrous separable convolution for semantic image segmentation. In: Proceedings of the European conference on computer vision (ECCV), 2018;801–18.
Chen L, Bentley P, Rueckert D. Fully automatic acute ischemic lesion segmentation in DWI using convolutional neural networks. NeuroImage. 2017;15:633–43.
Dolz J, Ayed IB, Desrosiers C. Dense multi-path u-net for ischemic stroke lesion segmentation in multiple image modalities. In: International MICCAI Brainlesion Workshop, Springer. 2018;271–82.
Donkor E. Stroke in the 21st century: a snapshot of the burden, epidemiology, and quality of life. Stroke Res Treat. 2018;2018. https://doi.org/10.1155/2018/3238165
Feng Y, Yang F, Zhou X, Guo Y, Tang F, Ren F, Guo J, Ji S. A deep learning approach for targeted contrast-enhanced ultrasound based prostate cancer detection. IEEE/ACM Trans Comput Biol Bioinf. 2018;16(6):1794–801.
Fu J, Liu J, Tian H, Li Y, Bao Y, Fang Z, Lu H. Dual attention network for scene segmentation. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2019;3146–54.
Guerrero R, Qin C, Oktay O, Bowles C, Chen L, Joules R, Wolz R, Valdés-Hernández MDC, Dickie DA, Wardlaw J, et al. White matter hyperintensity and stroke lesion segmentation and differentiation using convolutional neural networks. NeuroImage. 2018;17:918–34.
Hu X, Luo W, Hu J, Guo S, Huang W, Scott MR, Wiest R, Dahlweid M, Reyes M. Brain segnet: 3d local refinement network for brain lesion segmentation. BMC Med Imaging. 2020;20(1):1–10.
Hu J, Shen L, Sun G. Squeeze-and-excitation networks. In: Proceedings of the IEEE conference on computer vision and pattern recognition, 2018;7132–41.
Hwang H, Rehman HZU, Lee S. 3d u-net for skull strip** in brain MRI. Appl Sci. 2019;9(3):569.
Kamnitsas K, Ledig C, Newcombe VF, Simpson JP, Kane AD, Menon DK, Rueckert D, Glocker B. Efficient multi-scale 3d CNN with fully connected CRF for accurate brain lesion segmentation. Med Image Anal. 2017;36:61–78.
Kemmling A, Flottmann F, Forkert ND, Minnerup J, Heindel W, Thomalla G, Eckert B, Knauth M, Psychogios M, Langner S, et al. Multivariate dynamic prediction of ischemic infarction and tissue salvage as a function of time and degree of recanalization. J Cerebral Blood Flow Metab. 2015;35(9):1397–405.
Kundu R, Basak H, Singh PK, Ahmadian A, Ferrara M, Sarkar R. Fuzzy rank-based fusion of CNN models using gompertz function for screening COVID-19 CT-scans. Sci Rep. 2021;11(1):1–12.
Li X, Chen H, Qi X, Dou Q, Fu CW, Heng PA. H-denseunet: hybrid densely connected U-net for liver and tumor segmentation from CT volumes. IEEE Trans Med Imaging. 2018;37(12):2663–74.
Liew SL, Anglin JM, Banks NW, Sondag M, Ito KL, Kim H, Chan J, Ito J, Jung C, Khoshab N, et al. A large, open source dataset of stroke anatomical brain images and manual lesion segmentations. Sci Data. 2018;5(1):1–11.
Liu S, Huang D, et al. Receptive field block net for accurate and fast object detection. In: Proceedings of the European conference on computer vision (ECCV), 2018;385–400.
Lyksborg M, Puonti O, Agn M, Larsen R. An ensemble of 2d convolutional neural networks for tumor segmentation. In: Scandinavian conference on image analysis, Springer. 2015;201–11.
Mitra J, Bourgeat P, Fripp J, Ghose S, Rose S, Salvado O, Connelly A, Campbell B, Palmer S, Sharma G, et al. Lesion segmentation from multimodal MRI using random forest following ischemic stroke. Neuroimage. 2014;98:324–35.
Nabizadeh N, Kubat M, John N, Wright C. Automatic ischemic stroke lesion segmentation using single mr modality and gravitational histogram optimization based brain segmentation. In: Proceedings of the international conference on image processing, computer vision, and pattern recognition (IPCV), The Steering Committee of The World Congress in Computer Science, Computer Engineering and Applied Computing (WorldComp). 2013;1.
Nazari-Farsani S, Nyman M, Karjalainen T, Bucci M, Isojärvi J, Nummenmaa L. Automated segmentation of acute stroke lesions using a data-driven anomaly detection on diffusion weighted MRI. J Neurosci Methods. 2020;333:108575.
Neumann AB, Jonsdottir KY, Mouridsen K, Hjort N, Gyldensted C, Bizzi A, Fiehler J, Gasparotti R, Gillard JH, Hermier M, et al. Interrater agreement for final infarct MRI lesion delineation. Stroke. 2009;40(12):3768–71.
Pihur V, Datta S, Datta S. Weighted rank aggregation of cluster validation measures: a monte carlo cross-entropy approach. Bioinformatics. 2007;23(13):1607–15.
Qi K, Yang H, Li C, Liu Z, Wang M, Liu Q, Wang S. X-net: Brain stroke lesion segmentation based on depthwise separable convolution and long-range dependencies. In: International conference on medical image computing and computer-assisted intervention, Springer. 2019;247–55.
Redon J, Olsen MH, Cooper RS, Zurriaga O, Martinez-Beneito MA, Laurent S, Cifkova R, Coca A, Mancia G. Stroke mortality and trends from 1990 to 2006 in 39 countries from Europe and central Asia: implications for control of high blood pressure. Eur Heart J. 2011;32(11):1424–31.
Ronneberger O, Fischer P, Brox T. U-net: Convolutional networks for biomedical image segmentation. In: International Conference on Medical image computing and computer-assisted intervention, Springer. 2015;234–41.
Shao W, Huang SJ, Liu M, Zhang D. Querying representative and informative super-pixels for filament segmentation in bioimages. IEEE/ACM Trans Comput Biol Bioinf. 2019;17(4):1394–405.
Weng Y, Zhou T, Li Y, Qiu X. Nas-unet: neural architecture search for medical image segmentation. IEEE Access. 2019;7:44247–57.
Wu Z, Su L, Huang Q. Cascaded partial decoder for fast and accurate salient object detection. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2019;3907–16.
Zhang R, Zhao L, Lou W, Abrigo JM, Mok VC, Chu WC, Wang D, Shi L. Automatic segmentation of acute ischemic stroke from DWI using 3-d fully convolutional densenets. IEEE Trans Med Imaging. 2018;37(9):2149–60.
Zhang Z, Liu Q, Wang Y. Road extraction by deep residual u-net. IEEE Geosci Remote Sens Lett. 2018;15(5):749–53.
Zhang Z, Fu H, Dai H, Shen J, Pang Y, Shao L. Et-net: A generic edge-attention guidance network for medical image segmentation. In: International conference on medical image computing and computer-assisted intervention, Springer. 2019;442–50.
Zhao JX, Liu JJ, Fan DP, Cao Y, Yang J, Cheng MM. Egnet: edge guidance network for salient object detection. In: Proceedings of the IEEE/CVF international conference on computer vision, 2019;8779–88.
Zhao H, Shi J, Qi X, Wang X, Jia J. Pyramid scene parsing network. In: Proceedings of the IEEE conference on computer vision and pattern recognition, 2017;2881–90.
Funding
The authors did not receive support from any organization for the submitted work. No funding was received to assist with the preparation of this manuscript.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of Interest
Hritam Basak declares that he has no conflict of interest. Rukhshanda Hussain declares that she has no conflict of interest. Ajay Rana declares that he has no conflict of interest.
Ethical Approval
This article does not contain any studies with human participants or animals performed by any of the authors.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
This article is part of the topical collection “Progresses in Image Processing” guest edited by P. Nagabhushan, Peter Peer, Partha Pratim Roy and Satish Kumar Singh.
Rights and permissions
About this article
Cite this article
Basak, H., Hussain, R. & Rana, A. DFENet: A Novel Dimension Fusion Edge Guided Network for Brain MRI Segmentation. SN COMPUT. SCI. 2, 435 (2021). https://doi.org/10.1007/s42979-021-00835-x
Received:
Accepted:
Published:
DOI: https://doi.org/10.1007/s42979-021-00835-x