Log in

DFENet: A Novel Dimension Fusion Edge Guided Network for Brain MRI Segmentation

  • Original Research
  • Published:
SN Computer Science Aims and scope Submit manuscript

Abstract

The rapid increment of morbidity of brain stroke in the last few years have been a driving force towards fast and accurate segmentation of stroke lesions from brain MRI images. With the recent development of deep-learning, computer-aided and segmentation methods of ischemic stroke lesions have been useful for clinicians in early diagnosis and treatment planning. However, most of these methods suffer from inaccurate and unreliable segmentation results because of their inability to capture sufficient contextual features from the MRI volumes. To meet these requirements, 3D convolutional neural networks have been proposed, which, however, suffer from huge computational requirements. To mitigate these problems, we propose a novel Dimension Fusion Edge-guided network (DFENet) that can meet both of these requirements by fusing the features of 2D and 3D CNNs. Unlike other methods, our proposed network uses a parallel partial decoder (PPD) module for aggregating and upsampling selected features, rich in important contextual information. Additionally, we use an edge-guidance and enhanced mixing loss for constantly supervising and improvising the learning process of the network. The proposed method is evaluated on publicly available Anatomical Tracings of Lesions After Stroke (ATLAS) dataset, resulting in mean DSC, IoU, Precision and Recall values of 0.5457, 0.4015, 0.6371, and 0.4969 respectively. The results, when compared to other state-of-the-art methods, outperforms them by a significant margin. Therefore, the proposed model is robust, accurate, superior to the existing methods, and can be relied upon for biomedical applications.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Subscribe and save

Springer+ Basic
EUR 32.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or Ebook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

Similar content being viewed by others

References

  1. Badrinarayanan V, Kendall A, Cipolla R. Segnet: a deep convolutional encoder-decoder architecture for image segmentation. IEEE Trans Pattern Anal Mach Intell. 2017;39(12):2481–95.

    Article  Google Scholar 

  2. Basak H, Rana A. F-unet: a modified u-net architecture for segmentation of stroke lesion. CVIP. 2020;1:32–43.

    Google Scholar 

  3. Basak H, Kundu R, Agarwal A, Giri S. Single image super-resolution using residual channel attention network. In: 2020 IEEE 15th International conference on industrial and information systems (ICIIS), IEEE. 2020;219–24.

  4. Basak H, Kundu R, Chakraborty S, Das N. Cervical cytology classification using pca & gwo enhanced deep features selection. ar**v preprint. 2021. ar**v:2106.04919.

  5. Basak H, Kundu R. Comparative study of maturation profiles of neural cells in different species with the help of computer vision and deep learning. In: International symposium on signal processing and intelligent recognition systems, Springer. 2020;352–66.

  6. Bernal J, Kushibar K, Asfaw DS, Valverde S, Oliver A, Martí R, Lladó X. Deep convolutional neural networks for brain image analysis on magnetic resonance imaging: a review. Artif Intell Med. 2019;95:64–81.

    Article  Google Scholar 

  7. Chattopadhyay S, Basak H. Multi-scale attention u-net (msaunet): a modified u-net architecture for scene segmentation. ar**v preprint. 2020. ar**v:2009.06911.

  8. Chen LC, Zhu Y, Papandreou G, Schroff F, Adam H. Encoder-decoder with atrous separable convolution for semantic image segmentation. In: Proceedings of the European conference on computer vision (ECCV), 2018;801–18.

  9. Chen L, Bentley P, Rueckert D. Fully automatic acute ischemic lesion segmentation in DWI using convolutional neural networks. NeuroImage. 2017;15:633–43.

    Article  Google Scholar 

  10. Dolz J, Ayed IB, Desrosiers C. Dense multi-path u-net for ischemic stroke lesion segmentation in multiple image modalities. In: International MICCAI Brainlesion Workshop, Springer. 2018;271–82.

  11. Donkor E. Stroke in the 21st century: a snapshot of the burden, epidemiology, and quality of life. Stroke Res Treat. 2018;2018. https://doi.org/10.1155/2018/3238165

  12. Feng Y, Yang F, Zhou X, Guo Y, Tang F, Ren F, Guo J, Ji S. A deep learning approach for targeted contrast-enhanced ultrasound based prostate cancer detection. IEEE/ACM Trans Comput Biol Bioinf. 2018;16(6):1794–801.

    Article  Google Scholar 

  13. Fu J, Liu J, Tian H, Li Y, Bao Y, Fang Z, Lu H. Dual attention network for scene segmentation. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2019;3146–54.

  14. Guerrero R, Qin C, Oktay O, Bowles C, Chen L, Joules R, Wolz R, Valdés-Hernández MDC, Dickie DA, Wardlaw J, et al. White matter hyperintensity and stroke lesion segmentation and differentiation using convolutional neural networks. NeuroImage. 2018;17:918–34.

    Article  Google Scholar 

  15. Hu X, Luo W, Hu J, Guo S, Huang W, Scott MR, Wiest R, Dahlweid M, Reyes M. Brain segnet: 3d local refinement network for brain lesion segmentation. BMC Med Imaging. 2020;20(1):1–10.

    Article  Google Scholar 

  16. Hu J, Shen L, Sun G. Squeeze-and-excitation networks. In: Proceedings of the IEEE conference on computer vision and pattern recognition, 2018;7132–41.

  17. Hwang H, Rehman HZU, Lee S. 3d u-net for skull strip** in brain MRI. Appl Sci. 2019;9(3):569.

    Article  Google Scholar 

  18. Kamnitsas K, Ledig C, Newcombe VF, Simpson JP, Kane AD, Menon DK, Rueckert D, Glocker B. Efficient multi-scale 3d CNN with fully connected CRF for accurate brain lesion segmentation. Med Image Anal. 2017;36:61–78.

    Article  Google Scholar 

  19. Kemmling A, Flottmann F, Forkert ND, Minnerup J, Heindel W, Thomalla G, Eckert B, Knauth M, Psychogios M, Langner S, et al. Multivariate dynamic prediction of ischemic infarction and tissue salvage as a function of time and degree of recanalization. J Cerebral Blood Flow Metab. 2015;35(9):1397–405.

    Article  Google Scholar 

  20. Kundu R, Basak H, Singh PK, Ahmadian A, Ferrara M, Sarkar R. Fuzzy rank-based fusion of CNN models using gompertz function for screening COVID-19 CT-scans. Sci Rep. 2021;11(1):1–12.

    Article  Google Scholar 

  21. Li X, Chen H, Qi X, Dou Q, Fu CW, Heng PA. H-denseunet: hybrid densely connected U-net for liver and tumor segmentation from CT volumes. IEEE Trans Med Imaging. 2018;37(12):2663–74.

    Article  Google Scholar 

  22. Liew SL, Anglin JM, Banks NW, Sondag M, Ito KL, Kim H, Chan J, Ito J, Jung C, Khoshab N, et al. A large, open source dataset of stroke anatomical brain images and manual lesion segmentations. Sci Data. 2018;5(1):1–11.

    Article  Google Scholar 

  23. Liu S, Huang D, et al. Receptive field block net for accurate and fast object detection. In: Proceedings of the European conference on computer vision (ECCV), 2018;385–400.

  24. Lyksborg M, Puonti O, Agn M, Larsen R. An ensemble of 2d convolutional neural networks for tumor segmentation. In: Scandinavian conference on image analysis, Springer. 2015;201–11.

  25. Mitra J, Bourgeat P, Fripp J, Ghose S, Rose S, Salvado O, Connelly A, Campbell B, Palmer S, Sharma G, et al. Lesion segmentation from multimodal MRI using random forest following ischemic stroke. Neuroimage. 2014;98:324–35.

    Article  Google Scholar 

  26. Nabizadeh N, Kubat M, John N, Wright C. Automatic ischemic stroke lesion segmentation using single mr modality and gravitational histogram optimization based brain segmentation. In: Proceedings of the international conference on image processing, computer vision, and pattern recognition (IPCV), The Steering Committee of The World Congress in Computer Science, Computer Engineering and Applied Computing (WorldComp). 2013;1.

  27. Nazari-Farsani S, Nyman M, Karjalainen T, Bucci M, Isojärvi J, Nummenmaa L. Automated segmentation of acute stroke lesions using a data-driven anomaly detection on diffusion weighted MRI. J Neurosci Methods. 2020;333:108575.

    Article  Google Scholar 

  28. Neumann AB, Jonsdottir KY, Mouridsen K, Hjort N, Gyldensted C, Bizzi A, Fiehler J, Gasparotti R, Gillard JH, Hermier M, et al. Interrater agreement for final infarct MRI lesion delineation. Stroke. 2009;40(12):3768–71.

    Article  Google Scholar 

  29. Pihur V, Datta S, Datta S. Weighted rank aggregation of cluster validation measures: a monte carlo cross-entropy approach. Bioinformatics. 2007;23(13):1607–15.

    Article  Google Scholar 

  30. Qi K, Yang H, Li C, Liu Z, Wang M, Liu Q, Wang S. X-net: Brain stroke lesion segmentation based on depthwise separable convolution and long-range dependencies. In: International conference on medical image computing and computer-assisted intervention, Springer. 2019;247–55.

  31. Redon J, Olsen MH, Cooper RS, Zurriaga O, Martinez-Beneito MA, Laurent S, Cifkova R, Coca A, Mancia G. Stroke mortality and trends from 1990 to 2006 in 39 countries from Europe and central Asia: implications for control of high blood pressure. Eur Heart J. 2011;32(11):1424–31.

    Article  Google Scholar 

  32. Ronneberger O, Fischer P, Brox T. U-net: Convolutional networks for biomedical image segmentation. In: International Conference on Medical image computing and computer-assisted intervention, Springer. 2015;234–41.

  33. Shao W, Huang SJ, Liu M, Zhang D. Querying representative and informative super-pixels for filament segmentation in bioimages. IEEE/ACM Trans Comput Biol Bioinf. 2019;17(4):1394–405.

    Google Scholar 

  34. Weng Y, Zhou T, Li Y, Qiu X. Nas-unet: neural architecture search for medical image segmentation. IEEE Access. 2019;7:44247–57.

    Article  Google Scholar 

  35. Wu Z, Su L, Huang Q. Cascaded partial decoder for fast and accurate salient object detection. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2019;3907–16.

  36. Zhang R, Zhao L, Lou W, Abrigo JM, Mok VC, Chu WC, Wang D, Shi L. Automatic segmentation of acute ischemic stroke from DWI using 3-d fully convolutional densenets. IEEE Trans Med Imaging. 2018;37(9):2149–60.

    Article  Google Scholar 

  37. Zhang Z, Liu Q, Wang Y. Road extraction by deep residual u-net. IEEE Geosci Remote Sens Lett. 2018;15(5):749–53.

    Article  Google Scholar 

  38. Zhang Z, Fu H, Dai H, Shen J, Pang Y, Shao L. Et-net: A generic edge-attention guidance network for medical image segmentation. In: International conference on medical image computing and computer-assisted intervention, Springer. 2019;442–50.

  39. Zhao JX, Liu JJ, Fan DP, Cao Y, Yang J, Cheng MM. Egnet: edge guidance network for salient object detection. In: Proceedings of the IEEE/CVF international conference on computer vision, 2019;8779–88.

  40. Zhao H, Shi J, Qi X, Wang X, Jia J. Pyramid scene parsing network. In: Proceedings of the IEEE conference on computer vision and pattern recognition, 2017;2881–90.

Download references

Funding

The authors did not receive support from any organization for the submitted work. No funding was received to assist with the preparation of this manuscript.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Hritam Basak.

Ethics declarations

Conflict of Interest

Hritam Basak declares that he has no conflict of interest. Rukhshanda Hussain declares that she has no conflict of interest. Ajay Rana declares that he has no conflict of interest.

Ethical Approval

This article does not contain any studies with human participants or animals performed by any of the authors.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

This article is part of the topical collection “Progresses in Image Processing” guest edited by P. Nagabhushan, Peter Peer, Partha Pratim Roy and Satish Kumar Singh.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Basak, H., Hussain, R. & Rana, A. DFENet: A Novel Dimension Fusion Edge Guided Network for Brain MRI Segmentation. SN COMPUT. SCI. 2, 435 (2021). https://doi.org/10.1007/s42979-021-00835-x

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s42979-021-00835-x

Keywords

Navigation