Abstract
In the diagnosis of liver lesions, Gd-EOB-DTPA-enhanced magnetic resonance imaging (MRI) at the hepatobiliary phase (GED-HBP) is particularly valuable. However, the acquisition of GED-HBP is more costly than that of a conventional dynamic contrast-enhanced MRI (DCE-MRI). This paper introduces a new dataset and a novel application of image translation from multi-phase DCE-MRIs into a virtual GED-HBP image (v-HBP) that could be used as a substitute for GED-HBP in clinical liver diagnosis. This is achieved by a generative adversarial network (GAN) with an auxiliary registration network, referred to as MrGAN. MrGAN bypasses the challenges from intra-sequence misalignments as well as inter-sequence misalignments. Additionally, MrGAN incorporates a pre-trained shape consistency network to promote local generation in the liver region. Extensive experiments demonstrated the superiority of our MrGAN over other state-of-the-art methods in terms of quantitative, qualitative, and clinical evaluations. We outlook the utility of our new dataset will extend to other problems beyond lesion detection due to the improved quality of the generated image. Code can be found at https://github.com/Jy-stdio/MrGAN.git.
Contributed equally.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Arar, M., Ginger, Y., Danon, D., Bermano, A.H., Cohen-Or, D.: Unsupervised multi-modal image registration via geometry preserving image-to-image translation. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 13410–13419 (2020)
Balakrishnan, G., Zhao, A., Sabuncu, M.R., Guttag, J., Dalca, A.V.: Voxelmorph: a learning framework for deformable medical image registration. IEEE Trans. Med. Imaging 38(8), 1788–1800 (2019)
Chen, J., Wei, J., Li, R.: TarGAN: target-aware generative adversarial networks for multi-modality medical image translation. In: de Bruijne, M., et al. (eds.) MICCAI 2021. LNCS, vol. 12906, pp. 24–33. Springer, Cham (2021). https://doi.org/10.1007/978-3-030-87231-1_3
Conover, W.J.: Practical nonparametric statistics, vol. 350. John wiley & sons (1999)
Frid-Adar, M., Diamant, I., Klang, E., Amitai, M., Goldberger, J., Greenspan, H.: Gan-based synthetic medical image augmentation for increased CNN performance in liver lesion classification. Neurocomputing 321, 321–331 (2018)
Isola, P., Zhu, J.-Y., Zhou, T., Efros, A.A.: Image-to-image translation with conditional adversarial networks. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1125–1134 (2017)
Kim, T., Cha, M., Kim, H., Lee, J.K., Kim, J.: Learning to discover cross-domain relations with generative adversarial networks. In: International Conference on Machine Learning, pp. 1857–1865. PMLR (2017)
Kong, L., Lian, C., Huang, D., Yanle, H., Zhou, Q., Li, Z.: Breaking the dilemma of medical image-to-image translation. Adv. Neural. Inf. Process. Syst. 34, 1964–1978 (2021)
Purysko, A.S., Remer, E.M., Veniero, J.C.: Focal liver lesion detection and characterization with gd-eob-dtpa. Clin. Radiol. 66(7), 673–684 (2011)
Radford, A., Metz, L., Chintala, S.: Unsupervised representation learning with deep convolutional generative adversarial networks. ar**v preprint ar**v:1511.06434 (2015)
Ronneberger, O., Fischer, P., Brox, T.: U-Net: convolutional networks for biomedical image segmentation. In: Navab, N., Hornegger, J., Wells, W.M., Frangi, A.F. (eds.) MICCAI 2015. LNCS, vol. 9351, pp. 234–241. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-24574-4_28
Rueckert, D., Sonoda, L.I., Hayes, C., Hill, D.L.G., Leach, M.O., Hawkes, D.J.: Nonrigid registration using free-form deformations: application to breast mr images. IEEE Trans. Med. Imaging 18(8), 712–721 (1999)
Sano, K., et al.: Imaging study of early hepatocellular carcinoma: usefulness of gadoxetic acid-enhanced mr imaging. Radiology 261(3), 834–844 (2011)
Shan, H., et al.: Competitive performance of a modularized deep neural network compared to commercial algorithms for low-dose CT image reconstruction. Nat. Mach. Intell. 1(6), 269–276 (2019)
Verloh, N., et al.: Assessing liver function by liver enhancement during the hepatobiliary phase with gd-eob-dtpa-enhanced mri at 3 tesla. Eur. Radiol. 24, 1013–1019 (2014)
Wang, C., Chang, X., Wang, C., Tao, D.: Perceptual adversarial networks for image-to-image transformation. IEEE Trans. Image Process. 27(8), 4066–4079 (2018)
Wang, T.-C., Liu, M.-Y., Zhu, J.-Y., Tao, A., Kautz, J., Catanzaro, B.: High-resolution image synthesis and semantic manipulation with conditional gans. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 8798–8807 (2018)
Woo, S., Park, J., Lee, J.-Y., Kweon, I.S.: CBAM: convolutional block attention module. In: Ferrari, V., Hebert, M., Sminchisescu, C., Weiss, Y. (eds.) ECCV 2018. LNCS, vol. 11211, pp. 3–19. Springer, Cham (2018). https://doi.org/10.1007/978-3-030-01234-2_1
Yang, W., et al.: Predicting CT image from MRI data through feature matching with learned nonlinear local descriptors. IEEE Trans. Med. Imaging 37(4), 977–987 (2018)
Yi, Z., Zhang, H., Tan, P., Gong, M.: Dualgan: unsupervised dual learning for image-to-image translation. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 2849–2857 (2017)
Zhang, R., Isola, P., Efros, A.A., Shechtman, E., Wang, O.: The unreasonable effectiveness of deep features as a perceptual metric. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 586–595 (2018)
Zhao, J., et al.: Tripartite-gan: synthesizing liver contrast-enhanced mri to improve tumor detection. Med. Image Anal. 63, 101667 (2020)
Zhu, J.-Y., Park, T., Isola, P., Efros, A.A.: Unpaired image-to-image translation using cycle-consistent adversarial networks. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 2223–2232 (2017)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Liu, J. et al. (2023). Multi-phase Liver-Specific DCE-MRI Translation via A Registration-Guided GAN. In: Wolterink, J.M., Svoboda, D., Zhao, C., Fernandez, V. (eds) Simulation and Synthesis in Medical Imaging. SASHIMI 2023. Lecture Notes in Computer Science, vol 14288. Springer, Cham. https://doi.org/10.1007/978-3-031-44689-4_3
Download citation
DOI: https://doi.org/10.1007/978-3-031-44689-4_3
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-44688-7
Online ISBN: 978-3-031-44689-4
eBook Packages: Computer ScienceComputer Science (R0)
