Abstract
Twin-to-Twin Transfusion Syndrome (TTTS) is a condition that occurs in about 10% of pregnancies involving monochorionic twins. This complication can be treated with fetoscopic laser coagulation. The procedure could greatly benefit from panorama reconstruction to gain an overview of the placenta. Current state-of-the-art methods focus on panorama reconstruction in an ex-vivo setting. However, these methods fail in the in-vivo surgical setting. This paper describes the panorama reconstruction approach, the challenges posed by the in-vivo setting and the influence of these challenges on the panorama reconstruction. With experiments we show that the viewing quality is greatly reduced and that the limited motion of the fetoscope complicates and limits the precision of the image registration. We also identify the aspect necessary to shift from ex-vivo to in-vivo panorama reconstruction. Following our recommendations it should be possible to develop an approach that can be applied to TTTS surgery.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Bay, H., Ess, A., Tuytelaars, T., Van Gool, L.: Speeded-up robust features (surf). Comput. Vis. Image Underst. 110(3), 346–359 (2008)
Behrens, A., Stehle, T., Gross, S., Aach, T.: Local and global panoramic imaging for fluorescence bladder endoscopy. In: 2009 Annual International Conference of the IEEE Engineering in Medicine and Biology Society, pp. 6990–6993. IEEE (2009)
Brown, M., Lowe, D.G.: Automatic panoramic image stitching using invariant features. Int. J. Comput. Vis. 74(1), 59–73 (2007)
Calonder, M., Lepetit, V., Strecha, C., Fua, P.: BRIEF: binary robust independent elementary features. In: Daniilidis, K., Maragos, P., Paragios, N. (eds.) ECCV 2010. LNCS, vol. 6314, pp. 778–792. Springer, Heidelberg (2010). doi:10.1007/978-3-642-15561-1_56
Carroll, R.E., Seitz, S.M.: Rectified surface mosaics. Int. J. Comput. Vis. 85(3), 307–315 (2009)
Chmait, R.H., Kontopoulos, E.V., Korst, L.M., Llanes, A., Petisco, I., Quintero, R.A.: Stage-based outcomes of 682 consecutive cases of twin-twin transfusion syndrome treated with laser surgery: the usfetus experience. Am. J. Obstet. Gynecol. 204(5), 393-e1 (2011)
Fischler, M.A., Bolles, R.C.: Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Commun. ACM 24(6), 381–395 (1981)
Gaisser, F., Jonker, P.P., Chiba, T.: Image registration for placenta reconstruction. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, pp. 33–40 (2016)
Harris, C., Stephens, M.: A combined corner and edge detector. In: Alvey Vision Conference, vol. 15, p. 50 (1988). Citeseer
Lewi, L., Deprest, J., Hecher, K.: The vascular anastomoses in monochorionic twin pregnancies and their clinical consequences. Am. J. Obstet. Gynecol. 208(1), 19–30 (2013)
Li, Y., Shum, H.-Y., Tang, C.-K., Szeliski, R.: Stereo reconstruction from multiperspective panoramas. IEEE Trans. Pattern Anal. Mach. Intell. 26(1), 45–62 (2004)
Liao, H., Tsuzuki, M., Kobayashi, E., Dohi, T., Chiba, T., Mochizuki, T., Sakuma, I.: Fast image map** of endoscopic image mosaics with three-dimensional ultrasound image for intrauterine treatment of twin-to-twin transfusion syndrome. In: Dohi, T., Sakuma, I., Liao, H. (eds.) MIAR 2008. LNCS, vol. 5128, pp. 329–338. Springer, Heidelberg (2008). doi:10.1007/978-3-540-79982-5_36
Lowe, D.G.: Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vis. 60(2), 91–110 (2004)
Peeters, S.: Training and teaching fetoscopic laser therapy: assessment of a high fidelity simulator based curriculum. Ph.D. thesis, Leiden University Medical Center, January 2015
Rousseeuw, P.J.: Least median of squares regression. J. Am. Stat. Assoc. 79(388), 871–880 (1984)
Reeff, M., Gerhard, F., Cattin, P.C., Székely, G.: Mosaicing of endoscopic placenta images. In: Informatik fr Menschen, vol. 1. Hartung-Gorre Verlag (2006)
Rublee, E., Rabaud, V., Konolige, K., Bradski, G.: ORB: an efficient alternative to SIFT or SURF. In: 2011 IEEE International Conference on Computer Vision (ICCV), pp. 2564–2571, November 2011
Seshamani, S., Lau, W., Hager, G.: Real-time endoscopic mosaicking. In: Larsen, R., Nielsen, M., Sporring, J. (eds.) MICCAI 2006. LNCS, vol. 4190, pp. 355–363. Springer, Heidelberg (2006). doi:10.1007/11866565_44
Soper, T.D., Porter, M.P., Seibel, E.J.: Surface mosaics of the bladder reconstructed from endoscopic video for automated surveillance. IEEE Trans. Biomed. Eng. 59(6), 1670–1680 (2012)
Tella-Amo, M., Daga, P., Chadebecq, F., Thompson, S., Shakir, D.I., Dwyer, G., Wimalasundera, R., Deprest, J., Stoyanov, D., Vercauteren, T., et al.: A combined EM and visual tracking probabilistic model for robust mosaicking: application to fetoscopy. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, pp. 84–92 (2016)
Zitova, B., Flusser, J.: Image registration methods: a survey. Image Vis. Comput. 21(11), 977–1000 (2003)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2017 Springer International Publishing AG
About this paper
Cite this paper
Gaisser, F., Peeters, S.H.P., Lenseigne, B., Jonker, P.P., Oepkes, D. (2017). Fetoscopic Panorama Reconstruction: Moving from Ex-vivo to In-vivo. In: Valdés Hernández, M., González-Castro, V. (eds) Medical Image Understanding and Analysis. MIUA 2017. Communications in Computer and Information Science, vol 723. Springer, Cham. https://doi.org/10.1007/978-3-319-60964-5_51
Download citation
DOI: https://doi.org/10.1007/978-3-319-60964-5_51
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-60963-8
Online ISBN: 978-3-319-60964-5
eBook Packages: Computer ScienceComputer Science (R0)