Extended Reality (XR:VR/AR/MR), 3D Printing, Holography, A.I., Radiomics, and Online VR Tele-Medicine for Precision Surgery

  • Chapter
  • First Online:
Surgery and Operating Room Innovation

Abstract

Surgical navigation has become essential for surgeons to accurately and safely perform precision surgery. The 3D organ modeling based on individual patient’s medical image data is indispensable for simulation, navigation, and education for accurate and safe surgery. Thus, radiomics is a crucial role in systematically scientizing the enormous amount of radiological image information.

The polygon data in the shape of organs has already been put into practical use for surgical simulation and navigation using extended reality (XR), including virtual reality (VR), augmented reality (AR), mixed reality (MR), or 3D-printing technology. Machine learning with artificial intelligence may improve the accuracy of organ extraction.

We have developed an application that digitally analyzes CT and MRI data of individual patients, automatically extracts feature points of the organ shape with artificial intelligence (AI), converts them into polygons, and views these organ shape coordinates as XR. We also developed a 3D-printing surgical simulation and navigation system using anatomically accurate bio-elastic wet hemorrhagic organ replica by the resins, polyvinyl alcohol (PVA), and water based on MDCT data.

These could further develop “personalized medicine” into “precision medicine,” which selects individual analysis and establishes the optimal treatment for each specific population. Our patient-specific XR surgical navigation is highly effective and reduce surgical time, blood loss, and adverse event. This system must have value for future surgeons.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
EUR 32.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or Ebook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (Canada)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 79.99
Price excludes VAT (Canada)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 99.99
Price excludes VAT (Canada)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free ship** worldwide - see info
Hardcover Book
USD 139.99
Price excludes VAT (Canada)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free ship** worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Holoeyes Inc. http://holoeyes.jp/en. Accessed 27 Jan 2020.

  2. Sugimoto M. Augmented tangibility surgical navigation using spatial interactive 3-D Hologram zSpace with OsiriX and Bio-Texture 3-D Organ Modeling In: IEEE 2015 international conference on computer application technologies (CCATS 2015); 2015. p. 189–194.

    Google Scholar 

  3. Saito Y, Sugimoto M, Imura S, Morine Y, Ikemoto T, Iwahashi S, Yamada S, Shimada M. Intraoperative 3D hologram support with mixed reality techniques in liver surgery. Ann Surg. 2020;271(1):e4–7.

    Article  Google Scholar 

  4. Yamada T, Osako M, Uchimuro T, Yoon R, Morikawa T, Sugimoto M, Suda H, Shimizu H. Three-dimensional printing of life-like models for simulation and training of minimally invasive cardiac surgery. Innovations. 2017;12(6):459–65.

    Article  Google Scholar 

  5. Soejima Y, Taguchi T, Sugimoto M, Hayashida M, Yoshizumi T, Ikegami T, Uchiyama H, Shirabe K, Maehara Y. Three-dimensional printing and biotexture modeling for preoperative simulation in living donor liver transplantation for small infants. Liver Transpl. 2016;22(11):1610–4.

    Article  Google Scholar 

  6. Komai Y, Sugimoto M, Gotohda N, Matsubara N, Kobayashi T, Sakai Y, Shiga Y, Saito N. Patient-specific 3D printed kidney designed for “4D” surgical navigation-a novel aid to facilitate minimally invasive off-clamp partial nephrectomy in complex tumor cases. Urology. 2016;91:226–33.

    Article  Google Scholar 

  7. Kusaka M, Sugimoto M, Fukami N, Sasaki H, Takenaka M, Anraku T, Ito T, Kenmochi T, Shiroki R, Hoshinaga K. Initial experience with a tailor-made simulation and navigation program using a 3-D printer model of kidney transplantation surgery. Transplant Proc. 2015;47(3):596–9.

    Article  CAS  Google Scholar 

Download references

Acknowledgments

This work was supported by JSPS KAKENHI Grant Numbers JP 19152948, JP 19167615.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Maki Sugimoto .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2021 Springer Nature Singapore Pte Ltd.

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Sugimoto, M. (2021). Extended Reality (XR:VR/AR/MR), 3D Printing, Holography, A.I., Radiomics, and Online VR Tele-Medicine for Precision Surgery. In: Takenoshita, S., Yasuhara, H. (eds) Surgery and Operating Room Innovation. Springer, Singapore. https://doi.org/10.1007/978-981-15-8979-9_7

Download citation

  • DOI: https://doi.org/10.1007/978-981-15-8979-9_7

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-15-8978-2

  • Online ISBN: 978-981-15-8979-9

  • eBook Packages: MedicineMedicine (R0)

Publish with us

Policies and ethics

Navigation