Multiview Stereo

  • Living reference work entry
  • First Online:
Computer Vision
  • 131 Accesses

Synonyms

Multiple view stereo; Multiview stereovision; Multiview stereopsis

Related Concepts

Definition

Multiview stereo (MVS) refers to the task of reconstructing the 3D shape of the scene from multiple color or intensity images captured from different viewpoints such that the field of view of the associated cameras overlaps. Typically, the cameras are assumed to be fully calibrated. Various choices of 3D shape representations are possible for the estimated 3D scene reconstruction. For example, dense 3D point cloud or surface mesh representations are common in applications that synthesize a new photorealistic image of the scene using computer graphic rendering techniques. The topics of multiview stereo and multi-baseline stereo matching share key concepts related to the recovery of dense 2D pixel correspondences in multiple images.

Background

Reconstructing 3D geometry from images (often referred to as 3D photography or image-based...

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Institutional subscriptions

Notes

  1. 1.

    https://www.tanksand- temples.org/

  2. 2.

    https://demuc.de/colmap/

  3. 3.

    https:// www.gcc.tu-darmstadt.de/home/proj/mve/

  4. 4.

    http://cdcseacave.github.io/openMVS/

  5. 5.

    https://www.pix4d.com

  6. 6.

    https://www.agisoft.com

  7. 7.

    https://www.altizure.com

References

  1. Barnes C, Shechtman E, Finkelstein A, Goldman DB (2009) PatchMatch: a randomized correspondence algorithm for structural image editing. ACM transactions on graphics (Proc. SIGGRAPH) 28(3), Aug 2009

    Google Scholar 

  2. Curless B, Levoy M (1996) A volumetric method for building complex models from range images. In: Proceedings of the 23rd annual conference on computer graphics and interactive techniques, SIGGRAPH ’96. Association for Computing Machinery, New York, pp 303–312

    Chapter  Google Scholar 

  3. Fuhrmann S, Langguth F, Goesele M (2014) Mve-a multi-view reconstruction environment. In: GCH, pp 11–18

    Google Scholar 

  4. Furukawa Y, Curless B, Seitz SM, Szeliski R (2010) Towards internet-scale multi-view stereo. In: 2010 IEEE computer society conference on computer vision and pattern recognition. IEEE, pp 1434–1441

    Google Scholar 

  5. Furukawa Y, Hernández C (2015) Multi-view stereo: a tutorial. Found Trends® Comput Graph Vis 9(1–2):1–148

    Google Scholar 

  6. Furukawa Y, Ponce J (2009) Accurate, dense, and robust multiview stereopsis. IEEE Trans Pattern Anal Mach Intell 32(8):1362–1376

    Article  Google Scholar 

  7. Gallup D, Frahm J-M, Mordohai P, Yang Q, Pollefeys M (2007) Real-time plane-swee** stereo with multiple swee** directions. In: 2007 IEEE conference on computer vision and pattern recognition. IEEE, pp 1–8

    Google Scholar 

  8. Goesele M, Curless B, Seitz SM (2006) Multi-view stereo revisited. In: 2006 IEEE computer society conference on computer vision and pattern recognition (CVPR’06). IEEE, vol 2, pp 2402–2409

    Google Scholar 

  9. Goesele M, Snavely N, Curless B, Hoppe H, Seitz SM (2007) Multi-view stereo for community photo collections. In: 2007 IEEE 11th international conference on computer vision. IEEE, pp 1–8

    Google Scholar 

  10. Hartmann W, Galliani S, Havlena M, Van Gool L, Schindler K (2017) Learned multi-patch similarity. In: Proceedings of the IEEE international conference on computer vision, pp 1586–1594

    Google Scholar 

  11. Hernández C (2004) Stereo and silhouette fusion for 3D object modeling from uncalibrated images under circular motion. These de doctorat, École Nationale Supérieure des Télécommunications, 2

    Google Scholar 

  12. Hernández C, Vogiatzis G, Cipolla R (2007) Probabilistic visibility for multi-view stereo. In: 2007 IEEE conference on computer vision and pattern recognition. IEEE, pp 1–8

    Google Scholar 

  13. Hiep VH, Keriven R, Labatut P, Pons J-P (2009) Towards high-resolution large-scale multi-view stereo. In: 2009 IEEE conference on computer vision and pattern recognition. IEEE, pp 1430–1437

    Google Scholar 

  14. Hornung A, Kobbelt L (2006) Robust and efficient photo-consistency estimation for volumetric 3D reconstruction. In: European conference on computer vision. Springer, pp 179–190

    Google Scholar 

  15. Jensen R, Dahl A, Vogiatzis G, Tola E, Aanaes H (2014) Large scale multi-view stereopsis evaluation. In: The IEEE conference on computer vision and pattern recognition (CVPR), June 2014

    Google Scholar 

  16. Kanade T, Rander P, Narayanan PJ (1997) Virtualized reality: constructing virtual worlds from real scenes. IEEE Multimedia 4(1):34–47

    Article  Google Scholar 

  17. Knapitsch A, Park J, Zhou Q-Y, Koltun V (2017) Tanks and temples: benchmarking large-scale scene reconstruction. ACM Trans Graph (ToG) 36(4):1–13

    Article  Google Scholar 

  18. Kolev K, Klodt M, Brox T, Cremers D (2009) Continuous global optimization in multiview 3D reconstruction. Int J Comput Vis 84(1):80–96

    Article  Google Scholar 

  19. Kutulakos KN, Seitz SM (2000) A theory of shape by space carving. Int J Comput Vis 38(3):199–218

    Article  Google Scholar 

  20. Merrell P, Akbarzadeh A, Wang L, Mordohai P, Frahm J-M, Yang R, Nistér D, Pollefeys M (2007) Real-time visibility-based fusion of depth maps. In: 2007 IEEE 11th international conference on computer vision. IEEE, pp 1–8

    Google Scholar 

  21. Pons J-P, Keriven R, Faugeras O (2007) Multi-view stereo reconstruction and scene flow estimation with a global image-based matching score. Int J Comput Vis 72(2):179–193

    Article  Google Scholar 

  22. Schönberger JL, Zheng E, Frahm J-M, Pollefeys M (2016) Pixelwise view selection for unstructured multi-view stereo. In: European conference on computer vision. Springer, pp 501–518

    Google Scholar 

  23. Schops T, Schonberger JL, Galliani S, Sattler T, Schindler K, Pollefeys M, Geiger A (2017) A multi-view stereo benchmark with high-resolution images and multi-camera videos. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 3260–3269

    Google Scholar 

  24. Seitz SM, Curless B, Diebel J, Scharstein D, Szeliski R (2006) A comparison and evaluation of multi-view stereo reconstruction algorithms. In: 2006 IEEE computer society conference on computer vision and pattern recognition (CVPR’06). IEEE, vol 1, pp 519–528

    Google Scholar 

  25. Sinha SN, Mordohai P, Pollefeys M (2007) Multi-view stereo via graph cuts on the dual of an adaptive tetrahedral mesh. In: 2007 IEEE 11th international conference on computer vision. IEEE, pp 1–8

    Google Scholar 

  26. Slabaugh GG, Culbertson WB, Malzbender T, Stevens MR, Schafer RW (2004) Methods for volumetric reconstruction of visual scenes. Int J Comput Vis 57(3):179–199

    Article  Google Scholar 

  27. Strecha C, Von Hansen W, Van Gool L, Fua P, Thoennessen U (2008) On benchmarking camera calibration and multi-view stereo for high resolution imagery. In: 2008 IEEE conference on computer vision and pattern recognition. IEEE, pp 1–8

    Google Scholar 

  28. Tola E, Strecha C, Fua P (2012) Efficient large-scale multi-view stereo for ultra high-resolution image sets. Mach Vis Appl 23(5):903–920

    Article  Google Scholar 

  29. Vogiatzis G, Esteban CH, Torr PHS, Cipolla R (2007) Multiview stereo via volumetric graph-cuts and occlusion robust photo-consistency. IEEE Trans Pattern Anal Mach Intell 29(12):2241–2246

    Article  Google Scholar 

  30. Yao Y, Luo Z, Li S, Fang T, Quan L (2018) Mvsnet: depth inference for unstructured multi-view stereo. In: Proceedings of the European conference on computer vision (ECCV), pp 767–783

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Sudipta N. Sinha .

Section Editor information

Rights and permissions

Reprints and permissions

Copyright information

© 2021 Springer Nature Switzerland AG

About this entry

Check for updates. Verify currency and authenticity via CrossMark

Cite this entry

Sinha, S.N. (2021). Multiview Stereo. In: Computer Vision. Springer, Cham. https://doi.org/10.1007/978-3-030-03243-2_203-1

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-03243-2_203-1

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-03243-2

  • Online ISBN: 978-3-030-03243-2

  • eBook Packages: Springer Reference Computer SciencesReference Module Computer Science and Engineering

Publish with us

Policies and ethics

Navigation