Abstract
Omnidirectional cameras usually cannot capture the entire direction of view due to a blind side. Thus, such an invisible part decreases realistic sensation in a telepresence system. In this study, an omnidirectional video without invisible areas is generated by filling in the missing region using an image inpainting technique for highly realistic sensation in telepresence. This paper proposes a new method that successfully inpaints a missing region by compensating for the change in appearance of textures caused by the camera motion and determining a searching area for similar textures considering the camera motion and the shape of the scene around the missing region. In experiments, the effectiveness of the proposed method is demonstrated by inpainting missing regions in a real image sequence captured with an omnidirectional camera and generating an omnidirectional video without invisible areas.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Ikeda, S., Sato, T., Yokoya, N.: Immersive Telepresence System with a Locomotion Interface Using High-resolution Omnidirectional Videos. In: Proc. IAPR Conf. on Machine Vision Applications, pp. 602–605 (2005)
Hori, M., Kanbara, M., Yokoya, N.: Novel Stereoscopic View Generation by Image-Based Rendering Coordinated with Depth Information. In: Proc. Scandinavian Conf. on Image Analysis, pp. 193–202 (2007)
Bertalmio, M., Sapiro, G., Caselles, V., Ballester, C.: Image Inpainting. In: Proc. ACM SIGGRAPH 2000, pp. 417–424 (2000)
Criminisi, A., Perez, P., Toyama, K.: Region Filling and Object Removal by Exemplar-Based Inpainting. IEEE Trans. on Image Processing 13, 1200–1212 (2004)
Komodakis, N., Tziritas, G.: Image Completion Using Global Optimization. In: Proc. IEEE Conf. on Computer Vision and Pattern Recognition, pp. 442–452 (2006)
Matsushita, Y., Ofek, E., Ge, W., Tang, X., Shum, H.: Full-Frame Video Stabilization with Motion Inpainting. IEEE Trans. on Pattern Analysis and Machine Intelligence 28(7), 1150–1163 (2006)
Jia, J., Tai, Y., Wu, T., Tang, C.: Video Repairing under Variable Illumination Using Cyclic Motions. IEEE Trans. on Pattern Analysis and Machine Intelligence 28(5), 832–839 (2006)
Shen, Y., Lu, F., Cao, X., Foroosh, H.: Video Completion for Perspective Camera Under Constrained Motion. In: Proc. IEEE Int. Conf. on Pattern Recognition, pp. 63–66 (2006)
Patwardhan, K., Sapiro, G., Bertalmio, M.: Video Inpainting Under Constrained Camera Motion. IEEE Trans. on Image Processing 16, 545–553 (2007)
Wexler, Y., Shechtman, E., Irani, M.: Space-Time Completion of Video. Trans. on Pattern Analysis and Machine Intelligence 29, 463–476 (2007)
Cheung, V., Frey, B., Jojic, N.: Video epitomes. In: Proc. IEEE Conf. on Computer Vision and Patern Recognition, pp. 141–152 (2005)
Sato, T., Ikeda, S., Yokoya, N.: Extrinsic Camera Parameter Recovery from Multiple Image Sequences Captured by an Omni-directional Multi-camera System. In: Pajdla, T., Matas, J(G.) (eds.) ECCV 2004. LNCS, vol. 3022, pp. 326–340. Springer, Heidelberg (2004)
Kawai, N., Sato, T., Yokoya, N.: Image Inpainting Considering Brightness Change and Spatial Locality of Textures and Its Evaluation. In: Proc. Pacific-Rim Symp. on Image and Video Technology, pp. 271–282 (2009)
Point Grey Research Inc.: Ladybug, http://www.ptgrey.com/products/spherical.asp
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Kawai, N., Machikita, K., Sato, T., Yokoya, N. (2010). Generation of an Omnidirectional Video without Invisible Areas Using Image Inpainting. In: Zha, H., Taniguchi, Ri., Maybank, S. (eds) Computer Vision – ACCV 2009. ACCV 2009. Lecture Notes in Computer Science, vol 5995. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-12304-7_34
Download citation
DOI: https://doi.org/10.1007/978-3-642-12304-7_34
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-12303-0
Online ISBN: 978-3-642-12304-7
eBook Packages: Computer ScienceComputer Science (R0)