Abstract
Image inpainting techniques have been widely investigated to remove undesired objects in an image. Conventionally, missing parts in an image are completed by optimizing the objective function using pattern similarity. However, unnatural textures are easily generated due to two factors: (1) available samples in the image are quite limited, and (2) pattern similarity is one of the required conditions but is not sufficient for reproducing natural textures. In this paper, we propose a new energy function based on the pattern similarity considering brightness changes of sample textures (for (1)) and introducing spatial locality as an additional constraint (for (2)). The effectiveness of the proposed method is successfully demonstrated by qualitative and quantitative evaluation. Furthermore, the evaluation methods used in much inpainting research are discussed.
Chapter PDF
Similar content being viewed by others
References
Levin, A., Zomet, A., Weiss, Y.: Learning How to Inpaint from Global Image Statistics. In: Proc. ICCV, vol. 1, pp. 305–312 (2003)
Ballester, C., Bertalmio, M., Sapiro, V., Verdera, J.: Filling-In by Joint Interpolation of Vector Fields and Gray Levels. Trans. on Image Processing 10(8), 1200–1211 (2001)
Ballester, C., Caselles, V., Verdera, J., Bertalmio, M., Sapiro, G.: A Variational Model for Filling-In Gray Level and Color Images. In: Proc. ICCV, pp. 10–16 (2001)
Tschumperlé, D.: Curvature-preserving regularization of multi-valued images using pDE’s. In: Leonardis, A., Bischof, H., Pinz, A. (eds.) ECCV 2006. LNCS, vol. 3952, pp. 295–307. Springer, Heidelberg (2006)
Villéger, E., Aubert, G., Blanc-Féraud, L.: Image Disocclusion Using a Probabilistic Gradient Orientation. In: Proc. ICPR, vol. 2, pp. 52–55 (2004)
Bertalmio, M., Bertozzi, A.L., Sapiro, G.: Navier-Stokes, Fluid Dynamics, and Image and Video Inpainting. In: Proc. CVPR, pp. 355–362 (2001)
Bertalmio, M., Sapiro, G., Caselles, V., Ballester, C.: Image Inpainting. In: Proc. SIGGRAPH 2000, pp. 417–424 (2000)
Esedoglu, S., Shen, J.: Digital Inpainting Based on the Mumford-shah-euler Image Model. European J. of Applied Mathematics 13, 353–370 (2003)
Masnou, S., Morel, J.M.: Level Lines Based Disocclusion. In: Proc. ICIP, vol.  3, pp. 259–263 (1998)
Chan, T., Shen, J.: Non-texture Inpainting by Curvature-Driven Diffusions (CDD). J. of Visual Communication and Image Representation 12(4), 436–449 (2001)
Chan, T., Kang, S., Shen, J., Osher, S.: Euler’s Elastica and Curvature Based Inpaintings. SIAM J. of Applied Mathematics 63(2), 564–592 (2002)
Hirani, A.N., Totsuka, T.: Combining Frequency and Spatial Domain Information for Fast Interactive Image Noise Removal. In: Proc. SIGGRAPH 1996, pp. 269–276 (1996)
Rane, S.D., Remus, J., Sapiro, G.: Wavelet-Domain Reconstruction of Lost Blocks in Wireless Image Transmission and Packet-Switched. In: Proc. ICIP, vol. 1, pp. 309–312 (2002)
Amano, T.: Image Interpolation by High Dimensional Projection Based on Subspace Method. In: Proc. ICPR, vol. 4, pp. 665–668 (2004)
Efros, A.A., Leung, T.K.: Texture Synthesis by Non-parametric Sampling. In: Proc. ICCV, pp. 1033–1038 (1999)
Bornard, R., Lecan, E., Laborelli, L., Chenot, J.: Missing Data Correction in Still Images and Image Sequences. In: Proc. ACM Int. Conf. on Multimedia, pp. 355–361 (2002)
Criminisi, A., Pérez, P., Toyama, K.: Region Filling and Object Removal by Exemplar-Based Image Inpainting. Trans. on Image Processing 13(9), 1200–1212 (2004)
Li, B., Qi, Y., Shen, X.: An Image Inpainting Method. In: Proc. IEEE Int. Conf. on Computer Aided Design and Computer Graphics, pp. 531–536 (2005)
Allène, C., Paragios, N.: Image Renaissance Using Discrete Optimization. In: Proc. ICPR, pp. 631–634 (2006)
Wexler, Y., Shechtman, E., Irani, M.: Space-Time Completion of Video. Trans. on PAMI 29(3), 463–476 (2007)
Komodakis, N., Tziritas, G.: Image Completion Using Global Optimization. In: Proc. CVPR, pp. 442–452 (2006)
Drori, I., Cohen-Or, D., Yeshurun, H.: Fragment-Based Image Completion. In: Proc. SIGGRAPH 2003, pp. 303–312 (2003)
Sun, J., Yuan, L., Jia, J., Shum, H.: Image Completion with Structure Propagation. In: Proc. SIGGRAPH 2005, pp. 861–868 (2005)
Jia, J., Tang, C.: Image Repairing: Robust Image Synthesis by Adaptive ND Tensor Voting. In: Proc. CVPR, pp. 643–650 (2003)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2009 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Kawai, N., Sato, T., Yokoya, N. (2009). Image Inpainting Considering Brightness Change and Spatial Locality of Textures and Its Evaluation. In: Wada, T., Huang, F., Lin, S. (eds) Advances in Image and Video Technology. PSIVT 2009. Lecture Notes in Computer Science, vol 5414. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-92957-4_24
Download citation
DOI: https://doi.org/10.1007/978-3-540-92957-4_24
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-92956-7
Online ISBN: 978-3-540-92957-4
eBook Packages: Computer ScienceComputer Science (R0)