Full Text:   <1652>

CLC number: TP391.41

On-line Access: 2010-03-22

Received: 2009-05-24

Revision Accepted: 2009-10-28

Crosschecked: 2010-03-01

Cited: 5

Clicked: 3970

Citations:  Bibtex RefMan EndNote GB/T7714

-   Go to

Article info.
1. Reference List
Open peer comments

Journal of Zhejiang University SCIENCE C 2010 Vol.11 No.4 P.270-277

http://doi.org/10.1631/jzus.C0910308


Exemplar-based video inpainting with large patches


Author(s):  Abbas Koochari, Mohsen Soryani

Affiliation(s):  Department of Computer Engineering, Iran University of Science and Technology, Tehran 16846-13114, Iran

Corresponding email(s):   koochari@iust.ac.ir, soryani@iust.ac.ir

Key Words:  Video inpainting, Patch, Background modeling, Mosaic


Abbas Koochari, Mohsen Soryani. Exemplar-based video inpainting with large patches[J]. Journal of Zhejiang University Science C, 2010, 11(4): 270-277.

@article{title="Exemplar-based video inpainting with large patches",
author="Abbas Koochari, Mohsen Soryani",
journal="Journal of Zhejiang University Science C",
volume="11",
number="4",
pages="270-277",
year="2010",
publisher="Zhejiang University Press & Springer",
doi="10.1631/jzus.C0910308"
}

%0 Journal Article
%T Exemplar-based video inpainting with large patches
%A Abbas Koochari
%A Mohsen Soryani
%J Journal of Zhejiang University SCIENCE C
%V 11
%N 4
%P 270-277
%@ 1869-1951
%D 2010
%I Zhejiang University Press & Springer
%DOI 10.1631/jzus.C0910308

TY - JOUR
T1 - Exemplar-based video inpainting with large patches
A1 - Abbas Koochari
A1 - Mohsen Soryani
J0 - Journal of Zhejiang University Science C
VL - 11
IS - 4
SP - 270
EP - 277
%@ 1869-1951
Y1 - 2010
PB - Zhejiang University Press & Springer
ER -
DOI - 10.1631/jzus.C0910308


Abstract: 
Inpainting is the process of reconstructing damaged regions of images and video frames. This study deals with weaknesses of the current video inpainting techniques, when an object is totally damaged, and a framework for video inpainting is proposed. Using this framework, the moving object is separated from the background. A large mosaic image is constructed using the moving object and then a patch-based method with large patches is used to fill holes. In each frame, the inpainted foreground is obtained by placing the object in its location. Missing areas of the stationary background are also filled separately and the final video is produced by composing the inpainted background and object frames. Results for three video sequences with an occluded object show that this approach represents the object in the missing region better than other approaches.

Darkslateblue:Affiliate; Royal Blue:Author; Turquoise:Article

Reference

[1]Bertalmio, M., Sapiro, G., Caselles, V., Ballester, C., 2000. Image Inpainting. Proc. ACM SIGGRAPH Conf. on Computer Graphics, p.417-424.

[2]Bertalmio, M., Bertozzi, A.L., Sapiro, G., 2001. Navier-Stokes, Fluid Dynamics, and Image and Video Inpainting. Proc. IEEE Conf. on Computer Vision and Pattern Recognition, 1:355-362.

[3]Bertalmio, M., Vese, L., Sapiro, G., Osher, S., 2003. Simultaneous structure and texture image inpainting. IEEE Trans. Image Process., 12(8):882-889.

[4]Cheung, S., Zhao, J., Venkatesh, M.V., 2006. Efficient Object-Based Video Inpainting. Proc. IEEE Int. Conf. on Image Processing, p.705-708.

[5]Criminisi, A., Perez, P., Toyama, K., 2004. Region filling and object removal by exemplar-based inpainting. IEEE Trans. Image Process., 13(9):1200-1212.

[6]Ho, H.T., Goecke, R., 2007. Automatic Parametrisation for an Image Completion Method Based on Markov Random Fields. Proc. IEEE Int. Conf. on Image Processing, 3:541-544.

[7]Liu, D., Sun, X., Wu, F., Li, S., Zhang, Y.Q., 2007. Image compression with edge-based inpainting. IEEE Trans. Circ. Syst. Video Technol., 17(10):1273-1287.

[8]Matsushita, Y., Ofek, E., Ge, W., Tang, X., Shum, H.Y., 2006. Full-frame video stabilization with motion inpainting. IEEE Trans. Pattern Anal. Mach. Intell., 28(7):1150-1163.

[9]Oliveira, M.M., Bowen, B., McKenna, R., Chang, Y.S., 2001. Fast Digital Image Inpainting. Proc. Int. Conf. on Visualization, Imaging and Image Processing, p.261-266.

[10]Patwardhan, K.A., Sapiro, G., Bertalmio, M., 2007. Video inpainting under constrained camera motion. IEEE Trans. Image Process., 16(2):545-553.

[11]Sheikh, Y., Shah, M., 2005. Bayesian Object Detection in Dynamic Scenes. Proc. IEEE Conf. on Computer Vision and Pattern Recognition, 1:74-79.

[12]Shen, Y., Lu, F., Cao, X., Foroosh, H., 2006. Video Completion for Perspective Camera under Constrained Motion. Proc. 18th Int. Conf. on Pattern Recognition, 3:63-66.

[13]Stauffer, C., Grimson, W.E.L., 1999. Adaptive Background Mixture Models for Real-Time Tracking. Proc. Computer Vision and Pattern Recognition, p.246-252.

[14]Sun, J., Yuan, L., Jia, J., Shum, H.Y., 2005. Image completion with structure propagation. ACM Trans. Graph., 24(3):861-868.

[15]Venkatesh, M.V., Cheung, S.S., Zhao, J., 2009. Efficient object-based video inpainting. Pattern Recogn. Lett., 30(2):168-179.

[16]Wang, H., Li, H., Li, B., 2007. Video Inpainting for Largely Occluded Moving Human. Proc. IEEE Int. Conf. on Multimedia and Expo, p.1719-1722.

[17]Wexler, Y., Shechtman, E., Irani, M., 2004. Space-Time Video Completion. Proc. IEEE Computer Society Conf. on Computer Vision and Pattern Recognition, 1:120-127.

[18]Wexler, Y., Shechtman, E., Irani, M., 2007. Space-time completion of video. IEEE Trans. Pattern Anal. Mach. Intell., 29(3):463-476.

[19]Wren, C.R., Azarbayejani, A., Darrell, T., Pentland, A.P., 1997. Pfinder: Real-time tracking of the human body. IEEE Trans. Pattern Anal. Mach. Intell., 19(7):780-785.

[20]Zhang, Y., Xiao, J., Shah, M., 2005. Motion Layer Based Object Removal in Videos. Proc. IEEE Workshop on Applications of Computer Vision, p.516-521.

[21]Zivkovic, Z., 2004. Improved Adaptive Gaussian Mixture Model for Background Subtraction. Proc. 17th Int. Conf. on Pattern Recognition, 2:28-31.

Open peer comments: Debate/Discuss/Question/Opinion

<1>

rajesh chauhan<rajesh84_chauhan@yahoo.co.in>

2010-05-25 19:08:47

can u provide me code for any video inpainting technique

Please provide your name, email address and a comment





Journal of Zhejiang University-SCIENCE, 38 Zheda Road, Hangzhou 310027, China
Tel: +86-571-87952783; E-mail: cjzhang@zju.edu.cn
Copyright © 2000 - Journal of Zhejiang University-SCIENCE