Transforming Image Completion

Image completion is an important photo-editing task which involves synthetically filling a hole in the image such that the image still appears natural. State-of-the-art image completion methods work by searching for patches in the image that fit well in the hole region.

Our key insight is that image patches remain natural under a variety of transformations (such as scale, rotation and brightness change), and it is important to exploit this.

We propose and investigate the use of different optimisation methods to search for the best patches and their respective transformations for producing consistent, improved completions. Experiments on a number of challenging problem instances demonstrate that our methods outperform state-of-the-art techniques.

Publications

Transforming Image Completion
A. Mansfield, M. Prasad, C. Rother, T. Sharp, P. Kohli and L. Van Gool
British Machine Vision Conference (BMVC) 2011

[paper.pdf] (2.7 MB) [poster.pdf] (2.1 MB) [bibtex]

Code

You can download the code that we used to produce our results, which is available under a GNU General Public License. The implementation is written in MATLAB and C++ (with a MEX interface).

Please note that all code is provided for research purposes only. For any questions about the code, please contact Alex Mansfield.

[code.zip] (0.2MB)