The patch transform and its applications to image editing

Sang Cho Taeg, Moshe Butman, Shai Avidan, William T. Freeman

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

135 Scopus citations

Abstract

We introduce the patch transform, where an image is broken into non-overlapping patches, and modifications or constraints are applied in the "patch domain". A modified image is then reconstructed from the patches, subject to those constraints. When no constraints are given, the reconstruction problem reduces to solving a jigsaw puzzle. Constraints the user may specify include the spatial locations of patches, the size of the output image, or the pool of patches from which an image is reconstructed. We define terms in a Markov network to specify a good image reconstruction from patches: neighboring patches must fit to form a plausible image, and each patch should be used only once. We find an approximate solution to the Markov network using loopy belief propagation, introducing an approximation to handle the combinatorially difficult patch exclusion constraint. The resulting image reconstructions show the original image, modified to respect the user's changes. We apply the patch transform to various image editing tasks and show that the algorithm performs well on real world images.

Original languageEnglish
Title of host publication26th IEEE Conference on Computer Vision and Pattern Recognition, CVPR
PublisherIEEE Computer Society
ISBN (Print)9781424422432
DOIs
StatePublished - 2008
Externally publishedYes
Event26th IEEE Conference on Computer Vision and Pattern Recognition, CVPR - Anchorage, AK, United States
Duration: 23 Jun 200828 Jun 2008

Publication series

Name26th IEEE Conference on Computer Vision and Pattern Recognition, CVPR

Conference

Conference26th IEEE Conference on Computer Vision and Pattern Recognition, CVPR
Country/TerritoryUnited States
CityAnchorage, AK
Period23/06/0828/06/08

Fingerprint

Dive into the research topics of 'The patch transform and its applications to image editing'. Together they form a unique fingerprint.

Cite this