WMVL banner
WMVL banner Penn State Mark WMVL banner
WMVL banner

Home
News
People
Research
Publications
Courses
Seminars
Data & Code
Contact Us
Calendar
Other Links

Image De-fencing Members: Yanxi Liu, James Hays, Roberto Lublinerman, and Tamara Belkina

Abstract

We introduce a novel image segmentation algorithm that uses translational symmetry as the primary foreground/ background separation cue. We investigate the process of identifying and analyzing image regions that present approximate translational symmetry for the purpose of image foreground/background separation. In conjunction with texture-based inpainting, understanding the different see-through layers allows us to perform powerful image manipulations such as recovering a mesh occluded background (as much as 53% occluded area) to achieve the effect of image and photo de-fencing. Our algorithm consists of three distinct phases- (1) automatically finding the skeleton structure of a potential frontal layer (fence) in the form of a deformed lattice, (2) separating foreground/background layers using appearance regularity, and (3) occluded foreground inpainting to reveal a complete, non-occluded image. Each of these three tasks presents its own special computational challenges that are not encountered in previous, general image de-layering or texture inpainting applications.

Publications

  • Minwoo Park, Kyle Brocklehurst, Robert T. Collins and Yanxi Liu, "Image De-fencing Revisited," Asian Conference on Computer Vision (ACCV '10)
  • Yanxi Liu, Tamara Belkina, James H. Hays, and Roberto Lublinerman, "Image De-fencing," Computer Vision and Pattern Recognition Conference (CVPR '08)


Movies

airport_inpaint
airport_refine_mask
pipe_inpaint
pipe_refine_mask

Successes

airportinputairportresult
highwayinputhighwayfinal
leopard2inputleopard2result
pipeinputpiperesult
shadowinputshadowresult
girlgirlfinal
fencenetnetfnnresult

Inpainting Failures

 atriumsyntresultatrium
ducksynthresultduck
windowsynthresultwindow
birdbird-result
tigertigerresult
 flowersynthresultflower

Lattice detection failures

bird2flamingos
orangutanpantera
prison1prison-break
skyOriverthroughfence
tucan800dogs2
boy deers
crocodilebuilding
deer fenceshadowtanks
floortile georgetown
nofumhouse
lion nycpark
nyc86 paw
peacock prison
 sky rac_basket
dogwindow2
im70

 

WMVL banner


Maintained by LPAC webmaster

WMVL banner WMVL banner