Learning to Find Occlusion Regions


For two consecutive frames in a video, we identify which pixels in the first frame become occluded in the second. Such general-purpose detection of occlusion regions is difficult and important because one-to-one correspondence of imaged scene points is needed for many tracking, video segmentation, and reconstruction algorithms. Our hypothesis is that an effective trained occlusion detector can be generated on the basis of i) a broad spectrum of visual features, and ii) representative but synthetic training sequences. By using a Random Forest based framework for feature selection and training, we found that the proposed feature set was sufficient to frequently assign a high probability of occlusion to just the pixels that were indeed becoming occluded. Our extensive experiments on many sequences support this finding, and while accuracy is certainly still scene-dependent, the proposed classifier could be a useful pre-processing step to exploit temporal information in video.


CVPR 2011
Learning to Find Occlusion Regions
Ahmad Humayun , Oisin Mac Aodha and Gabriel J. Brostow
CVPR 2011
[paper] [supp material] [video] [bibtex]


Version 1.0 can be downloaded here [code], with instructions available here [instructions].


Contact: a[Last name of first author]@cc.gatech.edu