JumpCut: non-successive mask transfer and interpolation for video cutout
Qingnan Fan, Fan Zhong, Dani Lischinski, Daniel Cohen-Or, Baoquan Chen
In ACM Transactions on Graphics (TOG), 34(6), November 2015.
Abstract: We introduce JumpCut, a new mask transfer and interpolation method for interactive video cutout. Given a source frame for which a foreground mask is already available, we compute an estimate of the foreground mask at another, typically non-successive, target frame. Observing that the background and foreground regions typically exhibit different motions, we leverage these differences by computing two separate nearest-neighbor fields (split-NNF) from the target to the source frame. These NNFs are then used to jointly predict a coherent labeling of the pixels in the target frame. The same split-NNF is also used to aid a novel edge classifier in detecting silhouette edges (S-edges) that separate the foreground from the background. A modified level set method is then applied to produce a clean mask, based on the pixel labels and the S-edges computed by the previous two steps. The resulting mask transfer method may also be used for coherently interpolating the foreground masks between two distant source frames. Our results demonstrate that the proposed method is significantly more accurate than the existing state-of-the-art on a wide variety of video sequences. Thus, it reduces the required amount of user effort, and provides a basis for an effective interactive video object cutout tool.
Article URL: http://doi.acm.org/10.1145/2816795.2818105
BibTeX format:
@article{10.1145-2816795.2818105,
  author = {Qingnan Fan and Fan Zhong and Dani Lischinski and Daniel Cohen-Or and Baoquan Chen},
  title = {JumpCut: non-successive mask transfer and interpolation for video cutout},
  journal = {ACM Transactions on Graphics (TOG)},
  volume = {34},
  number = {6},
  articleno = {195},
  month = nov,
  year = {2015},
}
Search for more articles by Qingnan Fan.
Search for more articles by Fan Zhong.
Search for more articles by Dani Lischinski.
Search for more articles by Daniel Cohen-Or.
Search for more articles by Baoquan Chen.

Return to the search page.


graphbib: Powered by "bibsql" and "SQLite3."