Using eye-tracking data for automatic film comic creation
Masahiro Toyoura, Tomoya Sawada, Mamoru Kunihiro, Xiaoyang Mao
Proceedings of the Symposium on Eye Tracking Research and Applications, 2012, pp. 373--376.
Abstract: A film comic is a kind of art work representing a movie story as a comic. It uses the images of the movie as panels. Verbal information such as dialogue and narrations is represented in word balloons. A key issue in creating film comics is how to select images which are significant in conveying the story of the movie. Such significance of images is inherently semantic and context-dependent and hence, technologies purely based on image analysis usually fail to produce good results. On the other hand, the word balloon arrangement requires understanding not only the semantic of images but also the verbal information, which is difficult except for the case the script of the movie is available. This paper describes a new attempt to use eye-tracking data for the automatic creation of a film comic from a movie. Patterns of eye movement are analyzed for detecting the change of scenes and gaze information is used for automatically finding the location for inserting and directing the word balloons. Our experiments showed that the proposed technique can largely improve the selection of significant images compared with the method using image features only and realize the automatic balloon arrangement.
Article URL: http://doi.acm.org/10.1145/2168556.2168640
BibTeX format:
@inproceedings{10.1145-2168556.2168640,
  author = {Masahiro Toyoura and Tomoya Sawada and Mamoru Kunihiro and Xiaoyang Mao},
  title = {Using eye-tracking data for automatic film comic creation},
  booktitle = {Proceedings of the Symposium on Eye Tracking Research and Applications},
  pages = {373--376},
  year = {2012},
}
Search for more articles by Masahiro Toyoura.
Search for more articles by Tomoya Sawada.
Search for more articles by Mamoru Kunihiro.
Search for more articles by Xiaoyang Mao.

Return to the search page.


graphbib: Powered by "bibsql" and "SQLite3."