StoryGraphs


Goal

Automatically generate XKCD like charts for TV episodes. We currently work on the placement of characters, and will work on adding event bubbles at a later stage.

example StoryGraph with annotations

Paper and Poster

StoryGraphs: Visualizing Character Interactions as a Timeline
Makarand Tapaswi, Martin Baeuml and Rainer Stiefelhagen
IEEE Computer Vision and Pattern Recognition (CVPR Poster), Columbus, June 2014
[paper] [poster-1] [poster-2] [supp]


Contributions

  • Automatic method for single image representation of an entire episode
  • Optimize positions of characters trading off aesthetics and representation ability
  • Shot threads used to find optimal scene boundaries via dynamic programming (examples)
  • Evaluation on three diverse TV series: The Big Bang Theory, Buffy the Vampire Slayer and Game of Thrones

Codes

Try the StoryGraphs out at GitHub. The shot threading and scene detection code can be found here.


Downloads

Scene detection ground truth annotations visualized as simple HTML files can be downloaded here.

Links

At a glimpse

A snapshot of all multimedia related projects can be found here. This is the link you will come to from any of our papers too!

Multimedia Resources

I hope to collect links at one place to make it easy to browse the wonderful works.

CV, MM Papers on the Web

Meta-resources for Computer Vision conferences CVPapers, ACM Multimedia MM papers, and Multimedia Information Retrieval papers MIR.