word
Box around a word indicates words that are linked with object(s) in an image. Driving the mouse over the box will show the region
nountable
   
nounkitchen
Box below a noun indicates its ground-truth class (annotated only for classes of interest). Blue box indicates an object class, yellow box indicates scene class
 table     its Words marked with the same background color form the same coreference cluster. Different colors indicate different coreferences clusters.
Annotated prepositions are of form:  ⟨  noun1   relation   noun2   noun3  ⟩. If the nouns are linked to objects in the scene, then the noun on the left of the relation is marked with magenta color and nouns on the right are blue.

Example on the left:   ⟨  towel   above   trash_can  

close window

Note:  Dataset also has ground-truth adjectives for each noun, however, this is not shown below in order to not over clutter the visualization.

Note:  The annotators labeled coreference and prepositions by looking only at text, so there may be some errors with respect to the visual scene itself.

back to top

back to top

back to top

back to top

back to top

back to top

back to top

back to top

back to top

back to top