Creative Flow+ Dataset

large densely annotated artistic video dataset

including optical flow, occlusions, correspondences, segmentation labels, normals, and depth

About

Creative Flow+ Dataset challenges Computer Vision techniques to generalize to a wide range of styles, including messy stylized content. Our dataset is the first diverse multi-style artistic video dataset densely labeled with ground truth. Our synthetic dataset contains 3000 animated sequences (124K train and 10K test frames at 1500x1500) rendered in a wide range of artistic styles (40 line styles and 38 shading styles).

Citation

                        
@InProceedings{shugrina2019creative,
  author = {Shugrina, Maria and
    Liang, Ziheng and Kar, Amlan and Li, Jiaman and
    Singh, Angad and Singh, Karan and Fidler, Sanja},
  title = {Creative Flow+ Dataset},
  booktitle = {The IEEE Conference on Computer Vision
    and Pattern Recognition (CVPR)},
  month = {June},
  year = {2019}
}
                        
                    

Paper

Supplemental

Errata & Details

Download

 

Sequence Lists

Download these lists for navigating the data with our python utilities.

Rendering Packages

composite
shading
line
line alpha
original
 
train_renders_mixamo.zip (32GB)
train_renders_shapenet.zip
train_renders_web.zip
 
test_renders.zip (13GB)
train_renders_mixamo_halfres.zip (7GB)
train_renders_shapenet_halfres.zip
train_renders_web_halfres.zip
 
test_renders_halfres.zip (2.4GB)
These packages contain all visual renderings. Separate shading and line components of each composited stylized frame is also provided. Format: mp4 video files.

Flow Packages

flow
occlusions
 
train_flows_mixamo.zip (164GB)
train_flows_shapenet.zip
train_flows_web.zip
 
test_flows.zip (168GB)
train_flows_mixamo_halfres.zip (42GB)
train_flows_shapenet_halfres.zip
train_flows_web_halfres.zip
 
test_flows_halfres.zip (43GB)

These packages include forward flow, as special zip files, and occlusions, as mp4 clips.

Core Metadata Packages

alpha
labels
normals (lossy)
corresp. (lossy)
depth (images)
train_meta_mixamo.zip (5GB)
train_meta_shapenet.zip
train_meta_web.zip
 
test_meta.zip (2.3GB)
train_meta_mixamo_halfres.zip (2GB)
train_meta_shapenet_halfres.zip
train_meta_web_halfres.zip
 
test_meta_halfres.zip (1GB)

These packages include core metadata, compression strategies vary (see errata).

Supplementary Packages

normals (raw)
corresp. (raw)
train_supp_mixamo.zip (89GB)
train_supp_shapenet.zip
train_supp_web.zip
 
test_supp.zip (37GB)
train_supp_mixamo_halfres.zip (31GB)
train_supp_shapenet_halfres.zip
train_supp_web_halfres.zip
 
test_supp_halfres.zip (13GB)

The _supp_ packages include raw normals and correspondences images, compressed losslessly.

depth (arrays)
train_depth_mixamo.zip (79GB)
train_depth_shapenet.zip
train_depth_web.zip
 
test_depth.zip (77GB)
train_depth_mixamo_halfres.zip (21G)
train_depth_shapenet_halfres.zip
train_depth_web_halfres.zip
 
test_depth_halfres.zip (20GB)

The _depth_ packages include raw depth arrays, compressed losslessly.

backflow
train_backflow_mixamo.zip (126G)
train_backflow_shapenet.zip
train_backflow_web.zip
 
test_backflow.zip (97GB)
train_backflow_mixamo_halfres.zip (33G)
train_backflow_shapenet_halfres.zip
train_backflow_web_halfres.zip
 
test_backflow_halfres.zip (26GB)

The _backflow_ packages include back flow from frame F(i) to frame F(i-1).

Data Sanity Packages

Data sanity packages include per-frame sanity computed for full resolution frames.
See errata for details.

train_mixamo_sanity.zip (<1M)
train_shapenet_sanity.zip
train_web_sanity.zip
 
test_sanity.zip (<1M)

Styles

Below are the named shading and line styles. Our python utilities can easily filter sequences by style name, if you wish to only train/test on a subset. Below we also include videos of the training styles to give a sense of the styling in action, in the presence of color randomization.

Shading Styles

Line Styles

Stylit Shading Styles (Train)

Blender Shading Styles (Train)

Data Pipeline

Our data generation pipeline is available on our github page.