Curve-Transformer Comparisons

Overall Stats

Model 1 Better: 1106
Model 2 Better: 306

PVT Curve-Transformer on City+ADE IoU Better

Image 1

Ground Truth

missing

Model 1 Predictions

missing
Loss: 19.8570 IoU: 0.8967 FScore: 0.7797

Model 2 Predictions

missing
Loss: 111.7583 IoU: 0.6221 FScore: 0.6458

Image 2

Ground Truth

missing

Model 1 Predictions

missing
Loss: 41.9689 IoU: 0.7347 FScore: 0.3063

Model 2 Predictions

missing
Loss: 110.2019 IoU: 0.4599 FScore: 0.1108

Image 3

Ground Truth

missing

Model 1 Predictions

missing
Loss: 46.0475 IoU: 0.7159 FScore: 0.6703

Model 2 Predictions

missing
Loss: 89.9993 IoU: 0.4360 FScore: 0.3902

Image 4

Ground Truth

missing

Model 1 Predictions

missing
Loss: 128.9013 IoU: 0.4749 FScore: 0.3070

Model 2 Predictions

missing
Loss: 234.0183 IoU: 0.1904 FScore: 0.1804

Image 5

Ground Truth

missing

Model 1 Predictions

missing
Loss: 104.8244 IoU: 0.8201 FScore: 0.4948

Model 2 Predictions

missing
Loss: 171.6557 IoU: 0.5058 FScore: 0.2184

Image 6

Ground Truth

missing

Model 1 Predictions

missing
Loss: 36.1525 IoU: 0.8196 FScore: 0.2922

Model 2 Predictions

missing
Loss: 184.4536 IoU: 0.5047 FScore: 0.1892

Image 7

Ground Truth

missing

Model 1 Predictions

missing
Loss: 84.5961 IoU: 0.5374 FScore: 0.1936

Model 2 Predictions

missing
Loss: 352.3724 IoU: 0.2208 FScore: 0.1977

Image 8

Ground Truth

missing

Model 1 Predictions

missing
Loss: 105.0652 IoU: 0.5813 FScore: 0.3045

Model 2 Predictions

missing
Loss: 301.2200 IoU: 0.2599 FScore: 0.2196

Image 9

Ground Truth

missing

Model 1 Predictions

missing
Loss: 97.4951 IoU: 0.5424 FScore: 0.4620

Model 2 Predictions

missing
Loss: 364.7401 IoU: 0.2198 FScore: 0.1622

Image 10

Ground Truth

missing

Model 1 Predictions

missing
Loss: 78.1806 IoU: 0.6814 FScore: 0.4307

Model 2 Predictions

missing
Loss: 221.0998 IoU: 0.3472 FScore: 0.2261

Image 11

Ground Truth

missing

Model 1 Predictions

missing
Loss: 73.3616 IoU: 0.8144 FScore: 0.7017

Model 2 Predictions

missing
Loss: 246.8324 IoU: 0.4487 FScore: 0.2600

Image 12

Ground Truth

missing

Model 1 Predictions

missing
Loss: 63.0224 IoU: 0.8518 FScore: 0.4787

Model 2 Predictions

missing
Loss: 233.9413 IoU: 0.4821 FScore: 0.1342

Image 13

Ground Truth

missing

Model 1 Predictions

missing
Loss: 73.0036 IoU: 0.5777 FScore: 0.3908

Model 2 Predictions

missing
Loss: 260.3463 IoU: 0.2077 FScore: 0.2143

Image 14

Ground Truth

missing

Model 1 Predictions

missing
Loss: 21.9608 IoU: 0.8832 FScore: 0.4879

Model 2 Predictions

missing
Loss: 143.0253 IoU: 0.5067 FScore: 0.1959

Image 15

Ground Truth

missing

Model 1 Predictions

missing
Loss: 106.2854 IoU: 0.8001 FScore: 0.5666

Model 2 Predictions

missing
Loss: 236.4173 IoU: 0.3522 FScore: 0.1417

Image 16

Ground Truth

missing

Model 1 Predictions

missing
Loss: 36.1922 IoU: 0.8094 FScore: 0.5917

Model 2 Predictions

missing
Loss: 359.8212 IoU: 0.3490 FScore: 0.1966

Image 17

Ground Truth

missing

Model 1 Predictions

missing
Loss: 78.2921 IoU: 0.8205 FScore: 0.4916

Model 2 Predictions

missing
Loss: 384.2097 IoU: 0.3411 FScore: 0.2452

Image 18

Ground Truth

missing

Model 1 Predictions

missing
Loss: 53.5377 IoU: 0.7901 FScore: 0.4861

Model 2 Predictions

missing
Loss: 301.4831 IoU: 0.2594 FScore: 0.2018

Image 19

Ground Truth

missing

Model 1 Predictions

missing
Loss: 28.8302 IoU: 0.6598 FScore: 0.5203

Model 2 Predictions

missing
Loss: 456.0244 IoU: 0.0544 FScore: 0.0910

Image 20

Ground Truth

missing

Model 1 Predictions

missing
Loss: 18.7226 IoU: 0.7847 FScore: 0.5912

Model 2 Predictions

missing
Loss: 366.3667 IoU: 0.1351 FScore: 0.3000

Finetuned On DUTS IoU Better

Image 1

Ground Truth

missing

Model 1 Predictions

missing
Loss: 97.0078 IoU: 0.8238 FScore: 0.3760

Model 2 Predictions

missing
Loss: 97.9165 IoU: 0.8732 FScore: 0.5399

Image 2

Ground Truth

missing

Model 1 Predictions

missing
Loss: 203.1443 IoU: 0.5903 FScore: 0.2756

Model 2 Predictions

missing
Loss: 221.5183 IoU: 0.7574 FScore: 0.2350

Image 3

Ground Truth

missing

Model 1 Predictions

missing
Loss: 203.1443 IoU: 0.5903 FScore: 0.2756

Model 2 Predictions

missing
Loss: 221.5183 IoU: 0.7574 FScore: 0.2350

Image 4

Ground Truth

missing

Model 1 Predictions

missing
Loss: 167.7404 IoU: 0.2825 FScore: 0.1789

Model 2 Predictions

missing
Loss: 221.2976 IoU: 0.4622 FScore: 0.4095

Image 5

Ground Truth

missing

Model 1 Predictions

missing
Loss: 167.7404 IoU: 0.2825 FScore: 0.1789

Model 2 Predictions

missing
Loss: 221.2976 IoU: 0.4622 FScore: 0.4095

Image 6

Ground Truth

missing

Model 1 Predictions

missing
Loss: 118.2431 IoU: 0.7050 FScore: 0.3661

Model 2 Predictions

missing
Loss: 36.4914 IoU: 0.8894 FScore: 0.4967

Image 7

Ground Truth

missing

Model 1 Predictions

missing
Loss: 118.2431 IoU: 0.7050 FScore: 0.3661

Model 2 Predictions

missing
Loss: 36.4914 IoU: 0.8894 FScore: 0.4967

Image 8

Ground Truth

missing

Model 1 Predictions

missing
Loss: 117.1888 IoU: 0.7051 FScore: 0.5656

Model 2 Predictions

missing
Loss: 144.2233 IoU: 0.9071 FScore: 0.5413

Image 9

Ground Truth

missing

Model 1 Predictions

missing
Loss: 117.1888 IoU: 0.7051 FScore: 0.5656

Model 2 Predictions

missing
Loss: 144.2233 IoU: 0.9071 FScore: 0.5413

Image 10

Ground Truth

missing

Model 1 Predictions

missing
Loss: 226.2232 IoU: 0.5265 FScore: 0.1086

Model 2 Predictions

missing
Loss: 79.0418 IoU: 0.8066 FScore: 0.1890

Image 11

Ground Truth

missing

Model 1 Predictions

missing
Loss: 226.2232 IoU: 0.5265 FScore: 0.1086

Model 2 Predictions

missing
Loss: 79.0418 IoU: 0.8066 FScore: 0.1890

Image 12

Ground Truth

missing

Model 1 Predictions

missing
Loss: 136.6783 IoU: 0.3492 FScore: 0.1253

Model 2 Predictions

missing
Loss: 128.5331 IoU: 0.6635 FScore: 0.3409

Image 13

Ground Truth

missing

Model 1 Predictions

missing
Loss: 136.6783 IoU: 0.3492 FScore: 0.1253

Model 2 Predictions

missing
Loss: 128.5331 IoU: 0.6635 FScore: 0.3409

Image 14

Ground Truth

missing

Model 1 Predictions

missing
Loss: 286.1223 IoU: 0.4506 FScore: 0.3574

Model 2 Predictions

missing
Loss: 166.0528 IoU: 0.8688 FScore: 0.5068

Image 15

Ground Truth

missing

Model 1 Predictions

missing
Loss: 286.1223 IoU: 0.4506 FScore: 0.3574

Model 2 Predictions

missing
Loss: 166.0528 IoU: 0.8688 FScore: 0.5068

Image 16

Ground Truth

missing

Model 1 Predictions

missing
Loss: 217.9604 IoU: 0.3237 FScore: 0.2381

Model 2 Predictions

missing
Loss: 93.2361 IoU: 0.8904 FScore: 0.4974

Image 17

Ground Truth

missing

Model 1 Predictions

missing
Loss: 217.9604 IoU: 0.3237 FScore: 0.2381

Model 2 Predictions

missing
Loss: 93.2361 IoU: 0.8904 FScore: 0.4974

Image 18

Ground Truth

missing

Model 1 Predictions

missing
Loss: 400.8646 IoU: 0.0251 FScore: 0.2515

Model 2 Predictions

missing
Loss: 282.8485 IoU: 0.7928 FScore: 0.3753

Image 19

Ground Truth

missing

Model 1 Predictions

missing
Loss: 400.8646 IoU: 0.0251 FScore: 0.2515

Model 2 Predictions

missing
Loss: 282.8485 IoU: 0.7928 FScore: 0.3753

Image 20

Ground Truth

missing

Model 1 Predictions

missing
Loss: 97.0078 IoU: 0.8238 FScore: 0.3760

Model 2 Predictions

missing
Loss: 97.9165 IoU: 0.8732 FScore: 0.5399

PVT Curve-Transformer on City+ADE FScore Better

Image 1

Ground Truth

missing

Model 1 Predictions

missing
Loss: 11.6593 IoU: 0.9721 FScore: 0.9162

Model 2 Predictions

missing
Loss: 33.8610 IoU: 0.9402 FScore: 0.6589

Image 2

Ground Truth

missing

Model 1 Predictions

missing
Loss: 87.2009 IoU: 0.7101 FScore: 0.4659

Model 2 Predictions

missing
Loss: 148.0888 IoU: 0.4649 FScore: 0.2082

Image 3

Ground Truth

missing

Model 1 Predictions

missing
Loss: 22.2615 IoU: 0.9286 FScore: 0.8181

Model 2 Predictions

missing
Loss: 68.1757 IoU: 0.7290 FScore: 0.5473

Image 4

Ground Truth

missing

Model 1 Predictions

missing
Loss: 18.7882 IoU: 0.9787 FScore: 0.6897

Model 2 Predictions

missing
Loss: 56.9724 IoU: 0.9674 FScore: 0.4181

Image 5

Ground Truth

missing

Model 1 Predictions

missing
Loss: 40.6887 IoU: 0.9678 FScore: 0.4774

Model 2 Predictions

missing
Loss: 52.8246 IoU: 0.9432 FScore: 0.2057

Image 6

Ground Truth

missing

Model 1 Predictions

missing
Loss: 104.8244 IoU: 0.8201 FScore: 0.4948

Model 2 Predictions

missing
Loss: 171.6557 IoU: 0.5058 FScore: 0.2184

Image 7

Ground Truth

missing

Model 1 Predictions

missing
Loss: 46.0475 IoU: 0.7159 FScore: 0.6703

Model 2 Predictions

missing
Loss: 89.9993 IoU: 0.4360 FScore: 0.3902

Image 8

Ground Truth

missing

Model 1 Predictions

missing
Loss: 53.5377 IoU: 0.7901 FScore: 0.4861

Model 2 Predictions

missing
Loss: 301.4831 IoU: 0.2594 FScore: 0.2018

Image 9

Ground Truth

missing

Model 1 Predictions

missing
Loss: 18.7226 IoU: 0.7847 FScore: 0.5912

Model 2 Predictions

missing
Loss: 366.3667 IoU: 0.1351 FScore: 0.3000

Image 10

Ground Truth

missing

Model 1 Predictions

missing
Loss: 21.9608 IoU: 0.8832 FScore: 0.4879

Model 2 Predictions

missing
Loss: 143.0253 IoU: 0.5067 FScore: 0.1959

Image 11

Ground Truth

missing

Model 1 Predictions

missing
Loss: 51.4774 IoU: 0.8009 FScore: 0.5606

Model 2 Predictions

missing
Loss: 94.8960 IoU: 0.5728 FScore: 0.2654

Image 12

Ground Truth

missing

Model 1 Predictions

missing
Loss: 97.4951 IoU: 0.5424 FScore: 0.4620

Model 2 Predictions

missing
Loss: 364.7401 IoU: 0.2198 FScore: 0.1622

Image 13

Ground Truth

missing

Model 1 Predictions

missing
Loss: 61.8982 IoU: 0.8113 FScore: 0.7197

Model 2 Predictions

missing
Loss: 180.6098 IoU: 0.5496 FScore: 0.3815

Image 14

Ground Truth

missing

Model 1 Predictions

missing
Loss: 63.0224 IoU: 0.8518 FScore: 0.4787

Model 2 Predictions

missing
Loss: 233.9413 IoU: 0.4821 FScore: 0.1342

Image 15

Ground Truth

missing

Model 1 Predictions

missing
Loss: 36.1922 IoU: 0.8094 FScore: 0.5917

Model 2 Predictions

missing
Loss: 359.8212 IoU: 0.3490 FScore: 0.1966

Image 16

Ground Truth

missing

Model 1 Predictions

missing
Loss: 6.3130 IoU: 0.9521 FScore: 0.8861

Model 2 Predictions

missing
Loss: 24.5601 IoU: 0.8744 FScore: 0.4743

Image 17

Ground Truth

missing

Model 1 Predictions

missing
Loss: 27.5542 IoU: 0.9551 FScore: 0.5979

Model 2 Predictions

missing
Loss: 50.0159 IoU: 0.9119 FScore: 0.1794

Image 18

Ground Truth

missing

Model 1 Predictions

missing
Loss: 106.2854 IoU: 0.8001 FScore: 0.5666

Model 2 Predictions

missing
Loss: 236.4173 IoU: 0.3522 FScore: 0.1417

Image 19

Ground Truth

missing

Model 1 Predictions

missing
Loss: 28.8302 IoU: 0.6598 FScore: 0.5203

Model 2 Predictions

missing
Loss: 456.0244 IoU: 0.0544 FScore: 0.0910

Image 20

Ground Truth

missing

Model 1 Predictions

missing
Loss: 73.3616 IoU: 0.8144 FScore: 0.7017

Model 2 Predictions

missing
Loss: 246.8324 IoU: 0.4487 FScore: 0.2600

Finetuned On DUTS FScore Better

Image 1

Ground Truth

missing

Model 1 Predictions

missing
Loss: 30.9133 IoU: 0.9178 FScore: 0.5651

Model 2 Predictions

missing
Loss: 28.5393 IoU: 0.9183 FScore: 0.5654

Image 2

Ground Truth

missing

Model 1 Predictions

missing
Loss: 23.3813 IoU: 0.9561 FScore: 0.7593

Model 2 Predictions

missing
Loss: 42.1991 IoU: 0.9571 FScore: 0.7516

Image 3

Ground Truth

missing

Model 1 Predictions

missing
Loss: 107.2913 IoU: 0.7479 FScore: 0.4501

Model 2 Predictions

missing
Loss: 157.0876 IoU: 0.8134 FScore: 0.4415

Image 4

Ground Truth

missing

Model 1 Predictions

missing
Loss: 47.9816 IoU: 0.9525 FScore: 0.8456

Model 2 Predictions

missing
Loss: 70.4400 IoU: 0.9551 FScore: 0.8280

Image 5

Ground Truth

missing

Model 1 Predictions

missing
Loss: 29.3264 IoU: 0.8661 FScore: 0.5912

Model 2 Predictions

missing
Loss: 34.6573 IoU: 0.8767 FScore: 0.6116

Image 6

Ground Truth

missing

Model 1 Predictions

missing
Loss: 25.0813 IoU: 0.9360 FScore: 0.2074

Model 2 Predictions

missing
Loss: 44.0615 IoU: 0.9386 FScore: 0.1804

Image 7

Ground Truth

missing

Model 1 Predictions

missing
Loss: 102.0215 IoU: 0.7946 FScore: 0.4800

Model 2 Predictions

missing
Loss: 39.0370 IoU: 0.8098 FScore: 0.5090

Image 8

Ground Truth

missing

Model 1 Predictions

missing
Loss: 26.5822 IoU: 0.9640 FScore: 0.7845

Model 2 Predictions

missing
Loss: 30.0428 IoU: 0.9645 FScore: 0.7518

Image 9

Ground Truth

missing

Model 1 Predictions

missing
Loss: 44.2803 IoU: 0.8881 FScore: 0.4619

Model 2 Predictions

missing
Loss: 67.9982 IoU: 0.8995 FScore: 0.5339

Image 10

Ground Truth

missing

Model 1 Predictions

missing
Loss: 34.9045 IoU: 0.8844 FScore: 0.5577

Model 2 Predictions

missing
Loss: 124.0053 IoU: 0.9010 FScore: 0.6388

Image 11

Ground Truth

missing

Model 1 Predictions

missing
Loss: 23.9906 IoU: 0.9657 FScore: 0.7685

Model 2 Predictions

missing
Loss: 44.0392 IoU: 0.9673 FScore: 0.8527

Image 12

Ground Truth

missing

Model 1 Predictions

missing
Loss: 11.7914 IoU: 0.9709 FScore: 0.8151

Model 2 Predictions

missing
Loss: 35.8474 IoU: 0.9715 FScore: 0.9010

Image 13

Ground Truth

missing

Model 1 Predictions

missing
Loss: 15.6636 IoU: 0.9607 FScore: 0.4908

Model 2 Predictions

missing
Loss: 39.2537 IoU: 0.9610 FScore: 0.3924

Image 14

Ground Truth

missing

Model 1 Predictions

missing
Loss: 21.3256 IoU: 0.8738 FScore: 0.4758

Model 2 Predictions

missing
Loss: 109.1607 IoU: 0.8768 FScore: 0.5808

Image 15

Ground Truth

missing

Model 1 Predictions

missing
Loss: 53.8960 IoU: 0.8682 FScore: 0.4275

Model 2 Predictions

missing
Loss: 96.2966 IoU: 0.8797 FScore: 0.5489

Image 16

Ground Truth

missing

Model 1 Predictions

missing
Loss: 85.9277 IoU: 0.8455 FScore: 0.3834

Model 2 Predictions

missing
Loss: 115.5234 IoU: 0.8968 FScore: 0.5062

Image 17

Ground Truth

missing

Model 1 Predictions

missing
Loss: 42.2540 IoU: 0.8247 FScore: 0.3913

Model 2 Predictions

missing
Loss: 91.1971 IoU: 0.8636 FScore: 0.5464

Image 18

Ground Truth

missing

Model 1 Predictions

missing
Loss: 19.5912 IoU: 0.9100 FScore: 0.7180

Model 2 Predictions

missing
Loss: 23.6873 IoU: 0.9370 FScore: 0.8804

Image 19

Ground Truth

missing

Model 1 Predictions

missing
Loss: 55.3886 IoU: 0.9193 FScore: 0.4874

Model 2 Predictions

missing
Loss: 56.3142 IoU: 0.9203 FScore: 0.3246

Image 20

Ground Truth

missing

Model 1 Predictions

missing
Loss: 17.7351 IoU: 0.9444 FScore: 0.5542

Model 2 Predictions

missing
Loss: 33.4564 IoU: 0.9517 FScore: 0.7248