Curve-Transformer Comparisons

Overall Stats

Model 1 Better: 363
Model 2 Better: 869

Finetuned PVT Curve-Transformer on DUTS IoU Better

Image 1

Ground Truth

missing

Model 1 Predictions

missing
Loss: 220.3747 IoU: 0.8554 FScore: 0.4699

Model 2 Predictions

missing
Loss: 129.2097 IoU: 0.7382 FScore: 0.3628

Image 2

Ground Truth

missing

Model 1 Predictions

missing
Loss: 94.4672 IoU: 0.7872 FScore: 0.3397

Model 2 Predictions

missing
Loss: 100.6299 IoU: 0.6642 FScore: 0.3807

Image 3

Ground Truth

missing

Model 1 Predictions

missing
Loss: 94.5071 IoU: 0.8915 FScore: 0.3166

Model 2 Predictions

missing
Loss: 53.6294 IoU: 0.7625 FScore: 0.2418

Image 4

Ground Truth

missing

Model 1 Predictions

missing
Loss: 171.2201 IoU: 0.7935 FScore: 0.5405

Model 2 Predictions

missing
Loss: 127.2647 IoU: 0.6605 FScore: 0.3575

Image 5

Ground Truth

missing

Model 1 Predictions

missing
Loss: 217.7813 IoU: 0.6043 FScore: 0.1173

Model 2 Predictions

missing
Loss: 201.9362 IoU: 0.4659 FScore: 0.1848

Image 6

Ground Truth

missing

Model 1 Predictions

missing
Loss: 109.8731 IoU: 0.8773 FScore: 0.6028

Model 2 Predictions

missing
Loss: 70.1108 IoU: 0.7374 FScore: 0.3533

Image 7

Ground Truth

missing

Model 1 Predictions

missing
Loss: 61.9728 IoU: 0.9566 FScore: 0.3421

Model 2 Predictions

missing
Loss: 108.9636 IoU: 0.8166 FScore: 0.1552

Image 8

Ground Truth

missing

Model 1 Predictions

missing
Loss: 131.7941 IoU: 0.8233 FScore: 0.5398

Model 2 Predictions

missing
Loss: 109.4513 IoU: 0.6764 FScore: 0.3274

Image 9

Ground Truth

missing

Model 1 Predictions

missing
Loss: 76.0546 IoU: 0.8707 FScore: 0.6585

Model 2 Predictions

missing
Loss: 90.4139 IoU: 0.7231 FScore: 0.5018

Image 10

Ground Truth

missing

Model 1 Predictions

missing
Loss: 86.8700 IoU: 0.8841 FScore: 0.5490

Model 2 Predictions

missing
Loss: 79.9997 IoU: 0.7304 FScore: 0.2948

Image 11

Ground Truth

missing

Model 1 Predictions

missing
Loss: 64.3659 IoU: 0.8875 FScore: 0.6710

Model 2 Predictions

missing
Loss: 74.0322 IoU: 0.7290 FScore: 0.6143

Image 12

Ground Truth

missing

Model 1 Predictions

missing
Loss: 90.0992 IoU: 0.4408 FScore: 0.2872

Model 2 Predictions

missing
Loss: 107.1364 IoU: 0.2653 FScore: 0.2828

Image 13

Ground Truth

missing

Model 1 Predictions

missing
Loss: 62.2937 IoU: 0.8393 FScore: 0.6203

Model 2 Predictions

missing
Loss: 84.0392 IoU: 0.6509 FScore: 0.4863

Image 14

Ground Truth

missing

Model 1 Predictions

missing
Loss: 78.7247 IoU: 0.9012 FScore: 0.6409

Model 2 Predictions

missing
Loss: 85.6891 IoU: 0.6998 FScore: 0.5107

Image 15

Ground Truth

missing

Model 1 Predictions

missing
Loss: 112.4679 IoU: 0.8920 FScore: 0.4308

Model 2 Predictions

missing
Loss: 159.2975 IoU: 0.6882 FScore: 0.0891

Image 16

Ground Truth

missing

Model 1 Predictions

missing
Loss: 207.7043 IoU: 0.7929 FScore: 0.3701

Model 2 Predictions

missing
Loss: 220.1826 IoU: 0.5533 FScore: 0.3051

Image 17

Ground Truth

missing

Model 1 Predictions

missing
Loss: 71.7102 IoU: 0.8193 FScore: 0.2132

Model 2 Predictions

missing
Loss: 121.6999 IoU: 0.5358 FScore: 0.1919

Image 18

Ground Truth

missing

Model 1 Predictions

missing
Loss: 401.3772 IoU: 0.8613 FScore: 0.6274

Model 2 Predictions

missing
Loss: 252.4964 IoU: 0.5689 FScore: 0.3244

Image 19

Ground Truth

missing

Model 1 Predictions

missing
Loss: 97.6647 IoU: 0.9338 FScore: 0.6030

Model 2 Predictions

missing
Loss: 195.3608 IoU: 0.4919 FScore: 0.4747

Image 20

Ground Truth

missing

Model 1 Predictions

missing
Loss: 106.5195 IoU: 0.9058 FScore: 0.5538

Model 2 Predictions

missing
Loss: 279.3788 IoU: 0.2968 FScore: 0.2443

PVT Curve-Transformer IoU Better

Image 1

Ground Truth

missing

Model 1 Predictions

missing
Loss: 149.8014 IoU: 0.6178 FScore: 0.2368

Model 2 Predictions

missing
Loss: 78.7846 IoU: 0.8101 FScore: 0.3887

Image 2

Ground Truth

missing

Model 1 Predictions

missing
Loss: 294.4924 IoU: 0.3219 FScore: 0.3527

Model 2 Predictions

missing
Loss: 44.5576 IoU: 0.8775 FScore: 0.6488

Image 3

Ground Truth

missing

Model 1 Predictions

missing
Loss: 294.4924 IoU: 0.3219 FScore: 0.3527

Model 2 Predictions

missing
Loss: 44.5576 IoU: 0.8775 FScore: 0.6488

Image 4

Ground Truth

missing

Model 1 Predictions

missing
Loss: 361.1366 IoU: 0.2704 FScore: 0.1529

Model 2 Predictions

missing
Loss: 81.2092 IoU: 0.8372 FScore: 0.5533

Image 5

Ground Truth

missing

Model 1 Predictions

missing
Loss: 361.1366 IoU: 0.2704 FScore: 0.1529

Model 2 Predictions

missing
Loss: 81.2092 IoU: 0.8372 FScore: 0.5533

Image 6

Ground Truth

missing

Model 1 Predictions

missing
Loss: 344.1617 IoU: 0.1802 FScore: 0.0940

Model 2 Predictions

missing
Loss: 54.5584 IoU: 0.7527 FScore: 0.5034

Image 7

Ground Truth

missing

Model 1 Predictions

missing
Loss: 344.1617 IoU: 0.1802 FScore: 0.0940

Model 2 Predictions

missing
Loss: 54.5584 IoU: 0.7527 FScore: 0.5034

Image 8

Ground Truth

missing

Model 1 Predictions

missing
Loss: 386.8725 IoU: 0.2864 FScore: 0.1448

Model 2 Predictions

missing
Loss: 47.2232 IoU: 0.8770 FScore: 0.5138

Image 9

Ground Truth

missing

Model 1 Predictions

missing
Loss: 386.8725 IoU: 0.2864 FScore: 0.1448

Model 2 Predictions

missing
Loss: 47.2232 IoU: 0.8770 FScore: 0.5138

Image 10

Ground Truth

missing

Model 1 Predictions

missing
Loss: 400.4592 IoU: 0.2407 FScore: 0.1741

Model 2 Predictions

missing
Loss: 32.5263 IoU: 0.8450 FScore: 0.5862

Image 11

Ground Truth

missing

Model 1 Predictions

missing
Loss: 400.4592 IoU: 0.2407 FScore: 0.1741

Model 2 Predictions

missing
Loss: 32.5263 IoU: 0.8450 FScore: 0.5862

Image 12

Ground Truth

missing

Model 1 Predictions

missing
Loss: 345.6018 IoU: 0.2241 FScore: 0.1695

Model 2 Predictions

missing
Loss: 54.1742 IoU: 0.8332 FScore: 0.6106

Image 13

Ground Truth

missing

Model 1 Predictions

missing
Loss: 345.6018 IoU: 0.2241 FScore: 0.1695

Model 2 Predictions

missing
Loss: 54.1742 IoU: 0.8332 FScore: 0.6106

Image 14

Ground Truth

missing

Model 1 Predictions

missing
Loss: 412.6330 IoU: 0.1567 FScore: 0.0167

Model 2 Predictions

missing
Loss: 45.3330 IoU: 0.7720 FScore: 0.3867

Image 15

Ground Truth

missing

Model 1 Predictions

missing
Loss: 412.6330 IoU: 0.1567 FScore: 0.0167

Model 2 Predictions

missing
Loss: 45.3330 IoU: 0.7720 FScore: 0.3867

Image 16

Ground Truth

missing

Model 1 Predictions

missing
Loss: 606.1941 IoU: 0.1629 FScore: 0.1441

Model 2 Predictions

missing
Loss: 88.1533 IoU: 0.7952 FScore: 0.3705

Image 17

Ground Truth

missing

Model 1 Predictions

missing
Loss: 606.1941 IoU: 0.1629 FScore: 0.1441

Model 2 Predictions

missing
Loss: 88.1533 IoU: 0.7952 FScore: 0.3705

Image 18

Ground Truth

missing

Model 1 Predictions

missing
Loss: 384.9519 IoU: 0.0979 FScore: 0.1111

Model 2 Predictions

missing
Loss: 31.1951 IoU: 0.7338 FScore: 0.6553

Image 19

Ground Truth

missing

Model 1 Predictions

missing
Loss: 384.9519 IoU: 0.0979 FScore: 0.1111

Model 2 Predictions

missing
Loss: 31.1951 IoU: 0.7338 FScore: 0.6553

Image 20

Ground Truth

missing

Model 1 Predictions

missing
Loss: 74.4862 IoU: 0.7277 FScore: 0.2463

Model 2 Predictions

missing
Loss: 67.4383 IoU: 0.7453 FScore: 0.3884

Finetuned PVT Curve-Transformer on DUTS FScore Better

Image 1

Ground Truth

missing

Model 1 Predictions

missing
Loss: 62.2937 IoU: 0.8393 FScore: 0.6203

Model 2 Predictions

missing
Loss: 84.0392 IoU: 0.6509 FScore: 0.4863

Image 2

Ground Truth

missing

Model 1 Predictions

missing
Loss: 68.6969 IoU: 0.9650 FScore: 0.7600

Model 2 Predictions

missing
Loss: 42.9066 IoU: 0.9456 FScore: 0.5957

Image 3

Ground Truth

missing

Model 1 Predictions

missing
Loss: 108.8199 IoU: 0.8946 FScore: 0.7185

Model 2 Predictions

missing
Loss: 64.1249 IoU: 0.8241 FScore: 0.5381

Image 4

Ground Truth

missing

Model 1 Predictions

missing
Loss: 75.1953 IoU: 0.9381 FScore: 0.3583

Model 2 Predictions

missing
Loss: 70.4366 IoU: 0.8855 FScore: 0.1736

Image 5

Ground Truth

missing

Model 1 Predictions

missing
Loss: 134.1852 IoU: 0.8918 FScore: 0.5731

Model 2 Predictions

missing
Loss: 105.7978 IoU: 0.8332 FScore: 0.3739

Image 6

Ground Truth

missing

Model 1 Predictions

missing
Loss: 167.4308 IoU: 0.9203 FScore: 0.7332

Model 2 Predictions

missing
Loss: 87.0333 IoU: 0.8805 FScore: 0.5269

Image 7

Ground Truth

missing

Model 1 Predictions

missing
Loss: 131.7941 IoU: 0.8233 FScore: 0.5398

Model 2 Predictions

missing
Loss: 109.4513 IoU: 0.6764 FScore: 0.3274

Image 8

Ground Truth

missing

Model 1 Predictions

missing
Loss: 30.9558 IoU: 0.9449 FScore: 0.7013

Model 2 Predictions

missing
Loss: 22.8890 IoU: 0.9123 FScore: 0.4644

Image 9

Ground Truth

missing

Model 1 Predictions

missing
Loss: 85.2566 IoU: 0.8854 FScore: 0.5659

Model 2 Predictions

missing
Loss: 48.5710 IoU: 0.7935 FScore: 0.3274

Image 10

Ground Truth

missing

Model 1 Predictions

missing
Loss: 109.8731 IoU: 0.8773 FScore: 0.6028

Model 2 Predictions

missing
Loss: 70.1108 IoU: 0.7374 FScore: 0.3533

Image 11

Ground Truth

missing

Model 1 Predictions

missing
Loss: 76.2800 IoU: 0.8780 FScore: 0.4671

Model 2 Predictions

missing
Loss: 66.7473 IoU: 0.7814 FScore: 0.2141

Image 12

Ground Truth

missing

Model 1 Predictions

missing
Loss: 86.8700 IoU: 0.8841 FScore: 0.5490

Model 2 Predictions

missing
Loss: 79.9997 IoU: 0.7304 FScore: 0.2948

Image 13

Ground Truth

missing

Model 1 Predictions

missing
Loss: 115.4239 IoU: 0.8717 FScore: 0.5143

Model 2 Predictions

missing
Loss: 96.7315 IoU: 0.8619 FScore: 0.2574

Image 14

Ground Truth

missing

Model 1 Predictions

missing
Loss: 90.2709 IoU: 0.8952 FScore: 0.6170

Model 2 Predictions

missing
Loss: 61.4043 IoU: 0.8146 FScore: 0.3301

Image 15

Ground Truth

missing

Model 1 Predictions

missing
Loss: 401.3772 IoU: 0.8613 FScore: 0.6274

Model 2 Predictions

missing
Loss: 252.4964 IoU: 0.5689 FScore: 0.3244

Image 16

Ground Truth

missing

Model 1 Predictions

missing
Loss: 108.0340 IoU: 0.9543 FScore: 0.6007

Model 2 Predictions

missing
Loss: 133.1359 IoU: 0.9206 FScore: 0.2936

Image 17

Ground Truth

missing

Model 1 Predictions

missing
Loss: 106.5195 IoU: 0.9058 FScore: 0.5538

Model 2 Predictions

missing
Loss: 279.3788 IoU: 0.2968 FScore: 0.2443

Image 18

Ground Truth

missing

Model 1 Predictions

missing
Loss: 112.4679 IoU: 0.8920 FScore: 0.4308

Model 2 Predictions

missing
Loss: 159.2975 IoU: 0.6882 FScore: 0.0891

Image 19

Ground Truth

missing

Model 1 Predictions

missing
Loss: 71.7449 IoU: 0.9499 FScore: 0.4640

Model 2 Predictions

missing
Loss: 79.7399 IoU: 0.8410 FScore: 0.0192

Image 20

Ground Truth

missing

Model 1 Predictions

missing
Loss: 45.6001 IoU: 0.9751 FScore: 0.9049

Model 2 Predictions

missing
Loss: 38.2325 IoU: 0.9189 FScore: 0.4133

PVT Curve-Transformer FScore Better

Image 1

Ground Truth

missing

Model 1 Predictions

missing
Loss: 50.9340 IoU: 0.9610 FScore: 0.4314

Model 2 Predictions

missing
Loss: 35.1132 IoU: 0.9649 FScore: 0.4326

Image 2

Ground Truth

missing

Model 1 Predictions

missing
Loss: 63.7955 IoU: 0.9577 FScore: 0.7860

Model 2 Predictions

missing
Loss: 22.7252 IoU: 0.9620 FScore: 0.7873

Image 3

Ground Truth

missing

Model 1 Predictions

missing
Loss: 95.0781 IoU: 0.9178 FScore: 0.7294

Model 2 Predictions

missing
Loss: 32.2107 IoU: 0.9462 FScore: 0.7046

Image 4

Ground Truth

missing

Model 1 Predictions

missing
Loss: 54.5905 IoU: 0.9491 FScore: 0.7015

Model 2 Predictions

missing
Loss: 42.3707 IoU: 0.9510 FScore: 0.6609

Image 5

Ground Truth

missing

Model 1 Predictions

missing
Loss: 38.6005 IoU: 0.8959 FScore: 0.2995

Model 2 Predictions

missing
Loss: 22.3425 IoU: 0.9316 FScore: 0.2532

Image 6

Ground Truth

missing

Model 1 Predictions

missing
Loss: 175.5990 IoU: 0.6108 FScore: 0.1611

Model 2 Predictions

missing
Loss: 56.9160 IoU: 0.7909 FScore: 0.2088

Image 7

Ground Truth

missing

Model 1 Predictions

missing
Loss: 54.1671 IoU: 0.9499 FScore: 0.4619

Model 2 Predictions

missing
Loss: 25.8544 IoU: 0.9519 FScore: 0.4129

Image 8

Ground Truth

missing

Model 1 Predictions

missing
Loss: 38.0484 IoU: 0.9338 FScore: 0.6363

Model 2 Predictions

missing
Loss: 20.0535 IoU: 0.9530 FScore: 0.6856

Image 9

Ground Truth

missing

Model 1 Predictions

missing
Loss: 49.2183 IoU: 0.9499 FScore: 0.4460

Model 2 Predictions

missing
Loss: 27.3474 IoU: 0.9537 FScore: 0.3703

Image 10

Ground Truth

missing

Model 1 Predictions

missing
Loss: 35.1385 IoU: 0.9351 FScore: 0.5817

Model 2 Predictions

missing
Loss: 22.3235 IoU: 0.9481 FScore: 0.6575

Image 11

Ground Truth

missing

Model 1 Predictions

missing
Loss: 91.6834 IoU: 0.9222 FScore: 0.2750

Model 2 Predictions

missing
Loss: 28.5702 IoU: 0.9404 FScore: 0.3584

Image 12

Ground Truth

missing

Model 1 Predictions

missing
Loss: 41.6670 IoU: 0.9492 FScore: 0.5552

Model 2 Predictions

missing
Loss: 21.6234 IoU: 0.9501 FScore: 0.4683

Image 13

Ground Truth

missing

Model 1 Predictions

missing
Loss: 70.5849 IoU: 0.9640 FScore: 0.4799

Model 2 Predictions

missing
Loss: 25.9990 IoU: 0.9651 FScore: 0.5716

Image 14

Ground Truth

missing

Model 1 Predictions

missing
Loss: 40.4967 IoU: 0.9397 FScore: 0.5461

Model 2 Predictions

missing
Loss: 43.5062 IoU: 0.9426 FScore: 0.6551

Image 15

Ground Truth

missing

Model 1 Predictions

missing
Loss: 50.2189 IoU: 0.9468 FScore: 0.6700

Model 2 Predictions

missing
Loss: 31.9206 IoU: 0.9593 FScore: 0.8268

Image 16

Ground Truth

missing

Model 1 Predictions

missing
Loss: 130.4453 IoU: 0.6648 FScore: 0.3184

Model 2 Predictions

missing
Loss: 71.1478 IoU: 0.8107 FScore: 0.4787

Image 17

Ground Truth

missing

Model 1 Predictions

missing
Loss: 52.7494 IoU: 0.9553 FScore: 0.4318

Model 2 Predictions

missing
Loss: 35.9176 IoU: 0.9677 FScore: 0.6266

Image 18

Ground Truth

missing

Model 1 Predictions

missing
Loss: 94.5997 IoU: 0.9084 FScore: 0.1551

Model 2 Predictions

missing
Loss: 29.8650 IoU: 0.9408 FScore: 0.3504

Image 19

Ground Truth

missing

Model 1 Predictions

missing
Loss: 85.7333 IoU: 0.9259 FScore: 0.4252

Model 2 Predictions

missing
Loss: 49.0568 IoU: 0.9413 FScore: 0.6283

Image 20

Ground Truth

missing

Model 1 Predictions

missing
Loss: 256.5714 IoU: 0.4577 FScore: 0.3847

Model 2 Predictions

missing
Loss: 26.3020 IoU: 0.8903 FScore: 0.7205