Curve-Transformer Comparisons

Overall Stats

Model 1 Better: 147
Model 2 Better: 1265

Finetuned PVT Curve-Transformer on DUTS IoU Better

Image 1

Ground Truth

missing

Model 1 Predictions

missing
Loss: 120.4077 IoU: 0.8256 FScore: 0.4874

Model 2 Predictions

missing
Loss: 60.0207 IoU: 0.7802 FScore: 0.4497

Image 2

Ground Truth

missing

Model 1 Predictions

missing
Loss: 206.7721 IoU: 0.7039 FScore: 0.2263

Model 2 Predictions

missing
Loss: 114.8490 IoU: 0.6519 FScore: 0.2532

Image 3

Ground Truth

missing

Model 1 Predictions

missing
Loss: 101.4136 IoU: 0.8347 FScore: 0.5881

Model 2 Predictions

missing
Loss: 48.1062 IoU: 0.7818 FScore: 0.6141

Image 4

Ground Truth

missing

Model 1 Predictions

missing
Loss: 98.6349 IoU: 0.8662 FScore: 0.5392

Model 2 Predictions

missing
Loss: 51.8932 IoU: 0.8131 FScore: 0.4241

Image 5

Ground Truth

missing

Model 1 Predictions

missing
Loss: 79.1411 IoU: 0.8820 FScore: 0.4946

Model 2 Predictions

missing
Loss: 51.2696 IoU: 0.8261 FScore: 0.4383

Image 6

Ground Truth

missing

Model 1 Predictions

missing
Loss: 145.6529 IoU: 0.8751 FScore: 0.5891

Model 2 Predictions

missing
Loss: 43.0784 IoU: 0.8144 FScore: 0.5538

Image 7

Ground Truth

missing

Model 1 Predictions

missing
Loss: 78.3939 IoU: 0.7972 FScore: 0.3628

Model 2 Predictions

missing
Loss: 91.0869 IoU: 0.7355 FScore: 0.5160

Image 8

Ground Truth

missing

Model 1 Predictions

missing
Loss: 233.3802 IoU: 0.6657 FScore: 0.1412

Model 2 Predictions

missing
Loss: 180.8559 IoU: 0.6015 FScore: 0.1091

Image 9

Ground Truth

missing

Model 1 Predictions

missing
Loss: 113.6596 IoU: 0.9047 FScore: 0.5269

Model 2 Predictions

missing
Loss: 86.9173 IoU: 0.8298 FScore: 0.3907

Image 10

Ground Truth

missing

Model 1 Predictions

missing
Loss: 76.6633 IoU: 0.9196 FScore: 0.5318

Model 2 Predictions

missing
Loss: 81.8322 IoU: 0.8416 FScore: 0.3589

Image 11

Ground Truth

missing

Model 1 Predictions

missing
Loss: 129.9163 IoU: 0.8011 FScore: 0.2080

Model 2 Predictions

missing
Loss: 52.5453 IoU: 0.7192 FScore: 0.1733

Image 12

Ground Truth

missing

Model 1 Predictions

missing
Loss: 198.1376 IoU: 0.8632 FScore: 0.4536

Model 2 Predictions

missing
Loss: 111.8595 IoU: 0.7795 FScore: 0.4036

Image 13

Ground Truth

missing

Model 1 Predictions

missing
Loss: 79.3199 IoU: 0.8924 FScore: 0.5993

Model 2 Predictions

missing
Loss: 47.4086 IoU: 0.8036 FScore: 0.3804

Image 14

Ground Truth

missing

Model 1 Predictions

missing
Loss: 183.0923 IoU: 0.8360 FScore: 0.5770

Model 2 Predictions

missing
Loss: 100.8706 IoU: 0.7300 FScore: 0.4485

Image 15

Ground Truth

missing

Model 1 Predictions

missing
Loss: 62.1398 IoU: 0.7817 FScore: 0.5562

Model 2 Predictions

missing
Loss: 78.1685 IoU: 0.6709 FScore: 0.5376

Image 16

Ground Truth

missing

Model 1 Predictions

missing
Loss: 70.0382 IoU: 0.8708 FScore: 0.4721

Model 2 Predictions

missing
Loss: 60.8059 IoU: 0.7588 FScore: 0.6155

Image 17

Ground Truth

missing

Model 1 Predictions

missing
Loss: 65.0248 IoU: 0.8910 FScore: 0.3126

Model 2 Predictions

missing
Loss: 73.8313 IoU: 0.7608 FScore: 0.3696

Image 18

Ground Truth

missing

Model 1 Predictions

missing
Loss: 121.9034 IoU: 0.9011 FScore: 0.6674

Model 2 Predictions

missing
Loss: 104.3836 IoU: 0.7667 FScore: 0.5692

Image 19

Ground Truth

missing

Model 1 Predictions

missing
Loss: 97.3220 IoU: 0.9001 FScore: 0.3437

Model 2 Predictions

missing
Loss: 106.0422 IoU: 0.7264 FScore: 0.1688

Image 20

Ground Truth

missing

Model 1 Predictions

missing
Loss: 365.2896 IoU: 0.8652 FScore: 0.6348

Model 2 Predictions

missing
Loss: 252.1658 IoU: 0.5490 FScore: 0.3527

PVT Curve-Transformer IoU Better

Image 1

Ground Truth

missing

Model 1 Predictions

missing
Loss: 320.6092 IoU: 0.2454 FScore: 0.1065

Model 2 Predictions

missing
Loss: 53.2212 IoU: 0.7917 FScore: 0.4464

Image 2

Ground Truth

missing

Model 1 Predictions

missing
Loss: 365.3661 IoU: 0.2896 FScore: 0.1995

Model 2 Predictions

missing
Loss: 38.6447 IoU: 0.9009 FScore: 0.5714

Image 3

Ground Truth

missing

Model 1 Predictions

missing
Loss: 365.3661 IoU: 0.2896 FScore: 0.1995

Model 2 Predictions

missing
Loss: 38.6447 IoU: 0.9009 FScore: 0.5714

Image 4

Ground Truth

missing

Model 1 Predictions

missing
Loss: 456.7726 IoU: 0.2038 FScore: 0.1129

Model 2 Predictions

missing
Loss: 107.1516 IoU: 0.8152 FScore: 0.3879

Image 5

Ground Truth

missing

Model 1 Predictions

missing
Loss: 456.7726 IoU: 0.2038 FScore: 0.1129

Model 2 Predictions

missing
Loss: 107.1516 IoU: 0.8152 FScore: 0.3879

Image 6

Ground Truth

missing

Model 1 Predictions

missing
Loss: 338.6018 IoU: 0.2797 FScore: 0.2586

Model 2 Predictions

missing
Loss: 27.7167 IoU: 0.9087 FScore: 0.8234

Image 7

Ground Truth

missing

Model 1 Predictions

missing
Loss: 338.6018 IoU: 0.2797 FScore: 0.2586

Model 2 Predictions

missing
Loss: 27.7167 IoU: 0.9087 FScore: 0.8234

Image 8

Ground Truth

missing

Model 1 Predictions

missing
Loss: 299.0397 IoU: 0.1852 FScore: 0.0849

Model 2 Predictions

missing
Loss: 28.1620 IoU: 0.8285 FScore: 0.6337

Image 9

Ground Truth

missing

Model 1 Predictions

missing
Loss: 299.0397 IoU: 0.1852 FScore: 0.0849

Model 2 Predictions

missing
Loss: 28.1620 IoU: 0.8285 FScore: 0.6337

Image 10

Ground Truth

missing

Model 1 Predictions

missing
Loss: 300.6630 IoU: 0.1908 FScore: 0.0883

Model 2 Predictions

missing
Loss: 43.4104 IoU: 0.8347 FScore: 0.6954

Image 11

Ground Truth

missing

Model 1 Predictions

missing
Loss: 300.6630 IoU: 0.1908 FScore: 0.0883

Model 2 Predictions

missing
Loss: 43.4104 IoU: 0.8347 FScore: 0.6954

Image 12

Ground Truth

missing

Model 1 Predictions

missing
Loss: 435.3043 IoU: 0.0623 FScore: 0.0919

Model 2 Predictions

missing
Loss: 17.4486 IoU: 0.7090 FScore: 0.7928

Image 13

Ground Truth

missing

Model 1 Predictions

missing
Loss: 435.3043 IoU: 0.0623 FScore: 0.0919

Model 2 Predictions

missing
Loss: 17.4486 IoU: 0.7090 FScore: 0.7928

Image 14

Ground Truth

missing

Model 1 Predictions

missing
Loss: 455.0987 IoU: 0.1855 FScore: 0.0957

Model 2 Predictions

missing
Loss: 17.6159 IoU: 0.8687 FScore: 0.6613

Image 15

Ground Truth

missing

Model 1 Predictions

missing
Loss: 455.0987 IoU: 0.1855 FScore: 0.0957

Model 2 Predictions

missing
Loss: 17.6159 IoU: 0.8687 FScore: 0.6613

Image 16

Ground Truth

missing

Model 1 Predictions

missing
Loss: 414.7833 IoU: 0.1509 FScore: 0.0241

Model 2 Predictions

missing
Loss: 33.4038 IoU: 0.8352 FScore: 0.4202

Image 17

Ground Truth

missing

Model 1 Predictions

missing
Loss: 414.7833 IoU: 0.1509 FScore: 0.0241

Model 2 Predictions

missing
Loss: 33.4038 IoU: 0.8352 FScore: 0.4202

Image 18

Ground Truth

missing

Model 1 Predictions

missing
Loss: 588.8528 IoU: 0.1315 FScore: 0.1522

Model 2 Predictions

missing
Loss: 62.9957 IoU: 0.8298 FScore: 0.4168

Image 19

Ground Truth

missing

Model 1 Predictions

missing
Loss: 588.8528 IoU: 0.1315 FScore: 0.1522

Model 2 Predictions

missing
Loss: 62.9957 IoU: 0.8298 FScore: 0.4168

Image 20

Ground Truth

missing

Model 1 Predictions

missing
Loss: 320.6092 IoU: 0.2454 FScore: 0.1065

Model 2 Predictions

missing
Loss: 53.2212 IoU: 0.7917 FScore: 0.4464

Finetuned PVT Curve-Transformer on DUTS FScore Better

Image 1

Ground Truth

missing

Model 1 Predictions

missing
Loss: 62.1398 IoU: 0.7817 FScore: 0.5562

Model 2 Predictions

missing
Loss: 78.1685 IoU: 0.6709 FScore: 0.5376

Image 2

Ground Truth

missing

Model 1 Predictions

missing
Loss: 43.8108 IoU: 0.9048 FScore: 0.5732

Model 2 Predictions

missing
Loss: 42.9500 IoU: 0.8903 FScore: 0.4754

Image 3

Ground Truth

missing

Model 1 Predictions

missing
Loss: 121.9034 IoU: 0.9011 FScore: 0.6674

Model 2 Predictions

missing
Loss: 104.3836 IoU: 0.7667 FScore: 0.5692

Image 4

Ground Truth

missing

Model 1 Predictions

missing
Loss: 60.7505 IoU: 0.8586 FScore: 0.3726

Model 2 Predictions

missing
Loss: 83.5809 IoU: 0.8410 FScore: 0.2691

Image 5

Ground Truth

missing

Model 1 Predictions

missing
Loss: 98.6349 IoU: 0.8662 FScore: 0.5392

Model 2 Predictions

missing
Loss: 51.8932 IoU: 0.8131 FScore: 0.4241

Image 6

Ground Truth

missing

Model 1 Predictions

missing
Loss: 183.0923 IoU: 0.8360 FScore: 0.5770

Model 2 Predictions

missing
Loss: 100.8706 IoU: 0.7300 FScore: 0.4485

Image 7

Ground Truth

missing

Model 1 Predictions

missing
Loss: 177.3506 IoU: 0.8862 FScore: 0.5398

Model 2 Predictions

missing
Loss: 109.7255 IoU: 0.8560 FScore: 0.4074

Image 8

Ground Truth

missing

Model 1 Predictions

missing
Loss: 113.6596 IoU: 0.9047 FScore: 0.5269

Model 2 Predictions

missing
Loss: 86.9173 IoU: 0.8298 FScore: 0.3907

Image 9

Ground Truth

missing

Model 1 Predictions

missing
Loss: 69.7462 IoU: 0.9345 FScore: 0.2543

Model 2 Predictions

missing
Loss: 18.9958 IoU: 0.9342 FScore: 0.3922

Image 10

Ground Truth

missing

Model 1 Predictions

missing
Loss: 70.0382 IoU: 0.8708 FScore: 0.4721

Model 2 Predictions

missing
Loss: 60.8059 IoU: 0.7588 FScore: 0.6155

Image 11

Ground Truth

missing

Model 1 Predictions

missing
Loss: 56.6772 IoU: 0.9682 FScore: 0.9043

Model 2 Predictions

missing
Loss: 25.6373 IoU: 0.9676 FScore: 0.7555

Image 12

Ground Truth

missing

Model 1 Predictions

missing
Loss: 142.7412 IoU: 0.9179 FScore: 0.7322

Model 2 Predictions

missing
Loss: 106.2133 IoU: 0.8926 FScore: 0.5812

Image 13

Ground Truth

missing

Model 1 Predictions

missing
Loss: 74.8896 IoU: 0.9560 FScore: 0.7877

Model 2 Predictions

missing
Loss: 60.5490 IoU: 0.9219 FScore: 0.6294

Image 14

Ground Truth

missing

Model 1 Predictions

missing
Loss: 76.6633 IoU: 0.9196 FScore: 0.5318

Model 2 Predictions

missing
Loss: 81.8322 IoU: 0.8416 FScore: 0.3589

Image 15

Ground Truth

missing

Model 1 Predictions

missing
Loss: 97.3220 IoU: 0.9001 FScore: 0.3437

Model 2 Predictions

missing
Loss: 106.0422 IoU: 0.7264 FScore: 0.1688

Image 16

Ground Truth

missing

Model 1 Predictions

missing
Loss: 59.3642 IoU: 0.9654 FScore: 0.7696

Model 2 Predictions

missing
Loss: 44.6778 IoU: 0.9500 FScore: 0.5630

Image 17

Ground Truth

missing

Model 1 Predictions

missing
Loss: 79.3199 IoU: 0.8924 FScore: 0.5993

Model 2 Predictions

missing
Loss: 47.4086 IoU: 0.8036 FScore: 0.3804

Image 18

Ground Truth

missing

Model 1 Predictions

missing
Loss: 55.3643 IoU: 0.8587 FScore: 0.6228

Model 2 Predictions

missing
Loss: 46.2441 IoU: 0.8237 FScore: 0.3862

Image 19

Ground Truth

missing

Model 1 Predictions

missing
Loss: 365.2896 IoU: 0.8652 FScore: 0.6348

Model 2 Predictions

missing
Loss: 252.1658 IoU: 0.5490 FScore: 0.3527

Image 20

Ground Truth

missing

Model 1 Predictions

missing
Loss: 62.0398 IoU: 0.9682 FScore: 0.9095

Model 2 Predictions

missing
Loss: 30.8807 IoU: 0.9325 FScore: 0.4817

PVT Curve-Transformer FScore Better

Image 1

Ground Truth

missing

Model 1 Predictions

missing
Loss: 44.9845 IoU: 0.9379 FScore: 0.3992

Model 2 Predictions

missing
Loss: 32.8195 IoU: 0.9617 FScore: 0.3789

Image 2

Ground Truth

missing

Model 1 Predictions

missing
Loss: 31.3645 IoU: 0.9426 FScore: 0.6284

Model 2 Predictions

missing
Loss: 20.8519 IoU: 0.9497 FScore: 0.6667

Image 3

Ground Truth

missing

Model 1 Predictions

missing
Loss: 58.4404 IoU: 0.9652 FScore: 0.4654

Model 2 Predictions

missing
Loss: 12.5798 IoU: 0.9743 FScore: 0.5205

Image 4

Ground Truth

missing

Model 1 Predictions

missing
Loss: 36.5812 IoU: 0.9185 FScore: 0.5137

Model 2 Predictions

missing
Loss: 24.5091 IoU: 0.9412 FScore: 0.5798

Image 5

Ground Truth

missing

Model 1 Predictions

missing
Loss: 40.5098 IoU: 0.9442 FScore: 0.5554

Model 2 Predictions

missing
Loss: 29.5694 IoU: 0.9547 FScore: 0.6263

Image 6

Ground Truth

missing

Model 1 Predictions

missing
Loss: 76.4502 IoU: 0.9467 FScore: 0.8027

Model 2 Predictions

missing
Loss: 20.0153 IoU: 0.9714 FScore: 0.8818

Image 7

Ground Truth

missing

Model 1 Predictions

missing
Loss: 52.7831 IoU: 0.9520 FScore: 0.3818

Model 2 Predictions

missing
Loss: 34.4782 IoU: 0.9581 FScore: 0.4760

Image 8

Ground Truth

missing

Model 1 Predictions

missing
Loss: 43.9411 IoU: 0.9431 FScore: 0.7426

Model 2 Predictions

missing
Loss: 21.4710 IoU: 0.9646 FScore: 0.8447

Image 9

Ground Truth

missing

Model 1 Predictions

missing
Loss: 59.8554 IoU: 0.9407 FScore: 0.8703

Model 2 Predictions

missing
Loss: 8.0236 IoU: 0.9727 FScore: 0.9831

Image 10

Ground Truth

missing

Model 1 Predictions

missing
Loss: 71.7352 IoU: 0.9228 FScore: 0.2530

Model 2 Predictions

missing
Loss: 18.5849 IoU: 0.9435 FScore: 0.3687

Image 11

Ground Truth

missing

Model 1 Predictions

missing
Loss: 148.1412 IoU: 0.6130 FScore: 0.3346

Model 2 Predictions

missing
Loss: 68.5262 IoU: 0.8330 FScore: 0.4710

Image 12

Ground Truth

missing

Model 1 Predictions

missing
Loss: 65.9981 IoU: 0.9171 FScore: 0.3749

Model 2 Predictions

missing
Loss: 30.9569 IoU: 0.9373 FScore: 0.5389

Image 13

Ground Truth

missing

Model 1 Predictions

missing
Loss: 32.8289 IoU: 0.9342 FScore: 0.5606

Model 2 Predictions

missing
Loss: 18.7829 IoU: 0.9621 FScore: 0.7382

Image 14

Ground Truth

missing

Model 1 Predictions

missing
Loss: 43.7732 IoU: 0.9540 FScore: 0.3375

Model 2 Predictions

missing
Loss: 14.6328 IoU: 0.9681 FScore: 0.5423

Image 15

Ground Truth

missing

Model 1 Predictions

missing
Loss: 57.3798 IoU: 0.9398 FScore: 0.6751

Model 2 Predictions

missing
Loss: 15.1963 IoU: 0.9672 FScore: 0.8861

Image 16

Ground Truth

missing

Model 1 Predictions

missing
Loss: 94.9173 IoU: 0.8825 FScore: 0.6052

Model 2 Predictions

missing
Loss: 54.5035 IoU: 0.9565 FScore: 0.8332

Image 17

Ground Truth

missing

Model 1 Predictions

missing
Loss: 57.4904 IoU: 0.9411 FScore: 0.6319

Model 2 Predictions

missing
Loss: 25.8183 IoU: 0.9679 FScore: 0.8643

Image 18

Ground Truth

missing

Model 1 Predictions

missing
Loss: 44.3547 IoU: 0.9557 FScore: 0.3586

Model 2 Predictions

missing
Loss: 23.4824 IoU: 0.9738 FScore: 0.5962

Image 19

Ground Truth

missing

Model 1 Predictions

missing
Loss: 43.3325 IoU: 0.9474 FScore: 0.3549

Model 2 Predictions

missing
Loss: 16.9952 IoU: 0.9658 FScore: 0.6208

Image 20

Ground Truth

missing

Model 1 Predictions

missing
Loss: 145.9378 IoU: 0.7858 FScore: 0.0746

Model 2 Predictions

missing
Loss: 16.0222 IoU: 0.9531 FScore: 0.4651