Curve-Transformer Comparisons

Overall Stats

Model 1 Better: 3364
Model 2 Better: 5076

Finetuned PVT Curve-Transformer IoU Better

Image 1

Ground Truth

missing

Model 1 Predictions

missing
Loss: 53.4697 IoU: 0.5220 FScore: 0.5873

Model 2 Predictions

missing
Loss: 79.4242 IoU: 0.4064 FScore: 0.3715

Image 2

Ground Truth

missing

Model 1 Predictions

missing
Loss: 244.7061 IoU: 0.5830 FScore: 0.6854

Model 2 Predictions

missing
Loss: 273.8809 IoU: 0.4671 FScore: 0.6272

Image 3

Ground Truth

missing

Model 1 Predictions

missing
Loss: 55.2690 IoU: 0.8322 FScore: 0.8084

Model 2 Predictions

missing
Loss: 61.9914 IoU: 0.7145 FScore: 0.6450

Image 4

Ground Truth

missing

Model 1 Predictions

missing
Loss: 57.8972 IoU: 0.9105 FScore: 0.9213

Model 2 Predictions

missing
Loss: 149.3847 IoU: 0.7884 FScore: 0.7558

Image 5

Ground Truth

missing

Model 1 Predictions

missing
Loss: 32.6942 IoU: 0.8179 FScore: 0.9310

Model 2 Predictions

missing
Loss: 63.2478 IoU: 0.6950 FScore: 0.7129

Image 6

Ground Truth

missing

Model 1 Predictions

missing
Loss: 184.5891 IoU: 0.6464 FScore: 0.6912

Model 2 Predictions

missing
Loss: 238.3211 IoU: 0.5129 FScore: 0.5957

Image 7

Ground Truth

missing

Model 1 Predictions

missing
Loss: 43.9116 IoU: 0.8174 FScore: 0.7765

Model 2 Predictions

missing
Loss: 69.6721 IoU: 0.6817 FScore: 0.6461

Image 8

Ground Truth

missing

Model 1 Predictions

missing
Loss: 150.3346 IoU: 0.4780 FScore: 0.7453

Model 2 Predictions

missing
Loss: 163.2192 IoU: 0.3398 FScore: 0.5392

Image 9

Ground Truth

missing

Model 1 Predictions

missing
Loss: 100.1830 IoU: 0.6001 FScore: 0.9379

Model 2 Predictions

missing
Loss: 129.9579 IoU: 0.4615 FScore: 0.7573

Image 10

Ground Truth

missing

Model 1 Predictions

missing
Loss: 114.1908 IoU: 0.8508 FScore: 0.5528

Model 2 Predictions

missing
Loss: 191.8644 IoU: 0.7117 FScore: 0.4651

Image 11

Ground Truth

missing

Model 1 Predictions

missing
Loss: 130.1161 IoU: 0.3917 FScore: 0.4642

Model 2 Predictions

missing
Loss: 164.2058 IoU: 0.2525 FScore: 0.4105

Image 12

Ground Truth

missing

Model 1 Predictions

missing
Loss: 88.9260 IoU: 0.8604 FScore: 0.6115

Model 2 Predictions

missing
Loss: 146.3440 IoU: 0.7158 FScore: 0.5362

Image 13

Ground Truth

missing

Model 1 Predictions

missing
Loss: 303.7362 IoU: 0.4084 FScore: 0.2504

Model 2 Predictions

missing
Loss: 363.4655 IoU: 0.2462 FScore: 0.1666

Image 14

Ground Truth

missing

Model 1 Predictions

missing
Loss: 70.4615 IoU: 0.5953 FScore: 0.7451

Model 2 Predictions

missing
Loss: 133.8434 IoU: 0.4026 FScore: 0.5579

Image 15

Ground Truth

missing

Model 1 Predictions

missing
Loss: 68.7968 IoU: 0.7887 FScore: 0.8889

Model 2 Predictions

missing
Loss: 168.7691 IoU: 0.5645 FScore: 0.6538

Image 16

Ground Truth

missing

Model 1 Predictions

missing
Loss: 114.4192 IoU: 0.7627 FScore: 0.9271

Model 2 Predictions

missing
Loss: 190.4041 IoU: 0.5374 FScore: 0.7070

Image 17

Ground Truth

missing

Model 1 Predictions

missing
Loss: 111.1414 IoU: 0.6355 FScore: 0.7677

Model 2 Predictions

missing
Loss: 195.6294 IoU: 0.3983 FScore: 0.6719

Image 18

Ground Truth

missing

Model 1 Predictions

missing
Loss: 74.7495 IoU: 0.8098 FScore: 0.5623

Model 2 Predictions

missing
Loss: 109.2737 IoU: 0.5587 FScore: 0.3559

Image 19

Ground Truth

missing

Model 1 Predictions

missing
Loss: 356.4510 IoU: 0.5938 FScore: 0.4930

Model 2 Predictions

missing
Loss: 484.2434 IoU: 0.3306 FScore: 0.3800

Image 20

Ground Truth

missing

Model 1 Predictions

missing
Loss: 108.0535 IoU: 0.8091 FScore: 0.8382

Model 2 Predictions

missing
Loss: 183.5878 IoU: 0.5392 FScore: 0.3450

PVT Curve-Transformer IoU Better

Image 1

Ground Truth

missing

Model 1 Predictions

missing
Loss: 81.2708 IoU: 0.6782 FScore: 0.7733

Model 2 Predictions

missing
Loss: 80.5738 IoU: 0.7126 FScore: 0.8761

Image 2

Ground Truth

missing

Model 1 Predictions

missing
Loss: 224.2359 IoU: 0.4834 FScore: 0.5575

Model 2 Predictions

missing
Loss: 163.2746 IoU: 0.6201 FScore: 0.5802

Image 3

Ground Truth

missing

Model 1 Predictions

missing
Loss: 224.2359 IoU: 0.4834 FScore: 0.5575

Model 2 Predictions

missing
Loss: 163.2746 IoU: 0.6201 FScore: 0.5802

Image 4

Ground Truth

missing

Model 1 Predictions

missing
Loss: 151.0641 IoU: 0.5486 FScore: 0.5286

Model 2 Predictions

missing
Loss: 110.5005 IoU: 0.6908 FScore: 0.6409

Image 5

Ground Truth

missing

Model 1 Predictions

missing
Loss: 151.0641 IoU: 0.5486 FScore: 0.5286

Model 2 Predictions

missing
Loss: 110.5005 IoU: 0.6908 FScore: 0.6409

Image 6

Ground Truth

missing

Model 1 Predictions

missing
Loss: 94.1066 IoU: 0.5931 FScore: 0.4783

Model 2 Predictions

missing
Loss: 66.0868 IoU: 0.7477 FScore: 0.4724

Image 7

Ground Truth

missing

Model 1 Predictions

missing
Loss: 94.1066 IoU: 0.5931 FScore: 0.4783

Model 2 Predictions

missing
Loss: 66.0868 IoU: 0.7477 FScore: 0.4724

Image 8

Ground Truth

missing

Model 1 Predictions

missing
Loss: 132.6128 IoU: 0.5144 FScore: 0.7985

Model 2 Predictions

missing
Loss: 112.1034 IoU: 0.6704 FScore: 0.8187

Image 9

Ground Truth

missing

Model 1 Predictions

missing
Loss: 132.6128 IoU: 0.5144 FScore: 0.7985

Model 2 Predictions

missing
Loss: 112.1034 IoU: 0.6704 FScore: 0.8187

Image 10

Ground Truth

missing

Model 1 Predictions

missing
Loss: 96.8193 IoU: 0.4667 FScore: 0.5978

Model 2 Predictions

missing
Loss: 69.0428 IoU: 0.6298 FScore: 0.6607

Image 11

Ground Truth

missing

Model 1 Predictions

missing
Loss: 96.8193 IoU: 0.4667 FScore: 0.5978

Model 2 Predictions

missing
Loss: 69.0428 IoU: 0.6298 FScore: 0.6607

Image 12

Ground Truth

missing

Model 1 Predictions

missing
Loss: 110.2862 IoU: 0.3682 FScore: 0.4793

Model 2 Predictions

missing
Loss: 82.5221 IoU: 0.5462 FScore: 0.5277

Image 13

Ground Truth

missing

Model 1 Predictions

missing
Loss: 110.2862 IoU: 0.3682 FScore: 0.4793

Model 2 Predictions

missing
Loss: 82.5221 IoU: 0.5462 FScore: 0.5277

Image 14

Ground Truth

missing

Model 1 Predictions

missing
Loss: 143.8737 IoU: 0.2508 FScore: 0.6805

Model 2 Predictions

missing
Loss: 125.2308 IoU: 0.4506 FScore: 0.6610

Image 15

Ground Truth

missing

Model 1 Predictions

missing
Loss: 143.8737 IoU: 0.2508 FScore: 0.6805

Model 2 Predictions

missing
Loss: 125.2308 IoU: 0.4506 FScore: 0.6610

Image 16

Ground Truth

missing

Model 1 Predictions

missing
Loss: 194.8340 IoU: 0.2323 FScore: 0.1764

Model 2 Predictions

missing
Loss: 111.4909 IoU: 0.5945 FScore: 0.4097

Image 17

Ground Truth

missing

Model 1 Predictions

missing
Loss: 194.8340 IoU: 0.2323 FScore: 0.1764

Model 2 Predictions

missing
Loss: 111.4909 IoU: 0.5945 FScore: 0.4097

Image 18

Ground Truth

missing

Model 1 Predictions

missing
Loss: 111.7537 IoU: 0.4359 FScore: 0.6014

Model 2 Predictions

missing
Loss: 44.5133 IoU: 0.8401 FScore: 0.8247

Image 19

Ground Truth

missing

Model 1 Predictions

missing
Loss: 111.7537 IoU: 0.4359 FScore: 0.6014

Model 2 Predictions

missing
Loss: 44.5133 IoU: 0.8401 FScore: 0.8247

Image 20

Ground Truth

missing

Model 1 Predictions

missing
Loss: 42.4174 IoU: 0.7858 FScore: 0.4922

Model 2 Predictions

missing
Loss: 53.2212 IoU: 0.7917 FScore: 0.4464

Finetuned PVT Curve-Transformer FScore Better

Image 1

Ground Truth

missing

Model 1 Predictions

missing
Loss: 117.3371 IoU: 0.6901 FScore: 0.6050

Model 2 Predictions

missing
Loss: 147.0916 IoU: 0.6073 FScore: 0.4880

Image 2

Ground Truth

missing

Model 1 Predictions

missing
Loss: 143.0155 IoU: 0.7695 FScore: 0.4960

Model 2 Predictions

missing
Loss: 80.1776 IoU: 0.7312 FScore: 0.3647

Image 3

Ground Truth

missing

Model 1 Predictions

missing
Loss: 295.0996 IoU: 0.3616 FScore: 0.5215

Model 2 Predictions

missing
Loss: 297.7893 IoU: 0.2719 FScore: 0.3902

Image 4

Ground Truth

missing

Model 1 Predictions

missing
Loss: 184.0794 IoU: 0.4344 FScore: 0.5446

Model 2 Predictions

missing
Loss: 187.7054 IoU: 0.3283 FScore: 0.4090

Image 5

Ground Truth

missing

Model 1 Predictions

missing
Loss: 30.7440 IoU: 0.9501 FScore: 0.5237

Model 2 Predictions

missing
Loss: 18.5849 IoU: 0.9435 FScore: 0.3687

Image 6

Ground Truth

missing

Model 1 Predictions

missing
Loss: 55.2690 IoU: 0.8322 FScore: 0.8084

Model 2 Predictions

missing
Loss: 61.9914 IoU: 0.7145 FScore: 0.6450

Image 7

Ground Truth

missing

Model 1 Predictions

missing
Loss: 57.8972 IoU: 0.9105 FScore: 0.9213

Model 2 Predictions

missing
Loss: 149.3847 IoU: 0.7884 FScore: 0.7558

Image 8

Ground Truth

missing

Model 1 Predictions

missing
Loss: 57.7110 IoU: 0.6664 FScore: 0.8987

Model 2 Predictions

missing
Loss: 77.2412 IoU: 0.5671 FScore: 0.7209

Image 9

Ground Truth

missing

Model 1 Predictions

missing
Loss: 100.1830 IoU: 0.6001 FScore: 0.9379

Model 2 Predictions

missing
Loss: 129.9579 IoU: 0.4615 FScore: 0.7573

Image 10

Ground Truth

missing

Model 1 Predictions

missing
Loss: 70.4615 IoU: 0.5953 FScore: 0.7451

Model 2 Predictions

missing
Loss: 133.8434 IoU: 0.4026 FScore: 0.5579

Image 11

Ground Truth

missing

Model 1 Predictions

missing
Loss: 115.9496 IoU: 0.7306 FScore: 0.5006

Model 2 Predictions

missing
Loss: 96.4175 IoU: 0.6753 FScore: 0.3075

Image 12

Ground Truth

missing

Model 1 Predictions

missing
Loss: 132.2509 IoU: 0.4579 FScore: 0.7838

Model 2 Predictions

missing
Loss: 157.5586 IoU: 0.3483 FScore: 0.5890

Image 13

Ground Truth

missing

Model 1 Predictions

missing
Loss: 150.3346 IoU: 0.4780 FScore: 0.7453

Model 2 Predictions

missing
Loss: 163.2192 IoU: 0.3398 FScore: 0.5392

Image 14

Ground Truth

missing

Model 1 Predictions

missing
Loss: 74.7495 IoU: 0.8098 FScore: 0.5623

Model 2 Predictions

missing
Loss: 109.2737 IoU: 0.5587 FScore: 0.3559

Image 15

Ground Truth

missing

Model 1 Predictions

missing
Loss: 54.0578 IoU: 0.8397 FScore: 0.9868

Model 2 Predictions

missing
Loss: 84.9623 IoU: 0.7624 FScore: 0.7752

Image 16

Ground Truth

missing

Model 1 Predictions

missing
Loss: 53.4697 IoU: 0.5220 FScore: 0.5873

Model 2 Predictions

missing
Loss: 79.4242 IoU: 0.4064 FScore: 0.3715

Image 17

Ground Truth

missing

Model 1 Predictions

missing
Loss: 32.6942 IoU: 0.8179 FScore: 0.9310

Model 2 Predictions

missing
Loss: 63.2478 IoU: 0.6950 FScore: 0.7129

Image 18

Ground Truth

missing

Model 1 Predictions

missing
Loss: 114.4192 IoU: 0.7627 FScore: 0.9271

Model 2 Predictions

missing
Loss: 190.4041 IoU: 0.5374 FScore: 0.7070

Image 19

Ground Truth

missing

Model 1 Predictions

missing
Loss: 68.7968 IoU: 0.7887 FScore: 0.8889

Model 2 Predictions

missing
Loss: 168.7691 IoU: 0.5645 FScore: 0.6538

Image 20

Ground Truth

missing

Model 1 Predictions

missing
Loss: 108.0535 IoU: 0.8091 FScore: 0.8382

Model 2 Predictions

missing
Loss: 183.5878 IoU: 0.5392 FScore: 0.3450

PVT Curve-Transformer FScore Better

Image 1

Ground Truth

missing

Model 1 Predictions

missing
Loss: 40.2747 IoU: 0.9294 FScore: 1.0000

Model 2 Predictions

missing
Loss: 39.0628 IoU: 0.9315 FScore: 1.0000

Image 2

Ground Truth

missing

Model 1 Predictions

missing
Loss: 50.9896 IoU: 0.8019 FScore: 0.9868

Model 2 Predictions

missing
Loss: 48.4508 IoU: 0.8406 FScore: 0.9868

Image 3

Ground Truth

missing

Model 1 Predictions

missing
Loss: 38.5600 IoU: 0.9279 FScore: 0.9691

Model 2 Predictions

missing
Loss: 27.9058 IoU: 0.9331 FScore: 0.9687

Image 4

Ground Truth

missing

Model 1 Predictions

missing
Loss: 37.5875 IoU: 0.8324 FScore: 0.9966

Model 2 Predictions

missing
Loss: 39.9871 IoU: 0.8392 FScore: 0.9933

Image 5

Ground Truth

missing

Model 1 Predictions

missing
Loss: 45.0629 IoU: 0.8421 FScore: 0.7738

Model 2 Predictions

missing
Loss: 61.7496 IoU: 0.8508 FScore: 0.7783

Image 6

Ground Truth

missing

Model 1 Predictions

missing
Loss: 39.2429 IoU: 0.8842 FScore: 0.9043

Model 2 Predictions

missing
Loss: 31.1810 IoU: 0.8904 FScore: 0.8985

Image 7

Ground Truth

missing

Model 1 Predictions

missing
Loss: 41.8866 IoU: 0.8598 FScore: 0.9611

Model 2 Predictions

missing
Loss: 35.4878 IoU: 0.8627 FScore: 0.9687

Image 8

Ground Truth

missing

Model 1 Predictions

missing
Loss: 85.6993 IoU: 0.7577 FScore: 0.6692

Model 2 Predictions

missing
Loss: 93.6357 IoU: 0.7647 FScore: 0.6777

Image 9

Ground Truth

missing

Model 1 Predictions

missing
Loss: 29.1447 IoU: 0.9441 FScore: 0.9352

Model 2 Predictions

missing
Loss: 20.1335 IoU: 0.9502 FScore: 0.9217

Image 10

Ground Truth

missing

Model 1 Predictions

missing
Loss: 65.1759 IoU: 0.7501 FScore: 0.7833

Model 2 Predictions

missing
Loss: 61.5109 IoU: 0.7861 FScore: 0.7997

Image 11

Ground Truth

missing

Model 1 Predictions

missing
Loss: 65.9420 IoU: 0.8593 FScore: 0.9102

Model 2 Predictions

missing
Loss: 55.5758 IoU: 0.8768 FScore: 0.9312

Image 12

Ground Truth

missing

Model 1 Predictions

missing
Loss: 68.4333 IoU: 0.8283 FScore: 0.4489

Model 2 Predictions

missing
Loss: 68.5262 IoU: 0.8330 FScore: 0.4710

Image 13

Ground Truth

missing

Model 1 Predictions

missing
Loss: 59.1948 IoU: 0.9462 FScore: 0.8033

Model 2 Predictions

missing
Loss: 54.5035 IoU: 0.9565 FScore: 0.8332

Image 14

Ground Truth

missing

Model 1 Predictions

missing
Loss: 141.9253 IoU: 0.8015 FScore: 0.7341

Model 2 Predictions

missing
Loss: 129.1865 IoU: 0.8117 FScore: 0.7033

Image 15

Ground Truth

missing

Model 1 Predictions

missing
Loss: 24.9394 IoU: 0.9642 FScore: 0.8498

Model 2 Predictions

missing
Loss: 15.1963 IoU: 0.9672 FScore: 0.8861

Image 16

Ground Truth

missing

Model 1 Predictions

missing
Loss: 27.1012 IoU: 0.9647 FScore: 0.5620

Model 2 Predictions

missing
Loss: 16.9952 IoU: 0.9658 FScore: 0.6208

Image 17

Ground Truth

missing

Model 1 Predictions

missing
Loss: 35.2297 IoU: 0.8626 FScore: 0.8925

Model 2 Predictions

missing
Loss: 40.4495 IoU: 0.8628 FScore: 0.8229

Image 18

Ground Truth

missing

Model 1 Predictions

missing
Loss: 76.7749 IoU: 0.8004 FScore: 0.4859

Model 2 Predictions

missing
Loss: 55.4220 IoU: 0.8081 FScore: 0.5600

Image 19

Ground Truth

missing

Model 1 Predictions

missing
Loss: 24.3800 IoU: 0.9309 FScore: 0.3669

Model 2 Predictions

missing
Loss: 16.0222 IoU: 0.9531 FScore: 0.4651

Image 20

Ground Truth

missing

Model 1 Predictions

missing
Loss: 28.0367 IoU: 0.9428 FScore: 0.3591

Model 2 Predictions

missing
Loss: 16.6987 IoU: 0.9562 FScore: 0.5487