Curve-Transformer Comparisons

Overall Stats

Model 1 Better: 4964
Model 2 Better: 3476

Segformer Performed Better

Image 1

Ground Truth

missing

Model 1 Predictions

missing
Loss: 0.3998 IoU: 0.5236

Model 2 Predictions

missing
Loss: 185.2323 IoU: 0.1043

Image 2

Ground Truth

missing

Model 1 Predictions

missing
Loss: 0.1005 IoU: 0.7203

Model 2 Predictions

missing
Loss: 209.7441 IoU: 0.2984

Image 3

Ground Truth

missing

Model 1 Predictions

missing
Loss: 0.0765 IoU: 0.9438

Model 2 Predictions

missing
Loss: 176.0333 IoU: 0.5106

Image 4

Ground Truth

missing

Model 1 Predictions

missing
Loss: 0.2165 IoU: 0.7907

Model 2 Predictions

missing
Loss: 273.0134 IoU: 0.3454

Image 5

Ground Truth

missing

Model 1 Predictions

missing
Loss: 0.0523 IoU: 0.8682

Model 2 Predictions

missing
Loss: 285.6400 IoU: 0.4136

Image 6

Ground Truth

missing

Model 1 Predictions

missing
Loss: 0.3289 IoU: 0.7235

Model 2 Predictions

missing
Loss: 354.3137 IoU: 0.2653

Image 7

Ground Truth

missing

Model 1 Predictions

missing
Loss: 0.0975 IoU: 0.5859

Model 2 Predictions

missing
Loss: 303.8362 IoU: 0.1029

Image 8

Ground Truth

missing

Model 1 Predictions

missing
Loss: 0.0799 IoU: 0.9152

Model 2 Predictions

missing
Loss: 195.6294 IoU: 0.3983

Image 9

Ground Truth

missing

Model 1 Predictions

missing
Loss: 0.3293 IoU: 0.7469

Model 2 Predictions

missing
Loss: 234.2642 IoU: 0.1829

Image 10

Ground Truth

missing

Model 1 Predictions

missing
Loss: 0.3179 IoU: 0.7715

Model 2 Predictions

missing
Loss: 321.0007 IoU: 0.1875

PVT Encoder Curve-Transformer Performed Better

Image 1

Ground Truth

missing

Model 1 Predictions

missing
Loss: 1.0321 IoU: 0.4789

Model 2 Predictions

missing
Loss: 41.1175 IoU: 0.8007

Image 2

Ground Truth

missing

Model 1 Predictions

missing
Loss: 0.6126 IoU: 0.2303

Model 2 Predictions

missing
Loss: 41.8097 IoU: 0.5615

Image 3

Ground Truth

missing

Model 1 Predictions

missing
Loss: 0.3079 IoU: 0.4160

Model 2 Predictions

missing
Loss: 52.4956 IoU: 0.7495

Image 4

Ground Truth

missing

Model 1 Predictions

missing
Loss: 0.7661 IoU: 0.2773

Model 2 Predictions

missing
Loss: 141.1681 IoU: 0.6190

Image 5

Ground Truth

missing

Model 1 Predictions

missing
Loss: 0.2282 IoU: 0.3619

Model 2 Predictions

missing
Loss: 39.5222 IoU: 0.7152

Image 6

Ground Truth

missing

Model 1 Predictions

missing
Loss: 0.4505 IoU: 0.5972

Model 2 Predictions

missing
Loss: 21.2634 IoU: 0.9510

Image 7

Ground Truth

missing

Model 1 Predictions

missing
Loss: 0.3357 IoU: 0.3608

Model 2 Predictions

missing
Loss: 69.0354 IoU: 0.7193

Image 8

Ground Truth

missing

Model 1 Predictions

missing
Loss: 1.2192 IoU: 0.2979

Model 2 Predictions

missing
Loss: 208.2855 IoU: 0.6846

Image 9

Ground Truth

missing

Model 1 Predictions

missing
Loss: 1.2346 IoU: 0.1463

Model 2 Predictions

missing
Loss: 75.4271 IoU: 0.5424

Image 10

Ground Truth

missing

Model 1 Predictions

missing
Loss: 0.5586 IoU: 0.3823

Model 2 Predictions

missing
Loss: 82.5855 IoU: 0.7893

Segformer Best Images

Image 1

Ground Truth

missing

Model 1 Predictions

missing
Loss: 0.0201 IoU: 0.9849

Model 2 Predictions

missing
Loss: 16.4997 IoU: 0.9728

Image 2

Ground Truth

missing

Model 1 Predictions

missing
Loss: 0.0211 IoU: 0.9849

Model 2 Predictions

missing
Loss: 19.1359 IoU: 0.9754

Image 3

Ground Truth

missing

Model 1 Predictions

missing
Loss: 0.0224 IoU: 0.9851

Model 2 Predictions

missing
Loss: 21.7334 IoU: 0.9772

Image 4

Ground Truth

missing

Model 1 Predictions

missing
Loss: 0.0155 IoU: 0.9852

Model 2 Predictions

missing
Loss: 13.9185 IoU: 0.9772

Image 5

Ground Truth

missing

Model 1 Predictions

missing
Loss: 0.0201 IoU: 0.9852

Model 2 Predictions

missing
Loss: 35.7576 IoU: 0.9709

Image 6

Ground Truth

missing

Model 1 Predictions

missing
Loss: 0.0268 IoU: 0.9854

Model 2 Predictions

missing
Loss: 24.4069 IoU: 0.9707

Image 7

Ground Truth

missing

Model 1 Predictions

missing
Loss: 0.0194 IoU: 0.9858

Model 2 Predictions

missing
Loss: 15.3195 IoU: 0.9794

Image 8

Ground Truth

missing

Model 1 Predictions

missing
Loss: 0.0219 IoU: 0.9863

Model 2 Predictions

missing
Loss: 15.9938 IoU: 0.9777

Image 9

Ground Truth

missing

Model 1 Predictions

missing
Loss: 0.0141 IoU: 0.9873

Model 2 Predictions

missing
Loss: 14.8524 IoU: 0.9756

Image 10

Ground Truth

missing

Model 1 Predictions

missing
Loss: 0.0123 IoU: 0.9886

Model 2 Predictions

missing
Loss: 10.9226 IoU: 0.9774

PVT Encoder Curve-Transformer Best Images

Image 1

Ground Truth

missing

Model 1 Predictions

missing
Loss: 0.0219 IoU: 0.9863

Model 2 Predictions

missing
Loss: 15.9938 IoU: 0.9777

Image 2

Ground Truth

missing

Model 1 Predictions

missing
Loss: 0.0184 IoU: 0.9724

Model 2 Predictions

missing
Loss: 9.6259 IoU: 0.9779

Image 3

Ground Truth

missing

Model 1 Predictions

missing
Loss: 0.0238 IoU: 0.9840

Model 2 Predictions

missing
Loss: 16.6704 IoU: 0.9783

Image 4

Ground Truth

missing

Model 1 Predictions

missing
Loss: 0.0298 IoU: 0.9755

Model 2 Predictions

missing
Loss: 21.1783 IoU: 0.9783

Image 5

Ground Truth

missing

Model 1 Predictions

missing
Loss: 0.0341 IoU: 0.9694

Model 2 Predictions

missing
Loss: 15.8445 IoU: 0.9785

Image 6

Ground Truth

missing

Model 1 Predictions

missing
Loss: 0.0137 IoU: 0.9805

Model 2 Predictions

missing
Loss: 9.1859 IoU: 0.9787

Image 7

Ground Truth

missing

Model 1 Predictions

missing
Loss: 0.0194 IoU: 0.9858

Model 2 Predictions

missing
Loss: 15.3195 IoU: 0.9794

Image 8

Ground Truth

missing

Model 1 Predictions

missing
Loss: 0.0328 IoU: 0.9727

Model 2 Predictions

missing
Loss: 15.2408 IoU: 0.9796

Image 9

Ground Truth

missing

Model 1 Predictions

missing
Loss: 0.0180 IoU: 0.9833

Model 2 Predictions

missing
Loss: 12.9807 IoU: 0.9805

Image 10

Ground Truth

missing

Model 1 Predictions

missing
Loss: 0.0166 IoU: 0.9814

Model 2 Predictions

missing
Loss: 7.7587 IoU: 0.9820

Segformer Worst Images

Image 1

Ground Truth

missing

Model 1 Predictions

missing
Loss: 2.5770 IoU: 0.1189

Model 2 Predictions

missing
Loss: 337.9824 IoU: 0.0883

Image 2

Ground Truth

missing

Model 1 Predictions

missing
Loss: 1.2148 IoU: 0.1109

Model 2 Predictions

missing
Loss: 137.1669 IoU: 0.1059

Image 3

Ground Truth

missing

Model 1 Predictions

missing
Loss: 1.1414 IoU: 0.1097

Model 2 Predictions

missing
Loss: 206.8026 IoU: 0.3079

Image 4

Ground Truth

missing

Model 1 Predictions

missing
Loss: 0.8241 IoU: 0.1044

Model 2 Predictions

missing
Loss: 185.6116 IoU: 0.1264

Image 5

Ground Truth

missing

Model 1 Predictions

missing
Loss: 0.5672 IoU: 0.0980

Model 2 Predictions

missing
Loss: 524.6437 IoU: 0.0704

Image 6

Ground Truth

missing

Model 1 Predictions

missing
Loss: 2.8086 IoU: 0.0889

Model 2 Predictions

missing
Loss: 307.2247 IoU: 0.1272

Image 7

Ground Truth

missing

Model 1 Predictions

missing
Loss: 0.3144 IoU: 0.0886

Model 2 Predictions

missing
Loss: 133.1689 IoU: 0.1513

Image 8

Ground Truth

missing

Model 1 Predictions

missing
Loss: 1.0286 IoU: 0.0620

Model 2 Predictions

missing
Loss: 187.7054 IoU: 0.3283

Image 9

Ground Truth

missing

Model 1 Predictions

missing
Loss: 0.5604 IoU: 0.0450

Model 2 Predictions

missing
Loss: 148.5974 IoU: 0.2807

Image 10

Ground Truth

missing

Model 1 Predictions

missing
Loss: 2.2660 IoU: 0.0423

Model 2 Predictions

missing
Loss: 363.4655 IoU: 0.2462

PVT Encoder Curve-Transformer Worst Images

Image 1

Ground Truth

missing

Model 1 Predictions

missing
Loss: 1.7947 IoU: 0.1771

Model 2 Predictions

missing
Loss: 293.6548 IoU: 0.1388

Image 2

Ground Truth

missing

Model 1 Predictions

missing
Loss: 0.1931 IoU: 0.2375

Model 2 Predictions

missing
Loss: 70.8681 IoU: 0.1377

Image 3

Ground Truth

missing

Model 1 Predictions

missing
Loss: 2.8086 IoU: 0.0889

Model 2 Predictions

missing
Loss: 307.2247 IoU: 0.1272

Image 4

Ground Truth

missing

Model 1 Predictions

missing
Loss: 0.8241 IoU: 0.1044

Model 2 Predictions

missing
Loss: 185.6116 IoU: 0.1264

Image 5

Ground Truth

missing

Model 1 Predictions

missing
Loss: 1.0563 IoU: 0.1742

Model 2 Predictions

missing
Loss: 210.0361 IoU: 0.1201

Image 6

Ground Truth

missing

Model 1 Predictions

missing
Loss: 1.2148 IoU: 0.1109

Model 2 Predictions

missing
Loss: 137.1669 IoU: 0.1059

Image 7

Ground Truth

missing

Model 1 Predictions

missing
Loss: 0.3998 IoU: 0.5236

Model 2 Predictions

missing
Loss: 185.2323 IoU: 0.1043

Image 8

Ground Truth

missing

Model 1 Predictions

missing
Loss: 0.0975 IoU: 0.5859

Model 2 Predictions

missing
Loss: 303.8362 IoU: 0.1029

Image 9

Ground Truth

missing

Model 1 Predictions

missing
Loss: 2.5770 IoU: 0.1189

Model 2 Predictions

missing
Loss: 337.9824 IoU: 0.0883

Image 10

Ground Truth

missing

Model 1 Predictions

missing
Loss: 0.5672 IoU: 0.0980

Model 2 Predictions

missing
Loss: 524.6437 IoU: 0.0704