Curve-Transformer Comparisons
Overall Stats
Model 1 Better: 3016
Model 2 Better: 5424
DINO Encoder Curve-Transformer Performed Better
Image 1
Ground Truth
Model 1 Predictions
Loss: 78.7555 IoU: 0.7870
Model 2 Predictions
Loss: 203.2796 IoU: 0.4093
Model 1 Attentions
Show Attentions
Model 2 Attentions
Show Attentions
Image 2
Ground Truth
Model 1 Predictions
Loss: 63.3278 IoU: 0.7079
Model 2 Predictions
Loss: 224.5694 IoU: 0.3219
Model 1 Attentions
Show Attentions
Model 2 Attentions
Show Attentions
Image 3
Ground Truth
Model 1 Predictions
Loss: 141.0778 IoU: 0.4737
Model 2 Predictions
Loss: 296.1404 IoU: 0.0871
Model 1 Attentions
Show Attentions
Model 2 Attentions
Show Attentions
Image 4
Ground Truth
Model 1 Predictions
Loss: 113.2790 IoU: 0.8405
Model 2 Predictions
Loss: 169.4550 IoU: 0.4397
Model 1 Attentions
Show Attentions
Model 2 Attentions
Show Attentions
Image 5
Ground Truth
Model 1 Predictions
Loss: 66.7407 IoU: 0.8066
Model 2 Predictions
Loss: 179.9185 IoU: 0.4045
Model 1 Attentions
Show Attentions
Model 2 Attentions
Show Attentions
Image 6
Ground Truth
Model 1 Predictions
Loss: 204.5705 IoU: 0.7728
Model 2 Predictions
Loss: 333.3863 IoU: 0.3660
Model 1 Attentions
Show Attentions
Model 2 Attentions
Show Attentions
Image 7
Ground Truth
Model 1 Predictions
Loss: 53.1485 IoU: 0.5110
Model 2 Predictions
Loss: 204.4821 IoU: 0.0978
Model 1 Attentions
Show Attentions
Model 2 Attentions
Show Attentions
Image 8
Ground Truth
Model 1 Predictions
Loss: 93.6676 IoU: 0.6056
Model 2 Predictions
Loss: 395.9470 IoU: 0.1213
Model 1 Attentions
Show Attentions
Model 2 Attentions
Show Attentions
Image 9
Ground Truth
Model 1 Predictions
Loss: 60.3159 IoU: 0.5769
Model 2 Predictions
Loss: 353.7191 IoU: 0.0000
Model 1 Attentions
Show Attentions
Model 2 Attentions
Show Attentions
Image 10
Ground Truth
Model 1 Predictions
Loss: 45.4824 IoU: 0.6381
Model 2 Predictions
Loss: 271.7876 IoU: 0.0254
Model 1 Attentions
Show Attentions
Model 2 Attentions
Show Attentions
PVT Encoder Curve-Transformer Performed Better
Image 1
Ground Truth
Model 1 Predictions
Loss: 370.5241 IoU: 0.0700
Model 2 Predictions
Loss: 151.0313 IoU: 0.5751
Model 1 Attentions
Show Attentions
Model 2 Attentions
Show Attentions
Image 2
Ground Truth
Model 1 Predictions
Loss: 280.8731 IoU: 0.2753
Model 2 Predictions
Loss: 36.2864 IoU: 0.7990
Model 1 Attentions
Show Attentions
Model 2 Attentions
Show Attentions
Image 3
Ground Truth
Model 1 Predictions
Loss: 340.4596 IoU: 0.0750
Model 2 Predictions
Loss: 28.1090 IoU: 0.6207
Model 1 Attentions
Show Attentions
Model 2 Attentions
Show Attentions
Image 4
Ground Truth
Model 1 Predictions
Loss: 367.0681 IoU: 0.2875
Model 2 Predictions
Loss: 94.4373 IoU: 0.8339
Model 1 Attentions
Show Attentions
Model 2 Attentions
Show Attentions
Image 5
Ground Truth
Model 1 Predictions
Loss: 190.7424 IoU: 0.1637
Model 2 Predictions
Loss: 73.8950 IoU: 0.7254
Model 1 Attentions
Show Attentions
Model 2 Attentions
Show Attentions
Image 6
Ground Truth
Model 1 Predictions
Loss: 114.3458 IoU: 0.3545
Model 2 Predictions
Loss: 22.1989 IoU: 0.9209
Model 1 Attentions
Show Attentions
Model 2 Attentions
Show Attentions
Image 7
Ground Truth
Model 1 Predictions
Loss: 256.2527 IoU: 0.3074
Model 2 Predictions
Loss: 37.8465 IoU: 0.8954
Model 1 Attentions
Show Attentions
Model 2 Attentions
Show Attentions
Image 8
Ground Truth
Model 1 Predictions
Loss: 312.0289 IoU: 0.0403
Model 2 Predictions
Loss: 108.5727 IoU: 0.6432
Model 1 Attentions
Show Attentions
Model 2 Attentions
Show Attentions
Image 9
Ground Truth
Model 1 Predictions
Loss: 163.7357 IoU: 0.2361
Model 2 Predictions
Loss: 28.6220 IoU: 0.8642
Model 1 Attentions
Show Attentions
Model 2 Attentions
Show Attentions
Image 10
Ground Truth
Model 1 Predictions
Loss: 203.3000 IoU: 0.2670
Model 2 Predictions
Loss: 16.6887 IoU: 0.9335
Model 1 Attentions
Show Attentions
Model 2 Attentions
Show Attentions
DINO Encoder Curve-Transformer Best Images
Image 1
Ground Truth
Model 1 Predictions
Loss: 23.2058 IoU: 0.9730
Model 2 Predictions
Loss: 22.4710 IoU: 0.9719
Model 1 Attentions
Show Attentions
Model 2 Attentions
Show Attentions
Image 2
Ground Truth
Model 1 Predictions
Loss: 24.1320 IoU: 0.9734
Model 2 Predictions
Loss: 29.2866 IoU: 0.9618
Model 1 Attentions
Show Attentions
Model 2 Attentions
Show Attentions
Image 3
Ground Truth
Model 1 Predictions
Loss: 16.4441 IoU: 0.9735
Model 2 Predictions
Loss: 12.4911 IoU: 0.9786
Model 1 Attentions
Show Attentions
Model 2 Attentions
Show Attentions
Image 4
Ground Truth
Model 1 Predictions
Loss: 10.9210 IoU: 0.9735
Model 2 Predictions
Loss: 11.1700 IoU: 0.9748
Model 1 Attentions
Show Attentions
Model 2 Attentions
Show Attentions
Image 5
Ground Truth
Model 1 Predictions
Loss: 37.2019 IoU: 0.9736
Model 2 Predictions
Loss: 29.5396 IoU: 0.9743
Model 1 Attentions
Show Attentions
Model 2 Attentions
Show Attentions
Image 6
Ground Truth
Model 1 Predictions
Loss: 16.6639 IoU: 0.9740
Model 2 Predictions
Loss: 13.0480 IoU: 0.9759
Model 1 Attentions
Show Attentions
Model 2 Attentions
Show Attentions
Image 7
Ground Truth
Model 1 Predictions
Loss: 13.3710 IoU: 0.9746
Model 2 Predictions
Loss: 16.1932 IoU: 0.9750
Model 1 Attentions
Show Attentions
Model 2 Attentions
Show Attentions
Image 8
Ground Truth
Model 1 Predictions
Loss: 13.8714 IoU: 0.9764
Model 2 Predictions
Loss: 17.0057 IoU: 0.9715
Model 1 Attentions
Show Attentions
Model 2 Attentions
Show Attentions
Image 9
Ground Truth
Model 1 Predictions
Loss: 18.2236 IoU: 0.9766
Model 2 Predictions
Loss: 14.6929 IoU: 0.9768
Model 1 Attentions
Show Attentions
Model 2 Attentions
Show Attentions
Image 10
Ground Truth
Model 1 Predictions
Loss: 16.7071 IoU: 0.9767
Model 2 Predictions
Loss: 17.4993 IoU: 0.9695
Model 1 Attentions
Show Attentions
Model 2 Attentions
Show Attentions
PVT Encoder Curve-Transformer Best Images
Image 1
Ground Truth
Model 1 Predictions
Loss: 23.5529 IoU: 0.9621
Model 2 Predictions
Loss: 11.2433 IoU: 0.9755
Model 1 Attentions
Show Attentions
Model 2 Attentions
Show Attentions
Image 2
Ground Truth
Model 1 Predictions
Loss: 22.8419 IoU: 0.9625
Model 2 Predictions
Loss: 17.8259 IoU: 0.9758
Model 1 Attentions
Show Attentions
Model 2 Attentions
Show Attentions
Image 3
Ground Truth
Model 1 Predictions
Loss: 16.6639 IoU: 0.9740
Model 2 Predictions
Loss: 13.0480 IoU: 0.9759
Model 1 Attentions
Show Attentions
Model 2 Attentions
Show Attentions
Image 4
Ground Truth
Model 1 Predictions
Loss: 17.9466 IoU: 0.9702
Model 2 Predictions
Loss: 9.2378 IoU: 0.9764
Model 1 Attentions
Show Attentions
Model 2 Attentions
Show Attentions
Image 5
Ground Truth
Model 1 Predictions
Loss: 16.8203 IoU: 0.9645
Model 2 Predictions
Loss: 17.2246 IoU: 0.9765
Model 1 Attentions
Show Attentions
Model 2 Attentions
Show Attentions
Image 6
Ground Truth
Model 1 Predictions
Loss: 18.2236 IoU: 0.9766
Model 2 Predictions
Loss: 14.6929 IoU: 0.9768
Model 1 Attentions
Show Attentions
Model 2 Attentions
Show Attentions
Image 7
Ground Truth
Model 1 Predictions
Loss: 16.1611 IoU: 0.9729
Model 2 Predictions
Loss: 13.7035 IoU: 0.9776
Model 1 Attentions
Show Attentions
Model 2 Attentions
Show Attentions
Image 8
Ground Truth
Model 1 Predictions
Loss: 16.1548 IoU: 0.9699
Model 2 Predictions
Loss: 17.7513 IoU: 0.9780
Model 1 Attentions
Show Attentions
Model 2 Attentions
Show Attentions
Image 9
Ground Truth
Model 1 Predictions
Loss: 16.4441 IoU: 0.9735
Model 2 Predictions
Loss: 12.4911 IoU: 0.9786
Model 1 Attentions
Show Attentions
Model 2 Attentions
Show Attentions
Image 10
Ground Truth
Model 1 Predictions
Loss: 23.4808 IoU: 0.9612
Model 2 Predictions
Loss: 12.6702 IoU: 0.9811
Model 1 Attentions
Show Attentions
Model 2 Attentions
Show Attentions
DINO Encoder Curve-Transformer Worst Images
Image 1
Ground Truth
Model 1 Predictions
Loss: 390.4946 IoU: 0.0755
Model 2 Predictions
Loss: 223.9939 IoU: 0.1604
Model 1 Attentions
Show Attentions
Model 2 Attentions
Show Attentions
Image 2
Ground Truth
Model 1 Predictions
Loss: 340.4596 IoU: 0.0750
Model 2 Predictions
Loss: 28.1090 IoU: 0.6207
Model 1 Attentions
Show Attentions
Model 2 Attentions
Show Attentions
Image 3
Ground Truth
Model 1 Predictions
Loss: 318.9472 IoU: 0.0729
Model 2 Predictions
Loss: 190.3674 IoU: 0.4497
Model 1 Attentions
Show Attentions
Model 2 Attentions
Show Attentions
Image 4
Ground Truth
Model 1 Predictions
Loss: 370.5241 IoU: 0.0700
Model 2 Predictions
Loss: 151.0313 IoU: 0.5751
Model 1 Attentions
Show Attentions
Model 2 Attentions
Show Attentions
Image 5
Ground Truth
Model 1 Predictions
Loss: 313.9402 IoU: 0.0696
Model 2 Predictions
Loss: 197.5710 IoU: 0.0796
Model 1 Attentions
Show Attentions
Model 2 Attentions
Show Attentions
Image 6
Ground Truth
Model 1 Predictions
Loss: 242.4600 IoU: 0.0557
Model 2 Predictions
Loss: 225.3386 IoU: 0.2502
Model 1 Attentions
Show Attentions
Model 2 Attentions
Show Attentions
Image 7
Ground Truth
Model 1 Predictions
Loss: 274.0660 IoU: 0.0490
Model 2 Predictions
Loss: 230.6425 IoU: 0.1466
Model 1 Attentions
Show Attentions
Model 2 Attentions
Show Attentions
Image 8
Ground Truth
Model 1 Predictions
Loss: 399.3006 IoU: 0.0476
Model 2 Predictions
Loss: 449.6224 IoU: 0.0606
Model 1 Attentions
Show Attentions
Model 2 Attentions
Show Attentions
Image 9
Ground Truth
Model 1 Predictions
Loss: 312.0289 IoU: 0.0403
Model 2 Predictions
Loss: 108.5727 IoU: 0.6432
Model 1 Attentions
Show Attentions
Model 2 Attentions
Show Attentions
Image 10
Ground Truth
Model 1 Predictions
Loss: 286.6693 IoU: 0.0038
Model 2 Predictions
Loss: 233.4353 IoU: 0.1509
Model 1 Attentions
Show Attentions
Model 2 Attentions
Show Attentions
PVT Encoder Curve-Transformer Worst Images
Image 1
Ground Truth
Model 1 Predictions
Loss: 313.9402 IoU: 0.0696
Model 2 Predictions
Loss: 197.5710 IoU: 0.0796
Model 1 Attentions
Show Attentions
Model 2 Attentions
Show Attentions
Image 2
Ground Truth
Model 1 Predictions
Loss: 125.4571 IoU: 0.1892
Model 2 Predictions
Loss: 188.2731 IoU: 0.0739
Model 1 Attentions
Show Attentions
Model 2 Attentions
Show Attentions
Image 3
Ground Truth
Model 1 Predictions
Loss: 296.8464 IoU: 0.2033
Model 2 Predictions
Loss: 354.6714 IoU: 0.0685
Model 1 Attentions
Show Attentions
Model 2 Attentions
Show Attentions
Image 4
Ground Truth
Model 1 Predictions
Loss: 399.3006 IoU: 0.0476
Model 2 Predictions
Loss: 449.6224 IoU: 0.0606
Model 1 Attentions
Show Attentions
Model 2 Attentions
Show Attentions
Image 5
Ground Truth
Model 1 Predictions
Loss: 58.3273 IoU: 0.4261
Model 2 Predictions
Loss: 213.5687 IoU: 0.0560
Model 1 Attentions
Show Attentions
Model 2 Attentions
Show Attentions
Image 6
Ground Truth
Model 1 Predictions
Loss: 252.9319 IoU: 0.1531
Model 2 Predictions
Loss: 335.3914 IoU: 0.0431
Model 1 Attentions
Show Attentions
Model 2 Attentions
Show Attentions
Image 7
Ground Truth
Model 1 Predictions
Loss: 45.4824 IoU: 0.6381
Model 2 Predictions
Loss: 271.7876 IoU: 0.0254
Model 1 Attentions
Show Attentions
Model 2 Attentions
Show Attentions
Image 8
Ground Truth
Model 1 Predictions
Loss: 171.1300 IoU: 0.2195
Model 2 Predictions
Loss: 261.8976 IoU: 0.0245
Model 1 Attentions
Show Attentions
Model 2 Attentions
Show Attentions
Image 9
Ground Truth
Model 1 Predictions
Loss: 101.5741 IoU: 0.2645
Model 2 Predictions
Loss: 310.0575 IoU: 0.0033
Model 1 Attentions
Show Attentions
Model 2 Attentions
Show Attentions
Image 10
Ground Truth
Model 1 Predictions
Loss: 60.3159 IoU: 0.5769
Model 2 Predictions
Loss: 353.7191 IoU: 0.0000
Model 1 Attentions
Show Attentions
Model 2 Attentions
Show Attentions