Curve-Transformer Comparisons

Overall Stats

Model 1 Better: 1411
Model 2 Better: 1

PVT-GCN IoU Better

Image 1

Ground Truth

missing

Model 1 Predictions

missing
Loss: 19.9038 IoU: 0.9772 FScore: 0.6947

Model 2 Predictions

missing
Loss: nan IoU: 0.1871 FScore: 0.0000

Image 2

Ground Truth

missing

Model 1 Predictions

missing
Loss: 28.6526 IoU: 0.9451 FScore: 0.8037

Model 2 Predictions

missing
Loss: nan IoU: 0.1541 FScore: 0.0000

Image 3

Ground Truth

missing

Model 1 Predictions

missing
Loss: 20.3640 IoU: 0.9539 FScore: 0.7056

Model 2 Predictions

missing
Loss: nan IoU: 0.1624 FScore: 0.0000

Image 4

Ground Truth

missing

Model 1 Predictions

missing
Loss: 22.4353 IoU: 0.9184 FScore: 0.6501

Model 2 Predictions

missing
Loss: nan IoU: 0.1247 FScore: 1.0000

Image 5

Ground Truth

missing

Model 1 Predictions

missing
Loss: 38.8049 IoU: 0.8690 FScore: 0.4834

Model 2 Predictions

missing
Loss: nan IoU: 0.0750 FScore: 0.0000

Image 6

Ground Truth

missing

Model 1 Predictions

missing
Loss: 53.0770 IoU: 0.9366 FScore: 0.6850

Model 2 Predictions

missing
Loss: nan IoU: 0.1399 FScore: 1.0000

Image 7

Ground Truth

missing

Model 1 Predictions

missing
Loss: 18.6821 IoU: 0.9550 FScore: 0.7108

Model 2 Predictions

missing
Loss: nan IoU: 0.1582 FScore: 0.0000

Image 8

Ground Truth

missing

Model 1 Predictions

missing
Loss: 111.1036 IoU: 0.8450 FScore: 0.4864

Model 2 Predictions

missing
Loss: nan IoU: 0.0481 FScore: 0.0000

Image 9

Ground Truth

missing

Model 1 Predictions

missing
Loss: 45.1854 IoU: 0.8718 FScore: 0.7932

Model 2 Predictions

missing
Loss: nan IoU: 0.0717 FScore: 0.0000

Image 10

Ground Truth

missing

Model 1 Predictions

missing
Loss: 26.0030 IoU: 0.9485 FScore: 0.7711

Model 2 Predictions

missing
Loss: nan IoU: 0.1482 FScore: 0.0000

Image 11

Ground Truth

missing

Model 1 Predictions

missing
Loss: 17.5170 IoU: 0.9762 FScore: 0.8587

Model 2 Predictions

missing
Loss: nan IoU: 0.1705 FScore: 0.0000

Image 12

Ground Truth

missing

Model 1 Predictions

missing
Loss: 26.5606 IoU: 0.9653 FScore: 0.6095

Model 2 Predictions

missing
Loss: nan IoU: 0.1568 FScore: 0.0000

Image 13

Ground Truth

missing

Model 1 Predictions

missing
Loss: 17.3670 IoU: 0.9399 FScore: 0.8717

Model 2 Predictions

missing
Loss: nan IoU: 0.1314 FScore: 0.0000

Image 14

Ground Truth

missing

Model 1 Predictions

missing
Loss: 39.6311 IoU: 0.8613 FScore: 0.4294

Model 2 Predictions

missing
Loss: nan IoU: 0.0471 FScore: 0.0000

Image 15

Ground Truth

missing

Model 1 Predictions

missing
Loss: 72.7135 IoU: 0.8505 FScore: 0.5060

Model 2 Predictions

missing
Loss: nan IoU: 0.0343 FScore: 0.0000

Image 16

Ground Truth

missing

Model 1 Predictions

missing
Loss: 52.3124 IoU: 0.8914 FScore: 0.6102

Model 2 Predictions

missing
Loss: nan IoU: 0.0730 FScore: 0.0000

Image 17

Ground Truth

missing

Model 1 Predictions

missing
Loss: 88.9132 IoU: 0.9093 FScore: 0.5727

Model 2 Predictions

missing
Loss: nan IoU: 0.0901 FScore: 0.0000

Image 18

Ground Truth

missing

Model 1 Predictions

missing
Loss: 53.3865 IoU: 0.8542 FScore: 0.4599

Model 2 Predictions

missing
Loss: nan IoU: 0.0286 FScore: 0.0000

Image 19

Ground Truth

missing

Model 1 Predictions

missing
Loss: 31.2528 IoU: 0.8998 FScore: 0.8072

Model 2 Predictions

missing
Loss: nan IoU: 0.0642 FScore: 0.0000

Image 20

Ground Truth

missing

Model 1 Predictions

missing
Loss: 27.9129 IoU: 0.9226 FScore: 0.8526

Model 2 Predictions

missing
Loss: nan IoU: 0.0562 FScore: 0.0000

With Deepstrip Refinement Postprocessing IoU Better

Image 1

Ground Truth

missing

Model 1 Predictions

missing
Loss: 165.2363 IoU: 0.2687 FScore: 0.3793

Model 2 Predictions

missing
Loss: nan IoU: 0.6044 FScore: 0.0000

PVT-GCN FScore Better

Image 1

Ground Truth

missing

Model 1 Predictions

missing
Loss: 20.5148 IoU: 0.9292 FScore: 0.8214

Model 2 Predictions

missing
Loss: nan IoU: 0.2394 FScore: 0.0000

Image 2

Ground Truth

missing

Model 1 Predictions

missing
Loss: 23.8090 IoU: 0.9426 FScore: 0.8244

Model 2 Predictions

missing
Loss: nan IoU: 0.3863 FScore: 0.0000

Image 3

Ground Truth

missing

Model 1 Predictions

missing
Loss: 29.8657 IoU: 0.9639 FScore: 0.8276

Model 2 Predictions

missing
Loss: nan IoU: 0.3035 FScore: 0.0000

Image 4

Ground Truth

missing

Model 1 Predictions

missing
Loss: 30.4308 IoU: 0.9610 FScore: 0.8313

Model 2 Predictions

missing
Loss: nan IoU: 0.2926 FScore: 0.0000

Image 5

Ground Truth

missing

Model 1 Predictions

missing
Loss: 18.2402 IoU: 0.9556 FScore: 0.8349

Model 2 Predictions

missing
Loss: nan IoU: 0.3020 FScore: 0.0000

Image 6

Ground Truth

missing

Model 1 Predictions

missing
Loss: 14.5694 IoU: 0.9599 FScore: 0.8355

Model 2 Predictions

missing
Loss: nan IoU: 0.3556 FScore: 0.0000

Image 7

Ground Truth

missing

Model 1 Predictions

missing
Loss: 9.2925 IoU: 0.9696 FScore: 0.8391

Model 2 Predictions

missing
Loss: nan IoU: 0.3548 FScore: 0.0000

Image 8

Ground Truth

missing

Model 1 Predictions

missing
Loss: 27.9129 IoU: 0.9226 FScore: 0.8526

Model 2 Predictions

missing
Loss: nan IoU: 0.0562 FScore: 0.0000

Image 9

Ground Truth

missing

Model 1 Predictions

missing
Loss: 13.1518 IoU: 0.9673 FScore: 0.8532

Model 2 Predictions

missing
Loss: nan IoU: 0.3019 FScore: 0.0000

Image 10

Ground Truth

missing

Model 1 Predictions

missing
Loss: 13.8459 IoU: 0.9673 FScore: 0.8544

Model 2 Predictions

missing
Loss: nan IoU: 0.3057 FScore: 0.0000

Image 11

Ground Truth

missing

Model 1 Predictions

missing
Loss: 26.1241 IoU: 0.9603 FScore: 0.8544

Model 2 Predictions

missing
Loss: nan IoU: 0.3791 FScore: 0.0000

Image 12

Ground Truth

missing

Model 1 Predictions

missing
Loss: 17.5170 IoU: 0.9762 FScore: 0.8587

Model 2 Predictions

missing
Loss: nan IoU: 0.1705 FScore: 0.0000

Image 13

Ground Truth

missing

Model 1 Predictions

missing
Loss: 17.3670 IoU: 0.9399 FScore: 0.8717

Model 2 Predictions

missing
Loss: nan IoU: 0.1314 FScore: 0.0000

Image 14

Ground Truth

missing

Model 1 Predictions

missing
Loss: 36.6095 IoU: 0.9668 FScore: 0.8884

Model 2 Predictions

missing
Loss: nan IoU: 0.3574 FScore: 0.0000

Image 15

Ground Truth

missing

Model 1 Predictions

missing
Loss: 13.3305 IoU: 0.8796 FScore: 0.9023

Model 2 Predictions

missing
Loss: nan IoU: 0.1661 FScore: 0.0000

Image 16

Ground Truth

missing

Model 1 Predictions

missing
Loss: 23.8848 IoU: 0.9713 FScore: 0.9059

Model 2 Predictions

missing
Loss: nan IoU: 0.2908 FScore: 0.0000

Image 17

Ground Truth

missing

Model 1 Predictions

missing
Loss: 11.6610 IoU: 0.9548 FScore: 0.9196

Model 2 Predictions

missing
Loss: nan IoU: 0.2612 FScore: 0.0000

Image 18

Ground Truth

missing

Model 1 Predictions

missing
Loss: 19.8311 IoU: 0.9438 FScore: 0.9240

Model 2 Predictions

missing
Loss: nan IoU: 0.3648 FScore: 0.0000

Image 19

Ground Truth

missing

Model 1 Predictions

missing
Loss: 14.8792 IoU: 0.9742 FScore: 0.9323

Model 2 Predictions

missing
Loss: nan IoU: 0.3480 FScore: 0.0000

Image 20

Ground Truth

missing

Model 1 Predictions

missing
Loss: 12.0643 IoU: 0.9558 FScore: 0.9700

Model 2 Predictions

missing
Loss: nan IoU: 0.3139 FScore: 0.0000

With Deepstrip Refinement Postprocessing FScore Better

Image 1

Ground Truth

missing

Model 1 Predictions

missing
Loss: 165.2363 IoU: 0.2687 FScore: 0.3793

Model 2 Predictions

missing
Loss: nan IoU: 0.6044 FScore: 0.0000