Curve-Transformer Comparisons

Overall Stats

Model 1 Better: 3016
Model 2 Better: 5424

DINO Encoder Curve-Transformer Performed Better

Image 1

Ground Truth

missing

Model 1 Predictions

missing
Loss: 78.7555 IoU: 0.7870

Model 2 Predictions

missing
Loss: 203.2796 IoU: 0.4093

Model 1 Attentions

Model 2 Attentions

Image 2

Ground Truth

missing

Model 1 Predictions

missing
Loss: 63.3278 IoU: 0.7079

Model 2 Predictions

missing
Loss: 224.5694 IoU: 0.3219

Model 1 Attentions

Model 2 Attentions

Image 3

Ground Truth

missing

Model 1 Predictions

missing
Loss: 141.0778 IoU: 0.4737

Model 2 Predictions

missing
Loss: 296.1404 IoU: 0.0871

Model 1 Attentions

Model 2 Attentions

Image 4

Ground Truth

missing

Model 1 Predictions

missing
Loss: 113.2790 IoU: 0.8405

Model 2 Predictions

missing
Loss: 169.4550 IoU: 0.4397

Model 1 Attentions

Model 2 Attentions

Image 5

Ground Truth

missing

Model 1 Predictions

missing
Loss: 66.7407 IoU: 0.8066

Model 2 Predictions

missing
Loss: 179.9185 IoU: 0.4045

Model 1 Attentions

Model 2 Attentions

Image 6

Ground Truth

missing

Model 1 Predictions

missing
Loss: 204.5705 IoU: 0.7728

Model 2 Predictions

missing
Loss: 333.3863 IoU: 0.3660

Model 1 Attentions

Model 2 Attentions

Image 7

Ground Truth

missing

Model 1 Predictions

missing
Loss: 53.1485 IoU: 0.5110

Model 2 Predictions

missing
Loss: 204.4821 IoU: 0.0978

Model 1 Attentions

Model 2 Attentions

Image 8

Ground Truth

missing

Model 1 Predictions

missing
Loss: 93.6676 IoU: 0.6056

Model 2 Predictions

missing
Loss: 395.9470 IoU: 0.1213

Model 1 Attentions

Model 2 Attentions

Image 9

Ground Truth

missing

Model 1 Predictions

missing
Loss: 60.3159 IoU: 0.5769

Model 2 Predictions

missing
Loss: 353.7191 IoU: 0.0000

Model 1 Attentions

Model 2 Attentions

Image 10

Ground Truth

missing

Model 1 Predictions

missing
Loss: 45.4824 IoU: 0.6381

Model 2 Predictions

missing
Loss: 271.7876 IoU: 0.0254

Model 1 Attentions

Model 2 Attentions

PVT Encoder Curve-Transformer Performed Better

Image 1

Ground Truth

missing

Model 1 Predictions

missing
Loss: 370.5241 IoU: 0.0700

Model 2 Predictions

missing
Loss: 151.0313 IoU: 0.5751

Model 1 Attentions

Model 2 Attentions

Image 2

Ground Truth

missing

Model 1 Predictions

missing
Loss: 280.8731 IoU: 0.2753

Model 2 Predictions

missing
Loss: 36.2864 IoU: 0.7990

Model 1 Attentions

Model 2 Attentions

Image 3

Ground Truth

missing

Model 1 Predictions

missing
Loss: 340.4596 IoU: 0.0750

Model 2 Predictions

missing
Loss: 28.1090 IoU: 0.6207

Model 1 Attentions

Model 2 Attentions

Image 4

Ground Truth

missing

Model 1 Predictions

missing
Loss: 367.0681 IoU: 0.2875

Model 2 Predictions

missing
Loss: 94.4373 IoU: 0.8339

Model 1 Attentions

Model 2 Attentions

Image 5

Ground Truth

missing

Model 1 Predictions

missing
Loss: 190.7424 IoU: 0.1637

Model 2 Predictions

missing
Loss: 73.8950 IoU: 0.7254

Model 1 Attentions

Model 2 Attentions

Image 6

Ground Truth

missing

Model 1 Predictions

missing
Loss: 114.3458 IoU: 0.3545

Model 2 Predictions

missing
Loss: 22.1989 IoU: 0.9209

Model 1 Attentions

Model 2 Attentions

Image 7

Ground Truth

missing

Model 1 Predictions

missing
Loss: 256.2527 IoU: 0.3074

Model 2 Predictions

missing
Loss: 37.8465 IoU: 0.8954

Model 1 Attentions

Model 2 Attentions

Image 8

Ground Truth

missing

Model 1 Predictions

missing
Loss: 312.0289 IoU: 0.0403

Model 2 Predictions

missing
Loss: 108.5727 IoU: 0.6432

Model 1 Attentions

Model 2 Attentions

Image 9

Ground Truth

missing

Model 1 Predictions

missing
Loss: 163.7357 IoU: 0.2361

Model 2 Predictions

missing
Loss: 28.6220 IoU: 0.8642

Model 1 Attentions

Model 2 Attentions

Image 10

Ground Truth

missing

Model 1 Predictions

missing
Loss: 203.3000 IoU: 0.2670

Model 2 Predictions

missing
Loss: 16.6887 IoU: 0.9335

Model 1 Attentions

Model 2 Attentions

DINO Encoder Curve-Transformer Best Images

Image 1

Ground Truth

missing

Model 1 Predictions

missing
Loss: 23.2058 IoU: 0.9730

Model 2 Predictions

missing
Loss: 22.4710 IoU: 0.9719

Model 1 Attentions

Model 2 Attentions

Image 2

Ground Truth

missing

Model 1 Predictions

missing
Loss: 24.1320 IoU: 0.9734

Model 2 Predictions

missing
Loss: 29.2866 IoU: 0.9618

Model 1 Attentions

Model 2 Attentions

Image 3

Ground Truth

missing

Model 1 Predictions

missing
Loss: 16.4441 IoU: 0.9735

Model 2 Predictions

missing
Loss: 12.4911 IoU: 0.9786

Model 1 Attentions

Model 2 Attentions

Image 4

Ground Truth

missing

Model 1 Predictions

missing
Loss: 10.9210 IoU: 0.9735

Model 2 Predictions

missing
Loss: 11.1700 IoU: 0.9748

Model 1 Attentions

Model 2 Attentions

Image 5

Ground Truth

missing

Model 1 Predictions

missing
Loss: 37.2019 IoU: 0.9736

Model 2 Predictions

missing
Loss: 29.5396 IoU: 0.9743

Model 1 Attentions

Model 2 Attentions

Image 6

Ground Truth

missing

Model 1 Predictions

missing
Loss: 16.6639 IoU: 0.9740

Model 2 Predictions

missing
Loss: 13.0480 IoU: 0.9759

Model 1 Attentions

Model 2 Attentions

Image 7

Ground Truth

missing

Model 1 Predictions

missing
Loss: 13.3710 IoU: 0.9746

Model 2 Predictions

missing
Loss: 16.1932 IoU: 0.9750

Model 1 Attentions

Model 2 Attentions

Image 8

Ground Truth

missing

Model 1 Predictions

missing
Loss: 13.8714 IoU: 0.9764

Model 2 Predictions

missing
Loss: 17.0057 IoU: 0.9715

Model 1 Attentions

Model 2 Attentions

Image 9

Ground Truth

missing

Model 1 Predictions

missing
Loss: 18.2236 IoU: 0.9766

Model 2 Predictions

missing
Loss: 14.6929 IoU: 0.9768

Model 1 Attentions

Model 2 Attentions

Image 10

Ground Truth

missing

Model 1 Predictions

missing
Loss: 16.7071 IoU: 0.9767

Model 2 Predictions

missing
Loss: 17.4993 IoU: 0.9695

Model 1 Attentions

Model 2 Attentions

PVT Encoder Curve-Transformer Best Images

Image 1

Ground Truth

missing

Model 1 Predictions

missing
Loss: 23.5529 IoU: 0.9621

Model 2 Predictions

missing
Loss: 11.2433 IoU: 0.9755

Model 1 Attentions

Model 2 Attentions

Image 2

Ground Truth

missing

Model 1 Predictions

missing
Loss: 22.8419 IoU: 0.9625

Model 2 Predictions

missing
Loss: 17.8259 IoU: 0.9758

Model 1 Attentions

Model 2 Attentions

Image 3

Ground Truth

missing

Model 1 Predictions

missing
Loss: 16.6639 IoU: 0.9740

Model 2 Predictions

missing
Loss: 13.0480 IoU: 0.9759

Model 1 Attentions

Model 2 Attentions

Image 4

Ground Truth

missing

Model 1 Predictions

missing
Loss: 17.9466 IoU: 0.9702

Model 2 Predictions

missing
Loss: 9.2378 IoU: 0.9764

Model 1 Attentions

Model 2 Attentions

Image 5

Ground Truth

missing

Model 1 Predictions

missing
Loss: 16.8203 IoU: 0.9645

Model 2 Predictions

missing
Loss: 17.2246 IoU: 0.9765

Model 1 Attentions

Model 2 Attentions

Image 6

Ground Truth

missing

Model 1 Predictions

missing
Loss: 18.2236 IoU: 0.9766

Model 2 Predictions

missing
Loss: 14.6929 IoU: 0.9768

Model 1 Attentions

Model 2 Attentions

Image 7

Ground Truth

missing

Model 1 Predictions

missing
Loss: 16.1611 IoU: 0.9729

Model 2 Predictions

missing
Loss: 13.7035 IoU: 0.9776

Model 1 Attentions

Model 2 Attentions

Image 8

Ground Truth

missing

Model 1 Predictions

missing
Loss: 16.1548 IoU: 0.9699

Model 2 Predictions

missing
Loss: 17.7513 IoU: 0.9780

Model 1 Attentions

Model 2 Attentions

Image 9

Ground Truth

missing

Model 1 Predictions

missing
Loss: 16.4441 IoU: 0.9735

Model 2 Predictions

missing
Loss: 12.4911 IoU: 0.9786

Model 1 Attentions

Model 2 Attentions

Image 10

Ground Truth

missing

Model 1 Predictions

missing
Loss: 23.4808 IoU: 0.9612

Model 2 Predictions

missing
Loss: 12.6702 IoU: 0.9811

Model 1 Attentions

Model 2 Attentions

DINO Encoder Curve-Transformer Worst Images

Image 1

Ground Truth

missing

Model 1 Predictions

missing
Loss: 390.4946 IoU: 0.0755

Model 2 Predictions

missing
Loss: 223.9939 IoU: 0.1604

Model 1 Attentions

Model 2 Attentions

Image 2

Ground Truth

missing

Model 1 Predictions

missing
Loss: 340.4596 IoU: 0.0750

Model 2 Predictions

missing
Loss: 28.1090 IoU: 0.6207

Model 1 Attentions

Model 2 Attentions

Image 3

Ground Truth

missing

Model 1 Predictions

missing
Loss: 318.9472 IoU: 0.0729

Model 2 Predictions

missing
Loss: 190.3674 IoU: 0.4497

Model 1 Attentions

Model 2 Attentions

Image 4

Ground Truth

missing

Model 1 Predictions

missing
Loss: 370.5241 IoU: 0.0700

Model 2 Predictions

missing
Loss: 151.0313 IoU: 0.5751

Model 1 Attentions

Model 2 Attentions

Image 5

Ground Truth

missing

Model 1 Predictions

missing
Loss: 313.9402 IoU: 0.0696

Model 2 Predictions

missing
Loss: 197.5710 IoU: 0.0796

Model 1 Attentions

Model 2 Attentions

Image 6

Ground Truth

missing

Model 1 Predictions

missing
Loss: 242.4600 IoU: 0.0557

Model 2 Predictions

missing
Loss: 225.3386 IoU: 0.2502

Model 1 Attentions

Model 2 Attentions

Image 7

Ground Truth

missing

Model 1 Predictions

missing
Loss: 274.0660 IoU: 0.0490

Model 2 Predictions

missing
Loss: 230.6425 IoU: 0.1466

Model 1 Attentions

Model 2 Attentions

Image 8

Ground Truth

missing

Model 1 Predictions

missing
Loss: 399.3006 IoU: 0.0476

Model 2 Predictions

missing
Loss: 449.6224 IoU: 0.0606

Model 1 Attentions

Model 2 Attentions

Image 9

Ground Truth

missing

Model 1 Predictions

missing
Loss: 312.0289 IoU: 0.0403

Model 2 Predictions

missing
Loss: 108.5727 IoU: 0.6432

Model 1 Attentions

Model 2 Attentions

Image 10

Ground Truth

missing

Model 1 Predictions

missing
Loss: 286.6693 IoU: 0.0038

Model 2 Predictions

missing
Loss: 233.4353 IoU: 0.1509

Model 1 Attentions

Model 2 Attentions

PVT Encoder Curve-Transformer Worst Images

Image 1

Ground Truth

missing

Model 1 Predictions

missing
Loss: 313.9402 IoU: 0.0696

Model 2 Predictions

missing
Loss: 197.5710 IoU: 0.0796

Model 1 Attentions

Model 2 Attentions

Image 2

Ground Truth

missing

Model 1 Predictions

missing
Loss: 125.4571 IoU: 0.1892

Model 2 Predictions

missing
Loss: 188.2731 IoU: 0.0739

Model 1 Attentions

Model 2 Attentions

Image 3

Ground Truth

missing

Model 1 Predictions

missing
Loss: 296.8464 IoU: 0.2033

Model 2 Predictions

missing
Loss: 354.6714 IoU: 0.0685

Model 1 Attentions

Model 2 Attentions

Image 4

Ground Truth

missing

Model 1 Predictions

missing
Loss: 399.3006 IoU: 0.0476

Model 2 Predictions

missing
Loss: 449.6224 IoU: 0.0606

Model 1 Attentions

Model 2 Attentions

Image 5

Ground Truth

missing

Model 1 Predictions

missing
Loss: 58.3273 IoU: 0.4261

Model 2 Predictions

missing
Loss: 213.5687 IoU: 0.0560

Model 1 Attentions

Model 2 Attentions

Image 6

Ground Truth

missing

Model 1 Predictions

missing
Loss: 252.9319 IoU: 0.1531

Model 2 Predictions

missing
Loss: 335.3914 IoU: 0.0431

Model 1 Attentions

Model 2 Attentions

Image 7

Ground Truth

missing

Model 1 Predictions

missing
Loss: 45.4824 IoU: 0.6381

Model 2 Predictions

missing
Loss: 271.7876 IoU: 0.0254

Model 1 Attentions

Model 2 Attentions

Image 8

Ground Truth

missing

Model 1 Predictions

missing
Loss: 171.1300 IoU: 0.2195

Model 2 Predictions

missing
Loss: 261.8976 IoU: 0.0245

Model 1 Attentions

Model 2 Attentions

Image 9

Ground Truth

missing

Model 1 Predictions

missing
Loss: 101.5741 IoU: 0.2645

Model 2 Predictions

missing
Loss: 310.0575 IoU: 0.0033

Model 1 Attentions

Model 2 Attentions

Image 10

Ground Truth

missing

Model 1 Predictions

missing
Loss: 60.3159 IoU: 0.5769

Model 2 Predictions

missing
Loss: 353.7191 IoU: 0.0000

Model 1 Attentions

Model 2 Attentions