MVFormer Family
| model | params (m) | pretrain | finetune | GFLOPs | Top-1 |
|---|---|---|---|---|---|
| MVFormer-T | 27.0 | IN-1k : Sup. : 300 | — : — : — | 3.9 | 83.4 |
| MVFormer-T | 27.0 | IN-1k : Sup. : 300 | IN-1k : 30 : 384 | 11.5 | 84.8 |
| MVFormer-S | 40.0 | IN-1k : Sup. : 300 | — : — : — | 7.6 | 84.3 |
| MVFormer-S | 40.0 | IN-1k : Sup. : 300 | IN-1k : 30 : 384 | 22.2 | 85.6 |
| MVFormer-B | 57.0 | IN-1k : Sup. : 300 | — : — : — | 12.7 | 84.6 |
| MVFormer-B | 57.0 | IN-1k : Sup. : 300 | IN-1k : 30 : 384 | 37.4 | 85.7 |
| model | params (m) | pretrain | finetune | gflops | IN-1k |
|---|---|---|---|---|---|
| MVFormer-T | 27.0 | IN-1k : Sup. : 300 | — : — : — | 3.9 | 83.4/— |
| MVFormer-T | 27.0 | IN-1k : Sup. : 300 | IN-1k : 30 : 384 | 11.5 | 84.8/— |
| MVFormer-S | 40.0 | IN-1k : Sup. : 300 | — : — : — | 7.6 | 84.3/— |
| MVFormer-S | 40.0 | IN-1k : Sup. : 300 | IN-1k : 30 : 384 | 22.2 | 85.6/— |
| MVFormer-B | 57.0 | IN-1k : Sup. : 300 | — : — : — | 12.7 | 84.6/— |
| MVFormer-B | 57.0 | IN-1k : Sup. : 300 | IN-1k : 30 : 384 | 37.4 | 85.7/— |
COCO (val)
| model | pretrain | head | train | gflops | mAPb | APb50 | APb75 | mAPbs | mAPbm | mAPbl |
|---|---|---|---|---|---|---|---|---|---|---|
| MVFormer-T | IN-1k : Sup. : 300 | Mask R-CNN | COCO (train) : 12 | 231.0 | 46.2 | 68.4 | 50.8 | — | — | — |
| MVFormer-T | IN-1k : Sup. : 300 | RetinaNet | COCO (train) : 12 | 231.0 | 44.8 | 66.1 | 48.0 | — | — | — |
| MVFormer-T | IN-1k : Sup. : 300 | Mask R-CNN | COCO (train) : 36 | 231.0 | 47.6 | 69.1 | 52.0 | — | — | — |
| MVFormer-S | IN-1k : Sup. : 300 | Mask R-CNN | COCO (train) : 12 | 299.0 | 47.5 | 69.8 | 52.3 | — | — | — |
| MVFormer-S | IN-1k : Sup. : 300 | RetinaNet | COCO (train) : 12 | 306.0 | 45.8 | 67.2 | 49.3 | — | — | — |
COCO (val)
| model | pretrain | head | train | gflops | mAPm | APm50 | APm75 | mAPms | mAPmm | mAPml |
|---|---|---|---|---|---|---|---|---|---|---|
| MVFormer-T | IN-1k : Sup. : 300 | Mask R-CNN | COCO (train) : 12 | 231.0 | 42.1 | 65.4 | 45.2 | — | — | — |
| MVFormer-T | IN-1k : Sup. : 300 | Mask R-CNN | COCO (train) : 36 | 231.0 | 43.1 | 66.2 | 46.5 | — | — | — |
| MVFormer-S | IN-1k : Sup. : 300 | Mask R-CNN | COCO (train) : 12 | 299.0 | 43.0 | 66.8 | 46.3 | — | — | — |
ADE20K (val)
| model | pretrain | head | train | gflops | mIoUms | pAccms | mAccms | mIoUss | pAccss | mAccss |
|---|---|---|---|---|---|---|---|---|---|---|
| MVFormer-T | IN-1k : Sup. : 300 | Panoptic FPN | ADE20K (train) : 64 : 512 | 42.0 | — | — | — | 47.1 | — | — |
| MVFormer-S | IN-1k : Sup. : 300 | Panoptic FPN | ADE20K (train) : 64 : 512 | 61.0 | — | — | — | 48.8 | — | — |