Heedless Backbones

ViT-5 Family

Select an option
Results
Parameters (M)
Images / Second
Publication Date
Select an option
---------
Object Detection
Instance Segmentation
Classification
Semantic Segmentation
Panoptic Segmentation
Select an option
---------
ImageNet-1k
ImageNet-A
ImageNet-R
ImageNet-Sketch
ImageNet-C
ImageNet-C-bar
ImageNet-V2
ImageNet-ReaL
PASCAL VOC 2007 (val)
PASCAL VOC 2007 (test)
Select an option
----------
Top-1
Top-5
GFLOPs
Select an option
----------
224x224
384x384
512x512
Select an option
Results
Parameters (M)
Images / Second
GFLOPs
Publication Date
Select an option
---------
ImageNet-1k
ImageNet-22k
JFT-300M
JFT-3B
MegData73M
WT++London
WT++
Select an option
----------
Supervised
Sup. + TL
FCMAE
MAE
CL
MAP
Self-Distillation
Select an option
Family
Pretrain Dataset
Classification Resolution
Select an option
----------
Family
Pretrain Method
Classification Resolution
modelparams (m)pretrainfinetuneGFLOPsTop-1
ViT-5-S22.0IN-1k : Sup. : 800IN-1k : 20 : 2244.782.16
ViT-5-B87.0IN-1k : Sup. : 800IN-1k : 20 : 22417.984.16
ViT-5-B87.0IN-1k : Sup. : 800IN-1k : 20 : 38455.985.4
ViT-5-L304.0IN-1k : Sup. : 400IN-1k : 20 : 22462.884.86
ViT-5-L304.0IN-1k : Sup. : 400IN-1k : 20 : 384192.586.0
modelparams (m)pretrainfinetunegflopsIN-1k
ViT-5-S22.0IN-1k : Sup. : 800IN-1k : 20 : 2244.782.16/—
ViT-5-B87.0IN-1k : Sup. : 800IN-1k : 20 : 22417.984.16/—
ViT-5-B87.0IN-1k : Sup. : 800IN-1k : 20 : 38455.985.4/—
ViT-5-L304.0IN-1k : Sup. : 400IN-1k : 20 : 22462.884.86/—
ViT-5-L304.0IN-1k : Sup. : 400IN-1k : 20 : 384192.586.0/—

ADE20K (val)

modelpretrainheadtraingflopsmIoUmspAccmsmAccmsmIoUsspAccssmAccss
ViT-5-SIN-1k : Sup. : 800UPerNetADE20K (train) : 128 : 512None———47.5——
ViT-5-BIN-1k : Sup. : 800UPerNetADE20K (train) : 128 : 512None———49.1——
ViT-5-LIN-1k : Sup. : 400UPerNetADE20K (train) : 128 : 512None———52.0——