Panoptic FPN

Paper | GitHub

axis

Select an option

Results

Parameters (M)

Images / Second

Publication Date

task

Select an option

---------

Instance Segmentation

Semantic Segmentation

Panoptic Segmentation

dataset

Select an option

---------

Cityscapes (val)

Cityscapes (test)

ADE20K (val)

ADE20K (test)

PASCAL VOC 2007 (val)

PASCAL VOC 2007 (test)

metric

Select an option

mIoU^ms

pAcc^ms

mAcc^ms

mIoU^ss

pAcc^ss

mAcc^ss

GFLOPs

resolution

Select an option

----------

512x2048

640x2560

axis

Select an option

Results

Parameters (M)

Images / Second

GFLOPs

Publication Date

Filters

pretrain dataset

Select an option

---------

ImageNet-1k

ImageNet-22k

JFT-300M

JFT-3B

MegData73M

pretrain method

Select an option

----------

Supervised

Sup. + TL

FCMAE

MAE

MAP

Legend

Legend attribute

Select an option

Family

Pretrain Dataset

Pretrain Method

Semantic Segmentation Head

Semantic Segmentation Resolution

Semantic Segmentation Training Epochs

Legend attribute (second)

Select an option

----------

Pretrain Dataset

Pretrain Method

Semantic Segmentation Head

Semantic Segmentation Resolution

Semantic Segmentation Training Epochs

family	model	params (m)	pretrain	head	train	GFLOPs	mIoU^ms
AnchorFormer	AnchorFormer-T	4.2	IN-1k : Sup. : 300	Panoptic FPN	ADE20K (train) : 128 : 512	193.7	43.81
DAT	DAT-S	50.0	IN-1k : Sup. : 300	Panoptic FPN	ADE20K (train) : 32 : 512	320.0	48.46
DAT++	DAT-B++	93.0	IN-1k : Sup. : 300	Panoptic FPN	ADE20K (train) : 64 : 512	508.0	51.1
DAT	DAT-B	88.0	IN-1k : Sup. : 300	Panoptic FPN	ADE20K (train) : 32 : 512	481.0	49.01
DAT++	DAT-S++	53.0	IN-1k : Sup. : 300	Panoptic FPN	ADE20K (train) : 64 : 512	339.0	50.7
DAT++	DAT-T++	24.0	IN-1k : Sup. : 300	Panoptic FPN	ADE20K (train) : 64 : 512	212.0	48.8
DAT	DAT-T	29.0	IN-1k : Sup. : 300	Panoptic FPN	ADE20K (train) : 32 : 512	198.0	44.22

ADE20K (val)

family	model	pretrain	train	gflops	mIoU^ms	pAcc^ms	mAcc^ms	mIoU^ss	pAcc^ss	mAcc^ss
Swin	Swin-T	IN-1k : Sup. : 300	ADE20K (train) : 64 : 512	182.0	—	—	—	41.5	—	—
Swin	Swin-B	IN-1k : Sup. : 300	ADE20K (train) : 64 : 512	422.0	—	—	—	46.0	—	—
Swin	Swin-S	IN-1k : Sup. : 300	ADE20K (train) : 64 : 512	274.0	—	—	—	45.2	—	—
CSWin	CSWin-T	IN-1k : Sup. : 300	ADE20K (train) : 64 : 512	202.0	—	—	—	48.2	—	—
CSWin	CSWin-S	IN-1k : Sup. : 300	ADE20K (train) : 64 : 512	271.0	—	—	—	49.2	—	—
CSWin	CSWin-B	IN-1k : Sup. : 300	ADE20K (train) : 64 : 512	464.0	—	—	—	49.9	—	—
BiFormer	BiFormer-S	IN-1k : Sup. : 300	ADE20K (train) : 128 : 512	None	—	—	—	48.9	—	—
BiFormer	BiFormer-B	IN-1k : Sup. : 300	ADE20K (train) : 128 : 512	None	—	—	—	49.9	—	—
RMT	RMT-T	IN-1k : Sup. : 300	ADE20K (train) : 64 : 512	33.7	—	—	—	46.4	—	—
RMT	RMT-S	IN-1k : Sup. : 300	ADE20K (train) : 64 : 512	180.0	—	—	—	49.4	—	—
RMT	RMT-B	IN-1k : Sup. : 300	ADE20K (train) : 64 : 512	294.0	—	—	—	50.4	—	—
RMT	RMT-L	IN-1k : Sup. : 300	ADE20K (train) : 64 : 512	482.0	—	—	—	51.4	—	—
DAT++	DAT-T++	IN-1k : Sup. : 300	ADE20K (train) : 64 : 512	212.0	48.8	—	—	48.4	—	—
DAT++	DAT-S++	IN-1k : Sup. : 300	ADE20K (train) : 64 : 512	339.0	50.7	—	—	49.9	—	—
DAT++	DAT-B++	IN-1k : Sup. : 300	ADE20K (train) : 64 : 512	508.0	51.1	—	—	50.4	—	—
DAT	DAT-T	IN-1k : Sup. : 300	ADE20K (train) : 32 : 512	198.0	44.22	—	—	42.56	—	54.72
DAT	DAT-S	IN-1k : Sup. : 300	ADE20K (train) : 32 : 512	320.0	48.46	—	—	46.08	—	58.17
DAT	DAT-B	IN-1k : Sup. : 300	ADE20K (train) : 32 : 512	481.0	49.01	—	—	47.02	—	59.47
SSViT	SSViT-T	IN-1k : Sup. : 300	ADE20K (train) : 640 : 512	35.0	—	—	—	46.8	—	—
SSViT	SSViT-S	IN-1k : Sup. : 300	ADE20K (train) : 640 : 512	184.0	—	—	—	49.6	—	—
SSViT	SSViT-B	IN-1k : Sup. : 300	ADE20K (train) : 640 : 512	303.0	—	—	—	51.0	—	—
SSViT	SSViT-L	IN-1k : Sup. : 300	ADE20K (train) : 640 : 512	497.0	—	—	—	51.5	—	—
MA ViT	MA ViT-T	IN-1k : Sup. : 300	ADE20K (train) : 80 : 512	136.0	—	—	—	47.6	—	—
MA ViT	MA ViT-S	IN-1k : Sup. : 300	ADE20K (train) : 80 : 512	180.0	—	—	—	50.7	—	—
MA ViT	MA ViT-B	IN-1k : Sup. : 300	ADE20K (train) : 80 : 512	292.0	—	—	—	51.5	—	—
MA ViT	MA ViT-L	IN-1k : Sup. : 300	ADE20K (train) : 80 : 512	424.0	—	—	—	52.8	—	—
VCMamba	VCMamba-S	IN-1k : Sup. : 300	ADE20K (train) : 61 : 512	None	—	—	—	42.0	—	—
VCMamba	VCMamba-B	IN-1k : Sup. : 300	ADE20K (train) : 61 : 512	None	—	—	—	47.1	—	—
S2AFormer	S2AFormer-mini	IN-1k : Sup. : 300	ADE20K (train) : 1000 : 512	23.0	—	—	—	36.7	—	—
S2AFormer	S2AFormer-T	IN-1k : Sup. : 300	ADE20K (train) : 1000 : 512	25.0	—	—	—	38.0	—	—
S2AFormer	S2AFormer-XS	IN-1k : Sup. : 300	ADE20K (train) : 1000 : 512	25.0	—	—	—	39.2	—	—
S2AFormer	S2AFormer-S	IN-1k : Sup. : 300	ADE20K (train) : 1000 : 512	28.0	—	—	—	40.8	—	—
S2AFormer	S2AFormer-M	IN-1k : Sup. : 300	ADE20K (train) : 1000 : 512	43.0	—	—	—	43.7	—	—
AnchorFormer	AnchorFormer-T	IN-1k : Sup. : 300	ADE20K (train) : 128 : 512	193.7	43.81	—	56.57	—	—	—