Panoptic FPN

Paper | GitHub

axis

Select an option

Results

Parameters (M)

Images / Second

Publication Date

task

Select an option

---------

Instance Segmentation

Semantic Segmentation

Panoptic Segmentation

dataset

Select an option

---------

Cityscapes (val)

Cityscapes (test)

ADE20K (val)

ADE20K (test)

PASCAL VOC 2007 (val)

PASCAL VOC 2007 (test)

metric

Select an option

mIoU^ms

pAcc^ms

mAcc^ms

mIoU^ss

pAcc^ss

mAcc^ss

GFLOPs

resolution

Select an option

----------

512x2048

640x2560

axis

Select an option

Results

Parameters (M)

Images / Second

GFLOPs

Publication Date

Filters

Legend

Legend attribute

Select an option

Family

Pretrain Dataset

Pretrain Method

Semantic Segmentation Head

Semantic Segmentation Resolution

Semantic Segmentation Training Epochs

Legend attribute (second)

Select an option

----------

Pretrain Dataset

Pretrain Method

Semantic Segmentation Head

Semantic Segmentation Resolution

Semantic Segmentation Training Epochs

family	model	params (m)	pretrain	head	train	GFLOPs	mIoU^ms
DAT++	DAT-T++	24.0	IN-1k : Sup. : 300	Panoptic FPN	ADE20K (train) : 64 : 512	212.0	48.8
DAT++	DAT-B++	93.0	IN-1k : Sup. : 300	Panoptic FPN	ADE20K (train) : 64 : 512	508.0	51.1
DAT	DAT-S	50.0	IN-1k : Sup. : 300	Panoptic FPN	ADE20K (train) : 32 : 512	320.0	48.46
DAT++	DAT-S++	53.0	IN-1k : Sup. : 300	Panoptic FPN	ADE20K (train) : 64 : 512	339.0	50.7
DAT	DAT-B	88.0	IN-1k : Sup. : 300	Panoptic FPN	ADE20K (train) : 32 : 512	481.0	49.01
DAT	DAT-T	29.0	IN-1k : Sup. : 300	Panoptic FPN	ADE20K (train) : 32 : 512	198.0	44.22
AnchorFormer	AnchorFormer-T	4.2	IN-1k : Sup. : 300	Panoptic FPN	ADE20K (train) : 64 : 512	193.7	43.81

ADE20K (val)

family	model	pretrain	train	gflops	mIoU^ms	pAcc^ms	mAcc^ms	mIoU^ss	pAcc^ss	mAcc^ss
ConvNeXt	ConvNeXt-T	IN-1k : Sup. : 300	ADE20K (train) : 64 : 512	None	—	—	—	41.4	—	—
Swin	Swin-T	IN-1k : Sup. : 300	ADE20K (train) : 64 : 512	182.0	—	—	—	41.5	—	—
Swin	Swin-B	IN-1k : Sup. : 300	ADE20K (train) : 64 : 512	422.0	—	—	—	46.0	—	—
Swin	Swin-S	IN-1k : Sup. : 300	ADE20K (train) : 64 : 512	274.0	—	—	—	45.2	—	—
CSWin	CSWin-T	IN-1k : Sup. : 300	ADE20K (train) : 64 : 512	202.0	—	—	—	48.2	—	—
CSWin	CSWin-S	IN-1k : Sup. : 300	ADE20K (train) : 64 : 512	271.0	—	—	—	49.2	—	—
CSWin	CSWin-B	IN-1k : Sup. : 300	ADE20K (train) : 64 : 512	464.0	—	—	—	49.9	—	—
BiFormer	BiFormer-S	IN-1k : Sup. : 300	ADE20K (train) : 128 : 512	None	—	—	—	48.9	—	—
BiFormer	BiFormer-B	IN-1k : Sup. : 300	ADE20K (train) : 128 : 512	None	—	—	—	49.9	—	—
RMT	RMT-T	IN-1k : Sup. : 300	ADE20K (train) : 64 : 512	33.7	—	—	—	46.4	—	—
RMT	RMT-S	IN-1k : Sup. : 300	ADE20K (train) : 64 : 512	180.0	—	—	—	49.4	—	—
RMT	RMT-B	IN-1k : Sup. : 300	ADE20K (train) : 64 : 512	294.0	—	—	—	50.4	—	—
RMT	RMT-L	IN-1k : Sup. : 300	ADE20K (train) : 64 : 512	482.0	—	—	—	51.4	—	—
DAT++	DAT-T++	IN-1k : Sup. : 300	ADE20K (train) : 64 : 512	212.0	48.8	—	—	48.4	—	—
DAT++	DAT-S++	IN-1k : Sup. : 300	ADE20K (train) : 64 : 512	339.0	50.7	—	—	49.9	—	—
DAT++	DAT-B++	IN-1k : Sup. : 300	ADE20K (train) : 64 : 512	508.0	51.1	—	—	50.4	—	—
DAT	DAT-T	IN-1k : Sup. : 300	ADE20K (train) : 32 : 512	198.0	44.22	—	—	42.56	—	54.72
DAT	DAT-S	IN-1k : Sup. : 300	ADE20K (train) : 32 : 512	320.0	48.46	—	—	46.08	—	58.17
DAT	DAT-B	IN-1k : Sup. : 300	ADE20K (train) : 32 : 512	481.0	49.01	—	—	47.02	—	59.47
SSViT	SSViT-T	IN-1k : Sup. : 300	ADE20K (train) : 64 : 512	35.0	—	—	—	46.8	—	—
SSViT	SSViT-S	IN-1k : Sup. : 300	ADE20K (train) : 64 : 512	184.0	—	—	—	49.6	—	—
SSViT	SSViT-B	IN-1k : Sup. : 300	ADE20K (train) : 64 : 512	303.0	—	—	—	51.0	—	—
SSViT	SSViT-L	IN-1k : Sup. : 300	ADE20K (train) : 64 : 512	497.0	—	—	—	51.5	—	—
MA ViT	MA ViT-T	IN-1k : Sup. : 300	ADE20K (train) : 64 : 512	136.0	—	—	—	47.6	—	—
MA ViT	MA ViT-S	IN-1k : Sup. : 300	ADE20K (train) : 64 : 512	180.0	—	—	—	50.7	—	—
MA ViT	MA ViT-B	IN-1k : Sup. : 300	ADE20K (train) : 64 : 512	292.0	—	—	—	51.5	—	—
MA ViT	MA ViT-L	IN-1k : Sup. : 300	ADE20K (train) : 64 : 512	424.0	—	—	—	52.8	—	—
VCMamba	VCMamba-S	IN-1k : Sup. : 300	ADE20K (train) : 32 : 512	None	—	—	—	42.0	—	—
VCMamba	VCMamba-B	IN-1k : Sup. : 300	ADE20K (train) : 32 : 512	None	—	—	—	47.1	—	—
S2AFormer	S2AFormer-mini	IN-1k : Sup. : 300	ADE20K (train) : 64 : 512	23.0	—	—	—	36.7	—	—
S2AFormer	S2AFormer-T	IN-1k : Sup. : 300	ADE20K (train) : 64 : 512	25.0	—	—	—	38.0	—	—
S2AFormer	S2AFormer-XS	IN-1k : Sup. : 300	ADE20K (train) : 64 : 512	25.0	—	—	—	39.2	—	—
S2AFormer	S2AFormer-S	IN-1k : Sup. : 300	ADE20K (train) : 64 : 512	28.0	—	—	—	40.8	—	—
S2AFormer	S2AFormer-M	IN-1k : Sup. : 300	ADE20K (train) : 64 : 512	43.0	—	—	—	43.7	—	—
AnchorFormer	AnchorFormer-T	IN-1k : Sup. : 300	ADE20K (train) : 64 : 512	193.7	43.81	—	56.57	—	—	—
FAT	FAT-B0	IN-1k : Sup. : 300	ADE20K (train) : 64 : 512	25.0	—	—	—	41.5	—	—
HAT-Net	HAT-Net-Tiny	IN-1k : Sup. : 300	ADE20K (train) : 64 : 512	33.2	—	—	—	43.6	—	—
HAT-Net	HAT-Net-Small	IN-1k : Sup. : 300	ADE20K (train) : 64 : 512	49.6	—	—	—	46.6	—	—
HAT-Net	HAT-Net-Medium	IN-1k : Sup. : 300	ADE20K (train) : 64 : 512	74.7	—	—	—	49.3	—	—
HAT-Net	HAT-Net-Large	IN-1k : Sup. : 300	ADE20K (train) : 64 : 512	96.4	—	—	—	49.5	—	—
SDT-V3+SCA	SDT-V3+SCA-S	IN-1k : Sup. : 200	ADE20K (train) : 160 : 512	None	—	—	—	36.28	—	—
iFormer	iFormer-S	IN-1k : Sup. : 300	ADE20K (train) : 64 : 512	181.0	—	—	—	48.6	—	—
LinGlo	LinGlo-b0	IN-1k : Sup. : 300	ADE20K (train) : 64 : 512	None	—	—	—	37.3	—	—
LinGlo	LinGlo-b1	IN-1k : Sup. : 300	ADE20K (train) : 64 : 512	None	—	—	—	42.5	—	—
LinGlo	LinGlo-b2	IN-1k : Sup. : 300	ADE20K (train) : 64 : 512	None	—	—	—	45.2	—	—
P2T	P2T-Tiny	IN-1k : Sup. : 300	ADE20K (train) : 64 : 512	31.6	—	—	—	43.4	80.8	54.5
P2T	P2T-Small	IN-1k : Sup. : 300	ADE20K (train) : 64 : 512	42.7	—	—	—	46.7	82.0	58.4
P2T	P2T-Base	IN-1k : Sup. : 300	ADE20K (train) : 64 : 512	58.5	—	—	—	48.7	82.9	60.7
P2T	P2T-Large	IN-1k : Sup. : 300	ADE20K (train) : 64 : 512	77.7	—	—	—	49.4	83.3	61.9
LaViT	LaViT-S	IN-1k : Sup. : 300	ADE20K (train) : 64 : 512	122.0	—	—	—	44.1	—	—
SDT-V3+SCA	SDT-V3+SCA-M	IN-1k : Sup. : 200	ADE20K (train) : 160 : 512	None	—	—	—	41.23	—	—
SDT-V3+SCA	SDT-V3+SCA-L	IN-1k : Sup. : 200	ADE20K (train) : 160 : 512	None	—	—	—	42.76	—	—
EViT	EViT-Small	IN-1k : Sup. : 300	ADE20K (train) : 64 : 512	44.8	—	—	—	46.1	—	—
EViT	EViT-Base	IN-1k : Sup. : 300	ADE20K (train) : 64 : 512	60.1	—	—	—	48.5	—	—
TransXNet	TransXNet-T	IN-1k : Sup. : 300	ADE20K (train) : 128 : 512	121.0	—	—	—	45.5	—	—
TransXNet	TransXNet-S	IN-1k : Sup. : 300	ADE20K (train) : 128 : 512	179.0	—	—	—	48.5	—	—
TransXNet	TransXNet-B	IN-1k : Sup. : 300	ADE20K (train) : 128 : 512	256.0	—	—	—	49.9	—	—
FaViT	FaViT-B0	IN-1k : Sup. : 300	ADE20K (train) : 128 : 512	None	—	—	—	37.2	—	—
FaViT	FaViT-B1	IN-1k : Sup. : 300	ADE20K (train) : 128 : 512	None	—	—	—	42.0	—	—
FaViT	FaViT-B2	IN-1k : Sup. : 300	ADE20K (train) : 128 : 512	None	—	—	—	45.0	—	—
FaViT	FaViT-B3	IN-1k : Sup. : 300	ADE20K (train) : 128 : 512	None	—	—	—	47.2	—	—
FViT	FViT-Small	IN-1k : Sup. : 300	ADE20K (train) : 64 : 512	46.2	—	—	—	46.1	—	—
LSNet	LSNet-T	IN-1k : Sup. : 300	ADE20K (train) : 64 : 512	None	—	—	—	40.1	—	—
LSNet	LSNet-S	IN-1k : Sup. : 300	ADE20K (train) : 64 : 512	None	—	—	—	41.0	—	—
LSNet	LSNet-B	IN-1k : Sup. : 300	ADE20K (train) : 64 : 512	None	—	—	—	43.0	—	—
FViT	FViT-Base	IN-1k : Sup. : 300	ADE20K (train) : 64 : 512	62.7	—	—	—	47.9	—	—
RepNeXt	RepNeXt-M3	IN-1k : Sup. : 300	ADE20K (train) : 64 : 512	None	—	—	—	40.6	—	—
RepNeXt	RepNeXt-M4	IN-1k : Sup. : 300	ADE20K (train) : 64 : 512	None	—	—	—	43.3	—	—
RepNeXt	RepNeXt-M5	IN-1k : Sup. : 300	ADE20K (train) : 64 : 512	None	—	—	—	45.0	—	—
SwiftFormer	SwiftFormer-L1	IN-1k : Sup. : 300	ADE20K (train) : 64 : 512	None	—	—	—	41.4	—	—
SwiftFormer	SwiftFormer-L3	IN-1k : Sup. : 300	ADE20K (train) : 64 : 512	None	—	—	—	43.9	—	—
FAT	FAT-B1	IN-1k : Sup. : 300	ADE20K (train) : 64 : 512	27.5	—	—	—	42.9	—	—
SepViT	SepViT-T	IN-1k : Sup. : 300	ADE20K (train) : 64 : 512	181.0	—	—	—	44.8	—	—
SepViT	SepViT-S	IN-1k : Sup. : 300	ADE20K (train) : 64 : 512	244.0	—	—	—	46.6	—	—
SepViT	SepViT-B	IN-1k : Sup. : 300	ADE20K (train) : 64 : 512	367.0	—	—	—	47.6	—	—
FAT	FAT-B2	IN-1k : Sup. : 300	ADE20K (train) : 64 : 512	32.2	—	—	—	45.4	—	—
FAT	FAT-B3	IN-1k : Sup. : 300	ADE20K (train) : 64 : 512	179.0	—	—	—	48.9	—	—
RepViT	RepViT-M1.1	IN-1k : Sup. : 300	ADE20K (train) : 64 : 512	None	—	—	—	40.6	—	—
InceptionNeXt	InceptionNeXt-T	IN-1k : Sup. : 300	ADE20K (train) : 64 : 512	44.0	—	—	—	43.1	—	—
InceptionNeXt	InceptionNeXt-S	IN-1k : Sup. : 300	ADE20K (train) : 64 : 512	65.0	—	—	—	45.6	—	—
InceptionNeXt	InceptionNeXt-B	IN-1k : Sup. : 300	ADE20K (train) : 64 : 512	100.0	—	—	—	46.4	—	—
CloFormer	CloFormer-XXS	IN-1k : Sup. : 300	ADE20K (train) : 64 : 512	25.2	—	—	—	40.4	—	—
CloFormer	CloFormer-XS	IN-1k : Sup. : 300	ADE20K (train) : 64 : 512	28.2	—	—	—	42.4	—	—
CloFormer	CloFormer-S	IN-1k : Sup. : 300	ADE20K (train) : 64 : 512	34.6	—	—	—	44.2	—	—
TinyViM	TinyViM-S	IN-1k : Sup. : 300	ADE20K (train) : 64 : 512	None	—	—	—	38.9	—	—
TinyViM	TinyViM-B	IN-1k : Sup. : 300	ADE20K (train) : 64 : 512	None	—	—	—	41.9	—	—
TinyViM	TinyViM-L	IN-1k : Sup. : 300	ADE20K (train) : 64 : 512	None	—	—	—	44.2	—	—
MVFormer	MVFormer-T	IN-1k : Sup. : 300	ADE20K (train) : 64 : 512	42.0	—	—	—	47.1	—	—
MVFormer	MVFormer-S	IN-1k : Sup. : 300	ADE20K (train) : 64 : 512	61.0	—	—	—	48.8	—	—
iFormer (Mobile)	iFormer-M (Mobile)	IN-1k : Sup. : 300	ADE20K (train) : 64 : 512	None	—	—	—	42.4	—	—
iFormer (Mobile)	iFormer-L (Mobile)	IN-1k : Sup. : 300	ADE20K (train) : 64 : 512	None	—	—	—	44.5	—	—
iFormer (Mobile)	iFormer-L2 (Mobile)	IN-1k : Sup. : 450	ADE20K (train) : 64 : 512	None	—	—	—	46.2	—	—
FMViT	FMViT-B	IN-1k : Sup. : 300	ADE20K (train) : 64 : 512	22.2	—	—	—	43.5	—	—
FMViT	FMViT-L	IN-1k : Sup. : 300	ADE20K (train) : 64 : 512	37.4	—	—	—	46.9	—	—
RepViT	RepViT-M1.5	IN-1k : Sup. : 300	ADE20K (train) : 64 : 512	None	—	—	—	43.6	—	—
RepViT	RepViT-M2.3	IN-1k : Sup. : 450	ADE20K (train) : 64 : 512	None	—	—	—	46.1	—	—
DeBiFormer	DeBiFormer-S	IN-1k : Sup. : 300	ADE20K (train) : 128 : 512	None	—	—	—	49.2	—	—
DeBiFormer	DeBiFormer-B	IN-1k : Sup. : 300	ADE20K (train) : 128 : 512	None	—	—	—	50.6	—	—