Heedless Backbones

Backbone Families

namemodel typepretraining methodhierarchicalpublication dategithubpaper
TransNeXtAttn + ConvSupervisedTrue2023-11-28linklink
ConvNeXtConvolutionSupervisedTrue2022-01-10linklink
SwinAttentionSupervisedTrue2021-03-25linklink
DeiT IIIAttentionSupervisedFalse2022-04-14linklink
ResNet (RSB)ConvolutionSupervisedTrue2021-10-01linklink
ConvNeXt V2ConvolutionFCMAETrue2023-01-02linklink
HieraAttentionMAETrue2023-06-01linklink
InternImageConvolutionSupervisedTrue2022-11-11linklink
FocalNetAttn + ConvSupervisedTrue2022-03-22linklink
CSWinAttentionSupervisedTrue2021-07-01linklink
IdentityFormerIdentitySupervisedTrue2022-10-24linklink
RandFormerRandomSupervisedTrue2022-10-24linklink
CAFormerAttn + ConvSupervisedTrue2022-10-24linklink
ConvFormerConvolutionSupervisedTrue2022-10-24linklink
MaxViTAttn + ConvSupervisedTrue2022-04-22linklink
MogaNetConvolutionSupervisedTrue2024-02-16linklink
CoAtNetAttn + ConvSupervisedTrue2021-06-09linklink
VMambaState Space ModelSupervisedTrue2024-01-18linklink
UniRepLKNetConvolutionSupervisedTrue2023-11-27linklink