Heedless Backbones

Backbone Families

namemodel typepretraining methodhierarchicalpublication dategithubpaper
TransNeXtAttn + ConvSupervisedTrue2023-11-28linklink
ConvNeXtConvolutionSupervisedTrue2022-01-10linklink
SwinAttentionSupervisedTrue2021-03-25linklink
DeiT IIIAttentionSupervisedFalse2022-04-14linklink
ResNet (RSB)ConvolutionSupervisedTrue2021-10-01linklink
ConvNeXt V2ConvolutionFCMAETrue2023-01-02linklink
HieraAttentionMAETrue2023-06-01linklink
InternImageConvolutionSupervisedTrue2022-11-11linklink
FocalNetAttn + ConvSupervisedTrue2022-03-22linklink
CSWinAttentionSupervisedTrue2021-07-01linklink
IdentityFormerIdentitySupervisedTrue2022-10-24linklink
RandFormerRandomSupervisedTrue2022-10-24linklink
CAFormerAttn + ConvSupervisedTrue2022-10-24linklink
ConvFormerConvolutionSupervisedTrue2022-10-24linklink
MaxViTAttn + ConvSupervisedTrue2022-04-22linklink
MogaNetConvolutionSupervisedTrue2024-02-16linklink
CoAtNetAttn + ConvSupervisedTrue2021-06-09linklink
VMambaState Space ModelSupervisedTrue2024-01-18linklink
UniRepLKNetConvolutionSupervisedTrue2023-11-27linklink
SLaKConvolutionSupervisedTrue2023-03-03linklink
RepLKNetConvolutionSupervisedTrue2022-04-02linklink
BiFormerAttentionSupervisedTrue2023-03-15linklink
MambaOutConvolutionSupervisedTrue2024-05-20linklink
GroupMambaState Space ModelSupervisedTrue2024-03-28linklink
VimState Space ModelSupervisedFalse2024-02-29linklink
Hier-VimState Space ModelSupervisedTrue2024-02-29linklink
PlainMambaState Space ModelSupervisedFalse2024-08-15linklink
LocalVimState Space ModelSupervisedFalse2024-03-14linklink
LocalVMambaState Space ModelSupervisedTrue2024-03-14linklink
EfficientVMambaState Space ModelSupervisedTrue2024-03-15linklink
DAMambaState Space ModelSupervisedTrue2025-02-18linklink
VSSDState Space ModelSupervisedTrue2024-08-04linklink
RMTAttn + ConvSupervisedTrue2023-09-20linklink
DAT++Attn + ConvSupervisedTrue2023-09-04linklink
FANAttentionSupervisedTrue2022-07-17linklink
DATAttn + ConvSupervisedTrue2022-05-24linklink
NATAttentionSupervisedTrue2022-04-15linklink
SSViTAttentionSupervisedTrue2024-05-22linklink
Iwin TransformerAttn + ConvSupervisedTrue2025-07-24linklink
MA ViTAttentionSupervisedTrue2025-08-02linklink
VCMambaConv + SSMSupervisedTrue2025-09-04linklink
SpaRTANConvolutionSupervisedTrue2025-07-15linklink
UniConvNetConvolutionSupervisedTrue2025-08-12linklink
RecNeXtConvolutionSupervisedTrue2024-12-27linklink
A2MambaAttn + ConvSupervisedTrue2025-07-22linklink
FractalMamba++State Space ModelSupervisedTrue2025-08-13linklink
InceptionMambaConv + SSMSupervisedTrue2025-07-24linklink
CoCA ViTAttn + ConvSupervisedTrue2025-08-07linklink
HybridNetConv + SSMSupervisedTrue2025-05-23linklink
S2AFormerAttn + ConvSupervisedTrue2025-05-28linklink
VMINetAttentionSupervisedTrue2025-01-03linklink
Mamba-AdaptorState Space ModelSupervisedTrue2025-05-19linklink
AnchorFormerAttentionSupervisedTrue2025-06-18linklink
UniNeXtAttentionSupervisedTrue2023-04-26linklink