Backbone Families
| name | model type | pretraining method | hierarchical | publication date | github | paper |
|---|---|---|---|---|---|---|
| Swin | Attention | Supervised | True | 2021-03-25 | link | link |
| DeiT III | Attention | Supervised | False | 2022-04-14 | link | link |
| ResNet (RSB) | Convolution | Supervised | True | 2021-10-01 | link | link |
| ConvNeXt V2 | Convolution | FCMAE | True | 2023-01-02 | link | link |
| Hiera | Attention | MAE | True | 2023-06-01 | link | link |
| InternImage | Convolution | Supervised | True | 2022-11-11 | link | link |
| FocalNet | Attn + Conv | Supervised | True | 2022-03-22 | link | link |
| CSWin | Attention | Supervised | True | 2021-07-01 | link | link |
| IdentityFormer | Identity | Supervised | True | 2022-10-24 | link | link |
| RandFormer | Random | Supervised | True | 2022-10-24 | link | link |
| CAFormer | Attn + Conv | Supervised | True | 2022-10-24 | link | link |
| ConvFormer | Convolution | Supervised | True | 2022-10-24 | link | link |
| MaxViT | Attn + Conv | Supervised | True | 2022-04-22 | link | link |
| MogaNet | Convolution | Supervised | True | 2024-02-16 | link | link |
| CoAtNet | Attn + Conv | Supervised | True | 2021-06-09 | link | link |
| VMamba | State Space Model | Supervised | True | 2024-01-18 | link | link |
| UniRepLKNet | Convolution | Supervised | True | 2023-11-27 | link | link |
| FAN (Fully Attentional Networks) | Attention | Supervised | True | 2022-07-17 | link | link |
| SLaK | Convolution | Supervised | True | 2023-03-03 | link | link |
| TransNeXt | Attn + Conv | Supervised | True | 2023-11-28 | link | link |
| ConvNeXt | Convolution | Supervised | True | 2022-01-10 | link | link |
| RepLKNet | Convolution | Supervised | True | 2022-04-02 | link | link |
| BiFormer | Attention | Supervised | True | 2023-03-15 | link | link |
| MambaOut | Convolution | Supervised | True | 2024-05-20 | link | link |
| GroupMamba | State Space Model | Supervised | True | 2024-03-28 | link | link |
| Vim | State Space Model | Supervised | False | 2024-02-29 | link | link |
| Hier-Vim | State Space Model | Supervised | True | 2024-02-29 | link | link |
| PlainMamba | State Space Model | Supervised | False | 2024-08-15 | link | link |
| LocalVim | State Space Model | Supervised | False | 2024-03-14 | link | link |
| LocalVMamba | State Space Model | Supervised | True | 2024-03-14 | link | link |
| EfficientVMamba | State Space Model | Supervised | True | 2024-03-15 | link | link |
| DAMamba | State Space Model | Supervised | True | 2025-02-18 | link | link |
| VSSD | State Space Model | Supervised | True | 2024-08-04 | link | link |
| RMT | Attn + Conv | Supervised | True | 2023-09-20 | link | link |
| DAT++ | Attn + Conv | Supervised | True | 2023-09-04 | link | link |