LAST-ViT for ViT-S

[ysinjoro-coder]

Hello,

First of all, thank you for your excellent work on LAST-ViT. I really enjoyed reading the paper and exploring the repository.

I am currently working on a related project and would like to experiment with the small variant of LAST-ViT. However, I noticed that the pretrained weights for the small model are not available in the repository.

Would it be possible for you to share the pretrained weights for the small version? It would be extremely helpful for my research and for reproducing your results.

Thank you very much for your time and for making your work available to the community.

[ChengShiest]

Hi, thanks for your interest in our work!

Could you clarify which small variant (DeiT? pytorch-version? transformer-version? or pure ViT?) you need? Specifically, do you mean the ViT-S architecture, and under which pre-training setting?