SWIN V2 Hyperparameters

[yazdanbakhsh]

Hi everyone,

I am wondering if anyone has a yaml file to reproduce the results for SWIN V2 model, or at least getting on par results with the reported quality numbers

We are particularly interested in the following model:

name	pretrain	resolution	window	acc@1	acc@5	# PARAMS	FLOPS	FPS	FPS
winV2-B	ImageNet-1K	256x256	8x8	84.2	96.9	88M	20.3G	217	217

We have been using the following hyperparameters for ViT-Base and it has been producing reasonable accuracy results. Wondering if you have any recommendation on what to particularly modify for SWIN models.