How to convert checkpoint files that adapt to different distributed world sizes

[swjtulinxi]

hi， i have tried your example to convert the swin_moe_small_patch4_window12_192_16expert_32gpu_22k。the first problem is the example format does not match the filesofswin_moe_small_patch4_window12_192_16expert_32gpu_22k， therefore，i have modified some code， however the example can only convert one rank.pth，not all rank.pth to one， can you show the correct example， I am puzzled by this question， thanks。

[ghostplant]

Hi, the pre-trained SwinMoE parameters were based on an early Tutel version (maybe 0.1 or 0.2) while there is parameter renaming within MoE-layer since 0.3, so the old parameters from Swin should be synced to latest version to avoid parameter mapping incorrectly. Can you explain more details about which parameter link you found is problematic, and how can you reproduce it?