Replies: 7 comments
-
|
The same question. |
Beta Was this translation helpful? Give feedback.
-
I am working for it, but I am not sure if it will be accepted. |
Beta Was this translation helpful? Give feedback.
-
|
@matrixssy any progress ? thank you. |
Beta Was this translation helpful? Give feedback.
-
|
see #667 |
Beta Was this translation helpful? Give feedback.
-
|
Hi, Please refer to this script for MoE/Mixtral training. |
Beta Was this translation helpful? Give feedback.
-
Great! But I would like to know how to convert Hugging Face (HF) weights to Megatron (MG) format, and if it's possible to convert them back after training? |
Beta Was this translation helpful? Give feedback.
-
|
Marking as stale. No activity in 60 days. |
Beta Was this translation helpful? Give feedback.
-
Beta Was this translation helpful? Give feedback.
All reactions