what are the minimum no. of A100sxm 80GB GPU required for lora sft finetuning of "Qwen2-VL-72B-instruct"? #6077
Unanswered
MayurKuchhadiya
asked this question in
Q&A
Replies: 1 comment 1 reply
-
|
4GPUs with zero3 |
Beta Was this translation helpful? Give feedback.
1 reply
-
|
is this for default lora_rank? or else if i change lora_rank, no of gpu also change? |
Beta Was this translation helpful? Give feedback.
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
what are the minimum no. of A100sxm 80GB GPU required for lora sft finetuning of "Qwen2-VL-72B-instruct"?
Beta Was this translation helpful? Give feedback.
All reactions