Gcsfuse is very slow when compared to gsutil #1535
pratikkumar018
started this conversation in
General
Replies: 1 comment
-
Hi @pratikkumar018, Thank you for reaching out. In the meantime, could you please provide the following details to help us better understand the situation:
Thanks, |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Hi Team,
Our usecase is we are training models & we want to keep the training directory on cloud that is gcp buckets.
There are two options. One is copying the model checkpoints through gsutil & second is mounting the bucket as a disk & directly storing there.
We are more keen on the second option but we found that the second option is way too slower than the first option.
Is there any particular reason for this.
Beta Was this translation helpful? Give feedback.
All reactions