What is the dataset format would I set? JSON format or .bin and .idx format(convert by Megatron-LM process_data.py) #2
Replies: 1 comment
-
|
Replied in the issue #3 |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Hello I want to ask，
What is the dataset format would I set? JSON format or .bin and .idx format(convert by Megatron-LM process_data.py)？
Thanks a lot.
Beta Was this translation helpful? Give feedback.
All reactions