-
Notifications
You must be signed in to change notification settings - Fork 17
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Pre-training #8
Comments
Thanks for your interest! We provide example code at:
There aren't too many parameters for tuning, you can use the parameters in the example. (may change the batch-size or num_workers to fit in your hardware.) We will write documentation for custom pre-training, maybe next week. Before that, please try the example code with a few modifications. If you have problem, feel free to contact me again :) |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Can you provide documentation to perform the pre-training on custom datasets?
How is the data formatted and what are the appropriate parameters for the scripts in the ./pre_training directory?
Thank you!
The text was updated successfully, but these errors were encountered: