Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

IAI Group level policy for tracking ML training #34

Open
IKostric opened this issue Feb 15, 2022 · 3 comments
Open

IAI Group level policy for tracking ML training #34

IKostric opened this issue Feb 15, 2022 · 3 comments
Assignees
Labels
improvement Improvement that does not introduce new functionality P2 Low priority

Comments

@IKostric
Copy link
Contributor

Compare tensorboard, W&B, ...

@vinaysetty
Copy link
Contributor

My recommendation:

  1. While training use Weights and Biases https://wandb.ai/site to track the hyperparameters and logs
  2. Use dataset version control (DVC) https://dvc.org to track datasets used and models trained for the experiments in a GitHub repository and a remote storage like dropbox or even ssh store like on gustav1. Here is the quick start guide https://dvc.org/doc/start/data-and-model-versioning

@kbalog
Copy link
Contributor

kbalog commented Mar 8, 2022

Let's try these for TREC CAsT

@kbalog kbalog added improvement Improvement that does not introduce new functionality P2 Low priority labels Nov 18, 2022
@kbalog
Copy link
Contributor

kbalog commented Nov 18, 2022

Just go with the wandb suggestion for now

@kbalog kbalog assigned WerLaj and unassigned vinaysetty Nov 18, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
improvement Improvement that does not introduce new functionality P2 Low priority
Projects
None yet
Development

No branches or pull requests

4 participants