Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

two types of validation data for fine tuning experiment #150

Open
bhomass opened this issue Oct 29, 2023 · 1 comment
Open

two types of validation data for fine tuning experiment #150

bhomass opened this issue Oct 29, 2023 · 1 comment

Comments

@bhomass
Copy link

bhomass commented Oct 29, 2023

sciplex_ood_splits has two declarations for split_ood_finetuning = "test".

One looks up the 32 validation_drugs, the second one uses random splits from train.

what is idea behind the validate drugs? how were they selected?

Ultimately which is the better version to use?

@MxMstrmn
Copy link
Collaborator

MxMstrmn commented Mar 4, 2024

HI @bhomass,

the selection was done according to the original paper and their analysis of perturbation effect. Could you clarify, what you mean by 'sciplex_ood_splits has two declarations for split_ood_finetuning = "test".' ?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants