Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Convergence tests for protein mutation protocol #95

Merged
merged 7 commits into from
Oct 28, 2024

Conversation

ijpulidos
Copy link
Contributor

This set of changes includes the tests for the convergence validation.

Solves #79

The idea is that these would be run using the GPU CI workflow, since it's expected to take some hours. I'll be running these in some HPC system to check how long we should expect them to take. Some tweaking of the number of iterations might be needed to optimize the walltimes.

@ijpulidos
Copy link
Contributor Author

As usual, since this is only the tests, CI is expected to fail until we implement the protocol which should pass all the tests.

@ijpulidos ijpulidos requested a review from IAlibay October 23, 2024 13:38
@mikemhenry
Copy link
Contributor

image
not part of the PR but shouldn't be using GUFE'sJSON_HANDLER.decoder here?

@@ -192,3 +363,124 @@ def test_asp_to_leu_execute(self, protocol_asp_to_leu_result):
# the FinishUnit will always be the last to execute
finishresult = dagresult.protocol_unit_results[-1]
assert finishresult.name == "result"

@pytest.mark.slow
def test_ala_gly_convergence(
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This test shares a lot of the same code as https://github.com/OpenFreeEnergy/feflow/pull/95/files#diff-82d94bde95c44db8b1006ee5251daf53bea07e1026ed5a559da150c720b090deR263 should it be using the execute_forward_reverse_dag function?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yes it definitely should, good catch.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Actually, on a second thought, it's slightly different because of how the fe estimates and errors are computed for each case. There are ways to decrement the redundant code here but that requires probably better data types/containers to be able to be reused in both cases which I don't think it's worth it for the tests. That is, I think the tests are more readable this way, even if they have some redundant code. But as it's not API it should be fine, imo.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I just remember the perses tests got really annoying to work with since so many tests were duplicated with just one little change.

I think if you changed execute_forward_reverse_dag to return forward_dagresult, reverse_dagresult instead of the sums then each test would only be the different ways to caclualte errors.

Copy link
Contributor Author

@ijpulidos ijpulidos Oct 28, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This should have been addressed in the latest changes. Thanks for the feedback!

@ijpulidos ijpulidos requested a review from mikemhenry October 23, 2024 22:35
@jthorton jthorton linked an issue Oct 24, 2024 that may be closed by this pull request
Copy link
Member

@IAlibay IAlibay left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@mikemhenry's comments aside, this looks good to me

@mikemhenry mikemhenry merged commit f15592a into protein-mutation-protocol Oct 28, 2024
1 of 9 checks passed
@mikemhenry mikemhenry deleted the convergence-tests branch October 28, 2024 15:25
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Test convergence for capped AAs mutation
3 participants