-
Notifications
You must be signed in to change notification settings - Fork 7
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
EVA-3457 - Split variant load #195
EVA-3457 - Split variant load #195
Conversation
…istics calculation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
As I mentioned in the EVA-3455 PR, we might be able to combine the two variant load jobs into one which would change this PR slightly... otherwise this looks fine to me.
|
||
pipeline_parameters += " --spring.batch.job.names=calculate-statistics-job" | ||
|
||
pipeline_parameters += " --input.vcf.aggregation=" + aggregation.toString().toUpperCase() |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
If I'm understanding the old job configurations correctly, we should only run statistics calculation for genotyped vcf.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
That's a good point and one I was not aware of.
I'm a bit surprised by this considering that there are both variant level and study level statistics in the mongodb database. Maybe the study level is calculated in the Variant Load step.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I wonder if this is why this assertion passes in your test, even though the stats step hasn't been run...
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Yes that might be something else to investigate
Split the variant load nextflow process into
Also remove the option to run annotation only.