Skip to content

Commit

Permalink
add in compression of additional intermediate vcfs - fixes #20
Browse files Browse the repository at this point in the history
  • Loading branch information
jethror1 committed Feb 12, 2024
1 parent 2781c8c commit cf70964
Showing 1 changed file with 2 additions and 1 deletion.
3 changes: 2 additions & 1 deletion src/code.sh
Original file line number Diff line number Diff line change
Expand Up @@ -488,7 +488,8 @@ _upload_final_output() {

# compress intermediate genome VCFs since we don't use these routinely
# and they go from >300mb to < 10mb (plus its a vcf, it should be compressed)
find "/home/dnanexus/out/scatter/" -type f -name "*.vcf" -print0 \
time find /home/dnanexus/out/scatter/ /home/dnanexus/out/gather/Logs_Intermediates/ \
-type f -name "*.vcf" -print0 \
| xargs -I{} -n1 -P "$THREADS" gzip {}

# upload final run level MetricsOutput.tsv as distinct output field
Expand Down

0 comments on commit cf70964

Please sign in to comment.