Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Partition weather station model predictions table #4059

Merged
merged 34 commits into from
Nov 19, 2024

Conversation

conbrad
Copy link
Collaborator

@conbrad conbrad commented Nov 5, 2024

  • Migrations for partitioning the weather_station_model_predictions from the months we had data this past fire season, and 3 months into the future
  • Docker image, build and job for running the data migrations asynchronously
  • A job to archive/delete older partitions and create new partitions, monthly

Closes #4049

Test Links:

Landing Page
MoreCast
Percentile Calculator
C-Haines
FireBat
FireBat bookmark
Auto Spatial Advisory (ASA)
HFI Calculator

Copy link

codecov bot commented Nov 5, 2024

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 80.40%. Comparing base (9606e0f) to head (4c6c92f).
Report is 1 commits behind head on main.

Additional details and impacted files
@@           Coverage Diff           @@
##             main    #4059   +/-   ##
=======================================
  Coverage   80.40%   80.40%           
=======================================
  Files         309      309           
  Lines       11860    11860           
  Branches      537      537           
=======================================
  Hits         9536     9536           
  Misses       2138     2138           
  Partials      186      186           

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.


🚨 Try these New Features:

@conbrad conbrad requested review from brettedw and dgboss November 5, 2024 22:11
@conbrad conbrad closed this Nov 5, 2024
@conbrad conbrad reopened this Nov 6, 2024
Copy link
Collaborator

@brettedw brettedw left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice work, looks good. I imagine they'll be some down time and an increase in db size temporarily with all the indexes being generated?

openshift/pgslice/docker/fill_partition_data.sh Outdated Show resolved Hide resolved
openshift/templates/partition_filler_job.yaml Outdated Show resolved Hide resolved
@conbrad conbrad closed this Nov 12, 2024
@conbrad conbrad reopened this Nov 18, 2024
@conbrad conbrad closed this Nov 18, 2024
@conbrad conbrad reopened this Nov 19, 2024
@conbrad conbrad requested a review from dgboss November 19, 2024 18:47
@conbrad conbrad changed the title Partition weather station model predictions table, part 1 Partition weather station model predictions table Nov 19, 2024
@conbrad conbrad closed this Nov 19, 2024
@conbrad conbrad reopened this Nov 19, 2024
Copy link
Collaborator

@dgboss dgboss left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice work!

Copy link

sonarcloud bot commented Nov 19, 2024

@conbrad conbrad temporarily deployed to production November 19, 2024 22:20 Inactive
@conbrad conbrad merged commit d5cb753 into main Nov 19, 2024
25 checks passed
@conbrad conbrad deleted the task/partition-weather-station-model-predictions branch November 19, 2024 22:37
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Partition Operational Database for Historical Data Archiving
3 participants