Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

CI check to make sure that tables that are exempted from retention are not set to expire #6582

Open
wants to merge 4 commits into
base: main
Choose a base branch
from

Conversation

alekhyamoz
Copy link
Contributor

@alekhyamoz alekhyamoz commented Nov 29, 2024

As part of the data retention project, certain tables were identified to be exempt from retention.
This PR

  1. Add a section retention_exclusion_list to the config file bigconfig.yaml. This is list of files that should be excluded from setting the retention policy.
  2. adds a function validate_exclusion_list_expiration_days to fail the metadata validation if the table's metadata contains expiration_days set

┆Issue is synchronized with this Jira Task

@dataops-ci-bot

This comment has been minimized.

@dataops-ci-bot
Copy link

Integration report for "Merge branch 'main' into retention_exclusion"

sql.diff

No content detected.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants