Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

New behavior changes: state_modified_compare_more_unrendered and skip_nodes_if_on_run_start_fails #6204

Merged
merged 22 commits into from
Oct 3, 2024
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
22 commits
Select commit Hold shift + click to select a range
f68f723
on run start behavior change
matthewshaver Oct 1, 2024
66f612f
adding state:modified
matthewshaver Oct 1, 2024
adb5fa2
Adding parameter to table
matthewshaver Oct 1, 2024
316b53b
Merge branch 'current' into hook-change
runleonarun Oct 1, 2024
488e1f5
Merge branch 'current' into hook-change
mirnawong1 Oct 2, 2024
97430a2
Merge branch 'current' into hook-change
runleonarun Oct 2, 2024
0b2f1db
New updates
matthewshaver Oct 2, 2024
257bc4a
Undoing change
matthewshaver Oct 2, 2024
53b4d15
Removing content
matthewshaver Oct 2, 2024
ebe1bb1
Merge branch 'current' into hook-change
matthewshaver Oct 2, 2024
b493b5c
Splitting release note
matthewshaver Oct 2, 2024
1b34dbe
Merge branch 'hook-change' of https://github.com/dbt-labs/docs.getdbt…
matthewshaver Oct 2, 2024
4054384
Moving new content to top
matthewshaver Oct 2, 2024
789e4e5
Update website/docs/docs/dbt-versions/release-notes.md
matthewshaver Oct 2, 2024
44dd028
Removing until `state_modified_compare_vars` is shipped and available
dbeatty10 Oct 3, 2024
3940c63
Update website/docs/reference/global-configs/behavior-changes.md
matthewshaver Oct 3, 2024
5307d86
Merge branch 'current' into hook-change
matthewshaver Oct 3, 2024
b1ad4e0
Keep the `restrict_direct_pg_catalog_access` row as-is
dbeatty10 Oct 3, 2024
2cfa8f2
Update website/docs/reference/global-configs/behavior-changes.md
matthewshaver Oct 3, 2024
027e6d2
Apply suggestions from code review
matthewshaver Oct 3, 2024
b1f29f0
Update website/docs/reference/global-configs/behavior-changes.md
matthewshaver Oct 3, 2024
07c74a6
Update website/docs/reference/global-configs/behavior-changes.md
matthewshaver Oct 3, 2024
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 2 additions & 0 deletions website/docs/docs/dbt-versions/release-notes.md
Original file line number Diff line number Diff line change
Expand Up @@ -20,6 +20,8 @@ Release notes are grouped by month for both multi-tenant and virtual private clo

## October 2024

- **Behavior change:** Set [`state_modified_compare_more_unrendered`](/reference/global-configs/behavior-changes#source-definitions-for-state) to true to reduce false positives for `state:modified` when configs differ between `dev` and `prod` environments.
- **Behavior change:** Set the [`skip_nodes_if_on_run_start_fails`](/reference/global-configs/behavior-changes#failures-in-on-run-start-hooks) flag to `True` to skip all selected resources from running if there is a failure on an `on-run-start` hook.
- **Enhancement**: In dbt Cloud Versionless, snapshots defined in SQL files can now use `config` defined in `schema.yml` YAML files. This update resolves the previous limitation that required snapshot properties to be defined exclusively in `dbt_project.yml` and/or a `config()` block within the SQL file. This enhancement will be included in the upcoming dbt Core v1.9 release.
- **Enhancement**: In May 2024, dbt Cloud versionless began inferring a model's `primary_key` based on configured data tests and/or constraints within `manifest.json`. The inferred `primary_key` is visible in dbt Explorer and utilized by the dbt Cloud [compare changes](/docs/deploy/run-visibility#compare-tab) feature. This will also be released in dbt Core 1.9.
Read about the [order dbt infers columns can be used as primary key of a model](https://github.com/dbt-labs/dbt-core/blob/7940ad5c7858ff11ef100260a372f2f06a86e71f/core/dbt/contracts/graph/nodes.py#L534-L541).
Expand Down
18 changes: 17 additions & 1 deletion website/docs/reference/global-configs/behavior-changes.md
Original file line number Diff line number Diff line change
Expand Up @@ -68,11 +68,28 @@ When we use dbt Cloud in the following table, we're referring to accounts that h
| require_resource_names_without_spaces | 2024.05 | TBD* | 1.8.0 | 1.9.0 |
| source_freshness_run_project_hooks | 2024.03 | TBD* | 1.8.0 | 1.9.0 |
| [Redshift] [restrict_direct_pg_catalog_access](#redshift-restrict_direct_pg_catalog_access) | 2024.09 | TBD* | dbt-redshift v1.9.0 | 1.9.0 |
| skip_nodes_if_on_run_start_fails | 2024.10 | TBD* | 1.9.0 | TBD* |
| state_modified_compare_more_unrendered | 2024.10 | TBD* | 1.9.0 | TBD* |

When the dbt Cloud Maturity is "TBD," it means we have not yet determined the exact date when these flags' default values will change. Affected users will see deprecation warnings in the meantime, and they will receive emails providing advance warning ahead of the maturity date. In the meantime, if you are seeing a deprecation warning, you can either:
- Migrate your project to support the new behavior, and then set the flag to `True` to stop seeing the warnings.
- Set the flag to `False`. You will continue to see warnings, and you will retain the legacy behavior even after the maturity date (when the default value changes).

### Failures in on-run-start hooks

The flag is `False` by default.

Set the `skip_nodes_if_on_run_start_fails` flag to `True` to skip all selected resources from running if there is a failure on an `on-run-start` hook.

### Source definitions for state:modified

The flag is `False` by default.

Set `state_modified_compare_more_unrendered` to `True` to reduce false positives during `state:modified` checks (especially when configs differ by target environment like `prod` vs. `dev`).

Setting the flag to `True` changes the `state:modified` comparison from using rendered values to unrendered values instead. It accomplishes this by persisting `unrendered_config` during model parsing and `unrendered_database` and `unrendered_schema` configs during source parsing.


### Package override for built-in materialization

Setting the `require_explicit_package_overrides_for_builtin_materializations` flag to `True` prevents this automatic override.
Expand Down Expand Up @@ -128,4 +145,3 @@ on-run-start:
- '{{ ... if flags.WHICH != 'freshness' }}'
```
</File>

Loading