Skip to content

Commit

Permalink
Clarification for incremental-microbatch.md (#6260)
Browse files Browse the repository at this point in the history
  • Loading branch information
mirnawong1 authored Oct 8, 2024
2 parents abf7c44 + 04b754e commit 34a83c0
Showing 1 changed file with 9 additions and 0 deletions.
9 changes: 9 additions & 0 deletions website/docs/docs/build/incremental-microbatch.md
Original file line number Diff line number Diff line change
Expand Up @@ -30,6 +30,15 @@ A `sessions` model is aggregating and enriching data that comes from two other m

The `page_view_start` column in `page_views` is configured as that model's `event_time`. The `customers` model does not configure an `event_time`. Therefore, each batch of `sessions` will filter `page_views` to the equivalent time-bounded batch, and it will not filter `customers` (a full scan for every batch).

<File name="models/staging/page_views.yml">

```yaml
models:
- name: page_views
config:
event_time: page_view_start
```
</File>
We run the `sessions` model on October 1, 2024, and then again on October 2. It produces the following queries:

<Tabs>
Expand Down

0 comments on commit 34a83c0

Please sign in to comment.