Skip to content

Commit

Permalink
[ci skip] Deployed fe2bf1d with MkDocs version: 1.5.3
Browse files Browse the repository at this point in the history
  • Loading branch information
Unknown committed Nov 21, 2023
1 parent cac6db6 commit 7bd5a40
Show file tree
Hide file tree
Showing 16 changed files with 1,573 additions and 2,185 deletions.
13 changes: 10 additions & 3 deletions bqetl/index.html
Original file line number Diff line number Diff line change
Expand Up @@ -4307,8 +4307,13 @@ <h4 id="validate"><code>validate</code></h4>
<span class="w"> </span>ga_derived.blogs_goals_v1
</code></pre></div>
<h4 id="initialize"><code>initialize</code></h4>
<p>Create and initialize the destination table for the query.
Only for queries that have an <code>init.sql</code> file.</p>
<p>Run a full backfill on the destination table for the query.
Using this command will:
- Create the table if it doesn't exist and run a full backfill.
- Run a full backfill if the table exists and is empty.
- Raise an exception if the table exists and has data, or if the table exists and the schema doesn't match the query.
It supports <code>query.sql</code> files that use the is_init() pattern, and <code>init.sql</code> files.
To run in parallel per sample_id, include a @sample_id parameter in the query.</p>
<p><strong>Usage</strong></p>
<div class="highlight"><pre><span></span><code>$<span class="w"> </span>./bqetl<span class="w"> </span>query<span class="w"> </span>initialize<span class="w"> </span><span class="o">[</span>OPTIONS<span class="o">]</span><span class="w"> </span><span class="o">[</span>name<span class="o">]</span>

Expand All @@ -4320,7 +4325,9 @@ <h4 id="initialize"><code>initialize</code></h4>
--parallelism:<span class="w"> </span>Number<span class="w"> </span>of<span class="w"> </span>threads<span class="w"> </span><span class="k">for</span><span class="w"> </span>parallel<span class="w"> </span>processing
</code></pre></div>
<p><strong>Examples</strong></p>
<div class="highlight"><pre><span></span><code>./bqetl<span class="w"> </span>query<span class="w"> </span>initialize<span class="w"> </span>telemetry_derived.ssl_ratios_v1
<div class="highlight"><pre><span></span><code>Examples:
<span class="w"> </span>-<span class="w"> </span>For<span class="w"> </span>init.sql<span class="w"> </span>files:<span class="w"> </span>./bqetl<span class="w"> </span>query<span class="w"> </span>initialize<span class="w"> </span>telemetry_derived.ssl_ratios_v1
<span class="w"> </span>-<span class="w"> </span>For<span class="w"> </span>query.sql<span class="w"> </span>files<span class="w"> </span>and<span class="w"> </span>parallel<span class="w"> </span>run:<span class="w"> </span>./bqetl<span class="w"> </span>query<span class="w"> </span>initialize<span class="w"> </span>sql/moz-fx-data-shared-prod/telemetry_derived/clients_first_seen_v2/query.sql
</code></pre></div>
<h4 id="render"><code>render</code></h4>
<p>Render a query Jinja template.</p>
Expand Down
101 changes: 101 additions & 0 deletions mozdata/firefox_accounts/index.html
Original file line number Diff line number Diff line change
Expand Up @@ -3987,6 +3987,107 @@ <h2 id="docker_fxa_admin_server_sanitized"><a href="#docker_fxa_admin_server_san
<p><strong>Docker Fxa Admin Server Sanitized</strong></p>
<p><code>firefox_accounts.docker_fxa_admin_server_sanitized</code></p>
<p>Please provide a description for the query</p>
<table>
<caption>Schema</caption>
<tr>
<th>Column</th>
<th>Description</th>
<th>Type</th>
<th>Nullable</th>
</tr>
<tr>
<td>date</td>
<td></td>
<td>Date</td>
<td>Yes</td>
</tr><tr>
<td>logName</td>
<td></td>
<td>String</td>
<td>Yes</td>
</tr><tr>
<td>resource</td>
<td></td>
<td>Record</td>
<td>Yes</td>
</tr><tr>
<td>textPayload</td>
<td></td>
<td>String</td>
<td>Yes</td>
</tr><tr>
<td>jsonPayload</td>
<td></td>
<td>Record</td>
<td>Yes</td>
</tr><tr>
<td>timestamp</td>
<td></td>
<td>Timestamp</td>
<td>Yes</td>
</tr><tr>
<td>receiveTimestamp</td>
<td></td>
<td>Timestamp</td>
<td>Yes</td>
</tr><tr>
<td>severity</td>
<td></td>
<td>String</td>
<td>Yes</td>
</tr><tr>
<td>insertId</td>
<td></td>
<td>String</td>
<td>Yes</td>
</tr><tr>
<td>httpRequest</td>
<td></td>
<td>Record</td>
<td>Yes</td>
</tr><tr>
<td>labels</td>
<td></td>
<td>Record</td>
<td>Yes</td>
</tr><tr>
<td>operation</td>
<td></td>
<td>Record</td>
<td>Yes</td>
</tr><tr>
<td>trace</td>
<td></td>
<td>String</td>
<td>Yes</td>
</tr><tr>
<td>spanId</td>
<td></td>
<td>String</td>
<td>Yes</td>
</tr><tr>
<td>traceSampled</td>
<td></td>
<td>Boolean</td>
<td>Yes</td>
</tr><tr>
<td>sourceLocation</td>
<td></td>
<td>Record</td>
<td>Yes</td>
</tr><tr>
<td>split</td>
<td></td>
<td>Record</td>
<td>Yes</td>
</tr><tr>
<td>errorGroups</td>
<td></td>
<td>Record</td>
<td>No</td>
</tr>
</table>

<table>
<caption>Referenced Tables</caption>
<tr>
Expand Down
Loading

0 comments on commit 7bd5a40

Please sign in to comment.