DBT Research

Research the capability of DBT (Data Build Tool)

Git repo

Learning DBT

https://datacaffee.com/wp-content/uploads/2021/03/dbt-_commands.pdf

Setting up a project structure

https://docs.getdbt.com/docs/building-a-dbt-project/projects https://github.com/dbt-labs/corp/blob/main/dbt_style_guide.md

To create a new dbt project, run:

$ dbt init [project_name]

This will create a new directory in your current path (i.e. at ./[project-name] ).

Connect to an Azure SQL

https://github.com/dbt-msft/dbt-sqlserver https://docs.getdbt.com/reference/warehouse-profiles/mssql-profile

Example profile: https://github.com/dbt-msft/dbt-sqlserver/blob/master/test/integration/sample.profiles.yml

Seeds

https://docs.getdbt.com/docs/building-a-dbt-project/seeds

Copy data from one table to the next

Learning DTAP

Learning Documentation

Learning Lineage

Examples

https://github.com/dbt-labs/jaffle_shop https://github.com/dbt-labs/databricks_dbt_demo_project

Validations

https://github.com/dbt-labs/dbt-utils

https://github.com/dbt-labs/cytoscape.js https://js.cytoscape.org/