Skip to content

A containerized end-to-end analytics of sales data using dbt, Airbyte, Postgres, and Looker Studio.

Notifications You must be signed in to change notification settings

mustafa0taru/postgres-dbt-airbyte-looker

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

17 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Modern Data Stack for Sales Analysis

This repository offers a structured approach for ingesting, transforming, and visualizing sales data from Postgres, leveraging Airbyte's robust data integration, dbt's declarative modeling capabilities, and Looker's interactive exploration power. Tools:

The Medallion Architecture

Untitled (18)

Tools:

  • Postgres
  • Airbyte
  • dbt
  • Looker
  • Docker

The Dashboard

Screenshot 2024-03-05 044641 View here

Getting Started:

  • Clone the Repository: Use git clone git clone https://github.com/mustafa0taru/postgres-dbt-airbyte-looker.git to download the project.
  • Configure Connections: Update the connection details in airbyte.yaml, dbt_project.yml, and looker.ini with your specific Postgres, Airbyte, and Looker credentials.
  • Customize dbt Models: Adapt the provided dbt models (focusing on stg_store.sql, stg_product.sql, and stg_transaction.sql) to precisely align with your sales data schema and desired transformations.
  • Run the Pipeline: Follow the instructions in the README.md file to initiate the data extraction, transformation, and loading process.
  • Explore Your Sales Data: Access Looker to interactively explore your transformed sales data through insightful visualizations, dashboards, and SQL queries.

Resources:

  • Learn more about dbt in the docs
  • Check out Discourse for commonly asked questions and answers
  • Join the chat on Slack for live discussions and support
  • Find dbt events near you
  • Check out the blog for the latest news on dbt's development and best practices

About

A containerized end-to-end analytics of sales data using dbt, Airbyte, Postgres, and Looker Studio.

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages