Skip to content

rohanyg/Azure-Data-Engineering-Project

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

16 Commits
 
 
 
 
 
 

Repository files navigation

Azure-Data-Engineering-Project

Azure Data Factory is used for ingesting data stored in the web and on-premise to Data Lake gen 2 using automated pipelines. Azure Data Lake Gen 2 is used for storage of data. Databricks could be connected to Data Lake Gen 2 where the raw data is stored in the container. Databricks is used for data transformation as it provides the power of Apache spark without the requirement for setting up the environment. Then the data tranformed is stored back to Data Lake gen 2. Azure Synapse Analytics helps in setting up a database and querying it. Power BI is used to create dashboards.

hello

Power BI Dashboard Link : https://app.powerbi.com/groups/me/reports/0ee78901-53a8-411d-9192-84c57d308a4f/ReportSection?experience=power-bi

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published