Tokyo Olympics Azure ETL Pipeline

Built an ETL pipeline to familise with Azure data engineering tools. Extracted data from a Kaggle dataset to work on. Visualised transformed data using Tableau.

Tech Stack
  • Azure Data Factory (build data pipeline)
  • Azure Data Lake Gen 2 (storage of raw and transformed data)
  • Azure Databricks (data transformation)
  • Synapse Analytics (querying using SQL)
  • Tableau (data visualisation)
Architecture Diagram

Github URL: Project Link