OpenWeather ETL Pipeline

Built a simple ETL pipeline where Python is used to extract data from OpenWeather API, transforms it and loads into AWS S3, orchestrated using Apache Airflow deployed in AWS EC2.

Tech Stack
  • Python (data extraction, transformation and loading)
  • AWS S3 (storage of transformed data)
  • Apache Airflow (orchestration)
  • AWS EC2 (deployment of Airflow)
Architecture Diagram

Github URL: Project Link