OpenWeather ETL Pipeline

Built a simple ETL pipeline where Python is used to extract data from OpenWeather API, transforms it and loads into AWS S3, orchestrated using Apache Airflow deployed in AWS EC2.

Tech Stack

• Python (data extraction, transformation and loading)
• AWS S3 (storage of transformed data)
• Apache Airflow (orchestration)
• AWS EC2 (deployment of Airflow)

Architecture Diagram

Github URL: Project Link