Weekly Sales Reporting Pipeline and Dashboard with Airflow, BigQuery, and dbt
Project Summary
In this project, a fully automated weekly ELT pipeline was developed to process, validate, transform, and visualize electronic sales data.
Highlights:
- Cleaned & validated raw data with Soda SQL
- Automated data workflows in Airflow to transfer and load data (PostgreSQL → GCS → BigQuery).
- Created dbt transformations to deliver reliable, dashboard ready data
- Designed Looker Studio dashboard for KPIs
- Added Slack alerts for pipeline failures
Outcome:
Technologies used
- Apache Airflow
- Google Cloud Platform: GCS & BigQuery
- PostgreSQL
- dbt
- Soda SQL
- Looker Studio
- Slack Webhooks