Weekly Sales Reporting Pipeline and Dashboard with Airflow, BigQuery, and dbt
Project Summary
In this project, a fully automated weekly ELT pipeline was developed to process, validate, transform, and visualize electronic sales data.
Highlights:
- Cleaned & validated raw data with Soda SQL
- Automated data workflows in Airflow to transfer and load data (PostgreSQL → GCS → BigQuery).
- Created dbt transformations to deliver reliable, dashboard ready data
- Designed Looker Studio dashboard for KPIs
- Added Slack alerts for pipeline failures
Outcome:
- Built a fully automated weekly sales reporting pipeline.
- Cleaned and transformed raw data into reliable, analysis-ready tables.
- Provided with real-time insights while reducing manual reporting effort.
Technologies used
- Apache Airflow
- Google Cloud Platform: GCS & BigQuery
- PostgreSQL
- dbt
- Soda SQL
- Looker Studio
- Slack Webhooks
View the code.
View the Dashboard.