Rough DAG shape:
schedule (e.g. every N hours)
→ dbt build (staging + marts + tests)
→ on failure: alert
→ (optional) reconciliation task: spot-poll GitHub API,
compare counts against what streamed in, flag drift
- Self-hosted Airflow via Docker Compose
Rough DAG shape:
schedule (e.g. every N hours)
→ dbt build (staging + marts + tests)
→ on failure: alert
→ (optional) reconciliation task: spot-poll GitHub API,
compare counts against what streamed in, flag drift