Scheduling Strategy
Our batch scheduling strategy must handle dependencies:
- Ingest Flights & Weather (Parallel)
- Transform Bronze to Silver
- Load Silver to Warehouse
- Run dbt (Silver to Gold)
Since everything runs within a single Python orchestrator script executed by GitHub Actions, the script internally manages this sequential execution flow.