swadhinbiswas added:cookebook for this project · 8/1/2026
ce5d03e
16 lines · 449 Bytes
Raw Download

« Back to Index

Scheduling Strategy

Our batch scheduling strategy must handle dependencies:

  1. Ingest Flights & Weather (Parallel)
  2. Transform Bronze to Silver
  3. Load Silver to Warehouse
  4. Run dbt (Silver to Gold)

Since everything runs within a single Python orchestrator script executed by GitHub Actions, the script internally manages this sequential execution flow.


« Back to Index