Paths/Data Engineer/Orchestration & Scheduling / Reliability & Recovery
Alert on a Late Pipeline
Consumers need the data by a certain time, so the pipeline needs a deadline of its own. Write the alert that fires when the daily load misses it.
Validator
⏱ 0:00
IDLE — checks run live as you type commands; submit when done
01Requirements
live checks- File ~/orchestration/alerts.yaml exists○
- The alert states the deadline the pipeline must meet○
- The alert states the condition that fires it○
- The alert states how it notifies the team○
02Walkthrough
1 of 3 revealed- 01
Write the alert rule
deadline is the time the consumers need the data, on the clock the business cares about - not the scheduler's timezone.
echo 'alerts:\n - name: DailyLoadLate\n dag_id: daily_load\n deadline: "07:00"\n on_failure: [missing, failed, late]' > ~/orchestration/alerts.yaml - 2 locked · each failed submit reveals one
03Stuck?
0 of 3 revealedTake a hint without losing the lab — each one points at the thing to look at, not at the answer.
04AI Tutor
guides, never solvesTell me what you're stuck on — I'll nudge, not solve. Which requirement are you looking at?
04Notebook
saved locally in this browserlearner@lab — ubuntu:24.04
Session is disposable
↑/↓ recalls commands · Ctrl+Enter submits · type help for the command list