Paths/Data Engineer/Batch Ingestion & ETL / Transforms & Contracts
Deduplicate in SQL
Sources repeat themselves, and types arrive as strings. Write the transform that keeps the newest row per key and casts the columns.
Validator
⏱ 0:00
IDLE — checks run live as you type commands; submit when done
01Requirements
live checks- File ~/pipelines/transforms/clean_orders.sql exists○
- The query ranks the rows per key and keeps the newest one○
- The query casts the amount column to a number○
02Walkthrough
1 of 3 revealed- 01
Create the transforms directory
Transforms get their own folder - they are the part of the pipeline you rewrite most.
mkdir -p ~/pipelines/transforms - 2 locked · each failed submit reveals one
03Stuck?
0 of 3 revealedTake a hint without losing the lab — each one points at the thing to look at, not at the answer.
04AI Tutor
guides, never solvesTell me what you're stuck on — I'll nudge, not solve. Which requirement are you looking at?
04Notebook
saved locally in this browserlearner@lab — ubuntu:24.04
Session is disposable
↑/↓ recalls commands · Ctrl+Enter submits · type help for the command list