Paths/Data Engineer/Streaming & Event Pipelines / Event & Topic Design
Lay Out Your Topics
One topic per event, split into partitions, with a retention window you chose on purpose. Write the layout.
Validator
⏱ 0:00
IDLE — checks run live as you type commands; submit when done
01Requirements
live checks- File ~/streaming/topics.yaml exists○
- The config names the topics and their partitions○
- The config states the retention and the replication factor○
02Walkthrough
1 of 3 revealed- 01
Write the topic layout
Partitions are the unit of parallelism and of ordering - more partitions means more consumers, but never more order than partitions.
echo 'topics:\n - name: order_placed\n partitions: 12\n key: order_id\n retention.ms: 604800000\n replication_factor: 3\n - name: order_shipped\n partitions: 12\n key: order_id\n retention.ms: 2592000000\n replication_factor: 3' > ~/streaming/topics.yaml - 2 locked · each failed submit reveals one
03Stuck?
0 of 3 revealedTake a hint without losing the lab — each one points at the thing to look at, not at the answer.
04AI Tutor
guides, never solvesTell me what you're stuck on — I'll nudge, not solve. Which requirement are you looking at?
04Notebook
saved locally in this browserlearner@lab — ubuntu:24.04
Session is disposable
↑/↓ recalls commands · Ctrl+Enter submits · type help for the command list