Paths/Data Engineer/Governance & Lineage / Catalog & Lineage
Write a Catalog Entry
The catalog entry is where a dataset earns its name - who owns it, what it holds and how sensitive it is. Write one.
Validator
IDLE — checks run live as you type commands; submit when done
01Requirements
live checks- Directory ~/governance/catalog exists○
- File ~/governance/catalog/users.yaml exists○
- The entry names the owner and describes the dataset○
- The entry lists the columns and the classification○
02Walkthrough
4 steps- 01
Create the catalog directory
One file per dataset, in a directory that mirrors the warehouse.
mkdir -p ~/governance/catalog - 02
Write the entry
The owner is a team, the description says what the dataset holds, and the classification says how sensitive it is.
echo 'name: users\nowner: growth-team\ndescription: One row per registered user, updated hourly from the accounts service\nclassification: confidential' > ~/governance/catalog/users.yaml - 03
List the columns
Every column, its type and whether it holds personal data. The classification of the dataset is the strictest of its columns.
echo '\ncolumns:\n - name: user_id\n type: string\n - name: email\n type: string\n pii: true\n - name: country\n type: string\n pii: false' >> ~/governance/catalog/users.yaml - 04
Verify and submit
cat the entry, then submit for validation.
cat ~/governance/catalog/users.yaml
03Stuck?
0 of 3 revealedTake a hint without losing the lab — each one points at the thing to look at, not at the answer.
04AI Tutor
guides, never solvesTell me what you're stuck on — I'll nudge, not solve. Which requirement are you looking at?
04Notebook
saved locally in this browserlearner@lab — ubuntu:24.04
Session is disposable
↑/↓ recalls commands · Ctrl+Enter submits · type help for the command list