Paths/AI Engineer/LLMOps / Prompt Versioning and Evals
Write an Eval Results File
An eval is a set of test cases a prompt must survive, plus the score from the latest run. Create a cases file with three test cases and record a passing score in results.txt.
Validator
⏱ 0:00
IDLE — checks run live as you type commands; submit when done
01Requirements
live checks- File ~/evals/cases.txt exists with 3 test cases○
- File ~/evals/results.txt exists with the score○
02Walkthrough
1 of 7 revealed- 01
Create the evals directory
mkdir makes a new directory. Teams usually keep evals in their own folder so test cases are easy to find and rerun.
mkdir ~/evals - 6 locked · each failed submit reveals one
03Stuck?
0 of 3 revealedTake a hint without losing the lab — each one points at the thing to look at, not at the answer.
04AI Tutor
guides, never solvesTell me what you're stuck on — I'll nudge, not solve. Which requirement are you looking at?
04Notebook
saved locally in this browserlearner@lab — ubuntu:24.04
Session is disposable
↑/↓ recalls commands · Ctrl+Enter submits · type help for the command list