Paths/AI Engineer/LLMOps / Deploying & Rolling Out Models
Configure the Inference Endpoint
Everything the serving layer needs is configuration - which model, where it listens, how long it may think and what happens when it fails. Write it.
Validator
⏱ 0:00
IDLE — checks run live as you type commands; submit when done
01Requirements
live checks- Directory ~/llmops exists○
- File ~/llmops/endpoint.yaml exists○
- The config names the model and the port○
- The config sets a timeout and a retry count○
02Walkthrough
1 of 4 revealed- 01
Create the llmops directory
Deployment configuration belongs next to the tracking and evaluation configuration.
mkdir ~/llmops - 3 locked · each failed submit reveals one
03Stuck?
0 of 3 revealedTake a hint without losing the lab — each one points at the thing to look at, not at the answer.
04AI Tutor
guides, never solvesTell me what you're stuck on — I'll nudge, not solve. Which requirement are you looking at?
04Notebook
saved locally in this browserlearner@lab — ubuntu:24.04
Session is disposable
↑/↓ recalls commands · Ctrl+Enter submits · type help for the command list