Paths/MLOps Engineer/Model Serving / The Serving Stack
Serve the Model on a Port
Build a vLLM serving image and run it published on host port 8000 — the last hop between a model sitting on disk and a model answering HTTP requests.
Validator
⏱ 0:00
IDLE — checks run live as you type commands; submit when done
01Requirements
live checks- A Dockerfile exists in ~/serving-stack○
- An image vllm-serve:v1 is built○
- A container from vllm-serve:v1 is running, published on port 8000○
02Walkthrough
1 of 8 revealed- 01
Create the build directory
Every image build starts from a directory — the build context that holds the Dockerfile.
mkdir ~/serving-stack - 7 locked · each failed submit reveals one
03Stuck?
0 of 3 revealedTake a hint without losing the lab — each one points at the thing to look at, not at the answer.
04AI Tutor
guides, never solvesTell me what you're stuck on — I'll nudge, not solve. Which requirement are you looking at?
04Notebook
saved locally in this browserlearner@lab — docker:24
Session is disposable
↑/↓ recalls commands · Ctrl+Enter submits · type help for the command list