01
Eval cases
Make this concrete enough that another engineer can understand what you built and why.
CAREER PROJECT · Intermediate · 1 weekend
Prompt Regression Test Suite
Create versioned prompts, test cases and automated quality/cost regression checks.
Prompt engineeringEvaluationCIMetricsLLM APIs
DEFINITION OF DONE
Leave artifacts a reviewer can inspect.
02
CI check
Make this concrete enough that another engineer can understand what you built and why.
03
Versioned prompts
Make this concrete enough that another engineer can understand what you built and why.
04
Quality report
Make this concrete enough that another engineer can understand what you built and why.
05
Cost baseline
Make this concrete enough that another engineer can understand what you built and why.
RESUME / PORTFOLIO FRAMING
Describe what you actually did.
Created an automated prompt regression suite that tracks quality, latency and cost across prompt changes.
Use this as a starting structure, then replace it with your real implementation details, metrics and constraints. Do not claim outcomes you did not measure.
STRETCH GOALS
Go deeper if the core is already solid.
Model routing
Add only if it strengthens the engineering story instead of delaying a finished, deployable core.
Judge calibration
Add only if it strengthens the engineering story instead of delaying a finished, deployable core.
Dashboard
Add only if it strengthens the engineering story instead of delaying a finished, deployable core.