How to Evaluate Your LLM App: Building a Simple Eval Set
Posted on Sun 25 October 2026 in Tutorial • Tagged with GenAI, LLM, evaluation, evals, testing, Python, prompt-engineering
The Question I Couldn't Answer
For a long time, my process for improving a prompt was embarrassingly simple: change the wording, try two or three inputs, decide it "feels better," and move on. Then one day someone asked me a basic question: "Is the new version actually better than the …
Continue reading