I will demo the
ai-flow.eu evaluation suite and walk through how it is built end to end.
We will start with a minimal evaluation project and define a dataset of prompts and expected behavior. Then we will run automated evaluations across multiple models and configurations and capture structured results.
I will show how we:
- version datasets and test cases
- run deterministic checks plus LLM judged scoring
- track regressions between runs
- generate a simple report that is useful for engineers
The focus is on code, architecture, and the practical workflow to make LLM changes measurable.