What happens in a two-week LLM Quality Audit
Fixed scope. From €8,000. One agreed LLM or RAG surface unless scoped otherwise.
Week 1
| Day band | Work |
|---|---|
| Kickoff | NDA, system boundary, environments, data rules (synthetic or your controlled environment under a DPA). |
| Access | Read-only paths to prompts, retrieval, traces, CI if available. |
| Golden set | Build or extend labeled cases for the live surface. Agree pass marks before final scores. |
Week 2
| Day band | Work |
|---|---|
| Measure | Score six areas: golden set, groundedness, refusal and safety, CI and regression, production sampling, cost and latency. |
| Package | Engineering report (severity, engineer-day fixes), one-page exec summary, repeatable suite. CI harness when access allows. |
| Readout | 60 minutes with the person who ran the work. |
After
You own the suite and the report. Remediation can be yours, ours (scoped from findings), or a retainer. LLM Quality Audit is billed on its own and is not credited toward later packages.
If we do not deliver a prioritized roadmap and a working eval baseline for the agreed surface, you do not pay the Audit fee. Scope must be signed first.