Arviser

What happens in a two-week LLM Quality Audit

Fixed scope. From €8,000. One agreed LLM or RAG surface unless scoped otherwise.

Week 1

Day band Work
Kickoff NDA, system boundary, environments, data rules (synthetic or your controlled environment under a DPA).
Access Read-only paths to prompts, retrieval, traces, CI if available.
Golden set Build or extend labeled cases for the live surface. Agree pass marks before final scores.

Week 2

Day band Work
Measure Score six areas: golden set, groundedness, refusal and safety, CI and regression, production sampling, cost and latency.
Package Engineering report (severity, engineer-day fixes), one-page exec summary, repeatable suite. CI harness when access allows.
Readout 60 minutes with the person who ran the work.

After

You own the suite and the report. Remediation can be yours, ours (scoped from findings), or a retainer. LLM Quality Audit is billed on its own and is not credited toward later packages.

If we do not deliver a prioritized roadmap and a working eval baseline for the agreed surface, you do not pay the Audit fee. Scope must be signed first.

LLM Quality Audit · How we score · Request scope