# Eval and guardrail CI harness

Eval CI harness delivery wires Promptfoo or DeepEval into GitHub/GitLab/Azure with 50-case baselines, PII/refusal checks, and flaky latency policies tuned for shared runners. €3,100 standard package; €2,400 PoC when harness architecture is unsettled; €5,600 hardening for prod sampling hooks; €8,000 audit optional. Stops green merges that hide 4-point groundedness drops. Written scope arrives within 48 hours with numeric pass marks on accuracy, groundedness, p95 latency, and cost per thousand runs; deliverables include Dockerized repos, handoff notes, and Promptfoo or DeepEval fixtures your team can extend.

**Sprints from €2,400 PoC · €3,100 eval CI · €3,900 prototype · €5,600 hardening · €8,500 MVP · audit from €8,000** · Topic: `services-eval-ci-harness` · [Open proof](/#open-proof) · [Sample scorecard](/sample) · [go-llm-gateway-audit](https://github.com/nareyko/go-llm-gateway-audit) · [golden-set-schema](https://github.com/nareyko/golden-set-schema)

HTML: [/services/eval-ci-harness](/services/eval-ci-harness) · Markdown: [/services/eval-ci-harness.md](/services/eval-ci-harness.md)


_Eval and guardrail CI hub_

## Why teams trust this stack with Arviser

- Stack-specific gates for Eval and guardrail CI harness, not generic AI slideware.
- Senior engineers (10+ yrs) with daily eval tooling; founder architecture review (30+ yrs IT).
- Proof links include Open proof and sample scorecards, commercial sprints stay fixed-scope.

## Dual path

### For CTO / Staff Eng

Senior engineers (10+ yrs) build the vertical slice, wire retrieval and tools, and leave a repo your team can extend, with modular prompts, typed tool schemas, and CI eval fixtures.

### For VP Product / CFO

Fixed-hour packages (€2,400–€8,500) de-risk AI spend: kill fees on Risk-Shared PoC when narrow hypotheses fail, 100% PoC credit toward MVP on Go, and no surprise T&M overruns inside written scope.

Typical route: 32h Eval CI (€3,100) or 24h PoC (€2,400) on the riskiest slice, then 60h Hardening (€5,600) or LLM Quality Audit (€8,000) before executive sign-off.

## Stack-specific failure modes we gate in eval CI

- Promptfoo CI job uses cached provider responses from prior PR.
- GitHub Actions secret rotation breaks eval webhook but marks green.
- Flaky latency assert passes locally, fails on shared runners nightly.

### Sample eval fragment (svc-eval-ci)

```
ci:
  promptfoo:
    fail_on: regression>2%
```

## Which sprint fits?

| Situation | Recommendation | Sprint |
| --- | --- | --- |
| Hard unknown on this stack | 24h Technical PoC | €2,400 · 3–5 days |
| Working demo, no CI evals | 32h Eval CI harness | €3,100 · 1 week |
| Pilot traffic soon | 60h Hardening or 80h MVP | €5,600–€8,500 |

## FAQ

### Do you build Eval and guardrail CI harness under fixed scope?

Yes. We deliver written scope in 48h and fixed-hour packages; overruns inside agreed spec are on us.

### Can we start with eval CI only?

Yes, 32h Eval CI from €3,100 when a prototype exists but gates do not.

Reviewed by Vadim Nareyko, 30+ yrs IT · Last updated 2026-11-06

## Related

[Services hub](/services) · [Engineering hub](/engineering)

