# Vector store parity on golden sets

Vector store bake-offs compare pgvector, Pinecone, and others on filtered metadata recall, not just demo unfiltered ANN. We document HNSW params and vacuum lag risks. €2,400 PoC; €3,100 Eval CI; €3,900 prototype migration; €5,600 hardening; €8,500 MVP; audit from €8,000. Written scope arrives within 48 hours with numeric pass marks on accuracy, groundedness, p95 latency, and cost per thousand runs; deliverables include Dockerized repos, handoff notes, and Promptfoo or DeepEval fixtures your team can extend. Deliverables include Dockerized repos and Promptfoo or DeepEval fixtures wired to your CI provider.

**Sprints from €2,400 PoC · €3,100 eval CI · €3,900 prototype · €5,600 hardening · €8,500 MVP · audit from €8,000** · Topic: `ai-vector-stores` · [Open proof](/#open-proof) · [Sample scorecard](/sample)

HTML: [/ai/vector-stores](/ai/vector-stores) · Markdown: [/ai/vector-stores.md](/ai/vector-stores.md)


_Vector store parity on golden sets_

## Why teams trust this stack with Arviser

- Stack-specific gates for Vector store parity on golden sets, not generic AI slideware.
- Senior engineers (10+ yrs) with daily eval tooling; founder architecture review (30+ yrs IT).
- Proof links include Open proof and sample scorecards, commercial sprints stay fixed-scope.

## Dual path

### For CTO / Staff Eng

Senior engineers (10+ yrs) build the vertical slice, wire retrieval and tools, and leave a repo your team can extend, with modular prompts, typed tool schemas, and CI eval fixtures.

### For VP Product / CFO

Fixed-hour packages (€2,400–€8,500) de-risk AI spend: kill fees on Risk-Shared PoC when narrow hypotheses fail, 100% PoC credit toward MVP on Go, and no surprise T&M overruns inside written scope.

Route: 24h PoC (€2,400) if unknown feasibility, else 40h Prototype (€3,900); add 32h Eval CI (€3,100) before scale; harden at €5,600 or ship MVP at €8,500.

## Stack-specific failure modes we gate in eval CI

- HNSW ef_search tuned for demo recall collapses under filtered metadata queries.
- Pinecone namespace migration duplicates vectors with different IDs.
- pgvector vacuum lag serves deleted customer rows in RAG answers.

### Sample eval fragment (ai-vector-stores)

```
compare:
  stores: [pgvector, pinecone]
  recall@10_min: 0.85
```

## Which sprint fits?

| Situation | Recommendation | Sprint |
| --- | --- | --- |
| Hard unknown on this stack | 24h Technical PoC | €2,400 · 3–5 days |
| Working demo, no CI evals | 32h Eval CI harness | €3,100 · 1 week |
| Pilot traffic soon | 60h Hardening or 80h MVP | €5,600–€8,500 |

## FAQ

### Do you build Vector store parity on golden sets under fixed scope?

Yes. We deliver written scope in 48h and fixed-hour packages; overruns inside agreed spec are on us.

### Can we start with eval CI only?

Yes, 32h Eval CI from €3,100 when a prototype exists but gates do not.

Reviewed by Vadim Nareyko, 30+ yrs IT · Last updated 2026-11-06

## Related

[AI hub](/ai) · [Eval CI](/services/eval-ci-harness)

