diff --git a/CONTEXT.md b/CONTEXT.md index 1f469c3..988cedb 100644 --- a/CONTEXT.md +++ b/CONTEXT.md @@ -98,13 +98,21 @@ _Avoid_: Retrieved chunks list, neighbor list, expansion map An ordered batch of Experiments that hold Strategy and Corpus Embedding Model fixed while stepping Neighbor Expansion through symmetric levels (±0, ±1, ±2, ±3) — i.e. `(neighbor_prev, neighbor_next)` = `(0,0)`, `(1,1)`, `(2,2)`, `(3,3)` — across one or more documents. Each level is its own Experiment; the Sweep is the sequence, not a single stored row. _Avoid_: Batch run, sequential benchmark, benchmark script, neighbor matrix +**Strategy Candidate**: +A single comparable configuration for final Strategy selection under one Corpus Embedding Model: either `fixed_size` at one Neighbor Expansion level (±N), or `semantic` under one Boundary Embedding Model. Distinct from an Experiment (an Experiment is one doc’s run of one Candidate, or of several Strategies). Final selection compares Candidates, not raw multi-strategy Experiments. The Decision Board auto-discovers Candidates from single-strategy Experiments (newest per doc×Candidate cell), filtered by Corpus Embedding Model, with optional exclude of a bad Experiment. +_Avoid_: Variant, configuration, setup, arm + +**Decision Board**: +A top-level Dashboard Tab for choosing between Strategy families after tuning: stage 1 picks the best Strategy Candidate within `fixed_size` and within `semantic`; stage 2 compares those two winners. Always accompanied by a per-document breakdown so aggregate rank cannot hide doc-level disagreement. Document universe for v1 is the fixed 10-doc evaluation set (same as the Neighbor Expansion Benchmark Sweep). Distinct from Compare (ad-hoc multi-Experiment side-by-side) and from Retrieval Inspect. +_Avoid_: Final compare, strategy picker, results page, leaderboard, Decision mode + ## Architecture Decisions | # | Decision | Status | |---|----------|--------| ADR-0001 | Single-file React via CDN (no build step), served by FastAPI | Approved | ADR-0002 | New `/admin/` router for dashboard-specific backend ops (health, Qdrant CRUD, chunk preview, questions, cost) | Approved | - ADR-0003 | Top-tab navigation (Home, Documents, Query, Benchmarks, Admin) — not sidebar | Approved | + ADR-0003 | Top-tab navigation (Home, Documents, Query, Benchmarks, Decision, Admin) — not sidebar | Approved | ADR-0004 | Babel-in-browser JSX: single index.html with inline