Files
chunking_strategies_evaluation/docs/out-of-scope-v1.md
Mahdi Bazrafshan d3f8a9a5e5 docs: add project documentation and task tracking
Why:
- Need to track domain model, ADRs, task progress, and feature planning

Changes:
- CONTEXT.md: domain model with ADRs 0001-0014
- docs/tasks.md: updated task list with Phase 6 (Dashboard)
- docs/cant-do-yet.md: backend-ready but no UI features
- docs/out-of-scope-v1.md: intentionally excluded features

Impact:
- Project documentation centralized for reference
2026-07-29 17:55:01 +03:30

3.3 KiB

What's Completely Out of Scope for V1

Features that are intentionally excluded from the first version of the dashboard. These would require significant additional architecture, infrastructure, or design work that doesn't serve the core use case of a single-user localhost benchmarking tool.

User Authentication and Multi-User Support

No login, no sessions, no role-based access control. The dashboard runs on localhost and is operated by a single user. Adding auth would introduce JWT/session management, user storage, and permission logic — none of which serve the current workflow.

Exporting Results to CSV/PDF

No built-in export of experiment results, query logs, or benchmark comparisons to CSV, PDF, or Excel. The HTML report endpoint (/benchmarks/{id}/report) is the closest thing to an export. If you need raw data, use the API endpoints directly or query SQLite.

Custom Chunking Parameters from the UI

You cannot change chunk_size, chunk_overlap, semantic_threshold, or semantic_min_chunk_size from the dashboard. These are hardcoded in src/core/config.py with defaults (512 tokens, 50 overlap, 0.3 threshold). Changing them requires editing the config and restarting the server. The UI uses whatever the server has configured.

Streaming Responses

Answers from GPT-4o-mini appear all at once after the full response is generated. There is no Server-Sent Events (SSE) or WebSocket connection to stream the answer word-by-word as it is generated. The latency breakdown shows how long generation took, but you wait for the complete answer.

Dark/Light Theme Toggle

The dashboard is locked to the custom dark theme (#111113 base, #eab308 amber accent). There is no theme switcher or light mode alternative. The design tokens are hardcoded as CSS custom properties in the HTML file.

Mobile Responsive Layout

The dashboard is designed for desktop screens (max-width 1200px, tab bar, tables). It is not optimized for phones or tablets. Tables will overflow, the tab bar may wrap, and the drop zone will be small on mobile. A responsive redesign with breakpoints is not planned for V1.

WebSocket for Real-Time Updates

No persistent WebSocket connections. All communication is via standard HTTP REST requests. This means:

  • Processing status updates require polling or a full page refresh
  • No live push when a benchmark completes
  • No live updating of collection point counts as chunks are inserted

Batch Operations

You cannot process multiple documents at once, run multiple benchmarks in parallel, or delete several documents simultaneously. Each operation targets a single document. If you need to process 10 documents, you click "Process" 10 times.

Search Across Documents or Experiments

No full-text search or filtering within the dashboard. You cannot search for a specific question text, filter experiments by date range, or find documents by partial filename. The document list and experiment list show everything in chronological order with no search or filter controls.

Configuration Management from the UI

You cannot view or edit the server configuration (OpenAI model, temperature, max_tokens, embedding model, Qdrant URL, database path) from the dashboard. The /admin/config endpoint was deferred to V1.1. All configuration is managed via the .env file and src/core/config.py.