Files
chunking_strategies_evaluation/.env.example
Mahdi Bazrafshan 5fd19c12d9 feat(chunking): add embedding model registry and ollama config
Why:
- Operators need Cloud and Local Embedding Models with stable ids, dimensions, and defaults.

Changes:
- Add Embedding Model Registry; Ollama client; env defaults for model, Ollama host, and Neighbor Expansion knobs.

Impact:
- New installs default to text-embedding-3-large; OLLAMA_BASE_URL required for Local provider.

Co-authored-by: Cursor <cursoragent@cursor.com>
2026-08-10 14:12:36 +03:30

38 lines
860 B
Plaintext

# OpenAI API authentication (required)
OPENAI_API_KEY=sk-...
# Qdrant configuration
QDRANT_URL=http://localhost:6333
QDRANT_API_KEY=
# Default cloud Embedding Model (registry id / OpenAI model name)
EMBEDDING_MODEL=text-embedding-3-large
LLM_MODEL=gpt-4o-mini
# Local Ollama embeddings (Active model switched in Admin)
OLLAMA_BASE_URL=http://192.168.10.10:11435
# Retrieval defaults
TOP_K=5
# Neighbor Expansion for fixed_size only (ADR-0023); 0 = off
NEIGHBOR_PREV=0
NEIGHBOR_NEXT=0
# LLM generation parameters
TEMPERATURE=0.0
MAX_TOKENS=1024
# Chunking defaults
CHUNK_SIZE=512
CHUNK_OVERLAP=50
# Semantic chunking parameters
SEMANTIC_THRESHOLD=0.3
SEMANTIC_MIN_CHUNK_SIZE=3
# SQLite database path
DATABASE_URL=sqlite:///./data/chunking_benchmark.db
# Text PDF gate (reject scanned/image PDFs)
PDF_MIN_TOTAL_CHARS=100
PDF_MIN_MEDIAN_CHARS_PER_PAGE=40