mba/chunking_strategies_evaluation

Go to file

Mahdi Bazrafshan ef8bab5962 feat(benchmarking): add evaluation, benchmark service, and report

Why:
- Need LLM-as-Judge evaluation for automated scoring
- Need benchmark orchestration to run questions × strategies
- Need HTML report generation with two views (managerial/technical)

Changes:
- evaluation.py: LLM-as-Judge scoring on 4 metrics (context, similarity, faithfulness, hallucination)
- benchmark_service.py: Orchestration with per-strategy failure isolation
- report.py: Dual-view HTML reports with dark mode, charts, and strategy cards

2026-07-27 14:14:40 +03:30

docs: add phases, tasks, and chunking strategies documentation

2026-07-26 09:38:08 +03:30

docs(data): add 21-question evaluation dataset for benchmarking

2026-07-26 13:48:36 +03:30

feat(benchmarking): add evaluation, benchmark service, and report

2026-07-27 14:14:40 +03:30

.env.example

build: add project configuration and environment template

2026-07-21 18:51:51 +03:30

.gitignore

Initial commit

2026-07-21 11:27:49 +03:30

CONTEXT.md

docs: add domain glossary and architectural decision records

2026-07-21 18:51:46 +03:30

LICENSE

Initial commit

2026-07-21 11:27:49 +03:30

pyproject.toml

build: add project configuration and environment template

2026-07-21 18:51:51 +03:30

README.md

Initial commit

2026-07-21 11:27:49 +03:30

README.md

chunking_strategies_evaluation

This repo is in order to reach multiple chunking strategies and evaulate them