mba/chunking_strategies_evaluation

Go to file

Mahdi Bazrafshan 3f9677f6aa feat(jobs): add background job support for benchmarks and processing

Why:
- Long benchmark and process runs block HTTP clients; task #20 required async execution.

Changes:
- SQLite jobs table + GET /jobs and GET /jobs/{id}
- POST /benchmarks?background=true and POST /documents/{id}/process?background=true return 202 + job_id
- FastAPI BackgroundTasks execute work in-process; sync paths unchanged

Impact:
- Jobs are lost on server restart (Option A, no external queue)

Co-authored-by: Cursor <cursoragent@cursor.com>

2026-08-22 15:32:33 +03:30

docs: capture pdf domain language and deferred ingestion backlog

2026-08-02 16:59:42 +03:30

feat(jobs): add background job support for benchmarks and processing

2026-08-22 15:32:33 +03:30

docs(data): add 21-question evaluation dataset for benchmarking

2026-07-26 13:48:36 +03:30

chore(scripts): add neighbor expansion benchmark sweep

2026-08-10 14:13:07 +03:30

feat(jobs): add background job support for benchmarks and processing

2026-08-22 15:32:33 +03:30

.env.example

chore(config): sync env example and context for ±3 defaults

2026-08-22 15:32:29 +03:30

.gitignore

Initial commit

2026-07-21 11:27:49 +03:30

CONTEXT.md

chore(config): sync env example and context for ±3 defaults

2026-08-22 15:32:29 +03:30

LICENSE

Initial commit

2026-07-21 11:27:49 +03:30

pyproject.toml

build(deps): add pymupdf for text pdf extraction

2026-08-02 16:59:42 +03:30

README.md

Initial commit

2026-07-21 11:27:49 +03:30

README.md

chunking_strategies_evaluation

This repo is in order to reach multiple chunking strategies and evaulate them