docs: capture pdf domain language and deferred ingestion backlog
Co-authored-by: Cursor <cursoragent@cursor.com>
This commit is contained in:
20
backlog/pdfplumber-tables.md
Normal file
20
backlog/pdfplumber-tables.md
Normal file
@@ -0,0 +1,20 @@
|
||||
# pdfplumber for tables
|
||||
|
||||
## Why deferred
|
||||
|
||||
v1 uses PyMuPDF only. Dual extractors add complexity before we know tables are the failure mode.
|
||||
|
||||
## Trigger
|
||||
|
||||
Chunk Preview / Experiments show table cells concatenated in wrong order, or key cells missing, on table-heavy insurance PDFs — after Heading Reconstruction is otherwise fine.
|
||||
|
||||
## Approach to try
|
||||
|
||||
1. Keep PyMuPDF for body text + Heading Reconstruction
|
||||
2. Detect table regions (PyMuPDF or pdfplumber) and extract those via pdfplumber
|
||||
3. Flatten tables the same way DOCX does (sequential text blocks), not HTML tables in markdown (unless Strategies learn to use them)
|
||||
|
||||
## Success criteria
|
||||
|
||||
- Questions that answer from table cells improve without regressing prose headings
|
||||
- No second full-document parse path unless necessary
|
||||
Reference in New Issue
Block a user