3 Commits

Author SHA1 Message Date
04010d5ee2 Reframe README as the AI-assisted research center
Document the project as a git-backed research workspace: collect sources by
topic, convert to markdown, synthesize with Claude over whole files, commit
everything. Topics open-ended; demonology is the primary one today.

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-06-26 15:35:22 -05:00
6fa51d0d44 Group library into topic folders (pdfs/demonology, md/demonology)
Topic-per-subfolder layout so the same workflow scales to other subjects.
Converter already mirrors structure; rerun is a no-op (idempotent).

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-06-26 15:33:11 -05:00
057c96e10b Add PDF→markdown batch converter and research-library workflow
convert.py walks pdfs/ (recursing topic subfolders), mirrors a .md tree
into md/ via pymupdf4llm, idempotent on mtime. Detects no-text-layer PDFs
(needs-ocr.txt) and falls back to plain per-page text when pymupdf4llm's
layout pass returns near-empty despite a real text layer.

Pin pymupdf4llm==0.3.4 (lightweight line; 1.27.x bundles an ML/OCR
pipeline that fails on plain text PDFs). PDFs gitignored (copyrighted,
large) — only generated markdown is committed.

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-06-26 15:24:22 -05:00