Add PDF→markdown batch converter and research-library workflow

Browse Source

convert.py walks pdfs/ (recursing topic subfolders), mirrors a .md tree
into md/ via pymupdf4llm, idempotent on mtime. Detects no-text-layer PDFs
(needs-ocr.txt) and falls back to plain per-page text when pymupdf4llm's
layout pass returns near-empty despite a real text layer.

Pin pymupdf4llm==0.3.4 (lightweight line; 1.27.x bundles an ML/OCR
pipeline that fails on plain text PDFs). PDFs gitignored (copyrighted,
large) — only generated markdown is committed.

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>

...

This commit is contained in:

Phillip Tarrant

2026-06-26 15:24:22 -05:00

commit 057c96e10b

11 changed files with 83616 additions and 0 deletions

Show all changes Ignore whitespace when comparing lines Ignore changes in amount of whitespace Ignore changes in whitespace at EOL

Download Patch File Download Diff File Expand all files Collapse all files

11196

md/A Field Guide to Demons, Fairies, Fallen Angels and Other Subversive Spirits.md Normal file

File diff suppressed because it is too large Load Diff

12731

md/Dark Mirrors_ Azazel and Satanael in Early Jewish Demonology.md Normal file

File diff suppressed because it is too large Load Diff

8927

md/Personal or Impersonal_ An Analysis of Karl Barth and Merrill Ungers Perspectives on the Demonic.md Normal file

File diff suppressed because it is too large Load Diff

7014

md/Spiritism and the Fallen Angels in the Light of the Old and New Testaments.md Normal file

File diff suppressed because it is too large Load Diff

13112

md/The Demonology of King James I_ Includes the Original Text of Daemonologie and News from Scotland.md Normal file

File diff suppressed because it is too large Load Diff

30314

md/The Encyclopedia Of Demons And Demonology.md Normal file

File diff suppressed because it is too large Load Diff