AGENTS.md — docs/papers

AGENTS.md — docs/papers

Every paper here gets two files: the source .pdf (kept for humans to read) and a
generated .md (kept so agents can grep/read it without OCR/PDF-parsing detours).

Adding a paper

1. Save the PDF as <slug>.pdf in this directory.

2. Generate the markdown via the arxiv2md API
   (no auth, 30 req/min):

   curl -s "https://arxiv2md.org/api/markdown?url=<arxiv-id>&remove_refs=false&remove_toc=false&remove_citations=false" \
     -o <slug>.md
   

   <arxiv-id> is the numeric arXiv ID (e.g. 2605.17991), with or without version suffix.

3. Add an entry to README.md linking the PDF (human-facing).

Why arxiv2md, not a local PDF converter

arxiv2md parses arXiv’s structured HTML (not the PDF), so output has real ##
headings, a TOC, proper | tables, and LaTeX math ($L_{\max}$) instead of
mangled Unicode. Tried and rejected for this repo:

• markitdown on the PDF directly — reversed/garbled watermark text, broken
  tables, unreadable in places.
• markitdown on the arXiv HTML page — better than the PDF route, but bloats
  every inline citation with the full paper title as hover text
  ([26](#bib.bib7 "Denoising diffusion probabilistic models") repeated
  hundreds of times), and mangles inline math (4096×\times).
• markxiv.org — despite serving Content-Type: text/markdown, output has zero
  markdown syntax: no headings, no tables, no links, just page-numbered PDF text.

Only use PDF-parsing as a fallback for papers with no arXiv HTML rendering
(very old papers, non-arXiv sources).

Keep remove_refs=false&remove_toc=false&remove_citations=false — we want the
full reference list and TOC preserved for agent lookups; the API’s defaults strip
all three.