TriAttention — paper reading-group companion

Companion materials for Centers, Not Scores: KV Compression from the Pre-RoPE Geometry of Attention (arXiv:2604.04921). Pick an entry point below.

Read the companion

Companion — Unicode-math view HTML

The full write-up rendered in the browser (Markdown + Mermaid + inline SVG). Math is shown with Unicode symbols. Renders fine even when opened directly from disk.

Companion — LaTeX-math view HTML

Same write-up, with the equations typeset by KaTeX from a LaTeX source. Best for the derivations in §8.1 / §8.9 / §8.10.

Interactive demos HTML

Eight self-contained visual explainers (concentration & R, the RoPE spectrum, the distance curve, scoring/eviction, attention-vs-importance, phase φ, eviction mechanics, and the KV-vs-weights crossover).

Source files

Companion source — Unicode math .md

triattention_paper_presentation.md — the Markdown the Unicode view renders.

Companion source — LaTeX math .md

triattention_paper_presentation_latex.md — the LaTeX-math branch the LaTeX view renders.

Serving statically (e.g. nginx): drop all six files in one directory and point a location at it. When served over http(s) each viewer auto-loads its sibling .md live (so edits show on refresh); opened straight from disk, each viewer falls back to an embedded snapshot. The two .md links above open as raw text in most setups — add default_type text/plain; or a .md type mapping if you want them to display inline rather than download.