Latest articles
Chapters, research notes, and essays. New ideas and recent revisions, collected in one place.
A knowledge base should be a place to think
On writing explanations that can grow, connect, and change as understanding improves.
EssayEvaluating bounded agents
A small worked example separating task success, step budgets, and execution cost.
Research noteLinear algebra for language models
Vectors, matrix shapes, inner products, and the transformations behind attention.
ChapterThe attention mechanism
How queries, keys, and values turn a sequence into context-aware representations.
Chapter