FlashAttention

10-20-2026

Use this note for IO-aware exact attention, online softmax, tiling, numerical stability, backward computation, and the evolution across FlashAttention versions.