Attention

06-11-2026

Explain scaled dot-product attention, masking, tensor shapes, and the compute and memory costs of materializing attention scores.