Tag

#memory-bound

1 article tagged memory-bound.

The arithmetic of attention: why FlashAttention still matters

Inference & Serving

Memory bandwidth, not FLOPs, is what bounds modern inference. A walk through the numbers behind a kernel that quietly reshaped the field.

Liam Chen Nov 12, 2026