PyTorch 2.13 brings FlexAttention to Apple Silicon: a 12x sparse-attention speedup
PyTorch 2.13 landed FlexAttention on the Mac's Metal backend, with a documented ~12x speedup over SDPA on sparse masks. Here is what the numbers mean, how to write a mask in two lines, and where MLX still wins.
