Flash Attention Explained
A practical walkthrough of how Flash Attention reduces memory traffic and speeds up transformer training.
Writing
All posts →
GPU Kernels — First Notes
Notes from learning CUDA memory hierarchy, occupancy, and writing my first custom kernels.
