Why attention reads with weights
Distill author teams
Soft attention replaces a discrete memory lookup with a differentiable weighted read.
Original source and credit ↗Opening the explanation…
The original experience and its breakdown will appear here.