Workbook

Compute self-attention by hand, then check it in code. Ten exercises with full solutions covering scores, asymmetry, scaling, softmax, weighted outputs, saturation, causal masking, and the quadratic cost of context.