Skip to content
Kudos AI

Attention, Step by Step

Queries, keys and values on a worked three-token example: score, scale, normalise, blend - with every number computed by hand.

AdvancedModule 245 min · 180 XP
Three tokens scored against each other, the matrix scaled and softmaxed row by row, then the values blended in proportion to relevance.

This is a premium lesson

Sign in and enrol to read the full lesson, run the code, take the quiz, and earn XP toward the path badge.