Transformer basics: tokens, positional encoding and cross-attention
Explain what a Transformer consists of, how tokens and positional information enter the model, and where query/key/value vectors come from in decoder cross-attention.
Answer as you would in an interview
Answer aloud or write down a few key points. The text field is optional; the review opens after your attempt.