Back to questions
QuestionMediumML System DesignTechnical interview · Sber / GigaChat

RoPE and positional representations in GPT

What ways do Transformer order tokens exist and how does RoPE work?

Answer as you would in an interview

Answer aloud or write down a few key points. The text field is optional; the review opens after your attempt.

Loading
RoPE and positional representations in GPT — interview question — ML Mentor