Block length in speculative generation
How to choose the number of pre-proposed tokens in speculative generation and why too long a block can slow down the system?
Answer as you would in an interview
Answer aloud or write down a few key points. The text field is optional; the review opens after your attempt.