Model compression and catastrophic forgetting
What techniques can compress or adapt a large model, and how would you detect and reduce catastrophic forgetting during fine-tuning?
Answer as you would in an interview
Answer aloud or write down a few key points. The text field is optional; the review opens after your attempt.