RLHF/DPO for product alignment VLM
When is RLHF or DPO needed for a multimodal model, and how to collect preference data for such training?
Answer as you would in an interview
Answer aloud or write down a few key points. The text field is optional; the review opens after your attempt.