BatchNorm train/inference behavior and multi-GPU statistics
Explain BatchNorm for image tensors, what changes at inference, and what must be synchronized in multi-GPU training.
Answer as you would in an interview
Answer aloud or write down a few key points. The text field is optional; the review opens after your attempt.