Stability of Gradients in Deep Networks
Why do gradients disappear or explode and how do activations, initialization, normalization, residual bonds, and clipping help learning?
Answer as you would in an interview
Answer aloud or write down a few key points. The text field is optional; the review opens after your attempt.