TensorRT, ONNX, graph optimizations and quantization
Explain at a high level how TensorRT or similar inference optimizers speed up neural networks, and why INT8 quantization usually needs calibration.
Answer as you would in an interview
Answer aloud or write down a few key points. The text field is optional; the review opens after your attempt.