ModelOpt (INT8) · TensorRT
- torchvision
- INT8
- L4
- Labels
- Image
- Classification
- Build
- Embedl-optimized
- Precision
- INT8
- Runtime
- TensorRT 11.2.1 with Embedl optimizations
resnet152 is an image classifier from torchvision. It labels an image with one of the 1,000 ImageNet classes.
Methodology
- Latency: trtexec on the NVIDIA L4 with TensorRT 11.2.1: batch 1, median and p99 over the timed iterations.
- Accuracy: the ImageNet validation set, 50,000 images, on the NVIDIA L4.
- Build: ModelOpt INT8 quantization, calibrated on ImageNetCalibDataset (512 samples), compiled with TensorRT 11.2.1 on the NVIDIA L4.