Skip to content

torchvision/deeplabv3_resnet101

ModelOpt (INT8) · TensorRT
deeplabv3_resnet101 architecture graph
deeplabv3_resnet101 architecture graph
  • torchvision
  • INT8
  • L4
Labels
  • Image
  • Segmentation
Build
Embedl-optimized
Precision
INT8
Runtime
TensorRT 11.2.1 with Embedl optimizations
Run deeplabv3_resnet101 on L4

deeplabv3_resnet101 is a semantic segmentation model from torchvision: it assigns a class to every pixel of an image.

Methodology

  • Latency: trtexec on the NVIDIA L4 with TensorRT 11.2.1: batch 1, median and p99 over the timed iterations.
  • Accuracy: the COCO segmentation validation set, 2,000 images, on the NVIDIA L4.
  • Build: ModelOpt INT8 quantization, calibrated on CocoSegmentationCalibDataset (64 samples), compiled with TensorRT 11.2.1 on the NVIDIA L4.