Skip to content

torchvision/wide_resnet50_2

Embedl-optimized
Wide ResNet-50-2 architecture graph
Wide ResNet-50-2 architecture graph
  • torchvision/wide_resnet50_2
  • INT8
  • L4
Labels
  • Image
  • Classification
Build
Embedl-optimized
Precision
INT8
Runtime
TensorRT with Embedl optimizations
Run Wide ResNet-50-2 on L4

Wide ResNet-50-2 is an image classifier from torchvision. It labels an image with one of the 1,000 ImageNet classes.

Methodology

  • Latency: on the NVIDIA L4, batch 1, median GPU compute time (no copies to and from the GPU), from the build's own benchmark.
  • Accuracy: the ImageNet-1k validation split, 50,000 images, from the build's own validation on the NVIDIA L4.
  • Baseline TensorRT: the original model in FP16 on upstream TensorRT, same settings, same device. Not measured yet.
  • Build: Embedl Deploy quantization (INT8 weights per channel and activations), calibrated with ImageNetCalibDataset, 5000 batches of 1, exported to ONNX and compiled with Embedl's TensorRT transforms.