Embedl Deploy · TensorRT
- torchvision/resnet18
- INT8
- RTX 2080 Ti
- Labels
- Image
- Classification
- Build
- Embedl-optimized
- Precision
- INT8
- Runtime
- TensorRT 11.3.0.99 with Embedl optimizations
- Input size
- 224×224
ResNet-18 is an image classifier from torchvision. It labels an image with one of the 1,000 ImageNet classes.
Methodology
- Latency: on the NVIDIA GeForce RTX 2080 Ti: gPU time of one engine execution, batch 1 (copies excluded), 113476 runs.
- Accuracy: ImageNette validation (ImageNet labels), 3925 images, on the NVIDIA GeForce RTX 2080 Ti.
- Size: the serialized TensorRT engine.
- Build: Embedl Deploy INT8 (int8 symmetric activations; int8 symmetric per-channel weights), calibrated on 32 ImageNette train images, from torchvision ResNet18_Weights.IMAGENET1K_V1.