int8 (INT8) · embedl_tensorrt
- timm
- INT8
- L4
- Labels
- Image
- Classification
- Build
- Embedl-optimized
- Precision
- INT8
- Runtime
- TensorRT 11.2.1 with Embedl optimizations
resmlp_12_224.fb_dino is an image classifier from timm.
Methodology
- Latency: trtexec on the NVIDIA L4 with TensorRT 11.2.1: batch 1, median and p99 over the timed iterations.
- Accuracy: the ImageNet validation set, 50,000 images, on the NVIDIA L4.
- Build: Embedl Deploy INT8 quantization, calibrated on ImageNetCalibDataset (5,000 samples), compiled with TensorRT 11.2.1 on the NVIDIA L4.