RF-DETR Base

roboflow/rf-detr

Labels

Build

Baseline TensorRT

Precision

FP16

Runtime

TensorRT 10.16.2.10

Input size

560×560

Output

Bounding boxes, class labels and confidence scores

RF-DETR Base is a real-time object detector: for each object in an image it returns a bounding box, a class label and a confidence score.

Methodology

Latency: median GPU time per image, batch 1, timed with CUDA events around each run.
Accuracy: COCO box mAP (IoU 0.50 to 0.95), with mAP@50 and mAP@75, on 5,000 val2017 images, each through the served model's own pre- and post-processing.
Memory: peak memory while running the model.

Image	Size
Model docker.io/embedl/model-artifacts:rf-detr-base.fp16.thor.1baef8b9a091d314	54.8 MiB
Runtime docker.io/embedl/models:runtimes.tensorrt.arm64.2026110212523521	703 MiB

Every build of RF-DETR Base on AGX Thor.

Variant	Precision	Speed	Peak memory	Runtime
Embedl-optimized · TensorRT huggingface_int8_embedl_tensorrt	INT8	2.082 ms Latency: Median GPU time	547 MiB	TensorRT 10.16.2.10 with Embedl optimizations runtimes.tensorrt.arm64.2026110212523521
Baseline TensorRT This page rfdetr_fp16_tensorrt	FP16	2.295 ms Latency: Median GPU time	545 MiB	TensorRT 10.16.2.10 runtimes.tensorrt.arm64.2026110212523521