Embedl's build embedl/sam-3d-body of the original model facebook/sam-3d-body-dinov3
Baseline TensorRT
- huggingface
- FP16
- AGX Thor
- Labels
- Image
- Pose
- Build
- Baseline
- Precision
- FP16
- Runtime
- TensorRT 10.16.2.10
- People
- Up to 5 per photo
- Output
- A 3D body mesh per person
Example
Ran on NVIDIA Jetson AGX Thor (sm_110), TensorRT 10.16.2.10, during the build
COCO val2017 000000229553 (CC BY 2.0 (COCO val2017 licence 4))
--image
3D body
One photo in, a 3D body mesh for every person in it out: Meta's SAM 3D Body (DINOv3 ViT-H+/16 encoder), with a YOLOX-S person detector in front of it.
Derivative of facebook/sam-3d-body-dinov3 (SAM 3D Body License) and the DINOv3 weights (DINOv3 License); YOLOX-S is Megvii’s, Apache-2.0. NOTICE beside the files has the details.
Methodology
- Latency: on the NVIDIA Jetson AGX Thor, batch 1. Engines: GPU time of one execution between CUDA events, copies excluded. Photo to 3D body: wall time of serve.py's whole answer (detector, crops, engines with copies, packing), median of 10 after a warm-up.
- Accuracy: each photo through serve.py twice, on these engines and on FP32 in onnxruntime (CPU): the published decoder and detector graphs and Embedl's encoder graph with its Q/DQ stripped, unquantized; the reference's person boxes given to both. The mean distance of the 18,439 vertices per person, then over people; keypoints likewise. COCO val2017 photos (CC BY 2.0).
- Size: the detector, encoder and decoder TensorRT engines on disk.
- FP32 reference: Embedl’s encoder graph unquantized with the published decoder and detector graphs, in onnxruntime FP32 on the CPU.