Skip to content
Search models or paste a model link. Press Enter to search.

Nemotron 3 Nano 4B

nvidia/NVIDIA-Nemotron-3-Nano-4B-BF16
huggingface_fp16_tensorrt-edgellm
nvidia/NVIDIA-Nemotron-3-Nano-4B-BF16 architecture graph

Select hardware to start

Its measured speed and accuracy, its files and how to run it are per device.

nvidia/NVIDIA-Nemotron-3-Nano-4B-BF16 architecture graph
  • huggingface
  • AGX Thor
Labels
  • Text
  • LLM
  • Generation
Build
Embedl-optimized
Precision
W4A16
Runtime
TensorRT Edge-LLM 0.10.1 with Embedl optimizations
Context length
4,096 tokens

NVIDIA's 4B Nemotron 3 Nano model for chat and agents on edge devices, with optional step-by-step thinking.

Files

Image Size

Model

docker.io/embedl/model-artifacts:nemotron3-nano-4b.huggingface_int4_embedl_tensorrt-edgellm.94b4147be37a3f61

5.74 GiB

Runtime

docker.io/embedl/models:runtimes.tensorrt-edgellm.arm64.2026101815014ee0

0.91 GiB