Nemotron 3 Nano 4B
nvidia/NVIDIA-Nemotron-3-Nano-4B-BF16 Left and right arrow keys switch the vendor.
huggingface_fp16_tensorrt-edgellm
- huggingface
- AGX Thor
- Labels
- Text
- LLM
- Generation
- Build
- Embedl-optimized
- Precision
- W4A16
- Runtime
- TensorRT Edge-LLM 0.10.1 with Embedl optimizations
- Context length
- 4,096 tokens
NVIDIA's 4B Nemotron 3 Nano model for chat and agents on edge devices, with optional step-by-step thinking.
Files
Model variants (Pareto)
2 Embedl builds of Nemotron 3 Nano 4B on 2 devices: throughput against Average of 3. Click a build to open it.