Skip to content
Log in

Qwen/Qwen3-4B

huggingface_int4_modelopt_tensorrt-edgellm
Qwen/Qwen3-4B architecture graph
Qwen/Qwen3-4B architecture graph
  • huggingface
  • AGX Thor
Labels
  • Text
  • LLM
  • Generation
Build
Embedl-optimized
Precision
W4A16
Runtime
TensorRT Edge-LLM 0.10.1 with Embedl optimizations
Context length
4,096 tokens

Alibaba's 4B Qwen3 model for chat, math and code, with optional step-by-step thinking.

Files

Image Size

Model

docker.io/embedl/model-artifacts:qwen3-4b.huggingface_int4_modelopt_tensorrt-edgellm.1c7046f5af7cfd61

 3.24 GiB

Runtime

docker.io/embedl/models:runtimes.tensorrt-edgellm.arm64.2026101815014ee0

 1.01 GiB