Skip to content
Search models or paste a model link. Press Enter to search.

Qwen3 0.6B

Qwen/Qwen3-0.6B
Left and right arrow keys switch the vendor.
huggingface_fp16_tensorrt-edgellm
Qwen/Qwen3-0.6B architecture graph
Qwen/Qwen3-0.6B architecture graph
  • huggingface
  • AGX Thor
Labels
  • Text
  • LLM
  • Generation
Build
Embedl-optimized · FlashHead
Precision
W4A16
Runtime
TensorRT Edge-LLM 0.10.1 with Embedl optimizations
Context length
4,096 tokens

Alibaba's 0.6B Qwen3 model for chat, math and code, with optional step-by-step thinking.

Files

Image Size

Model

docker.io/embedl/model-artifacts:qwen3-0-6b.huggingface_int4_embedl-flashhead_tensorrt-edgellm.84cdc3713a399393

0.85 GiB

Runtime

docker.io/embedl/models:runtimes.tensorrt-edgellm.arm64.2026101815014ee0

0.91 GiB

Select hardware to start

Its measured speed and accuracy, its files and how to run it are per device.

Model variants (Pareto)

4 Embedl builds of Qwen3 0.6B on 4 devices: throughput against Average of 3. Click a build to open it.

  • Best trade-offs
45.546.046.547.047.548.0Average of 3 (%)50100150200250300Throughput (tok/s)Better ↗