Skip to content
Log in

meta-llama/Llama-3.1-8B-Instruct

huggingface_fp16_tensorrt-edgellm
meta-llama/Llama-3.1-8B-Instruct architecture graph
meta-llama/Llama-3.1-8B-Instruct architecture graph
  • huggingface
  • AGX Thor
Labels
  • Text
  • LLM
  • Generation
Build
Embedl-optimized
Precision
W4A16
Runtime
TensorRT Edge-LLM 0.10.1 with Embedl optimizations
Context length
4,096 tokens

Meta's 8B Llama 3.1 instruction model for chat and tool use.

Files

Image Size

Model

docker.io/embedl/model-artifacts:llama3-1-8b.huggingface_int4_embedl-eagle3_tensorrt-edgellm.27390dccd2376a2b

 5.77 GiB

Runtime

docker.io/embedl/models:runtimes.tensorrt-edgellm.arm64.2026101815014ee0

 1.01 GiB