huggingface_int4_embedl-mtp_tensorrt-edgellm
- huggingface
- AGX Thor
- Labels
- Image
- Text
- VLM
- Generation
- Build
- Embedl-optimized
- Precision
- W4A16
- Runtime
- TensorRT Edge-LLM 0.10.1 with Embedl optimizations
- Context length
- 4,096 tokens
Google's mixture-of-experts Gemma 4: 26B parameters, about 4B active per token, with images.