huggingface_fp16_tensorrt-edgellm
- huggingface
- AGX Thor
- Labels
- Image
- Text
- VLM
- Generation
- Build
- Embedl-optimized
- Precision
- W4A16
- Runtime
- TensorRT Edge-LLM 0.10.1 with Embedl optimizations
- Context length
- 4,096 tokens
The smallest Gemma 4 model, with about 2B effective parameters, for on-device use, with images.