huggingface_fp16_tensorrt-edgellm
- huggingface
- AGX Thor
- Labels
- Text
- LLM
- Generation
- Build
- Embedl-optimized
- Precision
- W4A16
- Runtime
- TensorRT Edge-LLM 0.10.1 with Embedl optimizations
- Context length
- 4,096 tokens
NVIDIA's 7B Cosmos-Reason1 vision-language model for physical-world reasoning in robotics and video analytics.