Embedl's build autotrust/jev-9b of the original model autotrust/JEV-9B
huggingface_int8_embedl_tensorrt-edgellm
- huggingface
- W8A8
- AGX Thor
- Labels
- Text
- LLM
- Classification
- Build
- Embedl-optimized
- Precision
- W8A8
- Runtime
- TensorRT Edge-LLM 0.10.1 with Embedl optimizations
- Context length
- 2,048 tokens
A System One decision model: it answers a typed question about a text — one of up to 16 options, yes or no, or a score from 0 to 5 — with a calibrated probability for every answer, in one pass and without writing any text. JEV-9B is AutoTrust AI's open-weights model (Apache-2.0) in the style of TypeSafe AI's Jev; it is not affiliated with TypeSafe AI.
| Quantization | Embedl INT8 (SmoothQuant W8A8), the answer read out in the engine |