RecursiveSI/flint

huggingface_int4_embedl_tensorrt-edgellm

Labels

Build

Embedl-optimized

Precision

W4A16

Runtime

TensorRT Edge-LLM 0.10.1 with Embedl optimizations

Context length

8,192 tokens

Recursive's Flint: a 40B mixture-of-experts coding model, about 2.5B parameters active per token, with reasoning and tool use.

Files

Image	Size
Model docker.io/embedl/models:hf.recursivesi.flint.int4-embedl.h200.2026102516157496	20.04 GiB
Runtime docker.io/embedl/models:runtimes.tensorrt-edgellm.amd64.2026102514063a64	—