replica source-backed
TypeAR: Jev-inspired type-safe decoding
An open-sourced decoding engine for autoregressive LLMs inspired by Jev: one output token per decision, no out-of-schema outputs, KV-cache reuse; demoed on SGLang with Qwen 27B.
Notes
Categorical decisions cost one output token; numbers use tokenizer-native constrained decoding; 5.8x relative throughput batched versus sequential on Qwen3.8-27B. Repository now under the TypeAR-AI org.
source-backed — Public repository, docs or live artifact. About this label
Destinations
Verification levels
- HTTP availability
- Link reachable ·
Method: bounded HTTP request with redirects. HTTP 200 · HTTP response only. Checked destination ↗ · Last reachable - Browser demo scenario
- Not checked
- Build
- Not checked
- Live API test
- Not checked