replica source-backed
system-one: batched single-token choice inference
Constrains token selection to choice indices so any open LLM answers many questions in one pass; includes Doom and Wikipedia-racing demos on Qwen models.
Notes
172 ms versus 600 ms median action latency compared with tool calling on Qwen3-8B.
source-backed — Public repository, docs or live artifact. About this label
Destinations
Verification levels
- HTTP availability
- Link reachable ·
Method: bounded HTTP request with redirects. HTTP 200 · HTTP response only. Checked destination ↗ · Last reachable - Browser demo scenario
- Not checked
- Build
- Not checked
- Live API test
- Not checked