openjev-sglang

A server that implements the TypeSafe/Jev HTTP API on Qwen3.6-35B-A3B with SGLang: prefill-only, one extra token per question, radix caching, deployable on Modal.

Notes

Independent implementation of the interface; limits: 64 concurrent questions, 64 answers per question.

source-backed — Public repository, docs or live artifact. About this label

Destinations

Filed under

• #replica
• #sglang
• #serving
• #github

In collections

• Local & replica models →