Mapika/decider-2b on an RTX 5070 Ti

A Jev-style 2B decider tested on a consumer RTX 5070 Ti under Windows 11.

Notes

After optimisation: 10.50 ms average, 95 decisions per second, 3.53 GiB VRAM on short two-question prompts ×100.

author demo — Result shown by its author. About this label

Destinations

Filed under

• #replica
• #huggingface
• #local
• #benchmark

In collections

• Benchmarks & independent tests →