Jevals: labelled benchmarks and per-decision logs

An independent evaluation site and data repository for Jev and LLMs answering the same typed questions. Public boards link accuracy, calibration, costs and latency to human-labelled tasks and individual decision logs.

Notes

Release 2026-09-18 contains eight systems across PubMedQA Noul, Banking77 Choice and HelpSteer2 Score tasks. Jev's reported Decision Scores are 69.0, 67.8 and 9.2; the repository documents formulas and publishes CC BY 4.0 logs.

source-backed — Public repository, docs or live artifact. About this label

Destinations

Filed under

• #benchmarks
• #calibration
• #datasets
• #evaluation

In collections

• Benchmarks & independent tests →