benchmark source-backed
llm-rankers: checking Jev's calibration with TREC judgments
The ielab document-ranking toolkit gained a jev module, with code that uses TREC human relevance judgments to test whether Jev's probabilities are actually calibrated.
Notes
Code for the calibration check; results in the repository.
source-backed — Public repository, docs or live artifact. About this label
Destinations
Verification levels
- HTTP availability
- Link reachable ·
Method: bounded HTTP request with redirects. HTTP 200 · HTTP response only. Checked destination ↗ · Last reachable - Browser demo scenario
- Not checked
- Build
- Not checked
- Live API test
- Not checked