Visible tradeoffsThis is a rubric-judged signal, so it is more structured than arena taste but still depends on the scoring rubric.
source
Scale Labs
metric
Score (%)
judge
Rubric
direction
higher better
group id
scale_multinrc_current
domain
Reasoning / math / science
What it measures vs what it misses
✓ Measures
Cross-lingual reasoning and answer quality on multilingual tasks.
✗ Misses
Search freshness. Image-grounded reasoning.
Why this countsIt is one of the cleaner reads on deliberate reasoning strength rather than style or popularity.Comparable-group ruleThis percentile only compares models inside the exact benchmark/version group shown here. It is not a universal score.What it missesIt still misses product usability, latency, and whether the model stays correct in messy real workflows.