MMLU-Pro

What it tests: A harder re-build of the classic MMLU: 12K questions, 10 answer choices instead of 4, more reasoning-heavy, 14 domains. The original MMLU is saturated (>93%) and retired from our scoring.

考什么:经典 MMLU 的加难重制版:1.2 万题、10 个选项(原来 4 个)、更重推理、14 个学科。原版 MMLU 已饱和(>93%),我们不再计入评分。

Why it counts: Still the standard 'general knowledge' yardstick — but top models cluster within a few points, so we watch its saturation closely.

为什么算数:仍是'通用知识'的标准尺子,但头部模型分差已很小——我们已把它列入饱和观察名单,随时准备降权。