What is Benchmark?
A standardized test to measure and compare the performance of different AI models.
// Explanation
Like university rankings, benchmarks are tests that let you compare models objectively (or at least try to). MMLU, HumanEval, SWE-bench, and GPQA are some of the most popular. Each company showcases their models with their best scores, which sometimes makes apples-to-apples comparisons tricky.
// Example
When OpenAI says GPT-5 beats Claude on MMLU, they're using a benchmark. It's like comparing students with the same exam — useful, but it doesn't tell the whole story.