#benchmarks

• 18 Mar 2026 · Study

  LLMs · Evaluation

  How LLMs are evaluated: perplexity, multiple-choice benchmarks scored by log-likelihood, exact match, LLM-as-a-judge, and the contamination problem, with a tiny log-likelihood multiple-choice eval on GPT-2.