How Popular AI Benchmarks Are Built
Nine case studies: how tasks are created and scored, why researchers use them, and what could improve.
29 min read
A PERSONAL BLOG
Notes along
the way.
Notes, ideas, and things I’m learning along the way.
The latest.
03 ENTRIESThe AI says “done.” How do we check?
Verifiable and unverifiable benchmarks, explained through acceptance checks, fallible graders, and the gap between a highlight reel and reliable work.
7 min read
Turning a thought into an article
From scattered notes to clearer expression, with a little room to think.
3 min read
No matching posts. Try another word.