How Popular AI Benchmarks Are Built
Nine case studies: how tasks are created and scored, why researchers use them, and what could improve.
29 min read
A PERSONAL BLOG
Notes along
the way.
Notes, ideas, and things I’m learning along the way.
Get Connected.
Undergraduate & Graduate Students: Happy to chat about research, careers, or life in AI/ML, and explore collaborations.
Fellow Researchers: Happy to exchange ideas and collaborate.
Industry & Startups: Happy to discuss research questions and explore collaborations.
The latest.
03 ENTRIESThe AI says “done.” How do we check?
Verifiable and unverifiable benchmarks, explained through acceptance checks, fallible graders, and the gap between a highlight reel and reliable work.
7 min read
Turning a thought into an article
From scattered notes to clearer expression, with a little room to think.
3 min read
No matching posts. Try another word.