Devin BostTechnology advisoryLet’s talk

Insights

How to Judge an AI Judge

LLM judges made automated AI evaluation practical, and introduced new ways to fool yourself. Here’s how I design judge panels, and what I’d ask before trusting one.

Read the article