About

This all started with a word salad on LinkedIn the week before…

EVALS.

You’re seeing them more and more as LinkedIn’s algorithm feeds your interest in AI.

You probably know “Eval” comes from “Evaluate”. You know evals are important, but… are they important for you? where do you start?

If your job is tied in any way to improving the answer or task completion quality of users interacting with your models, The art of writing good Evals starts with knowing what they are. Like all good guidelines, these flex to the situation, but Evals are generally :

• Yes/No Questions
• Concise and Precise (and generally pronoun-free) with no supersets.
  • You wouldn’t need both “Is an animal” and “is a mammal” to describe a cat. All mammals are animals, so “is an animal” is unnecessary.
• Atomic (“One Thought per Line”)
• When combined, they uniquely describe your object
  • (in the real world, they’d be uniquely combining your project success criteria, but for the purposes of this game, we’re doing evals on objects).

But I didn’t need inspirational words.
I needed to git gud.
And I wanted my teammates to git gud.
So I fired up Lovable and here we are.