DEV Community

#evaluation

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
An 8-Point nDCG Bump That Costs Two Minutes Is Not Free

An 8-Point nDCG Bump That Costs Two Minutes Is Not Free

Comments
4 min read
What gives an accidental paste away

What gives an accidental paste away

Comments
7 min read
Can You Tell an Eval from a Review?

Can You Tell an Eval from a Review?

Comments 1
21 min read
LLM Evaluation Explained: How a Benchmark Produces Comparable Numbers

LLM Evaluation Explained: How a Benchmark Produces Comparable Numbers

Comments
3 min read
How LLM Evaluation Actually Works: Inside a Benchmark That Produces Comparable Numbers

How LLM Evaluation Actually Works: Inside a Benchmark That Produces Comparable Numbers

Comments
4 min read
AI Agent Evaluation: Grade the Database, Not the Reply

AI Agent Evaluation: Grade the Database, Not the Reply

Comments
6 min read
FrontierAgent Runs Its Terminal Agent on the Same Engine as Its Benchmarks

FrontierAgent Runs Its Terminal Agent on the Same Engine as Its Benchmarks

Comments
4 min read
LLM Evaluation: How a Benchmark Turns Raw Answers Into Comparable Numbers

LLM Evaluation: How a Benchmark Turns Raw Answers Into Comparable Numbers

Comments
4 min read
LLM-as-Judge Is Not a Score. It Is a Reasoning Contract.

LLM-as-Judge Is Not a Score. It Is a Reasoning Contract.

Comments
5 min read
Sorry, That Was For Another Chat

Sorry, That Was For Another Chat

Comments
8 min read
Jev vs Local Models: Where Japanese Intent Routing Stands After 1,000 Utterances

Jev vs Local Models: Where Japanese Intent Routing Stands After 1,000 Utterances

Comments
12 min read
Assessing the Security of a Nondeterministic Encryption Method: Identifying Weaknesses and Improvements

Assessing the Security of a Nondeterministic Encryption Method: Identifying Weaknesses and Improvements

Comments
12 min read
I rejected a model that passed everyone else's benchmark

I rejected a model that passed everyone else's benchmark

Comments 1
5 min read
Election Forecasting Benchmarks: How LFORLA Scores Political Bias in LLMs

Election Forecasting Benchmarks: How LFORLA Scores Political Bias in LLMs

1
Comments
4 min read
Your Agent Has Observability. It Doesn't Have Evals.

Your Agent Has Observability. It Doesn't Have Evals.

Comments
10 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.