Skip to content
Navigation menu
Search
Powered by Algolia
Search
Log in
Create account
DEV Community
Close
#
evaluation
Follow
Hide
Posts
Left menu
đź‘‹
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
Right menu
An 8-Point nDCG Bump That Costs Two Minutes Is Not Free
Igor Eduardo
Igor Eduardo
Igor Eduardo
Follow
Oct 12
An 8-Point nDCG Bump That Costs Two Minutes Is Not Free
#
ai
#
agents
#
evaluation
#
retrieval
Comments
Add Comment
4 min read
What gives an accidental paste away
JaviMaligno
JaviMaligno
JaviMaligno
Follow
Oct 12
What gives an accidental paste away
#
ai
#
agents
#
evaluation
#
claude
Comments
Add Comment
7 min read
Can You Tell an Eval from a Review?
Tatsuya Shimomoto
Tatsuya Shimomoto
Tatsuya Shimomoto
Follow
Oct 12
Can You Tell an Eval from a Review?
#
claudecode
#
evaluation
#
evals
#
llmops
Comments
1
 comment
21 min read
LLM Evaluation Explained: How a Benchmark Produces Comparable Numbers
RESK
RESK
RESK
Follow
Oct 12
LLM Evaluation Explained: How a Benchmark Produces Comparable Numbers
#
llm
#
evaluation
#
benchmark
#
ai
Comments
Add Comment
3 min read
How LLM Evaluation Actually Works: Inside a Benchmark That Produces Comparable Numbers
RESK
RESK
RESK
Follow
Oct 10
How LLM Evaluation Actually Works: Inside a Benchmark That Produces Comparable Numbers
#
llm
#
evaluation
#
benchmark
#
ai
Comments
Add Comment
4 min read
AI Agent Evaluation: Grade the Database, Not the Reply
Qasim Parray
Qasim Parray
Qasim Parray
Follow
Oct 8
AI Agent Evaluation: Grade the Database, Not the Reply
#
aiagents
#
evaluation
#
postgres
#
testing
Comments
Add Comment
6 min read
FrontierAgent Runs Its Terminal Agent on the Same Engine as Its Benchmarks
Reno Lu
Reno Lu
Reno Lu
Follow
Oct 7
FrontierAgent Runs Its Terminal Agent on the Same Engine as Its Benchmarks
#
aiagents
#
multiagent
#
python
#
evaluation
Comments
Add Comment
4 min read
LLM Evaluation: How a Benchmark Turns Raw Answers Into Comparable Numbers
RESK
RESK
RESK
Follow
Oct 7
LLM Evaluation: How a Benchmark Turns Raw Answers Into Comparable Numbers
#
llm
#
evaluation
#
benchmark
#
ai
Comments
Add Comment
4 min read
LLM-as-Judge Is Not a Score. It Is a Reasoning Contract.
Harrison Guo
Harrison Guo
Harrison Guo
Follow
Oct 6
LLM-as-Judge Is Not a Score. It Is a Reasoning Contract.
#
llm
#
ai
#
evaluation
#
calibration
Comments
Add Comment
5 min read
Sorry, That Was For Another Chat
JaviMaligno
JaviMaligno
JaviMaligno
Follow
Oct 6
Sorry, That Was For Another Chat
#
ai
#
agents
#
evaluation
#
claude
Comments
Add Comment
8 min read
Jev vs Local Models: Where Japanese Intent Routing Stands After 1,000 Utterances
orca forge
orca forge
orca forge
Follow
Oct 2
Jev vs Local Models: Where Japanese Intent Routing Stands After 1,000 Utterances
#
llm
#
ai
#
evaluation
#
japanese
Comments
Add Comment
12 min read
Assessing the Security of a Nondeterministic Encryption Method: Identifying Weaknesses and Improvements
Artyom Kornilov
Artyom Kornilov
Artyom Kornilov
Follow
Oct 1
Assessing the Security of a Nondeterministic Encryption Method: Identifying Weaknesses and Improvements
#
encryption
#
security
#
cryptography
#
evaluation
Comments
Add Comment
12 min read
I rejected a model that passed everyone else's benchmark
Priyansh Kansara
Priyansh Kansara
Priyansh Kansara
Follow
Oct 3
I rejected a model that passed everyone else's benchmark
#
machinelearning
#
deepfake
#
evaluation
#
python
Comments
1
 comment
5 min read
Election Forecasting Benchmarks: How LFORLA Scores Political Bias in LLMs
RESK
RESK
RESK
Follow
Sep 30
Election Forecasting Benchmarks: How LFORLA Scores Political Bias in LLMs
#
llm
#
benchmark
#
politics
#
evaluation
1
 reaction
Comments
Add Comment
4 min read
Your Agent Has Observability. It Doesn't Have Evals.
Jason Lau
Jason Lau
Jason Lau
Follow
Sep 24
Your Agent Has Observability. It Doesn't Have Evals.
#
agents
#
observability
#
evaluation
#
llm
Comments
Add Comment
10 min read
đź‘‹
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
We're a place where coders share, stay up-to-date and grow their careers.
Log in
Create account