Benchmarks

👋 Sign in for the ability to sort posts by relevant, latest, or top.

lnc

Oct 14

Stop Blaming Serialization for Slow Python UDFs

#spark #pyspark #arrow #benchmarks

8 min read

Max Quimby

Oct 14

Meta's Muse Wonder Scores Big and Delivers Little

#ai #meta #llm #benchmarks

9 min read

Daniel Sam Pete Thiyagu

Oct 11

Passed Once, Failed 19 Times: The Reliability Gap Microsoft's ThinkingBox Found in Every Agent

#ai #agents #machinelearning #benchmarks

6 min read

Amit

Oct 10

Opus 5.5 Leads a Four-Model OWASP Java Test by 7 to 9 Points. Kimi K3, GLM 5.3, and GPT-6 Sol Tie.

#benchmarks #modeleconomics #security #bedrock

9 min read

QuantID

Oct 9

Reading the S1MB result: why Borda aggregation makes a #1 harder to fake

#ai #machinelearning #benchmarks #datascience

2 min read

Peremptory

Oct 9

OpenAI's 722 Math Proofs All Came From One Prompt

#openai #modelrelease #research #benchmarks

2 min read

Oct 8

The benchmark score is the number to trust least

#ai #benchmarks #llmops

2 min read

Efrain Garay

Oct 7

Strands Decider 2B vs LLM as a judge: a keyword regex tied the 2B

#llm #machinelearning #benchmarks #python

1 min read

Travis Frisinger

Oct 8

The Visible Test Suite Is the Ceiling on What the Next Agent Can Deliver

#aiagents #testdiscipline #verification #benchmarks

8 min read

Reid Marlow

Oct 12

Synthetic GUI Benchmarks Fail When the App Doesn't Actually Run

#ai #agents #benchmarks #devtools

2 min read

Efrain Garay

Oct 10

Qwen-Image 2.1 on 16 GB of VRAM, quantized to NF4: a real benchmark against FLUX

#stablediffusion #machinelearning #benchmarks #python

2 min read

Nobody

Sep 25

Why your SQLite WAL file never shrinks

#sqlite #database #internals #benchmarks

12 min read

Daniel Sam Pete Thiyagu

Oct 7

The Model Wasn't Stupid. It Was Blind: How a Four-Sentence Prompt Took Claude to a Perfect 100 on ARC-AGI-3

#ai #agents #machinelearning #benchmarks

6 min read

Efrain Garay

Sep 28

Wild beats mold linking Rust 20 times out of 20, and in release the linker is no longer the bottleneck

#rust #linkers #benchmarks #performance

1 min read

Efrain Garay

Sep 28

Rust Coreutils 0.12 vs GNU 9.12: almost everything works the same, starting a process costs nearly 3x more

#rust #linux #benchmarks #performance

1 min read

👋 Sign in for the ability to sort posts by relevant, latest, or top.