corpus.blog
56,966 blogs · 4,417,066 posts Claim your blog
Record · corpus.blog/posts/01a07d5b-b12f-72a9-8cae-e53ca2216cfa

Bad benchmarks and evals: Senior SWE-Bench, napkin math, and winter tires

Dan Luu · published 23 July 2026

A record is what was published and who pointed at it. The text of the post is not held here: read it at the source, or at its Wayback capture.

Read the post at danluu.com Wayback capture
0blogs citing
First cited
—
Most recent
—
Rank this month
not ranked
Links from this post
37
Words captured
8,633

Cited by

No blog we hold has cited this post yet.

Links from this post

Link
Host
https://github.com/sirupsen/napkin-math
github.com
https://www.cloudping.co/
cloudping.co
https://www.patreon.com/posts/127627543
patreon.com
Kioxia CD9P-R Review: Read-Intensive Gen5 Up to 61.44TB Read at the source ↗
storagereview.com
http://instlatx64.atw.hu/
instlatx64.atw.hu
Agentic test processes, LLM benchmarks, and other notes on agentic coding from Galapagos Island Read at the source ↗
danluu.com
https://deepswe.datacurve.ai/data/v1.1/tasks/boa-hierarchical-evaluation-cancellation
deepswe.datacurve.ai
https://deepswe.datacurve.ai/data/v1.1/tasks/fd-deterministic-multi-key-sorting
deepswe.datacurve.ai
https://deepswe.datacurve.ai/data/v1.1/tasks/oxvg-structural-selector-preservation
deepswe.datacurve.ai
https://deepswe.datacurve.ai/data/v1.1/tasks/wasmi-trap-coredumps
deepswe.datacurve.ai
https://senior-swe-bench.snorkel.ai/tasks/paperless-ngx-perf-workflow-queries
senior-swe-bench.snorkel.ai
https://senior-swe-bench.snorkel.ai/tasks/plausible-fix-top-pages-comparison
senior-swe-bench.snorkel.ai
Measurement, benchmarking, and data analysis are underrated Read at the source ↗
danluu.com
Why do people post on [bad platform] instead of [good platform]? Read at the source ↗
danluu.com
https://www.youtube.com/watch?v=bKtnczk8Mxk
youtube.com
https://upload.wikimedia.org/wikipedia/commons/a/a5/Causes_of_death_by_age_group_%28percent%29.png
upload.wikimedia.org
https://en.wikipedia.org/wiki/Head_injury_criterion
en.wikipedia.org
How do cars do in out-of-sample crash testing? Read at the source ↗
danluu.com
https://www.patreon.com/posts/107155602
patreon.com
https://www.patreon.com/posts/109004070
patreon.com
https://www.patreon.com/posts/118646029
patreon.com
https://www.patreon.com/posts/149123122
patreon.com
https://www.patreon.com/posts/160473058
patreon.com
https://www.scattered-thoughts.net/
scattered-thoughts.net
Against SQL Read at the source ↗
scattered-thoughts.net
Internal consistency in streaming systems Read at the source ↗
scattered-thoughts.net
The container throttling problem Read at the source ↗
danluu.com
A simple way to get more value from metrics Read at the source ↗
danluu.com
Which programming languages are most token-efficient? Read at the source ↗
martinalderson.com
How does programming language affect token efficiency and correctness? Read at the source ↗
danluu.com
https://www.reddit.com/r/codex/comments/1uuchvg/gpt_55_and_56_conversion_table/
reddit.com
https://www.patreon.com/danluu
patreon.com
https://en.wikipedia.org/wiki/Collider_(statistics
en.wikipedia.org
What the FTC got wrong in the Google antitrust investigation Read at the source ↗
danluu.com
Suspicious discontinuities Read at the source ↗
danluu.com
Fun and weirdness with SSDs Read at the source ↗
vondra.me
https://lwn.net/Articles/353411
lwn.net