corpus.blog
56,966 blogs · 4,417,066 posts Claim your blog
Record · corpus.blog/posts/01a07df3-316b-710b-935b-483113939c76

AI Evals: Everything You Need to Know

Hamel Husain · published 28 May 2025

A record is what was published and who pointed at it. The text of the post is not held here: read it at the source, or at its Wayback capture.

Read the post at hamel.dev Wayback capture
13blogs citing
First cited
19 Aug 2025
Most recent
5 Sept 2026
Rank this month
not ranked
Links from this post
41
Words captured
12,389

Cited by

Blog
In the post
Date
druce.ai
Agent Reliability Engineering: Field Notes on Building Predictable, Steerable Agents Read at the source ↗
5 Sept 2026
blog.kjamistan.com
Privacy Evaluations for AI Systems Read at the source ↗
2 Sept 2026
conorsvensson.com
Building an evals framework for audits Read at the source ↗
19 Aug 2026
bhargav.dev
LLM evals in production: turning real bugs into a weekly test habit Read at the source ↗
16 Aug 2026
sunnybak.net
How to Escape the Eval Cold Start Problem Read at the source ↗
1 Jul 2026
Datadog Engineering
Debug and evaluate your AI app from your coding agent with Datadog Agent Observability Read at the source ↗
30 Jun 2026
brandoncasci.com
Stop Correcting Your AI. Grade It, Tune It, and Compound the ROI. Read at the source ↗
2 Jun 2026
mkarots.github.io
What Do We Mean When We Say Evals? Read at the source ↗
25 May 2026
aroy.sh
A Synthesis of LLM Evaluation Read at the source ↗
15 Mar 2026
Eugene Yan
Product Evals in Three Simple Steps Read at the source ↗
23 Nov 2025
schneidenba.ch
Stop Trusting Your LLM Prompts - Write Evals Instead Read at the source ↗
17 Nov 2025
kylekukshtel.com
How to Git Gud at Claude Code (a loose guide) Read at the source ↗
17 Sept 2025
Pamela Fox
How I learn about generative AI Read at the source ↗
19 Aug 2025
Pamela Fox
How I learn about generative AI Read at the source ↗
19 Aug 2025

Links from this post

Link
Host
https://maven.com/parlance-labs/evals?promoCode=evals-info-book
maven.com
https://mlops.systems/posts/2025-06-04-instrumenting-an-agentic-app-with-arize-phoenix-and-litellm.html
mlops.systems
https://youtu.be/aqKUwPKBkB0?si=5KDmMQnRzO_Ce9xH
youtu.be
https://www.youtube.com/watch?v=aqKUwPKBkB0
youtube.com
https://www.youtube.com/watch?v=qH1dZ8JLLdU
youtube.com
https://ai-execs.com/2_intro.html
ai-execs.com
https://arxiv.org/abs/2404.12272
arxiv.org
https://m.youtube.com/watch?si=qknrtQeITqJ7VsJH&v=4dUFIRj-BWo&feature=youtu.be
m.youtube.com
https://www.youtube.com/watch?v=EEw2PpL-_NM
youtube.com
A Field Guide to Rapidly Improving AI Products Read at the source ↗
hamel.dev
Using LLM-as-a-Judge For Evaluation: A Complete Guide Read at the source ↗
hamel.dev
https://delvetool.com/blog/theoreticalsaturation
delvetool.com
https://www.youtube.com/watch?v=e2i6JbU2R-s
youtube.com
https://www.linkedin.com/in/pawel-huryn/
linkedin.com
https://github.com/ai-evals-course/evals-skills
github.com
https://youtu.be/tqUDjc1HzO4
youtu.be
https://youtu.be/e2i6JbU2R-s?si=8p5XVxbBiioz69Xc
youtu.be
https://www.youtube.com/watch?v=tqUDjc1HzO4
youtube.com
https://arxiv.org/pdf/2508.06709
arxiv.org
https://arxiv.org/search/?query=Abstention+Ability&searchtype=all
arxiv.org
https://www.ankihub.net/
ankihub.net
https://youtu.be/fA4pe9bE0LY
youtu.be
https://www.youtube.com/watch?v=fA4pe9bE0LY
youtube.com
https://julius.ai/
julius.ai
https://hex.tech
hex.tech
https://www.langchain.com/langsmith
langchain.com
https://arize.com/
arize.com
https://www.braintrust.dev/
braintrust.dev
https://github.com
github.com
https://desktop.github.com/
desktop.github.com
https://ben.balter.com/2023/03/02/github-for-non-technical-roles/
ben.balter.com
https://www.youtube.com/watch?v=N-qAOv_PNPc
youtube.com
https://hamel.dev/blog/posts/prompt/
hamel.dev
https://pashpashpash.substack.com/p/why-i-no-longer-recommend-rag-for
pashpashpash.substack.com
https://x.com/pashmerepat/status/1926717705660375463?s=46
x.com
https://jxnl.co/writing/2025/05/19/there-are-only-6-rag-evals/
jxnl.co
Your AI Product Needs Evals Read at the source ↗
hamel.dev
https://www.figma.com/deck/nwRlh5renu4s4olaCsf9lG/Failure-is-a-Funnel?node-id=2009-927&t=GJlTtxQ8bLJaQ92A-1
figma.com
https://youtu.be/R_HnI9oTv3c?si=hRRhDiydHU5k6ikc
youtu.be
https://www.youtube.com/watch?v=R_HnI9oTv3c
youtube.com
https://paulgraham.com/writes.html
paulgraham.com