Record · corpus.blog/posts/01a0872e-9b7a-7240-a711-1c81883dff18

A Synthesis of LLM Evaluation

aroy.sh · published 15 March 2026

A record is what was published and who pointed at it. The text of the post is not held here: read it at the source, or at its Wayback capture.

Read the post at aroy.sh Wayback capture

0blogs citing

First cited: —
Most recent: —
Rank this month: not ranked
Links from this post: 25
Words captured: 3,572

Cited by

No blog we hold has cited this post yet.

Links from this post

Link

Host

https://www.anthropic.com/engineering/demystifying-evals-for-ai-agents

anthropic.com

Your AI Product Needs Evals Read at the source ↗

hamel.dev

https://learning.oreilly.com/library/view/evals-for-ai/9798341660717/

learning.oreilly.com

https://arxiv.org/abs/2306.05685

arxiv.org

https://ai.pydantic.dev/evals/

ai.pydantic.dev

Working with the Evals API Read at the source ↗

platform.openai.com

https://www.promptfoo.dev/

promptfoo.dev

https://www.braintrust.dev/

braintrust.dev

https://deepeval.com/

deepeval.com

https://phoenix.arize.com/

phoenix.arize.com

https://pydantic.dev/logfire

pydantic.dev

https://langfuse.com/

langfuse.com

https://smith.langchain.com/

smith.langchain.com

https://opentelemetry.io/docs/specs/semconv/gen-ai/

opentelemetry.io

https://platform.claude.com/docs/en/test-and-evaluate/develop-tests

platform.claude.com

Using LLM-as-a-Judge For Evaluation: A Complete Guide Read at the source ↗

hamel.dev

AI Evals: Everything You Need to Know Read at the source ↗

hamel.dev

A Field Guide to Rapidly Improving AI Products Read at the source ↗

hamel.dev

https://www.lennysnewsletter.com/p/evals-error-analysis-and-better-prompts

lennysnewsletter.com

https://newsletter.pragmaticengineer.com/p/evals

newsletter.pragmaticengineer.com

https://www.evidentlyai.com/llm-guide/llm-as-a-judge

evidentlyai.com

https://www.honeyhive.ai/post/avoiding-common-pitfalls-in-llm-evaluation

honeyhive.ai

https://www.braintrust.dev/docs/best-practices/agents

braintrust.dev

https://labs.adaline.ai/p/ai-observability-and-evaluations

labs.adaline.ai

https://learning.oreilly.com/videos/evaluating-large-language/9780135451922/

learning.oreilly.com