corpus.blog
41,554 blogs · 5,197,919 posts Claim your blog
Record · corpus.blog/posts/01a087a7-9553-716d-b736-71b612401b8d

Why you should A/B test your LLM evals

mlumiste.com · published 9 August 2023

A record is what was published and who pointed at it. The text of the post is not held here: read it at the source, or at its Wayback capture.

Read the post at mlumiste.com Wayback capture
0blogs citing
First cited
—
Most recent
—
Rank this month
not ranked
External links
13
Words captured
5,827

Cited by

No blog we hold has cited this post yet.

Links from this post

Link
Host
https://twitter.com/yuntiandeng/status/1641108596510343168
twitter.com
https://community.openai.com/t/why-is-gpt-4-giving-different-answers-with-same-prompt-temperature-0/143513
community.openai.com
https://arstechnica.com/information-technology/2023/07/is-chatgpt-getting-worse-over-time-study-claims-yes-but-others-arent-sure/
arstechnica.com
https://github.com/Significant-Gravitas/Auto-GPT
github.com
https://community.openai.com/t/a-question-on-determinism/8185/2
community.openai.com
https://eugeneyan.com/writing/llm-patterns/
eugeneyan.com
https://en.wikipedia.org/wiki/Law_of_large_numbers
en.wikipedia.org
https://en.wikipedia.org/wiki/Paired_data
en.wikipedia.org
https://stats.stackexchange.com/questions/507154/paired-t-test-with-multiple-measurements-per-pair
stats.stackexchange.com
https://www.tjmahr.com/plotting-partial-pooling-in-mixed-effects-models/
tjmahr.com
https://en.wikipedia.org/wiki/Fixed_effects_model
en.wikipedia.org
https://link.springer.com/article/10.1007/s11135-018-0802-x
link.springer.com
https://medium.com/@marco_laube/the-paired-t-test-and-linear-mixed-models-185a084d7813
medium.com