corpus.blog
41554 blogs · 4,417,066 posts Claim your blog
Record · corpus.blog/posts/01a087ec-e4f4-72ad-a3dc-85b6e5881499

Eval Harnesses: lm-eval-harness and HELM

thegustafson.com · published undated

A record is what was published and who pointed at it. The text of the post is not held here: read it at the source, or at its Wayback capture.

Read the post at thegustafson.com Wayback capture
0blogs citing
First cited
—
Most recent
—
Rank this month
not ranked
Links from this post
13
Words captured
2,791

Cited by

No blog we hold has cited this post yet.

Links from this post

Link
Host
Language Modeling as Next-Token Prediction Read at the source ↗
thegustafson.com
Sampling Strategies: Temperature, Top-k, Top-p, and Min-p Read at the source ↗
thegustafson.com
Distributions, Softmax, and the Chain Rule of Words Read at the source ↗
thegustafson.com
Loss vs. Benchmarks: Two Languages for Model Quality Read at the source ↗
thegustafson.com
Contamination and Leakage Read at the source ↗
thegustafson.com
https://github.com/EleutherAI/lm-evaluation-harness
github.com
https://arxiv.org/abs/2005.14165
arxiv.org
https://arxiv.org/abs/2009.03300
arxiv.org
https://arxiv.org/abs/2211.09110
arxiv.org
https://crfm.stanford.edu/helm/lite/
crfm.stanford.edu
https://arxiv.org/abs/2303.08774
arxiv.org
https://arxiv.org/abs/2402.01781
arxiv.org
https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard
huggingface.co