corpus.blog
41554 blogs · 4,644,446 posts Claim your blog
Record · corpus.blog/posts/01a087de-bae6-723d-b1d0-88f97a44db8e

LM Benchmarks notes

serhii.net · published 27 September 2023

A record is what was published and who pointed at it. The text of the post is not held here: read it at the source, or at its Wayback capture.

Read the post at serhii.net Wayback capture
0blogs citing
First cited
—
Most recent
—
Rank this month
not ranked
Links from this post
24
Words captured
285

Cited by

No blog we hold has cited this post yet.

Links from this post

Link
Host
https://serhii.net/dtb/days/230928-1527-evaluation-benchmark-for-de-ua-text/
serhii.net
https://github.com/stanford-crfm/helm/blob/main/src/helm/benchmark/scenarios/commonsense_scenario.py
github.com
https://crfm.stanford.edu/helm/latest/?scenarios=1
crfm.stanford.edu
https://github.com/microsoft/GLUECoS/tree/master/Code
github.com
https://github.com/microsoft/XGLUE
github.com
https://microsoft.github.io/XGLUE/
microsoft.github.io
https://www.lesswrong.com/posts/PF58wEdztZFX2dSue/how-truthful-is-gpt-3-a-benchmark-for-language-models
lesswrong.com
https://github.com/sylinrl/TruthfulQA
github.com
https://github.com/sylinrl/TruthfulQA/blob/main/TruthfulQA.csv
github.com
https://arxiv.org/abs/2210.14986
arxiv.org
https://github.com/aviaefrat/lmentry/blob/main/data/last_letter.json
github.com
https://github.com/google/BIG-bench
github.com
https://colab.research.google.com/github/google/BIG-bench/blob/main/notebooks/colab_examples.ipynb
colab.research.google.com
https://huggingface.co/spaces/lmsys/chatbot-arena-leaderboard
huggingface.co
https://github.com/EleutherAI/lm-evaluation-harness/tree/big-refactor/lm_eval/tasks
github.com
https://github.com/facebookresearch/ParlAI/blob/main/parlai/tasks/multinli/test/multinli_test.yml
github.com
https://github.com/openai/evals
github.com
https://github.com/TheoremOne/llm-benchmarker-suite
github.com
https://github.com/TeunvdWeij/gpt-shutdownability/tree/main
github.com
https://github.com/EleutherAI/lm-evaluation-harness/tree/big-refactor/lm_eval/tasks/glue
github.com
https://github.com/EleutherAI/lm-evaluation-harness/blob/big-refactor/lm_eval/tasks/benchmarks/t0_eval.yaml
github.com
https://github.com/LauraRuis/do-pigs-fly
github.com
https://huggingface.co/datasets/UCL-DARK/ludwig/viewer/0-shot/validation?row=2
huggingface.co
https://github.com/aviaefrat/lmentry
github.com