corpus.blog
41554 blogs · 4,417,066 posts Claim your blog
Record · corpus.blog/posts/01a08752-870f-70f8-aff7-22bdd169cb71

Evaluating LLMs - Notes on a NeurIPS'24 Tutorial

blog.quipu-strands.com · published 6 March 2025

A record is what was published and who pointed at it. The text of the post is not held here: read it at the source, or at its Wayback capture.

Read the post at blog.quipu-strands.com Wayback capture
0blogs citing
First cited
—
Most recent
—
Rank this month
not ranked
Links from this post
43
Words captured
8,253

Cited by

No blog we hold has cited this post yet.

Links from this post

Link
Host
https://nips.cc/media/neurips-2024/Slides/99524.pdf
nips.cc
https://services.google.com/fh/files/blogs/neurips_evaluation.pdf?linkId=12695737&trk=feed-detail_comments-list_comment-textWe%27d
services.google.com
https://www.sqlite.org/testing.html
sqlite.org
https://cutlefish.substack.com/p/tbm-325-skeptoptimism-thinking-slow
cutlefish.substack.com
https://github.com/lisadunlap/VibeCheck
github.com
https://en.wikipedia.org/wiki/Discounted_cumulative_gain
en.wikipedia.org
https://huggingface.co/blog/g-ronimo/semscore
huggingface.co
https://github.com/nlpyang/geval
github.com
https://paperswithcode.com/sota/multi-task-language-understanding-on-mmlu
paperswithcode.com
https://lmarena.ai/?leaderboard
lmarena.ai
https://huyenchip.com/2024/07/25/genai-platform.html
huyenchip.com
https://aclanthology.org/2024.emnlp-main.248/
aclanthology.org
https://huggingface.co/stabilityai/stablelm-2-zephyr-1_6b
huggingface.co
https://lsa.umich.edu/content/dam/sweetland-assets/sweetland-documents/teachingresources/GivingFeedbackonStudentWriting/Sample_EssayGradingRubric.pdf
lsa.umich.edu
https://www.mturk.com/
mturk.com
https://huggingface.co/spaces/allenai/reward-bench
huggingface.co
Introducing ChatGPT Read at the source ↗
openai.com
https://www.interconnects.ai/p/why-reward-models-matter
interconnects.ai
https://www.youtube.com/watch?v=CAaHAfCqrBA
youtube.com
https://sebastianraschka.com/blog/2024/research-papers-in-march-2024.html
sebastianraschka.com
https://en.wikipedia.org/wiki/Spearman%27s_rank_correlation_coefficient
en.wikipedia.org
https://en.wikipedia.org/wiki/Kendall_rank_correlation_coefficient
en.wikipedia.org
https://en.wikipedia.org/wiki/Pearson_correlation_coefficient
en.wikipedia.org
https://en.wikipedia.org/wiki/Cohen%27s_kappa
en.wikipedia.org
https://stats.stackexchange.com/questions/59798/quadratic-weighted-kappa-versus-linear-weighted-kappa
stats.stackexchange.com
https://www.kaggle.com/code/aroraaman/quadratic-kappa-metric-explained-in-5-simple-steps
kaggle.com
https://en.wikipedia.org/wiki/Fleiss%27_kappa
en.wikipedia.org
https://en.wikipedia.org/wiki/Confusion_matrix
en.wikipedia.org
https://github.com/lm-sys/FastChat/tree/main/fastchat/llm_judge
github.com
https://lmarena.ai/
lmarena.ai
https://huggingface.co/datasets/nvidia/HelpSteer/viewer
huggingface.co
https://huggingface.co/datasets/nvidia/HelpSteer2
huggingface.co
https://huggingface.co/datasets/princeton-nlp/LLMBar
huggingface.co
https://tatsu-lab.github.io/alpaca_eval/
tatsu-lab.github.io
https://github.com/tatsu-lab/alpaca_eval?tab=readme-ov-file
github.com
https://github.com/anthropics/hh-rlhf
github.com
https://github.com/google/BIG-bench/tree/main/bigbench/benchmark_tasks/hhh_alignment
github.com
https://huggingface.co/datasets/bigcode/humanevalpack
huggingface.co
https://www.gharchive.org/
gharchive.org
https://huggingface.co/datasets/lytang/LLM-AggreFact
huggingface.co
https://huggingface.co/spaces/ScalerLab/JudgeBench
huggingface.co
https://huggingface.co/datasets/allenai/WildBench
huggingface.co
https://www.youtube.com/watch?v=VViyQRGxSKo
youtube.com