Record · corpus.blog/posts/01a08770-3c63-7061-b363-d03a2a01547b

What the hell Is GPQA, anyway?

Duarte O.Carmo · published 14 January 2025

A record is what was published and who pointed at it. The text of the post is not held here: read it at the source, or at its Wayback capture.

Read the post at duarteocarmo.com Wayback capture

0blogs citing

First cited: —
Most recent: —
Rank this month: not ranked
Links from this post: 27
Words captured: 3,547

Cited by

No blog we hold has cited this post yet.

Links from this post

Link

Host

https://www.anthropic.com/news/claude-3-family

anthropic.com

https://ai.meta.com/blog/llama-3-2-connect-2024-vision-edge-mobile-devices/

ai.meta.com

GPT-4o mini: advancing cost-efficient intelligence Read at the source ↗

openai.com

https://www.theverge.com/2024/10/28/24281965/honestly-this-is-a-work-of-art

theverge.com

https://duarteocarmo.com/blog/the-marathon

duarteocarmo.com

https://gist.github.com/duarteocarmo/3eeb2200af74880e034d45e63e30aafe

gist.github.com

https://huggingface.co/datasets/Idavidrein/gpqa

huggingface.co

https://github.com/idavidrein/gpqa

github.com

https://arxiv.org/pdf/2311.12022

arxiv.org

https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard

huggingface.co

https://huggingface.co/docs/leaderboards/open_llm_leaderboard/about

huggingface.co

https://github.com/EleutherAI/lm-evaluation-harness

github.com

https://github.com/openai/simple-evals?tab=readme-ov-file

github.com

https://github.com/openai/evals

github.com

https://github.com/EleutherAI/lm-evaluation-harness?tab=readme-ov-file

github.com

https://github.com/EleutherAI/lm-evaluation-harness/tree/main/lm_eval/tasks

github.com

https://github.com/EleutherAI/lm-evaluation-harness/blob/main/lm_eval/tasks/gpqa/README.md

github.com

https://github.com/EleutherAI/lm-evaluation-harness/tree/main/lm_eval/tasks/gpqa

github.com

https://github.com/EleutherAI/lm-evaluation-harness/blob/main/lm_eval/tasks/gpqa/zeroshot/_gpqa_zeroshot_yaml

github.com

https://github.com/EleutherAI/lm-evaluation-harness/blob/bb098f13b05e361f01a5afe7b612779ce362b3f2/lm_eval/tasks/gpqa/zeroshot/_gpqa_zeroshot_yaml

github.com

https://github.com/EleutherAI/lm-evaluation-harness/blob/main/lm_eval/tasks/gpqa/cot_zeroshot/_gpqa_cot_zeroshot_yaml

github.com

https://dspy.ai/

dspy.ai

Your AI Product Needs Evals Read at the source ↗

hamel.dev

https://lmarena.ai/

lmarena.ai

https://arxiv.org/pdf/2412.08905

arxiv.org

https://github.com/EleutherAI/lm-evaluation-harness/issues/942

github.com

https://github.com/EleutherAI/lm-evaluation-harness/issues/1196

github.com