corpus.blog
56,966 blogs · 4,417,066 posts Claim your blog
Record · corpus.blog/posts/01a0cabe-f4d5-71c5-bcf7-abe7f4aa6e1c

Scaling Laws – O1 Pro Architecture, Reasoning Training Infrastructure, Orion and Claude 3.5 Opus “Failures”

SemiAnalysis · published 11 December 2024

A record is what was published and who pointed at it. The text of the post is not held here: read it at the source, or at its Wayback capture.

Read the post at semianalysis.com Wayback capture
4blogs citing
First cited
29 Dec 2024
Most recent
27 Mar 2025
Rank this month
not ranked
Links from this post
32
Words captured
7,362

Cited by

Blog
In the post
Date
smw.ai
New Limits, or on Scaling Laws Read at the source ↗
27 Mar 2025
benjamintodd.substack.com
Teaching AI to reason: this year's most important story Read at the source ↗
12 Feb 2025
lukaspetersson.github.io
AI Founder’s Bitter Lesson. Chapter 3 - A Footnote in History Read at the source ↗
22 Jan 2025
zhengdongwang.com
2024 letter Read at the source ↗
29 Dec 2024

Links from this post

Link
Host
https://www.youtube.com/watch?v=AqwSZEQkknU
youtube.com
https://www.bloomberg.com/news/articles/2024-11-13/openai-google-and-anthropic-are-struggling-to-build-more-advanced-ai
bloomberg.com
https://www.ft.com/content/f24ba8d5-4c33-47ef-a91e-8f76340b08c4
ft.com
Amazon’s AI Self Sufficiency | Trainium2 Architecture & Networking Read at the source ↗
semianalysis.com
https://semianalysis.com/datacenter-industry-model/
semianalysis.com
Multi-Datacenter Training: OpenAI’s Ambitious Plan To Beat Google’s Infrastructure Read at the source ↗
semianalysis.com
https://www.youtube.com/watch?v=7p8ZeSbblec
youtube.com
https://www.researchgate.net/figure/CPU-transistor-densities-clock-speeds-power-and-performance-from-1970-2015-Courtesy-of_fig1_321233071
researchgate.net
Nvidia Blackwell Perf TCO Analysis – B100 vs B200 vs GB200 NVL72 Read at the source ↗
semianalysis.com
The Future of the Transistor Read at the source ↗
semianalysis.com
100,000 H100 Clusters: Power, Network Topology, Ethernet vs InfiniBand, Reliability, Failures, Checkpointing Read at the source ↗
semianalysis.com
The AI Brick Wall – A Practical Limit For Scaling Dense Transformer Models, and How GPT 4 Will Break Past It Read at the source ↗
semianalysis.com
GPT-4 Architecture, Infrastructure, Training Dataset, Costs, Vision, MoE Read at the source ↗
semianalysis.com
https://x.com/_sholtodouglas/status/1860228530338152587
x.com
https://metr.org/AI_R_D_Evaluation_Report.pdf
metr.org
https://arxiv.org/pdf/2311.12022
arxiv.org
https://arxiv.org/pdf/2411.04872
arxiv.org
https://importai.substack.com/p/import-ai-391-chinas-amazing-open?utm_source=post-email-title&publication_id=1317673&post_id=151483024&utm_campaign=email-post-title&isFreemail=true&r=e6s2j&triedRedirect=true&utm_medium=email
importai.substack.com
https://arxiv.org/pdf/2407.21783
arxiv.org
https://ar5iv.labs.arxiv.org/html/2307.09288
ar5iv.labs.arxiv.org
https://arxiv.org/pdf/2309.00267
arxiv.org
https://arxiv.org/abs/2212.08073
arxiv.org
https://arxiv.org/pdf/2305.20050
arxiv.org
https://github.com/openai/prm800k
github.com
https://arxiv.org/pdf/2103.03874
arxiv.org
https://arxiv.org/pdf/2312.08935
arxiv.org
Learning to reason with LLMs Read at the source ↗
openai.com
https://en.wikipedia.org/wiki/AlphaGo
en.wikipedia.org
https://youtu.be/hobvps-H38o?si=XkDzE1L09_FqGNFI&t=2864
youtu.be
https://arxiv.org/pdf/2407.21787
arxiv.org
https://www.youtube.com/watch?v=6PEJ96k1kiw
youtube.com
https://semianalysis.com/faq/
semianalysis.com