corpus.blog
41554 blogs · 4,417,066 posts Claim your blog
Record · corpus.blog/posts/01a0876d-c545-7253-aa6b-2bee5341fca2

frontier model training methodologies

djdumpling.github.io · published 31 January 2026

A record is what was published and who pointed at it. The text of the post is not held here: read it at the source, or at its Wayback capture.

Read the post at djdumpling.github.io Wayback capture
1blogs citing
First cited
22 Feb 2026
Most recent
22 Feb 2026
Rank this month
not ranked
Links from this post
105
Words captured
16,876

Cited by

Blog
In the post
Date
AI for Software Engineers | Logan Thorneloe | Substack
AI’s Biggest Cost Is Cognitive, Not Compute | Weekend Reads 2 Read at the source ↗
22 Feb 2026

Links from this post

Link
Host
https://huggingface.co/spaces/HuggingFaceTB/smol-training-playbook
huggingface.co
https://arxiv.org/abs/2512.16144
arxiv.org
https://arxiv.org/abs/2508.18255
arxiv.org
https://arxiv.org/pdf/2508.10925
arxiv.org
https://arxiv.org/pdf/2507.20534
arxiv.org
https://arxiv.org/pdf/2501.12948
arxiv.org
https://github.com/arcee-ai/trinity-large-tech-report/blob/main/Arcee%20Trinity%20Large.pdf
github.com
Tricks from OpenAI gpt-oss YOU 🫵 can use with transformers Read at the source ↗
huggingface.co
https://huggingface.co/moonshotai/Kimi-K2-Instruct/blob/main/tokenization_kimi.py
huggingface.co
https://github.com/openai/tiktoken
github.com
https://arxiv.org/abs/1911.02150
arxiv.org
https://arxiv.org/abs/2305.13245
arxiv.org
https://arxiv.org/abs/2407.21783
arxiv.org
https://arxiv.org/abs/2410.02660
arxiv.org
https://arxiv.org/abs/2503.15450
arxiv.org
https://x.com/PMinervini/status/1777596492351422866
x.com
https://pytorch.org/blog/advancing-low-bit-operators-in-pytorch-and-executorch-dynamic-kernel-selection-kleidiai-and-quantized-tied-embeddings/
pytorch.org
https://arxiv.org/abs/1706.03762
arxiv.org
https://arxiv.org/abs/2104.09864
arxiv.org
https://arxiv.org/abs/2309.16039
arxiv.org
https://arxiv.org/abs/2309.00071
arxiv.org
https://arxiv.org/abs/2305.19466
arxiv.org
https://arxiv.org/abs/2501.18795
arxiv.org
https://ai.meta.com/blog/llama-4-multimodal-intelligence/
ai.meta.com
https://arxiv.org/abs/2503.19786
arxiv.org
https://arxiv.org/pdf/2412.15115
arxiv.org
https://sebastianraschka.com/
sebastianraschka.com
https://arxiv.org/abs/2507.20534
arxiv.org
https://arxiv.org/abs/2507.17702
arxiv.org
https://arxiv.org/pdf/2507.17702
arxiv.org
https://arxiv.org/abs/2405.04434
arxiv.org
https://arxiv.org/abs/2412.19437
arxiv.org
https://arxiv.org/abs/2405.21060
arxiv.org
https://arxiv.org/abs/2504.03624
arxiv.org
https://arxiv.org/abs/2507.22448
arxiv.org
https://qwen.ai/blog?id=4074cca80393150c248e508aa62983f9cb7d27cd&from=research.latest-advancements-list
qwen.ai
https://github.com/fla-org/flash-linear-attention/pull/621
github.com
https://storage.googleapis.com/deepmind-media/gemma/gemma-2-report.pdf
storage.googleapis.com
https://arxiv.org/abs/2408.00118
arxiv.org
https://arxiv.org/abs/1609.08144
arxiv.org
Welcome Gemma 2 - Google’s new open LLM Read at the source ↗
huggingface.co
https://danieldk.eu/Machine-Learning/Building-Blocks/Logit-Softcapping
danieldk.eu
https://arxiv.org/abs/2011.14522
arxiv.org
https://arxiv.org/abs/2402.01035
arxiv.org
https://arxiv.org/abs/1508.07909
arxiv.org
https://arxiv.org/abs/2303.08774
arxiv.org
https://docs.modula.systems/algorithms/newton-schulz/
docs.modula.systems
https://kellerjordan.github.io/posts/muon/
kellerjordan.github.io
https://arxiv.org/abs/1608.03983
arxiv.org
https://arxiv.org/abs/2404.06395
arxiv.org
https://arxiv.org/abs/2401.02954
arxiv.org
https://arxiv.org/abs/1812.06162
arxiv.org
https://arxiv.org/abs/2203.15556
arxiv.org
https://arxiv.org/abs/2407.05065
arxiv.org
https://arxiv.org/abs/2001.08361
arxiv.org
https://arxiv.org/abs/2506.20920
arxiv.org
https://pile.eleuther.ai/
pile.eleuther.ai
https://arxiv.org/abs/2305.16264
arxiv.org
https://arxiv.org/abs/2502.02737
arxiv.org
https://arxiv.org/abs/2410.08527
arxiv.org
https://huggingface.co/datasets/allenai/dolmino-mix-1124/tree/main/data/pes2o
huggingface.co
https://huggingface.co/datasets/allenai/dolmino-mix-1124/tree/main/data/wiki
huggingface.co
https://huggingface.co/datasets/HuggingFaceTB/stackexchange_2025_md
huggingface.co
https://arxiv.org/abs/2402.19173
arxiv.org
https://arxiv.org/abs/2504.02807
arxiv.org
https://arxiv.org/abs/2402.10176
arxiv.org
https://arxiv.org/abs/2504.16891
arxiv.org
https://arxiv.org/abs/2406.11794
arxiv.org
https://arxiv.org/abs/2505.09388
arxiv.org
https://arxiv.org/abs/2404.06654
arxiv.org
https://huggingface.co/datasets/open-r1/Mixture-of-Thoughts
huggingface.co
https://arxiv.org/abs/2507.16812
arxiv.org
https://arxiv.org/abs/2505.19641
arxiv.org
https://huggingface.co/datasets/PrimeIntellect/SYNTHETIC-2
huggingface.co
https://arxiv.org/abs/2504.07164
arxiv.org
https://arxiv.org/abs/2504.21798
arxiv.org
https://arxiv.org/abs/2504.02605
arxiv.org
https://huggingface.co/datasets/zai-org/DeepDive
huggingface.co
https://huggingface.co/datasets/TIGER-Lab/WebInstruct-verified
huggingface.co
https://arxiv.org/abs/2505.21297
arxiv.org
https://arxiv.org/abs/2504.11456
arxiv.org
https://nousresearch.com/introducing-atropos/
nousresearch.com
https://huggingface.co/datasets/allenai/RLVR-IFeval
huggingface.co
https://huggingface.co/datasets/nvidia/Nemotron-Post-Training-Dataset-v1
huggingface.co
https://huggingface.co/datasets/a-m-team/AM-DeepSeek-R1-0528-Distilled
huggingface.co
https://github.com/zhenyuhe00/SWE-Swiss
github.com
https://arxiv.org/abs/2305.18290
arxiv.org
https://arxiv.org/abs/2402.01306
arxiv.org
https://arxiv.org/abs/2403.07691
arxiv.org
https://arxiv.org/abs/2408.06266
arxiv.org
https://arxiv.org/abs/2509.19128
arxiv.org
https://www.emergentmind.com/topics/icepop
emergentmind.com
https://arxiv.org/pdf/2512.12895
arxiv.org
https://arxiv.org/abs/2503.01307
arxiv.org
https://arxiv.org/abs/2503.14476
arxiv.org
On-Policy Distillation Read at the source ↗
thinkingmachines.ai
https://arxiv.org/abs/1712.01815
arxiv.org
Introducing SWE-bench Verified Read at the source ↗
openai.com
https://arxiv.org/abs/2504.01848
arxiv.org
https://arxiv.org/abs/2110.08193
arxiv.org
https://github.com/huggingface/gpu-fryer
github.com
https://docs.nvidia.com/datacenter/dcgm/latest/user-guide/dcgm-diagnostics.html
docs.nvidia.com
https://arxiv.org/abs/2204.02311
arxiv.org
https://arxiv.org/abs/2501.00656
arxiv.org
https://huggingface.co/spaces/Hugging
huggingface.co