corpus.blog
41554 blogs · 4,417,066 posts Claim your blog
Record · corpus.blog/posts/01a07d5d-9f4f-7055-8ebc-1363fb91b09f

Noteworthy LLM Research Papers of 2024

Ahead of AI · published 23 January 2025

A record is what was published and who pointed at it. The text of the post is not held here: read it at the source, or at its Wayback capture.

Read the post at magazine.sebastianraschka.com Wayback capture
0blogs citing
First cited
—
Most recent
—
Rank this month
not ranked
Links from this post
36
Words captured
3,313

Cited by

No blog we hold has cited this post yet.

Links from this post

Link
Host
LLM Research Papers: The 2024 List Read at the source ↗
magazine.sebastianraschka.com
https://arxiv.org/abs/2401.04088
arxiv.org
https://substackcdn.com/image/fetch/$s_!xyDu!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb6a8621c-2193-4d5f-b140-e8b669ccbc75_1490x1134.png
substackcdn.com
https://magazine.sebastianraschka.com/i/141130005/mixtral-of-experts
magazine.sebastianraschka.com
https://github.com/deepseek-ai/DeepSeek-V3/blob/main/DeepSeek_V3.pdf
github.com
https://magazine.sebastianraschka.com/p/practical-tips-for-finetuning-llms
magazine.sebastianraschka.com
https://amzn.to/4fqvn0D
amzn.to
https://arxiv.org/abs/2402.09353
arxiv.org
https://substackcdn.com/image/fetch/$s_!ap7E!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F014307aa-3e4d-47d1-a99f-37892d943c97_1600x702.png
substackcdn.com
https://substackcdn.com/image/fetch/$s_!smvV!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe39fff89-8c1b-4e06-80c9-f2ca375af019_1600x1165.png
substackcdn.com
Improving LoRA: Implementing Weight-Decomposed Low-Rank Adaptation (DoRA) from Scratch Read at the source ↗
magazine.sebastianraschka.com
https://arxiv.org/abs/2407.21075
arxiv.org
https://arxiv.org/abs/2403.08763
arxiv.org
https://substackcdn.com/image/fetch/$s_!6vK_!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Feaf69f6f-effb-4f77-9ffb-4eb7bbdbdf8c_1600x554.png
substackcdn.com
Tips for LLM Pretraining and Evaluating Reward Models Read at the source ↗
magazine.sebastianraschka.com
New LLM Pre-training and Post-training Paradigms Read at the source ↗
magazine.sebastianraschka.com
https://arxiv.org/abs/2404.19756
arxiv.org
https://arxiv.org/abs/2404.10719
arxiv.org
https://substackcdn.com/image/fetch/$s_!xaW9!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F96c470e8-0e63-4553-bfb9-4f82b1a821fd_1024x144.jpeg
substackcdn.com
https://magazine.sebastianraschka.com/p/llm-training-rlhf-and-its-alternatives
magazine.sebastianraschka.com
https://github.com/rasbt/LLMs-from-scratch/blob/main/ch07/04_preference-tuning-with-dpo/dpo-from-scratch.ipynb
github.com
https://substackcdn.com/image/fetch/$s_!xFjM!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5ade88a3-4ca5-43f4-92af-4bdfce84dc42_1600x918.png
substackcdn.com
https://arxiv.org/abs/2411.15124
arxiv.org
https://arxiv.org/abs/2405.09673
arxiv.org
https://substackcdn.com/image/fetch/$s_!-sha!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F68aeccb5-f78d-4fad-9ec5-2fc2f46b8340_1600x796.png
substackcdn.com
https://substackcdn.com/image/fetch/$s_!gtHU!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F84c8af4d-e189-483c-a2f3-a7ecf3812584_1600x662.png
substackcdn.com
https://arxiv.org/abs/2406.17557
arxiv.org
https://huggingface.co/datasets/HuggingFaceFW/fineweb
huggingface.co
https://github.com/huggingface/datatrove/blob/main/examples/fineweb.py
github.com
https://arxiv.org/abs/2203.15556
arxiv.org
https://github.com/togethercomputer/RedPajama-Data
github.com
https://substackcdn.com/image/fetch/$s_!j-61!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F988590ff-fab6-4b18-af4d-2945bc529c34_1600x825.png
substackcdn.com
https://arxiv.org/abs/2407.21783
arxiv.org
https://commoncrawl.org/
commoncrawl.org
https://substackcdn.com/image/fetch/$s_!JYkT!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fba7ca02d-dcb3-44a2-89fe-50578eb670b8_1600x1164.png
substackcdn.com
https://www.amazon.com/Build-Large-Language-Model-Scratch/dp/1633437167
amazon.com