corpus.blog
56,966 blogs · 4,417,066 posts Claim your blog
Record · corpus.blog/posts/01a087a5-cd4e-7177-bd85-8fa1e83a0f80

LLM Preference Alignment

miguel-mendez-ai.com · published 7 January 2025

A record is what was published and who pointed at it. The text of the post is not held here: read it at the source, or at its Wayback capture.

Read the post at miguel-mendez-ai.com Wayback capture
0blogs citing
First cited
—
Most recent
—
Rank this month
not ranked
Links from this post
20
Words captured
2,317

Cited by

No blog we hold has cited this post yet.

Links from this post

Link
Host
https://github.com/huggingface/smol-course
github.com
https://huggingface.co/Qwen/Qwen2-7B
huggingface.co
https://huggingface.co/Qwen/Qwen2-7B-Instruct
huggingface.co
https://huggingface.co/datasets/HuggingFaceH4/ultrafeedback_binarized
huggingface.co
https://miguel-mendez-ai.com/assets/images/fullsize/posts/2025-01-07-preference-alignment/reward-model.png
miguel-mendez-ai.com
Illustrating Reinforcement Learning from Human Feedback (RLHF) Read at the source ↗
huggingface.co
https://miguel-mendez-ai.com/assets/images/fullsize/posts/2025-01-07-preference-alignment/ppo.jpg
miguel-mendez-ai.com
https://neptune.ai/blog/customizing-llm-output-post-processing-techniques
neptune.ai
https://miguel-mendez-ai.com/assets/images/fullsize/posts/2025-01-07-preference-alignment/dpo.jpg
miguel-mendez-ai.com
Preference Tuning LLMs with Direct Preference Optimization Methods Read at the source ↗
huggingface.co
https://miguel-mendez-ai.com/assets/images/fullsize/posts/2025-01-07-preference-alignment/llm_diagram.jpg
miguel-mendez-ai.com
https://miguel-mendez-ai.com/assets/images/fullsize/posts/2025-01-07-preference-alignment/orpo_figure.png
miguel-mendez-ai.com
https://miguel-mendez-ai.com/assets/images/fullsize/posts/2025-01-07-preference-alignment/orpo.jpg
miguel-mendez-ai.com
https://huggingface.co/blog/mlabonne/orpo-llama-3
huggingface.co
https://arxiv.org/pdf/1707.06347
arxiv.org
https://arxiv.org/pdf/2305.18290
arxiv.org
https://arxiv.org/pdf/2403.07691
arxiv.org
https://vinija.ai/concepts/llm-alignment/
vinija.ai
https://www.youtube.com/watch?v=hvGa5Mba4c8&t=2590s
youtube.com
https://github.com/huggingface/alignment-handbook
github.com