corpus.blog
56,966 blogs · 4,417,066 posts Claim your blog
Record · corpus.blog/posts/01a07d5d-72e8-7140-82cd-cd9269b35102

Finally, a Replacement for BERT: Introducing ModernBERT

Hugging Face · published 19 December 2024

A record is what was published and who pointed at it. The text of the post is not held here: read it at the source, or at its Wayback capture.

Read the post at huggingface.co Wayback capture
13blogs citing
First cited
19 Dec 2024
Most recent
22 Sept 2026
Rank this month
not ranked
Links from this post
49
Words captured
4,830

Cited by

Blog
In the post
Date
senko
Analyzing Jev, a new AI model Read at the source ↗
22 Sept 2026
marktechpost.com
H Company Releases NeoMME: A Family of 260M and 800M Single-Tower Multimodal Encoders That Drop the Vision Tower and Causal Decoder Read at the source ↗
6 Sept 2026
f2r.github.io
LLM: From Probability to Orchestration Read at the source ↗
4 Mar 2026
Max Woolf's Blog
Predicting Average IMDb Movie Ratings Using Text Embeddings of Movie Metadata Read at the source ↗
30 Jun 2025
alpernebikanli.com
some berts and modernbert Read at the source ↗
22 May 2025
soundsandwords.io
What did you agree to? Readable privacy policies with help from ML Read at the source ↗
18 May 2025
danielvanstrien.xyz
Efficient Inference for ModernBERT Classifiers Using vLLM Read at the source ↗
24 Apr 2025
McGinnis, Will
Data Science Things Roundup #12 Read at the source ↗
20 Jan 2025
corbt.com
One Right Answer or Many? A Useful Distinction for Evaluating and Fine-Tuning LLMs Read at the source ↗
14 Jan 2025
danielvanstrien.xyz
Hygge Data - Cozy Content Filtering for a finer Scandinavian FineWeb Read at the source ↗
9 Jan 2025
drmindle.com
The Three Worlds of AI/ML Read at the source ↗
7 Jan 2025
philschmid.de
Fine-tune classifier with ModernBERT in 2025 Read at the source ↗
25 Dec 2024
markhw.com
Rethinking How I Do Supervised Topic Modeling, Using ModernBERT and GPT-4o mini Read at the source ↗
21 Dec 2024
cpbotha.net
Weekly Head Voices #258: Kogelberg 25 Read at the source ↗
19 Dec 2024

Links from this post

Link
Host
https://huggingface.co/collections/answerdotai/modernbert-67627ad707a4acbf33c41deb
huggingface.co
https://huggingface.co/papers/1810.04805
huggingface.co
https://huggingface.co/models?sort=downloads
huggingface.co
https://huggingface.co/sentence-transformers/all-MiniLM-L6-v2
huggingface.co
http://Answer.AI
answer.ai
https://www.lighton.ai/
lighton.ai
https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/blog/modernbert/modernbert_pareto_curve.png
huggingface.co
https://huggingface.co/openai-community/openai-gpt
huggingface.co
https://huggingface.co/meta-llama
huggingface.co
https://www.anthropic.com/claude
anthropic.com
https://huggingface.co/meta-llama/Llama-3.1-405B
huggingface.co
https://huggingface.co/FacebookAI/roberta-base
huggingface.co
https://huggingface.co/spaces/HuggingFaceFW/blogpost-fineweb-v1
huggingface.co
https://huggingface.co/meta-llama/Meta-Llama-3-70B-Instruct
huggingface.co
https://huggingface.co/HuggingFaceFW/fineweb-edu-classifier
huggingface.co
https://huggingface.co/pricing
huggingface.co
https://ai.google.dev/pricing
ai.google.dev
https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/blog/modernbert/modernbert_accuracy_table.png
huggingface.co
https://www.kaggle.com/
kaggle.com
https://huggingface.co/microsoft/deberta-v3-base
huggingface.co
https://huggingface.co/nomic-ai/nomic-bert-2048
huggingface.co
https://huggingface.co/Alibaba-NLP/gte-en-mlm-base
huggingface.co
https://huggingface.co/colbert-ir/colbertv2.0
huggingface.co
https://www.kaggle.com/datasets/imoore/60k-stack-overflow-questions-with-quality-rate
kaggle.com
https://github.com/AnswerDotAI/ModernBERT/tree/main/examples
github.com
https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/blog/modernbert/modernbert_efficiency_table.png
huggingface.co
https://github.com/facebookresearch/xformers
github.com
https://github.com/Dao-AILab/flash-attention
github.com
https://huggingface.co/albert/albert-base-v2
huggingface.co
https://arxiv.org/abs/2312.00752
arxiv.org
https://arxiv.org/abs/2307.09288
arxiv.org
You could have designed state of the art positional encoding Read at the source ↗
huggingface.co
https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/blog/modernbert/modernbert_alternating_attention.png
huggingface.co
https://arxiv.org/abs/2109.10686
arxiv.org
https://arxiv.org/abs/2401.14489
arxiv.org
https://media1.tenor.com/m/xJSM2Ky3WpgAAAAd/steve-ballmer-microsoft.gif
media1.tenor.com
https://arxiv.org/abs/2410.02660
arxiv.org
https://arxiv.org/abs/2304.01373
arxiv.org
https://azure.microsoft.com/en-us/products/phi
azure.microsoft.com
https://huggingface.co/docs/transformers/en/index
huggingface.co
https://github.com/urchade/GLiNER
github.com
https://sbert.net/
sbert.net
https://huggingface.co/answerdotai/ModernBERT-base
huggingface.co
https://huggingface.co/answerdotai/ModernBERT-large
huggingface.co
https://arxiv.org/abs/2412.13663
arxiv.org
https://huggingface.co/docs/transformers/main/en/model_doc/modernbert
huggingface.co
Training and Finetuning Embedding Models with Sentence Transformers Read at the source ↗
huggingface.co
Training and Finetuning Reranker Models with Sentence Transformers Read at the source ↗
huggingface.co
Training and Finetuning Sparse Embedding Models with Sentence Transformers Read at the source ↗
huggingface.co