corpus.blog
43,029 blogs · 5,458,805 posts Claim your blog
Record · corpus.blog/posts/01a0c54c-232e-7169-a645-efd070cd2171

Building Nemotron-CC, A High-Quality Trillion Token Dataset for LLM Pretraining from Common Crawl Using NVIDIA NeMo Curator

NVIDIA Developer Blog · published 7 May 2025

A record is what was published and who pointed at it. The text of the post is not held here: read it at the source, or at its Wayback capture.

Read the post at developer.nvidia.com Wayback capture
0blogs citing
First cited
—
Most recent
—
Rank this month
not ranked
External links
15
Words captured
1,413

Cited by

No blog we hold has cited this post yet.

Links from this post

Link
Host
https://www.nvidia.com/en-us/glossary/large-language-models/
nvidia.com
https://github.com/NVIDIA/NeMo-Curator/tree/main/tutorials/nemotron-cc
github.com
https://paperswithcode.com/dataset/mmlu
paperswithcode.com
https://commoncrawl.org/
commoncrawl.org
https://github.com/miso-belica/jusText
github.com
https://fasttext.cc/docs/en/language-identification.html
fasttext.cc
https://docs.nvidia.com/nemo-framework/user-guide/latest/datacuration/gpudeduplication.html
docs.nvidia.com
http://www.dask.org
dask.org
https://huggingface.co/edugp/kenlm
huggingface.co
https://huggingface.co/mlfoundations/fasttext-oh-eli5
huggingface.co
https://huggingface.co/nvidia/nemocurator-fineweb-mixtral-edu-classifier
huggingface.co
https://huggingface.co/nvidia/nemocurator-fineweb-nemotron-4-edu-classifier
huggingface.co
https://arxiv.org/pdf/2412.02595
arxiv.org
https://github.com/NVIDIA/NeMo-Curator/tree/main
github.com
https://github.com/NVIDIA/NeMo-Curator
github.com
Elsewhere on developer.nvidia.com (2)