corpus.blog
41554 blogs · 4,504,310 posts Claim your blog
Record · corpus.blog/posts/01a08c65-d521-7375-9c07-52c0699d806a

Mask Your User Tokens

yonigottesman.github.io · published 13 May 2024

A record is what was published and who pointed at it. The text of the post is not held here: read it at the source, or at its Wayback capture.

Read the post at yonigottesman.github.io Wayback capture
0blogs citing
First cited
—
Most recent
—
Rank this month
not ranked
Links from this post
16
Words captured
1,622

Cited by

No blog we hold has cited this post yet.

Links from this post

Link
Host
https://github.com/yonigottesman/broken_chat_formatting
github.com
https://huggingface.co/datasets/Universal-NER/Pile-NER-type
huggingface.co
https://huggingface.co/docs/transformers/en/chat_templating
huggingface.co
https://huggingface.co/docs/transformers/en/main_classes/tokenizer
huggingface.co
https://github.com/huggingface/alignment-handbook/blob/main/scripts/run_sft.py
github.com
https://github.com/NielsRogge/Transformers-Tutorials/blob/master/Mistral/Supervised_fine_tuning_(SFT
github.com
https://github.com/mlabonne/llm-course/blob/main/Fine_tune_Llama_2_in_Google_Colab.ipynb
github.com
https://github.com/huggingface/transformers/blob/v4.40.2/src/transformers/models/gemma/modeling_gemma.py
github.com
https://github.com/huggingface/transformers/blob/v4.40.2/src/transformers/data/data_collator.py
github.com
https://github.com/huggingface/trl/blob/main/trl/trainer/utils.py
github.com
https://github.com/huggingface/trl/blob/v0.8.6/trl/trainer/utils.py
github.com
https://huggingface.co/datasets/HuggingFaceH4/deita-10k-v0-sft
huggingface.co
https://github.com/huggingface/autotrain-advanced
github.com
https://github.com/huggingface/autotrain-advanced/blob/9c2c7b56eb2704ac16f4923d723b89b7c5364238/src/autotrain/trainers/clm/utils.py
github.com
https://github.com/meta-llama/llama-recipes/blob/main/recipes/finetuning/datasets/custom_dataset.py
github.com
https://github.com/lm-sys/FastChat/blob/922a78ba61c7def4682aa42c914adbdedbf3ac2f/fastchat/train/train.py
github.com