41554 blogs · 4,417,066 posts Claim your blog

Record · corpus.blog/posts/01a08c5d-689b-73f2-be21-b51496c04a9b

Can Tokenizer Changes Affect LLM Output?

vincentschmalbach.com · published 11 August 2026

A record is what was published and who pointed at it. The text of the post is not held here: read it at the source, or at its Wayback capture.

Read the post at vincentschmalbach.com Wayback capture

0blogs citing

First cited: —
Most recent: —
Rank this month: not ranked
Links from this post: 14
Words captured: 2,971

Cited by

No blog we hold has cited this post yet.

Links from this post

Link

Host

https://huggingface.co/docs/tokenizers/python/latest/api/reference.html

huggingface.co

https://github.com/google/sentencepiece/blob/master/python/README.md

github.com

https://huggingface.co/docs/transformers/main_classes/tokenizer

huggingface.co

https://aclanthology.org/2024.conll-1.8

aclanthology.org

https://github.com/google/sentencepiece

github.com

https://aclanthology.org/2024.findings-naacl.247

aclanthology.org

https://aclanthology.org/2025.findings-acl.572

aclanthology.org

https://huggingface.co/docs/transformers/v4.34.0/en/chat_templating

huggingface.co

https://huggingface.co/docs/transformers/main/chat_template_advanced

huggingface.co

https://huggingface.co/docs/transformers/v4.44.0/chat_templating

huggingface.co

https://aclanthology.org/2024.findings-acl.134

aclanthology.org

https://aclanthology.org/2025.acl-long.1546

aclanthology.org

https://aclanthology.org/2023.findings-acl.350

aclanthology.org

https://proceedings.mlr.press/v235/dagan24a.html

proceedings.mlr.press