Skip to content
corpus.blog
Sign in Claim your blog
Record · github.com

Tiktoken

https://github.com/openai/tiktoken

github.com

A page on github.com is cited by 61 distinct blogs to date (corpus.blog, measured 11 October 2026).

A record is what was published and who pointed at it. corpus.blog does not hold this page: read it at the source, or at its Wayback capture.

Read at github.com (opens in a new tab) Wayback capture (opens in a new tab)

61blogs citing

Citing blogs and links by period
Period Blogs Links
All time6166
Last 90 days1213
Last 30 days66
Last 7 days22
Figures for this page
First cited22 Nov 2022
Latest citation8 Oct 2026
Words blogs link it with5
Linked with its own title47 of 61 blogs
New citing blogs a weeksince Nov 2022
New citing blogs a week, since Nov 2022: 203 weeks, peak 3 a week, latest week 2

2 this week (still settling) · peak 3

Show as table
New citing blogs a week, week by week
Week of Value
21 Nov 20221
28 Nov 20220
5 Dec 20220
12 Dec 20220
19 Dec 20220
26 Dec 20220
2 Jan 20230
9 Jan 20230
16 Jan 20230
23 Jan 20230
30 Jan 20230
6 Feb 20230
13 Feb 20230
20 Feb 20230
27 Feb 20230
6 Mar 20230
13 Mar 20230
20 Mar 20230
27 Mar 20231
3 Apr 20230
10 Apr 20230
17 Apr 20230
24 Apr 20231
1 May 20230
8 May 20231
15 May 20230
22 May 20230
29 May 20230
5 Jun 20230
12 Jun 20230
19 Jun 20230
26 Jun 20231
3 Jul 20230
10 Jul 20231
17 Jul 20232
24 Jul 20230
31 Jul 20230
7 Aug 20231
14 Aug 20230
21 Aug 20230
28 Aug 20230
4 Sept 20230
11 Sept 20231
18 Sept 20230
25 Sept 20231
2 Oct 20230
9 Oct 20230
16 Oct 20231
23 Oct 20230
30 Oct 20230
6 Nov 20230
13 Nov 20230
20 Nov 20230
27 Nov 20230
4 Dec 20230
11 Dec 20230
18 Dec 20230
25 Dec 20230
1 Jan 20240
8 Jan 20241
15 Jan 20240
22 Jan 20240
29 Jan 20240
5 Feb 20240
12 Feb 20240
19 Feb 20240
26 Feb 20241
4 Mar 20240
11 Mar 20241
18 Mar 20240
25 Mar 20241
1 Apr 20241
8 Apr 20240
15 Apr 20240
22 Apr 20240
29 Apr 20240
6 May 20240
13 May 20240
20 May 20240
27 May 20240
3 Jun 20240
10 Jun 20240
17 Jun 20240
24 Jun 20240
1 Jul 20240
8 Jul 20240
15 Jul 20240
22 Jul 20240
29 Jul 20240
5 Aug 20240
12 Aug 20240
19 Aug 20240
26 Aug 20240
2 Sept 20240
9 Sept 20240
16 Sept 20240
23 Sept 20240
30 Sept 20241
7 Oct 20240
14 Oct 20240
21 Oct 20241
28 Oct 20241
4 Nov 20240
11 Nov 20241
18 Nov 20240
25 Nov 20240
2 Dec 20240
9 Dec 20240
16 Dec 20240
23 Dec 20240
30 Dec 20240
6 Jan 20250
13 Jan 20251
20 Jan 20250
27 Jan 20251
3 Feb 20250
10 Feb 20250
17 Feb 20250
24 Feb 20250
3 Mar 20250
10 Mar 20250
17 Mar 20250
24 Mar 20250
31 Mar 20250
7 Apr 20250
14 Apr 20250
21 Apr 20250
28 Apr 20250
5 May 20250
12 May 20250
19 May 20250
26 May 20250
2 Jun 20250
9 Jun 20251
16 Jun 20250
23 Jun 20250
30 Jun 20250
7 Jul 20250
14 Jul 20250
21 Jul 20252
28 Jul 20250
4 Aug 20250
11 Aug 20250
18 Aug 20250
25 Aug 20250
1 Sept 20251
8 Sept 20251
15 Sept 20250
22 Sept 20250
29 Sept 20250
6 Oct 20251
13 Oct 20252
20 Oct 20251
27 Oct 20250
3 Nov 20250
10 Nov 20250
17 Nov 20250
24 Nov 20250
1 Dec 20250
8 Dec 20250
15 Dec 20251
22 Dec 20251
29 Dec 20250
5 Jan 20260
12 Jan 20261
19 Jan 20260
26 Jan 20261
2 Feb 20261
9 Feb 20262
16 Feb 20260
23 Feb 20262
2 Mar 20261
9 Mar 20260
16 Mar 20260
23 Mar 20261
30 Mar 20260
6 Apr 20260
13 Apr 20260
20 Apr 20261
27 Apr 20260
4 May 20261
11 May 20261
18 May 20260
25 May 20260
1 Jun 20260
8 Jun 20260
15 Jun 20260
22 Jun 20260
29 Jun 20260
6 Jul 20260
13 Jul 20260
20 Jul 20261
27 Jul 20262
3 Aug 20260
10 Aug 20261
17 Aug 20261
24 Aug 20260
31 Aug 20261
7 Sept 20260
14 Sept 20260
21 Sept 20261
28 Sept 20263 (still settling)
5 Oct 20262 (still settling)

Shape: evergreen. Half of its 58 citing blogs had cited it after 1,054 days; 79% first cited it more than a year on.

Each blog counts once, in the week of its first citation. 3 blogs have no dated post that cites this page: counted in the tally, not here. A blog added to the index recently can bring old first citations in at once.

Words blogs link it with

The words blogs link this page with, by how many different blogs use them.

  • tiktoken47 blogs
  • openai/tiktoken2 blogs
  • tiktoken library2 blogs
  • tiktoken source code1 blog
  • (opens in new tab)1 blog

Cited by 61 blogs in 66 posts

One row per blog, the most recently citing first. Each shows the blog's newest citing post; open a row for the others.

Blog
Newest citing post
Date
Simon Willison3 posts
ttok 0.4

linked as “tiktoken”

Read at simonwillison.net (opens in a new tab)
8 Oct 2026
2 other posts
llm, ttok and strip-tags—CLI tools for working with ChatGPT and other LLMs

linked as “tiktoken”

Read at simonwillison.net (opens in a new tab)
—
Understanding GPT tokenizers

linked as “tiktoken”

Read at simonwillison.net (opens in a new tab)
—
Hey There Buddo! | Hot Leaves in a Cold Worlds.1 post
Machine Learning Read at philipzucker.com (opens in a new tab)
5 Oct 2026
tej.as1 post
Aleph Alpha Kolibri: How the Sovereign German LLM Works

linked as “tiktoken”

Read at tej.as (opens in a new tab)
3 Oct 2026
serpapi.com1 post
Comparing Markdown Search Results: SerpApi vs. Exa, Tavily, and Firecrawl

linked as “tiktoken”

Read at serpapi.com (opens in a new tab)
1 Oct 2026
dylancastillo.co1 post
Semantic Search with Elasticsearch, OpenAI, and LangChain – Dylan Castillo

linked as “tiktoken”

Read at dylancastillo.co (opens in a new tab)
30 Sept 2026
simmering.dev1 post
Evaluating an LLM for your use case – Paul Simmering

linked as “tiktoken”

Read at simmering.dev (opens in a new tab)
27 Sept 2026
gls2ro2 posts
Tokens, token IDs and array operations in Ruby

linked as “Tiktoken”

Read at allaboutcoding.ghinda.com (opens in a new tab)
9 Sept 2026
1 other post
What the HANDBOOK.md Benchmark Says About Your CLAUDE.md

linked as “tiktoken”

Read at allaboutcoding.ghinda.com (opens in a new tab)
11 Aug 2026
Andrew Healey1 post
What Makes LLM Tokenization Slow?

linked as “tiktoken”

Read at healeycodes.com (opens in a new tab)
2 Sept 2026
leoniemonigatti.com1 post
Easily Estimate Your OpenAI API Costs with Tiktoken – Leonie Monigatti

linked as “tiktoken”

Read at leoniemonigatti.com (opens in a new tab)
23 Aug 2026
hidekazu-konishi.com1 post
Japanese and CJK Text Preprocessing for RAG - Tokenization, Normalization, and Chunk Boundaries | hidekazu-konishi.com

linked as “openai/tiktoken”

Read at hidekazu-konishi.com (opens in a new tab)
2 Aug 2026
Martin Fowler1 post
The Economic Benefit of Refactoring

linked as “tiktoken”

Read at martinfowler.com (opens in a new tab)
30 Jul 2026
From first principles1 post
Building a Toy GPT from Scratch in PyTorch

linked as “tiktoken”

Read at arunkant.com (opens in a new tab)
24 Jul 2026
kshivendu.dev1 post
Token-Native Storage: Read and Write in Your Agent's Language

linked as “tiktoken”

Read at kshivendu.dev (opens in a new tab)
12 May 2026
nitayneeman.com1 post
How AI Works Under the Hood - LLMs Explained with Code

linked as “tiktoken”

Read at nitayneeman.com (opens in a new tab)
5 May 2026
Prakash Suresh | Curious Mind2 posts
How LLMs Get Built

linked as “tiktoken source code”

Read at spraka.sh (opens in a new tab)
28 Apr 2026
1 other post
Understanding LLMs: The Map

linked as “tiktoken source code”

Read at spraka.sh (opens in a new tab)
20 Apr 2026
crutcher.github.io1 post
Wordchipper 0.9: Fastest Gun in the West

linked as “tiktoken”

Read at crutcher.github.io (opens in a new tab)
23 Mar 2026
blog.yellowday.day1 post
GPT-OSS Inference from Scratch

linked as “tiktoken”

Read at blog.yellowday.day (opens in a new tab)
3 Mar 2026
paultendo.github.io1 post
Your LLM reads Unicode codepoints, not glyphs. That's an attack surface.

linked as “tiktoken”

Read at paultendo.github.io (opens in a new tab)
26 Feb 2026
salmanq.com1 post
The Grammar of LLM Special Tokens

linked as “tiktoken”

Read at salmanq.com (opens in a new tab)
24 Feb 2026
metehan.ai1 post
Reverse-Engineering the OpenAI's GPT-5 Tokenizer: What 200,000 Tokens Reveal About AEO/GEO

linked as “tiktoken”

Read at metehan.ai (opens in a new tab)
13 Feb 2026
Andrej Karpathy1 post
microgpt

linked as “tiktoken”

Read at karpathy.github.io (opens in a new tab)
12 Feb 2026
chaliy.name1 post
Rust Is Winning the AI Code Generation Race

linked as “tiktoken”

Read at chaliy.name (opens in a new tab)
7 Feb 2026
djdumpling.github.io1 post
frontier model training methodologies

linked as “o200k_harmony”

Read at djdumpling.github.io (opens in a new tab)
31 Jan 2026
manthanguptaa.in1 post
How To Train Your Own Language Model - Part 1: Tokenization

linked as “Tiktoken Documentation”

Read at manthanguptaa.in (opens in a new tab)
14 Jan 2026
Vicki Boykis1 post
2025 in review

linked as “tiktoken”

Read at vickiboykis.com (opens in a new tab)
22 Dec 2025

Something wrong with this page’s record? Report a problem with Tiktoken