Illustration drawn by RepoMasters from the repo’s ID and its language color. Credits
StableVery rare

karpathy/minbpe

Minimal, clean code for the Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization.

Owner
karpathy (personal account)
Stars
Stars: 10,999
Forks
Forks: 1,149
Language
Python
License
MIT
Created
2024
Tier
Stable (5,000 to 19,999 ★) What this tier means
View on GitHub

More repos by karpathy

All 51 repos by karpathy

Nearby in Python

All Python repos