Illustration: the project’s public image, pixelated by RepoMasters. Credits
StableVery rare

openai/tiktoken

tiktoken is a fast BPE tokeniser for use with OpenAI's models.

Owner
openai (organization)
Stars
Stars: 19,580
Forks
Forks: 1,664
Language
Python
License
MIT
Created
2022
Tier
Stable (5,000 to 19,999 ★) What this tier means
View on GitHub

More repos by openai

All 187 repos by openai

Nearby in Python

All Python repos