Illustration drawn by RepoMasters from the repo’s ID and its language color. Credits
PrototypeCommon

javirandor/anthropic-tokenizer

Approximation of the Claude 3 tokenizer by inspecting generation stream

Owner
javirandor (personal account)
Stars
Stars: 173
Forks
Forks: 9
Language
Python
License
MIT
Created
2024
Tier
Prototype (100 to 249 ★) What this tier means
View on GitHub

More repos by javirandor

All 2 repos by javirandor

Nearby in Python

All Python repos