# javirandor/anthropic-tokenizer

<https://repo.masters-masters.com/en/repos/javirandor/anthropic-tokenizer>

[Home](https://repo.masters-masters.com/en) › [javirandor](https://repo.masters-masters.com/en/owners/javirandor) › [anthropic-tokenizer](https://repo.masters-masters.com/en/repos/javirandor/anthropic-tokenizer)

javirandor/anthropic-tokenizer has 173 stars on GitHub. Its RepoMasters card: Prototype tier. Approximation of the Claude 3 tokenizer by inspecting generation…

| Field | Value |
| --- | --- |
| Owner | [javirandor](https://repo.masters-masters.com/en/owners/javirandor) |
| Stars | 173 |
| Forks | 9 |
| Language | [Python](https://repo.masters-masters.com/en/languages/python) |
| License | MIT |
| Created | 2024 |
| Tier | [Prototype (100 to 249 ★)](https://repo.masters-masters.com/en/ranks/rush) |
| View on GitHub | [javirandor/anthropic-tokenizer](https://github.com/javirandor/anthropic-tokenizer) |

## Repository

Approximation of the Claude 3 tokenizer by inspecting generation stream

The tier for repos with 100 to 249 ★. Published odds per card pulled: 70%. Rarity: Common.

## More repos by javirandor

- [javirandor/passgpt · ★ 101 · Python · Prototype](https://repo.masters-masters.com/en/repos/javirandor/passgpt)

## Nearby in Python

- [pretend1111/inko-skill · ★ 173 · Python · Prototype](https://repo.masters-masters.com/en/repos/pretend1111/inko-skill)
- [SupraGSX/Forceware-382.69 · ★ 173 · Python · Prototype](https://repo.masters-masters.com/en/repos/SupraGSX/Forceware-382.69)
- [Open-RUA/uni-robot-agent · ★ 173 · Python · Prototype](https://repo.masters-masters.com/en/repos/Open-RUA/uni-robot-agent)
- [zohmg/zohmg · ★ 173 · Python · Prototype](https://repo.masters-masters.com/en/repos/zohmg/zohmg)
- [tstone/django-uploadify · ★ 173 · Python · Prototype](https://repo.masters-masters.com/en/repos/tstone/django-uploadify)
- [astraw/svg\_stack · ★ 173 · Python · Prototype](https://repo.masters-masters.com/en/repos/astraw/svg_stack)

---
Data: GitHub · Illustration drawn by RepoMasters from the repo’s ID and its language color.