# zurawiki/tiktoken-rs

<https://repo.masters-masters.com/en/repos/zurawiki/tiktoken-rs>

[Home](https://repo.masters-masters.com/en) › [zurawiki](https://repo.masters-masters.com/en/owners/zurawiki) › [tiktoken-rs](https://repo.masters-masters.com/en/repos/zurawiki/tiktoken-rs)

zurawiki/tiktoken-rs has 409 stars on GitHub. Its RepoMasters card: Alpha tier. Ready-made tokenizer library for working with GPT and tiktoken Language: Rust.

| Field | Value |
| --- | --- |
| Owner | [zurawiki](https://repo.masters-masters.com/en/owners/zurawiki) |
| Stars | 409 |
| Forks | 76 |
| Language | [Rust](https://repo.masters-masters.com/en/languages/rust) |
| License | MIT |
| Created | 2023 |
| Topics | bpe, openai, rust, tokenizer |
| Tier | [Alpha (250 to 699 ★)](https://repo.masters-masters.com/en/ranks/b_movie) |
| View on GitHub | [zurawiki/tiktoken-rs](https://github.com/zurawiki/tiktoken-rs) |

## Repository

Ready-made tokenizer library for working with GPT and tiktoken

The tier for repos with 250 to 699 ★. Published odds per card pulled: 20%. Rarity: Uncommon.

## More repos by zurawiki

- [zurawiki/gptcommit · ★ 2,415 · Rust · RC](https://repo.masters-masters.com/en/repos/zurawiki/gptcommit)

## Nearby in Rust

- [eltavine/Duck-ToolBox · ★ 409 · Rust · Alpha](https://repo.masters-masters.com/en/repos/eltavine/Duck-ToolBox)
- [kookoo1sabzy/BaleVPN · ★ 409 · Rust · Alpha](https://repo.masters-masters.com/en/repos/kookoo1sabzy/BaleVPN)
- [namannn04/Veronica · ★ 409 · Rust · Alpha](https://repo.masters-masters.com/en/repos/namannn04/Veronica)
- [koute/speedy · ★ 409 · Rust · Alpha](https://repo.masters-masters.com/en/repos/koute/speedy)
- [streamnative/pulsar-rs · ★ 409 · Rust · Alpha](https://repo.masters-masters.com/en/repos/streamnative/pulsar-rs)
- [bearcove/rc-zip · ★ 409 · Rust · Alpha](https://repo.masters-masters.com/en/repos/bearcove/rc-zip)

---
Data: GitHub · Illustration drawn by RepoMasters from the repo’s ID and its language color.