# daulet/tokenizers

<https://repo.masters-masters.com/en/repos/daulet/tokenizers>

[Home](https://repo.masters-masters.com/en) › [daulet](https://repo.masters-masters.com/en/owners/daulet) › [tokenizers](https://repo.masters-masters.com/en/repos/daulet/tokenizers)

daulet/tokenizers has 229 stars on GitHub. Its RepoMasters card: Prototype tier. Go, Wasm bindings for HF Tokenizers and Tiktoken Language: Rust.

| Field | Value |
| --- | --- |
| Owner | [daulet](https://repo.masters-masters.com/en/owners/daulet) |
| Stars | 229 |
| Forks | 43 |
| Language | [Rust](https://repo.masters-masters.com/en/languages/rust) |
| License | MIT |
| Created | 2023 |
| Topics | go, huggingface-tokenizers, openai-tokenizer, tokenizer, wasm |
| Tier | [Prototype (100 to 249 ★)](https://repo.masters-masters.com/en/ranks/rush) |
| View on GitHub | [daulet/tokenizers](https://github.com/daulet/tokenizers) |

## Repository

Go, Wasm bindings for HF Tokenizers and Tiktoken

The tier for repos with 100 to 249 ★. Published odds per card pulled: 70%. Rarity: Common.

## Nearby in Rust

- [unhappychoice/splashboard · ★ 229 · Rust · Prototype](https://repo.masters-masters.com/en/repos/unhappychoice/splashboard)
- [RoversX/ThinkTerm · ★ 229 · Rust · Prototype](https://repo.masters-masters.com/en/repos/RoversX/ThinkTerm)
- [ctdoteam1110/ctdozlite · ★ 229 · Rust · Prototype](https://repo.masters-masters.com/en/repos/ctdoteam1110/ctdozlite)
- [kubo/rust-oracle · ★ 229 · Rust · Prototype](https://repo.masters-masters.com/en/repos/kubo/rust-oracle)
- [dtolnay/ref-cast · ★ 229 · Rust · Prototype](https://repo.masters-masters.com/en/repos/dtolnay/ref-cast)
- [openethereum/pwasm-tutorial · ★ 229 · Rust · Prototype](https://repo.masters-masters.com/en/repos/openethereum/pwasm-tutorial)

---
Data: GitHub · Illustration drawn by RepoMasters from the repo’s ID and its language color.