# mlc-ai/tokenizers-cpp

<https://repo.masters-masters.com/en/repos/mlc-ai/tokenizers-cpp>

[Home](https://repo.masters-masters.com/en) › [mlc-ai](https://repo.masters-masters.com/en/owners/mlc-ai) › [tokenizers-cpp](https://repo.masters-masters.com/en/repos/mlc-ai/tokenizers-cpp)

mlc-ai/tokenizers-cpp has 513 stars on GitHub. Its RepoMasters card: Alpha tier. Universal cross-platform tokenizers binding to HF and sentencepiece

| Field | Value |
| --- | --- |
| Owner | [mlc-ai](https://repo.masters-masters.com/en/owners/mlc-ai) |
| Stars | 513 |
| Forks | 131 |
| Language | [C++](https://repo.masters-masters.com/en/languages/c-plus-plus) |
| License | Apache-2.0 |
| Created | 2023 |
| Tier | [Alpha (250 to 699 ★)](https://repo.masters-masters.com/en/ranks/b_movie) |
| View on GitHub | [mlc-ai/tokenizers-cpp](https://github.com/mlc-ai/tokenizers-cpp) |

## Repository

Universal cross-platform tokenizers binding to HF and sentencepiece

The tier for repos with 250 to 699 ★. Published odds per card pulled: 20%. Rarity: Uncommon.

## More repos by mlc-ai

- [mlc-ai/mlc-llm · ★ 23,291 · Python · LTS](https://repo.masters-masters.com/en/repos/mlc-ai/mlc-llm)
- [mlc-ai/web-llm · ★ 19,346 · TypeScript · Stable](https://repo.masters-masters.com/en/repos/mlc-ai/web-llm)
- [mlc-ai/web-stable-diffusion · ★ 3,732 · Jupyter Notebook · RC](https://repo.masters-masters.com/en/repos/mlc-ai/web-stable-diffusion)
- [mlc-ai/xgrammar · ★ 1,987 · Python · Beta](https://repo.masters-masters.com/en/repos/mlc-ai/xgrammar)
- [mlc-ai/modern-gpu-programming-for-mlsys · ★ 1,378 · HTML · Beta](https://repo.masters-masters.com/en/repos/mlc-ai/modern-gpu-programming-for-mlsys)
- [mlc-ai/web-llm-chat · ★ 1,133 · TypeScript · Beta](https://repo.masters-masters.com/en/repos/mlc-ai/web-llm-chat)

## Nearby in C++

- [JonET/monksynth · ★ 513 · C++ · Alpha](https://repo.masters-masters.com/en/repos/JonET/monksynth)
- [keepvaibin/nebula · ★ 513 · C++ · Alpha](https://repo.masters-masters.com/en/repos/keepvaibin/nebula)
- [cutetailbud/ff-ruyijs · ★ 513 · C++ · Alpha](https://repo.masters-masters.com/en/repos/cutetailbud/ff-ruyijs)
- [k3ng/k3ng\_cw\_keyer · ★ 513 · C++ · Alpha](https://repo.masters-masters.com/en/repos/k3ng/k3ng_cw_keyer)
- [klmr/named-operator · ★ 513 · C++ · Alpha](https://repo.masters-masters.com/en/repos/klmr/named-operator)
- [ahodesuka/ahoviewer · ★ 513 · C++ · Alpha](https://repo.masters-masters.com/en/repos/ahodesuka/ahoviewer)

---
Data: GitHub · Illustration drawn by RepoMasters from the repo’s ID and its language color.