# NLPOptimize/flash-tokenizer

<https://repo.masters-masters.com/en/repos/NLPOptimize/flash-tokenizer>

[Home](https://repo.masters-masters.com/en) › [NLPOptimize](https://repo.masters-masters.com/en/owners/NLPOptimize) › [flash-tokenizer](https://repo.masters-masters.com/en/repos/NLPOptimize/flash-tokenizer)

NLPOptimize/flash-tokenizer has 457 stars on GitHub. Its RepoMasters card: Alpha tier. EFFICIENT AND OPTIMIZED TOKENIZER ENGINE FOR LLM INFERENCE SERVING

| Field | Value |
| --- | --- |
| Owner | [NLPOptimize](https://repo.masters-masters.com/en/owners/NLPOptimize) |
| Stars | 457 |
| Forks | 11 |
| Language | [C++](https://repo.masters-masters.com/en/languages/c-plus-plus) |
| License | None |
| Created | 2025 |
| Topics | deep-learning, nlp, python, berttokenizer, flash, wordpiece, wordpiece-tokenization, cpp, cpp17, tokenizer |
| Tier | [Alpha (250 to 699 ★)](https://repo.masters-masters.com/en/ranks/b_movie) |
| View on GitHub | [NLPOptimize/flash-tokenizer](https://github.com/NLPOptimize/flash-tokenizer) |

## Repository

EFFICIENT AND OPTIMIZED TOKENIZER ENGINE FOR LLM INFERENCE SERVING

The tier for repos with 250 to 699 ★. Published odds per card pulled: 20%. Rarity: Uncommon.

## Nearby in C++

- [Taeyoung96/GRIL-Calib · ★ 457 · C++ · Alpha](https://repo.masters-masters.com/en/repos/Taeyoung96/GRIL-Calib)
- [Zydak/Vulkan-Path-Tracer · ★ 457 · C++ · Alpha](https://repo.masters-masters.com/en/repos/Zydak/Vulkan-Path-Tracer)
- [Michael-Manning/E-Paper-Climate-Logger · ★ 457 · C++ · Alpha](https://repo.masters-masters.com/en/repos/Michael-Manning/E-Paper-Climate-Logger)
- [qtinuum/QtnProperty · ★ 457 · C++ · Alpha](https://repo.masters-masters.com/en/repos/qtinuum/QtnProperty)
- [marbl/Mash · ★ 457 · C++ · Alpha](https://repo.masters-masters.com/en/repos/marbl/Mash)
- [deepsense-ai/roi-pooling · ★ 457 · C++ · Alpha](https://repo.masters-masters.com/en/repos/deepsense-ai/roi-pooling)

---
Data: GitHub · Illustration drawn by RepoMasters from the repo’s ID and its language color.