AlphaUncommon
NLPOptimize/flash-tokenizer
EFFICIENT AND OPTIMIZED TOKENIZER ENGINE FOR LLM INFERENCE SERVING
- Owner
- NLPOptimize (organization)
- Stars
- Stars: 457
- Forks
- Forks: 11
- Language
- C++
- License
- None
- Created
- 2025
- Topics
- deep-learningnlppythonberttokenizerflashwordpiecewordpiece-tokenizationcppcpp17tokenizer
- Tier
- Alpha (250 to 699 ★) What this tier means
Nearby in C++
All C++ repos- Taeyoung96/GRIL-CalibStars: 457C++Alpha
- Zydak/Vulkan-Path-TracerStars: 457C++Alpha
- Michael-Manning/E-Paper-Climate-LoggerStars: 457C++Alpha
- qtinuum/QtnPropertyStars: 457C++Alpha
- marbl/MashStars: 457C++Alpha
- deepsense-ai/roi-poolingStars: 457C++Alpha