StableVery rare
huggingface/tokenizers
💥 Fast State-of-the-Art Tokenizers optimized for Research and Production
- Owner
- huggingface (organization)
- Stars
- Stars: 11,217
- Forks
- Forks: 1,244
- Language
- Rust
- License
- Apache-2.0
- Created
- 2019
- Topics
- nlpnatural-language-processingnatural-language-understandinglanguage-modeltransformersbertgpt
- Tier
- Stable (5,000 to 19,999 ★) What this tier means
More repos by huggingface
All 181 repos by huggingface- huggingface/transformersStars: 168,432PythonLTS
- huggingface/pytorch-image-modelsStars: 37,263PythonLTS
- huggingface/diffusersStars: 34,848PythonLTS
- huggingface/agents-courseStars: 34,320MDXLTS
- huggingface/smolagentsStars: 30,182PythonLTS
- huggingface/lerobotStars: 28,638PythonLTS
Nearby in Rust
All Rust repos- ekzhang/boreStars: 11,571RustStable
- Nasiko-Labs/nasikoStars: 11,445RustStable
- perspective-dev/perspectiveStars: 11,382RustStable
- QuipNetwork/hashsigs-rsStars: 11,206RustStable
- dmtrKovalenko/fffStars: 11,200RustStable
- storytold/vectorcraftStars: 11,200RustStable