AlphaUncommon
zurawiki/tiktoken-rs
Ready-made tokenizer library for working with GPT and tiktoken
- Owner
- zurawiki (personal account)
- Stars
- Stars: 409
- Forks
- Forks: 76
- Language
- Rust
- License
- MIT
- Created
- 2023
- Topics
- bpeopenairusttokenizer
- Tier
- Alpha (250 to 699 ★) What this tier means
More repos by zurawiki
All 2 repos by zurawiki- zurawiki/gptcommitStars: 2,415RustRC
Nearby in Rust
All Rust repos- eltavine/Duck-ToolBoxStars: 409RustAlpha
- kookoo1sabzy/BaleVPNStars: 409RustAlpha
- namannn04/VeronicaStars: 409RustAlpha
- koute/speedyStars: 409RustAlpha
- streamnative/pulsar-rsStars: 409RustAlpha
- bearcove/rc-zipStars: 409RustAlpha