BetaRare
niieani/gpt-tokenizer
The fastest JavaScript BPE Tokenizer Encoder Decoder for OpenAI's GPT models (gpt-5, gpt-o*, gpt-4o, etc.). Port of OpenAI's tiktoken with additional features.
- Owner
- niieani (personal account)
- Stars
- Stars: 857
- Forks
- Forks: 66
- Language
- TypeScript
- License
- MIT
- Created
- 2023
- Topics
- bpegpt-2gpt-3machine-learninggpt-4tokenizerdecoderencoderopenaigpt-4o
- Tier
- Beta (700 to 1,999 ★) What this tier means
More repos by niieani
All 4 repos by niieani- niieani/bash-oo-frameworkStars: 5,620ShellStable
- niieani/hashids.jsStars: 4,283TypeScriptRC
- niieani/typescript-vs-flowtypeStars: 1,725Beta
Nearby in TypeScript
All TypeScript repos- protomaps/protomaps-leafletStars: 857TypeScriptBeta
- skymethod/denoflareStars: 857TypeScriptBeta
- openai/build-hoursStars: 857TypeScriptBeta